Sep 11 02:52:53.516509 ip-10-0-138-210 systemd[1]: Starting Kubernetes Kubelet... Sep 11 02:52:53.894443 ip-10-0-138-210 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 11 02:52:53.894443 ip-10-0-138-210 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 11 02:52:53.894443 ip-10-0-138-210 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 11 02:52:53.894443 ip-10-0-138-210 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 11 02:52:53.894443 ip-10-0-138-210 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 11 02:52:53.896265 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.896170 2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 11 02:52:53.899846 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.899830 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 11 02:52:53.899893 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.899847 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 11 02:52:53.899893 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.899852 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 11 02:52:53.899893 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.899855 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 11 02:52:53.899893 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.899858 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 11 02:52:53.899893 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.899860 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 11 02:52:53.899893 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.899863 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 11 02:52:53.899893 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.899865 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 11 02:52:53.899893 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.899869 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 11 02:52:53.899893 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.899872 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 11 02:52:53.899893 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.899875 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 11 02:52:53.899893 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.899877 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 11 02:52:53.899893 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.899880 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 11 02:52:53.899893 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.899882 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 11 02:52:53.899893 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.899885 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 11 02:52:53.899893 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.899887 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 11 02:52:53.899893 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.899890 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 11 02:52:53.899893 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.899893 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 11 02:52:53.899893 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.899896 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 11 02:52:53.899893 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.899898 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 11 02:52:53.899893 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.899901 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 11 02:52:53.900418 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.899904 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 11 02:52:53.900418 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.899907 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 11 02:52:53.900418 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.899909 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 11 02:52:53.900418 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.899912 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 11 02:52:53.900418 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.899915 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 11 02:52:53.900418 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.899917 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 11 02:52:53.900418 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.899920 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 11 02:52:53.900418 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.899922 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 11 02:52:53.900418 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.899924 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 11 02:52:53.900418 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.899928 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 11 02:52:53.900418 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.899932 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 11 02:52:53.900418 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.899934 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 11 02:52:53.900418 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.899937 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 11 02:52:53.900418 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.899939 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 11 02:52:53.900418 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.899942 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 11 02:52:53.900418 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.899944 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 11 02:52:53.900418 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.899947 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 11 02:52:53.900418 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.899949 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 11 02:52:53.900418 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.899952 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 11 02:52:53.900418 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.899955 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 11 02:52:53.900904 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.899957 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 11 02:52:53.900904 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.899960 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 11 02:52:53.900904 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.899962 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 11 02:52:53.900904 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.899965 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 11 02:52:53.900904 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.899967 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 11 02:52:53.900904 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.899969 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 11 02:52:53.900904 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.899972 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 11 02:52:53.900904 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.899974 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 11 02:52:53.900904 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.899976 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 11 02:52:53.900904 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.899979 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 11 02:52:53.900904 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.899981 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 11 02:52:53.900904 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.899984 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 11 02:52:53.900904 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.899986 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 11 02:52:53.900904 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.899989 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 11 02:52:53.900904 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.899992 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 11 02:52:53.900904 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.899994 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 11 02:52:53.900904 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.899997 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 11 02:52:53.900904 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.899999 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 11 02:52:53.900904 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900003 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 11 02:52:53.900904 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900007 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 11 02:52:53.901408 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900009 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 11 02:52:53.901408 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900011 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 11 02:52:53.901408 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900014 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 11 02:52:53.901408 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900017 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 11 02:52:53.901408 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900019 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 11 02:52:53.901408 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900022 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 11 02:52:53.901408 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900024 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 11 02:52:53.901408 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900026 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 11 02:52:53.901408 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900029 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 11 02:52:53.901408 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900031 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 11 02:52:53.901408 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900034 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 11 02:52:53.901408 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900036 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 11 02:52:53.901408 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900039 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 11 02:52:53.901408 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900041 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 11 02:52:53.901408 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900044 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 11 02:52:53.901408 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900046 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 11 02:52:53.901408 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900048 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 11 02:52:53.901408 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900051 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 11 02:52:53.901408 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900053 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 11 02:52:53.901408 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900056 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 11 02:52:53.901878 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900058 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 11 02:52:53.901878 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900060 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 11 02:52:53.901878 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900063 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 11 02:52:53.901878 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900065 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 11 02:52:53.901878 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900068 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 11 02:52:53.901878 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900071 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 11 02:52:53.901878 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900074 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 11 02:52:53.901878 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900076 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 11 02:52:53.901878 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900080 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 11 02:52:53.901878 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900082 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 11 02:52:53.901878 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900085 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 11 02:52:53.901878 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900088 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 11 02:52:53.901878 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900090 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 11 02:52:53.901878 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900094 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 11 02:52:53.901878 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900098 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 11 02:52:53.901878 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900101 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 11 02:52:53.901878 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900105 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 11 02:52:53.901878 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900108 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 11 02:52:53.902323 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900775 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 11 02:52:53.902323 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900781 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 11 02:52:53.902323 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900784 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 11 02:52:53.902323 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900788 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 11 02:52:53.902323 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900791 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 11 02:52:53.902323 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900794 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 11 02:52:53.902323 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900797 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 11 02:52:53.902323 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900799 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 11 02:52:53.902323 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900802 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 11 02:52:53.902323 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900805 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 11 02:52:53.902323 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900807 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 11 02:52:53.902323 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900809 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 11 02:52:53.902323 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900812 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 11 02:52:53.902323 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900815 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 11 02:52:53.902323 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900817 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 11 02:52:53.902323 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900820 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 11 02:52:53.902323 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900823 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 11 02:52:53.902323 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900825 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 11 02:52:53.902323 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900827 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 11 02:52:53.902323 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900830 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 11 02:52:53.902816 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900833 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 11 02:52:53.902816 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900836 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 11 02:52:53.902816 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900838 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 11 02:52:53.902816 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900841 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 11 02:52:53.902816 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900844 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 11 02:52:53.902816 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900846 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 11 02:52:53.902816 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900849 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 11 02:52:53.902816 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900851 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 11 02:52:53.902816 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900854 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 11 02:52:53.902816 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900856 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 11 02:52:53.902816 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900859 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 11 02:52:53.902816 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900861 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 11 02:52:53.902816 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900864 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 11 02:52:53.902816 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900866 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 11 02:52:53.902816 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900869 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 11 02:52:53.902816 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900872 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 11 02:52:53.902816 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900875 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 11 02:52:53.902816 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900877 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 11 02:52:53.902816 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900880 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 11 02:52:53.902816 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900883 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 11 02:52:53.903321 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900885 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 11 02:52:53.903321 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900887 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 11 02:52:53.903321 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900890 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 11 02:52:53.903321 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900892 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 11 02:52:53.903321 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900895 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 11 02:52:53.903321 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900897 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 11 02:52:53.903321 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900900 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 11 02:52:53.903321 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900902 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 11 02:52:53.903321 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900905 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 11 02:52:53.903321 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900908 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 11 02:52:53.903321 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900911 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 11 02:52:53.903321 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900913 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 11 02:52:53.903321 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900916 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 11 02:52:53.903321 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900918 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 11 02:52:53.903321 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900920 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 11 02:52:53.903321 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900923 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 11 02:52:53.903321 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900926 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 11 02:52:53.903321 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900928 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 11 02:52:53.903321 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900930 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 11 02:52:53.903321 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900933 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 11 02:52:53.903815 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900935 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 11 02:52:53.903815 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900938 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 11 02:52:53.903815 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900941 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 11 02:52:53.903815 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900945 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 11 02:52:53.903815 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900947 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 11 02:52:53.903815 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900950 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 11 02:52:53.903815 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900952 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 11 02:52:53.903815 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900955 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 11 02:52:53.903815 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900957 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 11 02:52:53.903815 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900960 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 11 02:52:53.903815 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900962 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 11 02:52:53.903815 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900965 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 11 02:52:53.903815 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900968 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 11 02:52:53.903815 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900970 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 11 02:52:53.903815 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900972 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 11 02:52:53.903815 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900975 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 11 02:52:53.903815 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900979 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 11 02:52:53.903815 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900983 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 11 02:52:53.903815 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900985 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 11 02:52:53.903815 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900988 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 11 02:52:53.904324 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900992 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 11 02:52:53.904324 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900995 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 11 02:52:53.904324 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.900998 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 11 02:52:53.904324 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901001 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 11 02:52:53.904324 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901004 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 11 02:52:53.904324 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901007 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 11 02:52:53.904324 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901009 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 11 02:52:53.904324 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901012 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 11 02:52:53.904324 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901015 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 11 02:52:53.904324 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901018 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 11 02:52:53.904324 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901020 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 11 02:52:53.904324 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901023 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 11 02:52:53.904324 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901026 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 11 02:52:53.904324 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901029 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 11 02:52:53.904324 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901031 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 11 02:52:53.904324 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901034 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 11 02:52:53.904324 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901038 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 11 02:52:53.904324 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901042 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 11 02:52:53.904324 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901044 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 11 02:52:53.904787 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901429 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 11 02:52:53.904787 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901435 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 11 02:52:53.904787 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901438 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 11 02:52:53.904787 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901440 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 11 02:52:53.904787 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901443 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 11 02:52:53.904787 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901446 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 11 02:52:53.904787 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901448 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 11 02:52:53.904787 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901451 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 11 02:52:53.904787 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901454 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 11 02:52:53.904787 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901457 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 11 02:52:53.904787 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901459 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 11 02:52:53.904787 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901462 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 11 02:52:53.904787 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901464 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 11 02:52:53.904787 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901467 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 11 02:52:53.904787 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901471 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 11 02:52:53.904787 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901475 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 11 02:52:53.904787 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901478 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 11 02:52:53.904787 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901481 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 11 02:52:53.904787 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901484 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 11 02:52:53.904787 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901486 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 11 02:52:53.905286 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901489 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 11 02:52:53.905286 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901492 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 11 02:52:53.905286 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901494 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 11 02:52:53.905286 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901497 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 11 02:52:53.905286 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901499 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 11 02:52:53.905286 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901502 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 11 02:52:53.905286 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901504 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 11 02:52:53.905286 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901506 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 11 02:52:53.905286 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901509 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 11 02:52:53.905286 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901512 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 11 02:52:53.905286 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901515 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 11 02:52:53.905286 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901519 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 11 02:52:53.905286 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901522 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 11 02:52:53.905286 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901524 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 11 02:52:53.905286 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901526 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 11 02:52:53.905286 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901529 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 11 02:52:53.905286 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901532 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 11 02:52:53.905286 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901534 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 11 02:52:53.905286 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901537 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 11 02:52:53.905782 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901539 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 11 02:52:53.905782 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901542 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 11 02:52:53.905782 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901544 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 11 02:52:53.905782 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901546 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 11 02:52:53.905782 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901549 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 11 02:52:53.905782 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901552 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 11 02:52:53.905782 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901554 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 11 02:52:53.905782 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901558 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 11 02:52:53.905782 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901561 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 11 02:52:53.905782 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901564 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 11 02:52:53.905782 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901568 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 11 02:52:53.905782 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901571 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 11 02:52:53.905782 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901574 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 11 02:52:53.905782 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901577 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 11 02:52:53.905782 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901580 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 11 02:52:53.905782 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901582 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 11 02:52:53.905782 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901585 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 11 02:52:53.905782 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901588 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 11 02:52:53.905782 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901591 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 11 02:52:53.906244 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901593 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 11 02:52:53.906244 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901596 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 11 02:52:53.906244 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901598 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 11 02:52:53.906244 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901600 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 11 02:52:53.906244 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901603 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 11 02:52:53.906244 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901606 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 11 02:52:53.906244 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901608 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 11 02:52:53.906244 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901611 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 11 02:52:53.906244 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901614 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 11 02:52:53.906244 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901616 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 11 02:52:53.906244 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901618 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 11 02:52:53.906244 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901621 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 11 02:52:53.906244 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901623 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 11 02:52:53.906244 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901626 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 11 02:52:53.906244 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901628 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 11 02:52:53.906244 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901630 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 11 02:52:53.906244 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901633 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 11 02:52:53.906244 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901636 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 11 02:52:53.906244 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901638 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 11 02:52:53.906244 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901640 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 11 02:52:53.906741 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901643 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 11 02:52:53.906741 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901645 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 11 02:52:53.906741 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901648 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 11 02:52:53.906741 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901650 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 11 02:52:53.906741 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901652 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 11 02:52:53.906741 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901655 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 11 02:52:53.906741 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901657 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 11 02:52:53.906741 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901661 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 11 02:52:53.906741 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901664 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 11 02:52:53.906741 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901666 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 11 02:52:53.906741 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901669 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 11 02:52:53.906741 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901671 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 11 02:52:53.906741 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901674 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 11 02:52:53.906741 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901676 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 11 02:52:53.906741 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901678 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 11 02:52:53.906741 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901685 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 11 02:52:53.906741 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901687 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 11 02:52:53.906741 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901691 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 11 02:52:53.906741 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901695 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 11 02:52:53.906741 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901698 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 11 02:52:53.907262 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.901700 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 11 02:52:53.907262 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.901777 2580 flags.go:64] FLAG: --address="0.0.0.0" Sep 11 02:52:53.907262 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.901821 2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 11 02:52:53.907262 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.901828 2580 flags.go:64] FLAG: --anonymous-auth="true" Sep 11 02:52:53.907262 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.901832 2580 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 11 02:52:53.907262 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.901837 2580 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 11 02:52:53.907262 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.901840 2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 11 02:52:53.907262 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.901844 2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 11 02:52:53.907262 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.901848 2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 11 02:52:53.907262 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.901851 2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 11 02:52:53.907262 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.901854 2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 11 02:52:53.907262 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.901857 2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 11 02:52:53.907262 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.901861 2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 11 02:52:53.907262 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.901863 2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 11 02:52:53.907262 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.901866 2580 flags.go:64] FLAG: --cgroup-root="" Sep 11 02:52:53.907262 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.901869 2580 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 11 02:52:53.907262 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.901872 2580 flags.go:64] FLAG: --client-ca-file="" Sep 11 02:52:53.907262 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.901875 2580 flags.go:64] FLAG: --cloud-provider="external" Sep 11 02:52:53.907262 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.901877 2580 flags.go:64] FLAG: --cluster-dns="[]" Sep 11 02:52:53.907262 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.901881 2580 flags.go:64] FLAG: --cluster-domain="" Sep 11 02:52:53.907262 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.901883 2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 11 02:52:53.907262 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.901887 2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 11 02:52:53.907262 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.901890 2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 11 02:52:53.907262 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.901893 2580 flags.go:64] FLAG: --container-log-max-files="5" Sep 11 02:52:53.907924 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.901897 2580 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 11 02:52:53.907924 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.901899 2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 11 02:52:53.907924 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.901902 2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 11 02:52:53.907924 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.901907 2580 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 11 02:52:53.907924 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.901910 2580 flags.go:64] FLAG: --contention-profiling="false" Sep 11 02:52:53.907924 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.901913 2580 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 11 02:52:53.907924 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.901917 2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 11 02:52:53.907924 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.901920 2580 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 11 02:52:53.907924 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.901923 2580 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 11 02:52:53.907924 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.901927 2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 11 02:52:53.907924 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.901930 2580 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 11 02:52:53.907924 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.901933 2580 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 11 02:52:53.907924 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.901935 2580 flags.go:64] FLAG: --enable-load-reader="false" Sep 11 02:52:53.907924 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.901938 2580 flags.go:64] FLAG: --enable-server="true" Sep 11 02:52:53.907924 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.901941 2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 11 02:52:53.907924 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.901945 2580 flags.go:64] FLAG: --event-burst="100" Sep 11 02:52:53.907924 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.901948 2580 flags.go:64] FLAG: --event-qps="50" Sep 11 02:52:53.907924 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.901950 2580 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 11 02:52:53.907924 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.901954 2580 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 11 02:52:53.907924 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.901957 2580 flags.go:64] FLAG: --eviction-hard="" Sep 11 02:52:53.907924 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.901960 2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 11 02:52:53.907924 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.901963 2580 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 11 02:52:53.907924 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.901966 2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 11 02:52:53.907924 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.901969 2580 flags.go:64] FLAG: --eviction-soft="" Sep 11 02:52:53.907924 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.901972 2580 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 11 02:52:53.908551 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.901974 2580 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 11 02:52:53.908551 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.901977 2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 11 02:52:53.908551 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.901980 2580 flags.go:64] FLAG: --experimental-mounter-path="" Sep 11 02:52:53.908551 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.901982 2580 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 11 02:52:53.908551 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.901985 2580 flags.go:64] FLAG: --fail-swap-on="true" Sep 11 02:52:53.908551 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.901988 2580 flags.go:64] FLAG: --feature-gates="" Sep 11 02:52:53.908551 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.901992 2580 flags.go:64] FLAG: --file-check-frequency="20s" Sep 11 02:52:53.908551 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.901994 2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 11 02:52:53.908551 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.901997 2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 11 02:52:53.908551 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902000 2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 11 02:52:53.908551 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902004 2580 flags.go:64] FLAG: --healthz-port="10248" Sep 11 02:52:53.908551 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902007 2580 flags.go:64] FLAG: --help="false" Sep 11 02:52:53.908551 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902010 2580 flags.go:64] FLAG: --hostname-override="ip-10-0-138-210.ec2.internal" Sep 11 02:52:53.908551 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902014 2580 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 11 02:52:53.908551 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902017 2580 flags.go:64] FLAG: --http-check-frequency="20s" Sep 11 02:52:53.908551 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902020 2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 11 02:52:53.908551 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902023 2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 11 02:52:53.908551 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902026 2580 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 11 02:52:53.908551 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902029 2580 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 11 02:52:53.908551 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902032 2580 flags.go:64] FLAG: --image-service-endpoint="" Sep 11 02:52:53.908551 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902034 2580 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 11 02:52:53.908551 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902037 2580 flags.go:64] FLAG: --kube-api-burst="100" Sep 11 02:52:53.908551 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902040 2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 11 02:52:53.909420 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902043 2580 flags.go:64] FLAG: --kube-api-qps="50" Sep 11 02:52:53.909420 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902045 2580 flags.go:64] FLAG: --kube-reserved="" Sep 11 02:52:53.909420 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902048 2580 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 11 02:52:53.909420 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902051 2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 11 02:52:53.909420 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902054 2580 flags.go:64] FLAG: --kubelet-cgroups="" Sep 11 02:52:53.909420 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902056 2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 11 02:52:53.909420 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902059 2580 flags.go:64] FLAG: --lock-file="" Sep 11 02:52:53.909420 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902062 2580 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 11 02:52:53.909420 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902064 2580 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 11 02:52:53.909420 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902067 2580 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 11 02:52:53.909420 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902072 2580 flags.go:64] FLAG: --log-json-split-stream="false" Sep 11 02:52:53.909420 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902075 2580 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 11 02:52:53.909420 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902078 2580 flags.go:64] FLAG: --log-text-split-stream="false" Sep 11 02:52:53.909420 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902080 2580 flags.go:64] FLAG: --logging-format="text" Sep 11 02:52:53.909420 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902083 2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 11 02:52:53.909420 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902086 2580 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 11 02:52:53.909420 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902093 2580 flags.go:64] FLAG: --manifest-url="" Sep 11 02:52:53.909420 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902096 2580 flags.go:64] FLAG: --manifest-url-header="" Sep 11 02:52:53.909420 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902100 2580 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 11 02:52:53.909420 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902104 2580 flags.go:64] FLAG: --max-open-files="1000000" Sep 11 02:52:53.909420 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902108 2580 flags.go:64] FLAG: --max-pods="110" Sep 11 02:52:53.909420 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902111 2580 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 11 02:52:53.909420 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902115 2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 11 02:52:53.909420 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902118 2580 flags.go:64] FLAG: --memory-manager-policy="None" Sep 11 02:52:53.909420 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902121 2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 11 02:52:53.910441 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902124 2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 11 02:52:53.910441 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902127 2580 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 11 02:52:53.910441 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902130 2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 11 02:52:53.910441 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902136 2580 flags.go:64] FLAG: --node-status-max-images="50" Sep 11 02:52:53.910441 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902139 2580 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 11 02:52:53.910441 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902142 2580 flags.go:64] FLAG: --oom-score-adj="-999" Sep 11 02:52:53.910441 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902145 2580 flags.go:64] FLAG: --pod-cidr="" Sep 11 02:52:53.910441 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902148 2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10" Sep 11 02:52:53.910441 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902153 2580 flags.go:64] FLAG: --pod-manifest-path="" Sep 11 02:52:53.910441 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902155 2580 flags.go:64] FLAG: --pod-max-pids="-1" Sep 11 02:52:53.910441 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902158 2580 flags.go:64] FLAG: --pods-per-core="0" Sep 11 02:52:53.910441 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902161 2580 flags.go:64] FLAG: --port="10250" Sep 11 02:52:53.910441 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902164 2580 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 11 02:52:53.910441 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902167 2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ccd9fc5eca19d64f" Sep 11 02:52:53.910441 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902169 2580 flags.go:64] FLAG: --qos-reserved="" Sep 11 02:52:53.910441 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902172 2580 flags.go:64] FLAG: --read-only-port="10255" Sep 11 02:52:53.910441 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902175 2580 flags.go:64] FLAG: --register-node="true" Sep 11 02:52:53.910441 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902178 2580 flags.go:64] FLAG: --register-with-taints="" Sep 11 02:52:53.910441 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902181 2580 flags.go:64] FLAG: --registry-burst="10" Sep 11 02:52:53.910441 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902184 2580 flags.go:64] FLAG: --registry-qps="5" Sep 11 02:52:53.910441 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902187 2580 flags.go:64] FLAG: --reserved-cpus="" Sep 11 02:52:53.910441 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902190 2580 flags.go:64] FLAG: --reserved-memory="" Sep 11 02:52:53.910441 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902193 2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 11 02:52:53.910441 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902196 2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 11 02:52:53.910441 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902199 2580 flags.go:64] FLAG: --rotate-certificates="false" Sep 11 02:52:53.911259 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902201 2580 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 11 02:52:53.911259 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902204 2580 flags.go:64] FLAG: --runonce="false" Sep 11 02:52:53.911259 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902208 2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 11 02:52:53.911259 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902211 2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 11 02:52:53.911259 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902214 2580 flags.go:64] FLAG: --seccomp-default="false" Sep 11 02:52:53.911259 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902217 2580 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 11 02:52:53.911259 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902220 2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 11 02:52:53.911259 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902237 2580 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 11 02:52:53.911259 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902240 2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 11 02:52:53.911259 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902243 2580 flags.go:64] FLAG: --storage-driver-password="root" Sep 11 02:52:53.911259 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902246 2580 flags.go:64] FLAG: --storage-driver-secure="false" Sep 11 02:52:53.911259 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902248 2580 flags.go:64] FLAG: --storage-driver-table="stats" Sep 11 02:52:53.911259 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902251 2580 flags.go:64] FLAG: --storage-driver-user="root" Sep 11 02:52:53.911259 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902254 2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 11 02:52:53.911259 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902257 2580 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 11 02:52:53.911259 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902259 2580 flags.go:64] FLAG: --system-cgroups="" Sep 11 02:52:53.911259 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902262 2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 11 02:52:53.911259 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902267 2580 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 11 02:52:53.911259 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902270 2580 flags.go:64] FLAG: --tls-cert-file="" Sep 11 02:52:53.911259 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902273 2580 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 11 02:52:53.911259 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902277 2580 flags.go:64] FLAG: --tls-min-version="" Sep 11 02:52:53.911259 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902279 2580 flags.go:64] FLAG: --tls-private-key-file="" Sep 11 02:52:53.911259 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902282 2580 flags.go:64] FLAG: --topology-manager-policy="none" Sep 11 02:52:53.911259 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902284 2580 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 11 02:52:53.911259 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902287 2580 flags.go:64] FLAG: --topology-manager-scope="container" Sep 11 02:52:53.911899 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902290 2580 flags.go:64] FLAG: --v="2" Sep 11 02:52:53.911899 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902294 2580 flags.go:64] FLAG: --version="false" Sep 11 02:52:53.911899 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902297 2580 flags.go:64] FLAG: --vmodule="" Sep 11 02:52:53.911899 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902301 2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 11 02:52:53.911899 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.902304 2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 11 02:52:53.911899 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902416 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 11 02:52:53.911899 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902420 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 11 02:52:53.911899 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902423 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 11 02:52:53.911899 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902425 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 11 02:52:53.911899 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902429 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 11 02:52:53.911899 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902431 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 11 02:52:53.911899 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902435 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 11 02:52:53.911899 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902437 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 11 02:52:53.911899 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902440 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 11 02:52:53.911899 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902442 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 11 02:52:53.911899 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902445 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 11 02:52:53.911899 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902448 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 11 02:52:53.911899 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902450 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 11 02:52:53.911899 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902453 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 11 02:52:53.911899 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902455 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 11 02:52:53.911899 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902458 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 11 02:52:53.912422 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902460 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 11 02:52:53.912422 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902464 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 11 02:52:53.912422 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902468 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 11 02:52:53.912422 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902471 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 11 02:52:53.912422 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902474 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 11 02:52:53.912422 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902477 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 11 02:52:53.912422 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902480 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 11 02:52:53.912422 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902483 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 11 02:52:53.912422 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902485 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 11 02:52:53.912422 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902488 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 11 02:52:53.912422 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902490 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 11 02:52:53.912422 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902493 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 11 02:52:53.912422 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902495 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 11 02:52:53.912422 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902498 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 11 02:52:53.912422 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902500 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 11 02:52:53.912422 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902502 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 11 02:52:53.912422 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902505 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 11 02:52:53.912422 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902507 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 11 02:52:53.912422 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902510 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 11 02:52:53.912886 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902512 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 11 02:52:53.912886 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902515 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 11 02:52:53.912886 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902518 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 11 02:52:53.912886 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902521 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 11 02:52:53.912886 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902524 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 11 02:52:53.912886 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902526 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 11 02:52:53.912886 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902529 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 11 02:52:53.912886 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902532 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 11 02:52:53.912886 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902535 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 11 02:52:53.912886 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902537 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 11 02:52:53.912886 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902540 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 11 02:52:53.912886 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902542 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 11 02:52:53.912886 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902545 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 11 02:52:53.912886 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902547 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 11 02:52:53.912886 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902549 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 11 02:52:53.912886 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902552 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 11 02:52:53.912886 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902554 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 11 02:52:53.912886 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902557 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 11 02:52:53.912886 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902559 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 11 02:52:53.913356 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902561 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 11 02:52:53.913356 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902564 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 11 02:52:53.913356 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902567 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 11 02:52:53.913356 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902569 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 11 02:52:53.913356 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902572 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 11 02:52:53.913356 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902574 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 11 02:52:53.913356 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902577 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 11 02:52:53.913356 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902579 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 11 02:52:53.913356 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902582 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 11 02:52:53.913356 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902584 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 11 02:52:53.913356 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902587 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 11 02:52:53.913356 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902589 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 11 02:52:53.913356 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902592 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 11 02:52:53.913356 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902594 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 11 02:52:53.913356 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902597 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 11 02:52:53.913356 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902600 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 11 02:52:53.913356 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902604 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 11 02:52:53.913356 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902607 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 11 02:52:53.913356 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902610 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 11 02:52:53.913837 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902613 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 11 02:52:53.913837 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902616 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 11 02:52:53.913837 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902619 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 11 02:52:53.913837 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902622 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 11 02:52:53.913837 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902624 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 11 02:52:53.913837 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902627 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 11 02:52:53.913837 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902629 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 11 02:52:53.913837 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902631 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 11 02:52:53.913837 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902634 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 11 02:52:53.913837 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902636 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 11 02:52:53.913837 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902638 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 11 02:52:53.913837 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902641 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 11 02:52:53.913837 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902644 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 11 02:52:53.913837 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902647 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 11 02:52:53.913837 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902651 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 11 02:52:53.913837 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902654 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 11 02:52:53.913837 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902656 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 11 02:52:53.913837 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902659 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 11 02:52:53.913837 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902661 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 11 02:52:53.914322 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902663 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 11 02:52:53.914322 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902666 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 11 02:52:53.914322 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902668 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 11 02:52:53.914322 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902670 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 11 02:52:53.914322 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902673 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 11 02:52:53.914322 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902675 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 11 02:52:53.914322 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.902678 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 11 02:52:53.914322 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.903289 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 11 02:52:53.914322 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.911981 2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 11 02:52:53.914322 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.911996 2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 11 02:52:53.914322 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.913406 2580 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 11 02:52:53.914322 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.913415 2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 11 02:52:53.914322 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913473 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 11 02:52:53.914322 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913478 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 11 02:52:53.914322 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913481 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 11 02:52:53.914688 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913484 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 11 02:52:53.914688 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913489 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 11 02:52:53.914688 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913493 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 11 02:52:53.914688 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913496 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 11 02:52:53.914688 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913499 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 11 02:52:53.914688 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913503 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 11 02:52:53.914688 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913506 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 11 02:52:53.914688 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913509 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 11 02:52:53.914688 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913512 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 11 02:52:53.914688 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913515 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 11 02:52:53.914688 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913518 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 11 02:52:53.914688 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913521 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 11 02:52:53.914688 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913524 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 11 02:52:53.914688 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913526 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 11 02:52:53.914688 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913529 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 11 02:52:53.914688 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913532 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 11 02:52:53.914688 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913535 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 11 02:52:53.914688 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913537 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 11 02:52:53.914688 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913540 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 11 02:52:53.915174 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913543 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 11 02:52:53.915174 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913546 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 11 02:52:53.915174 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913548 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 11 02:52:53.915174 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913551 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 11 02:52:53.915174 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913554 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 11 02:52:53.915174 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913558 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 11 02:52:53.915174 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913561 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 11 02:52:53.915174 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913564 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 11 02:52:53.915174 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913567 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 11 02:52:53.915174 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913570 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 11 02:52:53.915174 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913573 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 11 02:52:53.915174 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913576 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 11 02:52:53.915174 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913578 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 11 02:52:53.915174 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913581 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 11 02:52:53.915174 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913583 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 11 02:52:53.915174 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913586 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 11 02:52:53.915174 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913588 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 11 02:52:53.915174 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913590 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 11 02:52:53.915174 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913593 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 11 02:52:53.915651 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913595 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 11 02:52:53.915651 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913598 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 11 02:52:53.915651 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913600 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 11 02:52:53.915651 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913603 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 11 02:52:53.915651 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913605 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 11 02:52:53.915651 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913609 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 11 02:52:53.915651 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913611 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 11 02:52:53.915651 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913614 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 11 02:52:53.915651 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913616 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 11 02:52:53.915651 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913618 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 11 02:52:53.915651 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913621 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 11 02:52:53.915651 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913624 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 11 02:52:53.915651 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913626 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 11 02:52:53.915651 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913629 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 11 02:52:53.915651 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913631 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 11 02:52:53.915651 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913633 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 11 02:52:53.915651 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913636 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 11 02:52:53.915651 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913638 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 11 02:52:53.915651 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913640 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 11 02:52:53.915651 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913644 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 11 02:52:53.916131 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913647 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 11 02:52:53.916131 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913649 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 11 02:52:53.916131 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913652 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 11 02:52:53.916131 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913654 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 11 02:52:53.916131 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913657 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 11 02:52:53.916131 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913660 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 11 02:52:53.916131 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913662 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 11 02:52:53.916131 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913665 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 11 02:52:53.916131 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913667 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 11 02:52:53.916131 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913670 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 11 02:52:53.916131 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913672 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 11 02:52:53.916131 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913675 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 11 02:52:53.916131 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913677 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 11 02:52:53.916131 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913680 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 11 02:52:53.916131 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913682 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 11 02:52:53.916131 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913685 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 11 02:52:53.916131 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913688 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 11 02:52:53.916131 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913690 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 11 02:52:53.916131 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913693 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 11 02:52:53.916131 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913696 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 11 02:52:53.916701 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913698 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 11 02:52:53.916701 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913700 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 11 02:52:53.916701 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913703 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 11 02:52:53.916701 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913705 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 11 02:52:53.916701 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913708 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 11 02:52:53.916701 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913710 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 11 02:52:53.916701 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913713 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 11 02:52:53.916701 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913715 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 11 02:52:53.916701 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913718 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 11 02:52:53.916701 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913721 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 11 02:52:53.916701 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913723 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 11 02:52:53.916701 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913726 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 11 02:52:53.916701 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913728 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 11 02:52:53.916701 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913731 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 11 02:52:53.916701 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913734 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 11 02:52:53.916701 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913736 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 11 02:52:53.916701 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913738 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 11 02:52:53.916701 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913741 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 11 02:52:53.917132 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.913746 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 11 02:52:53.917132 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913864 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 11 02:52:53.917132 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913869 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 11 02:52:53.917132 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913872 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 11 02:52:53.917132 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913874 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 11 02:52:53.917132 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913877 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 11 02:52:53.917132 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913880 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 11 02:52:53.917132 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913883 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 11 02:52:53.917132 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913885 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 11 02:52:53.917132 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913888 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 11 02:52:53.917132 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913891 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 11 02:52:53.917132 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913893 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 11 02:52:53.917132 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913896 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 11 02:52:53.917132 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913900 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 11 02:52:53.917132 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913903 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 11 02:52:53.917517 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913905 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 11 02:52:53.917517 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913909 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 11 02:52:53.917517 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913912 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 11 02:52:53.917517 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913916 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 11 02:52:53.917517 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913919 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 11 02:52:53.917517 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913922 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 11 02:52:53.917517 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913924 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 11 02:52:53.917517 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913927 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 11 02:52:53.917517 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913930 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 11 02:52:53.917517 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913932 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 11 02:52:53.917517 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913934 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 11 02:52:53.917517 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913937 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 11 02:52:53.917517 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913939 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 11 02:52:53.917517 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913942 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 11 02:52:53.917517 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913944 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 11 02:52:53.917517 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913946 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 11 02:52:53.917517 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913949 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 11 02:52:53.917517 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913951 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 11 02:52:53.917517 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913954 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 11 02:52:53.917517 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913956 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 11 02:52:53.918038 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913959 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 11 02:52:53.918038 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913961 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 11 02:52:53.918038 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913963 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 11 02:52:53.918038 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913966 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 11 02:52:53.918038 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913968 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 11 02:52:53.918038 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913971 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 11 02:52:53.918038 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913973 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 11 02:52:53.918038 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913975 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 11 02:52:53.918038 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913978 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 11 02:52:53.918038 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913980 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 11 02:52:53.918038 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913983 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 11 02:52:53.918038 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913987 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 11 02:52:53.918038 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913989 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 11 02:52:53.918038 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913992 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 11 02:52:53.918038 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913994 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 11 02:52:53.918038 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913997 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 11 02:52:53.918038 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.913999 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 11 02:52:53.918038 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.914002 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 11 02:52:53.918038 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.914004 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 11 02:52:53.918038 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.914007 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 11 02:52:53.918552 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.914009 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 11 02:52:53.918552 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.914012 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 11 02:52:53.918552 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.914015 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 11 02:52:53.918552 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.914018 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 11 02:52:53.918552 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.914021 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 11 02:52:53.918552 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.914024 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 11 02:52:53.918552 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.914027 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 11 02:52:53.918552 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.914029 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 11 02:52:53.918552 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.914032 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 11 02:52:53.918552 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.914034 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 11 02:52:53.918552 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.914037 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 11 02:52:53.918552 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.914039 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 11 02:52:53.918552 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.914042 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 11 02:52:53.918552 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.914045 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 11 02:52:53.918552 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.914049 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 11 02:52:53.918552 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.914051 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 11 02:52:53.918552 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.914054 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 11 02:52:53.918552 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.914057 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 11 02:52:53.918552 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.914059 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 11 02:52:53.919336 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.914061 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 11 02:52:53.919336 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.914064 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 11 02:52:53.919336 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.914066 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 11 02:52:53.919336 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.914069 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 11 02:52:53.919336 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.914071 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 11 02:52:53.919336 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.914075 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 11 02:52:53.919336 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.914078 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 11 02:52:53.919336 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.914080 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 11 02:52:53.919336 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.914083 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 11 02:52:53.919336 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.914085 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 11 02:52:53.919336 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.914088 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 11 02:52:53.919336 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.914090 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 11 02:52:53.919336 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.914093 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 11 02:52:53.919336 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.914095 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 11 02:52:53.919336 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.914097 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 11 02:52:53.919336 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.914100 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 11 02:52:53.919336 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.914102 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 11 02:52:53.919336 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.914104 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 11 02:52:53.919336 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.914107 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 11 02:52:53.919945 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.914110 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 11 02:52:53.919945 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.914112 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 11 02:52:53.919945 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.914115 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 11 02:52:53.919945 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.914117 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 11 02:52:53.919945 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.914120 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 11 02:52:53.919945 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.914122 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 11 02:52:53.919945 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:53.914125 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 11 02:52:53.919945 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.914130 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 11 02:52:53.919945 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.914254 2580 server.go:962] "Client rotation is on, will bootstrap in background" Sep 11 02:52:53.919945 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.917642 2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 11 02:52:53.919945 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.918424 2580 server.go:1019] "Starting client certificate rotation" Sep 11 02:52:53.919945 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.918543 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 11 02:52:53.919945 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.918597 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 11 02:52:53.921050 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.921035 2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 11 02:52:53.925379 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.925361 2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 11 02:52:53.935099 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.935083 2580 log.go:25] "Validated CRI v1 runtime API" Sep 11 02:52:53.938035 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.938021 2580 log.go:25] "Validated CRI v1 image API" Sep 11 02:52:53.938985 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.938972 2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 11 02:52:53.941804 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.941779 2580 fs.go:135] Filesystem UUIDs: map[55c6ebf5-696e-4f6f-bafb-28c21b10e1fd:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 efb95cd4-e9c1-49ce-aada-261fd41d5811:/dev/nvme0n1p4] Sep 11 02:52:53.941860 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.941804 2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 11 02:52:53.947346 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.947329 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 11 02:52:53.948800 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.948691 2580 manager.go:216] Machine: {Timestamp:2026-09-11 02:52:53.947324829 +0000 UTC m=+0.318042292 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3109257 MemoryCapacity:32812150784 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24447d4612a1e48b2f4fcc7aedb95f SystemUUID:ec24447d-4612-a1e4-8b2f-4fcc7aedb95f BootID:9c2d027b-2f72-4997-be7c-fc91c6595bc8 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406077440 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406073344 Type:vfs Inodes:4005389 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562430976 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:14:1b:db:35:b9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:14:1b:db:35:b9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ee:2c:f5:a5:cf:32 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812150784 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 11 02:52:53.948800 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.948798 2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 11 02:52:53.948899 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.948872 2580 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 11 02:52:53.951646 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.951626 2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 11 02:52:53.951772 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.951649 2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-210.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 11 02:52:53.952322 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.952311 2580 topology_manager.go:138] "Creating topology manager with none policy" Sep 11 02:52:53.952392 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.952325 2580 container_manager_linux.go:309] "Creating device plugin manager" Sep 11 02:52:53.952392 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.952333 2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 11 02:52:53.953194 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.953185 2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 11 02:52:53.954096 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.954087 2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 11 02:52:53.957543 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.957532 2580 state_mem.go:36] "Initialized new in-memory state store" Sep 11 02:52:53.957664 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.957655 2580 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 11 02:52:53.957704 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.957682 2580 kubelet.go:486] "Attempting to sync node with API server" Sep 11 02:52:53.957704 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.957691 2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 11 02:52:53.957704 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.957705 2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 11 02:52:53.957815 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.957734 2580 kubelet.go:398] "Adding apiserver pod source" Sep 11 02:52:53.957815 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.957742 2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 11 02:52:53.958118 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.958096 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 11 02:52:53.958118 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.958122 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 11 02:52:53.960029 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.960012 2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 11 02:52:53.962152 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.962138 2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 11 02:52:53.962255 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.962168 2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 11 02:52:53.963504 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.963492 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 11 02:52:53.963557 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.963508 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 11 02:52:53.963557 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.963514 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 11 02:52:53.963557 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.963520 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 11 02:52:53.963557 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.963528 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 11 02:52:53.963557 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.963533 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 11 02:52:53.963557 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.963547 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 11 02:52:53.963557 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.963559 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 11 02:52:53.963744 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.963566 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 11 02:52:53.963744 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.963572 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 11 02:52:53.963744 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.963581 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 11 02:52:53.963744 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.963586 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 11 02:52:53.964241 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.964214 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 11 02:52:53.964274 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.964241 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 11 02:52:53.967006 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.966988 2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-210.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 11 02:52:53.967081 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:52:53.967057 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 11 02:52:53.967192 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:52:53.967165 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-210.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 11 02:52:53.968471 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.968458 2580 server.go:1268] "Started kubelet" Sep 11 02:52:53.968587 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.968515 2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 11 02:52:53.968658 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.968536 2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 11 02:52:53.968706 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.968674 2580 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 11 02:52:53.969423 ip-10-0-138-210 systemd[1]: Started Kubernetes Kubelet. Sep 11 02:52:53.970169 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.970130 2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 11 02:52:53.970705 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.970685 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bvx6r" Sep 11 02:52:53.971201 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.971189 2580 server.go:310] "Adding debug handlers to kubelet server" Sep 11 02:52:53.972587 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:52:53.972567 2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 11 02:52:53.974613 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.974597 2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 11 02:52:53.974706 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.974612 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 11 02:52:53.974761 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:52:53.974691 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-210.ec2.internal\" not found" Sep 11 02:52:53.975208 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.975190 2580 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 11 02:52:53.975208 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.975208 2580 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 11 02:52:53.975350 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.975246 2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 11 02:52:53.975350 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.975306 2580 reconstruct.go:97] "Volume reconstruction finished" Sep 11 02:52:53.975350 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.975316 2580 reconciler.go:29] "Reconciler: start to sync state" Sep 11 02:52:53.976113 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.976093 2580 factory.go:55] Registering systemd factory Sep 11 02:52:53.976113 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.976114 2580 factory.go:223] Registration of the systemd container factory successfully Sep 11 02:52:53.976333 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.976310 2580 factory.go:153] Registering CRI-O factory Sep 11 02:52:53.976333 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.976325 2580 factory.go:223] Registration of the crio container factory successfully Sep 11 02:52:53.976434 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.976368 2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 11 02:52:53.976434 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.976387 2580 factory.go:103] Registering Raw factory Sep 11 02:52:53.976434 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.976408 2580 manager.go:1196] Started watching for new ooms in manager Sep 11 02:52:53.976744 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.976721 2580 manager.go:349] Starting recovery of all containers Sep 11 02:52:53.976828 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:52:53.975013 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-210.ec2.internal.18d42494e9bfd4dd default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-210.ec2.internal,UID:ip-10-0-138-210.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-210.ec2.internal,},FirstTimestamp:2026-09-11 02:52:53.968352477 +0000 UTC m=+0.339069937,LastTimestamp:2026-09-11 02:52:53.968352477 +0000 UTC m=+0.339069937,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-210.ec2.internal,}" Sep 11 02:52:53.981215 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:52:53.978994 2580 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-210.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 11 02:52:53.981215 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:52:53.979362 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 11 02:52:53.981215 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.978425 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bvx6r" Sep 11 02:52:53.986187 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.986156 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 11 02:52:53.988487 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.988411 2580 manager.go:354] Recovery completed Sep 11 02:52:53.990561 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:52:53.990533 2580 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Sep 11 02:52:53.993530 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.993517 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 02:52:53.995130 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.995115 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-210.ec2.internal" event="NodeHasSufficientMemory" Sep 11 02:52:53.995204 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.995147 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-210.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 02:52:53.995204 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.995162 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-210.ec2.internal" event="NodeHasSufficientPID" Sep 11 02:52:53.995817 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.995804 2580 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 11 02:52:53.995817 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.995817 2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 11 02:52:53.995899 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.995831 2580 state_mem.go:36] "Initialized new in-memory state store" Sep 11 02:52:53.995899 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.995811 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 02:52:53.996552 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.996537 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-210.ec2.internal" event="NodeHasSufficientMemory" Sep 11 02:52:53.996633 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.996566 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-210.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 02:52:53.996633 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.996579 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-210.ec2.internal" event="NodeHasSufficientPID" Sep 11 02:52:53.997816 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.997803 2580 policy_none.go:49] "None policy: Start" Sep 11 02:52:53.997873 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.997819 2580 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 11 02:52:53.997873 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.997829 2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 11 02:52:53.999738 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:53.999728 2580 policy_none.go:47] "Start" Sep 11 02:52:54.035787 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:54.035773 2580 manager.go:337] "Starting Device Plugin manager" Sep 11 02:52:54.053919 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:52:54.035815 2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 11 02:52:54.053919 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:54.035824 2580 server.go:87] "Starting device plugin registration server" Sep 11 02:52:54.053919 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:54.036156 2580 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 11 02:52:54.053919 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:54.036167 2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 11 02:52:54.053919 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:54.036296 2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 11 02:52:54.053919 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:54.036383 2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 11 02:52:54.053919 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:54.036405 2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 11 02:52:54.053919 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:52:54.036929 2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 11 02:52:54.053919 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:52:54.036974 2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-210.ec2.internal\" not found" Sep 11 02:52:54.105863 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:54.105838 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 11 02:52:54.105950 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:54.105886 2580 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 11 02:52:54.105950 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:54.105912 2580 kubelet.go:2448] "Starting kubelet main sync loop" Sep 11 02:52:54.106010 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:52:54.105949 2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 11 02:52:54.108100 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:54.108077 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 11 02:52:54.137267 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:54.137248 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 02:52:54.138047 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:54.138033 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-210.ec2.internal" event="NodeHasSufficientMemory" Sep 11 02:52:54.138102 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:54.138062 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-210.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 02:52:54.138102 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:54.138073 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-210.ec2.internal" event="NodeHasSufficientPID" Sep 11 02:52:54.138162 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:54.138112 2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-210.ec2.internal" Sep 11 02:52:54.145822 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:54.145766 2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-210.ec2.internal" Sep 11 02:52:54.145822 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:52:54.145786 2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-210.ec2.internal\": node \"ip-10-0-138-210.ec2.internal\" not found" Sep 11 02:52:54.163936 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:52:54.163913 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-210.ec2.internal\" not found" Sep 11 02:52:54.206699 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:54.206679 2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-210.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-210.ec2.internal"] Sep 11 02:52:54.206771 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:54.206750 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 02:52:54.208064 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:54.208052 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-210.ec2.internal" event="NodeHasSufficientMemory" Sep 11 02:52:54.208126 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:54.208080 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-210.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 02:52:54.208126 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:54.208089 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-210.ec2.internal" event="NodeHasSufficientPID" Sep 11 02:52:54.210381 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:54.210369 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 02:52:54.210837 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:54.210820 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-210.ec2.internal" Sep 11 02:52:54.210908 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:54.210861 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 02:52:54.211031 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:54.211014 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-210.ec2.internal" event="NodeHasSufficientMemory" Sep 11 02:52:54.211127 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:54.211038 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-210.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 02:52:54.211127 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:54.211048 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-210.ec2.internal" event="NodeHasSufficientPID" Sep 11 02:52:54.211563 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:54.211545 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-210.ec2.internal" event="NodeHasSufficientMemory" Sep 11 02:52:54.211628 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:54.211574 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-210.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 02:52:54.211628 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:54.211585 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-210.ec2.internal" event="NodeHasSufficientPID" Sep 11 02:52:54.213239 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:54.213211 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-210.ec2.internal" Sep 11 02:52:54.213287 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:54.213272 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 02:52:54.214004 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:54.213987 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-210.ec2.internal" event="NodeHasSufficientMemory" Sep 11 02:52:54.214088 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:54.214018 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-210.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 02:52:54.214088 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:54.214031 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-210.ec2.internal" event="NodeHasSufficientPID" Sep 11 02:52:54.235840 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:52:54.235819 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-210.ec2.internal\" not found" node="ip-10-0-138-210.ec2.internal" Sep 11 02:52:54.239989 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:52:54.239974 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-210.ec2.internal\" not found" node="ip-10-0-138-210.ec2.internal" Sep 11 02:52:54.264736 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:52:54.264719 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-210.ec2.internal\" not found" Sep 11 02:52:54.365634 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:52:54.365618 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-210.ec2.internal\" not found" Sep 11 02:52:54.376908 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:54.376889 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d79d7fb3dbee895c79a46f52d8374f34-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-210.ec2.internal\" (UID: \"d79d7fb3dbee895c79a46f52d8374f34\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-210.ec2.internal" Sep 11 02:52:54.376989 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:54.376914 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8374f836a1cb97d92580857849ff95ac-config\") pod \"kube-apiserver-proxy-ip-10-0-138-210.ec2.internal\" (UID: \"8374f836a1cb97d92580857849ff95ac\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-210.ec2.internal" Sep 11 02:52:54.376989 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:54.376931 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d79d7fb3dbee895c79a46f52d8374f34-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-210.ec2.internal\" (UID: \"d79d7fb3dbee895c79a46f52d8374f34\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-210.ec2.internal" Sep 11 02:52:54.466304 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:52:54.466260 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-210.ec2.internal\" not found" Sep 11 02:52:54.477583 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:54.477567 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d79d7fb3dbee895c79a46f52d8374f34-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-210.ec2.internal\" (UID: \"d79d7fb3dbee895c79a46f52d8374f34\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-210.ec2.internal" Sep 11 02:52:54.477634 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:54.477587 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d79d7fb3dbee895c79a46f52d8374f34-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-210.ec2.internal\" (UID: \"d79d7fb3dbee895c79a46f52d8374f34\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-210.ec2.internal" Sep 11 02:52:54.477634 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:54.477603 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8374f836a1cb97d92580857849ff95ac-config\") pod \"kube-apiserver-proxy-ip-10-0-138-210.ec2.internal\" (UID: \"8374f836a1cb97d92580857849ff95ac\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-210.ec2.internal" Sep 11 02:52:54.477634 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:54.477625 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8374f836a1cb97d92580857849ff95ac-config\") pod \"kube-apiserver-proxy-ip-10-0-138-210.ec2.internal\" (UID: \"8374f836a1cb97d92580857849ff95ac\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-210.ec2.internal" Sep 11 02:52:54.477726 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:54.477655 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d79d7fb3dbee895c79a46f52d8374f34-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-210.ec2.internal\" (UID: \"d79d7fb3dbee895c79a46f52d8374f34\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-210.ec2.internal" Sep 11 02:52:54.477726 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:54.477671 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d79d7fb3dbee895c79a46f52d8374f34-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-210.ec2.internal\" (UID: \"d79d7fb3dbee895c79a46f52d8374f34\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-210.ec2.internal" Sep 11 02:52:54.538717 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:54.538688 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-210.ec2.internal" Sep 11 02:52:54.542309 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:54.542292 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-210.ec2.internal" Sep 11 02:52:54.566842 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:52:54.566817 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-210.ec2.internal\" not found" Sep 11 02:52:54.667365 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:52:54.667342 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-210.ec2.internal\" not found" Sep 11 02:52:54.767836 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:52:54.767792 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-210.ec2.internal\" not found" Sep 11 02:52:54.868346 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:52:54.868324 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-210.ec2.internal\" not found" Sep 11 02:52:54.918790 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:54.918767 2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 11 02:52:54.919146 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:54.918885 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 11 02:52:54.968779 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:52:54.968761 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-210.ec2.internal\" not found" Sep 11 02:52:54.983636 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:54.983604 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-10 02:47:55 +0000 UTC" deadline="2028-04-10 22:38:30.62163642 +0000 UTC" Sep 11 02:52:54.983636 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:54.983628 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13867h45m35.63801189s" Sep 11 02:52:55.069651 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:52:55.069603 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-210.ec2.internal\" not found" Sep 11 02:52:55.078443 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:55.078426 2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 11 02:52:55.150733 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:55.150709 2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 11 02:52:55.174940 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:55.174917 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-210.ec2.internal" Sep 11 02:52:55.185988 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:55.185967 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 11 02:52:55.187456 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:55.187443 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-210.ec2.internal" Sep 11 02:52:55.195526 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:55.195507 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 11 02:52:55.249468 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:55.249442 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd79d7fb3dbee895c79a46f52d8374f34.slice/crio-be436a9d312700b87f4471c51dfd764010c80d4de002a404fce3c71fce5a76ce WatchSource:0}: Error finding container be436a9d312700b87f4471c51dfd764010c80d4de002a404fce3c71fce5a76ce: Status 404 returned error can't find the container with id be436a9d312700b87f4471c51dfd764010c80d4de002a404fce3c71fce5a76ce Sep 11 02:52:55.249815 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:55.249797 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8374f836a1cb97d92580857849ff95ac.slice/crio-bbcc92fd73b90730854b441b82693a92f065f425d11981d8729cfecae30fdc7c WatchSource:0}: Error finding container bbcc92fd73b90730854b441b82693a92f065f425d11981d8729cfecae30fdc7c: Status 404 returned error can't find the container with id bbcc92fd73b90730854b441b82693a92f065f425d11981d8729cfecae30fdc7c Sep 11 02:52:55.255129 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:55.255110 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 11 02:52:55.306609 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:55.306589 2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 11 02:52:57.126317 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.126283 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 11 02:52:57.189564 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.189534 2580 apiserver.go:52] "Watching apiserver" Sep 11 02:52:57.200103 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.200074 2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 11 02:52:57.201525 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.201503 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-p5427","openshift-ovn-kubernetes/ovnkube-node-jv2sz","kube-system/global-pull-secret-syncer-h2th6","kube-system/konnectivity-agent-tzxkr","kube-system/kube-apiserver-proxy-ip-10-0-138-210.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fncs7","openshift-image-registry/node-ca-d26rx","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-210.ec2.internal","openshift-multus/multus-additional-cni-plugins-lh4rj","openshift-multus/multus-j54mv","openshift-cluster-node-tuning-operator/tuned-x6s5v","openshift-dns/node-resolver-5qzk7","openshift-multus/network-metrics-daemon-qb9m9","openshift-network-diagnostics/network-check-target-pxq8g"] Sep 11 02:52:57.204069 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.204048 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-d26rx" Sep 11 02:52:57.206195 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.206173 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-x6s5v" Sep 11 02:52:57.206392 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.206371 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 11 02:52:57.208496 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.208440 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h2th6" Sep 11 02:52:57.208634 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:52:57.208565 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h2th6" podUID="2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a" Sep 11 02:52:57.208733 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.208607 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 11 02:52:57.208801 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.208753 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 11 02:52:57.208888 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.208872 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qncdd\"" Sep 11 02:52:57.208997 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.208981 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 11 02:52:57.209599 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.209475 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 11 02:52:57.209599 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.209593 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 11 02:52:57.210194 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.210177 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-dxfrq\"" Sep 11 02:52:57.210914 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.210897 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tzxkr" Sep 11 02:52:57.212970 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.212955 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxq8g" Sep 11 02:52:57.213063 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:52:57.213024 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxq8g" podUID="dffb443d-1d41-4705-a57d-1dbad16fff80" Sep 11 02:52:57.213446 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.213425 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-8qlpl\"" Sep 11 02:52:57.213545 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.213530 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 11 02:52:57.213609 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.213559 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 11 02:52:57.215223 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.215203 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fncs7" Sep 11 02:52:57.216108 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.216085 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/958470e1-b0b5-42c0-a6ad-b81f134eb760-run\") pod \"tuned-x6s5v\" (UID: \"958470e1-b0b5-42c0-a6ad-b81f134eb760\") " pod="openshift-cluster-node-tuning-operator/tuned-x6s5v" Sep 11 02:52:57.216200 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.216120 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/958470e1-b0b5-42c0-a6ad-b81f134eb760-sys\") pod \"tuned-x6s5v\" (UID: \"958470e1-b0b5-42c0-a6ad-b81f134eb760\") " pod="openshift-cluster-node-tuning-operator/tuned-x6s5v" Sep 11 02:52:57.216200 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.216147 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cad088c2-48c1-4e27-83e0-40244586b0c0-host\") pod \"node-ca-d26rx\" (UID: \"cad088c2-48c1-4e27-83e0-40244586b0c0\") " pod="openshift-image-registry/node-ca-d26rx" Sep 11 02:52:57.216306 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.216198 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tf6dd\" (UniqueName: \"kubernetes.io/projected/cad088c2-48c1-4e27-83e0-40244586b0c0-kube-api-access-tf6dd\") pod \"node-ca-d26rx\" (UID: \"cad088c2-48c1-4e27-83e0-40244586b0c0\") " pod="openshift-image-registry/node-ca-d26rx" Sep 11 02:52:57.216306 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.216268 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/958470e1-b0b5-42c0-a6ad-b81f134eb760-etc-sysctl-conf\") pod \"tuned-x6s5v\" (UID: \"958470e1-b0b5-42c0-a6ad-b81f134eb760\") " pod="openshift-cluster-node-tuning-operator/tuned-x6s5v" Sep 11 02:52:57.216306 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.216292 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/958470e1-b0b5-42c0-a6ad-b81f134eb760-tmp\") pod \"tuned-x6s5v\" (UID: \"958470e1-b0b5-42c0-a6ad-b81f134eb760\") " pod="openshift-cluster-node-tuning-operator/tuned-x6s5v" Sep 11 02:52:57.216443 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.216319 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/958470e1-b0b5-42c0-a6ad-b81f134eb760-etc-modprobe-d\") pod \"tuned-x6s5v\" (UID: \"958470e1-b0b5-42c0-a6ad-b81f134eb760\") " pod="openshift-cluster-node-tuning-operator/tuned-x6s5v" Sep 11 02:52:57.216443 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.216340 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/958470e1-b0b5-42c0-a6ad-b81f134eb760-lib-modules\") pod \"tuned-x6s5v\" (UID: \"958470e1-b0b5-42c0-a6ad-b81f134eb760\") " pod="openshift-cluster-node-tuning-operator/tuned-x6s5v" Sep 11 02:52:57.216443 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.216374 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/958470e1-b0b5-42c0-a6ad-b81f134eb760-host\") pod \"tuned-x6s5v\" (UID: \"958470e1-b0b5-42c0-a6ad-b81f134eb760\") " pod="openshift-cluster-node-tuning-operator/tuned-x6s5v" Sep 11 02:52:57.216443 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.216414 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdktk\" (UniqueName: \"kubernetes.io/projected/958470e1-b0b5-42c0-a6ad-b81f134eb760-kube-api-access-jdktk\") pod \"tuned-x6s5v\" (UID: \"958470e1-b0b5-42c0-a6ad-b81f134eb760\") " pod="openshift-cluster-node-tuning-operator/tuned-x6s5v" Sep 11 02:52:57.216582 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.216445 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a-kubelet-config\") pod \"global-pull-secret-syncer-h2th6\" (UID: \"2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a\") " pod="kube-system/global-pull-secret-syncer-h2th6" Sep 11 02:52:57.216582 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.216491 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a-dbus\") pod \"global-pull-secret-syncer-h2th6\" (UID: \"2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a\") " pod="kube-system/global-pull-secret-syncer-h2th6" Sep 11 02:52:57.216582 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.216514 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cad088c2-48c1-4e27-83e0-40244586b0c0-serviceca\") pod \"node-ca-d26rx\" (UID: \"cad088c2-48c1-4e27-83e0-40244586b0c0\") " pod="openshift-image-registry/node-ca-d26rx" Sep 11 02:52:57.216582 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.216540 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/958470e1-b0b5-42c0-a6ad-b81f134eb760-etc-sysctl-d\") pod \"tuned-x6s5v\" (UID: \"958470e1-b0b5-42c0-a6ad-b81f134eb760\") " pod="openshift-cluster-node-tuning-operator/tuned-x6s5v" Sep 11 02:52:57.216802 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.216577 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/958470e1-b0b5-42c0-a6ad-b81f134eb760-etc-systemd\") pod \"tuned-x6s5v\" (UID: \"958470e1-b0b5-42c0-a6ad-b81f134eb760\") " pod="openshift-cluster-node-tuning-operator/tuned-x6s5v" Sep 11 02:52:57.216802 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.216638 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/958470e1-b0b5-42c0-a6ad-b81f134eb760-var-lib-kubelet\") pod \"tuned-x6s5v\" (UID: \"958470e1-b0b5-42c0-a6ad-b81f134eb760\") " pod="openshift-cluster-node-tuning-operator/tuned-x6s5v" Sep 11 02:52:57.216802 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.216663 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/958470e1-b0b5-42c0-a6ad-b81f134eb760-etc-tuned\") pod \"tuned-x6s5v\" (UID: \"958470e1-b0b5-42c0-a6ad-b81f134eb760\") " pod="openshift-cluster-node-tuning-operator/tuned-x6s5v" Sep 11 02:52:57.216802 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.216685 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a-original-pull-secret\") pod \"global-pull-secret-syncer-h2th6\" (UID: \"2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a\") " pod="kube-system/global-pull-secret-syncer-h2th6" Sep 11 02:52:57.216802 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.216709 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/958470e1-b0b5-42c0-a6ad-b81f134eb760-etc-sysconfig\") pod \"tuned-x6s5v\" (UID: \"958470e1-b0b5-42c0-a6ad-b81f134eb760\") " pod="openshift-cluster-node-tuning-operator/tuned-x6s5v" Sep 11 02:52:57.216802 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.216730 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/958470e1-b0b5-42c0-a6ad-b81f134eb760-etc-kubernetes\") pod \"tuned-x6s5v\" (UID: \"958470e1-b0b5-42c0-a6ad-b81f134eb760\") " pod="openshift-cluster-node-tuning-operator/tuned-x6s5v" Sep 11 02:52:57.217769 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.217408 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lh4rj" Sep 11 02:52:57.218114 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.218095 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 11 02:52:57.218248 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.218228 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 11 02:52:57.218318 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.218301 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-96c7n\"" Sep 11 02:52:57.218373 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.218360 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 11 02:52:57.219683 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.219665 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qb9m9" Sep 11 02:52:57.219763 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.219730 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 11 02:52:57.219763 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:52:57.219727 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qb9m9" podUID="1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237" Sep 11 02:52:57.220216 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.220199 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 11 02:52:57.221397 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.220202 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zx58n\"" Sep 11 02:52:57.221397 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.220690 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 11 02:52:57.221397 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.221209 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 11 02:52:57.221397 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.221280 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 11 02:52:57.221680 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.221430 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 11 02:52:57.224140 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.224122 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" Sep 11 02:52:57.226523 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.226507 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-j54mv" Sep 11 02:52:57.226773 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.226755 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 11 02:52:57.226773 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.226765 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 11 02:52:57.226940 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.226925 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-swnfn\"" Sep 11 02:52:57.227001 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.226974 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 11 02:52:57.227054 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.227000 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 11 02:52:57.228467 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.228451 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 11 02:52:57.228558 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.228452 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 11 02:52:57.229035 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.229016 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-p5427" Sep 11 02:52:57.229537 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.229518 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-sk7l2\"" Sep 11 02:52:57.229607 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.229541 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 11 02:52:57.231413 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.231397 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 11 02:52:57.231560 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.231541 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 11 02:52:57.231704 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.231478 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5qzk7" Sep 11 02:52:57.231704 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.231609 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 11 02:52:57.231704 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.231691 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-p5frv\"" Sep 11 02:52:57.234235 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.234219 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 11 02:52:57.234448 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.234426 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-x7wjp\"" Sep 11 02:52:57.234541 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.234462 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 11 02:52:57.237596 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.237576 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-27tch" Sep 11 02:52:57.245749 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.245712 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-27tch" Sep 11 02:52:57.308478 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.308460 2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 11 02:52:57.317944 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.317863 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7fba1324-3940-475b-9d4d-4557d2c7f603-system-cni-dir\") pod \"multus-additional-cni-plugins-lh4rj\" (UID: \"7fba1324-3940-475b-9d4d-4557d2c7f603\") " pod="openshift-multus/multus-additional-cni-plugins-lh4rj" Sep 11 02:52:57.318036 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.317959 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7fba1324-3940-475b-9d4d-4557d2c7f603-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lh4rj\" (UID: \"7fba1324-3940-475b-9d4d-4557d2c7f603\") " pod="openshift-multus/multus-additional-cni-plugins-lh4rj" Sep 11 02:52:57.318036 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.317988 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbd2d\" (UniqueName: \"kubernetes.io/projected/7fba1324-3940-475b-9d4d-4557d2c7f603-kube-api-access-jbd2d\") pod \"multus-additional-cni-plugins-lh4rj\" (UID: \"7fba1324-3940-475b-9d4d-4557d2c7f603\") " pod="openshift-multus/multus-additional-cni-plugins-lh4rj" Sep 11 02:52:57.318036 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.318012 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/20839eea-3cc5-49bd-9112-ec0fe94ae537-host-run-multus-certs\") pod \"multus-j54mv\" (UID: \"20839eea-3cc5-49bd-9112-ec0fe94ae537\") " pod="openshift-multus/multus-j54mv" Sep 11 02:52:57.318196 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.318036 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/20839eea-3cc5-49bd-9112-ec0fe94ae537-etc-kubernetes\") pod \"multus-j54mv\" (UID: \"20839eea-3cc5-49bd-9112-ec0fe94ae537\") " pod="openshift-multus/multus-j54mv" Sep 11 02:52:57.318196 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.318058 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77be8a04-830c-44b1-b712-725ffff73a4e-var-lib-openvswitch\") pod \"ovnkube-node-jv2sz\" (UID: \"77be8a04-830c-44b1-b712-725ffff73a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" Sep 11 02:52:57.318196 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.318082 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f5755599-e56c-401d-bec3-6543e0f8ab40-tmp-dir\") pod \"node-resolver-5qzk7\" (UID: \"f5755599-e56c-401d-bec3-6543e0f8ab40\") " pod="openshift-dns/node-resolver-5qzk7" Sep 11 02:52:57.318196 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.318105 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/77be8a04-830c-44b1-b712-725ffff73a4e-run-systemd\") pod \"ovnkube-node-jv2sz\" (UID: \"77be8a04-830c-44b1-b712-725ffff73a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" Sep 11 02:52:57.318196 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.318127 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4dtd\" (UniqueName: \"kubernetes.io/projected/2167cf85-9290-4962-9f9c-ba69f4fd3866-kube-api-access-k4dtd\") pod \"iptables-alerter-p5427\" (UID: \"2167cf85-9290-4962-9f9c-ba69f4fd3866\") " pod="openshift-network-operator/iptables-alerter-p5427" Sep 11 02:52:57.318196 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.318148 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/958470e1-b0b5-42c0-a6ad-b81f134eb760-host\") pod \"tuned-x6s5v\" (UID: \"958470e1-b0b5-42c0-a6ad-b81f134eb760\") " pod="openshift-cluster-node-tuning-operator/tuned-x6s5v" Sep 11 02:52:57.318196 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.318162 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdktk\" (UniqueName: \"kubernetes.io/projected/958470e1-b0b5-42c0-a6ad-b81f134eb760-kube-api-access-jdktk\") pod \"tuned-x6s5v\" (UID: \"958470e1-b0b5-42c0-a6ad-b81f134eb760\") " pod="openshift-cluster-node-tuning-operator/tuned-x6s5v" Sep 11 02:52:57.318196 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.318188 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cad088c2-48c1-4e27-83e0-40244586b0c0-serviceca\") pod \"node-ca-d26rx\" (UID: \"cad088c2-48c1-4e27-83e0-40244586b0c0\") " pod="openshift-image-registry/node-ca-d26rx" Sep 11 02:52:57.318443 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.318203 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7fba1324-3940-475b-9d4d-4557d2c7f603-cni-binary-copy\") pod \"multus-additional-cni-plugins-lh4rj\" (UID: \"7fba1324-3940-475b-9d4d-4557d2c7f603\") " pod="openshift-multus/multus-additional-cni-plugins-lh4rj" Sep 11 02:52:57.318443 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.318217 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7fba1324-3940-475b-9d4d-4557d2c7f603-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lh4rj\" (UID: \"7fba1324-3940-475b-9d4d-4557d2c7f603\") " pod="openshift-multus/multus-additional-cni-plugins-lh4rj" Sep 11 02:52:57.318443 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.318231 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/20839eea-3cc5-49bd-9112-ec0fe94ae537-cnibin\") pod \"multus-j54mv\" (UID: \"20839eea-3cc5-49bd-9112-ec0fe94ae537\") " pod="openshift-multus/multus-j54mv" Sep 11 02:52:57.318443 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.318260 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/20839eea-3cc5-49bd-9112-ec0fe94ae537-multus-socket-dir-parent\") pod \"multus-j54mv\" (UID: \"20839eea-3cc5-49bd-9112-ec0fe94ae537\") " pod="openshift-multus/multus-j54mv" Sep 11 02:52:57.318443 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.318276 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/958470e1-b0b5-42c0-a6ad-b81f134eb760-etc-systemd\") pod \"tuned-x6s5v\" (UID: \"958470e1-b0b5-42c0-a6ad-b81f134eb760\") " pod="openshift-cluster-node-tuning-operator/tuned-x6s5v" Sep 11 02:52:57.318443 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.318291 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7fba1324-3940-475b-9d4d-4557d2c7f603-cnibin\") pod \"multus-additional-cni-plugins-lh4rj\" (UID: \"7fba1324-3940-475b-9d4d-4557d2c7f603\") " pod="openshift-multus/multus-additional-cni-plugins-lh4rj" Sep 11 02:52:57.318443 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.318305 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f5cae9bb-577e-402b-a4be-e44745036dc9-device-dir\") pod \"aws-ebs-csi-driver-node-fncs7\" (UID: \"f5cae9bb-577e-402b-a4be-e44745036dc9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fncs7" Sep 11 02:52:57.318443 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.318326 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f5cae9bb-577e-402b-a4be-e44745036dc9-etc-selinux\") pod \"aws-ebs-csi-driver-node-fncs7\" (UID: \"f5cae9bb-577e-402b-a4be-e44745036dc9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fncs7" Sep 11 02:52:57.318443 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.318342 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/77be8a04-830c-44b1-b712-725ffff73a4e-host-slash\") pod \"ovnkube-node-jv2sz\" (UID: \"77be8a04-830c-44b1-b712-725ffff73a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" Sep 11 02:52:57.318443 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.318355 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77be8a04-830c-44b1-b712-725ffff73a4e-run-openvswitch\") pod \"ovnkube-node-jv2sz\" (UID: \"77be8a04-830c-44b1-b712-725ffff73a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" Sep 11 02:52:57.318443 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.318369 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/958470e1-b0b5-42c0-a6ad-b81f134eb760-etc-kubernetes\") pod \"tuned-x6s5v\" (UID: \"958470e1-b0b5-42c0-a6ad-b81f134eb760\") " pod="openshift-cluster-node-tuning-operator/tuned-x6s5v" Sep 11 02:52:57.318443 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.318382 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/958470e1-b0b5-42c0-a6ad-b81f134eb760-sys\") pod \"tuned-x6s5v\" (UID: \"958470e1-b0b5-42c0-a6ad-b81f134eb760\") " pod="openshift-cluster-node-tuning-operator/tuned-x6s5v" Sep 11 02:52:57.318443 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.318395 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/20839eea-3cc5-49bd-9112-ec0fe94ae537-hostroot\") pod \"multus-j54mv\" (UID: \"20839eea-3cc5-49bd-9112-ec0fe94ae537\") " pod="openshift-multus/multus-j54mv" Sep 11 02:52:57.318443 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.318417 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f5cae9bb-577e-402b-a4be-e44745036dc9-registration-dir\") pod \"aws-ebs-csi-driver-node-fncs7\" (UID: \"f5cae9bb-577e-402b-a4be-e44745036dc9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fncs7" Sep 11 02:52:57.318443 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.318430 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/77be8a04-830c-44b1-b712-725ffff73a4e-node-log\") pod \"ovnkube-node-jv2sz\" (UID: \"77be8a04-830c-44b1-b712-725ffff73a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" Sep 11 02:52:57.318956 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.318463 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/77be8a04-830c-44b1-b712-725ffff73a4e-ovnkube-script-lib\") pod \"ovnkube-node-jv2sz\" (UID: \"77be8a04-830c-44b1-b712-725ffff73a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" Sep 11 02:52:57.318956 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.318491 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2167cf85-9290-4962-9f9c-ba69f4fd3866-iptables-alerter-script\") pod \"iptables-alerter-p5427\" (UID: \"2167cf85-9290-4962-9f9c-ba69f4fd3866\") " pod="openshift-network-operator/iptables-alerter-p5427" Sep 11 02:52:57.318956 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.318515 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/958470e1-b0b5-42c0-a6ad-b81f134eb760-etc-sysctl-conf\") pod \"tuned-x6s5v\" (UID: \"958470e1-b0b5-42c0-a6ad-b81f134eb760\") " pod="openshift-cluster-node-tuning-operator/tuned-x6s5v" Sep 11 02:52:57.318956 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.318537 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/958470e1-b0b5-42c0-a6ad-b81f134eb760-tmp\") pod \"tuned-x6s5v\" (UID: \"958470e1-b0b5-42c0-a6ad-b81f134eb760\") " pod="openshift-cluster-node-tuning-operator/tuned-x6s5v" Sep 11 02:52:57.318956 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.318575 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/20839eea-3cc5-49bd-9112-ec0fe94ae537-host-run-k8s-cni-cncf-io\") pod \"multus-j54mv\" (UID: \"20839eea-3cc5-49bd-9112-ec0fe94ae537\") " pod="openshift-multus/multus-j54mv" Sep 11 02:52:57.318956 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.318598 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8t2s9\" (UniqueName: \"kubernetes.io/projected/20839eea-3cc5-49bd-9112-ec0fe94ae537-kube-api-access-8t2s9\") pod \"multus-j54mv\" (UID: \"20839eea-3cc5-49bd-9112-ec0fe94ae537\") " pod="openshift-multus/multus-j54mv" Sep 11 02:52:57.318956 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.318639 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/77be8a04-830c-44b1-b712-725ffff73a4e-systemd-units\") pod \"ovnkube-node-jv2sz\" (UID: \"77be8a04-830c-44b1-b712-725ffff73a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" Sep 11 02:52:57.318956 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.318672 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/958470e1-b0b5-42c0-a6ad-b81f134eb760-lib-modules\") pod \"tuned-x6s5v\" (UID: \"958470e1-b0b5-42c0-a6ad-b81f134eb760\") " pod="openshift-cluster-node-tuning-operator/tuned-x6s5v" Sep 11 02:52:57.318956 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.318692 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/20839eea-3cc5-49bd-9112-ec0fe94ae537-cni-binary-copy\") pod \"multus-j54mv\" (UID: \"20839eea-3cc5-49bd-9112-ec0fe94ae537\") " pod="openshift-multus/multus-j54mv" Sep 11 02:52:57.318956 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.318706 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f5cae9bb-577e-402b-a4be-e44745036dc9-socket-dir\") pod \"aws-ebs-csi-driver-node-fncs7\" (UID: \"f5cae9bb-577e-402b-a4be-e44745036dc9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fncs7" Sep 11 02:52:57.318956 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.318726 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/77be8a04-830c-44b1-b712-725ffff73a4e-host-cni-netd\") pod \"ovnkube-node-jv2sz\" (UID: \"77be8a04-830c-44b1-b712-725ffff73a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" Sep 11 02:52:57.318956 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.318746 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/77be8a04-830c-44b1-b712-725ffff73a4e-env-overrides\") pod \"ovnkube-node-jv2sz\" (UID: \"77be8a04-830c-44b1-b712-725ffff73a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" Sep 11 02:52:57.318956 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.318762 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/958470e1-b0b5-42c0-a6ad-b81f134eb760-var-lib-kubelet\") pod \"tuned-x6s5v\" (UID: \"958470e1-b0b5-42c0-a6ad-b81f134eb760\") " pod="openshift-cluster-node-tuning-operator/tuned-x6s5v" Sep 11 02:52:57.318956 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.318777 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a-original-pull-secret\") pod \"global-pull-secret-syncer-h2th6\" (UID: \"2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a\") " pod="kube-system/global-pull-secret-syncer-h2th6" Sep 11 02:52:57.318956 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.318806 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrc86\" (UniqueName: \"kubernetes.io/projected/dffb443d-1d41-4705-a57d-1dbad16fff80-kube-api-access-jrc86\") pod \"network-check-target-pxq8g\" (UID: \"dffb443d-1d41-4705-a57d-1dbad16fff80\") " pod="openshift-network-diagnostics/network-check-target-pxq8g" Sep 11 02:52:57.318956 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.318833 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f5755599-e56c-401d-bec3-6543e0f8ab40-hosts-file\") pod \"node-resolver-5qzk7\" (UID: \"f5755599-e56c-401d-bec3-6543e0f8ab40\") " pod="openshift-dns/node-resolver-5qzk7" Sep 11 02:52:57.319613 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.318848 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77be8a04-830c-44b1-b712-725ffff73a4e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jv2sz\" (UID: \"77be8a04-830c-44b1-b712-725ffff73a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" Sep 11 02:52:57.319613 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.318865 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/958470e1-b0b5-42c0-a6ad-b81f134eb760-etc-sysconfig\") pod \"tuned-x6s5v\" (UID: \"958470e1-b0b5-42c0-a6ad-b81f134eb760\") " pod="openshift-cluster-node-tuning-operator/tuned-x6s5v" Sep 11 02:52:57.319613 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.318885 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/20839eea-3cc5-49bd-9112-ec0fe94ae537-host-var-lib-cni-multus\") pod \"multus-j54mv\" (UID: \"20839eea-3cc5-49bd-9112-ec0fe94ae537\") " pod="openshift-multus/multus-j54mv" Sep 11 02:52:57.319613 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.318908 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/20839eea-3cc5-49bd-9112-ec0fe94ae537-host-var-lib-kubelet\") pod \"multus-j54mv\" (UID: \"20839eea-3cc5-49bd-9112-ec0fe94ae537\") " pod="openshift-multus/multus-j54mv" Sep 11 02:52:57.319613 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.318925 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2167cf85-9290-4962-9f9c-ba69f4fd3866-host-slash\") pod \"iptables-alerter-p5427\" (UID: \"2167cf85-9290-4962-9f9c-ba69f4fd3866\") " pod="openshift-network-operator/iptables-alerter-p5427" Sep 11 02:52:57.319613 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.318941 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237-metrics-certs\") pod \"network-metrics-daemon-qb9m9\" (UID: \"1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237\") " pod="openshift-multus/network-metrics-daemon-qb9m9" Sep 11 02:52:57.319613 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.318961 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22h6d\" (UniqueName: \"kubernetes.io/projected/1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237-kube-api-access-22h6d\") pod \"network-metrics-daemon-qb9m9\" (UID: \"1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237\") " pod="openshift-multus/network-metrics-daemon-qb9m9" Sep 11 02:52:57.319613 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.318984 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/958470e1-b0b5-42c0-a6ad-b81f134eb760-etc-modprobe-d\") pod \"tuned-x6s5v\" (UID: \"958470e1-b0b5-42c0-a6ad-b81f134eb760\") " pod="openshift-cluster-node-tuning-operator/tuned-x6s5v" Sep 11 02:52:57.319613 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.319009 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a-kubelet-config\") pod \"global-pull-secret-syncer-h2th6\" (UID: \"2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a\") " pod="kube-system/global-pull-secret-syncer-h2th6" Sep 11 02:52:57.319613 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.319033 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/20839eea-3cc5-49bd-9112-ec0fe94ae537-multus-cni-dir\") pod \"multus-j54mv\" (UID: \"20839eea-3cc5-49bd-9112-ec0fe94ae537\") " pod="openshift-multus/multus-j54mv" Sep 11 02:52:57.319613 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.319067 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/77be8a04-830c-44b1-b712-725ffff73a4e-log-socket\") pod \"ovnkube-node-jv2sz\" (UID: \"77be8a04-830c-44b1-b712-725ffff73a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" Sep 11 02:52:57.319613 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.319090 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/77be8a04-830c-44b1-b712-725ffff73a4e-ovnkube-config\") pod \"ovnkube-node-jv2sz\" (UID: \"77be8a04-830c-44b1-b712-725ffff73a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" Sep 11 02:52:57.319613 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.319116 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gg78t\" (UniqueName: \"kubernetes.io/projected/77be8a04-830c-44b1-b712-725ffff73a4e-kube-api-access-gg78t\") pod \"ovnkube-node-jv2sz\" (UID: \"77be8a04-830c-44b1-b712-725ffff73a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" Sep 11 02:52:57.319613 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.319140 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/958470e1-b0b5-42c0-a6ad-b81f134eb760-etc-sysctl-d\") pod \"tuned-x6s5v\" (UID: \"958470e1-b0b5-42c0-a6ad-b81f134eb760\") " pod="openshift-cluster-node-tuning-operator/tuned-x6s5v" Sep 11 02:52:57.319613 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.319172 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/20839eea-3cc5-49bd-9112-ec0fe94ae537-system-cni-dir\") pod \"multus-j54mv\" (UID: \"20839eea-3cc5-49bd-9112-ec0fe94ae537\") " pod="openshift-multus/multus-j54mv" Sep 11 02:52:57.319613 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.319197 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/77be8a04-830c-44b1-b712-725ffff73a4e-host-kubelet\") pod \"ovnkube-node-jv2sz\" (UID: \"77be8a04-830c-44b1-b712-725ffff73a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" Sep 11 02:52:57.320158 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.319221 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/77be8a04-830c-44b1-b712-725ffff73a4e-host-cni-bin\") pod \"ovnkube-node-jv2sz\" (UID: \"77be8a04-830c-44b1-b712-725ffff73a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" Sep 11 02:52:57.320158 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.319244 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/958470e1-b0b5-42c0-a6ad-b81f134eb760-run\") pod \"tuned-x6s5v\" (UID: \"958470e1-b0b5-42c0-a6ad-b81f134eb760\") " pod="openshift-cluster-node-tuning-operator/tuned-x6s5v" Sep 11 02:52:57.320158 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.319269 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cad088c2-48c1-4e27-83e0-40244586b0c0-host\") pod \"node-ca-d26rx\" (UID: \"cad088c2-48c1-4e27-83e0-40244586b0c0\") " pod="openshift-image-registry/node-ca-d26rx" Sep 11 02:52:57.320158 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.319293 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/20839eea-3cc5-49bd-9112-ec0fe94ae537-host-run-netns\") pod \"multus-j54mv\" (UID: \"20839eea-3cc5-49bd-9112-ec0fe94ae537\") " pod="openshift-multus/multus-j54mv" Sep 11 02:52:57.320158 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.319309 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/20839eea-3cc5-49bd-9112-ec0fe94ae537-multus-conf-dir\") pod \"multus-j54mv\" (UID: \"20839eea-3cc5-49bd-9112-ec0fe94ae537\") " pod="openshift-multus/multus-j54mv" Sep 11 02:52:57.320158 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.319323 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f5cae9bb-577e-402b-a4be-e44745036dc9-sys-fs\") pod \"aws-ebs-csi-driver-node-fncs7\" (UID: \"f5cae9bb-577e-402b-a4be-e44745036dc9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fncs7" Sep 11 02:52:57.320158 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.319338 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/77be8a04-830c-44b1-b712-725ffff73a4e-host-run-netns\") pod \"ovnkube-node-jv2sz\" (UID: \"77be8a04-830c-44b1-b712-725ffff73a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" Sep 11 02:52:57.320158 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.319358 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77be8a04-830c-44b1-b712-725ffff73a4e-host-run-ovn-kubernetes\") pod \"ovnkube-node-jv2sz\" (UID: \"77be8a04-830c-44b1-b712-725ffff73a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" Sep 11 02:52:57.320158 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.319374 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c31501a3-cea9-47fd-af08-6fb89a5d3e6c-agent-certs\") pod \"konnectivity-agent-tzxkr\" (UID: \"c31501a3-cea9-47fd-af08-6fb89a5d3e6c\") " pod="kube-system/konnectivity-agent-tzxkr" Sep 11 02:52:57.320158 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.319392 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54bcr\" (UniqueName: \"kubernetes.io/projected/f5cae9bb-577e-402b-a4be-e44745036dc9-kube-api-access-54bcr\") pod \"aws-ebs-csi-driver-node-fncs7\" (UID: \"f5cae9bb-577e-402b-a4be-e44745036dc9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fncs7" Sep 11 02:52:57.320158 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.319409 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a-dbus\") pod \"global-pull-secret-syncer-h2th6\" (UID: \"2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a\") " pod="kube-system/global-pull-secret-syncer-h2th6" Sep 11 02:52:57.320158 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.319430 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/20839eea-3cc5-49bd-9112-ec0fe94ae537-multus-daemon-config\") pod \"multus-j54mv\" (UID: \"20839eea-3cc5-49bd-9112-ec0fe94ae537\") " pod="openshift-multus/multus-j54mv" Sep 11 02:52:57.320158 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.319445 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j247k\" (UniqueName: \"kubernetes.io/projected/f5755599-e56c-401d-bec3-6543e0f8ab40-kube-api-access-j247k\") pod \"node-resolver-5qzk7\" (UID: \"f5755599-e56c-401d-bec3-6543e0f8ab40\") " pod="openshift-dns/node-resolver-5qzk7" Sep 11 02:52:57.320158 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.319460 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f5cae9bb-577e-402b-a4be-e44745036dc9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fncs7\" (UID: \"f5cae9bb-577e-402b-a4be-e44745036dc9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fncs7" Sep 11 02:52:57.320158 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.319476 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77be8a04-830c-44b1-b712-725ffff73a4e-etc-openvswitch\") pod \"ovnkube-node-jv2sz\" (UID: \"77be8a04-830c-44b1-b712-725ffff73a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" Sep 11 02:52:57.320158 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.319498 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/958470e1-b0b5-42c0-a6ad-b81f134eb760-etc-tuned\") pod \"tuned-x6s5v\" (UID: \"958470e1-b0b5-42c0-a6ad-b81f134eb760\") " pod="openshift-cluster-node-tuning-operator/tuned-x6s5v" Sep 11 02:52:57.320158 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.319514 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7fba1324-3940-475b-9d4d-4557d2c7f603-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lh4rj\" (UID: \"7fba1324-3940-475b-9d4d-4557d2c7f603\") " pod="openshift-multus/multus-additional-cni-plugins-lh4rj" Sep 11 02:52:57.320705 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.319537 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/20839eea-3cc5-49bd-9112-ec0fe94ae537-host-var-lib-cni-bin\") pod \"multus-j54mv\" (UID: \"20839eea-3cc5-49bd-9112-ec0fe94ae537\") " pod="openshift-multus/multus-j54mv" Sep 11 02:52:57.320705 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.319552 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/77be8a04-830c-44b1-b712-725ffff73a4e-run-ovn\") pod \"ovnkube-node-jv2sz\" (UID: \"77be8a04-830c-44b1-b712-725ffff73a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" Sep 11 02:52:57.320705 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.319567 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/77be8a04-830c-44b1-b712-725ffff73a4e-ovn-node-metrics-cert\") pod \"ovnkube-node-jv2sz\" (UID: \"77be8a04-830c-44b1-b712-725ffff73a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" Sep 11 02:52:57.320705 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.319584 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tf6dd\" (UniqueName: \"kubernetes.io/projected/cad088c2-48c1-4e27-83e0-40244586b0c0-kube-api-access-tf6dd\") pod \"node-ca-d26rx\" (UID: \"cad088c2-48c1-4e27-83e0-40244586b0c0\") " pod="openshift-image-registry/node-ca-d26rx" Sep 11 02:52:57.320705 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.319604 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c31501a3-cea9-47fd-af08-6fb89a5d3e6c-konnectivity-ca\") pod \"konnectivity-agent-tzxkr\" (UID: \"c31501a3-cea9-47fd-af08-6fb89a5d3e6c\") " pod="kube-system/konnectivity-agent-tzxkr" Sep 11 02:52:57.320705 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.319746 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/958470e1-b0b5-42c0-a6ad-b81f134eb760-host\") pod \"tuned-x6s5v\" (UID: \"958470e1-b0b5-42c0-a6ad-b81f134eb760\") " pod="openshift-cluster-node-tuning-operator/tuned-x6s5v" Sep 11 02:52:57.320705 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.320332 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cad088c2-48c1-4e27-83e0-40244586b0c0-serviceca\") pod \"node-ca-d26rx\" (UID: \"cad088c2-48c1-4e27-83e0-40244586b0c0\") " pod="openshift-image-registry/node-ca-d26rx" Sep 11 02:52:57.320705 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.320455 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/958470e1-b0b5-42c0-a6ad-b81f134eb760-etc-systemd\") pod \"tuned-x6s5v\" (UID: \"958470e1-b0b5-42c0-a6ad-b81f134eb760\") " pod="openshift-cluster-node-tuning-operator/tuned-x6s5v" Sep 11 02:52:57.320705 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.320567 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/958470e1-b0b5-42c0-a6ad-b81f134eb760-etc-kubernetes\") pod \"tuned-x6s5v\" (UID: \"958470e1-b0b5-42c0-a6ad-b81f134eb760\") " pod="openshift-cluster-node-tuning-operator/tuned-x6s5v" Sep 11 02:52:57.320705 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.320608 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/958470e1-b0b5-42c0-a6ad-b81f134eb760-sys\") pod \"tuned-x6s5v\" (UID: \"958470e1-b0b5-42c0-a6ad-b81f134eb760\") " pod="openshift-cluster-node-tuning-operator/tuned-x6s5v" Sep 11 02:52:57.321172 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.320875 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/958470e1-b0b5-42c0-a6ad-b81f134eb760-etc-sysctl-conf\") pod \"tuned-x6s5v\" (UID: \"958470e1-b0b5-42c0-a6ad-b81f134eb760\") " pod="openshift-cluster-node-tuning-operator/tuned-x6s5v" Sep 11 02:52:57.321225 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.321197 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/958470e1-b0b5-42c0-a6ad-b81f134eb760-etc-sysctl-d\") pod \"tuned-x6s5v\" (UID: \"958470e1-b0b5-42c0-a6ad-b81f134eb760\") " pod="openshift-cluster-node-tuning-operator/tuned-x6s5v" Sep 11 02:52:57.321435 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.321414 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/958470e1-b0b5-42c0-a6ad-b81f134eb760-lib-modules\") pod \"tuned-x6s5v\" (UID: \"958470e1-b0b5-42c0-a6ad-b81f134eb760\") " pod="openshift-cluster-node-tuning-operator/tuned-x6s5v" Sep 11 02:52:57.321543 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.321518 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/958470e1-b0b5-42c0-a6ad-b81f134eb760-var-lib-kubelet\") pod \"tuned-x6s5v\" (UID: \"958470e1-b0b5-42c0-a6ad-b81f134eb760\") " pod="openshift-cluster-node-tuning-operator/tuned-x6s5v" Sep 11 02:52:57.321672 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:52:57.321652 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 02:52:57.321874 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.321860 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/958470e1-b0b5-42c0-a6ad-b81f134eb760-run\") pod \"tuned-x6s5v\" (UID: \"958470e1-b0b5-42c0-a6ad-b81f134eb760\") " pod="openshift-cluster-node-tuning-operator/tuned-x6s5v" Sep 11 02:52:57.321935 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.321927 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/958470e1-b0b5-42c0-a6ad-b81f134eb760-etc-modprobe-d\") pod \"tuned-x6s5v\" (UID: \"958470e1-b0b5-42c0-a6ad-b81f134eb760\") " pod="openshift-cluster-node-tuning-operator/tuned-x6s5v" Sep 11 02:52:57.322036 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.322021 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a-kubelet-config\") pod \"global-pull-secret-syncer-h2th6\" (UID: \"2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a\") " pod="kube-system/global-pull-secret-syncer-h2th6" Sep 11 02:52:57.322084 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.322072 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cad088c2-48c1-4e27-83e0-40244586b0c0-host\") pod \"node-ca-d26rx\" (UID: \"cad088c2-48c1-4e27-83e0-40244586b0c0\") " pod="openshift-image-registry/node-ca-d26rx" Sep 11 02:52:57.322159 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.322138 2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 11 02:52:57.322638 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.322593 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a-dbus\") pod \"global-pull-secret-syncer-h2th6\" (UID: \"2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a\") " pod="kube-system/global-pull-secret-syncer-h2th6" Sep 11 02:52:57.322808 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.322788 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/958470e1-b0b5-42c0-a6ad-b81f134eb760-etc-sysconfig\") pod \"tuned-x6s5v\" (UID: \"958470e1-b0b5-42c0-a6ad-b81f134eb760\") " pod="openshift-cluster-node-tuning-operator/tuned-x6s5v" Sep 11 02:52:57.322857 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:52:57.322837 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a-original-pull-secret podName:2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a nodeName:}" failed. No retries permitted until 2026-09-11 02:52:57.822805075 +0000 UTC m=+2.962128264 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a-original-pull-secret") pod "global-pull-secret-syncer-h2th6" (UID: "2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a") : object "kube-system"/"original-pull-secret" not registered Sep 11 02:52:57.326478 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.326359 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/958470e1-b0b5-42c0-a6ad-b81f134eb760-etc-tuned\") pod \"tuned-x6s5v\" (UID: \"958470e1-b0b5-42c0-a6ad-b81f134eb760\") " pod="openshift-cluster-node-tuning-operator/tuned-x6s5v" Sep 11 02:52:57.329096 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.329075 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdktk\" (UniqueName: \"kubernetes.io/projected/958470e1-b0b5-42c0-a6ad-b81f134eb760-kube-api-access-jdktk\") pod \"tuned-x6s5v\" (UID: \"958470e1-b0b5-42c0-a6ad-b81f134eb760\") " pod="openshift-cluster-node-tuning-operator/tuned-x6s5v" Sep 11 02:52:57.330603 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.330582 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/958470e1-b0b5-42c0-a6ad-b81f134eb760-tmp\") pod \"tuned-x6s5v\" (UID: \"958470e1-b0b5-42c0-a6ad-b81f134eb760\") " pod="openshift-cluster-node-tuning-operator/tuned-x6s5v" Sep 11 02:52:57.331196 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.331173 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tf6dd\" (UniqueName: \"kubernetes.io/projected/cad088c2-48c1-4e27-83e0-40244586b0c0-kube-api-access-tf6dd\") pod \"node-ca-d26rx\" (UID: \"cad088c2-48c1-4e27-83e0-40244586b0c0\") " pod="openshift-image-registry/node-ca-d26rx" Sep 11 02:52:57.342498 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.342451 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-210.ec2.internal" event={"ID":"8374f836a1cb97d92580857849ff95ac","Type":"ContainerStarted","Data":"bbcc92fd73b90730854b441b82693a92f065f425d11981d8729cfecae30fdc7c"} Sep 11 02:52:57.344250 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.344228 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-210.ec2.internal" event={"ID":"d79d7fb3dbee895c79a46f52d8374f34","Type":"ContainerStarted","Data":"be436a9d312700b87f4471c51dfd764010c80d4de002a404fce3c71fce5a76ce"} Sep 11 02:52:57.420709 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.420678 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/20839eea-3cc5-49bd-9112-ec0fe94ae537-system-cni-dir\") pod \"multus-j54mv\" (UID: \"20839eea-3cc5-49bd-9112-ec0fe94ae537\") " pod="openshift-multus/multus-j54mv" Sep 11 02:52:57.420876 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.420719 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/77be8a04-830c-44b1-b712-725ffff73a4e-host-kubelet\") pod \"ovnkube-node-jv2sz\" (UID: \"77be8a04-830c-44b1-b712-725ffff73a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" Sep 11 02:52:57.420876 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.420743 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/77be8a04-830c-44b1-b712-725ffff73a4e-host-cni-bin\") pod \"ovnkube-node-jv2sz\" (UID: \"77be8a04-830c-44b1-b712-725ffff73a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" Sep 11 02:52:57.420876 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.420768 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/20839eea-3cc5-49bd-9112-ec0fe94ae537-host-run-netns\") pod \"multus-j54mv\" (UID: \"20839eea-3cc5-49bd-9112-ec0fe94ae537\") " pod="openshift-multus/multus-j54mv" Sep 11 02:52:57.420876 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.420811 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/20839eea-3cc5-49bd-9112-ec0fe94ae537-multus-conf-dir\") pod \"multus-j54mv\" (UID: \"20839eea-3cc5-49bd-9112-ec0fe94ae537\") " pod="openshift-multus/multus-j54mv" Sep 11 02:52:57.420876 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.420817 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/20839eea-3cc5-49bd-9112-ec0fe94ae537-system-cni-dir\") pod \"multus-j54mv\" (UID: \"20839eea-3cc5-49bd-9112-ec0fe94ae537\") " pod="openshift-multus/multus-j54mv" Sep 11 02:52:57.420876 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.420833 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f5cae9bb-577e-402b-a4be-e44745036dc9-sys-fs\") pod \"aws-ebs-csi-driver-node-fncs7\" (UID: \"f5cae9bb-577e-402b-a4be-e44745036dc9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fncs7" Sep 11 02:52:57.420876 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.420829 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/77be8a04-830c-44b1-b712-725ffff73a4e-host-cni-bin\") pod \"ovnkube-node-jv2sz\" (UID: \"77be8a04-830c-44b1-b712-725ffff73a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" Sep 11 02:52:57.420876 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.420817 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/77be8a04-830c-44b1-b712-725ffff73a4e-host-kubelet\") pod \"ovnkube-node-jv2sz\" (UID: \"77be8a04-830c-44b1-b712-725ffff73a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" Sep 11 02:52:57.420876 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.420852 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/20839eea-3cc5-49bd-9112-ec0fe94ae537-host-run-netns\") pod \"multus-j54mv\" (UID: \"20839eea-3cc5-49bd-9112-ec0fe94ae537\") " pod="openshift-multus/multus-j54mv" Sep 11 02:52:57.420876 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.420872 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/20839eea-3cc5-49bd-9112-ec0fe94ae537-multus-conf-dir\") pod \"multus-j54mv\" (UID: \"20839eea-3cc5-49bd-9112-ec0fe94ae537\") " pod="openshift-multus/multus-j54mv" Sep 11 02:52:57.421367 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.420881 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f5cae9bb-577e-402b-a4be-e44745036dc9-sys-fs\") pod \"aws-ebs-csi-driver-node-fncs7\" (UID: \"f5cae9bb-577e-402b-a4be-e44745036dc9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fncs7" Sep 11 02:52:57.421367 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.420882 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/77be8a04-830c-44b1-b712-725ffff73a4e-host-run-netns\") pod \"ovnkube-node-jv2sz\" (UID: \"77be8a04-830c-44b1-b712-725ffff73a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" Sep 11 02:52:57.421367 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.420913 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/77be8a04-830c-44b1-b712-725ffff73a4e-host-run-netns\") pod \"ovnkube-node-jv2sz\" (UID: \"77be8a04-830c-44b1-b712-725ffff73a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" Sep 11 02:52:57.421367 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.420930 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77be8a04-830c-44b1-b712-725ffff73a4e-host-run-ovn-kubernetes\") pod \"ovnkube-node-jv2sz\" (UID: \"77be8a04-830c-44b1-b712-725ffff73a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" Sep 11 02:52:57.421367 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.420955 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c31501a3-cea9-47fd-af08-6fb89a5d3e6c-agent-certs\") pod \"konnectivity-agent-tzxkr\" (UID: \"c31501a3-cea9-47fd-af08-6fb89a5d3e6c\") " pod="kube-system/konnectivity-agent-tzxkr" Sep 11 02:52:57.421367 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.420963 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77be8a04-830c-44b1-b712-725ffff73a4e-host-run-ovn-kubernetes\") pod \"ovnkube-node-jv2sz\" (UID: \"77be8a04-830c-44b1-b712-725ffff73a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" Sep 11 02:52:57.421367 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.420975 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54bcr\" (UniqueName: \"kubernetes.io/projected/f5cae9bb-577e-402b-a4be-e44745036dc9-kube-api-access-54bcr\") pod \"aws-ebs-csi-driver-node-fncs7\" (UID: \"f5cae9bb-577e-402b-a4be-e44745036dc9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fncs7" Sep 11 02:52:57.421367 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.420991 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/20839eea-3cc5-49bd-9112-ec0fe94ae537-multus-daemon-config\") pod \"multus-j54mv\" (UID: \"20839eea-3cc5-49bd-9112-ec0fe94ae537\") " pod="openshift-multus/multus-j54mv" Sep 11 02:52:57.421367 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.421007 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j247k\" (UniqueName: \"kubernetes.io/projected/f5755599-e56c-401d-bec3-6543e0f8ab40-kube-api-access-j247k\") pod \"node-resolver-5qzk7\" (UID: \"f5755599-e56c-401d-bec3-6543e0f8ab40\") " pod="openshift-dns/node-resolver-5qzk7" Sep 11 02:52:57.421367 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.421033 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f5cae9bb-577e-402b-a4be-e44745036dc9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fncs7\" (UID: \"f5cae9bb-577e-402b-a4be-e44745036dc9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fncs7" Sep 11 02:52:57.421367 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.421057 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77be8a04-830c-44b1-b712-725ffff73a4e-etc-openvswitch\") pod \"ovnkube-node-jv2sz\" (UID: \"77be8a04-830c-44b1-b712-725ffff73a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" Sep 11 02:52:57.421367 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.421100 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7fba1324-3940-475b-9d4d-4557d2c7f603-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lh4rj\" (UID: \"7fba1324-3940-475b-9d4d-4557d2c7f603\") " pod="openshift-multus/multus-additional-cni-plugins-lh4rj" Sep 11 02:52:57.421367 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.421138 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/20839eea-3cc5-49bd-9112-ec0fe94ae537-host-var-lib-cni-bin\") pod \"multus-j54mv\" (UID: \"20839eea-3cc5-49bd-9112-ec0fe94ae537\") " pod="openshift-multus/multus-j54mv" Sep 11 02:52:57.421367 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.421161 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/77be8a04-830c-44b1-b712-725ffff73a4e-run-ovn\") pod \"ovnkube-node-jv2sz\" (UID: \"77be8a04-830c-44b1-b712-725ffff73a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" Sep 11 02:52:57.421367 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.421186 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/77be8a04-830c-44b1-b712-725ffff73a4e-ovn-node-metrics-cert\") pod \"ovnkube-node-jv2sz\" (UID: \"77be8a04-830c-44b1-b712-725ffff73a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" Sep 11 02:52:57.421367 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.421195 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77be8a04-830c-44b1-b712-725ffff73a4e-etc-openvswitch\") pod \"ovnkube-node-jv2sz\" (UID: \"77be8a04-830c-44b1-b712-725ffff73a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" Sep 11 02:52:57.421367 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.421210 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c31501a3-cea9-47fd-af08-6fb89a5d3e6c-konnectivity-ca\") pod \"konnectivity-agent-tzxkr\" (UID: \"c31501a3-cea9-47fd-af08-6fb89a5d3e6c\") " pod="kube-system/konnectivity-agent-tzxkr" Sep 11 02:52:57.421884 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.421233 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7fba1324-3940-475b-9d4d-4557d2c7f603-system-cni-dir\") pod \"multus-additional-cni-plugins-lh4rj\" (UID: \"7fba1324-3940-475b-9d4d-4557d2c7f603\") " pod="openshift-multus/multus-additional-cni-plugins-lh4rj" Sep 11 02:52:57.421884 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.421249 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f5cae9bb-577e-402b-a4be-e44745036dc9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fncs7\" (UID: \"f5cae9bb-577e-402b-a4be-e44745036dc9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fncs7" Sep 11 02:52:57.421884 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.421258 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7fba1324-3940-475b-9d4d-4557d2c7f603-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lh4rj\" (UID: \"7fba1324-3940-475b-9d4d-4557d2c7f603\") " pod="openshift-multus/multus-additional-cni-plugins-lh4rj" Sep 11 02:52:57.421884 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.421283 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbd2d\" (UniqueName: \"kubernetes.io/projected/7fba1324-3940-475b-9d4d-4557d2c7f603-kube-api-access-jbd2d\") pod \"multus-additional-cni-plugins-lh4rj\" (UID: \"7fba1324-3940-475b-9d4d-4557d2c7f603\") " pod="openshift-multus/multus-additional-cni-plugins-lh4rj" Sep 11 02:52:57.421884 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.421283 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/77be8a04-830c-44b1-b712-725ffff73a4e-run-ovn\") pod \"ovnkube-node-jv2sz\" (UID: \"77be8a04-830c-44b1-b712-725ffff73a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" Sep 11 02:52:57.421884 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.421305 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/20839eea-3cc5-49bd-9112-ec0fe94ae537-host-run-multus-certs\") pod \"multus-j54mv\" (UID: \"20839eea-3cc5-49bd-9112-ec0fe94ae537\") " pod="openshift-multus/multus-j54mv" Sep 11 02:52:57.421884 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.421329 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/20839eea-3cc5-49bd-9112-ec0fe94ae537-etc-kubernetes\") pod \"multus-j54mv\" (UID: \"20839eea-3cc5-49bd-9112-ec0fe94ae537\") " pod="openshift-multus/multus-j54mv" Sep 11 02:52:57.421884 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.421351 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77be8a04-830c-44b1-b712-725ffff73a4e-var-lib-openvswitch\") pod \"ovnkube-node-jv2sz\" (UID: \"77be8a04-830c-44b1-b712-725ffff73a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" Sep 11 02:52:57.421884 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.421373 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f5755599-e56c-401d-bec3-6543e0f8ab40-tmp-dir\") pod \"node-resolver-5qzk7\" (UID: \"f5755599-e56c-401d-bec3-6543e0f8ab40\") " pod="openshift-dns/node-resolver-5qzk7" Sep 11 02:52:57.421884 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.421418 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/77be8a04-830c-44b1-b712-725ffff73a4e-run-systemd\") pod \"ovnkube-node-jv2sz\" (UID: \"77be8a04-830c-44b1-b712-725ffff73a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" Sep 11 02:52:57.421884 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.421443 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4dtd\" (UniqueName: \"kubernetes.io/projected/2167cf85-9290-4962-9f9c-ba69f4fd3866-kube-api-access-k4dtd\") pod \"iptables-alerter-p5427\" (UID: \"2167cf85-9290-4962-9f9c-ba69f4fd3866\") " pod="openshift-network-operator/iptables-alerter-p5427" Sep 11 02:52:57.421884 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.421451 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7fba1324-3940-475b-9d4d-4557d2c7f603-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lh4rj\" (UID: \"7fba1324-3940-475b-9d4d-4557d2c7f603\") " pod="openshift-multus/multus-additional-cni-plugins-lh4rj" Sep 11 02:52:57.421884 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.421471 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7fba1324-3940-475b-9d4d-4557d2c7f603-cni-binary-copy\") pod \"multus-additional-cni-plugins-lh4rj\" (UID: \"7fba1324-3940-475b-9d4d-4557d2c7f603\") " pod="openshift-multus/multus-additional-cni-plugins-lh4rj" Sep 11 02:52:57.421884 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.421495 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7fba1324-3940-475b-9d4d-4557d2c7f603-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lh4rj\" (UID: \"7fba1324-3940-475b-9d4d-4557d2c7f603\") " pod="openshift-multus/multus-additional-cni-plugins-lh4rj" Sep 11 02:52:57.421884 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.421522 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/20839eea-3cc5-49bd-9112-ec0fe94ae537-cnibin\") pod \"multus-j54mv\" (UID: \"20839eea-3cc5-49bd-9112-ec0fe94ae537\") " pod="openshift-multus/multus-j54mv" Sep 11 02:52:57.421884 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.421529 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7fba1324-3940-475b-9d4d-4557d2c7f603-system-cni-dir\") pod \"multus-additional-cni-plugins-lh4rj\" (UID: \"7fba1324-3940-475b-9d4d-4557d2c7f603\") " pod="openshift-multus/multus-additional-cni-plugins-lh4rj" Sep 11 02:52:57.421884 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.421522 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/20839eea-3cc5-49bd-9112-ec0fe94ae537-multus-daemon-config\") pod \"multus-j54mv\" (UID: \"20839eea-3cc5-49bd-9112-ec0fe94ae537\") " pod="openshift-multus/multus-j54mv" Sep 11 02:52:57.422341 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.421575 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/77be8a04-830c-44b1-b712-725ffff73a4e-run-systemd\") pod \"ovnkube-node-jv2sz\" (UID: \"77be8a04-830c-44b1-b712-725ffff73a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" Sep 11 02:52:57.422341 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.421603 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/20839eea-3cc5-49bd-9112-ec0fe94ae537-multus-socket-dir-parent\") pod \"multus-j54mv\" (UID: \"20839eea-3cc5-49bd-9112-ec0fe94ae537\") " pod="openshift-multus/multus-j54mv" Sep 11 02:52:57.422341 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.421653 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7fba1324-3940-475b-9d4d-4557d2c7f603-cnibin\") pod \"multus-additional-cni-plugins-lh4rj\" (UID: \"7fba1324-3940-475b-9d4d-4557d2c7f603\") " pod="openshift-multus/multus-additional-cni-plugins-lh4rj" Sep 11 02:52:57.422341 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.421676 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f5cae9bb-577e-402b-a4be-e44745036dc9-device-dir\") pod \"aws-ebs-csi-driver-node-fncs7\" (UID: \"f5cae9bb-577e-402b-a4be-e44745036dc9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fncs7" Sep 11 02:52:57.422341 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.421700 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f5cae9bb-577e-402b-a4be-e44745036dc9-etc-selinux\") pod \"aws-ebs-csi-driver-node-fncs7\" (UID: \"f5cae9bb-577e-402b-a4be-e44745036dc9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fncs7" Sep 11 02:52:57.422341 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.421723 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/77be8a04-830c-44b1-b712-725ffff73a4e-host-slash\") pod \"ovnkube-node-jv2sz\" (UID: \"77be8a04-830c-44b1-b712-725ffff73a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" Sep 11 02:52:57.422341 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.421747 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77be8a04-830c-44b1-b712-725ffff73a4e-run-openvswitch\") pod \"ovnkube-node-jv2sz\" (UID: \"77be8a04-830c-44b1-b712-725ffff73a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" Sep 11 02:52:57.422341 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.421773 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/20839eea-3cc5-49bd-9112-ec0fe94ae537-hostroot\") pod \"multus-j54mv\" (UID: \"20839eea-3cc5-49bd-9112-ec0fe94ae537\") " pod="openshift-multus/multus-j54mv" Sep 11 02:52:57.422341 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.421797 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f5cae9bb-577e-402b-a4be-e44745036dc9-registration-dir\") pod \"aws-ebs-csi-driver-node-fncs7\" (UID: \"f5cae9bb-577e-402b-a4be-e44745036dc9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fncs7" Sep 11 02:52:57.422341 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.421817 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c31501a3-cea9-47fd-af08-6fb89a5d3e6c-konnectivity-ca\") pod \"konnectivity-agent-tzxkr\" (UID: \"c31501a3-cea9-47fd-af08-6fb89a5d3e6c\") " pod="kube-system/konnectivity-agent-tzxkr" Sep 11 02:52:57.422341 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.421824 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/77be8a04-830c-44b1-b712-725ffff73a4e-node-log\") pod \"ovnkube-node-jv2sz\" (UID: \"77be8a04-830c-44b1-b712-725ffff73a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" Sep 11 02:52:57.422341 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.421495 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/20839eea-3cc5-49bd-9112-ec0fe94ae537-host-var-lib-cni-bin\") pod \"multus-j54mv\" (UID: \"20839eea-3cc5-49bd-9112-ec0fe94ae537\") " pod="openshift-multus/multus-j54mv" Sep 11 02:52:57.422341 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.421850 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/77be8a04-830c-44b1-b712-725ffff73a4e-ovnkube-script-lib\") pod \"ovnkube-node-jv2sz\" (UID: \"77be8a04-830c-44b1-b712-725ffff73a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" Sep 11 02:52:57.422341 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.421893 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2167cf85-9290-4962-9f9c-ba69f4fd3866-iptables-alerter-script\") pod \"iptables-alerter-p5427\" (UID: \"2167cf85-9290-4962-9f9c-ba69f4fd3866\") " pod="openshift-network-operator/iptables-alerter-p5427" Sep 11 02:52:57.422341 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.421922 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/20839eea-3cc5-49bd-9112-ec0fe94ae537-host-run-k8s-cni-cncf-io\") pod \"multus-j54mv\" (UID: \"20839eea-3cc5-49bd-9112-ec0fe94ae537\") " pod="openshift-multus/multus-j54mv" Sep 11 02:52:57.422341 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.421924 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7fba1324-3940-475b-9d4d-4557d2c7f603-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lh4rj\" (UID: \"7fba1324-3940-475b-9d4d-4557d2c7f603\") " pod="openshift-multus/multus-additional-cni-plugins-lh4rj" Sep 11 02:52:57.422341 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.421946 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8t2s9\" (UniqueName: \"kubernetes.io/projected/20839eea-3cc5-49bd-9112-ec0fe94ae537-kube-api-access-8t2s9\") pod \"multus-j54mv\" (UID: \"20839eea-3cc5-49bd-9112-ec0fe94ae537\") " pod="openshift-multus/multus-j54mv" Sep 11 02:52:57.422808 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.421970 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/77be8a04-830c-44b1-b712-725ffff73a4e-systemd-units\") pod \"ovnkube-node-jv2sz\" (UID: \"77be8a04-830c-44b1-b712-725ffff73a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" Sep 11 02:52:57.422808 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.421989 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/20839eea-3cc5-49bd-9112-ec0fe94ae537-cnibin\") pod \"multus-j54mv\" (UID: \"20839eea-3cc5-49bd-9112-ec0fe94ae537\") " pod="openshift-multus/multus-j54mv" Sep 11 02:52:57.422808 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.421998 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/20839eea-3cc5-49bd-9112-ec0fe94ae537-cni-binary-copy\") pod \"multus-j54mv\" (UID: \"20839eea-3cc5-49bd-9112-ec0fe94ae537\") " pod="openshift-multus/multus-j54mv" Sep 11 02:52:57.422808 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.422022 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f5cae9bb-577e-402b-a4be-e44745036dc9-socket-dir\") pod \"aws-ebs-csi-driver-node-fncs7\" (UID: \"f5cae9bb-577e-402b-a4be-e44745036dc9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fncs7" Sep 11 02:52:57.422808 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.422029 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/77be8a04-830c-44b1-b712-725ffff73a4e-host-slash\") pod \"ovnkube-node-jv2sz\" (UID: \"77be8a04-830c-44b1-b712-725ffff73a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" Sep 11 02:52:57.422808 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.422048 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/77be8a04-830c-44b1-b712-725ffff73a4e-host-cni-netd\") pod \"ovnkube-node-jv2sz\" (UID: \"77be8a04-830c-44b1-b712-725ffff73a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" Sep 11 02:52:57.422808 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.422071 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/77be8a04-830c-44b1-b712-725ffff73a4e-env-overrides\") pod \"ovnkube-node-jv2sz\" (UID: \"77be8a04-830c-44b1-b712-725ffff73a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" Sep 11 02:52:57.422808 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.422108 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7fba1324-3940-475b-9d4d-4557d2c7f603-cni-binary-copy\") pod \"multus-additional-cni-plugins-lh4rj\" (UID: \"7fba1324-3940-475b-9d4d-4557d2c7f603\") " pod="openshift-multus/multus-additional-cni-plugins-lh4rj" Sep 11 02:52:57.422808 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.422135 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrc86\" (UniqueName: \"kubernetes.io/projected/dffb443d-1d41-4705-a57d-1dbad16fff80-kube-api-access-jrc86\") pod \"network-check-target-pxq8g\" (UID: \"dffb443d-1d41-4705-a57d-1dbad16fff80\") " pod="openshift-network-diagnostics/network-check-target-pxq8g" Sep 11 02:52:57.422808 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.422162 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f5755599-e56c-401d-bec3-6543e0f8ab40-hosts-file\") pod \"node-resolver-5qzk7\" (UID: \"f5755599-e56c-401d-bec3-6543e0f8ab40\") " pod="openshift-dns/node-resolver-5qzk7" Sep 11 02:52:57.422808 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.422186 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77be8a04-830c-44b1-b712-725ffff73a4e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jv2sz\" (UID: \"77be8a04-830c-44b1-b712-725ffff73a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" Sep 11 02:52:57.422808 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.422212 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/20839eea-3cc5-49bd-9112-ec0fe94ae537-host-var-lib-cni-multus\") pod \"multus-j54mv\" (UID: \"20839eea-3cc5-49bd-9112-ec0fe94ae537\") " pod="openshift-multus/multus-j54mv" Sep 11 02:52:57.422808 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.422235 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/20839eea-3cc5-49bd-9112-ec0fe94ae537-host-var-lib-kubelet\") pod \"multus-j54mv\" (UID: \"20839eea-3cc5-49bd-9112-ec0fe94ae537\") " pod="openshift-multus/multus-j54mv" Sep 11 02:52:57.422808 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.422257 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2167cf85-9290-4962-9f9c-ba69f4fd3866-host-slash\") pod \"iptables-alerter-p5427\" (UID: \"2167cf85-9290-4962-9f9c-ba69f4fd3866\") " pod="openshift-network-operator/iptables-alerter-p5427" Sep 11 02:52:57.422808 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.422279 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237-metrics-certs\") pod \"network-metrics-daemon-qb9m9\" (UID: \"1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237\") " pod="openshift-multus/network-metrics-daemon-qb9m9" Sep 11 02:52:57.422808 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.422300 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f5755599-e56c-401d-bec3-6543e0f8ab40-tmp-dir\") pod \"node-resolver-5qzk7\" (UID: \"f5755599-e56c-401d-bec3-6543e0f8ab40\") " pod="openshift-dns/node-resolver-5qzk7" Sep 11 02:52:57.422808 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.422300 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22h6d\" (UniqueName: \"kubernetes.io/projected/1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237-kube-api-access-22h6d\") pod \"network-metrics-daemon-qb9m9\" (UID: \"1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237\") " pod="openshift-multus/network-metrics-daemon-qb9m9" Sep 11 02:52:57.423260 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.422334 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/20839eea-3cc5-49bd-9112-ec0fe94ae537-multus-cni-dir\") pod \"multus-j54mv\" (UID: \"20839eea-3cc5-49bd-9112-ec0fe94ae537\") " pod="openshift-multus/multus-j54mv" Sep 11 02:52:57.423260 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.422351 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/77be8a04-830c-44b1-b712-725ffff73a4e-log-socket\") pod \"ovnkube-node-jv2sz\" (UID: \"77be8a04-830c-44b1-b712-725ffff73a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" Sep 11 02:52:57.423260 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.422364 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7fba1324-3940-475b-9d4d-4557d2c7f603-cnibin\") pod \"multus-additional-cni-plugins-lh4rj\" (UID: \"7fba1324-3940-475b-9d4d-4557d2c7f603\") " pod="openshift-multus/multus-additional-cni-plugins-lh4rj" Sep 11 02:52:57.423260 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.422368 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/77be8a04-830c-44b1-b712-725ffff73a4e-ovnkube-config\") pod \"ovnkube-node-jv2sz\" (UID: \"77be8a04-830c-44b1-b712-725ffff73a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" Sep 11 02:52:57.423260 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.422400 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gg78t\" (UniqueName: \"kubernetes.io/projected/77be8a04-830c-44b1-b712-725ffff73a4e-kube-api-access-gg78t\") pod \"ovnkube-node-jv2sz\" (UID: \"77be8a04-830c-44b1-b712-725ffff73a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" Sep 11 02:52:57.423260 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.422414 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f5cae9bb-577e-402b-a4be-e44745036dc9-device-dir\") pod \"aws-ebs-csi-driver-node-fncs7\" (UID: \"f5cae9bb-577e-402b-a4be-e44745036dc9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fncs7" Sep 11 02:52:57.423260 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.422453 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/20839eea-3cc5-49bd-9112-ec0fe94ae537-etc-kubernetes\") pod \"multus-j54mv\" (UID: \"20839eea-3cc5-49bd-9112-ec0fe94ae537\") " pod="openshift-multus/multus-j54mv" Sep 11 02:52:57.423260 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.422478 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77be8a04-830c-44b1-b712-725ffff73a4e-var-lib-openvswitch\") pod \"ovnkube-node-jv2sz\" (UID: \"77be8a04-830c-44b1-b712-725ffff73a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" Sep 11 02:52:57.423260 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.422501 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f5cae9bb-577e-402b-a4be-e44745036dc9-etc-selinux\") pod \"aws-ebs-csi-driver-node-fncs7\" (UID: \"f5cae9bb-577e-402b-a4be-e44745036dc9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fncs7" Sep 11 02:52:57.423260 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.422505 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77be8a04-830c-44b1-b712-725ffff73a4e-run-openvswitch\") pod \"ovnkube-node-jv2sz\" (UID: \"77be8a04-830c-44b1-b712-725ffff73a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" Sep 11 02:52:57.423260 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.422512 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/20839eea-3cc5-49bd-9112-ec0fe94ae537-multus-cni-dir\") pod \"multus-j54mv\" (UID: \"20839eea-3cc5-49bd-9112-ec0fe94ae537\") " pod="openshift-multus/multus-j54mv" Sep 11 02:52:57.423260 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.422332 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/20839eea-3cc5-49bd-9112-ec0fe94ae537-multus-socket-dir-parent\") pod \"multus-j54mv\" (UID: \"20839eea-3cc5-49bd-9112-ec0fe94ae537\") " pod="openshift-multus/multus-j54mv" Sep 11 02:52:57.423260 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.422523 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7fba1324-3940-475b-9d4d-4557d2c7f603-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lh4rj\" (UID: \"7fba1324-3940-475b-9d4d-4557d2c7f603\") " pod="openshift-multus/multus-additional-cni-plugins-lh4rj" Sep 11 02:52:57.423260 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.422541 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/20839eea-3cc5-49bd-9112-ec0fe94ae537-hostroot\") pod \"multus-j54mv\" (UID: \"20839eea-3cc5-49bd-9112-ec0fe94ae537\") " pod="openshift-multus/multus-j54mv" Sep 11 02:52:57.423260 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.422541 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/20839eea-3cc5-49bd-9112-ec0fe94ae537-host-run-multus-certs\") pod \"multus-j54mv\" (UID: \"20839eea-3cc5-49bd-9112-ec0fe94ae537\") " pod="openshift-multus/multus-j54mv" Sep 11 02:52:57.423260 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.422556 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/77be8a04-830c-44b1-b712-725ffff73a4e-node-log\") pod \"ovnkube-node-jv2sz\" (UID: \"77be8a04-830c-44b1-b712-725ffff73a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" Sep 11 02:52:57.423260 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.422570 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f5cae9bb-577e-402b-a4be-e44745036dc9-registration-dir\") pod \"aws-ebs-csi-driver-node-fncs7\" (UID: \"f5cae9bb-577e-402b-a4be-e44745036dc9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fncs7" Sep 11 02:52:57.423260 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.422607 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2167cf85-9290-4962-9f9c-ba69f4fd3866-host-slash\") pod \"iptables-alerter-p5427\" (UID: \"2167cf85-9290-4962-9f9c-ba69f4fd3866\") " pod="openshift-network-operator/iptables-alerter-p5427" Sep 11 02:52:57.424050 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.422607 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/77be8a04-830c-44b1-b712-725ffff73a4e-host-cni-netd\") pod \"ovnkube-node-jv2sz\" (UID: \"77be8a04-830c-44b1-b712-725ffff73a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" Sep 11 02:52:57.424050 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.422659 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/20839eea-3cc5-49bd-9112-ec0fe94ae537-host-var-lib-cni-multus\") pod \"multus-j54mv\" (UID: \"20839eea-3cc5-49bd-9112-ec0fe94ae537\") " pod="openshift-multus/multus-j54mv" Sep 11 02:52:57.424050 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:52:57.422709 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 02:52:57.424050 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:52:57.422768 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237-metrics-certs podName:1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237 nodeName:}" failed. No retries permitted until 2026-09-11 02:52:57.922751083 +0000 UTC m=+3.062074271 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237-metrics-certs") pod "network-metrics-daemon-qb9m9" (UID: "1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 02:52:57.424050 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.422807 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f5755599-e56c-401d-bec3-6543e0f8ab40-hosts-file\") pod \"node-resolver-5qzk7\" (UID: \"f5755599-e56c-401d-bec3-6543e0f8ab40\") " pod="openshift-dns/node-resolver-5qzk7" Sep 11 02:52:57.424050 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.422846 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/20839eea-3cc5-49bd-9112-ec0fe94ae537-host-var-lib-kubelet\") pod \"multus-j54mv\" (UID: \"20839eea-3cc5-49bd-9112-ec0fe94ae537\") " pod="openshift-multus/multus-j54mv" Sep 11 02:52:57.424050 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.422939 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/77be8a04-830c-44b1-b712-725ffff73a4e-ovnkube-config\") pod \"ovnkube-node-jv2sz\" (UID: \"77be8a04-830c-44b1-b712-725ffff73a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" Sep 11 02:52:57.424050 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.423011 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/77be8a04-830c-44b1-b712-725ffff73a4e-systemd-units\") pod \"ovnkube-node-jv2sz\" (UID: \"77be8a04-830c-44b1-b712-725ffff73a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" Sep 11 02:52:57.424050 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.423127 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/77be8a04-830c-44b1-b712-725ffff73a4e-env-overrides\") pod \"ovnkube-node-jv2sz\" (UID: \"77be8a04-830c-44b1-b712-725ffff73a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" Sep 11 02:52:57.424050 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.423174 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77be8a04-830c-44b1-b712-725ffff73a4e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jv2sz\" (UID: \"77be8a04-830c-44b1-b712-725ffff73a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" Sep 11 02:52:57.424050 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.423176 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f5cae9bb-577e-402b-a4be-e44745036dc9-socket-dir\") pod \"aws-ebs-csi-driver-node-fncs7\" (UID: \"f5cae9bb-577e-402b-a4be-e44745036dc9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fncs7" Sep 11 02:52:57.424050 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.423208 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/77be8a04-830c-44b1-b712-725ffff73a4e-ovnkube-script-lib\") pod \"ovnkube-node-jv2sz\" (UID: \"77be8a04-830c-44b1-b712-725ffff73a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" Sep 11 02:52:57.424050 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.423222 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/77be8a04-830c-44b1-b712-725ffff73a4e-log-socket\") pod \"ovnkube-node-jv2sz\" (UID: \"77be8a04-830c-44b1-b712-725ffff73a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" Sep 11 02:52:57.424050 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.423265 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/20839eea-3cc5-49bd-9112-ec0fe94ae537-host-run-k8s-cni-cncf-io\") pod \"multus-j54mv\" (UID: \"20839eea-3cc5-49bd-9112-ec0fe94ae537\") " pod="openshift-multus/multus-j54mv" Sep 11 02:52:57.424050 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.423476 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2167cf85-9290-4962-9f9c-ba69f4fd3866-iptables-alerter-script\") pod \"iptables-alerter-p5427\" (UID: \"2167cf85-9290-4962-9f9c-ba69f4fd3866\") " pod="openshift-network-operator/iptables-alerter-p5427" Sep 11 02:52:57.424050 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.423516 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/20839eea-3cc5-49bd-9112-ec0fe94ae537-cni-binary-copy\") pod \"multus-j54mv\" (UID: \"20839eea-3cc5-49bd-9112-ec0fe94ae537\") " pod="openshift-multus/multus-j54mv" Sep 11 02:52:57.425754 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.425730 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c31501a3-cea9-47fd-af08-6fb89a5d3e6c-agent-certs\") pod \"konnectivity-agent-tzxkr\" (UID: \"c31501a3-cea9-47fd-af08-6fb89a5d3e6c\") " pod="kube-system/konnectivity-agent-tzxkr" Sep 11 02:52:57.426778 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.426760 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/77be8a04-830c-44b1-b712-725ffff73a4e-ovn-node-metrics-cert\") pod \"ovnkube-node-jv2sz\" (UID: \"77be8a04-830c-44b1-b712-725ffff73a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" Sep 11 02:52:57.430351 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.430002 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j247k\" (UniqueName: \"kubernetes.io/projected/f5755599-e56c-401d-bec3-6543e0f8ab40-kube-api-access-j247k\") pod \"node-resolver-5qzk7\" (UID: \"f5755599-e56c-401d-bec3-6543e0f8ab40\") " pod="openshift-dns/node-resolver-5qzk7" Sep 11 02:52:57.430500 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.430479 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54bcr\" (UniqueName: \"kubernetes.io/projected/f5cae9bb-577e-402b-a4be-e44745036dc9-kube-api-access-54bcr\") pod \"aws-ebs-csi-driver-node-fncs7\" (UID: \"f5cae9bb-577e-402b-a4be-e44745036dc9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fncs7" Sep 11 02:52:57.431185 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.431158 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbd2d\" (UniqueName: \"kubernetes.io/projected/7fba1324-3940-475b-9d4d-4557d2c7f603-kube-api-access-jbd2d\") pod \"multus-additional-cni-plugins-lh4rj\" (UID: \"7fba1324-3940-475b-9d4d-4557d2c7f603\") " pod="openshift-multus/multus-additional-cni-plugins-lh4rj" Sep 11 02:52:57.432206 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:52:57.432187 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 02:52:57.432308 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:52:57.432211 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 02:52:57.432308 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:52:57.432225 2580 projected.go:196] Error preparing data for projected volume kube-api-access-jrc86 for pod openshift-network-diagnostics/network-check-target-pxq8g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 02:52:57.432308 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:52:57.432289 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dffb443d-1d41-4705-a57d-1dbad16fff80-kube-api-access-jrc86 podName:dffb443d-1d41-4705-a57d-1dbad16fff80 nodeName:}" failed. No retries permitted until 2026-09-11 02:52:57.93227277 +0000 UTC m=+3.071595955 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jrc86" (UniqueName: "kubernetes.io/projected/dffb443d-1d41-4705-a57d-1dbad16fff80-kube-api-access-jrc86") pod "network-check-target-pxq8g" (UID: "dffb443d-1d41-4705-a57d-1dbad16fff80") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 02:52:57.432478 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.432418 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4dtd\" (UniqueName: \"kubernetes.io/projected/2167cf85-9290-4962-9f9c-ba69f4fd3866-kube-api-access-k4dtd\") pod \"iptables-alerter-p5427\" (UID: \"2167cf85-9290-4962-9f9c-ba69f4fd3866\") " pod="openshift-network-operator/iptables-alerter-p5427" Sep 11 02:52:57.434601 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.434560 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22h6d\" (UniqueName: \"kubernetes.io/projected/1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237-kube-api-access-22h6d\") pod \"network-metrics-daemon-qb9m9\" (UID: \"1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237\") " pod="openshift-multus/network-metrics-daemon-qb9m9" Sep 11 02:52:57.434730 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.434707 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gg78t\" (UniqueName: \"kubernetes.io/projected/77be8a04-830c-44b1-b712-725ffff73a4e-kube-api-access-gg78t\") pod \"ovnkube-node-jv2sz\" (UID: \"77be8a04-830c-44b1-b712-725ffff73a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" Sep 11 02:52:57.435863 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.435832 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8t2s9\" (UniqueName: \"kubernetes.io/projected/20839eea-3cc5-49bd-9112-ec0fe94ae537-kube-api-access-8t2s9\") pod \"multus-j54mv\" (UID: \"20839eea-3cc5-49bd-9112-ec0fe94ae537\") " pod="openshift-multus/multus-j54mv" Sep 11 02:52:57.515684 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.515561 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-d26rx" Sep 11 02:52:57.525342 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.525324 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-x6s5v" Sep 11 02:52:57.533214 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.533038 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tzxkr" Sep 11 02:52:57.538735 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.538717 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fncs7" Sep 11 02:52:57.545565 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.545542 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lh4rj" Sep 11 02:52:57.552537 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.552521 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" Sep 11 02:52:57.558303 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.558280 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-j54mv" Sep 11 02:52:57.565214 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.565193 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-p5427" Sep 11 02:52:57.570825 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.570807 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5qzk7" Sep 11 02:52:57.826219 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.826134 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a-original-pull-secret\") pod \"global-pull-secret-syncer-h2th6\" (UID: \"2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a\") " pod="kube-system/global-pull-secret-syncer-h2th6" Sep 11 02:52:57.826358 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:52:57.826279 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 02:52:57.826358 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:52:57.826342 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a-original-pull-secret podName:2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a nodeName:}" failed. No retries permitted until 2026-09-11 02:52:58.826327681 +0000 UTC m=+3.965650853 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a-original-pull-secret") pod "global-pull-secret-syncer-h2th6" (UID: "2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a") : object "kube-system"/"original-pull-secret" not registered Sep 11 02:52:57.926758 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:57.926725 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237-metrics-certs\") pod \"network-metrics-daemon-qb9m9\" (UID: \"1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237\") " pod="openshift-multus/network-metrics-daemon-qb9m9" Sep 11 02:52:57.926904 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:52:57.926833 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 02:52:57.926904 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:52:57.926894 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237-metrics-certs podName:1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237 nodeName:}" failed. No retries permitted until 2026-09-11 02:52:58.926879638 +0000 UTC m=+4.066202807 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237-metrics-certs") pod "network-metrics-daemon-qb9m9" (UID: "1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 02:52:58.027031 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:58.027001 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrc86\" (UniqueName: \"kubernetes.io/projected/dffb443d-1d41-4705-a57d-1dbad16fff80-kube-api-access-jrc86\") pod \"network-check-target-pxq8g\" (UID: \"dffb443d-1d41-4705-a57d-1dbad16fff80\") " pod="openshift-network-diagnostics/network-check-target-pxq8g" Sep 11 02:52:58.027212 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:52:58.027143 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 02:52:58.027212 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:52:58.027158 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 02:52:58.027212 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:52:58.027166 2580 projected.go:196] Error preparing data for projected volume kube-api-access-jrc86 for pod openshift-network-diagnostics/network-check-target-pxq8g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 02:52:58.027369 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:52:58.027230 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dffb443d-1d41-4705-a57d-1dbad16fff80-kube-api-access-jrc86 podName:dffb443d-1d41-4705-a57d-1dbad16fff80 nodeName:}" failed. No retries permitted until 2026-09-11 02:52:59.027215941 +0000 UTC m=+4.166539111 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jrc86" (UniqueName: "kubernetes.io/projected/dffb443d-1d41-4705-a57d-1dbad16fff80-kube-api-access-jrc86") pod "network-check-target-pxq8g" (UID: "dffb443d-1d41-4705-a57d-1dbad16fff80") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 02:52:58.249004 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:58.248917 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 02:47:57 +0000 UTC" deadline="2028-02-09 18:29:03.369325326 +0000 UTC" Sep 11 02:52:58.249004 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:58.248955 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12399h36m5.12037825s" Sep 11 02:52:58.441454 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:58.441392 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20839eea_3cc5_49bd_9112_ec0fe94ae537.slice/crio-ae08cd7750afa9e57247bac235cb0d3527f5ffb9d72fd4db4d7052f280ff31a3 WatchSource:0}: Error finding container ae08cd7750afa9e57247bac235cb0d3527f5ffb9d72fd4db4d7052f280ff31a3: Status 404 returned error can't find the container with id ae08cd7750afa9e57247bac235cb0d3527f5ffb9d72fd4db4d7052f280ff31a3 Sep 11 02:52:58.444387 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:58.444265 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod958470e1_b0b5_42c0_a6ad_b81f134eb760.slice/crio-6cfb3f8bfbbf7e3ab6a03144c10e68694dc78617ffe2678b83b96d6a9932fa2b WatchSource:0}: Error finding container 6cfb3f8bfbbf7e3ab6a03144c10e68694dc78617ffe2678b83b96d6a9932fa2b: Status 404 returned error can't find the container with id 6cfb3f8bfbbf7e3ab6a03144c10e68694dc78617ffe2678b83b96d6a9932fa2b Sep 11 02:52:58.448858 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:58.448767 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcad088c2_48c1_4e27_83e0_40244586b0c0.slice/crio-6ea34523ec72eb2afea4f065981b3d6c333fe931eca735d1fe06e8c6bf929c37 WatchSource:0}: Error finding container 6ea34523ec72eb2afea4f065981b3d6c333fe931eca735d1fe06e8c6bf929c37: Status 404 returned error can't find the container with id 6ea34523ec72eb2afea4f065981b3d6c333fe931eca735d1fe06e8c6bf929c37 Sep 11 02:52:58.449206 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:58.449165 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5755599_e56c_401d_bec3_6543e0f8ab40.slice/crio-3fe80752f13eb82f6c6f269834adc6c7f68b9a2ff6edcd056ad223f38d74b1aa WatchSource:0}: Error finding container 3fe80752f13eb82f6c6f269834adc6c7f68b9a2ff6edcd056ad223f38d74b1aa: Status 404 returned error can't find the container with id 3fe80752f13eb82f6c6f269834adc6c7f68b9a2ff6edcd056ad223f38d74b1aa Sep 11 02:52:58.451518 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:58.451385 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77be8a04_830c_44b1_b712_725ffff73a4e.slice/crio-6ade43cae6b0b83dd94bab8145d0554a33bc5ea714acc48b8de1915bd54cf041 WatchSource:0}: Error finding container 6ade43cae6b0b83dd94bab8145d0554a33bc5ea714acc48b8de1915bd54cf041: Status 404 returned error can't find the container with id 6ade43cae6b0b83dd94bab8145d0554a33bc5ea714acc48b8de1915bd54cf041 Sep 11 02:52:58.456239 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:58.456072 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2167cf85_9290_4962_9f9c_ba69f4fd3866.slice/crio-ed7605b62677d92d2229563a17c28b58aca16bb2ad140cd60606cc178371fc7f WatchSource:0}: Error finding container ed7605b62677d92d2229563a17c28b58aca16bb2ad140cd60606cc178371fc7f: Status 404 returned error can't find the container with id ed7605b62677d92d2229563a17c28b58aca16bb2ad140cd60606cc178371fc7f Sep 11 02:52:58.457012 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:52:58.456987 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5cae9bb_577e_402b_a4be_e44745036dc9.slice/crio-cfa386e9fe4cccd5fa4117a05ffd724dd86c150b55e643c87e06382613bc0f7b WatchSource:0}: Error finding container cfa386e9fe4cccd5fa4117a05ffd724dd86c150b55e643c87e06382613bc0f7b: Status 404 returned error can't find the container with id cfa386e9fe4cccd5fa4117a05ffd724dd86c150b55e643c87e06382613bc0f7b Sep 11 02:52:58.832742 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:58.832683 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a-original-pull-secret\") pod \"global-pull-secret-syncer-h2th6\" (UID: \"2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a\") " pod="kube-system/global-pull-secret-syncer-h2th6" Sep 11 02:52:58.832857 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:52:58.832812 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 02:52:58.832893 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:52:58.832859 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a-original-pull-secret podName:2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a nodeName:}" failed. No retries permitted until 2026-09-11 02:53:00.832847042 +0000 UTC m=+5.972170216 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a-original-pull-secret") pod "global-pull-secret-syncer-h2th6" (UID: "2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a") : object "kube-system"/"original-pull-secret" not registered Sep 11 02:52:58.934440 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:58.933895 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237-metrics-certs\") pod \"network-metrics-daemon-qb9m9\" (UID: \"1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237\") " pod="openshift-multus/network-metrics-daemon-qb9m9" Sep 11 02:52:58.934440 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:52:58.934050 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 02:52:58.934440 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:52:58.934122 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237-metrics-certs podName:1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237 nodeName:}" failed. No retries permitted until 2026-09-11 02:53:00.934099411 +0000 UTC m=+6.073422595 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237-metrics-certs") pod "network-metrics-daemon-qb9m9" (UID: "1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 02:52:59.035310 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:59.034671 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrc86\" (UniqueName: \"kubernetes.io/projected/dffb443d-1d41-4705-a57d-1dbad16fff80-kube-api-access-jrc86\") pod \"network-check-target-pxq8g\" (UID: \"dffb443d-1d41-4705-a57d-1dbad16fff80\") " pod="openshift-network-diagnostics/network-check-target-pxq8g" Sep 11 02:52:59.035310 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:52:59.034873 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 02:52:59.035310 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:52:59.034895 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 02:52:59.035310 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:52:59.034908 2580 projected.go:196] Error preparing data for projected volume kube-api-access-jrc86 for pod openshift-network-diagnostics/network-check-target-pxq8g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 02:52:59.035310 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:52:59.034970 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dffb443d-1d41-4705-a57d-1dbad16fff80-kube-api-access-jrc86 podName:dffb443d-1d41-4705-a57d-1dbad16fff80 nodeName:}" failed. No retries permitted until 2026-09-11 02:53:01.034950912 +0000 UTC m=+6.174274101 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jrc86" (UniqueName: "kubernetes.io/projected/dffb443d-1d41-4705-a57d-1dbad16fff80-kube-api-access-jrc86") pod "network-check-target-pxq8g" (UID: "dffb443d-1d41-4705-a57d-1dbad16fff80") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 02:52:59.250168 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:59.250052 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 02:47:57 +0000 UTC" deadline="2028-04-23 20:07:39.242125133 +0000 UTC" Sep 11 02:52:59.250168 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:59.250114 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14177h14m39.992015179s" Sep 11 02:52:59.339961 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:59.339929 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h2th6" Sep 11 02:52:59.340121 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:52:59.340064 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h2th6" podUID="2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a" Sep 11 02:52:59.340774 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:59.340565 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxq8g" Sep 11 02:52:59.340774 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:52:59.340678 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxq8g" podUID="dffb443d-1d41-4705-a57d-1dbad16fff80" Sep 11 02:52:59.340774 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:59.340750 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qb9m9" Sep 11 02:52:59.340996 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:52:59.340848 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qb9m9" podUID="1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237" Sep 11 02:52:59.363421 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:59.363226 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-210.ec2.internal" event={"ID":"8374f836a1cb97d92580857849ff95ac","Type":"ContainerStarted","Data":"6a2506c031c4bc89dde9b575846d64089247c36e572cdb35d4f19f16964869c9"} Sep 11 02:52:59.370021 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:59.369993 2580 generic.go:356] "Generic (PLEG): container finished" podID="d79d7fb3dbee895c79a46f52d8374f34" containerID="7e38a2dda0be3f66fd912a832f3f0bc8166f510b0274a1439343e6ddbccca5ce" exitCode=0 Sep 11 02:52:59.370253 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:59.370232 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-210.ec2.internal" event={"ID":"d79d7fb3dbee895c79a46f52d8374f34","Type":"ContainerDied","Data":"7e38a2dda0be3f66fd912a832f3f0bc8166f510b0274a1439343e6ddbccca5ce"} Sep 11 02:52:59.372267 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:59.372236 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" event={"ID":"77be8a04-830c-44b1-b712-725ffff73a4e","Type":"ContainerStarted","Data":"6ade43cae6b0b83dd94bab8145d0554a33bc5ea714acc48b8de1915bd54cf041"} Sep 11 02:52:59.378646 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:59.378227 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-210.ec2.internal" podStartSLOduration=3.37821078 podStartE2EDuration="3.37821078s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 02:52:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:52:59.37760632 +0000 UTC m=+4.516929514" watchObservedRunningTime="2026-09-11 02:52:59.37821078 +0000 UTC m=+4.517533972" Sep 11 02:52:59.381984 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:59.381911 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tzxkr" event={"ID":"c31501a3-cea9-47fd-af08-6fb89a5d3e6c","Type":"ContainerStarted","Data":"63ad94a810e04e48fd2521b499e81487f1604b679644acdf26f001804794d6ec"} Sep 11 02:52:59.397667 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:59.397438 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5qzk7" event={"ID":"f5755599-e56c-401d-bec3-6543e0f8ab40","Type":"ContainerStarted","Data":"3fe80752f13eb82f6c6f269834adc6c7f68b9a2ff6edcd056ad223f38d74b1aa"} Sep 11 02:52:59.401221 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:59.401158 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-x6s5v" event={"ID":"958470e1-b0b5-42c0-a6ad-b81f134eb760","Type":"ContainerStarted","Data":"6cfb3f8bfbbf7e3ab6a03144c10e68694dc78617ffe2678b83b96d6a9932fa2b"} Sep 11 02:52:59.415847 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:59.415821 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lh4rj" event={"ID":"7fba1324-3940-475b-9d4d-4557d2c7f603","Type":"ContainerStarted","Data":"664aaf9551345e1fc0b86edb6dc78f98ef360008709ed15a897cafe5ee2c536d"} Sep 11 02:52:59.419825 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:59.419757 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fncs7" event={"ID":"f5cae9bb-577e-402b-a4be-e44745036dc9","Type":"ContainerStarted","Data":"cfa386e9fe4cccd5fa4117a05ffd724dd86c150b55e643c87e06382613bc0f7b"} Sep 11 02:52:59.422139 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:59.422067 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-p5427" event={"ID":"2167cf85-9290-4962-9f9c-ba69f4fd3866","Type":"ContainerStarted","Data":"ed7605b62677d92d2229563a17c28b58aca16bb2ad140cd60606cc178371fc7f"} Sep 11 02:52:59.424953 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:59.424930 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-d26rx" event={"ID":"cad088c2-48c1-4e27-83e0-40244586b0c0","Type":"ContainerStarted","Data":"6ea34523ec72eb2afea4f065981b3d6c333fe931eca735d1fe06e8c6bf929c37"} Sep 11 02:52:59.426133 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:52:59.426110 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-j54mv" event={"ID":"20839eea-3cc5-49bd-9112-ec0fe94ae537","Type":"ContainerStarted","Data":"ae08cd7750afa9e57247bac235cb0d3527f5ffb9d72fd4db4d7052f280ff31a3"} Sep 11 02:53:00.436168 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:00.436121 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-210.ec2.internal" event={"ID":"d79d7fb3dbee895c79a46f52d8374f34","Type":"ContainerStarted","Data":"82e9d55ca97f75850d16eaddd1e6755268c217d6b943e27d47cfd8fcc5b35f1e"} Sep 11 02:53:00.854923 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:00.854258 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a-original-pull-secret\") pod \"global-pull-secret-syncer-h2th6\" (UID: \"2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a\") " pod="kube-system/global-pull-secret-syncer-h2th6" Sep 11 02:53:00.854923 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:00.854425 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 02:53:00.854923 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:00.854483 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a-original-pull-secret podName:2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a nodeName:}" failed. No retries permitted until 2026-09-11 02:53:04.854466408 +0000 UTC m=+9.993789603 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a-original-pull-secret") pod "global-pull-secret-syncer-h2th6" (UID: "2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a") : object "kube-system"/"original-pull-secret" not registered Sep 11 02:53:00.955282 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:00.954746 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237-metrics-certs\") pod \"network-metrics-daemon-qb9m9\" (UID: \"1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237\") " pod="openshift-multus/network-metrics-daemon-qb9m9" Sep 11 02:53:00.955282 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:00.954907 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 02:53:00.955282 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:00.954966 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237-metrics-certs podName:1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237 nodeName:}" failed. No retries permitted until 2026-09-11 02:53:04.95494745 +0000 UTC m=+10.094270632 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237-metrics-certs") pod "network-metrics-daemon-qb9m9" (UID: "1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 02:53:01.056175 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:01.055360 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrc86\" (UniqueName: \"kubernetes.io/projected/dffb443d-1d41-4705-a57d-1dbad16fff80-kube-api-access-jrc86\") pod \"network-check-target-pxq8g\" (UID: \"dffb443d-1d41-4705-a57d-1dbad16fff80\") " pod="openshift-network-diagnostics/network-check-target-pxq8g" Sep 11 02:53:01.056175 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:01.055533 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 02:53:01.056175 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:01.055560 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 02:53:01.056175 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:01.055575 2580 projected.go:196] Error preparing data for projected volume kube-api-access-jrc86 for pod openshift-network-diagnostics/network-check-target-pxq8g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 02:53:01.056175 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:01.055648 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dffb443d-1d41-4705-a57d-1dbad16fff80-kube-api-access-jrc86 podName:dffb443d-1d41-4705-a57d-1dbad16fff80 nodeName:}" failed. No retries permitted until 2026-09-11 02:53:05.055612645 +0000 UTC m=+10.194935828 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jrc86" (UniqueName: "kubernetes.io/projected/dffb443d-1d41-4705-a57d-1dbad16fff80-kube-api-access-jrc86") pod "network-check-target-pxq8g" (UID: "dffb443d-1d41-4705-a57d-1dbad16fff80") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 02:53:01.338825 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:01.338744 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h2th6" Sep 11 02:53:01.338989 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:01.338750 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxq8g" Sep 11 02:53:01.338989 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:01.338909 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h2th6" podUID="2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a" Sep 11 02:53:01.338989 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:01.338930 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qb9m9" Sep 11 02:53:01.339161 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:01.339029 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxq8g" podUID="dffb443d-1d41-4705-a57d-1dbad16fff80" Sep 11 02:53:01.339161 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:01.339118 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qb9m9" podUID="1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237" Sep 11 02:53:03.340550 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:03.339804 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxq8g" Sep 11 02:53:03.340550 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:03.339928 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxq8g" podUID="dffb443d-1d41-4705-a57d-1dbad16fff80" Sep 11 02:53:03.340550 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:03.340281 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qb9m9" Sep 11 02:53:03.340550 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:03.340381 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qb9m9" podUID="1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237" Sep 11 02:53:03.340550 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:03.340424 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h2th6" Sep 11 02:53:03.340550 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:03.340495 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h2th6" podUID="2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a" Sep 11 02:53:04.886611 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:04.886408 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a-original-pull-secret\") pod \"global-pull-secret-syncer-h2th6\" (UID: \"2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a\") " pod="kube-system/global-pull-secret-syncer-h2th6" Sep 11 02:53:04.887072 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:04.886804 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 02:53:04.887072 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:04.886871 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a-original-pull-secret podName:2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a nodeName:}" failed. No retries permitted until 2026-09-11 02:53:12.886851122 +0000 UTC m=+18.026174314 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a-original-pull-secret") pod "global-pull-secret-syncer-h2th6" (UID: "2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a") : object "kube-system"/"original-pull-secret" not registered Sep 11 02:53:04.987682 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:04.987650 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237-metrics-certs\") pod \"network-metrics-daemon-qb9m9\" (UID: \"1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237\") " pod="openshift-multus/network-metrics-daemon-qb9m9" Sep 11 02:53:04.987867 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:04.987819 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 02:53:04.987938 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:04.987901 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237-metrics-certs podName:1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237 nodeName:}" failed. No retries permitted until 2026-09-11 02:53:12.9878801 +0000 UTC m=+18.127203288 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237-metrics-certs") pod "network-metrics-daemon-qb9m9" (UID: "1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 02:53:05.088798 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:05.088154 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrc86\" (UniqueName: \"kubernetes.io/projected/dffb443d-1d41-4705-a57d-1dbad16fff80-kube-api-access-jrc86\") pod \"network-check-target-pxq8g\" (UID: \"dffb443d-1d41-4705-a57d-1dbad16fff80\") " pod="openshift-network-diagnostics/network-check-target-pxq8g" Sep 11 02:53:05.088798 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:05.088341 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 02:53:05.088798 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:05.088360 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 02:53:05.088798 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:05.088373 2580 projected.go:196] Error preparing data for projected volume kube-api-access-jrc86 for pod openshift-network-diagnostics/network-check-target-pxq8g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 02:53:05.088798 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:05.088430 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dffb443d-1d41-4705-a57d-1dbad16fff80-kube-api-access-jrc86 podName:dffb443d-1d41-4705-a57d-1dbad16fff80 nodeName:}" failed. No retries permitted until 2026-09-11 02:53:13.088411845 +0000 UTC m=+18.227735020 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jrc86" (UniqueName: "kubernetes.io/projected/dffb443d-1d41-4705-a57d-1dbad16fff80-kube-api-access-jrc86") pod "network-check-target-pxq8g" (UID: "dffb443d-1d41-4705-a57d-1dbad16fff80") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 02:53:05.339412 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:05.339338 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h2th6" Sep 11 02:53:05.339542 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:05.339449 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h2th6" podUID="2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a" Sep 11 02:53:05.343797 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:05.343768 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxq8g" Sep 11 02:53:05.343949 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:05.343917 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxq8g" podUID="dffb443d-1d41-4705-a57d-1dbad16fff80" Sep 11 02:53:05.346524 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:05.346506 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qb9m9" Sep 11 02:53:05.346684 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:05.346664 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qb9m9" podUID="1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237" Sep 11 02:53:07.340329 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:07.340293 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxq8g" Sep 11 02:53:07.340723 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:07.340419 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxq8g" podUID="dffb443d-1d41-4705-a57d-1dbad16fff80" Sep 11 02:53:07.340769 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:07.340747 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h2th6" Sep 11 02:53:07.340861 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:07.340833 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h2th6" podUID="2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a" Sep 11 02:53:07.341001 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:07.340885 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qb9m9" Sep 11 02:53:07.341001 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:07.340972 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qb9m9" podUID="1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237" Sep 11 02:53:09.337952 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:09.337922 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qb9m9" Sep 11 02:53:09.337952 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:09.337936 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h2th6" Sep 11 02:53:09.338435 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:09.338052 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qb9m9" podUID="1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237" Sep 11 02:53:09.338435 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:09.338093 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h2th6" podUID="2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a" Sep 11 02:53:09.338435 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:09.338133 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxq8g" Sep 11 02:53:09.338435 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:09.338199 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxq8g" podUID="dffb443d-1d41-4705-a57d-1dbad16fff80" Sep 11 02:53:11.338442 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:11.338402 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxq8g" Sep 11 02:53:11.338442 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:11.338443 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h2th6" Sep 11 02:53:11.339026 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:11.338402 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qb9m9" Sep 11 02:53:11.339026 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:11.338535 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxq8g" podUID="dffb443d-1d41-4705-a57d-1dbad16fff80" Sep 11 02:53:11.339026 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:11.338632 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qb9m9" podUID="1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237" Sep 11 02:53:11.339026 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:11.338703 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h2th6" podUID="2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a" Sep 11 02:53:12.945910 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:12.945879 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a-original-pull-secret\") pod \"global-pull-secret-syncer-h2th6\" (UID: \"2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a\") " pod="kube-system/global-pull-secret-syncer-h2th6" Sep 11 02:53:12.946321 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:12.945994 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 02:53:12.946321 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:12.946047 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a-original-pull-secret podName:2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a nodeName:}" failed. No retries permitted until 2026-09-11 02:53:28.94602999 +0000 UTC m=+34.085353162 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a-original-pull-secret") pod "global-pull-secret-syncer-h2th6" (UID: "2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a") : object "kube-system"/"original-pull-secret" not registered Sep 11 02:53:13.046277 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:13.046256 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237-metrics-certs\") pod \"network-metrics-daemon-qb9m9\" (UID: \"1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237\") " pod="openshift-multus/network-metrics-daemon-qb9m9" Sep 11 02:53:13.046381 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:13.046348 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 02:53:13.046421 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:13.046391 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237-metrics-certs podName:1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237 nodeName:}" failed. No retries permitted until 2026-09-11 02:53:29.046379156 +0000 UTC m=+34.185702330 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237-metrics-certs") pod "network-metrics-daemon-qb9m9" (UID: "1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 02:53:13.147349 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:13.147322 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrc86\" (UniqueName: \"kubernetes.io/projected/dffb443d-1d41-4705-a57d-1dbad16fff80-kube-api-access-jrc86\") pod \"network-check-target-pxq8g\" (UID: \"dffb443d-1d41-4705-a57d-1dbad16fff80\") " pod="openshift-network-diagnostics/network-check-target-pxq8g" Sep 11 02:53:13.147463 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:13.147450 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 02:53:13.147501 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:13.147470 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 02:53:13.147501 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:13.147479 2580 projected.go:196] Error preparing data for projected volume kube-api-access-jrc86 for pod openshift-network-diagnostics/network-check-target-pxq8g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 02:53:13.147563 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:13.147538 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dffb443d-1d41-4705-a57d-1dbad16fff80-kube-api-access-jrc86 podName:dffb443d-1d41-4705-a57d-1dbad16fff80 nodeName:}" failed. No retries permitted until 2026-09-11 02:53:29.147507031 +0000 UTC m=+34.286830200 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jrc86" (UniqueName: "kubernetes.io/projected/dffb443d-1d41-4705-a57d-1dbad16fff80-kube-api-access-jrc86") pod "network-check-target-pxq8g" (UID: "dffb443d-1d41-4705-a57d-1dbad16fff80") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 02:53:13.337897 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:13.337819 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h2th6" Sep 11 02:53:13.338049 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:13.337943 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxq8g" Sep 11 02:53:13.338049 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:13.337956 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h2th6" podUID="2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a" Sep 11 02:53:13.338049 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:13.338020 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxq8g" podUID="dffb443d-1d41-4705-a57d-1dbad16fff80" Sep 11 02:53:13.338049 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:13.338038 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qb9m9" Sep 11 02:53:13.338266 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:13.338134 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qb9m9" podUID="1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237" Sep 11 02:53:15.338348 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:15.338315 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxq8g" Sep 11 02:53:15.338798 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:15.338402 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxq8g" podUID="dffb443d-1d41-4705-a57d-1dbad16fff80" Sep 11 02:53:15.338798 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:15.338437 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h2th6" Sep 11 02:53:15.338798 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:15.338543 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h2th6" podUID="2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a" Sep 11 02:53:15.338798 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:15.338577 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qb9m9" Sep 11 02:53:15.338798 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:15.338678 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qb9m9" podUID="1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237" Sep 11 02:53:17.338632 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:17.338438 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxq8g" Sep 11 02:53:17.339249 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:17.338438 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h2th6" Sep 11 02:53:17.339249 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:17.338728 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxq8g" podUID="dffb443d-1d41-4705-a57d-1dbad16fff80" Sep 11 02:53:17.339249 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:17.338504 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qb9m9" Sep 11 02:53:17.339249 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:17.338813 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h2th6" podUID="2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a" Sep 11 02:53:17.339249 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:17.338868 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qb9m9" podUID="1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237" Sep 11 02:53:17.471915 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:17.471879 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-d26rx" event={"ID":"cad088c2-48c1-4e27-83e0-40244586b0c0","Type":"ContainerStarted","Data":"7f0a9e74208d5e820dedf364b204d5891ba688b79215e71a7a317f1fb86f4b11"} Sep 11 02:53:17.473678 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:17.473652 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-j54mv" event={"ID":"20839eea-3cc5-49bd-9112-ec0fe94ae537","Type":"ContainerStarted","Data":"0fe2205ee2854405f0959c4ddaffc63647f5fe905e406b275aa409bd7c15845f"} Sep 11 02:53:17.476760 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:17.476733 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" event={"ID":"77be8a04-830c-44b1-b712-725ffff73a4e","Type":"ContainerStarted","Data":"38e3522514cdccb8d1495035c281a97f05cd6ce6d5762a5fd57448e6d1e1ce98"} Sep 11 02:53:17.476894 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:17.476823 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" event={"ID":"77be8a04-830c-44b1-b712-725ffff73a4e","Type":"ContainerStarted","Data":"1d51685eb17a7f8250cd0d52ca7c9ea7d5d869a33faf28e46873a0cbda3740c4"} Sep 11 02:53:17.476894 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:17.476872 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" event={"ID":"77be8a04-830c-44b1-b712-725ffff73a4e","Type":"ContainerStarted","Data":"a19412b2d981f7b222991d6ec5aaabea33b0ed2ed1973d94c92ce57a7599881a"} Sep 11 02:53:17.476986 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:17.476921 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" event={"ID":"77be8a04-830c-44b1-b712-725ffff73a4e","Type":"ContainerStarted","Data":"462735ac3ba557ffc432531382ac55a07510fe0934de9407775feb2332a96aa7"} Sep 11 02:53:17.478333 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:17.478312 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tzxkr" event={"ID":"c31501a3-cea9-47fd-af08-6fb89a5d3e6c","Type":"ContainerStarted","Data":"28a45a5b127803d9c9907d6445833cc14cdff9ffc46eb8ef36fc07c7aa1c8c25"} Sep 11 02:53:17.479763 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:17.479743 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5qzk7" event={"ID":"f5755599-e56c-401d-bec3-6543e0f8ab40","Type":"ContainerStarted","Data":"9af8d1d6395b038db8674b7f7d873de0d6fd6ab2d52d1606d6fdc5451e53b66b"} Sep 11 02:53:17.481218 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:17.481192 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-x6s5v" event={"ID":"958470e1-b0b5-42c0-a6ad-b81f134eb760","Type":"ContainerStarted","Data":"b43f699f9f6ce8883a44eb1611a8871a50f48500d02ab19eebe0ab7fb39e2971"} Sep 11 02:53:17.482663 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:17.482642 2580 generic.go:356] "Generic (PLEG): container finished" podID="7fba1324-3940-475b-9d4d-4557d2c7f603" containerID="a92d4288ecf653511b3afe4ae1434f87022dbfe8f099f03f8a073ae745852b2a" exitCode=0 Sep 11 02:53:17.482744 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:17.482715 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lh4rj" event={"ID":"7fba1324-3940-475b-9d4d-4557d2c7f603","Type":"ContainerDied","Data":"a92d4288ecf653511b3afe4ae1434f87022dbfe8f099f03f8a073ae745852b2a"} Sep 11 02:53:17.484281 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:17.484261 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fncs7" event={"ID":"f5cae9bb-577e-402b-a4be-e44745036dc9","Type":"ContainerStarted","Data":"6f535b651ac82840e8eb14b88e0a7121ad206110db5499807cc6c995ba69ac60"} Sep 11 02:53:17.487147 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:17.487114 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-d26rx" podStartSLOduration=4.034401547 podStartE2EDuration="22.487102741s" totalImagesPullingTime="18.452701194s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 02:52:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:53:17.486858931 +0000 UTC m=+22.626182124" watchObservedRunningTime="2026-09-11 02:53:17.487102741 +0000 UTC m=+22.626425930" Sep 11 02:53:17.487207 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:17.487180 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-210.ec2.internal" podStartSLOduration=21.487174397 podStartE2EDuration="21.487174397s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 02:52:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:53:00.463829526 +0000 UTC m=+5.603152719" watchObservedRunningTime="2026-09-11 02:53:17.487174397 +0000 UTC m=+22.626497588" Sep 11 02:53:17.520754 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:17.520717 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-5qzk7" podStartSLOduration=4.067203835 podStartE2EDuration="22.520703818s" totalImagesPullingTime="18.453499983s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 02:52:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:53:17.520124336 +0000 UTC m=+22.659447527" watchObservedRunningTime="2026-09-11 02:53:17.520703818 +0000 UTC m=+22.660027010" Sep 11 02:53:17.535831 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:17.535788 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-x6s5v" podStartSLOduration=4.091130126 podStartE2EDuration="22.535771234s" totalImagesPullingTime="18.444641108s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 02:52:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:53:17.53513669 +0000 UTC m=+22.674459880" watchObservedRunningTime="2026-09-11 02:53:17.535771234 +0000 UTC m=+22.675094426" Sep 11 02:53:17.549681 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:17.549648 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-tzxkr" podStartSLOduration=4.111038375 podStartE2EDuration="22.549614709s" totalImagesPullingTime="18.438576334s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 02:52:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:53:17.549111232 +0000 UTC m=+22.688434427" watchObservedRunningTime="2026-09-11 02:53:17.549614709 +0000 UTC m=+22.688937900" Sep 11 02:53:17.568405 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:17.568374 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-j54mv" podStartSLOduration=4.053975197 podStartE2EDuration="22.56835217s" totalImagesPullingTime="18.514376973s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 02:52:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:53:17.568101698 +0000 UTC m=+22.707424893" watchObservedRunningTime="2026-09-11 02:53:17.56835217 +0000 UTC m=+22.707675398" Sep 11 02:53:17.694803 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:17.694772 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tzxkr_c31501a3-cea9-47fd-af08-6fb89a5d3e6c/konnectivity-agent/0.log" limit=1024 Sep 11 02:53:17.791242 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:17.791216 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tzxkr_c31501a3-cea9-47fd-af08-6fb89a5d3e6c/konnectivity-agent/0.log" limit=1024 Sep 11 02:53:18.489867 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:18.489826 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" event={"ID":"77be8a04-830c-44b1-b712-725ffff73a4e","Type":"ContainerStarted","Data":"8485ab1bb2eaf9f5748e1cc9fb5fde0db409d7f63a54a02c62c7aeaf2f23b067"} Sep 11 02:53:18.490348 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:18.489951 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" event={"ID":"77be8a04-830c-44b1-b712-725ffff73a4e","Type":"ContainerStarted","Data":"f80a60a9de191b905586f36d550193c7b7f3a230b21d28c3989641f74aa968ed"} Sep 11 02:53:18.491520 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:18.491484 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-p5427" event={"ID":"2167cf85-9290-4962-9f9c-ba69f4fd3866","Type":"ContainerStarted","Data":"2998bb606d8bfe9f3afcf09236c86b4c00669d1121d30ef0a4037cfc2f7b5848"} Sep 11 02:53:18.511598 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:18.511548 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-p5427" podStartSLOduration=5.061825234 podStartE2EDuration="23.511529779s" totalImagesPullingTime="18.449704545s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 02:52:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:53:18.510747405 +0000 UTC m=+23.650070608" watchObservedRunningTime="2026-09-11 02:53:18.511529779 +0000 UTC m=+23.650852971" Sep 11 02:53:18.701945 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:18.701781 2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 11 02:53:19.285023 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:19.284925 2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-11T02:53:18.701942607Z","UUID":"8848000a-494c-4ff8-a66a-e5c09ab4b463","Handler":null,"Name":"","Endpoint":""} Sep 11 02:53:19.286883 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:19.286839 2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 11 02:53:19.286883 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:19.286872 2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 11 02:53:19.337934 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:19.337907 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qb9m9" Sep 11 02:53:19.338113 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:19.338040 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qb9m9" podUID="1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237" Sep 11 02:53:19.338113 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:19.337907 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxq8g" Sep 11 02:53:19.338232 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:19.338134 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxq8g" podUID="dffb443d-1d41-4705-a57d-1dbad16fff80" Sep 11 02:53:19.338232 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:19.338185 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h2th6" Sep 11 02:53:19.338309 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:19.338254 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h2th6" podUID="2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a" Sep 11 02:53:19.496104 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:19.496069 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fncs7" event={"ID":"f5cae9bb-577e-402b-a4be-e44745036dc9","Type":"ContainerStarted","Data":"984612890cc4538c2f706b04e40fe572d5482cd39c8b3700732c28721fe3e893"} Sep 11 02:53:19.694959 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:19.694929 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-tzxkr" Sep 11 02:53:19.695380 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:19.695357 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-tzxkr" Sep 11 02:53:19.837240 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:19.837220 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5qzk7_f5755599-e56c-401d-bec3-6543e0f8ab40/dns-node-resolver/0.log" Sep 11 02:53:20.503847 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:20.503812 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" event={"ID":"77be8a04-830c-44b1-b712-725ffff73a4e","Type":"ContainerStarted","Data":"622a26e921b9557feccfcd8db3022813baa1693a69ec03c8cee2bd1263bee161"} Sep 11 02:53:20.506201 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:20.506172 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fncs7" event={"ID":"f5cae9bb-577e-402b-a4be-e44745036dc9","Type":"ContainerStarted","Data":"8a2c81d77ee201837fbbff7352ebbd5c1157f50e7b8100ae57f2ede61446b2cc"} Sep 11 02:53:20.506506 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:20.506488 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-tzxkr" Sep 11 02:53:20.507177 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:20.507155 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-tzxkr" Sep 11 02:53:20.523856 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:20.523806 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fncs7" podStartSLOduration=4.617960651 podStartE2EDuration="25.523793567s" totalImagesPullingTime="20.905832916s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 02:52:55 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:53:20.523683436 +0000 UTC m=+25.663006632" watchObservedRunningTime="2026-09-11 02:53:20.523793567 +0000 UTC m=+25.663116759" Sep 11 02:53:20.637256 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:20.637224 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-d26rx_cad088c2-48c1-4e27-83e0-40244586b0c0/node-ca/0.log" Sep 11 02:53:21.338636 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:21.338594 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxq8g" Sep 11 02:53:21.338636 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:21.338614 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qb9m9" Sep 11 02:53:21.338842 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:21.338695 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h2th6" Sep 11 02:53:21.338842 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:21.338824 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h2th6" podUID="2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a" Sep 11 02:53:21.338965 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:21.338940 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxq8g" podUID="dffb443d-1d41-4705-a57d-1dbad16fff80" Sep 11 02:53:21.339104 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:21.339035 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qb9m9" podUID="1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237" Sep 11 02:53:22.512844 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:22.512605 2580 generic.go:356] "Generic (PLEG): container finished" podID="7fba1324-3940-475b-9d4d-4557d2c7f603" containerID="a217bf1c2428f0181b334bf5dd1feaaac61633727440ddd5da074fa33099fcc1" exitCode=0 Sep 11 02:53:22.512844 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:22.512694 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lh4rj" event={"ID":"7fba1324-3940-475b-9d4d-4557d2c7f603","Type":"ContainerDied","Data":"a217bf1c2428f0181b334bf5dd1feaaac61633727440ddd5da074fa33099fcc1"} Sep 11 02:53:22.516768 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:22.516741 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" event={"ID":"77be8a04-830c-44b1-b712-725ffff73a4e","Type":"ContainerStarted","Data":"2a3873c461ec6f0fcc0637617701839f33a92db5e0c9658becb103625019e04c"} Sep 11 02:53:22.560307 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:22.560268 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" podStartSLOduration=9.071987381 podStartE2EDuration="27.560253265s" totalImagesPullingTime="18.488265884s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 02:52:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:53:22.558778304 +0000 UTC m=+27.698101496" watchObservedRunningTime="2026-09-11 02:53:22.560253265 +0000 UTC m=+27.699576458" Sep 11 02:53:23.341370 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:23.341334 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h2th6" Sep 11 02:53:23.341646 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:23.341438 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxq8g" Sep 11 02:53:23.341646 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:23.341445 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h2th6" podUID="2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a" Sep 11 02:53:23.341646 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:23.341455 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qb9m9" Sep 11 02:53:23.341646 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:23.341521 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxq8g" podUID="dffb443d-1d41-4705-a57d-1dbad16fff80" Sep 11 02:53:23.341646 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:23.341594 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qb9m9" podUID="1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237" Sep 11 02:53:23.519649 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:23.519464 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" Sep 11 02:53:23.519649 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:23.519545 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" Sep 11 02:53:23.519649 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:23.519580 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" Sep 11 02:53:23.536397 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:23.536373 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" Sep 11 02:53:23.536614 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:23.536594 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" Sep 11 02:53:24.523212 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:24.523186 2580 generic.go:356] "Generic (PLEG): container finished" podID="7fba1324-3940-475b-9d4d-4557d2c7f603" containerID="cdbc977cce0d7a5c1c9365fee40537b08b43839969f04a91dfd31afe6b66f78b" exitCode=0 Sep 11 02:53:24.523640 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:24.523269 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lh4rj" event={"ID":"7fba1324-3940-475b-9d4d-4557d2c7f603","Type":"ContainerDied","Data":"cdbc977cce0d7a5c1c9365fee40537b08b43839969f04a91dfd31afe6b66f78b"} Sep 11 02:53:25.339186 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:25.339147 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxq8g" Sep 11 02:53:25.339366 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:25.339246 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxq8g" podUID="dffb443d-1d41-4705-a57d-1dbad16fff80" Sep 11 02:53:25.339366 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:25.339310 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h2th6" Sep 11 02:53:25.339467 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:25.339375 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h2th6" podUID="2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a" Sep 11 02:53:25.339467 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:25.339416 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qb9m9" Sep 11 02:53:25.339528 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:25.339512 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qb9m9" podUID="1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237" Sep 11 02:53:26.529050 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:26.529016 2580 generic.go:356] "Generic (PLEG): container finished" podID="7fba1324-3940-475b-9d4d-4557d2c7f603" containerID="4a478f2dbc05953d163578fa3929238192c71a9275a8d7cb13716310081e8b3b" exitCode=0 Sep 11 02:53:26.529519 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:26.529075 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lh4rj" event={"ID":"7fba1324-3940-475b-9d4d-4557d2c7f603","Type":"ContainerDied","Data":"4a478f2dbc05953d163578fa3929238192c71a9275a8d7cb13716310081e8b3b"} Sep 11 02:53:27.338469 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:27.338435 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxq8g" Sep 11 02:53:27.338673 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:27.338435 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h2th6" Sep 11 02:53:27.338673 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:27.338445 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qb9m9" Sep 11 02:53:27.338673 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:27.338556 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxq8g" podUID="dffb443d-1d41-4705-a57d-1dbad16fff80" Sep 11 02:53:27.338857 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:27.338705 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qb9m9" podUID="1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237" Sep 11 02:53:27.338857 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:27.338817 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h2th6" podUID="2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a" Sep 11 02:53:28.962103 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:28.962061 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a-original-pull-secret\") pod \"global-pull-secret-syncer-h2th6\" (UID: \"2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a\") " pod="kube-system/global-pull-secret-syncer-h2th6" Sep 11 02:53:28.962493 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:28.962213 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 02:53:28.962493 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:28.962279 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a-original-pull-secret podName:2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a nodeName:}" failed. No retries permitted until 2026-09-11 02:54:00.962260225 +0000 UTC m=+66.101583393 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a-original-pull-secret") pod "global-pull-secret-syncer-h2th6" (UID: "2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a") : object "kube-system"/"original-pull-secret" not registered Sep 11 02:53:29.062491 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:29.062453 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237-metrics-certs\") pod \"network-metrics-daemon-qb9m9\" (UID: \"1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237\") " pod="openshift-multus/network-metrics-daemon-qb9m9" Sep 11 02:53:29.062669 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:29.062589 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 02:53:29.062736 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:29.062675 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237-metrics-certs podName:1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237 nodeName:}" failed. No retries permitted until 2026-09-11 02:54:01.062654216 +0000 UTC m=+66.201977390 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237-metrics-certs") pod "network-metrics-daemon-qb9m9" (UID: "1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 02:53:29.163727 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:29.163690 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrc86\" (UniqueName: \"kubernetes.io/projected/dffb443d-1d41-4705-a57d-1dbad16fff80-kube-api-access-jrc86\") pod \"network-check-target-pxq8g\" (UID: \"dffb443d-1d41-4705-a57d-1dbad16fff80\") " pod="openshift-network-diagnostics/network-check-target-pxq8g" Sep 11 02:53:29.163905 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:29.163882 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 02:53:29.163905 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:29.163900 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 02:53:29.164027 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:29.163910 2580 projected.go:196] Error preparing data for projected volume kube-api-access-jrc86 for pod openshift-network-diagnostics/network-check-target-pxq8g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 02:53:29.164027 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:29.163962 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dffb443d-1d41-4705-a57d-1dbad16fff80-kube-api-access-jrc86 podName:dffb443d-1d41-4705-a57d-1dbad16fff80 nodeName:}" failed. No retries permitted until 2026-09-11 02:54:01.163946096 +0000 UTC m=+66.303269289 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jrc86" (UniqueName: "kubernetes.io/projected/dffb443d-1d41-4705-a57d-1dbad16fff80-kube-api-access-jrc86") pod "network-check-target-pxq8g" (UID: "dffb443d-1d41-4705-a57d-1dbad16fff80") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 02:53:29.337888 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:29.337807 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxq8g" Sep 11 02:53:29.338026 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:29.337910 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxq8g" podUID="dffb443d-1d41-4705-a57d-1dbad16fff80" Sep 11 02:53:29.338213 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:29.338198 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qb9m9" Sep 11 02:53:29.338288 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:29.338274 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qb9m9" podUID="1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237" Sep 11 02:53:29.338456 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:29.338428 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h2th6" Sep 11 02:53:29.338579 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:29.338529 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h2th6" podUID="2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a" Sep 11 02:53:30.540991 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:30.540964 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lh4rj" event={"ID":"7fba1324-3940-475b-9d4d-4557d2c7f603","Type":"ContainerStarted","Data":"5da2ea066a4195e8c440e8c0dc8f3f5aba2c13b960d98e4040acb47ef00df478"} Sep 11 02:53:31.338232 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:31.338201 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h2th6" Sep 11 02:53:31.338232 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:31.338214 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qb9m9" Sep 11 02:53:31.338456 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:31.338201 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxq8g" Sep 11 02:53:31.338456 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:31.338291 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h2th6" podUID="2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a" Sep 11 02:53:31.338456 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:31.338371 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxq8g" podUID="dffb443d-1d41-4705-a57d-1dbad16fff80" Sep 11 02:53:31.338456 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:31.338436 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qb9m9" podUID="1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237" Sep 11 02:53:31.545183 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:31.545151 2580 generic.go:356] "Generic (PLEG): container finished" podID="7fba1324-3940-475b-9d4d-4557d2c7f603" containerID="5da2ea066a4195e8c440e8c0dc8f3f5aba2c13b960d98e4040acb47ef00df478" exitCode=0 Sep 11 02:53:31.545498 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:31.545207 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lh4rj" event={"ID":"7fba1324-3940-475b-9d4d-4557d2c7f603","Type":"ContainerDied","Data":"5da2ea066a4195e8c440e8c0dc8f3f5aba2c13b960d98e4040acb47ef00df478"} Sep 11 02:53:32.550515 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:32.550323 2580 generic.go:356] "Generic (PLEG): container finished" podID="7fba1324-3940-475b-9d4d-4557d2c7f603" containerID="9a7a09e47be1afa39b59480856b9533c746f5dd47913edea9eddb9b5c056f5d3" exitCode=0 Sep 11 02:53:32.550963 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:32.550412 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lh4rj" event={"ID":"7fba1324-3940-475b-9d4d-4557d2c7f603","Type":"ContainerDied","Data":"9a7a09e47be1afa39b59480856b9533c746f5dd47913edea9eddb9b5c056f5d3"} Sep 11 02:53:33.338498 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:33.338465 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h2th6" Sep 11 02:53:33.338498 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:33.338491 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qb9m9" Sep 11 02:53:33.338744 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:33.338473 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxq8g" Sep 11 02:53:33.338744 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:33.338563 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h2th6" podUID="2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a" Sep 11 02:53:33.338744 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:33.338679 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qb9m9" podUID="1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237" Sep 11 02:53:33.338907 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:33.338770 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxq8g" podUID="dffb443d-1d41-4705-a57d-1dbad16fff80" Sep 11 02:53:33.556312 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:33.556282 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lh4rj" event={"ID":"7fba1324-3940-475b-9d4d-4557d2c7f603","Type":"ContainerStarted","Data":"641d6de39c246b3d3a23c6c1df41a72281806caf425808e0d23a1e4e2bddffb8"} Sep 11 02:53:33.578320 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:33.578279 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-lh4rj" podStartSLOduration=9.114221759 podStartE2EDuration="38.578265308s" totalImagesPullingTime="29.464043549s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 02:52:55 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:53:33.576519901 +0000 UTC m=+38.715843092" watchObservedRunningTime="2026-09-11 02:53:33.578265308 +0000 UTC m=+38.717588500" Sep 11 02:53:35.339139 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:35.339116 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h2th6" Sep 11 02:53:35.339517 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:35.339204 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h2th6" podUID="2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a" Sep 11 02:53:35.339517 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:35.339253 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxq8g" Sep 11 02:53:35.339517 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:35.339318 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxq8g" podUID="dffb443d-1d41-4705-a57d-1dbad16fff80" Sep 11 02:53:35.339517 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:35.339339 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qb9m9" Sep 11 02:53:35.339517 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:35.339419 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qb9m9" podUID="1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237" Sep 11 02:53:37.337926 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:37.337894 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h2th6" Sep 11 02:53:37.337926 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:37.337911 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxq8g" Sep 11 02:53:37.338390 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:37.337896 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qb9m9" Sep 11 02:53:37.338390 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:37.337984 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h2th6" podUID="2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a" Sep 11 02:53:37.338390 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:37.338057 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxq8g" podUID="dffb443d-1d41-4705-a57d-1dbad16fff80" Sep 11 02:53:37.338390 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:37.338120 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qb9m9" podUID="1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237" Sep 11 02:53:39.338127 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:39.338100 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxq8g" Sep 11 02:53:39.338127 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:39.338123 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qb9m9" Sep 11 02:53:39.338607 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:39.338100 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h2th6" Sep 11 02:53:39.338607 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:39.338200 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxq8g" podUID="dffb443d-1d41-4705-a57d-1dbad16fff80" Sep 11 02:53:39.338607 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:39.338305 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h2th6" podUID="2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a" Sep 11 02:53:39.338607 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:39.338403 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qb9m9" podUID="1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237" Sep 11 02:53:41.337679 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:41.337644 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxq8g" Sep 11 02:53:41.337679 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:41.337663 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qb9m9" Sep 11 02:53:41.338100 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:41.337644 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h2th6" Sep 11 02:53:41.338100 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:41.337749 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxq8g" podUID="dffb443d-1d41-4705-a57d-1dbad16fff80" Sep 11 02:53:41.338100 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:41.337846 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qb9m9" podUID="1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237" Sep 11 02:53:41.338100 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:41.337896 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h2th6" podUID="2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a" Sep 11 02:53:42.130758 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:42.130729 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-h2th6"] Sep 11 02:53:42.130902 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:42.130854 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h2th6" Sep 11 02:53:42.130986 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:42.130964 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h2th6" podUID="2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a" Sep 11 02:53:42.136061 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:42.136034 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qb9m9"] Sep 11 02:53:42.136474 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:42.136150 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qb9m9" Sep 11 02:53:42.136474 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:42.136261 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qb9m9" podUID="1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237" Sep 11 02:53:42.136812 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:42.136787 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pxq8g"] Sep 11 02:53:42.136993 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:42.136861 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxq8g" Sep 11 02:53:42.136993 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:42.136937 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxq8g" podUID="dffb443d-1d41-4705-a57d-1dbad16fff80" Sep 11 02:53:44.338252 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:44.338222 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qb9m9" Sep 11 02:53:44.338679 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:44.338222 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h2th6" Sep 11 02:53:44.338679 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:44.338318 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qb9m9" podUID="1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237" Sep 11 02:53:44.338679 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:44.338222 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxq8g" Sep 11 02:53:44.338679 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:44.338387 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h2th6" podUID="2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a" Sep 11 02:53:44.338679 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:44.338479 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxq8g" podUID="dffb443d-1d41-4705-a57d-1dbad16fff80" Sep 11 02:53:46.338517 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:46.338289 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qb9m9" Sep 11 02:53:46.338925 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:46.338314 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h2th6" Sep 11 02:53:46.338925 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:46.338597 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qb9m9" podUID="1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237" Sep 11 02:53:46.338925 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:46.338349 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxq8g" Sep 11 02:53:46.338925 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:46.338689 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h2th6" podUID="2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a" Sep 11 02:53:46.338925 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:53:46.338711 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxq8g" podUID="dffb443d-1d41-4705-a57d-1dbad16fff80" Sep 11 02:53:46.646580 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:46.646514 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-210.ec2.internal" event="NodeReady" Sep 11 02:53:46.646727 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:46.646658 2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 11 02:53:46.691595 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:46.691565 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vpgxz"] Sep 11 02:53:46.716444 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:46.716423 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8chld"] Sep 11 02:53:46.716553 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:46.716542 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vpgxz" Sep 11 02:53:46.719183 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:46.719160 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 11 02:53:46.719296 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:46.719217 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 11 02:53:46.719296 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:46.719163 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-kxxqm\"" Sep 11 02:53:46.719296 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:46.719163 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 11 02:53:46.740494 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:46.740474 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vpgxz"] Sep 11 02:53:46.740594 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:46.740505 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8chld"] Sep 11 02:53:46.740594 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:46.740534 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vf6hb"] Sep 11 02:53:46.740730 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:46.740593 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8chld" Sep 11 02:53:46.743398 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:46.743381 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 11 02:53:46.743504 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:46.743427 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 11 02:53:46.743572 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:46.743535 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 11 02:53:46.743705 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:46.743688 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xfvtk\"" Sep 11 02:53:46.743779 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:46.743724 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 11 02:53:46.755913 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:46.755890 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vf6hb"] Sep 11 02:53:46.755989 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:46.755968 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vf6hb" Sep 11 02:53:46.759197 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:46.759180 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 11 02:53:46.759321 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:46.759187 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-r5gwk\"" Sep 11 02:53:46.759585 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:46.759572 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 11 02:53:46.893510 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:46.893486 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4fzn\" (UniqueName: \"kubernetes.io/projected/78189675-5274-4826-99e2-69c83a7b59e3-kube-api-access-d4fzn\") pod \"dns-default-vf6hb\" (UID: \"78189675-5274-4826-99e2-69c83a7b59e3\") " pod="openshift-dns/dns-default-vf6hb" Sep 11 02:53:46.893656 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:46.893514 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2986\" (UniqueName: \"kubernetes.io/projected/c7169bef-9526-47a6-accd-4192623b9eca-kube-api-access-k2986\") pod \"ingress-canary-vpgxz\" (UID: \"c7169bef-9526-47a6-accd-4192623b9eca\") " pod="openshift-ingress-canary/ingress-canary-vpgxz" Sep 11 02:53:46.893656 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:46.893550 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d72r4\" (UniqueName: \"kubernetes.io/projected/d361fc5b-5ed7-460a-ba3b-d1789ce6f25d-kube-api-access-d72r4\") pod \"insights-runtime-extractor-8chld\" (UID: \"d361fc5b-5ed7-460a-ba3b-d1789ce6f25d\") " pod="openshift-insights/insights-runtime-extractor-8chld" Sep 11 02:53:46.893656 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:46.893579 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d361fc5b-5ed7-460a-ba3b-d1789ce6f25d-data-volume\") pod \"insights-runtime-extractor-8chld\" (UID: \"d361fc5b-5ed7-460a-ba3b-d1789ce6f25d\") " pod="openshift-insights/insights-runtime-extractor-8chld" Sep 11 02:53:46.893799 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:46.893654 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d361fc5b-5ed7-460a-ba3b-d1789ce6f25d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8chld\" (UID: \"d361fc5b-5ed7-460a-ba3b-d1789ce6f25d\") " pod="openshift-insights/insights-runtime-extractor-8chld" Sep 11 02:53:46.893799 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:46.893700 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/78189675-5274-4826-99e2-69c83a7b59e3-config-volume\") pod \"dns-default-vf6hb\" (UID: \"78189675-5274-4826-99e2-69c83a7b59e3\") " pod="openshift-dns/dns-default-vf6hb" Sep 11 02:53:46.893799 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:46.893730 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/78189675-5274-4826-99e2-69c83a7b59e3-metrics-tls\") pod \"dns-default-vf6hb\" (UID: \"78189675-5274-4826-99e2-69c83a7b59e3\") " pod="openshift-dns/dns-default-vf6hb" Sep 11 02:53:46.893799 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:46.893746 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/78189675-5274-4826-99e2-69c83a7b59e3-tmp-dir\") pod \"dns-default-vf6hb\" (UID: \"78189675-5274-4826-99e2-69c83a7b59e3\") " pod="openshift-dns/dns-default-vf6hb" Sep 11 02:53:46.893799 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:46.893767 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d361fc5b-5ed7-460a-ba3b-d1789ce6f25d-crio-socket\") pod \"insights-runtime-extractor-8chld\" (UID: \"d361fc5b-5ed7-460a-ba3b-d1789ce6f25d\") " pod="openshift-insights/insights-runtime-extractor-8chld" Sep 11 02:53:46.893799 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:46.893785 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d361fc5b-5ed7-460a-ba3b-d1789ce6f25d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8chld\" (UID: \"d361fc5b-5ed7-460a-ba3b-d1789ce6f25d\") " pod="openshift-insights/insights-runtime-extractor-8chld" Sep 11 02:53:46.894013 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:46.893849 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c7169bef-9526-47a6-accd-4192623b9eca-cert\") pod \"ingress-canary-vpgxz\" (UID: \"c7169bef-9526-47a6-accd-4192623b9eca\") " pod="openshift-ingress-canary/ingress-canary-vpgxz" Sep 11 02:53:46.994274 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:46.994254 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d72r4\" (UniqueName: \"kubernetes.io/projected/d361fc5b-5ed7-460a-ba3b-d1789ce6f25d-kube-api-access-d72r4\") pod \"insights-runtime-extractor-8chld\" (UID: \"d361fc5b-5ed7-460a-ba3b-d1789ce6f25d\") " pod="openshift-insights/insights-runtime-extractor-8chld" Sep 11 02:53:46.994360 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:46.994278 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d361fc5b-5ed7-460a-ba3b-d1789ce6f25d-data-volume\") pod \"insights-runtime-extractor-8chld\" (UID: \"d361fc5b-5ed7-460a-ba3b-d1789ce6f25d\") " pod="openshift-insights/insights-runtime-extractor-8chld" Sep 11 02:53:46.994360 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:46.994296 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d361fc5b-5ed7-460a-ba3b-d1789ce6f25d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8chld\" (UID: \"d361fc5b-5ed7-460a-ba3b-d1789ce6f25d\") " pod="openshift-insights/insights-runtime-extractor-8chld" Sep 11 02:53:46.994360 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:46.994316 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/78189675-5274-4826-99e2-69c83a7b59e3-config-volume\") pod \"dns-default-vf6hb\" (UID: \"78189675-5274-4826-99e2-69c83a7b59e3\") " pod="openshift-dns/dns-default-vf6hb" Sep 11 02:53:46.994360 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:46.994330 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/78189675-5274-4826-99e2-69c83a7b59e3-metrics-tls\") pod \"dns-default-vf6hb\" (UID: \"78189675-5274-4826-99e2-69c83a7b59e3\") " pod="openshift-dns/dns-default-vf6hb" Sep 11 02:53:46.994554 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:46.994363 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/78189675-5274-4826-99e2-69c83a7b59e3-tmp-dir\") pod \"dns-default-vf6hb\" (UID: \"78189675-5274-4826-99e2-69c83a7b59e3\") " pod="openshift-dns/dns-default-vf6hb" Sep 11 02:53:46.994554 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:46.994386 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d361fc5b-5ed7-460a-ba3b-d1789ce6f25d-crio-socket\") pod \"insights-runtime-extractor-8chld\" (UID: \"d361fc5b-5ed7-460a-ba3b-d1789ce6f25d\") " pod="openshift-insights/insights-runtime-extractor-8chld" Sep 11 02:53:46.994554 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:46.994401 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d361fc5b-5ed7-460a-ba3b-d1789ce6f25d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8chld\" (UID: \"d361fc5b-5ed7-460a-ba3b-d1789ce6f25d\") " pod="openshift-insights/insights-runtime-extractor-8chld" Sep 11 02:53:46.994554 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:46.994433 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c7169bef-9526-47a6-accd-4192623b9eca-cert\") pod \"ingress-canary-vpgxz\" (UID: \"c7169bef-9526-47a6-accd-4192623b9eca\") " pod="openshift-ingress-canary/ingress-canary-vpgxz" Sep 11 02:53:46.994554 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:46.994467 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4fzn\" (UniqueName: \"kubernetes.io/projected/78189675-5274-4826-99e2-69c83a7b59e3-kube-api-access-d4fzn\") pod \"dns-default-vf6hb\" (UID: \"78189675-5274-4826-99e2-69c83a7b59e3\") " pod="openshift-dns/dns-default-vf6hb" Sep 11 02:53:46.994820 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:46.994566 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2986\" (UniqueName: \"kubernetes.io/projected/c7169bef-9526-47a6-accd-4192623b9eca-kube-api-access-k2986\") pod \"ingress-canary-vpgxz\" (UID: \"c7169bef-9526-47a6-accd-4192623b9eca\") " pod="openshift-ingress-canary/ingress-canary-vpgxz" Sep 11 02:53:46.994820 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:46.994705 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d361fc5b-5ed7-460a-ba3b-d1789ce6f25d-crio-socket\") pod \"insights-runtime-extractor-8chld\" (UID: \"d361fc5b-5ed7-460a-ba3b-d1789ce6f25d\") " pod="openshift-insights/insights-runtime-extractor-8chld" Sep 11 02:53:46.995297 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:46.994996 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/78189675-5274-4826-99e2-69c83a7b59e3-tmp-dir\") pod \"dns-default-vf6hb\" (UID: \"78189675-5274-4826-99e2-69c83a7b59e3\") " pod="openshift-dns/dns-default-vf6hb" Sep 11 02:53:46.995297 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:46.995222 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d361fc5b-5ed7-460a-ba3b-d1789ce6f25d-data-volume\") pod \"insights-runtime-extractor-8chld\" (UID: \"d361fc5b-5ed7-460a-ba3b-d1789ce6f25d\") " pod="openshift-insights/insights-runtime-extractor-8chld" Sep 11 02:53:46.995297 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:46.995224 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/78189675-5274-4826-99e2-69c83a7b59e3-config-volume\") pod \"dns-default-vf6hb\" (UID: \"78189675-5274-4826-99e2-69c83a7b59e3\") " pod="openshift-dns/dns-default-vf6hb" Sep 11 02:53:46.995435 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:46.995310 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d361fc5b-5ed7-460a-ba3b-d1789ce6f25d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8chld\" (UID: \"d361fc5b-5ed7-460a-ba3b-d1789ce6f25d\") " pod="openshift-insights/insights-runtime-extractor-8chld" Sep 11 02:53:46.998541 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:46.998520 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c7169bef-9526-47a6-accd-4192623b9eca-cert\") pod \"ingress-canary-vpgxz\" (UID: \"c7169bef-9526-47a6-accd-4192623b9eca\") " pod="openshift-ingress-canary/ingress-canary-vpgxz" Sep 11 02:53:46.998541 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:46.998536 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/78189675-5274-4826-99e2-69c83a7b59e3-metrics-tls\") pod \"dns-default-vf6hb\" (UID: \"78189675-5274-4826-99e2-69c83a7b59e3\") " pod="openshift-dns/dns-default-vf6hb" Sep 11 02:53:46.998712 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:46.998536 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d361fc5b-5ed7-460a-ba3b-d1789ce6f25d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8chld\" (UID: \"d361fc5b-5ed7-460a-ba3b-d1789ce6f25d\") " pod="openshift-insights/insights-runtime-extractor-8chld" Sep 11 02:53:47.010394 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:47.010377 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d72r4\" (UniqueName: \"kubernetes.io/projected/d361fc5b-5ed7-460a-ba3b-d1789ce6f25d-kube-api-access-d72r4\") pod \"insights-runtime-extractor-8chld\" (UID: \"d361fc5b-5ed7-460a-ba3b-d1789ce6f25d\") " pod="openshift-insights/insights-runtime-extractor-8chld" Sep 11 02:53:47.014026 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:47.013999 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4fzn\" (UniqueName: \"kubernetes.io/projected/78189675-5274-4826-99e2-69c83a7b59e3-kube-api-access-d4fzn\") pod \"dns-default-vf6hb\" (UID: \"78189675-5274-4826-99e2-69c83a7b59e3\") " pod="openshift-dns/dns-default-vf6hb" Sep 11 02:53:47.014347 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:47.014332 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2986\" (UniqueName: \"kubernetes.io/projected/c7169bef-9526-47a6-accd-4192623b9eca-kube-api-access-k2986\") pod \"ingress-canary-vpgxz\" (UID: \"c7169bef-9526-47a6-accd-4192623b9eca\") " pod="openshift-ingress-canary/ingress-canary-vpgxz" Sep 11 02:53:47.026149 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:47.026132 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vpgxz" Sep 11 02:53:47.040049 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:47.040030 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7447c8fc9c-5n6bm"] Sep 11 02:53:47.048474 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:47.048450 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8chld" Sep 11 02:53:47.062299 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:47.062279 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7447c8fc9c-5n6bm"] Sep 11 02:53:47.062376 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:47.062361 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7447c8fc9c-5n6bm" Sep 11 02:53:47.062967 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:47.062920 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vf6hb" Sep 11 02:53:47.065456 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:47.065275 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 11 02:53:47.065456 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:47.065309 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-zbxlp\"" Sep 11 02:53:47.065456 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:47.065323 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 11 02:53:47.065456 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:47.065273 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 11 02:53:47.065456 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:47.065361 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 11 02:53:47.066563 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:47.066547 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 11 02:53:47.066667 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:47.066594 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 11 02:53:47.066731 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:47.066684 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 11 02:53:47.197160 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:47.197109 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/55922251-fd40-4f6b-a4d4-97ba03fbe579-console-oauth-config\") pod \"console-7447c8fc9c-5n6bm\" (UID: \"55922251-fd40-4f6b-a4d4-97ba03fbe579\") " pod="openshift-console/console-7447c8fc9c-5n6bm" Sep 11 02:53:47.197296 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:47.197169 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/55922251-fd40-4f6b-a4d4-97ba03fbe579-oauth-serving-cert\") pod \"console-7447c8fc9c-5n6bm\" (UID: \"55922251-fd40-4f6b-a4d4-97ba03fbe579\") " pod="openshift-console/console-7447c8fc9c-5n6bm" Sep 11 02:53:47.197296 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:47.197224 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/55922251-fd40-4f6b-a4d4-97ba03fbe579-service-ca\") pod \"console-7447c8fc9c-5n6bm\" (UID: \"55922251-fd40-4f6b-a4d4-97ba03fbe579\") " pod="openshift-console/console-7447c8fc9c-5n6bm" Sep 11 02:53:47.197296 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:47.197243 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/55922251-fd40-4f6b-a4d4-97ba03fbe579-console-config\") pod \"console-7447c8fc9c-5n6bm\" (UID: \"55922251-fd40-4f6b-a4d4-97ba03fbe579\") " pod="openshift-console/console-7447c8fc9c-5n6bm" Sep 11 02:53:47.197296 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:47.197270 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/55922251-fd40-4f6b-a4d4-97ba03fbe579-console-serving-cert\") pod \"console-7447c8fc9c-5n6bm\" (UID: \"55922251-fd40-4f6b-a4d4-97ba03fbe579\") " pod="openshift-console/console-7447c8fc9c-5n6bm" Sep 11 02:53:47.197296 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:47.197289 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzgdr\" (UniqueName: \"kubernetes.io/projected/55922251-fd40-4f6b-a4d4-97ba03fbe579-kube-api-access-dzgdr\") pod \"console-7447c8fc9c-5n6bm\" (UID: \"55922251-fd40-4f6b-a4d4-97ba03fbe579\") " pod="openshift-console/console-7447c8fc9c-5n6bm" Sep 11 02:53:47.298042 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:47.297976 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/55922251-fd40-4f6b-a4d4-97ba03fbe579-console-oauth-config\") pod \"console-7447c8fc9c-5n6bm\" (UID: \"55922251-fd40-4f6b-a4d4-97ba03fbe579\") " pod="openshift-console/console-7447c8fc9c-5n6bm" Sep 11 02:53:47.298042 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:47.298013 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/55922251-fd40-4f6b-a4d4-97ba03fbe579-oauth-serving-cert\") pod \"console-7447c8fc9c-5n6bm\" (UID: \"55922251-fd40-4f6b-a4d4-97ba03fbe579\") " pod="openshift-console/console-7447c8fc9c-5n6bm" Sep 11 02:53:47.298188 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:47.298082 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/55922251-fd40-4f6b-a4d4-97ba03fbe579-service-ca\") pod \"console-7447c8fc9c-5n6bm\" (UID: \"55922251-fd40-4f6b-a4d4-97ba03fbe579\") " pod="openshift-console/console-7447c8fc9c-5n6bm" Sep 11 02:53:47.298188 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:47.298111 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/55922251-fd40-4f6b-a4d4-97ba03fbe579-console-config\") pod \"console-7447c8fc9c-5n6bm\" (UID: \"55922251-fd40-4f6b-a4d4-97ba03fbe579\") " pod="openshift-console/console-7447c8fc9c-5n6bm" Sep 11 02:53:47.298188 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:47.298150 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/55922251-fd40-4f6b-a4d4-97ba03fbe579-console-serving-cert\") pod \"console-7447c8fc9c-5n6bm\" (UID: \"55922251-fd40-4f6b-a4d4-97ba03fbe579\") " pod="openshift-console/console-7447c8fc9c-5n6bm" Sep 11 02:53:47.298188 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:47.298178 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzgdr\" (UniqueName: \"kubernetes.io/projected/55922251-fd40-4f6b-a4d4-97ba03fbe579-kube-api-access-dzgdr\") pod \"console-7447c8fc9c-5n6bm\" (UID: \"55922251-fd40-4f6b-a4d4-97ba03fbe579\") " pod="openshift-console/console-7447c8fc9c-5n6bm" Sep 11 02:53:47.298921 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:47.298888 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/55922251-fd40-4f6b-a4d4-97ba03fbe579-oauth-serving-cert\") pod \"console-7447c8fc9c-5n6bm\" (UID: \"55922251-fd40-4f6b-a4d4-97ba03fbe579\") " pod="openshift-console/console-7447c8fc9c-5n6bm" Sep 11 02:53:47.299060 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:47.299036 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/55922251-fd40-4f6b-a4d4-97ba03fbe579-service-ca\") pod \"console-7447c8fc9c-5n6bm\" (UID: \"55922251-fd40-4f6b-a4d4-97ba03fbe579\") " pod="openshift-console/console-7447c8fc9c-5n6bm" Sep 11 02:53:47.299103 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:47.299053 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/55922251-fd40-4f6b-a4d4-97ba03fbe579-console-config\") pod \"console-7447c8fc9c-5n6bm\" (UID: \"55922251-fd40-4f6b-a4d4-97ba03fbe579\") " pod="openshift-console/console-7447c8fc9c-5n6bm" Sep 11 02:53:47.300692 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:47.300670 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/55922251-fd40-4f6b-a4d4-97ba03fbe579-console-oauth-config\") pod \"console-7447c8fc9c-5n6bm\" (UID: \"55922251-fd40-4f6b-a4d4-97ba03fbe579\") " pod="openshift-console/console-7447c8fc9c-5n6bm" Sep 11 02:53:47.300781 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:47.300764 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/55922251-fd40-4f6b-a4d4-97ba03fbe579-console-serving-cert\") pod \"console-7447c8fc9c-5n6bm\" (UID: \"55922251-fd40-4f6b-a4d4-97ba03fbe579\") " pod="openshift-console/console-7447c8fc9c-5n6bm" Sep 11 02:53:47.306822 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:47.306801 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzgdr\" (UniqueName: \"kubernetes.io/projected/55922251-fd40-4f6b-a4d4-97ba03fbe579-kube-api-access-dzgdr\") pod \"console-7447c8fc9c-5n6bm\" (UID: \"55922251-fd40-4f6b-a4d4-97ba03fbe579\") " pod="openshift-console/console-7447c8fc9c-5n6bm" Sep 11 02:53:47.372741 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:47.372720 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7447c8fc9c-5n6bm" Sep 11 02:53:47.376610 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:47.376589 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vpgxz"] Sep 11 02:53:47.380420 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:47.380399 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8chld"] Sep 11 02:53:47.380772 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:53:47.380744 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7169bef_9526_47a6_accd_4192623b9eca.slice/crio-aa4dd8ac3e332e34e27cfa739d898526a31b404528af278802e07c1cf5388005 WatchSource:0}: Error finding container aa4dd8ac3e332e34e27cfa739d898526a31b404528af278802e07c1cf5388005: Status 404 returned error can't find the container with id aa4dd8ac3e332e34e27cfa739d898526a31b404528af278802e07c1cf5388005 Sep 11 02:53:47.382913 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:53:47.382888 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd361fc5b_5ed7_460a_ba3b_d1789ce6f25d.slice/crio-0ef57222c5ac7984da731f7834b7af2861da1b441f315dae945ccd545a0ed274 WatchSource:0}: Error finding container 0ef57222c5ac7984da731f7834b7af2861da1b441f315dae945ccd545a0ed274: Status 404 returned error can't find the container with id 0ef57222c5ac7984da731f7834b7af2861da1b441f315dae945ccd545a0ed274 Sep 11 02:53:47.385730 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:47.385713 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vf6hb"] Sep 11 02:53:47.388679 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:53:47.388656 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78189675_5274_4826_99e2_69c83a7b59e3.slice/crio-6817bb030f25542a8771b1caeb84077dd6d691a6dd4fe015dfaca6ae6d14ee09 WatchSource:0}: Error finding container 6817bb030f25542a8771b1caeb84077dd6d691a6dd4fe015dfaca6ae6d14ee09: Status 404 returned error can't find the container with id 6817bb030f25542a8771b1caeb84077dd6d691a6dd4fe015dfaca6ae6d14ee09 Sep 11 02:53:47.585512 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:47.585418 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vf6hb" event={"ID":"78189675-5274-4826-99e2-69c83a7b59e3","Type":"ContainerStarted","Data":"6817bb030f25542a8771b1caeb84077dd6d691a6dd4fe015dfaca6ae6d14ee09"} Sep 11 02:53:47.586895 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:47.586867 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8chld" event={"ID":"d361fc5b-5ed7-460a-ba3b-d1789ce6f25d","Type":"ContainerStarted","Data":"c5491af75cdad81d8d1dec874a23068b731277903a74d4bf16af498b4a1ba160"} Sep 11 02:53:47.586985 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:47.586920 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8chld" event={"ID":"d361fc5b-5ed7-460a-ba3b-d1789ce6f25d","Type":"ContainerStarted","Data":"0ef57222c5ac7984da731f7834b7af2861da1b441f315dae945ccd545a0ed274"} Sep 11 02:53:47.587916 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:47.587892 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vpgxz" event={"ID":"c7169bef-9526-47a6-accd-4192623b9eca","Type":"ContainerStarted","Data":"aa4dd8ac3e332e34e27cfa739d898526a31b404528af278802e07c1cf5388005"} Sep 11 02:53:47.673030 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:47.673004 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7447c8fc9c-5n6bm"] Sep 11 02:53:47.676276 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:53:47.676257 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55922251_fd40_4f6b_a4d4_97ba03fbe579.slice/crio-11d9772743eacd9009482ab1b560c7eb9d51434a96deeedc03470158f9e309c3 WatchSource:0}: Error finding container 11d9772743eacd9009482ab1b560c7eb9d51434a96deeedc03470158f9e309c3: Status 404 returned error can't find the container with id 11d9772743eacd9009482ab1b560c7eb9d51434a96deeedc03470158f9e309c3 Sep 11 02:53:48.337905 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:48.337869 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qb9m9" Sep 11 02:53:48.337905 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:48.337890 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxq8g" Sep 11 02:53:48.338135 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:48.337915 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h2th6" Sep 11 02:53:48.342202 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:48.342180 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 11 02:53:48.342331 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:48.342186 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jdnxv\"" Sep 11 02:53:48.342423 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:48.342406 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 11 02:53:48.342554 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:48.342541 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 11 02:53:48.342645 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:48.342607 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kjvvr\"" Sep 11 02:53:48.342708 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:48.342698 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 11 02:53:48.398392 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:48.398365 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7949df7596-bxcws"] Sep 11 02:53:48.400420 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:48.400399 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7949df7596-bxcws" Sep 11 02:53:48.409367 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:48.409346 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 11 02:53:48.413206 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:48.412592 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7949df7596-bxcws"] Sep 11 02:53:48.508180 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:48.508150 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6fd469b7-01d6-4078-bd48-46013095bd0d-oauth-serving-cert\") pod \"console-7949df7596-bxcws\" (UID: \"6fd469b7-01d6-4078-bd48-46013095bd0d\") " pod="openshift-console/console-7949df7596-bxcws" Sep 11 02:53:48.508356 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:48.508192 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6fd469b7-01d6-4078-bd48-46013095bd0d-console-serving-cert\") pod \"console-7949df7596-bxcws\" (UID: \"6fd469b7-01d6-4078-bd48-46013095bd0d\") " pod="openshift-console/console-7949df7596-bxcws" Sep 11 02:53:48.508356 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:48.508265 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6fd469b7-01d6-4078-bd48-46013095bd0d-console-config\") pod \"console-7949df7596-bxcws\" (UID: \"6fd469b7-01d6-4078-bd48-46013095bd0d\") " pod="openshift-console/console-7949df7596-bxcws" Sep 11 02:53:48.508356 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:48.508309 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fd469b7-01d6-4078-bd48-46013095bd0d-trusted-ca-bundle\") pod \"console-7949df7596-bxcws\" (UID: \"6fd469b7-01d6-4078-bd48-46013095bd0d\") " pod="openshift-console/console-7949df7596-bxcws" Sep 11 02:53:48.508356 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:48.508326 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5nl5\" (UniqueName: \"kubernetes.io/projected/6fd469b7-01d6-4078-bd48-46013095bd0d-kube-api-access-p5nl5\") pod \"console-7949df7596-bxcws\" (UID: \"6fd469b7-01d6-4078-bd48-46013095bd0d\") " pod="openshift-console/console-7949df7596-bxcws" Sep 11 02:53:48.508550 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:48.508390 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6fd469b7-01d6-4078-bd48-46013095bd0d-console-oauth-config\") pod \"console-7949df7596-bxcws\" (UID: \"6fd469b7-01d6-4078-bd48-46013095bd0d\") " pod="openshift-console/console-7949df7596-bxcws" Sep 11 02:53:48.508550 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:48.508426 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6fd469b7-01d6-4078-bd48-46013095bd0d-service-ca\") pod \"console-7949df7596-bxcws\" (UID: \"6fd469b7-01d6-4078-bd48-46013095bd0d\") " pod="openshift-console/console-7949df7596-bxcws" Sep 11 02:53:48.593482 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:48.593446 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7447c8fc9c-5n6bm" event={"ID":"55922251-fd40-4f6b-a4d4-97ba03fbe579","Type":"ContainerStarted","Data":"11d9772743eacd9009482ab1b560c7eb9d51434a96deeedc03470158f9e309c3"} Sep 11 02:53:48.596949 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:48.596922 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8chld" event={"ID":"d361fc5b-5ed7-460a-ba3b-d1789ce6f25d","Type":"ContainerStarted","Data":"e7f6db9f6db8eb3bee07e504e5b02ad25a3707d88efc1638b2a71a76b432a899"} Sep 11 02:53:48.610530 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:48.610503 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6fd469b7-01d6-4078-bd48-46013095bd0d-console-oauth-config\") pod \"console-7949df7596-bxcws\" (UID: \"6fd469b7-01d6-4078-bd48-46013095bd0d\") " pod="openshift-console/console-7949df7596-bxcws" Sep 11 02:53:48.610720 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:48.610557 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6fd469b7-01d6-4078-bd48-46013095bd0d-service-ca\") pod \"console-7949df7596-bxcws\" (UID: \"6fd469b7-01d6-4078-bd48-46013095bd0d\") " pod="openshift-console/console-7949df7596-bxcws" Sep 11 02:53:48.610720 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:48.610596 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6fd469b7-01d6-4078-bd48-46013095bd0d-oauth-serving-cert\") pod \"console-7949df7596-bxcws\" (UID: \"6fd469b7-01d6-4078-bd48-46013095bd0d\") " pod="openshift-console/console-7949df7596-bxcws" Sep 11 02:53:48.610720 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:48.610644 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6fd469b7-01d6-4078-bd48-46013095bd0d-console-serving-cert\") pod \"console-7949df7596-bxcws\" (UID: \"6fd469b7-01d6-4078-bd48-46013095bd0d\") " pod="openshift-console/console-7949df7596-bxcws" Sep 11 02:53:48.610720 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:48.610679 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6fd469b7-01d6-4078-bd48-46013095bd0d-console-config\") pod \"console-7949df7596-bxcws\" (UID: \"6fd469b7-01d6-4078-bd48-46013095bd0d\") " pod="openshift-console/console-7949df7596-bxcws" Sep 11 02:53:48.610720 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:48.610714 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fd469b7-01d6-4078-bd48-46013095bd0d-trusted-ca-bundle\") pod \"console-7949df7596-bxcws\" (UID: \"6fd469b7-01d6-4078-bd48-46013095bd0d\") " pod="openshift-console/console-7949df7596-bxcws" Sep 11 02:53:48.610986 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:48.610738 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5nl5\" (UniqueName: \"kubernetes.io/projected/6fd469b7-01d6-4078-bd48-46013095bd0d-kube-api-access-p5nl5\") pod \"console-7949df7596-bxcws\" (UID: \"6fd469b7-01d6-4078-bd48-46013095bd0d\") " pod="openshift-console/console-7949df7596-bxcws" Sep 11 02:53:48.612125 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:48.611996 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6fd469b7-01d6-4078-bd48-46013095bd0d-oauth-serving-cert\") pod \"console-7949df7596-bxcws\" (UID: \"6fd469b7-01d6-4078-bd48-46013095bd0d\") " pod="openshift-console/console-7949df7596-bxcws" Sep 11 02:53:48.614125 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:48.614103 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6fd469b7-01d6-4078-bd48-46013095bd0d-console-config\") pod \"console-7949df7596-bxcws\" (UID: \"6fd469b7-01d6-4078-bd48-46013095bd0d\") " pod="openshift-console/console-7949df7596-bxcws" Sep 11 02:53:48.616510 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:48.615080 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6fd469b7-01d6-4078-bd48-46013095bd0d-service-ca\") pod \"console-7949df7596-bxcws\" (UID: \"6fd469b7-01d6-4078-bd48-46013095bd0d\") " pod="openshift-console/console-7949df7596-bxcws" Sep 11 02:53:48.619853 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:48.616821 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fd469b7-01d6-4078-bd48-46013095bd0d-trusted-ca-bundle\") pod \"console-7949df7596-bxcws\" (UID: \"6fd469b7-01d6-4078-bd48-46013095bd0d\") " pod="openshift-console/console-7949df7596-bxcws" Sep 11 02:53:48.619853 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:48.617957 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6fd469b7-01d6-4078-bd48-46013095bd0d-console-serving-cert\") pod \"console-7949df7596-bxcws\" (UID: \"6fd469b7-01d6-4078-bd48-46013095bd0d\") " pod="openshift-console/console-7949df7596-bxcws" Sep 11 02:53:48.624670 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:48.624615 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5nl5\" (UniqueName: \"kubernetes.io/projected/6fd469b7-01d6-4078-bd48-46013095bd0d-kube-api-access-p5nl5\") pod \"console-7949df7596-bxcws\" (UID: \"6fd469b7-01d6-4078-bd48-46013095bd0d\") " pod="openshift-console/console-7949df7596-bxcws" Sep 11 02:53:48.634327 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:48.634287 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6fd469b7-01d6-4078-bd48-46013095bd0d-console-oauth-config\") pod \"console-7949df7596-bxcws\" (UID: \"6fd469b7-01d6-4078-bd48-46013095bd0d\") " pod="openshift-console/console-7949df7596-bxcws" Sep 11 02:53:48.717072 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:48.717037 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7949df7596-bxcws" Sep 11 02:53:49.014742 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:49.014702 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7949df7596-bxcws"] Sep 11 02:53:49.516040 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:53:49.515988 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fd469b7_01d6_4078_bd48_46013095bd0d.slice/crio-5810b5730fc2f81d817eb68dbb975f20278f1159439dcb8a94ca727dbea45b50 WatchSource:0}: Error finding container 5810b5730fc2f81d817eb68dbb975f20278f1159439dcb8a94ca727dbea45b50: Status 404 returned error can't find the container with id 5810b5730fc2f81d817eb68dbb975f20278f1159439dcb8a94ca727dbea45b50 Sep 11 02:53:49.602131 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:49.602090 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7949df7596-bxcws" event={"ID":"6fd469b7-01d6-4078-bd48-46013095bd0d","Type":"ContainerStarted","Data":"5810b5730fc2f81d817eb68dbb975f20278f1159439dcb8a94ca727dbea45b50"} Sep 11 02:53:52.614723 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:52.614462 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vf6hb" event={"ID":"78189675-5274-4826-99e2-69c83a7b59e3","Type":"ContainerStarted","Data":"d36f4d1406d9f39b42a7ca9de5449fc27bef8cb0d06c2af159762caa3499f7dc"} Sep 11 02:53:52.615182 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:52.614767 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vf6hb" Sep 11 02:53:52.615182 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:52.614799 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vf6hb" event={"ID":"78189675-5274-4826-99e2-69c83a7b59e3","Type":"ContainerStarted","Data":"a6d8519dfa29b07e668249407c9a679eea576317eccd34f6b160938ae9cf756d"} Sep 11 02:53:52.616723 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:52.616697 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8chld" event={"ID":"d361fc5b-5ed7-460a-ba3b-d1789ce6f25d","Type":"ContainerStarted","Data":"0dbe62f14ce0651c1a953cc69046ff9730d7f3b95e8fefd918320f365fdc2b69"} Sep 11 02:53:52.618156 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:52.618131 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vpgxz" event={"ID":"c7169bef-9526-47a6-accd-4192623b9eca","Type":"ContainerStarted","Data":"278e4a4296a923952fa120a891e25a1bb94389b097cacea38df1febe0259f99b"} Sep 11 02:53:52.619550 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:52.619530 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7447c8fc9c-5n6bm" event={"ID":"55922251-fd40-4f6b-a4d4-97ba03fbe579","Type":"ContainerStarted","Data":"1b0792a7a878671a29362d36f2acf2ec5a77d5732de20333eacefd4acb95c12a"} Sep 11 02:53:52.621133 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:52.621116 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7949df7596-bxcws" event={"ID":"6fd469b7-01d6-4078-bd48-46013095bd0d","Type":"ContainerStarted","Data":"24caabce93c021255e66f5a05aa9d87c41d16c06ee5107bc903b5f6bb3c20445"} Sep 11 02:53:52.634000 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:52.633967 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-vf6hb" podStartSLOduration=2.302358685 podStartE2EDuration="6.633955334s" totalImagesPullingTime="4.331596649s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 02:53:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:53:52.63306165 +0000 UTC m=+57.772384842" watchObservedRunningTime="2026-09-11 02:53:52.633955334 +0000 UTC m=+57.773278574" Sep 11 02:53:52.651908 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:52.651866 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-vpgxz" podStartSLOduration=2.302208314 podStartE2EDuration="6.651852959s" totalImagesPullingTime="4.349644645s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 02:53:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:53:52.651256811 +0000 UTC m=+57.790579999" watchObservedRunningTime="2026-09-11 02:53:52.651852959 +0000 UTC m=+57.791176185" Sep 11 02:53:52.670569 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:52.670533 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7949df7596-bxcws" podStartSLOduration=2.458742404 podStartE2EDuration="4.670521108s" totalImagesPullingTime="2.211778704s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 02:53:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:53:52.67030122 +0000 UTC m=+57.809624412" watchObservedRunningTime="2026-09-11 02:53:52.670521108 +0000 UTC m=+57.809844293" Sep 11 02:53:52.709565 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:52.709521 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8chld" podStartSLOduration=2.57775374 podStartE2EDuration="6.709508406s" totalImagesPullingTime="4.131754666s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 02:53:46 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:53:52.70906825 +0000 UTC m=+57.848391442" watchObservedRunningTime="2026-09-11 02:53:52.709508406 +0000 UTC m=+57.848831600" Sep 11 02:53:52.709693 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:52.709658 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7447c8fc9c-5n6bm" podStartSLOduration=1.655388732 podStartE2EDuration="5.709650592s" totalImagesPullingTime="4.05426186s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 02:53:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:53:52.69120011 +0000 UTC m=+57.830523302" watchObservedRunningTime="2026-09-11 02:53:52.709650592 +0000 UTC m=+57.848973780" Sep 11 02:53:55.540085 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:55.540061 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jv2sz" Sep 11 02:53:56.064749 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:56.064722 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-8kcmh"] Sep 11 02:53:56.067529 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:56.067505 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8kcmh" Sep 11 02:53:56.080687 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:56.080668 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 11 02:53:56.080687 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:56.080668 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 11 02:53:56.080867 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:56.080689 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-85lth\"" Sep 11 02:53:56.081034 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:56.081021 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 11 02:53:56.083525 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:56.083507 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-j67df"] Sep 11 02:53:56.085052 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:56.085035 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 11 02:53:56.085574 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:56.085560 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-j67df" Sep 11 02:53:56.086703 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:56.086669 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 11 02:53:56.086900 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:56.086886 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 11 02:53:56.100748 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:56.100724 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 11 02:53:56.100837 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:56.100803 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 11 02:53:56.100889 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:56.100874 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-bxv6w\"" Sep 11 02:53:56.101846 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:56.101832 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 11 02:53:56.128265 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:56.128244 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-8kcmh"] Sep 11 02:53:56.170188 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:56.170164 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f6cd68d6-662f-4fed-a498-9b33eeed647d-node-exporter-tls\") pod \"node-exporter-j67df\" (UID: \"f6cd68d6-662f-4fed-a498-9b33eeed647d\") " pod="openshift-monitoring/node-exporter-j67df" Sep 11 02:53:56.170269 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:56.170195 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/76cb2384-d3a5-4d57-a912-acdf2d2eee83-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-8kcmh\" (UID: \"76cb2384-d3a5-4d57-a912-acdf2d2eee83\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8kcmh" Sep 11 02:53:56.170269 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:56.170214 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f6cd68d6-662f-4fed-a498-9b33eeed647d-node-exporter-accelerators-collector-config\") pod \"node-exporter-j67df\" (UID: \"f6cd68d6-662f-4fed-a498-9b33eeed647d\") " pod="openshift-monitoring/node-exporter-j67df" Sep 11 02:53:56.170269 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:56.170241 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/76cb2384-d3a5-4d57-a912-acdf2d2eee83-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-8kcmh\" (UID: \"76cb2384-d3a5-4d57-a912-acdf2d2eee83\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8kcmh" Sep 11 02:53:56.170432 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:56.170292 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8j85\" (UniqueName: \"kubernetes.io/projected/f6cd68d6-662f-4fed-a498-9b33eeed647d-kube-api-access-j8j85\") pod \"node-exporter-j67df\" (UID: \"f6cd68d6-662f-4fed-a498-9b33eeed647d\") " pod="openshift-monitoring/node-exporter-j67df" Sep 11 02:53:56.170432 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:56.170314 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5htff\" (UniqueName: \"kubernetes.io/projected/76cb2384-d3a5-4d57-a912-acdf2d2eee83-kube-api-access-5htff\") pod \"kube-state-metrics-59fbdd77d-8kcmh\" (UID: \"76cb2384-d3a5-4d57-a912-acdf2d2eee83\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8kcmh" Sep 11 02:53:56.170432 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:56.170380 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f6cd68d6-662f-4fed-a498-9b33eeed647d-metrics-client-ca\") pod \"node-exporter-j67df\" (UID: \"f6cd68d6-662f-4fed-a498-9b33eeed647d\") " pod="openshift-monitoring/node-exporter-j67df" Sep 11 02:53:56.170553 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:56.170448 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f6cd68d6-662f-4fed-a498-9b33eeed647d-node-exporter-textfile\") pod \"node-exporter-j67df\" (UID: \"f6cd68d6-662f-4fed-a498-9b33eeed647d\") " pod="openshift-monitoring/node-exporter-j67df" Sep 11 02:53:56.170553 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:56.170475 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/76cb2384-d3a5-4d57-a912-acdf2d2eee83-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-8kcmh\" (UID: \"76cb2384-d3a5-4d57-a912-acdf2d2eee83\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8kcmh" Sep 11 02:53:56.170553 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:56.170512 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/76cb2384-d3a5-4d57-a912-acdf2d2eee83-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-8kcmh\" (UID: \"76cb2384-d3a5-4d57-a912-acdf2d2eee83\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8kcmh" Sep 11 02:53:56.170553 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:56.170530 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f6cd68d6-662f-4fed-a498-9b33eeed647d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-j67df\" (UID: \"f6cd68d6-662f-4fed-a498-9b33eeed647d\") " pod="openshift-monitoring/node-exporter-j67df" Sep 11 02:53:56.170718 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:56.170554 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f6cd68d6-662f-4fed-a498-9b33eeed647d-node-exporter-wtmp\") pod \"node-exporter-j67df\" (UID: \"f6cd68d6-662f-4fed-a498-9b33eeed647d\") " pod="openshift-monitoring/node-exporter-j67df" Sep 11 02:53:56.170718 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:56.170578 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f6cd68d6-662f-4fed-a498-9b33eeed647d-root\") pod \"node-exporter-j67df\" (UID: \"f6cd68d6-662f-4fed-a498-9b33eeed647d\") " pod="openshift-monitoring/node-exporter-j67df" Sep 11 02:53:56.170718 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:56.170596 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/76cb2384-d3a5-4d57-a912-acdf2d2eee83-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-8kcmh\" (UID: \"76cb2384-d3a5-4d57-a912-acdf2d2eee83\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8kcmh" Sep 11 02:53:56.170718 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:56.170613 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f6cd68d6-662f-4fed-a498-9b33eeed647d-sys\") pod \"node-exporter-j67df\" (UID: \"f6cd68d6-662f-4fed-a498-9b33eeed647d\") " pod="openshift-monitoring/node-exporter-j67df" Sep 11 02:53:56.271171 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:56.271143 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f6cd68d6-662f-4fed-a498-9b33eeed647d-node-exporter-tls\") pod \"node-exporter-j67df\" (UID: \"f6cd68d6-662f-4fed-a498-9b33eeed647d\") " pod="openshift-monitoring/node-exporter-j67df" Sep 11 02:53:56.271289 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:56.271179 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/76cb2384-d3a5-4d57-a912-acdf2d2eee83-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-8kcmh\" (UID: \"76cb2384-d3a5-4d57-a912-acdf2d2eee83\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8kcmh" Sep 11 02:53:56.271289 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:56.271196 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f6cd68d6-662f-4fed-a498-9b33eeed647d-node-exporter-accelerators-collector-config\") pod \"node-exporter-j67df\" (UID: \"f6cd68d6-662f-4fed-a498-9b33eeed647d\") " pod="openshift-monitoring/node-exporter-j67df" Sep 11 02:53:56.271289 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:56.271231 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/76cb2384-d3a5-4d57-a912-acdf2d2eee83-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-8kcmh\" (UID: \"76cb2384-d3a5-4d57-a912-acdf2d2eee83\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8kcmh" Sep 11 02:53:56.271289 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:56.271265 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8j85\" (UniqueName: \"kubernetes.io/projected/f6cd68d6-662f-4fed-a498-9b33eeed647d-kube-api-access-j8j85\") pod \"node-exporter-j67df\" (UID: \"f6cd68d6-662f-4fed-a498-9b33eeed647d\") " pod="openshift-monitoring/node-exporter-j67df" Sep 11 02:53:56.271475 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:56.271290 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5htff\" (UniqueName: \"kubernetes.io/projected/76cb2384-d3a5-4d57-a912-acdf2d2eee83-kube-api-access-5htff\") pod \"kube-state-metrics-59fbdd77d-8kcmh\" (UID: \"76cb2384-d3a5-4d57-a912-acdf2d2eee83\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8kcmh" Sep 11 02:53:56.271475 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:56.271316 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f6cd68d6-662f-4fed-a498-9b33eeed647d-metrics-client-ca\") pod \"node-exporter-j67df\" (UID: \"f6cd68d6-662f-4fed-a498-9b33eeed647d\") " pod="openshift-monitoring/node-exporter-j67df" Sep 11 02:53:56.271475 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:56.271374 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f6cd68d6-662f-4fed-a498-9b33eeed647d-node-exporter-textfile\") pod \"node-exporter-j67df\" (UID: \"f6cd68d6-662f-4fed-a498-9b33eeed647d\") " pod="openshift-monitoring/node-exporter-j67df" Sep 11 02:53:56.271475 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:56.271400 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/76cb2384-d3a5-4d57-a912-acdf2d2eee83-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-8kcmh\" (UID: \"76cb2384-d3a5-4d57-a912-acdf2d2eee83\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8kcmh" Sep 11 02:53:56.271475 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:56.271434 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/76cb2384-d3a5-4d57-a912-acdf2d2eee83-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-8kcmh\" (UID: \"76cb2384-d3a5-4d57-a912-acdf2d2eee83\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8kcmh" Sep 11 02:53:56.271475 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:56.271467 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f6cd68d6-662f-4fed-a498-9b33eeed647d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-j67df\" (UID: \"f6cd68d6-662f-4fed-a498-9b33eeed647d\") " pod="openshift-monitoring/node-exporter-j67df" Sep 11 02:53:56.271793 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:56.271495 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f6cd68d6-662f-4fed-a498-9b33eeed647d-node-exporter-wtmp\") pod \"node-exporter-j67df\" (UID: \"f6cd68d6-662f-4fed-a498-9b33eeed647d\") " pod="openshift-monitoring/node-exporter-j67df" Sep 11 02:53:56.271793 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:56.271521 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f6cd68d6-662f-4fed-a498-9b33eeed647d-root\") pod \"node-exporter-j67df\" (UID: \"f6cd68d6-662f-4fed-a498-9b33eeed647d\") " pod="openshift-monitoring/node-exporter-j67df" Sep 11 02:53:56.271793 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:56.271550 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/76cb2384-d3a5-4d57-a912-acdf2d2eee83-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-8kcmh\" (UID: \"76cb2384-d3a5-4d57-a912-acdf2d2eee83\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8kcmh" Sep 11 02:53:56.271793 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:56.271580 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f6cd68d6-662f-4fed-a498-9b33eeed647d-sys\") pod \"node-exporter-j67df\" (UID: \"f6cd68d6-662f-4fed-a498-9b33eeed647d\") " pod="openshift-monitoring/node-exporter-j67df" Sep 11 02:53:56.271793 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:56.271691 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f6cd68d6-662f-4fed-a498-9b33eeed647d-sys\") pod \"node-exporter-j67df\" (UID: \"f6cd68d6-662f-4fed-a498-9b33eeed647d\") " pod="openshift-monitoring/node-exporter-j67df" Sep 11 02:53:56.271989 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:56.271909 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f6cd68d6-662f-4fed-a498-9b33eeed647d-node-exporter-accelerators-collector-config\") pod \"node-exporter-j67df\" (UID: \"f6cd68d6-662f-4fed-a498-9b33eeed647d\") " pod="openshift-monitoring/node-exporter-j67df" Sep 11 02:53:56.272075 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:56.272055 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f6cd68d6-662f-4fed-a498-9b33eeed647d-node-exporter-wtmp\") pod \"node-exporter-j67df\" (UID: \"f6cd68d6-662f-4fed-a498-9b33eeed647d\") " pod="openshift-monitoring/node-exporter-j67df" Sep 11 02:53:56.272120 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:56.272065 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f6cd68d6-662f-4fed-a498-9b33eeed647d-metrics-client-ca\") pod \"node-exporter-j67df\" (UID: \"f6cd68d6-662f-4fed-a498-9b33eeed647d\") " pod="openshift-monitoring/node-exporter-j67df" Sep 11 02:53:56.272120 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:56.272081 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/76cb2384-d3a5-4d57-a912-acdf2d2eee83-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-8kcmh\" (UID: \"76cb2384-d3a5-4d57-a912-acdf2d2eee83\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8kcmh" Sep 11 02:53:56.272120 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:56.272109 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f6cd68d6-662f-4fed-a498-9b33eeed647d-root\") pod \"node-exporter-j67df\" (UID: \"f6cd68d6-662f-4fed-a498-9b33eeed647d\") " pod="openshift-monitoring/node-exporter-j67df" Sep 11 02:53:56.272510 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:56.272410 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/76cb2384-d3a5-4d57-a912-acdf2d2eee83-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-8kcmh\" (UID: \"76cb2384-d3a5-4d57-a912-acdf2d2eee83\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8kcmh" Sep 11 02:53:56.272573 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:56.272475 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f6cd68d6-662f-4fed-a498-9b33eeed647d-node-exporter-textfile\") pod \"node-exporter-j67df\" (UID: \"f6cd68d6-662f-4fed-a498-9b33eeed647d\") " pod="openshift-monitoring/node-exporter-j67df" Sep 11 02:53:56.272656 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:56.272613 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/76cb2384-d3a5-4d57-a912-acdf2d2eee83-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-8kcmh\" (UID: \"76cb2384-d3a5-4d57-a912-acdf2d2eee83\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8kcmh" Sep 11 02:53:56.274538 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:56.274512 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f6cd68d6-662f-4fed-a498-9b33eeed647d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-j67df\" (UID: \"f6cd68d6-662f-4fed-a498-9b33eeed647d\") " pod="openshift-monitoring/node-exporter-j67df" Sep 11 02:53:56.274645 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:56.274594 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f6cd68d6-662f-4fed-a498-9b33eeed647d-node-exporter-tls\") pod \"node-exporter-j67df\" (UID: \"f6cd68d6-662f-4fed-a498-9b33eeed647d\") " pod="openshift-monitoring/node-exporter-j67df" Sep 11 02:53:56.274745 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:56.274725 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/76cb2384-d3a5-4d57-a912-acdf2d2eee83-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-8kcmh\" (UID: \"76cb2384-d3a5-4d57-a912-acdf2d2eee83\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8kcmh" Sep 11 02:53:56.274781 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:56.274767 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/76cb2384-d3a5-4d57-a912-acdf2d2eee83-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-8kcmh\" (UID: \"76cb2384-d3a5-4d57-a912-acdf2d2eee83\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8kcmh" Sep 11 02:53:56.279386 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:56.279365 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8j85\" (UniqueName: \"kubernetes.io/projected/f6cd68d6-662f-4fed-a498-9b33eeed647d-kube-api-access-j8j85\") pod \"node-exporter-j67df\" (UID: \"f6cd68d6-662f-4fed-a498-9b33eeed647d\") " pod="openshift-monitoring/node-exporter-j67df" Sep 11 02:53:56.280456 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:56.280434 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5htff\" (UniqueName: \"kubernetes.io/projected/76cb2384-d3a5-4d57-a912-acdf2d2eee83-kube-api-access-5htff\") pod \"kube-state-metrics-59fbdd77d-8kcmh\" (UID: \"76cb2384-d3a5-4d57-a912-acdf2d2eee83\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8kcmh" Sep 11 02:53:56.375598 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:56.375545 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8kcmh" Sep 11 02:53:56.393808 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:56.393785 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-j67df" Sep 11 02:53:56.403222 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:53:56.403190 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6cd68d6_662f_4fed_a498_9b33eeed647d.slice/crio-c663c8400e99095bad4ac4c2f5efd322f2e20b7a4640237718f6ec74e162ee28 WatchSource:0}: Error finding container c663c8400e99095bad4ac4c2f5efd322f2e20b7a4640237718f6ec74e162ee28: Status 404 returned error can't find the container with id c663c8400e99095bad4ac4c2f5efd322f2e20b7a4640237718f6ec74e162ee28 Sep 11 02:53:56.644011 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:56.643936 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j67df" event={"ID":"f6cd68d6-662f-4fed-a498-9b33eeed647d","Type":"ContainerStarted","Data":"c663c8400e99095bad4ac4c2f5efd322f2e20b7a4640237718f6ec74e162ee28"} Sep 11 02:53:56.650968 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:56.650944 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-8kcmh"] Sep 11 02:53:56.653663 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:53:56.653636 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76cb2384_d3a5_4d57_a912_acdf2d2eee83.slice/crio-cd1862a982c67e497cc2b116f12a701aa2111fe896d0ae7b8061945ea10b2a1f WatchSource:0}: Error finding container cd1862a982c67e497cc2b116f12a701aa2111fe896d0ae7b8061945ea10b2a1f: Status 404 returned error can't find the container with id cd1862a982c67e497cc2b116f12a701aa2111fe896d0ae7b8061945ea10b2a1f Sep 11 02:53:57.124205 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:57.124173 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 11 02:53:57.127253 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:57.127234 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:53:57.130256 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:57.130233 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 11 02:53:57.130379 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:57.130262 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-wtwv2\"" Sep 11 02:53:57.130379 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:57.130278 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 11 02:53:57.130379 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:57.130296 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 11 02:53:57.130379 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:57.130262 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 11 02:53:57.130560 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:57.130444 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 11 02:53:57.130679 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:57.130652 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 11 02:53:57.130811 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:57.130694 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 11 02:53:57.130811 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:57.130777 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 11 02:53:57.131934 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:57.131896 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 11 02:53:57.150687 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:57.150668 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 11 02:53:57.179673 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:57.179646 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:53:57.179797 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:57.179686 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wmpk\" (UniqueName: \"kubernetes.io/projected/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-kube-api-access-8wmpk\") pod \"alertmanager-main-0\" (UID: \"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:53:57.179797 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:57.179741 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:53:57.179917 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:57.179825 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-config-volume\") pod \"alertmanager-main-0\" (UID: \"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:53:57.179917 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:57.179853 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-config-out\") pod \"alertmanager-main-0\" (UID: \"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:53:57.179917 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:57.179874 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:53:57.180043 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:57.179924 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:53:57.180043 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:57.179956 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:53:57.180043 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:57.179981 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:53:57.180195 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:57.180047 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-web-config\") pod \"alertmanager-main-0\" (UID: \"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:53:57.180195 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:57.180095 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:53:57.180195 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:57.180121 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:53:57.180339 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:57.180199 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:53:57.281111 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:57.281078 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-web-config\") pod \"alertmanager-main-0\" (UID: \"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:53:57.281250 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:57.281125 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:53:57.281250 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:57.281144 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:53:57.281250 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:57.281178 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:53:57.281250 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:57.281196 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:53:57.281250 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:57.281211 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wmpk\" (UniqueName: \"kubernetes.io/projected/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-kube-api-access-8wmpk\") pod \"alertmanager-main-0\" (UID: \"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:53:57.281250 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:57.281228 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:53:57.281250 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:57.281249 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-config-volume\") pod \"alertmanager-main-0\" (UID: \"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:53:57.281491 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:57.281272 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-config-out\") pod \"alertmanager-main-0\" (UID: \"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:53:57.281491 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:57.281286 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:53:57.281491 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:57.281306 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:53:57.281491 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:57.281322 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:53:57.281491 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:57.281337 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:53:57.281947 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:57.281920 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:53:57.283815 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:57.282426 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:53:57.283815 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:57.283772 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:53:57.285357 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:57.285301 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:53:57.285357 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:57.285301 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:53:57.286272 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:57.286199 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-web-config\") pod \"alertmanager-main-0\" (UID: \"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:53:57.287048 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:57.286574 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:53:57.287048 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:57.287006 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:53:57.287635 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:57.287574 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:53:57.288107 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:57.288066 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-config-out\") pod \"alertmanager-main-0\" (UID: \"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:53:57.288430 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:57.288408 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:53:57.289143 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:57.289123 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-config-volume\") pod \"alertmanager-main-0\" (UID: \"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:53:57.291403 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:57.291379 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wmpk\" (UniqueName: \"kubernetes.io/projected/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-kube-api-access-8wmpk\") pod \"alertmanager-main-0\" (UID: \"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:53:57.372834 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:57.372800 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7447c8fc9c-5n6bm" Sep 11 02:53:57.373008 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:57.372865 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7447c8fc9c-5n6bm" Sep 11 02:53:57.378406 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:57.378345 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7447c8fc9c-5n6bm" Sep 11 02:53:57.439268 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:57.439242 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:53:57.649171 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:57.649062 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8kcmh" event={"ID":"76cb2384-d3a5-4d57-a912-acdf2d2eee83","Type":"ContainerStarted","Data":"cd1862a982c67e497cc2b116f12a701aa2111fe896d0ae7b8061945ea10b2a1f"} Sep 11 02:53:57.650940 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:57.650913 2580 generic.go:356] "Generic (PLEG): container finished" podID="f6cd68d6-662f-4fed-a498-9b33eeed647d" containerID="5beaec510191bc425313895a994fb9623dbe772beb21c01b1fde185758cff7b7" exitCode=0 Sep 11 02:53:57.651072 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:57.650959 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j67df" event={"ID":"f6cd68d6-662f-4fed-a498-9b33eeed647d","Type":"ContainerDied","Data":"5beaec510191bc425313895a994fb9623dbe772beb21c01b1fde185758cff7b7"} Sep 11 02:53:57.656264 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:57.656241 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7447c8fc9c-5n6bm" Sep 11 02:53:57.729527 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:57.729498 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 11 02:53:57.736153 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:53:57.736128 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc43f2dd_45d2_4f5e_a50e_01e3ccdf5a40.slice/crio-10b75a05d29f1ed0e34535bce23b23d3027da88e101ee3566184a0059ae02299 WatchSource:0}: Error finding container 10b75a05d29f1ed0e34535bce23b23d3027da88e101ee3566184a0059ae02299: Status 404 returned error can't find the container with id 10b75a05d29f1ed0e34535bce23b23d3027da88e101ee3566184a0059ae02299 Sep 11 02:53:58.099174 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:58.099140 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-78f8566f6f-tcrrf"] Sep 11 02:53:58.102324 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:58.102299 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-78f8566f6f-tcrrf" Sep 11 02:53:58.105352 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:58.105322 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-qgq27\"" Sep 11 02:53:58.105466 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:58.105326 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 11 02:53:58.105466 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:58.105450 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-d4m88olvolcnd\"" Sep 11 02:53:58.105580 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:58.105473 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 11 02:53:58.105580 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:58.105570 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 11 02:53:58.105774 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:58.105757 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 11 02:53:58.105863 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:58.105764 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 11 02:53:58.116987 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:58.116965 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-78f8566f6f-tcrrf"] Sep 11 02:53:58.189718 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:58.189685 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f4a7a8df-9ef1-475d-a27a-696e65035073-secret-grpc-tls\") pod \"thanos-querier-78f8566f6f-tcrrf\" (UID: \"f4a7a8df-9ef1-475d-a27a-696e65035073\") " pod="openshift-monitoring/thanos-querier-78f8566f6f-tcrrf" Sep 11 02:53:58.189868 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:58.189733 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f4a7a8df-9ef1-475d-a27a-696e65035073-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-78f8566f6f-tcrrf\" (UID: \"f4a7a8df-9ef1-475d-a27a-696e65035073\") " pod="openshift-monitoring/thanos-querier-78f8566f6f-tcrrf" Sep 11 02:53:58.189868 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:58.189764 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9bbs\" (UniqueName: \"kubernetes.io/projected/f4a7a8df-9ef1-475d-a27a-696e65035073-kube-api-access-k9bbs\") pod \"thanos-querier-78f8566f6f-tcrrf\" (UID: \"f4a7a8df-9ef1-475d-a27a-696e65035073\") " pod="openshift-monitoring/thanos-querier-78f8566f6f-tcrrf" Sep 11 02:53:58.189868 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:58.189818 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f4a7a8df-9ef1-475d-a27a-696e65035073-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-78f8566f6f-tcrrf\" (UID: \"f4a7a8df-9ef1-475d-a27a-696e65035073\") " pod="openshift-monitoring/thanos-querier-78f8566f6f-tcrrf" Sep 11 02:53:58.190016 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:58.189873 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f4a7a8df-9ef1-475d-a27a-696e65035073-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-78f8566f6f-tcrrf\" (UID: \"f4a7a8df-9ef1-475d-a27a-696e65035073\") " pod="openshift-monitoring/thanos-querier-78f8566f6f-tcrrf" Sep 11 02:53:58.190016 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:58.189899 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f4a7a8df-9ef1-475d-a27a-696e65035073-secret-thanos-querier-tls\") pod \"thanos-querier-78f8566f6f-tcrrf\" (UID: \"f4a7a8df-9ef1-475d-a27a-696e65035073\") " pod="openshift-monitoring/thanos-querier-78f8566f6f-tcrrf" Sep 11 02:53:58.190016 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:58.189916 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f4a7a8df-9ef1-475d-a27a-696e65035073-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-78f8566f6f-tcrrf\" (UID: \"f4a7a8df-9ef1-475d-a27a-696e65035073\") " pod="openshift-monitoring/thanos-querier-78f8566f6f-tcrrf" Sep 11 02:53:58.190016 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:58.189936 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f4a7a8df-9ef1-475d-a27a-696e65035073-metrics-client-ca\") pod \"thanos-querier-78f8566f6f-tcrrf\" (UID: \"f4a7a8df-9ef1-475d-a27a-696e65035073\") " pod="openshift-monitoring/thanos-querier-78f8566f6f-tcrrf" Sep 11 02:53:58.291144 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:58.291086 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f4a7a8df-9ef1-475d-a27a-696e65035073-secret-grpc-tls\") pod \"thanos-querier-78f8566f6f-tcrrf\" (UID: \"f4a7a8df-9ef1-475d-a27a-696e65035073\") " pod="openshift-monitoring/thanos-querier-78f8566f6f-tcrrf" Sep 11 02:53:58.291144 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:58.291123 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f4a7a8df-9ef1-475d-a27a-696e65035073-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-78f8566f6f-tcrrf\" (UID: \"f4a7a8df-9ef1-475d-a27a-696e65035073\") " pod="openshift-monitoring/thanos-querier-78f8566f6f-tcrrf" Sep 11 02:53:58.291144 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:58.291143 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9bbs\" (UniqueName: \"kubernetes.io/projected/f4a7a8df-9ef1-475d-a27a-696e65035073-kube-api-access-k9bbs\") pod \"thanos-querier-78f8566f6f-tcrrf\" (UID: \"f4a7a8df-9ef1-475d-a27a-696e65035073\") " pod="openshift-monitoring/thanos-querier-78f8566f6f-tcrrf" Sep 11 02:53:58.291381 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:58.291188 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f4a7a8df-9ef1-475d-a27a-696e65035073-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-78f8566f6f-tcrrf\" (UID: \"f4a7a8df-9ef1-475d-a27a-696e65035073\") " pod="openshift-monitoring/thanos-querier-78f8566f6f-tcrrf" Sep 11 02:53:58.291381 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:58.291285 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f4a7a8df-9ef1-475d-a27a-696e65035073-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-78f8566f6f-tcrrf\" (UID: \"f4a7a8df-9ef1-475d-a27a-696e65035073\") " pod="openshift-monitoring/thanos-querier-78f8566f6f-tcrrf" Sep 11 02:53:58.291381 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:58.291318 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f4a7a8df-9ef1-475d-a27a-696e65035073-secret-thanos-querier-tls\") pod \"thanos-querier-78f8566f6f-tcrrf\" (UID: \"f4a7a8df-9ef1-475d-a27a-696e65035073\") " pod="openshift-monitoring/thanos-querier-78f8566f6f-tcrrf" Sep 11 02:53:58.291381 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:58.291340 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f4a7a8df-9ef1-475d-a27a-696e65035073-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-78f8566f6f-tcrrf\" (UID: \"f4a7a8df-9ef1-475d-a27a-696e65035073\") " pod="openshift-monitoring/thanos-querier-78f8566f6f-tcrrf" Sep 11 02:53:58.291381 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:58.291365 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f4a7a8df-9ef1-475d-a27a-696e65035073-metrics-client-ca\") pod \"thanos-querier-78f8566f6f-tcrrf\" (UID: \"f4a7a8df-9ef1-475d-a27a-696e65035073\") " pod="openshift-monitoring/thanos-querier-78f8566f6f-tcrrf" Sep 11 02:53:58.292354 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:58.292133 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f4a7a8df-9ef1-475d-a27a-696e65035073-metrics-client-ca\") pod \"thanos-querier-78f8566f6f-tcrrf\" (UID: \"f4a7a8df-9ef1-475d-a27a-696e65035073\") " pod="openshift-monitoring/thanos-querier-78f8566f6f-tcrrf" Sep 11 02:53:58.294093 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:58.293971 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f4a7a8df-9ef1-475d-a27a-696e65035073-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-78f8566f6f-tcrrf\" (UID: \"f4a7a8df-9ef1-475d-a27a-696e65035073\") " pod="openshift-monitoring/thanos-querier-78f8566f6f-tcrrf" Sep 11 02:53:58.294185 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:58.294163 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f4a7a8df-9ef1-475d-a27a-696e65035073-secret-thanos-querier-tls\") pod \"thanos-querier-78f8566f6f-tcrrf\" (UID: \"f4a7a8df-9ef1-475d-a27a-696e65035073\") " pod="openshift-monitoring/thanos-querier-78f8566f6f-tcrrf" Sep 11 02:53:58.294451 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:58.294422 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f4a7a8df-9ef1-475d-a27a-696e65035073-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-78f8566f6f-tcrrf\" (UID: \"f4a7a8df-9ef1-475d-a27a-696e65035073\") " pod="openshift-monitoring/thanos-querier-78f8566f6f-tcrrf" Sep 11 02:53:58.294501 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:58.294455 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f4a7a8df-9ef1-475d-a27a-696e65035073-secret-grpc-tls\") pod \"thanos-querier-78f8566f6f-tcrrf\" (UID: \"f4a7a8df-9ef1-475d-a27a-696e65035073\") " pod="openshift-monitoring/thanos-querier-78f8566f6f-tcrrf" Sep 11 02:53:58.294586 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:58.294568 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f4a7a8df-9ef1-475d-a27a-696e65035073-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-78f8566f6f-tcrrf\" (UID: \"f4a7a8df-9ef1-475d-a27a-696e65035073\") " pod="openshift-monitoring/thanos-querier-78f8566f6f-tcrrf" Sep 11 02:53:58.294874 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:58.294852 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f4a7a8df-9ef1-475d-a27a-696e65035073-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-78f8566f6f-tcrrf\" (UID: \"f4a7a8df-9ef1-475d-a27a-696e65035073\") " pod="openshift-monitoring/thanos-querier-78f8566f6f-tcrrf" Sep 11 02:53:58.315737 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:58.315716 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9bbs\" (UniqueName: \"kubernetes.io/projected/f4a7a8df-9ef1-475d-a27a-696e65035073-kube-api-access-k9bbs\") pod \"thanos-querier-78f8566f6f-tcrrf\" (UID: \"f4a7a8df-9ef1-475d-a27a-696e65035073\") " pod="openshift-monitoring/thanos-querier-78f8566f6f-tcrrf" Sep 11 02:53:58.413277 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:58.413249 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-78f8566f6f-tcrrf" Sep 11 02:53:58.656320 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:58.656191 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40","Type":"ContainerStarted","Data":"10b75a05d29f1ed0e34535bce23b23d3027da88e101ee3566184a0059ae02299"} Sep 11 02:53:58.659376 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:58.658796 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8kcmh" event={"ID":"76cb2384-d3a5-4d57-a912-acdf2d2eee83","Type":"ContainerStarted","Data":"0fd5ea908b60a9263503902b05005c3c3c319e80ed5aeef2ddcc8a6447d9b0e1"} Sep 11 02:53:58.659376 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:58.658854 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8kcmh" event={"ID":"76cb2384-d3a5-4d57-a912-acdf2d2eee83","Type":"ContainerStarted","Data":"3cf6544090d39afe0a4e5ab70f9e111cc7d5a270cf15237ddf99159a36f3bb0a"} Sep 11 02:53:58.659376 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:58.658886 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8kcmh" event={"ID":"76cb2384-d3a5-4d57-a912-acdf2d2eee83","Type":"ContainerStarted","Data":"d2f3ce84024995cb8a9aa9b55036376459770ae9afa632b4d2d741f0e0dd8700"} Sep 11 02:53:58.662172 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:58.661733 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j67df" event={"ID":"f6cd68d6-662f-4fed-a498-9b33eeed647d","Type":"ContainerStarted","Data":"d69fc5a961e1116873a6aa4fcce85439d082e294b1c6cc804d485a4dfe5d1375"} Sep 11 02:53:58.662172 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:58.661781 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j67df" event={"ID":"f6cd68d6-662f-4fed-a498-9b33eeed647d","Type":"ContainerStarted","Data":"d45079ada650b5dfa5f485b3e030c4dc11e41a1e15f9bff23c980bfee0cddbec"} Sep 11 02:53:58.683342 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:58.683292 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8kcmh" podStartSLOduration=1.0377664659999999 podStartE2EDuration="2.683274823s" totalImagesPullingTime="1.645508357s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 02:53:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:53:58.683274736 +0000 UTC m=+63.822597928" watchObservedRunningTime="2026-09-11 02:53:58.683274823 +0000 UTC m=+63.822598016" Sep 11 02:53:58.708122 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:58.708078 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-j67df" podStartSLOduration=1.593606112 podStartE2EDuration="2.708061737s" totalImagesPullingTime="1.04521907s" totalInitContainerRuntime="69.236555ms" isStatefulPod=true podCreationTimestamp="2026-09-11 02:53:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:53:58.707055876 +0000 UTC m=+63.846379093" watchObservedRunningTime="2026-09-11 02:53:58.708061737 +0000 UTC m=+63.847384927" Sep 11 02:53:58.712740 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:58.712712 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-78f8566f6f-tcrrf"] Sep 11 02:53:58.716652 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:53:58.716601 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4a7a8df_9ef1_475d_a27a_696e65035073.slice/crio-cb059f1d7a0f765556cb011b96b5122a74ddb0bfa55226d8b7701709e09be1fa WatchSource:0}: Error finding container cb059f1d7a0f765556cb011b96b5122a74ddb0bfa55226d8b7701709e09be1fa: Status 404 returned error can't find the container with id cb059f1d7a0f765556cb011b96b5122a74ddb0bfa55226d8b7701709e09be1fa Sep 11 02:53:58.717898 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:58.717698 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7949df7596-bxcws" Sep 11 02:53:58.717898 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:58.717743 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7949df7596-bxcws" Sep 11 02:53:58.723411 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:58.723392 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7949df7596-bxcws" Sep 11 02:53:59.667180 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:59.667123 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78f8566f6f-tcrrf" event={"ID":"f4a7a8df-9ef1-475d-a27a-696e65035073","Type":"ContainerStarted","Data":"cb059f1d7a0f765556cb011b96b5122a74ddb0bfa55226d8b7701709e09be1fa"} Sep 11 02:53:59.669026 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:59.668996 2580 generic.go:356] "Generic (PLEG): container finished" podID="dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40" containerID="b8daf357e399bb422124f36890a9baa2b25f888c2e1935a14408a3f672f07be9" exitCode=0 Sep 11 02:53:59.669334 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:59.669307 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40","Type":"ContainerDied","Data":"b8daf357e399bb422124f36890a9baa2b25f888c2e1935a14408a3f672f07be9"} Sep 11 02:53:59.674966 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:59.674945 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7949df7596-bxcws" Sep 11 02:53:59.748056 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:53:59.748029 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7447c8fc9c-5n6bm"] Sep 11 02:54:00.676314 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:00.676278 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78f8566f6f-tcrrf" event={"ID":"f4a7a8df-9ef1-475d-a27a-696e65035073","Type":"ContainerStarted","Data":"b187a8452999c2a576809367769f6622c85e275c71e80d372d2c9671688327b1"} Sep 11 02:54:00.676740 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:00.676360 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78f8566f6f-tcrrf" event={"ID":"f4a7a8df-9ef1-475d-a27a-696e65035073","Type":"ContainerStarted","Data":"a81d9b9c49e4b0a46827fd0dfce97da48ef0a19cf8ddff950a3dfe1d6fb12695"} Sep 11 02:54:00.676740 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:00.676396 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78f8566f6f-tcrrf" event={"ID":"f4a7a8df-9ef1-475d-a27a-696e65035073","Type":"ContainerStarted","Data":"6c694fb0be566bcbf7c9962586304e49084284868f8e56ba3026a7f4e7b98d25"} Sep 11 02:54:01.017441 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:01.017403 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a-original-pull-secret\") pod \"global-pull-secret-syncer-h2th6\" (UID: \"2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a\") " pod="kube-system/global-pull-secret-syncer-h2th6" Sep 11 02:54:01.020377 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:01.020351 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 11 02:54:01.030852 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:01.030829 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a-original-pull-secret\") pod \"global-pull-secret-syncer-h2th6\" (UID: \"2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a\") " pod="kube-system/global-pull-secret-syncer-h2th6" Sep 11 02:54:01.118321 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:01.118290 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237-metrics-certs\") pod \"network-metrics-daemon-qb9m9\" (UID: \"1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237\") " pod="openshift-multus/network-metrics-daemon-qb9m9" Sep 11 02:54:01.121395 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:01.121370 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 11 02:54:01.131322 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:01.131300 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237-metrics-certs\") pod \"network-metrics-daemon-qb9m9\" (UID: \"1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237\") " pod="openshift-multus/network-metrics-daemon-qb9m9" Sep 11 02:54:01.218935 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:01.218898 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrc86\" (UniqueName: \"kubernetes.io/projected/dffb443d-1d41-4705-a57d-1dbad16fff80-kube-api-access-jrc86\") pod \"network-check-target-pxq8g\" (UID: \"dffb443d-1d41-4705-a57d-1dbad16fff80\") " pod="openshift-network-diagnostics/network-check-target-pxq8g" Sep 11 02:54:01.221866 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:01.221840 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 11 02:54:01.232045 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:01.232022 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 11 02:54:01.242138 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:01.242119 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrc86\" (UniqueName: \"kubernetes.io/projected/dffb443d-1d41-4705-a57d-1dbad16fff80-kube-api-access-jrc86\") pod \"network-check-target-pxq8g\" (UID: \"dffb443d-1d41-4705-a57d-1dbad16fff80\") " pod="openshift-network-diagnostics/network-check-target-pxq8g" Sep 11 02:54:01.257233 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:01.257210 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kjvvr\"" Sep 11 02:54:01.264760 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:01.264729 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qb9m9" Sep 11 02:54:01.265299 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:01.265281 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jdnxv\"" Sep 11 02:54:01.270242 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:01.270221 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h2th6" Sep 11 02:54:01.272718 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:01.272696 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxq8g" Sep 11 02:54:02.229609 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.229583 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-f8d566cc6-5mc96"] Sep 11 02:54:02.252057 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.252031 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f8d566cc6-5mc96"] Sep 11 02:54:02.252267 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.252242 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f8d566cc6-5mc96" Sep 11 02:54:02.328940 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.328890 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1321708f-c1c0-42f4-ab0b-58fd2038eb97-service-ca\") pod \"console-f8d566cc6-5mc96\" (UID: \"1321708f-c1c0-42f4-ab0b-58fd2038eb97\") " pod="openshift-console/console-f8d566cc6-5mc96" Sep 11 02:54:02.328940 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.328932 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1321708f-c1c0-42f4-ab0b-58fd2038eb97-oauth-serving-cert\") pod \"console-f8d566cc6-5mc96\" (UID: \"1321708f-c1c0-42f4-ab0b-58fd2038eb97\") " pod="openshift-console/console-f8d566cc6-5mc96" Sep 11 02:54:02.329048 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.328978 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1321708f-c1c0-42f4-ab0b-58fd2038eb97-console-config\") pod \"console-f8d566cc6-5mc96\" (UID: \"1321708f-c1c0-42f4-ab0b-58fd2038eb97\") " pod="openshift-console/console-f8d566cc6-5mc96" Sep 11 02:54:02.329048 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.329008 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1321708f-c1c0-42f4-ab0b-58fd2038eb97-trusted-ca-bundle\") pod \"console-f8d566cc6-5mc96\" (UID: \"1321708f-c1c0-42f4-ab0b-58fd2038eb97\") " pod="openshift-console/console-f8d566cc6-5mc96" Sep 11 02:54:02.329048 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.329025 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzndf\" (UniqueName: \"kubernetes.io/projected/1321708f-c1c0-42f4-ab0b-58fd2038eb97-kube-api-access-rzndf\") pod \"console-f8d566cc6-5mc96\" (UID: \"1321708f-c1c0-42f4-ab0b-58fd2038eb97\") " pod="openshift-console/console-f8d566cc6-5mc96" Sep 11 02:54:02.329144 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.329085 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1321708f-c1c0-42f4-ab0b-58fd2038eb97-console-serving-cert\") pod \"console-f8d566cc6-5mc96\" (UID: \"1321708f-c1c0-42f4-ab0b-58fd2038eb97\") " pod="openshift-console/console-f8d566cc6-5mc96" Sep 11 02:54:02.329174 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.329138 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1321708f-c1c0-42f4-ab0b-58fd2038eb97-console-oauth-config\") pod \"console-f8d566cc6-5mc96\" (UID: \"1321708f-c1c0-42f4-ab0b-58fd2038eb97\") " pod="openshift-console/console-f8d566cc6-5mc96" Sep 11 02:54:02.389327 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.388998 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pxq8g"] Sep 11 02:54:02.394296 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:54:02.394262 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddffb443d_1d41_4705_a57d_1dbad16fff80.slice/crio-f21cc5cdebabafbaa36d1108161b8ae0bf3439f0322457f89262a3d0c8c112c2 WatchSource:0}: Error finding container f21cc5cdebabafbaa36d1108161b8ae0bf3439f0322457f89262a3d0c8c112c2: Status 404 returned error can't find the container with id f21cc5cdebabafbaa36d1108161b8ae0bf3439f0322457f89262a3d0c8c112c2 Sep 11 02:54:02.398390 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.398373 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 11 02:54:02.417490 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:54:02.417465 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e4f9c4a_e3a1_4ce8_b1c2_fdc15eef432a.slice/crio-ef0a7f926a7747d273aed10710775d01c00eb7a806dd8d9b6ab21a6d3697f6df WatchSource:0}: Error finding container ef0a7f926a7747d273aed10710775d01c00eb7a806dd8d9b6ab21a6d3697f6df: Status 404 returned error can't find the container with id ef0a7f926a7747d273aed10710775d01c00eb7a806dd8d9b6ab21a6d3697f6df Sep 11 02:54:02.418231 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:54:02.418208 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ce5d1e5_34a0_476f_a8b4_8d8aacb9b237.slice/crio-a7d68bc415a3bab3f65c4171fd9847592ce6ee72a5ef1921a640d0738e0ce4bf WatchSource:0}: Error finding container a7d68bc415a3bab3f65c4171fd9847592ce6ee72a5ef1921a640d0738e0ce4bf: Status 404 returned error can't find the container with id a7d68bc415a3bab3f65c4171fd9847592ce6ee72a5ef1921a640d0738e0ce4bf Sep 11 02:54:02.429216 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.429194 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-h2th6"] Sep 11 02:54:02.429305 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.429233 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qb9m9"] Sep 11 02:54:02.429305 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.429261 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 11 02:54:02.429414 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.429334 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:54:02.429547 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.429514 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1321708f-c1c0-42f4-ab0b-58fd2038eb97-service-ca\") pod \"console-f8d566cc6-5mc96\" (UID: \"1321708f-c1c0-42f4-ab0b-58fd2038eb97\") " pod="openshift-console/console-f8d566cc6-5mc96" Sep 11 02:54:02.429613 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.429567 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1321708f-c1c0-42f4-ab0b-58fd2038eb97-oauth-serving-cert\") pod \"console-f8d566cc6-5mc96\" (UID: \"1321708f-c1c0-42f4-ab0b-58fd2038eb97\") " pod="openshift-console/console-f8d566cc6-5mc96" Sep 11 02:54:02.429613 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.429605 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1321708f-c1c0-42f4-ab0b-58fd2038eb97-console-config\") pod \"console-f8d566cc6-5mc96\" (UID: \"1321708f-c1c0-42f4-ab0b-58fd2038eb97\") " pod="openshift-console/console-f8d566cc6-5mc96" Sep 11 02:54:02.429741 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.429723 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1321708f-c1c0-42f4-ab0b-58fd2038eb97-trusted-ca-bundle\") pod \"console-f8d566cc6-5mc96\" (UID: \"1321708f-c1c0-42f4-ab0b-58fd2038eb97\") " pod="openshift-console/console-f8d566cc6-5mc96" Sep 11 02:54:02.429791 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.429751 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzndf\" (UniqueName: \"kubernetes.io/projected/1321708f-c1c0-42f4-ab0b-58fd2038eb97-kube-api-access-rzndf\") pod \"console-f8d566cc6-5mc96\" (UID: \"1321708f-c1c0-42f4-ab0b-58fd2038eb97\") " pod="openshift-console/console-f8d566cc6-5mc96" Sep 11 02:54:02.429791 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.429778 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1321708f-c1c0-42f4-ab0b-58fd2038eb97-console-serving-cert\") pod \"console-f8d566cc6-5mc96\" (UID: \"1321708f-c1c0-42f4-ab0b-58fd2038eb97\") " pod="openshift-console/console-f8d566cc6-5mc96" Sep 11 02:54:02.429872 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.429816 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1321708f-c1c0-42f4-ab0b-58fd2038eb97-console-oauth-config\") pod \"console-f8d566cc6-5mc96\" (UID: \"1321708f-c1c0-42f4-ab0b-58fd2038eb97\") " pod="openshift-console/console-f8d566cc6-5mc96" Sep 11 02:54:02.430865 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.430809 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1321708f-c1c0-42f4-ab0b-58fd2038eb97-service-ca\") pod \"console-f8d566cc6-5mc96\" (UID: \"1321708f-c1c0-42f4-ab0b-58fd2038eb97\") " pod="openshift-console/console-f8d566cc6-5mc96" Sep 11 02:54:02.430865 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.430809 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1321708f-c1c0-42f4-ab0b-58fd2038eb97-console-config\") pod \"console-f8d566cc6-5mc96\" (UID: \"1321708f-c1c0-42f4-ab0b-58fd2038eb97\") " pod="openshift-console/console-f8d566cc6-5mc96" Sep 11 02:54:02.431273 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.431204 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1321708f-c1c0-42f4-ab0b-58fd2038eb97-trusted-ca-bundle\") pod \"console-f8d566cc6-5mc96\" (UID: \"1321708f-c1c0-42f4-ab0b-58fd2038eb97\") " pod="openshift-console/console-f8d566cc6-5mc96" Sep 11 02:54:02.431386 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.431363 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1321708f-c1c0-42f4-ab0b-58fd2038eb97-oauth-serving-cert\") pod \"console-f8d566cc6-5mc96\" (UID: \"1321708f-c1c0-42f4-ab0b-58fd2038eb97\") " pod="openshift-console/console-f8d566cc6-5mc96" Sep 11 02:54:02.433200 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.432598 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 11 02:54:02.433200 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.432775 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1321708f-c1c0-42f4-ab0b-58fd2038eb97-console-oauth-config\") pod \"console-f8d566cc6-5mc96\" (UID: \"1321708f-c1c0-42f4-ab0b-58fd2038eb97\") " pod="openshift-console/console-f8d566cc6-5mc96" Sep 11 02:54:02.433200 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.432853 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 11 02:54:02.433200 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.432984 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 11 02:54:02.433200 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.433104 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 11 02:54:02.433200 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.433180 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 11 02:54:02.433688 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.433608 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 11 02:54:02.434148 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.433842 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 11 02:54:02.434148 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.433857 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 11 02:54:02.434148 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.433882 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 11 02:54:02.434148 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.433912 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1321708f-c1c0-42f4-ab0b-58fd2038eb97-console-serving-cert\") pod \"console-f8d566cc6-5mc96\" (UID: \"1321708f-c1c0-42f4-ab0b-58fd2038eb97\") " pod="openshift-console/console-f8d566cc6-5mc96" Sep 11 02:54:02.434148 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.434041 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 11 02:54:02.434148 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.434046 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 11 02:54:02.434148 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.434061 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 11 02:54:02.434531 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.434271 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-951ncsgudi32q\"" Sep 11 02:54:02.434531 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.434278 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 11 02:54:02.434659 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.434559 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 11 02:54:02.435246 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.434954 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-zlb8r\"" Sep 11 02:54:02.437890 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.437872 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 11 02:54:02.445987 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.445968 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzndf\" (UniqueName: \"kubernetes.io/projected/1321708f-c1c0-42f4-ab0b-58fd2038eb97-kube-api-access-rzndf\") pod \"console-f8d566cc6-5mc96\" (UID: \"1321708f-c1c0-42f4-ab0b-58fd2038eb97\") " pod="openshift-console/console-f8d566cc6-5mc96" Sep 11 02:54:02.531065 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.531037 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f6076f23-d106-459a-a958-d91759dac571-config\") pod \"prometheus-k8s-0\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:54:02.531151 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.531085 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6076f23-d106-459a-a958-d91759dac571-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:54:02.531151 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.531120 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f6076f23-d106-459a-a958-d91759dac571-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:54:02.531264 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.531148 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2j4c\" (UniqueName: \"kubernetes.io/projected/f6076f23-d106-459a-a958-d91759dac571-kube-api-access-p2j4c\") pod \"prometheus-k8s-0\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:54:02.531264 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.531182 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f6076f23-d106-459a-a958-d91759dac571-web-config\") pod \"prometheus-k8s-0\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:54:02.531264 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.531241 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f6076f23-d106-459a-a958-d91759dac571-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:54:02.531379 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.531289 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f6076f23-d106-459a-a958-d91759dac571-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:54:02.531379 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.531326 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f6076f23-d106-459a-a958-d91759dac571-config-out\") pod \"prometheus-k8s-0\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:54:02.531379 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.531355 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f6076f23-d106-459a-a958-d91759dac571-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:54:02.531498 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.531421 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f6076f23-d106-459a-a958-d91759dac571-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:54:02.531532 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.531491 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f6076f23-d106-459a-a958-d91759dac571-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:54:02.531565 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.531537 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f6076f23-d106-459a-a958-d91759dac571-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:54:02.531606 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.531564 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f6076f23-d106-459a-a958-d91759dac571-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:54:02.531606 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.531585 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f6076f23-d106-459a-a958-d91759dac571-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:54:02.531606 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.531600 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f6076f23-d106-459a-a958-d91759dac571-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:54:02.531728 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.531661 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6076f23-d106-459a-a958-d91759dac571-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:54:02.531766 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.531723 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f6076f23-d106-459a-a958-d91759dac571-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:54:02.531766 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.531755 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f6076f23-d106-459a-a958-d91759dac571-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:54:02.531825 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.531779 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6076f23-d106-459a-a958-d91759dac571-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:54:02.531825 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.531796 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f6076f23-d106-459a-a958-d91759dac571-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:54:02.562586 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.562568 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f8d566cc6-5mc96" Sep 11 02:54:02.629385 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.629362 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vf6hb" Sep 11 02:54:02.637026 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.633424 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f6076f23-d106-459a-a958-d91759dac571-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:54:02.637026 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.633464 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f6076f23-d106-459a-a958-d91759dac571-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:54:02.637026 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.633489 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f6076f23-d106-459a-a958-d91759dac571-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:54:02.637026 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.633512 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f6076f23-d106-459a-a958-d91759dac571-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:54:02.637026 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.633543 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6076f23-d106-459a-a958-d91759dac571-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:54:02.637026 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.633579 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f6076f23-d106-459a-a958-d91759dac571-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:54:02.637026 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.633602 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f6076f23-d106-459a-a958-d91759dac571-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:54:02.637026 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.633651 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6076f23-d106-459a-a958-d91759dac571-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:54:02.637026 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.633678 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f6076f23-d106-459a-a958-d91759dac571-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:54:02.637026 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.633707 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f6076f23-d106-459a-a958-d91759dac571-config\") pod \"prometheus-k8s-0\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:54:02.637026 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.633730 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6076f23-d106-459a-a958-d91759dac571-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:54:02.637026 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.633756 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f6076f23-d106-459a-a958-d91759dac571-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:54:02.637026 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.633779 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2j4c\" (UniqueName: \"kubernetes.io/projected/f6076f23-d106-459a-a958-d91759dac571-kube-api-access-p2j4c\") pod \"prometheus-k8s-0\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:54:02.637026 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.634601 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f6076f23-d106-459a-a958-d91759dac571-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:54:02.637026 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.635855 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6076f23-d106-459a-a958-d91759dac571-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:54:02.639671 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.639064 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6076f23-d106-459a-a958-d91759dac571-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:54:02.641422 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.640793 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f6076f23-d106-459a-a958-d91759dac571-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:54:02.641422 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.640846 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f6076f23-d106-459a-a958-d91759dac571-web-config\") pod \"prometheus-k8s-0\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:54:02.641422 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.640888 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f6076f23-d106-459a-a958-d91759dac571-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:54:02.641422 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.640927 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f6076f23-d106-459a-a958-d91759dac571-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:54:02.641422 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.640962 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f6076f23-d106-459a-a958-d91759dac571-config-out\") pod \"prometheus-k8s-0\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:54:02.641422 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.640994 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f6076f23-d106-459a-a958-d91759dac571-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:54:02.641422 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.641021 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f6076f23-d106-459a-a958-d91759dac571-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:54:02.643559 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.643539 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f6076f23-d106-459a-a958-d91759dac571-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:54:02.643889 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.642494 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f6076f23-d106-459a-a958-d91759dac571-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:54:02.643999 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.643012 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f6076f23-d106-459a-a958-d91759dac571-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:54:02.643999 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.643151 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f6076f23-d106-459a-a958-d91759dac571-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:54:02.643999 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.643239 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f6076f23-d106-459a-a958-d91759dac571-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:54:02.643999 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.643474 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f6076f23-d106-459a-a958-d91759dac571-config\") pod \"prometheus-k8s-0\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:54:02.643999 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.641338 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6076f23-d106-459a-a958-d91759dac571-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:54:02.652871 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.651158 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f6076f23-d106-459a-a958-d91759dac571-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:54:02.652871 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.651335 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f6076f23-d106-459a-a958-d91759dac571-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:54:02.652871 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.651602 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f6076f23-d106-459a-a958-d91759dac571-web-config\") pod \"prometheus-k8s-0\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:54:02.652871 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.651795 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f6076f23-d106-459a-a958-d91759dac571-config-out\") pod \"prometheus-k8s-0\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:54:02.652871 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.652325 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f6076f23-d106-459a-a958-d91759dac571-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:54:02.652871 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.652511 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f6076f23-d106-459a-a958-d91759dac571-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:54:02.653566 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.653206 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f6076f23-d106-459a-a958-d91759dac571-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:54:02.654704 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.653889 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2j4c\" (UniqueName: \"kubernetes.io/projected/f6076f23-d106-459a-a958-d91759dac571-kube-api-access-p2j4c\") pod \"prometheus-k8s-0\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:54:02.654704 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.654322 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f6076f23-d106-459a-a958-d91759dac571-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:54:02.659271 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.659246 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f6076f23-d106-459a-a958-d91759dac571-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:54:02.684823 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.684787 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pxq8g" event={"ID":"dffb443d-1d41-4705-a57d-1dbad16fff80","Type":"ContainerStarted","Data":"f21cc5cdebabafbaa36d1108161b8ae0bf3439f0322457f89262a3d0c8c112c2"} Sep 11 02:54:02.688016 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.687981 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78f8566f6f-tcrrf" event={"ID":"f4a7a8df-9ef1-475d-a27a-696e65035073","Type":"ContainerStarted","Data":"b4f5fa28eb78cc5dda3fed22e1669b37f984f7d7acc5db8bb36ddae9cd71f0bc"} Sep 11 02:54:02.688093 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.688044 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78f8566f6f-tcrrf" event={"ID":"f4a7a8df-9ef1-475d-a27a-696e65035073","Type":"ContainerStarted","Data":"65d4bedf3b9a110ca12b68c7268881738db2c029787aa905b5f1c4484cf7ea9a"} Sep 11 02:54:02.688093 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.688072 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78f8566f6f-tcrrf" event={"ID":"f4a7a8df-9ef1-475d-a27a-696e65035073","Type":"ContainerStarted","Data":"c874c3417734172cca9add05a21003adf602d70730b122788a10c6efd2f3e938"} Sep 11 02:54:02.688182 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.688100 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-78f8566f6f-tcrrf" Sep 11 02:54:02.689494 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.689467 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-h2th6" event={"ID":"2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a","Type":"ContainerStarted","Data":"ef0a7f926a7747d273aed10710775d01c00eb7a806dd8d9b6ab21a6d3697f6df"} Sep 11 02:54:02.690727 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.690706 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qb9m9" event={"ID":"1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237","Type":"ContainerStarted","Data":"a7d68bc415a3bab3f65c4171fd9847592ce6ee72a5ef1921a640d0738e0ce4bf"} Sep 11 02:54:02.693572 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.693553 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40","Type":"ContainerStarted","Data":"bf8a075dda349db2e0511e60d49f1d6a7cdf9571e793518d14cc90ec319025d4"} Sep 11 02:54:02.693659 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.693600 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40","Type":"ContainerStarted","Data":"a5fa9de78ceb7e1f358e6b74d1f47e6ef2767fc5122a6504d59df540995a43a8"} Sep 11 02:54:02.693659 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.693645 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40","Type":"ContainerStarted","Data":"58f601bb91b342ee0a1b8f57603fec7bad8fd147c5b0685f6db334fe4dea3a7a"} Sep 11 02:54:02.693739 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.693671 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40","Type":"ContainerStarted","Data":"9e7b509a5c35a4e4340dfffa45cf9a3fa907538402e590662cee50dcd5dbbae8"} Sep 11 02:54:02.710028 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.709968 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-78f8566f6f-tcrrf" podStartSLOduration=1.460838919 podStartE2EDuration="4.709950141s" totalImagesPullingTime="3.249111222s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 02:53:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:54:02.708919192 +0000 UTC m=+67.848242383" watchObservedRunningTime="2026-09-11 02:54:02.709950141 +0000 UTC m=+67.849273354" Sep 11 02:54:02.743515 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.743493 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:54:02.861518 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:02.861494 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f8d566cc6-5mc96"] Sep 11 02:54:02.863643 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:54:02.863604 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1321708f_c1c0_42f4_ab0b_58fd2038eb97.slice/crio-df679cd13bfec1cf2aef354bbf4568ce530c0e66884f3959fc34acb7a7aa223d WatchSource:0}: Error finding container df679cd13bfec1cf2aef354bbf4568ce530c0e66884f3959fc34acb7a7aa223d: Status 404 returned error can't find the container with id df679cd13bfec1cf2aef354bbf4568ce530c0e66884f3959fc34acb7a7aa223d Sep 11 02:54:03.049247 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:03.049215 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 11 02:54:03.054696 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:54:03.054663 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6076f23_d106_459a_a958_d91759dac571.slice/crio-daecaaf59b5fb1d3874bbb54bf1763a5ec8781bb01f8388b1d63c862a9d408e4 WatchSource:0}: Error finding container daecaaf59b5fb1d3874bbb54bf1763a5ec8781bb01f8388b1d63c862a9d408e4: Status 404 returned error can't find the container with id daecaaf59b5fb1d3874bbb54bf1763a5ec8781bb01f8388b1d63c862a9d408e4 Sep 11 02:54:03.701330 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:03.701292 2580 generic.go:356] "Generic (PLEG): container finished" podID="f6076f23-d106-459a-a958-d91759dac571" containerID="82e5a8d68efecbffd3faf7eb77357655ea9655cfa9d64bfb6a80978ae08b6eaf" exitCode=0 Sep 11 02:54:03.701768 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:03.701383 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f6076f23-d106-459a-a958-d91759dac571","Type":"ContainerDied","Data":"82e5a8d68efecbffd3faf7eb77357655ea9655cfa9d64bfb6a80978ae08b6eaf"} Sep 11 02:54:03.701768 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:03.701454 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f6076f23-d106-459a-a958-d91759dac571","Type":"ContainerStarted","Data":"daecaaf59b5fb1d3874bbb54bf1763a5ec8781bb01f8388b1d63c862a9d408e4"} Sep 11 02:54:03.705453 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:03.705413 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f8d566cc6-5mc96" event={"ID":"1321708f-c1c0-42f4-ab0b-58fd2038eb97","Type":"ContainerStarted","Data":"7ef959f3735101f06e89db13ce5441322272f7b1f8e1d7acee8c84ecb067e360"} Sep 11 02:54:03.705545 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:03.705461 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f8d566cc6-5mc96" event={"ID":"1321708f-c1c0-42f4-ab0b-58fd2038eb97","Type":"ContainerStarted","Data":"df679cd13bfec1cf2aef354bbf4568ce530c0e66884f3959fc34acb7a7aa223d"} Sep 11 02:54:03.711299 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:03.711268 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40","Type":"ContainerStarted","Data":"80870e8e5893f543a8ae0f2e52495407207cad9cee201ea4fe5968550f4cc32a"} Sep 11 02:54:03.711409 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:03.711340 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40","Type":"ContainerStarted","Data":"1a16615fd622e1743294a274eeb7c5bb4fa0d04966ff6bb12fbf9e990d4fd4d7"} Sep 11 02:54:03.776372 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:03.774828 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.025534864 podStartE2EDuration="6.774812964s" totalImagesPullingTime="3.733595774s" totalInitContainerRuntime="15.682326ms" isStatefulPod=false podCreationTimestamp="2026-09-11 02:53:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:54:03.774582005 +0000 UTC m=+68.913905223" watchObservedRunningTime="2026-09-11 02:54:03.774812964 +0000 UTC m=+68.914136157" Sep 11 02:54:03.795744 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:03.795686 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-f8d566cc6-5mc96" podStartSLOduration=1.795664791 podStartE2EDuration="1.795664791s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 02:54:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:54:03.795029554 +0000 UTC m=+68.934352749" watchObservedRunningTime="2026-09-11 02:54:03.795664791 +0000 UTC m=+68.934987984" Sep 11 02:54:04.722359 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:04.721733 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qb9m9" event={"ID":"1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237","Type":"ContainerStarted","Data":"b497757d837763c0fb0d9eb740590b79b7ff28ad016de8f7b27f154ebd1a5306"} Sep 11 02:54:04.722359 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:04.721828 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qb9m9" event={"ID":"1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237","Type":"ContainerStarted","Data":"214190c81aacb07ff1413f9b8e392b3b2f434868f6251ee8dd1fa6f52fde3348"} Sep 11 02:54:08.717871 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:08.717512 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-78f8566f6f-tcrrf" Sep 11 02:54:08.744309 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:08.744240 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qb9m9" podStartSLOduration=72.298010086 podStartE2EDuration="1m13.744224494s" totalImagesPullingTime="1.446214408s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 02:52:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:54:04.740746544 +0000 UTC m=+69.880069737" watchObservedRunningTime="2026-09-11 02:54:08.744224494 +0000 UTC m=+73.883547684" Sep 11 02:54:08.744492 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:08.744469 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pxq8g" event={"ID":"dffb443d-1d41-4705-a57d-1dbad16fff80","Type":"ContainerStarted","Data":"122d37ce2d15b303cf881e0164d88c2ffdf7d67da20d2b8c484de46d15e60022"} Sep 11 02:54:08.747391 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:08.747370 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f6076f23-d106-459a-a958-d91759dac571","Type":"ContainerStarted","Data":"707f74d6e4ee31ebb77fad492b465e7848512f6b63162a0da37d5bae54b6d990"} Sep 11 02:54:08.747533 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:08.747436 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f6076f23-d106-459a-a958-d91759dac571","Type":"ContainerStarted","Data":"217bc9207afe05834dfd74be804e49af827508b9ab100c728b66655a740d81fe"} Sep 11 02:54:08.747533 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:08.747477 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f6076f23-d106-459a-a958-d91759dac571","Type":"ContainerStarted","Data":"5a1921ec26c24a4bfd1fb9ee02c7ab8b0df2e8c7862ba6f80b782485bd30b02c"} Sep 11 02:54:08.747533 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:08.747516 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f6076f23-d106-459a-a958-d91759dac571","Type":"ContainerStarted","Data":"56b6b3277bca448878cd2ac8d963f12afa8a585e31b2635036f5592422a04de2"} Sep 11 02:54:08.750772 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:08.750565 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-h2th6" event={"ID":"2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a","Type":"ContainerStarted","Data":"2b6949648cc856003347803af716f128720d6abb31018e196a1c39e33f35f77b"} Sep 11 02:54:08.764301 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:08.764257 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-pxq8g" podStartSLOduration=67.749492757 podStartE2EDuration="1m13.764241456s" totalImagesPullingTime="6.014748699s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 02:52:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:54:08.763923324 +0000 UTC m=+73.903246515" watchObservedRunningTime="2026-09-11 02:54:08.764241456 +0000 UTC m=+73.903564645" Sep 11 02:54:08.779869 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:08.779819 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-h2th6" podStartSLOduration=67.775818087 podStartE2EDuration="1m13.779801727s" totalImagesPullingTime="6.00398364s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 02:52:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:54:08.779686975 +0000 UTC m=+73.919010168" watchObservedRunningTime="2026-09-11 02:54:08.779801727 +0000 UTC m=+73.919124917" Sep 11 02:54:09.757466 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:09.757426 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f6076f23-d106-459a-a958-d91759dac571","Type":"ContainerStarted","Data":"4d79bbd8be34f97a432c7869e589cd92f6cd3d0beeee629cf72ebe6029758836"} Sep 11 02:54:09.757946 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:09.757509 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f6076f23-d106-459a-a958-d91759dac571","Type":"ContainerStarted","Data":"15f3f98aea1c20c8e5aef483f3e8770865bf4810dadd711e51e191faf101fd52"} Sep 11 02:54:09.757946 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:09.757788 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-pxq8g" Sep 11 02:54:09.787666 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:09.787606 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.051442545 podStartE2EDuration="7.78759176s" totalImagesPullingTime="4.712218619s" totalInitContainerRuntime="23.930596ms" isStatefulPod=false podCreationTimestamp="2026-09-11 02:54:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:54:09.785304967 +0000 UTC m=+74.924628196" watchObservedRunningTime="2026-09-11 02:54:09.78759176 +0000 UTC m=+74.926914950" Sep 11 02:54:12.563454 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:12.563421 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f8d566cc6-5mc96" Sep 11 02:54:12.563913 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:12.563608 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f8d566cc6-5mc96" Sep 11 02:54:12.568191 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:12.568172 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f8d566cc6-5mc96" Sep 11 02:54:12.743913 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:12.743880 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:54:12.774751 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:12.774729 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f8d566cc6-5mc96" Sep 11 02:54:12.819730 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:12.819670 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7949df7596-bxcws"] Sep 11 02:54:24.772686 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:24.772537 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7447c8fc9c-5n6bm" podUID="55922251-fd40-4f6b-a4d4-97ba03fbe579" containerName="console" containerID="cri-o://1b0792a7a878671a29362d36f2acf2ec5a77d5732de20333eacefd4acb95c12a" gracePeriod=15 Sep 11 02:54:25.037093 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:25.037039 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7447c8fc9c-5n6bm" Sep 11 02:54:25.135879 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:25.135855 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/55922251-fd40-4f6b-a4d4-97ba03fbe579-console-serving-cert\") pod \"55922251-fd40-4f6b-a4d4-97ba03fbe579\" (UID: \"55922251-fd40-4f6b-a4d4-97ba03fbe579\") " Sep 11 02:54:25.136049 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:25.135915 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/55922251-fd40-4f6b-a4d4-97ba03fbe579-console-oauth-config\") pod \"55922251-fd40-4f6b-a4d4-97ba03fbe579\" (UID: \"55922251-fd40-4f6b-a4d4-97ba03fbe579\") " Sep 11 02:54:25.136049 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:25.135933 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/55922251-fd40-4f6b-a4d4-97ba03fbe579-service-ca\") pod \"55922251-fd40-4f6b-a4d4-97ba03fbe579\" (UID: \"55922251-fd40-4f6b-a4d4-97ba03fbe579\") " Sep 11 02:54:25.136175 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:25.136062 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/55922251-fd40-4f6b-a4d4-97ba03fbe579-oauth-serving-cert\") pod \"55922251-fd40-4f6b-a4d4-97ba03fbe579\" (UID: \"55922251-fd40-4f6b-a4d4-97ba03fbe579\") " Sep 11 02:54:25.136175 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:25.136095 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/55922251-fd40-4f6b-a4d4-97ba03fbe579-console-config\") pod \"55922251-fd40-4f6b-a4d4-97ba03fbe579\" (UID: \"55922251-fd40-4f6b-a4d4-97ba03fbe579\") " Sep 11 02:54:25.136175 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:25.136170 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dzgdr\" (UniqueName: \"kubernetes.io/projected/55922251-fd40-4f6b-a4d4-97ba03fbe579-kube-api-access-dzgdr\") pod \"55922251-fd40-4f6b-a4d4-97ba03fbe579\" (UID: \"55922251-fd40-4f6b-a4d4-97ba03fbe579\") " Sep 11 02:54:25.136337 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:25.136304 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55922251-fd40-4f6b-a4d4-97ba03fbe579-service-ca" (OuterVolumeSpecName: "service-ca") pod "55922251-fd40-4f6b-a4d4-97ba03fbe579" (UID: "55922251-fd40-4f6b-a4d4-97ba03fbe579"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 02:54:25.136453 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:25.136421 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55922251-fd40-4f6b-a4d4-97ba03fbe579-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "55922251-fd40-4f6b-a4d4-97ba03fbe579" (UID: "55922251-fd40-4f6b-a4d4-97ba03fbe579"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 02:54:25.136566 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:25.136491 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/55922251-fd40-4f6b-a4d4-97ba03fbe579-service-ca\") on node \"ip-10-0-138-210.ec2.internal\" DevicePath \"\"" Sep 11 02:54:25.136566 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:25.136492 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55922251-fd40-4f6b-a4d4-97ba03fbe579-console-config" (OuterVolumeSpecName: "console-config") pod "55922251-fd40-4f6b-a4d4-97ba03fbe579" (UID: "55922251-fd40-4f6b-a4d4-97ba03fbe579"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 02:54:25.138315 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:25.138292 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55922251-fd40-4f6b-a4d4-97ba03fbe579-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "55922251-fd40-4f6b-a4d4-97ba03fbe579" (UID: "55922251-fd40-4f6b-a4d4-97ba03fbe579"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 02:54:25.138389 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:25.138365 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55922251-fd40-4f6b-a4d4-97ba03fbe579-kube-api-access-dzgdr" (OuterVolumeSpecName: "kube-api-access-dzgdr") pod "55922251-fd40-4f6b-a4d4-97ba03fbe579" (UID: "55922251-fd40-4f6b-a4d4-97ba03fbe579"). InnerVolumeSpecName "kube-api-access-dzgdr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 02:54:25.138389 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:25.138372 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55922251-fd40-4f6b-a4d4-97ba03fbe579-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "55922251-fd40-4f6b-a4d4-97ba03fbe579" (UID: "55922251-fd40-4f6b-a4d4-97ba03fbe579"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 02:54:25.236906 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:25.236885 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/55922251-fd40-4f6b-a4d4-97ba03fbe579-console-oauth-config\") on node \"ip-10-0-138-210.ec2.internal\" DevicePath \"\"" Sep 11 02:54:25.236906 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:25.236904 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/55922251-fd40-4f6b-a4d4-97ba03fbe579-oauth-serving-cert\") on node \"ip-10-0-138-210.ec2.internal\" DevicePath \"\"" Sep 11 02:54:25.237023 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:25.236914 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/55922251-fd40-4f6b-a4d4-97ba03fbe579-console-config\") on node \"ip-10-0-138-210.ec2.internal\" DevicePath \"\"" Sep 11 02:54:25.237023 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:25.236922 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dzgdr\" (UniqueName: \"kubernetes.io/projected/55922251-fd40-4f6b-a4d4-97ba03fbe579-kube-api-access-dzgdr\") on node \"ip-10-0-138-210.ec2.internal\" DevicePath \"\"" Sep 11 02:54:25.237023 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:25.236931 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/55922251-fd40-4f6b-a4d4-97ba03fbe579-console-serving-cert\") on node \"ip-10-0-138-210.ec2.internal\" DevicePath \"\"" Sep 11 02:54:25.828893 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:25.828858 2580 generic.go:356] "Generic (PLEG): container finished" podID="55922251-fd40-4f6b-a4d4-97ba03fbe579" containerID="1b0792a7a878671a29362d36f2acf2ec5a77d5732de20333eacefd4acb95c12a" exitCode=0 Sep 11 02:54:25.829267 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:25.828923 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7447c8fc9c-5n6bm" Sep 11 02:54:25.829267 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:25.828946 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7447c8fc9c-5n6bm" event={"ID":"55922251-fd40-4f6b-a4d4-97ba03fbe579","Type":"ContainerDied","Data":"1b0792a7a878671a29362d36f2acf2ec5a77d5732de20333eacefd4acb95c12a"} Sep 11 02:54:25.829267 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:25.829000 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7447c8fc9c-5n6bm" event={"ID":"55922251-fd40-4f6b-a4d4-97ba03fbe579","Type":"ContainerDied","Data":"11d9772743eacd9009482ab1b560c7eb9d51434a96deeedc03470158f9e309c3"} Sep 11 02:54:25.829267 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:25.829019 2580 scope.go:117] "RemoveContainer" containerID="1b0792a7a878671a29362d36f2acf2ec5a77d5732de20333eacefd4acb95c12a" Sep 11 02:54:25.844936 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:25.844918 2580 scope.go:117] "RemoveContainer" containerID="1b0792a7a878671a29362d36f2acf2ec5a77d5732de20333eacefd4acb95c12a" Sep 11 02:54:25.845248 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:54:25.845228 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b0792a7a878671a29362d36f2acf2ec5a77d5732de20333eacefd4acb95c12a\": container with ID starting with 1b0792a7a878671a29362d36f2acf2ec5a77d5732de20333eacefd4acb95c12a not found: ID does not exist" containerID="1b0792a7a878671a29362d36f2acf2ec5a77d5732de20333eacefd4acb95c12a" Sep 11 02:54:25.845295 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:25.845258 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b0792a7a878671a29362d36f2acf2ec5a77d5732de20333eacefd4acb95c12a"} err="failed to get container status \"1b0792a7a878671a29362d36f2acf2ec5a77d5732de20333eacefd4acb95c12a\": rpc error: code = NotFound desc = could not find container \"1b0792a7a878671a29362d36f2acf2ec5a77d5732de20333eacefd4acb95c12a\": container with ID starting with 1b0792a7a878671a29362d36f2acf2ec5a77d5732de20333eacefd4acb95c12a not found: ID does not exist" Sep 11 02:54:25.848811 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:25.848790 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7447c8fc9c-5n6bm"] Sep 11 02:54:25.856121 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:25.856100 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7447c8fc9c-5n6bm"] Sep 11 02:54:27.342971 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:27.342941 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55922251-fd40-4f6b-a4d4-97ba03fbe579" path="/var/lib/kubelet/pods/55922251-fd40-4f6b-a4d4-97ba03fbe579/volumes" Sep 11 02:54:29.679270 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:29.679233 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vpgxz_c7169bef-9526-47a6-accd-4192623b9eca/serve-healthcheck-canary/0.log" Sep 11 02:54:37.839737 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:37.839693 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7949df7596-bxcws" podUID="6fd469b7-01d6-4078-bd48-46013095bd0d" containerName="console" containerID="cri-o://24caabce93c021255e66f5a05aa9d87c41d16c06ee5107bc903b5f6bb3c20445" gracePeriod=15 Sep 11 02:54:38.081308 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:38.081286 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7949df7596-bxcws" Sep 11 02:54:38.133377 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:38.133309 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6fd469b7-01d6-4078-bd48-46013095bd0d-console-oauth-config\") pod \"6fd469b7-01d6-4078-bd48-46013095bd0d\" (UID: \"6fd469b7-01d6-4078-bd48-46013095bd0d\") " Sep 11 02:54:38.133377 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:38.133354 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6fd469b7-01d6-4078-bd48-46013095bd0d-console-config\") pod \"6fd469b7-01d6-4078-bd48-46013095bd0d\" (UID: \"6fd469b7-01d6-4078-bd48-46013095bd0d\") " Sep 11 02:54:38.133377 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:38.133375 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fd469b7-01d6-4078-bd48-46013095bd0d-trusted-ca-bundle\") pod \"6fd469b7-01d6-4078-bd48-46013095bd0d\" (UID: \"6fd469b7-01d6-4078-bd48-46013095bd0d\") " Sep 11 02:54:38.133615 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:38.133413 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6fd469b7-01d6-4078-bd48-46013095bd0d-console-serving-cert\") pod \"6fd469b7-01d6-4078-bd48-46013095bd0d\" (UID: \"6fd469b7-01d6-4078-bd48-46013095bd0d\") " Sep 11 02:54:38.133615 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:38.133477 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p5nl5\" (UniqueName: \"kubernetes.io/projected/6fd469b7-01d6-4078-bd48-46013095bd0d-kube-api-access-p5nl5\") pod \"6fd469b7-01d6-4078-bd48-46013095bd0d\" (UID: \"6fd469b7-01d6-4078-bd48-46013095bd0d\") " Sep 11 02:54:38.133615 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:38.133505 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6fd469b7-01d6-4078-bd48-46013095bd0d-oauth-serving-cert\") pod \"6fd469b7-01d6-4078-bd48-46013095bd0d\" (UID: \"6fd469b7-01d6-4078-bd48-46013095bd0d\") " Sep 11 02:54:38.133615 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:38.133548 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6fd469b7-01d6-4078-bd48-46013095bd0d-service-ca\") pod \"6fd469b7-01d6-4078-bd48-46013095bd0d\" (UID: \"6fd469b7-01d6-4078-bd48-46013095bd0d\") " Sep 11 02:54:38.133971 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:38.133920 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fd469b7-01d6-4078-bd48-46013095bd0d-console-config" (OuterVolumeSpecName: "console-config") pod "6fd469b7-01d6-4078-bd48-46013095bd0d" (UID: "6fd469b7-01d6-4078-bd48-46013095bd0d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 02:54:38.133971 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:38.133936 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fd469b7-01d6-4078-bd48-46013095bd0d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6fd469b7-01d6-4078-bd48-46013095bd0d" (UID: "6fd469b7-01d6-4078-bd48-46013095bd0d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 02:54:38.134195 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:38.134076 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fd469b7-01d6-4078-bd48-46013095bd0d-service-ca" (OuterVolumeSpecName: "service-ca") pod "6fd469b7-01d6-4078-bd48-46013095bd0d" (UID: "6fd469b7-01d6-4078-bd48-46013095bd0d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 02:54:38.134195 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:38.134099 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fd469b7-01d6-4078-bd48-46013095bd0d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6fd469b7-01d6-4078-bd48-46013095bd0d" (UID: "6fd469b7-01d6-4078-bd48-46013095bd0d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 02:54:38.135591 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:38.135557 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fd469b7-01d6-4078-bd48-46013095bd0d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6fd469b7-01d6-4078-bd48-46013095bd0d" (UID: "6fd469b7-01d6-4078-bd48-46013095bd0d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 02:54:38.135764 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:38.135740 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fd469b7-01d6-4078-bd48-46013095bd0d-kube-api-access-p5nl5" (OuterVolumeSpecName: "kube-api-access-p5nl5") pod "6fd469b7-01d6-4078-bd48-46013095bd0d" (UID: "6fd469b7-01d6-4078-bd48-46013095bd0d"). InnerVolumeSpecName "kube-api-access-p5nl5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 02:54:38.135813 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:38.135778 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fd469b7-01d6-4078-bd48-46013095bd0d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6fd469b7-01d6-4078-bd48-46013095bd0d" (UID: "6fd469b7-01d6-4078-bd48-46013095bd0d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 02:54:38.234498 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:38.234464 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6fd469b7-01d6-4078-bd48-46013095bd0d-service-ca\") on node \"ip-10-0-138-210.ec2.internal\" DevicePath \"\"" Sep 11 02:54:38.234498 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:38.234496 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6fd469b7-01d6-4078-bd48-46013095bd0d-console-oauth-config\") on node \"ip-10-0-138-210.ec2.internal\" DevicePath \"\"" Sep 11 02:54:38.234498 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:38.234506 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6fd469b7-01d6-4078-bd48-46013095bd0d-console-config\") on node \"ip-10-0-138-210.ec2.internal\" DevicePath \"\"" Sep 11 02:54:38.234685 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:38.234515 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fd469b7-01d6-4078-bd48-46013095bd0d-trusted-ca-bundle\") on node \"ip-10-0-138-210.ec2.internal\" DevicePath \"\"" Sep 11 02:54:38.234685 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:38.234523 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6fd469b7-01d6-4078-bd48-46013095bd0d-console-serving-cert\") on node \"ip-10-0-138-210.ec2.internal\" DevicePath \"\"" Sep 11 02:54:38.234685 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:38.234531 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p5nl5\" (UniqueName: \"kubernetes.io/projected/6fd469b7-01d6-4078-bd48-46013095bd0d-kube-api-access-p5nl5\") on node \"ip-10-0-138-210.ec2.internal\" DevicePath \"\"" Sep 11 02:54:38.234685 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:38.234540 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6fd469b7-01d6-4078-bd48-46013095bd0d-oauth-serving-cert\") on node \"ip-10-0-138-210.ec2.internal\" DevicePath \"\"" Sep 11 02:54:38.878776 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:38.878746 2580 generic.go:356] "Generic (PLEG): container finished" podID="6fd469b7-01d6-4078-bd48-46013095bd0d" containerID="24caabce93c021255e66f5a05aa9d87c41d16c06ee5107bc903b5f6bb3c20445" exitCode=0 Sep 11 02:54:38.879173 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:38.878789 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7949df7596-bxcws" Sep 11 02:54:38.879173 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:38.878823 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7949df7596-bxcws" event={"ID":"6fd469b7-01d6-4078-bd48-46013095bd0d","Type":"ContainerDied","Data":"24caabce93c021255e66f5a05aa9d87c41d16c06ee5107bc903b5f6bb3c20445"} Sep 11 02:54:38.879173 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:38.878869 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7949df7596-bxcws" event={"ID":"6fd469b7-01d6-4078-bd48-46013095bd0d","Type":"ContainerDied","Data":"5810b5730fc2f81d817eb68dbb975f20278f1159439dcb8a94ca727dbea45b50"} Sep 11 02:54:38.879173 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:38.878891 2580 scope.go:117] "RemoveContainer" containerID="24caabce93c021255e66f5a05aa9d87c41d16c06ee5107bc903b5f6bb3c20445" Sep 11 02:54:38.887980 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:38.887961 2580 scope.go:117] "RemoveContainer" containerID="24caabce93c021255e66f5a05aa9d87c41d16c06ee5107bc903b5f6bb3c20445" Sep 11 02:54:38.888220 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:54:38.888202 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24caabce93c021255e66f5a05aa9d87c41d16c06ee5107bc903b5f6bb3c20445\": container with ID starting with 24caabce93c021255e66f5a05aa9d87c41d16c06ee5107bc903b5f6bb3c20445 not found: ID does not exist" containerID="24caabce93c021255e66f5a05aa9d87c41d16c06ee5107bc903b5f6bb3c20445" Sep 11 02:54:38.888267 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:38.888228 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24caabce93c021255e66f5a05aa9d87c41d16c06ee5107bc903b5f6bb3c20445"} err="failed to get container status \"24caabce93c021255e66f5a05aa9d87c41d16c06ee5107bc903b5f6bb3c20445\": rpc error: code = NotFound desc = could not find container \"24caabce93c021255e66f5a05aa9d87c41d16c06ee5107bc903b5f6bb3c20445\": container with ID starting with 24caabce93c021255e66f5a05aa9d87c41d16c06ee5107bc903b5f6bb3c20445 not found: ID does not exist" Sep 11 02:54:38.904172 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:38.904150 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7949df7596-bxcws"] Sep 11 02:54:38.908380 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:38.908356 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7949df7596-bxcws"] Sep 11 02:54:39.342215 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:39.342185 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6fd469b7-01d6-4078-bd48-46013095bd0d" path="/var/lib/kubelet/pods/6fd469b7-01d6-4078-bd48-46013095bd0d/volumes" Sep 11 02:54:40.765488 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:54:40.765460 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-pxq8g" Sep 11 02:55:02.743919 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:02.743883 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:55:02.763283 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:02.763251 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:55:02.987573 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:02.987549 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:55:16.396584 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:16.396550 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 11 02:55:17.021693 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:17.021615 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40" containerName="alertmanager" containerID="cri-o://9e7b509a5c35a4e4340dfffa45cf9a3fa907538402e590662cee50dcd5dbbae8" gracePeriod=120 Sep 11 02:55:17.021693 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:17.021676 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40" containerName="kube-rbac-proxy-metric" containerID="cri-o://1a16615fd622e1743294a274eeb7c5bb4fa0d04966ff6bb12fbf9e990d4fd4d7" gracePeriod=120 Sep 11 02:55:17.021961 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:17.021704 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40" containerName="kube-rbac-proxy-web" containerID="cri-o://a5fa9de78ceb7e1f358e6b74d1f47e6ef2767fc5122a6504d59df540995a43a8" gracePeriod=120 Sep 11 02:55:17.021961 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:17.021699 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40" containerName="prom-label-proxy" containerID="cri-o://80870e8e5893f543a8ae0f2e52495407207cad9cee201ea4fe5968550f4cc32a" gracePeriod=120 Sep 11 02:55:17.021961 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:17.021756 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40" containerName="config-reloader" containerID="cri-o://58f601bb91b342ee0a1b8f57603fec7bad8fd147c5b0685f6db334fe4dea3a7a" gracePeriod=120 Sep 11 02:55:17.021961 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:17.021793 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40" containerName="kube-rbac-proxy" containerID="cri-o://bf8a075dda349db2e0511e60d49f1d6a7cdf9571e793518d14cc90ec319025d4" gracePeriod=120 Sep 11 02:55:18.028752 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:18.028721 2580 generic.go:356] "Generic (PLEG): container finished" podID="dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40" containerID="80870e8e5893f543a8ae0f2e52495407207cad9cee201ea4fe5968550f4cc32a" exitCode=0 Sep 11 02:55:18.028752 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:18.028745 2580 generic.go:356] "Generic (PLEG): container finished" podID="dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40" containerID="1a16615fd622e1743294a274eeb7c5bb4fa0d04966ff6bb12fbf9e990d4fd4d7" exitCode=0 Sep 11 02:55:18.028752 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:18.028753 2580 generic.go:356] "Generic (PLEG): container finished" podID="dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40" containerID="bf8a075dda349db2e0511e60d49f1d6a7cdf9571e793518d14cc90ec319025d4" exitCode=0 Sep 11 02:55:18.028752 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:18.028764 2580 generic.go:356] "Generic (PLEG): container finished" podID="dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40" containerID="58f601bb91b342ee0a1b8f57603fec7bad8fd147c5b0685f6db334fe4dea3a7a" exitCode=0 Sep 11 02:55:18.028752 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:18.028770 2580 generic.go:356] "Generic (PLEG): container finished" podID="dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40" containerID="9e7b509a5c35a4e4340dfffa45cf9a3fa907538402e590662cee50dcd5dbbae8" exitCode=0 Sep 11 02:55:18.029224 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:18.028801 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40","Type":"ContainerDied","Data":"80870e8e5893f543a8ae0f2e52495407207cad9cee201ea4fe5968550f4cc32a"} Sep 11 02:55:18.029224 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:18.028899 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40","Type":"ContainerDied","Data":"1a16615fd622e1743294a274eeb7c5bb4fa0d04966ff6bb12fbf9e990d4fd4d7"} Sep 11 02:55:18.029224 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:18.028926 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40","Type":"ContainerDied","Data":"bf8a075dda349db2e0511e60d49f1d6a7cdf9571e793518d14cc90ec319025d4"} Sep 11 02:55:18.029224 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:18.028950 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40","Type":"ContainerDied","Data":"58f601bb91b342ee0a1b8f57603fec7bad8fd147c5b0685f6db334fe4dea3a7a"} Sep 11 02:55:18.029224 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:18.028973 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40","Type":"ContainerDied","Data":"9e7b509a5c35a4e4340dfffa45cf9a3fa907538402e590662cee50dcd5dbbae8"} Sep 11 02:55:18.257960 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:18.257940 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:55:18.320745 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:18.320676 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-secret-alertmanager-kube-rbac-proxy-metric\") pod \"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40\" (UID: \"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40\") " Sep 11 02:55:18.320745 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:18.320725 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-web-config\") pod \"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40\" (UID: \"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40\") " Sep 11 02:55:18.320939 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:18.320775 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-secret-alertmanager-main-tls\") pod \"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40\" (UID: \"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40\") " Sep 11 02:55:18.320939 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:18.320801 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-config-volume\") pod \"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40\" (UID: \"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40\") " Sep 11 02:55:18.320939 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:18.320838 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-alertmanager-trusted-ca-bundle\") pod \"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40\" (UID: \"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40\") " Sep 11 02:55:18.320939 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:18.320880 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-secret-alertmanager-kube-rbac-proxy-web\") pod \"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40\" (UID: \"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40\") " Sep 11 02:55:18.320939 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:18.320907 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-alertmanager-main-db\") pod \"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40\" (UID: \"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40\") " Sep 11 02:55:18.321254 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:18.321225 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40" (UID: "dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 11 02:55:18.321340 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:18.321278 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40" (UID: "dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 02:55:18.321340 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:18.321330 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-config-out\") pod \"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40\" (UID: \"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40\") " Sep 11 02:55:18.321443 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:18.321368 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-metrics-client-ca\") pod \"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40\" (UID: \"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40\") " Sep 11 02:55:18.321443 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:18.321393 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-cluster-tls-config\") pod \"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40\" (UID: \"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40\") " Sep 11 02:55:18.321744 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:18.321450 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8wmpk\" (UniqueName: \"kubernetes.io/projected/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-kube-api-access-8wmpk\") pod \"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40\" (UID: \"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40\") " Sep 11 02:55:18.321744 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:18.321674 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-secret-alertmanager-kube-rbac-proxy\") pod \"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40\" (UID: \"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40\") " Sep 11 02:55:18.321744 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:18.321729 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-tls-assets\") pod \"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40\" (UID: \"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40\") " Sep 11 02:55:18.321998 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:18.321978 2580 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-138-210.ec2.internal\" DevicePath \"\"" Sep 11 02:55:18.322075 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:18.322005 2580 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-alertmanager-main-db\") on node \"ip-10-0-138-210.ec2.internal\" DevicePath \"\"" Sep 11 02:55:18.323120 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:18.323089 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40" (UID: "dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 02:55:18.324465 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:18.324435 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-config-volume" (OuterVolumeSpecName: "config-volume") pod "dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40" (UID: "dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 02:55:18.325040 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:18.325000 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40" (UID: "dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 02:55:18.325265 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:18.325227 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40" (UID: "dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 02:55:18.325743 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:18.325714 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40" (UID: "dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 02:55:18.325836 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:18.325752 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40" (UID: "dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 02:55:18.326424 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:18.326391 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40" (UID: "dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 02:55:18.326564 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:18.326541 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-config-out" (OuterVolumeSpecName: "config-out") pod "dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40" (UID: "dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 11 02:55:18.326892 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:18.326870 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-kube-api-access-8wmpk" (OuterVolumeSpecName: "kube-api-access-8wmpk") pod "dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40" (UID: "dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40"). InnerVolumeSpecName "kube-api-access-8wmpk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 02:55:18.330461 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:18.330434 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40" (UID: "dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 02:55:18.335646 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:18.335537 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-web-config" (OuterVolumeSpecName: "web-config") pod "dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40" (UID: "dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 02:55:18.423431 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:18.423398 2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-138-210.ec2.internal\" DevicePath \"\"" Sep 11 02:55:18.423431 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:18.423427 2580 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-config-out\") on node \"ip-10-0-138-210.ec2.internal\" DevicePath \"\"" Sep 11 02:55:18.423615 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:18.423440 2580 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-metrics-client-ca\") on node \"ip-10-0-138-210.ec2.internal\" DevicePath \"\"" Sep 11 02:55:18.423615 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:18.423454 2580 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-cluster-tls-config\") on node \"ip-10-0-138-210.ec2.internal\" DevicePath \"\"" Sep 11 02:55:18.423615 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:18.423466 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8wmpk\" (UniqueName: \"kubernetes.io/projected/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-kube-api-access-8wmpk\") on node \"ip-10-0-138-210.ec2.internal\" DevicePath \"\"" Sep 11 02:55:18.423615 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:18.423480 2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-138-210.ec2.internal\" DevicePath \"\"" Sep 11 02:55:18.423615 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:18.423494 2580 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-tls-assets\") on node \"ip-10-0-138-210.ec2.internal\" DevicePath \"\"" Sep 11 02:55:18.423615 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:18.423508 2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-138-210.ec2.internal\" DevicePath \"\"" Sep 11 02:55:18.423615 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:18.423522 2580 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-web-config\") on node \"ip-10-0-138-210.ec2.internal\" DevicePath \"\"" Sep 11 02:55:18.423615 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:18.423536 2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-secret-alertmanager-main-tls\") on node \"ip-10-0-138-210.ec2.internal\" DevicePath \"\"" Sep 11 02:55:18.423615 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:18.423550 2580 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40-config-volume\") on node \"ip-10-0-138-210.ec2.internal\" DevicePath \"\"" Sep 11 02:55:19.036110 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.036078 2580 generic.go:356] "Generic (PLEG): container finished" podID="dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40" containerID="a5fa9de78ceb7e1f358e6b74d1f47e6ef2767fc5122a6504d59df540995a43a8" exitCode=0 Sep 11 02:55:19.036486 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.036158 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40","Type":"ContainerDied","Data":"a5fa9de78ceb7e1f358e6b74d1f47e6ef2767fc5122a6504d59df540995a43a8"} Sep 11 02:55:19.036486 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.036223 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40","Type":"ContainerDied","Data":"10b75a05d29f1ed0e34535bce23b23d3027da88e101ee3566184a0059ae02299"} Sep 11 02:55:19.036486 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.036168 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:55:19.036486 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.036258 2580 scope.go:117] "RemoveContainer" containerID="80870e8e5893f543a8ae0f2e52495407207cad9cee201ea4fe5968550f4cc32a" Sep 11 02:55:19.044576 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.044561 2580 scope.go:117] "RemoveContainer" containerID="1a16615fd622e1743294a274eeb7c5bb4fa0d04966ff6bb12fbf9e990d4fd4d7" Sep 11 02:55:19.051105 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.051091 2580 scope.go:117] "RemoveContainer" containerID="bf8a075dda349db2e0511e60d49f1d6a7cdf9571e793518d14cc90ec319025d4" Sep 11 02:55:19.057515 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.057498 2580 scope.go:117] "RemoveContainer" containerID="a5fa9de78ceb7e1f358e6b74d1f47e6ef2767fc5122a6504d59df540995a43a8" Sep 11 02:55:19.061953 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.061930 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 11 02:55:19.065363 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.065346 2580 scope.go:117] "RemoveContainer" containerID="58f601bb91b342ee0a1b8f57603fec7bad8fd147c5b0685f6db334fe4dea3a7a" Sep 11 02:55:19.066057 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.066039 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 11 02:55:19.071957 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.071941 2580 scope.go:117] "RemoveContainer" containerID="9e7b509a5c35a4e4340dfffa45cf9a3fa907538402e590662cee50dcd5dbbae8" Sep 11 02:55:19.078583 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.078565 2580 scope.go:117] "RemoveContainer" containerID="b8daf357e399bb422124f36890a9baa2b25f888c2e1935a14408a3f672f07be9" Sep 11 02:55:19.085368 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.085348 2580 scope.go:117] "RemoveContainer" containerID="80870e8e5893f543a8ae0f2e52495407207cad9cee201ea4fe5968550f4cc32a" Sep 11 02:55:19.085675 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:55:19.085655 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80870e8e5893f543a8ae0f2e52495407207cad9cee201ea4fe5968550f4cc32a\": container with ID starting with 80870e8e5893f543a8ae0f2e52495407207cad9cee201ea4fe5968550f4cc32a not found: ID does not exist" containerID="80870e8e5893f543a8ae0f2e52495407207cad9cee201ea4fe5968550f4cc32a" Sep 11 02:55:19.085729 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.085683 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80870e8e5893f543a8ae0f2e52495407207cad9cee201ea4fe5968550f4cc32a"} err="failed to get container status \"80870e8e5893f543a8ae0f2e52495407207cad9cee201ea4fe5968550f4cc32a\": rpc error: code = NotFound desc = could not find container \"80870e8e5893f543a8ae0f2e52495407207cad9cee201ea4fe5968550f4cc32a\": container with ID starting with 80870e8e5893f543a8ae0f2e52495407207cad9cee201ea4fe5968550f4cc32a not found: ID does not exist" Sep 11 02:55:19.085729 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.085701 2580 scope.go:117] "RemoveContainer" containerID="1a16615fd622e1743294a274eeb7c5bb4fa0d04966ff6bb12fbf9e990d4fd4d7" Sep 11 02:55:19.086081 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:55:19.086062 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a16615fd622e1743294a274eeb7c5bb4fa0d04966ff6bb12fbf9e990d4fd4d7\": container with ID starting with 1a16615fd622e1743294a274eeb7c5bb4fa0d04966ff6bb12fbf9e990d4fd4d7 not found: ID does not exist" containerID="1a16615fd622e1743294a274eeb7c5bb4fa0d04966ff6bb12fbf9e990d4fd4d7" Sep 11 02:55:19.086180 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.086086 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a16615fd622e1743294a274eeb7c5bb4fa0d04966ff6bb12fbf9e990d4fd4d7"} err="failed to get container status \"1a16615fd622e1743294a274eeb7c5bb4fa0d04966ff6bb12fbf9e990d4fd4d7\": rpc error: code = NotFound desc = could not find container \"1a16615fd622e1743294a274eeb7c5bb4fa0d04966ff6bb12fbf9e990d4fd4d7\": container with ID starting with 1a16615fd622e1743294a274eeb7c5bb4fa0d04966ff6bb12fbf9e990d4fd4d7 not found: ID does not exist" Sep 11 02:55:19.086180 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.086104 2580 scope.go:117] "RemoveContainer" containerID="bf8a075dda349db2e0511e60d49f1d6a7cdf9571e793518d14cc90ec319025d4" Sep 11 02:55:19.086339 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:55:19.086325 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf8a075dda349db2e0511e60d49f1d6a7cdf9571e793518d14cc90ec319025d4\": container with ID starting with bf8a075dda349db2e0511e60d49f1d6a7cdf9571e793518d14cc90ec319025d4 not found: ID does not exist" containerID="bf8a075dda349db2e0511e60d49f1d6a7cdf9571e793518d14cc90ec319025d4" Sep 11 02:55:19.086374 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.086343 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf8a075dda349db2e0511e60d49f1d6a7cdf9571e793518d14cc90ec319025d4"} err="failed to get container status \"bf8a075dda349db2e0511e60d49f1d6a7cdf9571e793518d14cc90ec319025d4\": rpc error: code = NotFound desc = could not find container \"bf8a075dda349db2e0511e60d49f1d6a7cdf9571e793518d14cc90ec319025d4\": container with ID starting with bf8a075dda349db2e0511e60d49f1d6a7cdf9571e793518d14cc90ec319025d4 not found: ID does not exist" Sep 11 02:55:19.086374 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.086356 2580 scope.go:117] "RemoveContainer" containerID="a5fa9de78ceb7e1f358e6b74d1f47e6ef2767fc5122a6504d59df540995a43a8" Sep 11 02:55:19.086639 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:55:19.086600 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5fa9de78ceb7e1f358e6b74d1f47e6ef2767fc5122a6504d59df540995a43a8\": container with ID starting with a5fa9de78ceb7e1f358e6b74d1f47e6ef2767fc5122a6504d59df540995a43a8 not found: ID does not exist" containerID="a5fa9de78ceb7e1f358e6b74d1f47e6ef2767fc5122a6504d59df540995a43a8" Sep 11 02:55:19.086710 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.086689 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5fa9de78ceb7e1f358e6b74d1f47e6ef2767fc5122a6504d59df540995a43a8"} err="failed to get container status \"a5fa9de78ceb7e1f358e6b74d1f47e6ef2767fc5122a6504d59df540995a43a8\": rpc error: code = NotFound desc = could not find container \"a5fa9de78ceb7e1f358e6b74d1f47e6ef2767fc5122a6504d59df540995a43a8\": container with ID starting with a5fa9de78ceb7e1f358e6b74d1f47e6ef2767fc5122a6504d59df540995a43a8 not found: ID does not exist" Sep 11 02:55:19.086751 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.086715 2580 scope.go:117] "RemoveContainer" containerID="58f601bb91b342ee0a1b8f57603fec7bad8fd147c5b0685f6db334fe4dea3a7a" Sep 11 02:55:19.086993 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:55:19.086978 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58f601bb91b342ee0a1b8f57603fec7bad8fd147c5b0685f6db334fe4dea3a7a\": container with ID starting with 58f601bb91b342ee0a1b8f57603fec7bad8fd147c5b0685f6db334fe4dea3a7a not found: ID does not exist" containerID="58f601bb91b342ee0a1b8f57603fec7bad8fd147c5b0685f6db334fe4dea3a7a" Sep 11 02:55:19.087044 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.086997 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58f601bb91b342ee0a1b8f57603fec7bad8fd147c5b0685f6db334fe4dea3a7a"} err="failed to get container status \"58f601bb91b342ee0a1b8f57603fec7bad8fd147c5b0685f6db334fe4dea3a7a\": rpc error: code = NotFound desc = could not find container \"58f601bb91b342ee0a1b8f57603fec7bad8fd147c5b0685f6db334fe4dea3a7a\": container with ID starting with 58f601bb91b342ee0a1b8f57603fec7bad8fd147c5b0685f6db334fe4dea3a7a not found: ID does not exist" Sep 11 02:55:19.087044 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.087011 2580 scope.go:117] "RemoveContainer" containerID="9e7b509a5c35a4e4340dfffa45cf9a3fa907538402e590662cee50dcd5dbbae8" Sep 11 02:55:19.087271 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:55:19.087253 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e7b509a5c35a4e4340dfffa45cf9a3fa907538402e590662cee50dcd5dbbae8\": container with ID starting with 9e7b509a5c35a4e4340dfffa45cf9a3fa907538402e590662cee50dcd5dbbae8 not found: ID does not exist" containerID="9e7b509a5c35a4e4340dfffa45cf9a3fa907538402e590662cee50dcd5dbbae8" Sep 11 02:55:19.087338 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.087279 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e7b509a5c35a4e4340dfffa45cf9a3fa907538402e590662cee50dcd5dbbae8"} err="failed to get container status \"9e7b509a5c35a4e4340dfffa45cf9a3fa907538402e590662cee50dcd5dbbae8\": rpc error: code = NotFound desc = could not find container \"9e7b509a5c35a4e4340dfffa45cf9a3fa907538402e590662cee50dcd5dbbae8\": container with ID starting with 9e7b509a5c35a4e4340dfffa45cf9a3fa907538402e590662cee50dcd5dbbae8 not found: ID does not exist" Sep 11 02:55:19.087338 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.087301 2580 scope.go:117] "RemoveContainer" containerID="b8daf357e399bb422124f36890a9baa2b25f888c2e1935a14408a3f672f07be9" Sep 11 02:55:19.087542 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:55:19.087524 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8daf357e399bb422124f36890a9baa2b25f888c2e1935a14408a3f672f07be9\": container with ID starting with b8daf357e399bb422124f36890a9baa2b25f888c2e1935a14408a3f672f07be9 not found: ID does not exist" containerID="b8daf357e399bb422124f36890a9baa2b25f888c2e1935a14408a3f672f07be9" Sep 11 02:55:19.087584 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.087546 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8daf357e399bb422124f36890a9baa2b25f888c2e1935a14408a3f672f07be9"} err="failed to get container status \"b8daf357e399bb422124f36890a9baa2b25f888c2e1935a14408a3f672f07be9\": rpc error: code = NotFound desc = could not find container \"b8daf357e399bb422124f36890a9baa2b25f888c2e1935a14408a3f672f07be9\": container with ID starting with b8daf357e399bb422124f36890a9baa2b25f888c2e1935a14408a3f672f07be9 not found: ID does not exist" Sep 11 02:55:19.095195 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.095166 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 11 02:55:19.095454 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.095439 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55922251-fd40-4f6b-a4d4-97ba03fbe579" containerName="console" Sep 11 02:55:19.095529 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.095457 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="55922251-fd40-4f6b-a4d4-97ba03fbe579" containerName="console" Sep 11 02:55:19.095529 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.095469 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40" containerName="config-reloader" Sep 11 02:55:19.095529 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.095478 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40" containerName="config-reloader" Sep 11 02:55:19.095529 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.095496 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40" containerName="init-config-reloader" Sep 11 02:55:19.095529 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.095505 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40" containerName="init-config-reloader" Sep 11 02:55:19.095529 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.095516 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40" containerName="kube-rbac-proxy-web" Sep 11 02:55:19.095529 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.095524 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40" containerName="kube-rbac-proxy-web" Sep 11 02:55:19.095873 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.095535 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40" containerName="prom-label-proxy" Sep 11 02:55:19.095873 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.095543 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40" containerName="prom-label-proxy" Sep 11 02:55:19.095873 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.095564 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fd469b7-01d6-4078-bd48-46013095bd0d" containerName="console" Sep 11 02:55:19.095873 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.095572 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fd469b7-01d6-4078-bd48-46013095bd0d" containerName="console" Sep 11 02:55:19.095873 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.095587 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40" containerName="alertmanager" Sep 11 02:55:19.095873 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.095595 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40" containerName="alertmanager" Sep 11 02:55:19.095873 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.095605 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40" containerName="kube-rbac-proxy" Sep 11 02:55:19.095873 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.095613 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40" containerName="kube-rbac-proxy" Sep 11 02:55:19.095873 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.095646 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40" containerName="kube-rbac-proxy-metric" Sep 11 02:55:19.095873 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.095653 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40" containerName="kube-rbac-proxy-metric" Sep 11 02:55:19.095873 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.095720 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40" containerName="kube-rbac-proxy-web" Sep 11 02:55:19.095873 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.095731 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40" containerName="prom-label-proxy" Sep 11 02:55:19.095873 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.095740 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40" containerName="alertmanager" Sep 11 02:55:19.095873 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.095749 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40" containerName="config-reloader" Sep 11 02:55:19.095873 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.095756 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40" containerName="kube-rbac-proxy" Sep 11 02:55:19.095873 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.095763 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="55922251-fd40-4f6b-a4d4-97ba03fbe579" containerName="console" Sep 11 02:55:19.095873 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.095770 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fd469b7-01d6-4078-bd48-46013095bd0d" containerName="console" Sep 11 02:55:19.095873 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.095778 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40" containerName="kube-rbac-proxy-metric" Sep 11 02:55:19.099172 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.099155 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:55:19.102013 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.101994 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 11 02:55:19.102013 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.102013 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 11 02:55:19.102177 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.102013 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 11 02:55:19.102177 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.102016 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 11 02:55:19.102355 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.102342 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 11 02:55:19.102438 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.102422 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 11 02:55:19.102492 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.102422 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 11 02:55:19.102658 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.102642 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 11 02:55:19.102894 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.102880 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-wtwv2\"" Sep 11 02:55:19.107585 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.107565 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 11 02:55:19.117218 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.117200 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 11 02:55:19.229442 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.229416 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/32057561-68b9-4f96-b477-bb8f988a4dfa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"32057561-68b9-4f96-b477-bb8f988a4dfa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:55:19.229442 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.229442 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxmb4\" (UniqueName: \"kubernetes.io/projected/32057561-68b9-4f96-b477-bb8f988a4dfa-kube-api-access-cxmb4\") pod \"alertmanager-main-0\" (UID: \"32057561-68b9-4f96-b477-bb8f988a4dfa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:55:19.229611 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.229462 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/32057561-68b9-4f96-b477-bb8f988a4dfa-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"32057561-68b9-4f96-b477-bb8f988a4dfa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:55:19.229611 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.229479 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32057561-68b9-4f96-b477-bb8f988a4dfa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"32057561-68b9-4f96-b477-bb8f988a4dfa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:55:19.229611 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.229503 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/32057561-68b9-4f96-b477-bb8f988a4dfa-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"32057561-68b9-4f96-b477-bb8f988a4dfa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:55:19.229611 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.229520 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/32057561-68b9-4f96-b477-bb8f988a4dfa-tls-assets\") pod \"alertmanager-main-0\" (UID: \"32057561-68b9-4f96-b477-bb8f988a4dfa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:55:19.229611 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.229537 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/32057561-68b9-4f96-b477-bb8f988a4dfa-config-out\") pod \"alertmanager-main-0\" (UID: \"32057561-68b9-4f96-b477-bb8f988a4dfa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:55:19.229611 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.229550 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/32057561-68b9-4f96-b477-bb8f988a4dfa-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"32057561-68b9-4f96-b477-bb8f988a4dfa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:55:19.229611 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.229572 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/32057561-68b9-4f96-b477-bb8f988a4dfa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"32057561-68b9-4f96-b477-bb8f988a4dfa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:55:19.229611 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.229588 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/32057561-68b9-4f96-b477-bb8f988a4dfa-config-volume\") pod \"alertmanager-main-0\" (UID: \"32057561-68b9-4f96-b477-bb8f988a4dfa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:55:19.229963 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.229648 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/32057561-68b9-4f96-b477-bb8f988a4dfa-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"32057561-68b9-4f96-b477-bb8f988a4dfa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:55:19.229963 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.229742 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/32057561-68b9-4f96-b477-bb8f988a4dfa-web-config\") pod \"alertmanager-main-0\" (UID: \"32057561-68b9-4f96-b477-bb8f988a4dfa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:55:19.229963 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.229792 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/32057561-68b9-4f96-b477-bb8f988a4dfa-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"32057561-68b9-4f96-b477-bb8f988a4dfa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:55:19.330865 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.330808 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/32057561-68b9-4f96-b477-bb8f988a4dfa-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"32057561-68b9-4f96-b477-bb8f988a4dfa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:55:19.330865 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.330841 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/32057561-68b9-4f96-b477-bb8f988a4dfa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"32057561-68b9-4f96-b477-bb8f988a4dfa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:55:19.330865 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.330857 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxmb4\" (UniqueName: \"kubernetes.io/projected/32057561-68b9-4f96-b477-bb8f988a4dfa-kube-api-access-cxmb4\") pod \"alertmanager-main-0\" (UID: \"32057561-68b9-4f96-b477-bb8f988a4dfa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:55:19.331054 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.330874 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/32057561-68b9-4f96-b477-bb8f988a4dfa-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"32057561-68b9-4f96-b477-bb8f988a4dfa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:55:19.331054 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.330892 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32057561-68b9-4f96-b477-bb8f988a4dfa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"32057561-68b9-4f96-b477-bb8f988a4dfa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:55:19.331054 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.330923 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/32057561-68b9-4f96-b477-bb8f988a4dfa-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"32057561-68b9-4f96-b477-bb8f988a4dfa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:55:19.331054 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.330949 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/32057561-68b9-4f96-b477-bb8f988a4dfa-tls-assets\") pod \"alertmanager-main-0\" (UID: \"32057561-68b9-4f96-b477-bb8f988a4dfa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:55:19.331054 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.330971 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/32057561-68b9-4f96-b477-bb8f988a4dfa-config-out\") pod \"alertmanager-main-0\" (UID: \"32057561-68b9-4f96-b477-bb8f988a4dfa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:55:19.331381 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.331321 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/32057561-68b9-4f96-b477-bb8f988a4dfa-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"32057561-68b9-4f96-b477-bb8f988a4dfa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:55:19.331381 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.331362 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/32057561-68b9-4f96-b477-bb8f988a4dfa-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"32057561-68b9-4f96-b477-bb8f988a4dfa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:55:19.331549 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.331412 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/32057561-68b9-4f96-b477-bb8f988a4dfa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"32057561-68b9-4f96-b477-bb8f988a4dfa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:55:19.331549 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.331445 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/32057561-68b9-4f96-b477-bb8f988a4dfa-config-volume\") pod \"alertmanager-main-0\" (UID: \"32057561-68b9-4f96-b477-bb8f988a4dfa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:55:19.331549 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.331469 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/32057561-68b9-4f96-b477-bb8f988a4dfa-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"32057561-68b9-4f96-b477-bb8f988a4dfa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:55:19.331549 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.331512 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/32057561-68b9-4f96-b477-bb8f988a4dfa-web-config\") pod \"alertmanager-main-0\" (UID: \"32057561-68b9-4f96-b477-bb8f988a4dfa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:55:19.331933 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.331652 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/32057561-68b9-4f96-b477-bb8f988a4dfa-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"32057561-68b9-4f96-b477-bb8f988a4dfa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:55:19.332361 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.331983 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32057561-68b9-4f96-b477-bb8f988a4dfa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"32057561-68b9-4f96-b477-bb8f988a4dfa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:55:19.334372 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.334224 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/32057561-68b9-4f96-b477-bb8f988a4dfa-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"32057561-68b9-4f96-b477-bb8f988a4dfa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:55:19.334372 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.334232 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/32057561-68b9-4f96-b477-bb8f988a4dfa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"32057561-68b9-4f96-b477-bb8f988a4dfa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:55:19.334372 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.334259 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/32057561-68b9-4f96-b477-bb8f988a4dfa-tls-assets\") pod \"alertmanager-main-0\" (UID: \"32057561-68b9-4f96-b477-bb8f988a4dfa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:55:19.334694 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.334672 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/32057561-68b9-4f96-b477-bb8f988a4dfa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"32057561-68b9-4f96-b477-bb8f988a4dfa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:55:19.334763 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.334701 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/32057561-68b9-4f96-b477-bb8f988a4dfa-config-out\") pod \"alertmanager-main-0\" (UID: \"32057561-68b9-4f96-b477-bb8f988a4dfa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:55:19.334890 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.334871 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/32057561-68b9-4f96-b477-bb8f988a4dfa-web-config\") pod \"alertmanager-main-0\" (UID: \"32057561-68b9-4f96-b477-bb8f988a4dfa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:55:19.334924 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.334889 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/32057561-68b9-4f96-b477-bb8f988a4dfa-config-volume\") pod \"alertmanager-main-0\" (UID: \"32057561-68b9-4f96-b477-bb8f988a4dfa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:55:19.335149 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.335128 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/32057561-68b9-4f96-b477-bb8f988a4dfa-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"32057561-68b9-4f96-b477-bb8f988a4dfa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:55:19.336272 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.336249 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/32057561-68b9-4f96-b477-bb8f988a4dfa-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"32057561-68b9-4f96-b477-bb8f988a4dfa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:55:19.339340 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.339322 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxmb4\" (UniqueName: \"kubernetes.io/projected/32057561-68b9-4f96-b477-bb8f988a4dfa-kube-api-access-cxmb4\") pod \"alertmanager-main-0\" (UID: \"32057561-68b9-4f96-b477-bb8f988a4dfa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:55:19.341895 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.341873 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40" path="/var/lib/kubelet/pods/dc43f2dd-45d2-4f5e-a50e-01e3ccdf5a40/volumes" Sep 11 02:55:19.409409 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.409386 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 11 02:55:19.684937 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:19.684910 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 11 02:55:19.687426 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:55:19.687403 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32057561_68b9_4f96_b477_bb8f988a4dfa.slice/crio-3efebb9854a39e7c8af474351e12f257f4f027a1d71345cfd79c1395a067377d WatchSource:0}: Error finding container 3efebb9854a39e7c8af474351e12f257f4f027a1d71345cfd79c1395a067377d: Status 404 returned error can't find the container with id 3efebb9854a39e7c8af474351e12f257f4f027a1d71345cfd79c1395a067377d Sep 11 02:55:20.040572 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:20.040534 2580 generic.go:356] "Generic (PLEG): container finished" podID="32057561-68b9-4f96-b477-bb8f988a4dfa" containerID="898ca4bb2f466884e6dfc038802746d768ab4e0862319a846978a791270a1ba8" exitCode=0 Sep 11 02:55:20.041022 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:20.040636 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"32057561-68b9-4f96-b477-bb8f988a4dfa","Type":"ContainerDied","Data":"898ca4bb2f466884e6dfc038802746d768ab4e0862319a846978a791270a1ba8"} Sep 11 02:55:20.041022 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:20.040738 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"32057561-68b9-4f96-b477-bb8f988a4dfa","Type":"ContainerStarted","Data":"3efebb9854a39e7c8af474351e12f257f4f027a1d71345cfd79c1395a067377d"} Sep 11 02:55:20.714937 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:20.714861 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 11 02:55:20.715166 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:20.715132 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f6076f23-d106-459a-a958-d91759dac571" containerName="kube-rbac-proxy" containerID="cri-o://15f3f98aea1c20c8e5aef483f3e8770865bf4810dadd711e51e191faf101fd52" gracePeriod=600 Sep 11 02:55:20.715301 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:20.715165 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f6076f23-d106-459a-a958-d91759dac571" containerName="thanos-sidecar" containerID="cri-o://217bc9207afe05834dfd74be804e49af827508b9ab100c728b66655a740d81fe" gracePeriod=600 Sep 11 02:55:20.715301 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:20.715193 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f6076f23-d106-459a-a958-d91759dac571" containerName="kube-rbac-proxy-thanos" containerID="cri-o://4d79bbd8be34f97a432c7869e589cd92f6cd3d0beeee629cf72ebe6029758836" gracePeriod=600 Sep 11 02:55:20.715301 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:20.715165 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f6076f23-d106-459a-a958-d91759dac571" containerName="config-reloader" containerID="cri-o://5a1921ec26c24a4bfd1fb9ee02c7ab8b0df2e8c7862ba6f80b782485bd30b02c" gracePeriod=600 Sep 11 02:55:20.715301 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:20.715217 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f6076f23-d106-459a-a958-d91759dac571" containerName="kube-rbac-proxy-web" containerID="cri-o://707f74d6e4ee31ebb77fad492b465e7848512f6b63162a0da37d5bae54b6d990" gracePeriod=600 Sep 11 02:55:20.715301 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:20.715129 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f6076f23-d106-459a-a958-d91759dac571" containerName="prometheus" containerID="cri-o://56b6b3277bca448878cd2ac8d963f12afa8a585e31b2635036f5592422a04de2" gracePeriod=600 Sep 11 02:55:20.958826 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:20.958804 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:55:21.043309 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.043283 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f6076f23-d106-459a-a958-d91759dac571-tls-assets\") pod \"f6076f23-d106-459a-a958-d91759dac571\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " Sep 11 02:55:21.043788 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.043319 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f6076f23-d106-459a-a958-d91759dac571-secret-grpc-tls\") pod \"f6076f23-d106-459a-a958-d91759dac571\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " Sep 11 02:55:21.043788 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.043338 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f6076f23-d106-459a-a958-d91759dac571-configmap-metrics-client-ca\") pod \"f6076f23-d106-459a-a958-d91759dac571\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " Sep 11 02:55:21.043788 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.043358 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f6076f23-d106-459a-a958-d91759dac571-config\") pod \"f6076f23-d106-459a-a958-d91759dac571\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " Sep 11 02:55:21.043788 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.043376 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p2j4c\" (UniqueName: \"kubernetes.io/projected/f6076f23-d106-459a-a958-d91759dac571-kube-api-access-p2j4c\") pod \"f6076f23-d106-459a-a958-d91759dac571\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " Sep 11 02:55:21.043788 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.043400 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f6076f23-d106-459a-a958-d91759dac571-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"f6076f23-d106-459a-a958-d91759dac571\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " Sep 11 02:55:21.043788 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.043435 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f6076f23-d106-459a-a958-d91759dac571-prometheus-k8s-rulefiles-2\") pod \"f6076f23-d106-459a-a958-d91759dac571\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " Sep 11 02:55:21.043788 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.043459 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f6076f23-d106-459a-a958-d91759dac571-prometheus-k8s-rulefiles-1\") pod \"f6076f23-d106-459a-a958-d91759dac571\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " Sep 11 02:55:21.043788 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.043485 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6076f23-d106-459a-a958-d91759dac571-prometheus-trusted-ca-bundle\") pod \"f6076f23-d106-459a-a958-d91759dac571\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " Sep 11 02:55:21.043788 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.043516 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6076f23-d106-459a-a958-d91759dac571-configmap-kubelet-serving-ca-bundle\") pod \"f6076f23-d106-459a-a958-d91759dac571\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " Sep 11 02:55:21.043788 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.043745 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6076f23-d106-459a-a958-d91759dac571-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "f6076f23-d106-459a-a958-d91759dac571" (UID: "f6076f23-d106-459a-a958-d91759dac571"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 02:55:21.044458 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.043853 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f6076f23-d106-459a-a958-d91759dac571-web-config\") pod \"f6076f23-d106-459a-a958-d91759dac571\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " Sep 11 02:55:21.044458 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.043902 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f6076f23-d106-459a-a958-d91759dac571-secret-kube-rbac-proxy\") pod \"f6076f23-d106-459a-a958-d91759dac571\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " Sep 11 02:55:21.044458 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.043936 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f6076f23-d106-459a-a958-d91759dac571-thanos-prometheus-http-client-file\") pod \"f6076f23-d106-459a-a958-d91759dac571\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " Sep 11 02:55:21.044458 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.043964 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f6076f23-d106-459a-a958-d91759dac571-prometheus-k8s-rulefiles-0\") pod \"f6076f23-d106-459a-a958-d91759dac571\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " Sep 11 02:55:21.044458 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.044003 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f6076f23-d106-459a-a958-d91759dac571-secret-prometheus-k8s-tls\") pod \"f6076f23-d106-459a-a958-d91759dac571\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " Sep 11 02:55:21.044458 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.044036 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f6076f23-d106-459a-a958-d91759dac571-prometheus-k8s-db\") pod \"f6076f23-d106-459a-a958-d91759dac571\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " Sep 11 02:55:21.044458 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.044062 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6076f23-d106-459a-a958-d91759dac571-configmap-serving-certs-ca-bundle\") pod \"f6076f23-d106-459a-a958-d91759dac571\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " Sep 11 02:55:21.044458 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.044062 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6076f23-d106-459a-a958-d91759dac571-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "f6076f23-d106-459a-a958-d91759dac571" (UID: "f6076f23-d106-459a-a958-d91759dac571"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 02:55:21.044458 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.044104 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f6076f23-d106-459a-a958-d91759dac571-secret-metrics-client-certs\") pod \"f6076f23-d106-459a-a958-d91759dac571\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " Sep 11 02:55:21.044458 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.044133 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f6076f23-d106-459a-a958-d91759dac571-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"f6076f23-d106-459a-a958-d91759dac571\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " Sep 11 02:55:21.044458 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.044190 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f6076f23-d106-459a-a958-d91759dac571-config-out\") pod \"f6076f23-d106-459a-a958-d91759dac571\" (UID: \"f6076f23-d106-459a-a958-d91759dac571\") " Sep 11 02:55:21.044458 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.044373 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6076f23-d106-459a-a958-d91759dac571-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "f6076f23-d106-459a-a958-d91759dac571" (UID: "f6076f23-d106-459a-a958-d91759dac571"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 02:55:21.044458 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.044452 2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f6076f23-d106-459a-a958-d91759dac571-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-138-210.ec2.internal\" DevicePath \"\"" Sep 11 02:55:21.044458 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.044469 2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6076f23-d106-459a-a958-d91759dac571-prometheus-trusted-ca-bundle\") on node \"ip-10-0-138-210.ec2.internal\" DevicePath \"\"" Sep 11 02:55:21.045166 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.044483 2580 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f6076f23-d106-459a-a958-d91759dac571-configmap-metrics-client-ca\") on node \"ip-10-0-138-210.ec2.internal\" DevicePath \"\"" Sep 11 02:55:21.045734 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.045705 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6076f23-d106-459a-a958-d91759dac571-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "f6076f23-d106-459a-a958-d91759dac571" (UID: "f6076f23-d106-459a-a958-d91759dac571"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 02:55:21.046187 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.046162 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6076f23-d106-459a-a958-d91759dac571-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "f6076f23-d106-459a-a958-d91759dac571" (UID: "f6076f23-d106-459a-a958-d91759dac571"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 02:55:21.047026 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.046910 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6076f23-d106-459a-a958-d91759dac571-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "f6076f23-d106-459a-a958-d91759dac571" (UID: "f6076f23-d106-459a-a958-d91759dac571"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 02:55:21.047127 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.047030 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6076f23-d106-459a-a958-d91759dac571-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "f6076f23-d106-459a-a958-d91759dac571" (UID: "f6076f23-d106-459a-a958-d91759dac571"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 02:55:21.047194 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.047158 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6076f23-d106-459a-a958-d91759dac571-kube-api-access-p2j4c" (OuterVolumeSpecName: "kube-api-access-p2j4c") pod "f6076f23-d106-459a-a958-d91759dac571" (UID: "f6076f23-d106-459a-a958-d91759dac571"). InnerVolumeSpecName "kube-api-access-p2j4c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 02:55:21.047258 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.047185 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6076f23-d106-459a-a958-d91759dac571-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "f6076f23-d106-459a-a958-d91759dac571" (UID: "f6076f23-d106-459a-a958-d91759dac571"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 02:55:21.047358 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.047338 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6076f23-d106-459a-a958-d91759dac571-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "f6076f23-d106-459a-a958-d91759dac571" (UID: "f6076f23-d106-459a-a958-d91759dac571"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 02:55:21.047797 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.047724 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6076f23-d106-459a-a958-d91759dac571-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "f6076f23-d106-459a-a958-d91759dac571" (UID: "f6076f23-d106-459a-a958-d91759dac571"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 11 02:55:21.048719 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.048668 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6076f23-d106-459a-a958-d91759dac571-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "f6076f23-d106-459a-a958-d91759dac571" (UID: "f6076f23-d106-459a-a958-d91759dac571"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 02:55:21.050038 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.050011 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6076f23-d106-459a-a958-d91759dac571-config" (OuterVolumeSpecName: "config") pod "f6076f23-d106-459a-a958-d91759dac571" (UID: "f6076f23-d106-459a-a958-d91759dac571"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 02:55:21.050145 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.050046 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6076f23-d106-459a-a958-d91759dac571-config-out" (OuterVolumeSpecName: "config-out") pod "f6076f23-d106-459a-a958-d91759dac571" (UID: "f6076f23-d106-459a-a958-d91759dac571"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 11 02:55:21.050226 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.050201 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6076f23-d106-459a-a958-d91759dac571-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "f6076f23-d106-459a-a958-d91759dac571" (UID: "f6076f23-d106-459a-a958-d91759dac571"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 02:55:21.050539 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.050500 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6076f23-d106-459a-a958-d91759dac571-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "f6076f23-d106-459a-a958-d91759dac571" (UID: "f6076f23-d106-459a-a958-d91759dac571"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 02:55:21.050705 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.050652 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6076f23-d106-459a-a958-d91759dac571-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "f6076f23-d106-459a-a958-d91759dac571" (UID: "f6076f23-d106-459a-a958-d91759dac571"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 02:55:21.050862 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.050750 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6076f23-d106-459a-a958-d91759dac571-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "f6076f23-d106-459a-a958-d91759dac571" (UID: "f6076f23-d106-459a-a958-d91759dac571"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 02:55:21.050936 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.050917 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6076f23-d106-459a-a958-d91759dac571-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "f6076f23-d106-459a-a958-d91759dac571" (UID: "f6076f23-d106-459a-a958-d91759dac571"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 02:55:21.053014 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.052986 2580 generic.go:356] "Generic (PLEG): container finished" podID="f6076f23-d106-459a-a958-d91759dac571" containerID="4d79bbd8be34f97a432c7869e589cd92f6cd3d0beeee629cf72ebe6029758836" exitCode=0 Sep 11 02:55:21.053014 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.053009 2580 generic.go:356] "Generic (PLEG): container finished" podID="f6076f23-d106-459a-a958-d91759dac571" containerID="15f3f98aea1c20c8e5aef483f3e8770865bf4810dadd711e51e191faf101fd52" exitCode=0 Sep 11 02:55:21.053014 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.053016 2580 generic.go:356] "Generic (PLEG): container finished" podID="f6076f23-d106-459a-a958-d91759dac571" containerID="707f74d6e4ee31ebb77fad492b465e7848512f6b63162a0da37d5bae54b6d990" exitCode=0 Sep 11 02:55:21.053217 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.053022 2580 generic.go:356] "Generic (PLEG): container finished" podID="f6076f23-d106-459a-a958-d91759dac571" containerID="217bc9207afe05834dfd74be804e49af827508b9ab100c728b66655a740d81fe" exitCode=0 Sep 11 02:55:21.053217 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.053027 2580 generic.go:356] "Generic (PLEG): container finished" podID="f6076f23-d106-459a-a958-d91759dac571" containerID="5a1921ec26c24a4bfd1fb9ee02c7ab8b0df2e8c7862ba6f80b782485bd30b02c" exitCode=0 Sep 11 02:55:21.053217 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.053032 2580 generic.go:356] "Generic (PLEG): container finished" podID="f6076f23-d106-459a-a958-d91759dac571" containerID="56b6b3277bca448878cd2ac8d963f12afa8a585e31b2635036f5592422a04de2" exitCode=0 Sep 11 02:55:21.053217 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.053082 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:55:21.053217 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.053081 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f6076f23-d106-459a-a958-d91759dac571","Type":"ContainerDied","Data":"4d79bbd8be34f97a432c7869e589cd92f6cd3d0beeee629cf72ebe6029758836"} Sep 11 02:55:21.053217 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.053164 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f6076f23-d106-459a-a958-d91759dac571","Type":"ContainerDied","Data":"15f3f98aea1c20c8e5aef483f3e8770865bf4810dadd711e51e191faf101fd52"} Sep 11 02:55:21.053217 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.053207 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f6076f23-d106-459a-a958-d91759dac571","Type":"ContainerDied","Data":"707f74d6e4ee31ebb77fad492b465e7848512f6b63162a0da37d5bae54b6d990"} Sep 11 02:55:21.053521 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.053251 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f6076f23-d106-459a-a958-d91759dac571","Type":"ContainerDied","Data":"217bc9207afe05834dfd74be804e49af827508b9ab100c728b66655a740d81fe"} Sep 11 02:55:21.053521 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.053291 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f6076f23-d106-459a-a958-d91759dac571","Type":"ContainerDied","Data":"5a1921ec26c24a4bfd1fb9ee02c7ab8b0df2e8c7862ba6f80b782485bd30b02c"} Sep 11 02:55:21.053521 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.053330 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f6076f23-d106-459a-a958-d91759dac571","Type":"ContainerDied","Data":"56b6b3277bca448878cd2ac8d963f12afa8a585e31b2635036f5592422a04de2"} Sep 11 02:55:21.053521 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.053370 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f6076f23-d106-459a-a958-d91759dac571","Type":"ContainerDied","Data":"daecaaf59b5fb1d3874bbb54bf1763a5ec8781bb01f8388b1d63c862a9d408e4"} Sep 11 02:55:21.053521 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.053416 2580 scope.go:117] "RemoveContainer" containerID="4d79bbd8be34f97a432c7869e589cd92f6cd3d0beeee629cf72ebe6029758836" Sep 11 02:55:21.057430 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.057403 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"32057561-68b9-4f96-b477-bb8f988a4dfa","Type":"ContainerStarted","Data":"462b91d66e2a1ed07fa7c62d4318024e631d88b42d16e471947f4c7e93f29a9d"} Sep 11 02:55:21.057530 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.057468 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"32057561-68b9-4f96-b477-bb8f988a4dfa","Type":"ContainerStarted","Data":"f51e6994f08d3f25f114b6ea69eee19d64953f9100509cb3ad042e969581c7ab"} Sep 11 02:55:21.057530 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.057497 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"32057561-68b9-4f96-b477-bb8f988a4dfa","Type":"ContainerStarted","Data":"ceeb27d1b1e3834d3eeb84e26458a460d62e1f5a2253bb50395b52e9b11afed7"} Sep 11 02:55:21.057530 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.057528 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"32057561-68b9-4f96-b477-bb8f988a4dfa","Type":"ContainerStarted","Data":"9d3ac0472a2fe89957b3d81291d022fd715a7df7bc9d9c91b211394b4c3d2674"} Sep 11 02:55:21.057696 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.057551 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"32057561-68b9-4f96-b477-bb8f988a4dfa","Type":"ContainerStarted","Data":"519d7b0dc34bf5a57ecc9c8760c9c6687a8190e28f92c3ed397d81976cc78858"} Sep 11 02:55:21.057696 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.057575 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"32057561-68b9-4f96-b477-bb8f988a4dfa","Type":"ContainerStarted","Data":"1f11a63dd65717531b191321b4e1c0fa4ba37e38fc71efe1698140a2a52fca2d"} Sep 11 02:55:21.061479 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.061463 2580 scope.go:117] "RemoveContainer" containerID="15f3f98aea1c20c8e5aef483f3e8770865bf4810dadd711e51e191faf101fd52" Sep 11 02:55:21.062326 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.062306 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6076f23-d106-459a-a958-d91759dac571-web-config" (OuterVolumeSpecName: "web-config") pod "f6076f23-d106-459a-a958-d91759dac571" (UID: "f6076f23-d106-459a-a958-d91759dac571"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 02:55:21.068293 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.068277 2580 scope.go:117] "RemoveContainer" containerID="707f74d6e4ee31ebb77fad492b465e7848512f6b63162a0da37d5bae54b6d990" Sep 11 02:55:21.074838 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.074823 2580 scope.go:117] "RemoveContainer" containerID="217bc9207afe05834dfd74be804e49af827508b9ab100c728b66655a740d81fe" Sep 11 02:55:21.081087 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.081071 2580 scope.go:117] "RemoveContainer" containerID="5a1921ec26c24a4bfd1fb9ee02c7ab8b0df2e8c7862ba6f80b782485bd30b02c" Sep 11 02:55:21.083967 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.083929 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.067961911 podStartE2EDuration="2.083914868s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.952957ms" isStatefulPod=false podCreationTimestamp="2026-09-11 02:55:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:55:21.081857137 +0000 UTC m=+146.221180325" watchObservedRunningTime="2026-09-11 02:55:21.083914868 +0000 UTC m=+146.223238422" Sep 11 02:55:21.088141 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.088124 2580 scope.go:117] "RemoveContainer" containerID="56b6b3277bca448878cd2ac8d963f12afa8a585e31b2635036f5592422a04de2" Sep 11 02:55:21.096458 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.096431 2580 scope.go:117] "RemoveContainer" containerID="82e5a8d68efecbffd3faf7eb77357655ea9655cfa9d64bfb6a80978ae08b6eaf" Sep 11 02:55:21.103568 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.103548 2580 scope.go:117] "RemoveContainer" containerID="4d79bbd8be34f97a432c7869e589cd92f6cd3d0beeee629cf72ebe6029758836" Sep 11 02:55:21.103869 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:55:21.103850 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d79bbd8be34f97a432c7869e589cd92f6cd3d0beeee629cf72ebe6029758836\": container with ID starting with 4d79bbd8be34f97a432c7869e589cd92f6cd3d0beeee629cf72ebe6029758836 not found: ID does not exist" containerID="4d79bbd8be34f97a432c7869e589cd92f6cd3d0beeee629cf72ebe6029758836" Sep 11 02:55:21.103942 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.103877 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d79bbd8be34f97a432c7869e589cd92f6cd3d0beeee629cf72ebe6029758836"} err="failed to get container status \"4d79bbd8be34f97a432c7869e589cd92f6cd3d0beeee629cf72ebe6029758836\": rpc error: code = NotFound desc = could not find container \"4d79bbd8be34f97a432c7869e589cd92f6cd3d0beeee629cf72ebe6029758836\": container with ID starting with 4d79bbd8be34f97a432c7869e589cd92f6cd3d0beeee629cf72ebe6029758836 not found: ID does not exist" Sep 11 02:55:21.103942 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.103893 2580 scope.go:117] "RemoveContainer" containerID="15f3f98aea1c20c8e5aef483f3e8770865bf4810dadd711e51e191faf101fd52" Sep 11 02:55:21.104149 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:55:21.104134 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15f3f98aea1c20c8e5aef483f3e8770865bf4810dadd711e51e191faf101fd52\": container with ID starting with 15f3f98aea1c20c8e5aef483f3e8770865bf4810dadd711e51e191faf101fd52 not found: ID does not exist" containerID="15f3f98aea1c20c8e5aef483f3e8770865bf4810dadd711e51e191faf101fd52" Sep 11 02:55:21.104193 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.104152 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15f3f98aea1c20c8e5aef483f3e8770865bf4810dadd711e51e191faf101fd52"} err="failed to get container status \"15f3f98aea1c20c8e5aef483f3e8770865bf4810dadd711e51e191faf101fd52\": rpc error: code = NotFound desc = could not find container \"15f3f98aea1c20c8e5aef483f3e8770865bf4810dadd711e51e191faf101fd52\": container with ID starting with 15f3f98aea1c20c8e5aef483f3e8770865bf4810dadd711e51e191faf101fd52 not found: ID does not exist" Sep 11 02:55:21.104193 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.104165 2580 scope.go:117] "RemoveContainer" containerID="707f74d6e4ee31ebb77fad492b465e7848512f6b63162a0da37d5bae54b6d990" Sep 11 02:55:21.104396 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:55:21.104377 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"707f74d6e4ee31ebb77fad492b465e7848512f6b63162a0da37d5bae54b6d990\": container with ID starting with 707f74d6e4ee31ebb77fad492b465e7848512f6b63162a0da37d5bae54b6d990 not found: ID does not exist" containerID="707f74d6e4ee31ebb77fad492b465e7848512f6b63162a0da37d5bae54b6d990" Sep 11 02:55:21.104501 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.104398 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"707f74d6e4ee31ebb77fad492b465e7848512f6b63162a0da37d5bae54b6d990"} err="failed to get container status \"707f74d6e4ee31ebb77fad492b465e7848512f6b63162a0da37d5bae54b6d990\": rpc error: code = NotFound desc = could not find container \"707f74d6e4ee31ebb77fad492b465e7848512f6b63162a0da37d5bae54b6d990\": container with ID starting with 707f74d6e4ee31ebb77fad492b465e7848512f6b63162a0da37d5bae54b6d990 not found: ID does not exist" Sep 11 02:55:21.104501 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.104418 2580 scope.go:117] "RemoveContainer" containerID="217bc9207afe05834dfd74be804e49af827508b9ab100c728b66655a740d81fe" Sep 11 02:55:21.104722 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:55:21.104699 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"217bc9207afe05834dfd74be804e49af827508b9ab100c728b66655a740d81fe\": container with ID starting with 217bc9207afe05834dfd74be804e49af827508b9ab100c728b66655a740d81fe not found: ID does not exist" containerID="217bc9207afe05834dfd74be804e49af827508b9ab100c728b66655a740d81fe" Sep 11 02:55:21.104759 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.104732 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"217bc9207afe05834dfd74be804e49af827508b9ab100c728b66655a740d81fe"} err="failed to get container status \"217bc9207afe05834dfd74be804e49af827508b9ab100c728b66655a740d81fe\": rpc error: code = NotFound desc = could not find container \"217bc9207afe05834dfd74be804e49af827508b9ab100c728b66655a740d81fe\": container with ID starting with 217bc9207afe05834dfd74be804e49af827508b9ab100c728b66655a740d81fe not found: ID does not exist" Sep 11 02:55:21.104809 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.104756 2580 scope.go:117] "RemoveContainer" containerID="5a1921ec26c24a4bfd1fb9ee02c7ab8b0df2e8c7862ba6f80b782485bd30b02c" Sep 11 02:55:21.105071 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:55:21.105054 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a1921ec26c24a4bfd1fb9ee02c7ab8b0df2e8c7862ba6f80b782485bd30b02c\": container with ID starting with 5a1921ec26c24a4bfd1fb9ee02c7ab8b0df2e8c7862ba6f80b782485bd30b02c not found: ID does not exist" containerID="5a1921ec26c24a4bfd1fb9ee02c7ab8b0df2e8c7862ba6f80b782485bd30b02c" Sep 11 02:55:21.105134 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.105079 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a1921ec26c24a4bfd1fb9ee02c7ab8b0df2e8c7862ba6f80b782485bd30b02c"} err="failed to get container status \"5a1921ec26c24a4bfd1fb9ee02c7ab8b0df2e8c7862ba6f80b782485bd30b02c\": rpc error: code = NotFound desc = could not find container \"5a1921ec26c24a4bfd1fb9ee02c7ab8b0df2e8c7862ba6f80b782485bd30b02c\": container with ID starting with 5a1921ec26c24a4bfd1fb9ee02c7ab8b0df2e8c7862ba6f80b782485bd30b02c not found: ID does not exist" Sep 11 02:55:21.105134 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.105096 2580 scope.go:117] "RemoveContainer" containerID="56b6b3277bca448878cd2ac8d963f12afa8a585e31b2635036f5592422a04de2" Sep 11 02:55:21.105317 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:55:21.105303 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56b6b3277bca448878cd2ac8d963f12afa8a585e31b2635036f5592422a04de2\": container with ID starting with 56b6b3277bca448878cd2ac8d963f12afa8a585e31b2635036f5592422a04de2 not found: ID does not exist" containerID="56b6b3277bca448878cd2ac8d963f12afa8a585e31b2635036f5592422a04de2" Sep 11 02:55:21.105400 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.105320 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56b6b3277bca448878cd2ac8d963f12afa8a585e31b2635036f5592422a04de2"} err="failed to get container status \"56b6b3277bca448878cd2ac8d963f12afa8a585e31b2635036f5592422a04de2\": rpc error: code = NotFound desc = could not find container \"56b6b3277bca448878cd2ac8d963f12afa8a585e31b2635036f5592422a04de2\": container with ID starting with 56b6b3277bca448878cd2ac8d963f12afa8a585e31b2635036f5592422a04de2 not found: ID does not exist" Sep 11 02:55:21.105400 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.105331 2580 scope.go:117] "RemoveContainer" containerID="82e5a8d68efecbffd3faf7eb77357655ea9655cfa9d64bfb6a80978ae08b6eaf" Sep 11 02:55:21.105561 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:55:21.105541 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82e5a8d68efecbffd3faf7eb77357655ea9655cfa9d64bfb6a80978ae08b6eaf\": container with ID starting with 82e5a8d68efecbffd3faf7eb77357655ea9655cfa9d64bfb6a80978ae08b6eaf not found: ID does not exist" containerID="82e5a8d68efecbffd3faf7eb77357655ea9655cfa9d64bfb6a80978ae08b6eaf" Sep 11 02:55:21.105598 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.105568 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82e5a8d68efecbffd3faf7eb77357655ea9655cfa9d64bfb6a80978ae08b6eaf"} err="failed to get container status \"82e5a8d68efecbffd3faf7eb77357655ea9655cfa9d64bfb6a80978ae08b6eaf\": rpc error: code = NotFound desc = could not find container \"82e5a8d68efecbffd3faf7eb77357655ea9655cfa9d64bfb6a80978ae08b6eaf\": container with ID starting with 82e5a8d68efecbffd3faf7eb77357655ea9655cfa9d64bfb6a80978ae08b6eaf not found: ID does not exist" Sep 11 02:55:21.105598 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.105586 2580 scope.go:117] "RemoveContainer" containerID="4d79bbd8be34f97a432c7869e589cd92f6cd3d0beeee629cf72ebe6029758836" Sep 11 02:55:21.105879 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.105859 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d79bbd8be34f97a432c7869e589cd92f6cd3d0beeee629cf72ebe6029758836"} err="failed to get container status \"4d79bbd8be34f97a432c7869e589cd92f6cd3d0beeee629cf72ebe6029758836\": rpc error: code = NotFound desc = could not find container \"4d79bbd8be34f97a432c7869e589cd92f6cd3d0beeee629cf72ebe6029758836\": container with ID starting with 4d79bbd8be34f97a432c7869e589cd92f6cd3d0beeee629cf72ebe6029758836 not found: ID does not exist" Sep 11 02:55:21.105939 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.105881 2580 scope.go:117] "RemoveContainer" containerID="15f3f98aea1c20c8e5aef483f3e8770865bf4810dadd711e51e191faf101fd52" Sep 11 02:55:21.106137 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.106120 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15f3f98aea1c20c8e5aef483f3e8770865bf4810dadd711e51e191faf101fd52"} err="failed to get container status \"15f3f98aea1c20c8e5aef483f3e8770865bf4810dadd711e51e191faf101fd52\": rpc error: code = NotFound desc = could not find container \"15f3f98aea1c20c8e5aef483f3e8770865bf4810dadd711e51e191faf101fd52\": container with ID starting with 15f3f98aea1c20c8e5aef483f3e8770865bf4810dadd711e51e191faf101fd52 not found: ID does not exist" Sep 11 02:55:21.106183 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.106138 2580 scope.go:117] "RemoveContainer" containerID="707f74d6e4ee31ebb77fad492b465e7848512f6b63162a0da37d5bae54b6d990" Sep 11 02:55:21.106372 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.106352 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"707f74d6e4ee31ebb77fad492b465e7848512f6b63162a0da37d5bae54b6d990"} err="failed to get container status \"707f74d6e4ee31ebb77fad492b465e7848512f6b63162a0da37d5bae54b6d990\": rpc error: code = NotFound desc = could not find container \"707f74d6e4ee31ebb77fad492b465e7848512f6b63162a0da37d5bae54b6d990\": container with ID starting with 707f74d6e4ee31ebb77fad492b465e7848512f6b63162a0da37d5bae54b6d990 not found: ID does not exist" Sep 11 02:55:21.106372 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.106372 2580 scope.go:117] "RemoveContainer" containerID="217bc9207afe05834dfd74be804e49af827508b9ab100c728b66655a740d81fe" Sep 11 02:55:21.106649 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.106610 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"217bc9207afe05834dfd74be804e49af827508b9ab100c728b66655a740d81fe"} err="failed to get container status \"217bc9207afe05834dfd74be804e49af827508b9ab100c728b66655a740d81fe\": rpc error: code = NotFound desc = could not find container \"217bc9207afe05834dfd74be804e49af827508b9ab100c728b66655a740d81fe\": container with ID starting with 217bc9207afe05834dfd74be804e49af827508b9ab100c728b66655a740d81fe not found: ID does not exist" Sep 11 02:55:21.106649 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.106642 2580 scope.go:117] "RemoveContainer" containerID="5a1921ec26c24a4bfd1fb9ee02c7ab8b0df2e8c7862ba6f80b782485bd30b02c" Sep 11 02:55:21.106906 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.106887 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a1921ec26c24a4bfd1fb9ee02c7ab8b0df2e8c7862ba6f80b782485bd30b02c"} err="failed to get container status \"5a1921ec26c24a4bfd1fb9ee02c7ab8b0df2e8c7862ba6f80b782485bd30b02c\": rpc error: code = NotFound desc = could not find container \"5a1921ec26c24a4bfd1fb9ee02c7ab8b0df2e8c7862ba6f80b782485bd30b02c\": container with ID starting with 5a1921ec26c24a4bfd1fb9ee02c7ab8b0df2e8c7862ba6f80b782485bd30b02c not found: ID does not exist" Sep 11 02:55:21.106906 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.106906 2580 scope.go:117] "RemoveContainer" containerID="56b6b3277bca448878cd2ac8d963f12afa8a585e31b2635036f5592422a04de2" Sep 11 02:55:21.107170 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.107154 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56b6b3277bca448878cd2ac8d963f12afa8a585e31b2635036f5592422a04de2"} err="failed to get container status \"56b6b3277bca448878cd2ac8d963f12afa8a585e31b2635036f5592422a04de2\": rpc error: code = NotFound desc = could not find container \"56b6b3277bca448878cd2ac8d963f12afa8a585e31b2635036f5592422a04de2\": container with ID starting with 56b6b3277bca448878cd2ac8d963f12afa8a585e31b2635036f5592422a04de2 not found: ID does not exist" Sep 11 02:55:21.107211 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.107170 2580 scope.go:117] "RemoveContainer" containerID="82e5a8d68efecbffd3faf7eb77357655ea9655cfa9d64bfb6a80978ae08b6eaf" Sep 11 02:55:21.107412 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.107393 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82e5a8d68efecbffd3faf7eb77357655ea9655cfa9d64bfb6a80978ae08b6eaf"} err="failed to get container status \"82e5a8d68efecbffd3faf7eb77357655ea9655cfa9d64bfb6a80978ae08b6eaf\": rpc error: code = NotFound desc = could not find container \"82e5a8d68efecbffd3faf7eb77357655ea9655cfa9d64bfb6a80978ae08b6eaf\": container with ID starting with 82e5a8d68efecbffd3faf7eb77357655ea9655cfa9d64bfb6a80978ae08b6eaf not found: ID does not exist" Sep 11 02:55:21.107484 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.107415 2580 scope.go:117] "RemoveContainer" containerID="4d79bbd8be34f97a432c7869e589cd92f6cd3d0beeee629cf72ebe6029758836" Sep 11 02:55:21.107697 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.107673 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d79bbd8be34f97a432c7869e589cd92f6cd3d0beeee629cf72ebe6029758836"} err="failed to get container status \"4d79bbd8be34f97a432c7869e589cd92f6cd3d0beeee629cf72ebe6029758836\": rpc error: code = NotFound desc = could not find container \"4d79bbd8be34f97a432c7869e589cd92f6cd3d0beeee629cf72ebe6029758836\": container with ID starting with 4d79bbd8be34f97a432c7869e589cd92f6cd3d0beeee629cf72ebe6029758836 not found: ID does not exist" Sep 11 02:55:21.107697 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.107698 2580 scope.go:117] "RemoveContainer" containerID="15f3f98aea1c20c8e5aef483f3e8770865bf4810dadd711e51e191faf101fd52" Sep 11 02:55:21.107926 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.107907 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15f3f98aea1c20c8e5aef483f3e8770865bf4810dadd711e51e191faf101fd52"} err="failed to get container status \"15f3f98aea1c20c8e5aef483f3e8770865bf4810dadd711e51e191faf101fd52\": rpc error: code = NotFound desc = could not find container \"15f3f98aea1c20c8e5aef483f3e8770865bf4810dadd711e51e191faf101fd52\": container with ID starting with 15f3f98aea1c20c8e5aef483f3e8770865bf4810dadd711e51e191faf101fd52 not found: ID does not exist" Sep 11 02:55:21.107989 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.107933 2580 scope.go:117] "RemoveContainer" containerID="707f74d6e4ee31ebb77fad492b465e7848512f6b63162a0da37d5bae54b6d990" Sep 11 02:55:21.108141 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.108126 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"707f74d6e4ee31ebb77fad492b465e7848512f6b63162a0da37d5bae54b6d990"} err="failed to get container status \"707f74d6e4ee31ebb77fad492b465e7848512f6b63162a0da37d5bae54b6d990\": rpc error: code = NotFound desc = could not find container \"707f74d6e4ee31ebb77fad492b465e7848512f6b63162a0da37d5bae54b6d990\": container with ID starting with 707f74d6e4ee31ebb77fad492b465e7848512f6b63162a0da37d5bae54b6d990 not found: ID does not exist" Sep 11 02:55:21.108201 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.108141 2580 scope.go:117] "RemoveContainer" containerID="217bc9207afe05834dfd74be804e49af827508b9ab100c728b66655a740d81fe" Sep 11 02:55:21.108377 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.108362 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"217bc9207afe05834dfd74be804e49af827508b9ab100c728b66655a740d81fe"} err="failed to get container status \"217bc9207afe05834dfd74be804e49af827508b9ab100c728b66655a740d81fe\": rpc error: code = NotFound desc = could not find container \"217bc9207afe05834dfd74be804e49af827508b9ab100c728b66655a740d81fe\": container with ID starting with 217bc9207afe05834dfd74be804e49af827508b9ab100c728b66655a740d81fe not found: ID does not exist" Sep 11 02:55:21.108432 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.108377 2580 scope.go:117] "RemoveContainer" containerID="5a1921ec26c24a4bfd1fb9ee02c7ab8b0df2e8c7862ba6f80b782485bd30b02c" Sep 11 02:55:21.108600 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.108582 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a1921ec26c24a4bfd1fb9ee02c7ab8b0df2e8c7862ba6f80b782485bd30b02c"} err="failed to get container status \"5a1921ec26c24a4bfd1fb9ee02c7ab8b0df2e8c7862ba6f80b782485bd30b02c\": rpc error: code = NotFound desc = could not find container \"5a1921ec26c24a4bfd1fb9ee02c7ab8b0df2e8c7862ba6f80b782485bd30b02c\": container with ID starting with 5a1921ec26c24a4bfd1fb9ee02c7ab8b0df2e8c7862ba6f80b782485bd30b02c not found: ID does not exist" Sep 11 02:55:21.108700 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.108603 2580 scope.go:117] "RemoveContainer" containerID="56b6b3277bca448878cd2ac8d963f12afa8a585e31b2635036f5592422a04de2" Sep 11 02:55:21.108858 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.108840 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56b6b3277bca448878cd2ac8d963f12afa8a585e31b2635036f5592422a04de2"} err="failed to get container status \"56b6b3277bca448878cd2ac8d963f12afa8a585e31b2635036f5592422a04de2\": rpc error: code = NotFound desc = could not find container \"56b6b3277bca448878cd2ac8d963f12afa8a585e31b2635036f5592422a04de2\": container with ID starting with 56b6b3277bca448878cd2ac8d963f12afa8a585e31b2635036f5592422a04de2 not found: ID does not exist" Sep 11 02:55:21.108922 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.108857 2580 scope.go:117] "RemoveContainer" containerID="82e5a8d68efecbffd3faf7eb77357655ea9655cfa9d64bfb6a80978ae08b6eaf" Sep 11 02:55:21.109097 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.109081 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82e5a8d68efecbffd3faf7eb77357655ea9655cfa9d64bfb6a80978ae08b6eaf"} err="failed to get container status \"82e5a8d68efecbffd3faf7eb77357655ea9655cfa9d64bfb6a80978ae08b6eaf\": rpc error: code = NotFound desc = could not find container \"82e5a8d68efecbffd3faf7eb77357655ea9655cfa9d64bfb6a80978ae08b6eaf\": container with ID starting with 82e5a8d68efecbffd3faf7eb77357655ea9655cfa9d64bfb6a80978ae08b6eaf not found: ID does not exist" Sep 11 02:55:21.109157 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.109097 2580 scope.go:117] "RemoveContainer" containerID="4d79bbd8be34f97a432c7869e589cd92f6cd3d0beeee629cf72ebe6029758836" Sep 11 02:55:21.109344 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.109326 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d79bbd8be34f97a432c7869e589cd92f6cd3d0beeee629cf72ebe6029758836"} err="failed to get container status \"4d79bbd8be34f97a432c7869e589cd92f6cd3d0beeee629cf72ebe6029758836\": rpc error: code = NotFound desc = could not find container \"4d79bbd8be34f97a432c7869e589cd92f6cd3d0beeee629cf72ebe6029758836\": container with ID starting with 4d79bbd8be34f97a432c7869e589cd92f6cd3d0beeee629cf72ebe6029758836 not found: ID does not exist" Sep 11 02:55:21.109406 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.109348 2580 scope.go:117] "RemoveContainer" containerID="15f3f98aea1c20c8e5aef483f3e8770865bf4810dadd711e51e191faf101fd52" Sep 11 02:55:21.109585 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.109566 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15f3f98aea1c20c8e5aef483f3e8770865bf4810dadd711e51e191faf101fd52"} err="failed to get container status \"15f3f98aea1c20c8e5aef483f3e8770865bf4810dadd711e51e191faf101fd52\": rpc error: code = NotFound desc = could not find container \"15f3f98aea1c20c8e5aef483f3e8770865bf4810dadd711e51e191faf101fd52\": container with ID starting with 15f3f98aea1c20c8e5aef483f3e8770865bf4810dadd711e51e191faf101fd52 not found: ID does not exist" Sep 11 02:55:21.109662 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.109599 2580 scope.go:117] "RemoveContainer" containerID="707f74d6e4ee31ebb77fad492b465e7848512f6b63162a0da37d5bae54b6d990" Sep 11 02:55:21.109838 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.109822 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"707f74d6e4ee31ebb77fad492b465e7848512f6b63162a0da37d5bae54b6d990"} err="failed to get container status \"707f74d6e4ee31ebb77fad492b465e7848512f6b63162a0da37d5bae54b6d990\": rpc error: code = NotFound desc = could not find container \"707f74d6e4ee31ebb77fad492b465e7848512f6b63162a0da37d5bae54b6d990\": container with ID starting with 707f74d6e4ee31ebb77fad492b465e7848512f6b63162a0da37d5bae54b6d990 not found: ID does not exist" Sep 11 02:55:21.109898 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.109840 2580 scope.go:117] "RemoveContainer" containerID="217bc9207afe05834dfd74be804e49af827508b9ab100c728b66655a740d81fe" Sep 11 02:55:21.110053 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.110035 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"217bc9207afe05834dfd74be804e49af827508b9ab100c728b66655a740d81fe"} err="failed to get container status \"217bc9207afe05834dfd74be804e49af827508b9ab100c728b66655a740d81fe\": rpc error: code = NotFound desc = could not find container \"217bc9207afe05834dfd74be804e49af827508b9ab100c728b66655a740d81fe\": container with ID starting with 217bc9207afe05834dfd74be804e49af827508b9ab100c728b66655a740d81fe not found: ID does not exist" Sep 11 02:55:21.110165 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.110055 2580 scope.go:117] "RemoveContainer" containerID="5a1921ec26c24a4bfd1fb9ee02c7ab8b0df2e8c7862ba6f80b782485bd30b02c" Sep 11 02:55:21.110308 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.110290 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a1921ec26c24a4bfd1fb9ee02c7ab8b0df2e8c7862ba6f80b782485bd30b02c"} err="failed to get container status \"5a1921ec26c24a4bfd1fb9ee02c7ab8b0df2e8c7862ba6f80b782485bd30b02c\": rpc error: code = NotFound desc = could not find container \"5a1921ec26c24a4bfd1fb9ee02c7ab8b0df2e8c7862ba6f80b782485bd30b02c\": container with ID starting with 5a1921ec26c24a4bfd1fb9ee02c7ab8b0df2e8c7862ba6f80b782485bd30b02c not found: ID does not exist" Sep 11 02:55:21.110367 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.110309 2580 scope.go:117] "RemoveContainer" containerID="56b6b3277bca448878cd2ac8d963f12afa8a585e31b2635036f5592422a04de2" Sep 11 02:55:21.110542 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.110522 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56b6b3277bca448878cd2ac8d963f12afa8a585e31b2635036f5592422a04de2"} err="failed to get container status \"56b6b3277bca448878cd2ac8d963f12afa8a585e31b2635036f5592422a04de2\": rpc error: code = NotFound desc = could not find container \"56b6b3277bca448878cd2ac8d963f12afa8a585e31b2635036f5592422a04de2\": container with ID starting with 56b6b3277bca448878cd2ac8d963f12afa8a585e31b2635036f5592422a04de2 not found: ID does not exist" Sep 11 02:55:21.110600 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.110543 2580 scope.go:117] "RemoveContainer" containerID="82e5a8d68efecbffd3faf7eb77357655ea9655cfa9d64bfb6a80978ae08b6eaf" Sep 11 02:55:21.110757 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.110742 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82e5a8d68efecbffd3faf7eb77357655ea9655cfa9d64bfb6a80978ae08b6eaf"} err="failed to get container status \"82e5a8d68efecbffd3faf7eb77357655ea9655cfa9d64bfb6a80978ae08b6eaf\": rpc error: code = NotFound desc = could not find container \"82e5a8d68efecbffd3faf7eb77357655ea9655cfa9d64bfb6a80978ae08b6eaf\": container with ID starting with 82e5a8d68efecbffd3faf7eb77357655ea9655cfa9d64bfb6a80978ae08b6eaf not found: ID does not exist" Sep 11 02:55:21.110826 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.110758 2580 scope.go:117] "RemoveContainer" containerID="4d79bbd8be34f97a432c7869e589cd92f6cd3d0beeee629cf72ebe6029758836" Sep 11 02:55:21.111013 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.110992 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d79bbd8be34f97a432c7869e589cd92f6cd3d0beeee629cf72ebe6029758836"} err="failed to get container status \"4d79bbd8be34f97a432c7869e589cd92f6cd3d0beeee629cf72ebe6029758836\": rpc error: code = NotFound desc = could not find container \"4d79bbd8be34f97a432c7869e589cd92f6cd3d0beeee629cf72ebe6029758836\": container with ID starting with 4d79bbd8be34f97a432c7869e589cd92f6cd3d0beeee629cf72ebe6029758836 not found: ID does not exist" Sep 11 02:55:21.111013 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.111012 2580 scope.go:117] "RemoveContainer" containerID="15f3f98aea1c20c8e5aef483f3e8770865bf4810dadd711e51e191faf101fd52" Sep 11 02:55:21.111242 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.111226 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15f3f98aea1c20c8e5aef483f3e8770865bf4810dadd711e51e191faf101fd52"} err="failed to get container status \"15f3f98aea1c20c8e5aef483f3e8770865bf4810dadd711e51e191faf101fd52\": rpc error: code = NotFound desc = could not find container \"15f3f98aea1c20c8e5aef483f3e8770865bf4810dadd711e51e191faf101fd52\": container with ID starting with 15f3f98aea1c20c8e5aef483f3e8770865bf4810dadd711e51e191faf101fd52 not found: ID does not exist" Sep 11 02:55:21.111307 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.111244 2580 scope.go:117] "RemoveContainer" containerID="707f74d6e4ee31ebb77fad492b465e7848512f6b63162a0da37d5bae54b6d990" Sep 11 02:55:21.111478 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.111462 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"707f74d6e4ee31ebb77fad492b465e7848512f6b63162a0da37d5bae54b6d990"} err="failed to get container status \"707f74d6e4ee31ebb77fad492b465e7848512f6b63162a0da37d5bae54b6d990\": rpc error: code = NotFound desc = could not find container \"707f74d6e4ee31ebb77fad492b465e7848512f6b63162a0da37d5bae54b6d990\": container with ID starting with 707f74d6e4ee31ebb77fad492b465e7848512f6b63162a0da37d5bae54b6d990 not found: ID does not exist" Sep 11 02:55:21.111542 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.111478 2580 scope.go:117] "RemoveContainer" containerID="217bc9207afe05834dfd74be804e49af827508b9ab100c728b66655a740d81fe" Sep 11 02:55:21.111747 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.111730 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"217bc9207afe05834dfd74be804e49af827508b9ab100c728b66655a740d81fe"} err="failed to get container status \"217bc9207afe05834dfd74be804e49af827508b9ab100c728b66655a740d81fe\": rpc error: code = NotFound desc = could not find container \"217bc9207afe05834dfd74be804e49af827508b9ab100c728b66655a740d81fe\": container with ID starting with 217bc9207afe05834dfd74be804e49af827508b9ab100c728b66655a740d81fe not found: ID does not exist" Sep 11 02:55:21.111827 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.111749 2580 scope.go:117] "RemoveContainer" containerID="5a1921ec26c24a4bfd1fb9ee02c7ab8b0df2e8c7862ba6f80b782485bd30b02c" Sep 11 02:55:21.111982 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.111965 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a1921ec26c24a4bfd1fb9ee02c7ab8b0df2e8c7862ba6f80b782485bd30b02c"} err="failed to get container status \"5a1921ec26c24a4bfd1fb9ee02c7ab8b0df2e8c7862ba6f80b782485bd30b02c\": rpc error: code = NotFound desc = could not find container \"5a1921ec26c24a4bfd1fb9ee02c7ab8b0df2e8c7862ba6f80b782485bd30b02c\": container with ID starting with 5a1921ec26c24a4bfd1fb9ee02c7ab8b0df2e8c7862ba6f80b782485bd30b02c not found: ID does not exist" Sep 11 02:55:21.112025 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.111982 2580 scope.go:117] "RemoveContainer" containerID="56b6b3277bca448878cd2ac8d963f12afa8a585e31b2635036f5592422a04de2" Sep 11 02:55:21.112192 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.112175 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56b6b3277bca448878cd2ac8d963f12afa8a585e31b2635036f5592422a04de2"} err="failed to get container status \"56b6b3277bca448878cd2ac8d963f12afa8a585e31b2635036f5592422a04de2\": rpc error: code = NotFound desc = could not find container \"56b6b3277bca448878cd2ac8d963f12afa8a585e31b2635036f5592422a04de2\": container with ID starting with 56b6b3277bca448878cd2ac8d963f12afa8a585e31b2635036f5592422a04de2 not found: ID does not exist" Sep 11 02:55:21.112255 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.112193 2580 scope.go:117] "RemoveContainer" containerID="82e5a8d68efecbffd3faf7eb77357655ea9655cfa9d64bfb6a80978ae08b6eaf" Sep 11 02:55:21.112426 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.112405 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82e5a8d68efecbffd3faf7eb77357655ea9655cfa9d64bfb6a80978ae08b6eaf"} err="failed to get container status \"82e5a8d68efecbffd3faf7eb77357655ea9655cfa9d64bfb6a80978ae08b6eaf\": rpc error: code = NotFound desc = could not find container \"82e5a8d68efecbffd3faf7eb77357655ea9655cfa9d64bfb6a80978ae08b6eaf\": container with ID starting with 82e5a8d68efecbffd3faf7eb77357655ea9655cfa9d64bfb6a80978ae08b6eaf not found: ID does not exist" Sep 11 02:55:21.112529 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.112428 2580 scope.go:117] "RemoveContainer" containerID="4d79bbd8be34f97a432c7869e589cd92f6cd3d0beeee629cf72ebe6029758836" Sep 11 02:55:21.112682 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.112666 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d79bbd8be34f97a432c7869e589cd92f6cd3d0beeee629cf72ebe6029758836"} err="failed to get container status \"4d79bbd8be34f97a432c7869e589cd92f6cd3d0beeee629cf72ebe6029758836\": rpc error: code = NotFound desc = could not find container \"4d79bbd8be34f97a432c7869e589cd92f6cd3d0beeee629cf72ebe6029758836\": container with ID starting with 4d79bbd8be34f97a432c7869e589cd92f6cd3d0beeee629cf72ebe6029758836 not found: ID does not exist" Sep 11 02:55:21.112734 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.112683 2580 scope.go:117] "RemoveContainer" containerID="15f3f98aea1c20c8e5aef483f3e8770865bf4810dadd711e51e191faf101fd52" Sep 11 02:55:21.112922 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.112900 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15f3f98aea1c20c8e5aef483f3e8770865bf4810dadd711e51e191faf101fd52"} err="failed to get container status \"15f3f98aea1c20c8e5aef483f3e8770865bf4810dadd711e51e191faf101fd52\": rpc error: code = NotFound desc = could not find container \"15f3f98aea1c20c8e5aef483f3e8770865bf4810dadd711e51e191faf101fd52\": container with ID starting with 15f3f98aea1c20c8e5aef483f3e8770865bf4810dadd711e51e191faf101fd52 not found: ID does not exist" Sep 11 02:55:21.112922 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.112919 2580 scope.go:117] "RemoveContainer" containerID="707f74d6e4ee31ebb77fad492b465e7848512f6b63162a0da37d5bae54b6d990" Sep 11 02:55:21.113231 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.113213 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"707f74d6e4ee31ebb77fad492b465e7848512f6b63162a0da37d5bae54b6d990"} err="failed to get container status \"707f74d6e4ee31ebb77fad492b465e7848512f6b63162a0da37d5bae54b6d990\": rpc error: code = NotFound desc = could not find container \"707f74d6e4ee31ebb77fad492b465e7848512f6b63162a0da37d5bae54b6d990\": container with ID starting with 707f74d6e4ee31ebb77fad492b465e7848512f6b63162a0da37d5bae54b6d990 not found: ID does not exist" Sep 11 02:55:21.113231 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.113232 2580 scope.go:117] "RemoveContainer" containerID="217bc9207afe05834dfd74be804e49af827508b9ab100c728b66655a740d81fe" Sep 11 02:55:21.113473 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.113452 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"217bc9207afe05834dfd74be804e49af827508b9ab100c728b66655a740d81fe"} err="failed to get container status \"217bc9207afe05834dfd74be804e49af827508b9ab100c728b66655a740d81fe\": rpc error: code = NotFound desc = could not find container \"217bc9207afe05834dfd74be804e49af827508b9ab100c728b66655a740d81fe\": container with ID starting with 217bc9207afe05834dfd74be804e49af827508b9ab100c728b66655a740d81fe not found: ID does not exist" Sep 11 02:55:21.113562 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.113475 2580 scope.go:117] "RemoveContainer" containerID="5a1921ec26c24a4bfd1fb9ee02c7ab8b0df2e8c7862ba6f80b782485bd30b02c" Sep 11 02:55:21.113741 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.113724 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a1921ec26c24a4bfd1fb9ee02c7ab8b0df2e8c7862ba6f80b782485bd30b02c"} err="failed to get container status \"5a1921ec26c24a4bfd1fb9ee02c7ab8b0df2e8c7862ba6f80b782485bd30b02c\": rpc error: code = NotFound desc = could not find container \"5a1921ec26c24a4bfd1fb9ee02c7ab8b0df2e8c7862ba6f80b782485bd30b02c\": container with ID starting with 5a1921ec26c24a4bfd1fb9ee02c7ab8b0df2e8c7862ba6f80b782485bd30b02c not found: ID does not exist" Sep 11 02:55:21.113800 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.113742 2580 scope.go:117] "RemoveContainer" containerID="56b6b3277bca448878cd2ac8d963f12afa8a585e31b2635036f5592422a04de2" Sep 11 02:55:21.114020 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.114002 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56b6b3277bca448878cd2ac8d963f12afa8a585e31b2635036f5592422a04de2"} err="failed to get container status \"56b6b3277bca448878cd2ac8d963f12afa8a585e31b2635036f5592422a04de2\": rpc error: code = NotFound desc = could not find container \"56b6b3277bca448878cd2ac8d963f12afa8a585e31b2635036f5592422a04de2\": container with ID starting with 56b6b3277bca448878cd2ac8d963f12afa8a585e31b2635036f5592422a04de2 not found: ID does not exist" Sep 11 02:55:21.114090 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.114022 2580 scope.go:117] "RemoveContainer" containerID="82e5a8d68efecbffd3faf7eb77357655ea9655cfa9d64bfb6a80978ae08b6eaf" Sep 11 02:55:21.114289 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.114269 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82e5a8d68efecbffd3faf7eb77357655ea9655cfa9d64bfb6a80978ae08b6eaf"} err="failed to get container status \"82e5a8d68efecbffd3faf7eb77357655ea9655cfa9d64bfb6a80978ae08b6eaf\": rpc error: code = NotFound desc = could not find container \"82e5a8d68efecbffd3faf7eb77357655ea9655cfa9d64bfb6a80978ae08b6eaf\": container with ID starting with 82e5a8d68efecbffd3faf7eb77357655ea9655cfa9d64bfb6a80978ae08b6eaf not found: ID does not exist" Sep 11 02:55:21.146165 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.146138 2580 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6076f23-d106-459a-a958-d91759dac571-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-138-210.ec2.internal\" DevicePath \"\"" Sep 11 02:55:21.146266 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.146168 2580 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f6076f23-d106-459a-a958-d91759dac571-web-config\") on node \"ip-10-0-138-210.ec2.internal\" DevicePath \"\"" Sep 11 02:55:21.146266 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.146184 2580 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f6076f23-d106-459a-a958-d91759dac571-secret-kube-rbac-proxy\") on node \"ip-10-0-138-210.ec2.internal\" DevicePath \"\"" Sep 11 02:55:21.146266 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.146198 2580 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f6076f23-d106-459a-a958-d91759dac571-thanos-prometheus-http-client-file\") on node \"ip-10-0-138-210.ec2.internal\" DevicePath \"\"" Sep 11 02:55:21.146266 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.146212 2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f6076f23-d106-459a-a958-d91759dac571-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-138-210.ec2.internal\" DevicePath \"\"" Sep 11 02:55:21.146266 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.146224 2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f6076f23-d106-459a-a958-d91759dac571-secret-prometheus-k8s-tls\") on node \"ip-10-0-138-210.ec2.internal\" DevicePath \"\"" Sep 11 02:55:21.146266 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.146234 2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f6076f23-d106-459a-a958-d91759dac571-prometheus-k8s-db\") on node \"ip-10-0-138-210.ec2.internal\" DevicePath \"\"" Sep 11 02:55:21.146266 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.146244 2580 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6076f23-d106-459a-a958-d91759dac571-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-138-210.ec2.internal\" DevicePath \"\"" Sep 11 02:55:21.146266 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.146252 2580 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f6076f23-d106-459a-a958-d91759dac571-secret-metrics-client-certs\") on node \"ip-10-0-138-210.ec2.internal\" DevicePath \"\"" Sep 11 02:55:21.146266 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.146261 2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f6076f23-d106-459a-a958-d91759dac571-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-138-210.ec2.internal\" DevicePath \"\"" Sep 11 02:55:21.146514 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.146271 2580 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f6076f23-d106-459a-a958-d91759dac571-config-out\") on node \"ip-10-0-138-210.ec2.internal\" DevicePath \"\"" Sep 11 02:55:21.146514 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.146283 2580 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f6076f23-d106-459a-a958-d91759dac571-tls-assets\") on node \"ip-10-0-138-210.ec2.internal\" DevicePath \"\"" Sep 11 02:55:21.146514 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.146295 2580 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f6076f23-d106-459a-a958-d91759dac571-secret-grpc-tls\") on node \"ip-10-0-138-210.ec2.internal\" DevicePath \"\"" Sep 11 02:55:21.146514 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.146302 2580 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/f6076f23-d106-459a-a958-d91759dac571-config\") on node \"ip-10-0-138-210.ec2.internal\" DevicePath \"\"" Sep 11 02:55:21.146514 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.146309 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2j4c\" (UniqueName: \"kubernetes.io/projected/f6076f23-d106-459a-a958-d91759dac571-kube-api-access-p2j4c\") on node \"ip-10-0-138-210.ec2.internal\" DevicePath \"\"" Sep 11 02:55:21.146514 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.146317 2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f6076f23-d106-459a-a958-d91759dac571-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-138-210.ec2.internal\" DevicePath \"\"" Sep 11 02:55:21.146514 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.146326 2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f6076f23-d106-459a-a958-d91759dac571-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-138-210.ec2.internal\" DevicePath \"\"" Sep 11 02:55:21.373330 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.373305 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 11 02:55:21.377415 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.377394 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 11 02:55:21.402394 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.402372 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 11 02:55:21.402609 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.402598 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6076f23-d106-459a-a958-d91759dac571" containerName="thanos-sidecar" Sep 11 02:55:21.402677 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.402611 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6076f23-d106-459a-a958-d91759dac571" containerName="thanos-sidecar" Sep 11 02:55:21.402677 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.402636 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6076f23-d106-459a-a958-d91759dac571" containerName="kube-rbac-proxy-web" Sep 11 02:55:21.402677 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.402644 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6076f23-d106-459a-a958-d91759dac571" containerName="kube-rbac-proxy-web" Sep 11 02:55:21.402677 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.402654 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6076f23-d106-459a-a958-d91759dac571" containerName="kube-rbac-proxy-thanos" Sep 11 02:55:21.402677 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.402662 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6076f23-d106-459a-a958-d91759dac571" containerName="kube-rbac-proxy-thanos" Sep 11 02:55:21.402677 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.402677 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6076f23-d106-459a-a958-d91759dac571" containerName="kube-rbac-proxy" Sep 11 02:55:21.402840 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.402682 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6076f23-d106-459a-a958-d91759dac571" containerName="kube-rbac-proxy" Sep 11 02:55:21.402840 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.402688 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6076f23-d106-459a-a958-d91759dac571" containerName="init-config-reloader" Sep 11 02:55:21.402840 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.402694 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6076f23-d106-459a-a958-d91759dac571" containerName="init-config-reloader" Sep 11 02:55:21.402840 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.402706 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6076f23-d106-459a-a958-d91759dac571" containerName="prometheus" Sep 11 02:55:21.402840 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.402711 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6076f23-d106-459a-a958-d91759dac571" containerName="prometheus" Sep 11 02:55:21.402840 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.402716 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6076f23-d106-459a-a958-d91759dac571" containerName="config-reloader" Sep 11 02:55:21.402840 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.402721 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6076f23-d106-459a-a958-d91759dac571" containerName="config-reloader" Sep 11 02:55:21.402840 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.402765 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6076f23-d106-459a-a958-d91759dac571" containerName="config-reloader" Sep 11 02:55:21.402840 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.402773 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6076f23-d106-459a-a958-d91759dac571" containerName="kube-rbac-proxy-thanos" Sep 11 02:55:21.402840 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.402781 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6076f23-d106-459a-a958-d91759dac571" containerName="thanos-sidecar" Sep 11 02:55:21.402840 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.402786 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6076f23-d106-459a-a958-d91759dac571" containerName="kube-rbac-proxy" Sep 11 02:55:21.402840 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.402792 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6076f23-d106-459a-a958-d91759dac571" containerName="kube-rbac-proxy-web" Sep 11 02:55:21.402840 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.402797 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6076f23-d106-459a-a958-d91759dac571" containerName="prometheus" Sep 11 02:55:21.406779 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.406763 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:55:21.409754 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.409721 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 11 02:55:21.409754 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.409750 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 11 02:55:21.409952 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.409923 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 11 02:55:21.409952 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.409951 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 11 02:55:21.410113 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.410004 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-zlb8r\"" Sep 11 02:55:21.410113 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.410004 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-951ncsgudi32q\"" Sep 11 02:55:21.410113 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.410066 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 11 02:55:21.410113 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.410097 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 11 02:55:21.410312 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.410141 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 11 02:55:21.410312 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.410219 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 11 02:55:21.410386 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.410316 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 11 02:55:21.410386 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.410319 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 11 02:55:21.410719 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.410701 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 11 02:55:21.410803 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.410706 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 11 02:55:21.411033 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.411018 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 11 02:55:21.414029 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.414013 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 11 02:55:21.415867 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.415848 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 11 02:55:21.427767 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.427748 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 11 02:55:21.548703 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.548676 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00c935c0-4c70-484a-b76f-d353a4024ff5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"00c935c0-4c70-484a-b76f-d353a4024ff5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:55:21.548808 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.548708 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/00c935c0-4c70-484a-b76f-d353a4024ff5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"00c935c0-4c70-484a-b76f-d353a4024ff5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:55:21.548808 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.548725 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/00c935c0-4c70-484a-b76f-d353a4024ff5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"00c935c0-4c70-484a-b76f-d353a4024ff5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:55:21.548808 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.548743 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/00c935c0-4c70-484a-b76f-d353a4024ff5-config-out\") pod \"prometheus-k8s-0\" (UID: \"00c935c0-4c70-484a-b76f-d353a4024ff5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:55:21.548808 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.548761 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/00c935c0-4c70-484a-b76f-d353a4024ff5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"00c935c0-4c70-484a-b76f-d353a4024ff5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:55:21.548808 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.548793 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/00c935c0-4c70-484a-b76f-d353a4024ff5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"00c935c0-4c70-484a-b76f-d353a4024ff5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:55:21.548808 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.548809 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/00c935c0-4c70-484a-b76f-d353a4024ff5-config\") pod \"prometheus-k8s-0\" (UID: \"00c935c0-4c70-484a-b76f-d353a4024ff5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:55:21.549024 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.548826 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/00c935c0-4c70-484a-b76f-d353a4024ff5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"00c935c0-4c70-484a-b76f-d353a4024ff5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:55:21.549024 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.548861 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/00c935c0-4c70-484a-b76f-d353a4024ff5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"00c935c0-4c70-484a-b76f-d353a4024ff5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:55:21.549024 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.548879 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnfk6\" (UniqueName: \"kubernetes.io/projected/00c935c0-4c70-484a-b76f-d353a4024ff5-kube-api-access-rnfk6\") pod \"prometheus-k8s-0\" (UID: \"00c935c0-4c70-484a-b76f-d353a4024ff5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:55:21.549024 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.548896 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/00c935c0-4c70-484a-b76f-d353a4024ff5-web-config\") pod \"prometheus-k8s-0\" (UID: \"00c935c0-4c70-484a-b76f-d353a4024ff5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:55:21.549024 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.548914 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/00c935c0-4c70-484a-b76f-d353a4024ff5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"00c935c0-4c70-484a-b76f-d353a4024ff5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:55:21.549024 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.548927 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/00c935c0-4c70-484a-b76f-d353a4024ff5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"00c935c0-4c70-484a-b76f-d353a4024ff5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:55:21.549024 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.548942 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/00c935c0-4c70-484a-b76f-d353a4024ff5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"00c935c0-4c70-484a-b76f-d353a4024ff5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:55:21.549024 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.548960 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/00c935c0-4c70-484a-b76f-d353a4024ff5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"00c935c0-4c70-484a-b76f-d353a4024ff5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:55:21.549024 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.548998 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/00c935c0-4c70-484a-b76f-d353a4024ff5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"00c935c0-4c70-484a-b76f-d353a4024ff5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:55:21.549024 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.549023 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/00c935c0-4c70-484a-b76f-d353a4024ff5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"00c935c0-4c70-484a-b76f-d353a4024ff5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:55:21.549358 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.549042 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/00c935c0-4c70-484a-b76f-d353a4024ff5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"00c935c0-4c70-484a-b76f-d353a4024ff5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:55:21.549358 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.549059 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00c935c0-4c70-484a-b76f-d353a4024ff5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"00c935c0-4c70-484a-b76f-d353a4024ff5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:55:21.549358 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.549131 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00c935c0-4c70-484a-b76f-d353a4024ff5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"00c935c0-4c70-484a-b76f-d353a4024ff5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:55:21.650138 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.650073 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00c935c0-4c70-484a-b76f-d353a4024ff5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"00c935c0-4c70-484a-b76f-d353a4024ff5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:55:21.650138 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.650102 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00c935c0-4c70-484a-b76f-d353a4024ff5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"00c935c0-4c70-484a-b76f-d353a4024ff5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:55:21.650138 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.650133 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/00c935c0-4c70-484a-b76f-d353a4024ff5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"00c935c0-4c70-484a-b76f-d353a4024ff5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:55:21.650331 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.650237 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/00c935c0-4c70-484a-b76f-d353a4024ff5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"00c935c0-4c70-484a-b76f-d353a4024ff5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:55:21.650331 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.650264 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/00c935c0-4c70-484a-b76f-d353a4024ff5-config-out\") pod \"prometheus-k8s-0\" (UID: \"00c935c0-4c70-484a-b76f-d353a4024ff5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:55:21.650331 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.650284 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/00c935c0-4c70-484a-b76f-d353a4024ff5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"00c935c0-4c70-484a-b76f-d353a4024ff5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:55:21.650331 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.650308 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/00c935c0-4c70-484a-b76f-d353a4024ff5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"00c935c0-4c70-484a-b76f-d353a4024ff5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:55:21.650653 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.650335 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/00c935c0-4c70-484a-b76f-d353a4024ff5-config\") pod \"prometheus-k8s-0\" (UID: \"00c935c0-4c70-484a-b76f-d353a4024ff5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:55:21.650653 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.650361 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/00c935c0-4c70-484a-b76f-d353a4024ff5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"00c935c0-4c70-484a-b76f-d353a4024ff5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:55:21.650653 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.650391 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/00c935c0-4c70-484a-b76f-d353a4024ff5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"00c935c0-4c70-484a-b76f-d353a4024ff5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:55:21.650653 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.650421 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnfk6\" (UniqueName: \"kubernetes.io/projected/00c935c0-4c70-484a-b76f-d353a4024ff5-kube-api-access-rnfk6\") pod \"prometheus-k8s-0\" (UID: \"00c935c0-4c70-484a-b76f-d353a4024ff5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:55:21.650653 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.650453 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/00c935c0-4c70-484a-b76f-d353a4024ff5-web-config\") pod \"prometheus-k8s-0\" (UID: \"00c935c0-4c70-484a-b76f-d353a4024ff5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:55:21.650653 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.650480 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/00c935c0-4c70-484a-b76f-d353a4024ff5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"00c935c0-4c70-484a-b76f-d353a4024ff5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:55:21.650653 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.650501 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/00c935c0-4c70-484a-b76f-d353a4024ff5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"00c935c0-4c70-484a-b76f-d353a4024ff5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:55:21.650653 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.650525 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/00c935c0-4c70-484a-b76f-d353a4024ff5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"00c935c0-4c70-484a-b76f-d353a4024ff5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:55:21.650653 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.650559 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/00c935c0-4c70-484a-b76f-d353a4024ff5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"00c935c0-4c70-484a-b76f-d353a4024ff5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:55:21.650653 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.650595 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/00c935c0-4c70-484a-b76f-d353a4024ff5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"00c935c0-4c70-484a-b76f-d353a4024ff5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:55:21.650653 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.650647 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/00c935c0-4c70-484a-b76f-d353a4024ff5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"00c935c0-4c70-484a-b76f-d353a4024ff5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:55:21.651372 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.650671 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/00c935c0-4c70-484a-b76f-d353a4024ff5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"00c935c0-4c70-484a-b76f-d353a4024ff5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:55:21.651372 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.650706 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00c935c0-4c70-484a-b76f-d353a4024ff5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"00c935c0-4c70-484a-b76f-d353a4024ff5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:55:21.651372 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.650824 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00c935c0-4c70-484a-b76f-d353a4024ff5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"00c935c0-4c70-484a-b76f-d353a4024ff5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:55:21.651372 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.650921 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/00c935c0-4c70-484a-b76f-d353a4024ff5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"00c935c0-4c70-484a-b76f-d353a4024ff5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:55:21.651372 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.651193 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/00c935c0-4c70-484a-b76f-d353a4024ff5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"00c935c0-4c70-484a-b76f-d353a4024ff5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:55:21.651610 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.651569 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00c935c0-4c70-484a-b76f-d353a4024ff5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"00c935c0-4c70-484a-b76f-d353a4024ff5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:55:21.652085 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.652061 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/00c935c0-4c70-484a-b76f-d353a4024ff5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"00c935c0-4c70-484a-b76f-d353a4024ff5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:55:21.653049 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.653024 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/00c935c0-4c70-484a-b76f-d353a4024ff5-config-out\") pod \"prometheus-k8s-0\" (UID: \"00c935c0-4c70-484a-b76f-d353a4024ff5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:55:21.653142 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.653046 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00c935c0-4c70-484a-b76f-d353a4024ff5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"00c935c0-4c70-484a-b76f-d353a4024ff5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:55:21.653339 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.653313 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/00c935c0-4c70-484a-b76f-d353a4024ff5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"00c935c0-4c70-484a-b76f-d353a4024ff5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:55:21.653407 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.653345 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/00c935c0-4c70-484a-b76f-d353a4024ff5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"00c935c0-4c70-484a-b76f-d353a4024ff5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:55:21.654228 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.653774 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/00c935c0-4c70-484a-b76f-d353a4024ff5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"00c935c0-4c70-484a-b76f-d353a4024ff5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:55:21.654228 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.653817 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/00c935c0-4c70-484a-b76f-d353a4024ff5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"00c935c0-4c70-484a-b76f-d353a4024ff5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:55:21.654948 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.654924 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/00c935c0-4c70-484a-b76f-d353a4024ff5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"00c935c0-4c70-484a-b76f-d353a4024ff5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:55:21.655819 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.655303 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/00c935c0-4c70-484a-b76f-d353a4024ff5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"00c935c0-4c70-484a-b76f-d353a4024ff5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:55:21.655920 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.655857 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/00c935c0-4c70-484a-b76f-d353a4024ff5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"00c935c0-4c70-484a-b76f-d353a4024ff5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:55:21.656223 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.656200 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/00c935c0-4c70-484a-b76f-d353a4024ff5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"00c935c0-4c70-484a-b76f-d353a4024ff5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:55:21.656315 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.656295 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/00c935c0-4c70-484a-b76f-d353a4024ff5-config\") pod \"prometheus-k8s-0\" (UID: \"00c935c0-4c70-484a-b76f-d353a4024ff5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:55:21.656401 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.656382 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/00c935c0-4c70-484a-b76f-d353a4024ff5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"00c935c0-4c70-484a-b76f-d353a4024ff5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:55:21.656511 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.656491 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/00c935c0-4c70-484a-b76f-d353a4024ff5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"00c935c0-4c70-484a-b76f-d353a4024ff5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:55:21.656608 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.656590 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/00c935c0-4c70-484a-b76f-d353a4024ff5-web-config\") pod \"prometheus-k8s-0\" (UID: \"00c935c0-4c70-484a-b76f-d353a4024ff5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:55:21.661973 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.661956 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnfk6\" (UniqueName: \"kubernetes.io/projected/00c935c0-4c70-484a-b76f-d353a4024ff5-kube-api-access-rnfk6\") pod \"prometheus-k8s-0\" (UID: \"00c935c0-4c70-484a-b76f-d353a4024ff5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:55:21.716027 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:21.716001 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:55:22.002916 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:22.002892 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 11 02:55:22.004848 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:55:22.004806 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00c935c0_4c70_484a_b76f_d353a4024ff5.slice/crio-87eaaa466fcb3939d050d1126e2fbc0bf963f87f99dae7cac64952968e75bfe0 WatchSource:0}: Error finding container 87eaaa466fcb3939d050d1126e2fbc0bf963f87f99dae7cac64952968e75bfe0: Status 404 returned error can't find the container with id 87eaaa466fcb3939d050d1126e2fbc0bf963f87f99dae7cac64952968e75bfe0 Sep 11 02:55:22.064692 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:22.064657 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"00c935c0-4c70-484a-b76f-d353a4024ff5","Type":"ContainerStarted","Data":"ed84fef557c212ccd04d86000b1963e52d923feb3d497f28193794ba9beddbd2"} Sep 11 02:55:22.065047 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:22.064727 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"00c935c0-4c70-484a-b76f-d353a4024ff5","Type":"ContainerStarted","Data":"87eaaa466fcb3939d050d1126e2fbc0bf963f87f99dae7cac64952968e75bfe0"} Sep 11 02:55:23.070520 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:23.070482 2580 generic.go:356] "Generic (PLEG): container finished" podID="00c935c0-4c70-484a-b76f-d353a4024ff5" containerID="ed84fef557c212ccd04d86000b1963e52d923feb3d497f28193794ba9beddbd2" exitCode=0 Sep 11 02:55:23.070889 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:23.070575 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"00c935c0-4c70-484a-b76f-d353a4024ff5","Type":"ContainerDied","Data":"ed84fef557c212ccd04d86000b1963e52d923feb3d497f28193794ba9beddbd2"} Sep 11 02:55:23.345215 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:23.345187 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6076f23-d106-459a-a958-d91759dac571" path="/var/lib/kubelet/pods/f6076f23-d106-459a-a958-d91759dac571/volumes" Sep 11 02:55:24.078297 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:24.078262 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"00c935c0-4c70-484a-b76f-d353a4024ff5","Type":"ContainerStarted","Data":"cb089f0a15d75fb3fe87f3f86ea01dc3e2143b20efc5124b1f9428de2c9434c1"} Sep 11 02:55:24.078676 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:24.078342 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"00c935c0-4c70-484a-b76f-d353a4024ff5","Type":"ContainerStarted","Data":"028ff0e8a32a831b86eee020ea505a82ad3d829981953908b9aa956b2eee6953"} Sep 11 02:55:24.078676 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:24.078382 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"00c935c0-4c70-484a-b76f-d353a4024ff5","Type":"ContainerStarted","Data":"c5b00d8beb96333d5848d697e46b83a7a704d6a5e12e4265546e4d70339354e9"} Sep 11 02:55:24.078676 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:24.078422 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"00c935c0-4c70-484a-b76f-d353a4024ff5","Type":"ContainerStarted","Data":"2e27b738418f046fef54f4e8855a99f711937ecca705094c5db34a1bf5072fee"} Sep 11 02:55:24.078676 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:24.078460 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"00c935c0-4c70-484a-b76f-d353a4024ff5","Type":"ContainerStarted","Data":"ff0184ef8cf73886987d41d9d28c455f829d138765c911aea6611d861ce36636"} Sep 11 02:55:24.078676 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:24.078494 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"00c935c0-4c70-484a-b76f-d353a4024ff5","Type":"ContainerStarted","Data":"615c98031b9a0d2d524e4fc9f68843033b3c77e46d9e7696112e3ab5ae4a981d"} Sep 11 02:55:24.109041 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:24.108993 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.089755305 podStartE2EDuration="3.108978553s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.223248ms" isStatefulPod=false podCreationTimestamp="2026-09-11 02:55:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:55:24.106918483 +0000 UTC m=+149.246241699" watchObservedRunningTime="2026-09-11 02:55:24.108978553 +0000 UTC m=+149.248301744" Sep 11 02:55:24.354123 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:24.354041 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-864cdd6964-x4rpx"] Sep 11 02:55:24.356199 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:24.356179 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-864cdd6964-x4rpx" Sep 11 02:55:24.367748 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:24.367730 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-864cdd6964-x4rpx"] Sep 11 02:55:24.475879 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:24.475847 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b3a70bbb-728e-4e92-8055-d14dbb4cfe8c-oauth-serving-cert\") pod \"console-864cdd6964-x4rpx\" (UID: \"b3a70bbb-728e-4e92-8055-d14dbb4cfe8c\") " pod="openshift-console/console-864cdd6964-x4rpx" Sep 11 02:55:24.475997 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:24.475893 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b3a70bbb-728e-4e92-8055-d14dbb4cfe8c-console-oauth-config\") pod \"console-864cdd6964-x4rpx\" (UID: \"b3a70bbb-728e-4e92-8055-d14dbb4cfe8c\") " pod="openshift-console/console-864cdd6964-x4rpx" Sep 11 02:55:24.475997 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:24.475950 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b3a70bbb-728e-4e92-8055-d14dbb4cfe8c-console-serving-cert\") pod \"console-864cdd6964-x4rpx\" (UID: \"b3a70bbb-728e-4e92-8055-d14dbb4cfe8c\") " pod="openshift-console/console-864cdd6964-x4rpx" Sep 11 02:55:24.475997 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:24.475986 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3a70bbb-728e-4e92-8055-d14dbb4cfe8c-trusted-ca-bundle\") pod \"console-864cdd6964-x4rpx\" (UID: \"b3a70bbb-728e-4e92-8055-d14dbb4cfe8c\") " pod="openshift-console/console-864cdd6964-x4rpx" Sep 11 02:55:24.476103 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:24.476025 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b3a70bbb-728e-4e92-8055-d14dbb4cfe8c-service-ca\") pod \"console-864cdd6964-x4rpx\" (UID: \"b3a70bbb-728e-4e92-8055-d14dbb4cfe8c\") " pod="openshift-console/console-864cdd6964-x4rpx" Sep 11 02:55:24.476103 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:24.476040 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6zrt\" (UniqueName: \"kubernetes.io/projected/b3a70bbb-728e-4e92-8055-d14dbb4cfe8c-kube-api-access-x6zrt\") pod \"console-864cdd6964-x4rpx\" (UID: \"b3a70bbb-728e-4e92-8055-d14dbb4cfe8c\") " pod="openshift-console/console-864cdd6964-x4rpx" Sep 11 02:55:24.476103 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:24.476094 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b3a70bbb-728e-4e92-8055-d14dbb4cfe8c-console-config\") pod \"console-864cdd6964-x4rpx\" (UID: \"b3a70bbb-728e-4e92-8055-d14dbb4cfe8c\") " pod="openshift-console/console-864cdd6964-x4rpx" Sep 11 02:55:24.577327 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:24.577301 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b3a70bbb-728e-4e92-8055-d14dbb4cfe8c-oauth-serving-cert\") pod \"console-864cdd6964-x4rpx\" (UID: \"b3a70bbb-728e-4e92-8055-d14dbb4cfe8c\") " pod="openshift-console/console-864cdd6964-x4rpx" Sep 11 02:55:24.577438 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:24.577337 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b3a70bbb-728e-4e92-8055-d14dbb4cfe8c-console-oauth-config\") pod \"console-864cdd6964-x4rpx\" (UID: \"b3a70bbb-728e-4e92-8055-d14dbb4cfe8c\") " pod="openshift-console/console-864cdd6964-x4rpx" Sep 11 02:55:24.577438 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:24.577369 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b3a70bbb-728e-4e92-8055-d14dbb4cfe8c-console-serving-cert\") pod \"console-864cdd6964-x4rpx\" (UID: \"b3a70bbb-728e-4e92-8055-d14dbb4cfe8c\") " pod="openshift-console/console-864cdd6964-x4rpx" Sep 11 02:55:24.577438 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:24.577398 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3a70bbb-728e-4e92-8055-d14dbb4cfe8c-trusted-ca-bundle\") pod \"console-864cdd6964-x4rpx\" (UID: \"b3a70bbb-728e-4e92-8055-d14dbb4cfe8c\") " pod="openshift-console/console-864cdd6964-x4rpx" Sep 11 02:55:24.577438 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:24.577430 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b3a70bbb-728e-4e92-8055-d14dbb4cfe8c-service-ca\") pod \"console-864cdd6964-x4rpx\" (UID: \"b3a70bbb-728e-4e92-8055-d14dbb4cfe8c\") " pod="openshift-console/console-864cdd6964-x4rpx" Sep 11 02:55:24.577696 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:24.577451 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6zrt\" (UniqueName: \"kubernetes.io/projected/b3a70bbb-728e-4e92-8055-d14dbb4cfe8c-kube-api-access-x6zrt\") pod \"console-864cdd6964-x4rpx\" (UID: \"b3a70bbb-728e-4e92-8055-d14dbb4cfe8c\") " pod="openshift-console/console-864cdd6964-x4rpx" Sep 11 02:55:24.577696 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:24.577498 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b3a70bbb-728e-4e92-8055-d14dbb4cfe8c-console-config\") pod \"console-864cdd6964-x4rpx\" (UID: \"b3a70bbb-728e-4e92-8055-d14dbb4cfe8c\") " pod="openshift-console/console-864cdd6964-x4rpx" Sep 11 02:55:24.578166 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:24.578140 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b3a70bbb-728e-4e92-8055-d14dbb4cfe8c-console-config\") pod \"console-864cdd6964-x4rpx\" (UID: \"b3a70bbb-728e-4e92-8055-d14dbb4cfe8c\") " pod="openshift-console/console-864cdd6964-x4rpx" Sep 11 02:55:24.578272 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:24.578140 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b3a70bbb-728e-4e92-8055-d14dbb4cfe8c-oauth-serving-cert\") pod \"console-864cdd6964-x4rpx\" (UID: \"b3a70bbb-728e-4e92-8055-d14dbb4cfe8c\") " pod="openshift-console/console-864cdd6964-x4rpx" Sep 11 02:55:24.578373 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:24.578353 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3a70bbb-728e-4e92-8055-d14dbb4cfe8c-trusted-ca-bundle\") pod \"console-864cdd6964-x4rpx\" (UID: \"b3a70bbb-728e-4e92-8055-d14dbb4cfe8c\") " pod="openshift-console/console-864cdd6964-x4rpx" Sep 11 02:55:24.578447 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:24.578379 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b3a70bbb-728e-4e92-8055-d14dbb4cfe8c-service-ca\") pod \"console-864cdd6964-x4rpx\" (UID: \"b3a70bbb-728e-4e92-8055-d14dbb4cfe8c\") " pod="openshift-console/console-864cdd6964-x4rpx" Sep 11 02:55:24.579946 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:24.579923 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b3a70bbb-728e-4e92-8055-d14dbb4cfe8c-console-serving-cert\") pod \"console-864cdd6964-x4rpx\" (UID: \"b3a70bbb-728e-4e92-8055-d14dbb4cfe8c\") " pod="openshift-console/console-864cdd6964-x4rpx" Sep 11 02:55:24.580038 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:24.579980 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b3a70bbb-728e-4e92-8055-d14dbb4cfe8c-console-oauth-config\") pod \"console-864cdd6964-x4rpx\" (UID: \"b3a70bbb-728e-4e92-8055-d14dbb4cfe8c\") " pod="openshift-console/console-864cdd6964-x4rpx" Sep 11 02:55:24.585491 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:24.585469 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6zrt\" (UniqueName: \"kubernetes.io/projected/b3a70bbb-728e-4e92-8055-d14dbb4cfe8c-kube-api-access-x6zrt\") pod \"console-864cdd6964-x4rpx\" (UID: \"b3a70bbb-728e-4e92-8055-d14dbb4cfe8c\") " pod="openshift-console/console-864cdd6964-x4rpx" Sep 11 02:55:24.664430 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:24.664382 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-864cdd6964-x4rpx" Sep 11 02:55:24.932977 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:24.932914 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-864cdd6964-x4rpx"] Sep 11 02:55:24.934948 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:55:24.934917 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3a70bbb_728e_4e92_8055_d14dbb4cfe8c.slice/crio-fd4c0309ba86b5ef75ac33347f02ed7dbe1b96e7e154aa6beb8076f4de85217a WatchSource:0}: Error finding container fd4c0309ba86b5ef75ac33347f02ed7dbe1b96e7e154aa6beb8076f4de85217a: Status 404 returned error can't find the container with id fd4c0309ba86b5ef75ac33347f02ed7dbe1b96e7e154aa6beb8076f4de85217a Sep 11 02:55:25.086389 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:25.086348 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-864cdd6964-x4rpx" event={"ID":"b3a70bbb-728e-4e92-8055-d14dbb4cfe8c","Type":"ContainerStarted","Data":"bd0291d5cb9178953ba09b27ffdb83d85dcce06d4ad40c6305c3e3d5f68670f6"} Sep 11 02:55:25.086770 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:25.086406 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-864cdd6964-x4rpx" event={"ID":"b3a70bbb-728e-4e92-8055-d14dbb4cfe8c","Type":"ContainerStarted","Data":"fd4c0309ba86b5ef75ac33347f02ed7dbe1b96e7e154aa6beb8076f4de85217a"} Sep 11 02:55:25.104088 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:25.104044 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-864cdd6964-x4rpx" podStartSLOduration=1.1040302 podStartE2EDuration="1.1040302s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 02:55:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:55:25.103845263 +0000 UTC m=+150.243168456" watchObservedRunningTime="2026-09-11 02:55:25.1040302 +0000 UTC m=+150.243353392" Sep 11 02:55:26.716694 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:26.716659 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:55:34.665353 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:34.665324 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-864cdd6964-x4rpx" Sep 11 02:55:34.665834 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:34.665374 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-864cdd6964-x4rpx" Sep 11 02:55:34.670063 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:34.670040 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-864cdd6964-x4rpx" Sep 11 02:55:35.132270 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:35.132243 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-864cdd6964-x4rpx" Sep 11 02:55:35.172654 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:55:35.172606 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f8d566cc6-5mc96"] Sep 11 02:56:00.196869 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:56:00.196818 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-f8d566cc6-5mc96" podUID="1321708f-c1c0-42f4-ab0b-58fd2038eb97" containerName="console" containerID="cri-o://7ef959f3735101f06e89db13ce5441322272f7b1f8e1d7acee8c84ecb067e360" gracePeriod=15 Sep 11 02:56:00.441280 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:56:00.441255 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f8d566cc6-5mc96" Sep 11 02:56:00.554977 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:56:00.554943 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1321708f-c1c0-42f4-ab0b-58fd2038eb97-console-serving-cert\") pod \"1321708f-c1c0-42f4-ab0b-58fd2038eb97\" (UID: \"1321708f-c1c0-42f4-ab0b-58fd2038eb97\") " Sep 11 02:56:00.555133 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:56:00.554992 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rzndf\" (UniqueName: \"kubernetes.io/projected/1321708f-c1c0-42f4-ab0b-58fd2038eb97-kube-api-access-rzndf\") pod \"1321708f-c1c0-42f4-ab0b-58fd2038eb97\" (UID: \"1321708f-c1c0-42f4-ab0b-58fd2038eb97\") " Sep 11 02:56:00.555133 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:56:00.555018 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1321708f-c1c0-42f4-ab0b-58fd2038eb97-trusted-ca-bundle\") pod \"1321708f-c1c0-42f4-ab0b-58fd2038eb97\" (UID: \"1321708f-c1c0-42f4-ab0b-58fd2038eb97\") " Sep 11 02:56:00.555133 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:56:00.555095 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1321708f-c1c0-42f4-ab0b-58fd2038eb97-console-oauth-config\") pod \"1321708f-c1c0-42f4-ab0b-58fd2038eb97\" (UID: \"1321708f-c1c0-42f4-ab0b-58fd2038eb97\") " Sep 11 02:56:00.555133 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:56:00.555122 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1321708f-c1c0-42f4-ab0b-58fd2038eb97-oauth-serving-cert\") pod \"1321708f-c1c0-42f4-ab0b-58fd2038eb97\" (UID: \"1321708f-c1c0-42f4-ab0b-58fd2038eb97\") " Sep 11 02:56:00.555341 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:56:00.555159 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1321708f-c1c0-42f4-ab0b-58fd2038eb97-service-ca\") pod \"1321708f-c1c0-42f4-ab0b-58fd2038eb97\" (UID: \"1321708f-c1c0-42f4-ab0b-58fd2038eb97\") " Sep 11 02:56:00.555341 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:56:00.555199 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1321708f-c1c0-42f4-ab0b-58fd2038eb97-console-config\") pod \"1321708f-c1c0-42f4-ab0b-58fd2038eb97\" (UID: \"1321708f-c1c0-42f4-ab0b-58fd2038eb97\") " Sep 11 02:56:00.555532 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:56:00.555488 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1321708f-c1c0-42f4-ab0b-58fd2038eb97-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1321708f-c1c0-42f4-ab0b-58fd2038eb97" (UID: "1321708f-c1c0-42f4-ab0b-58fd2038eb97"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 02:56:00.555934 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:56:00.555533 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1321708f-c1c0-42f4-ab0b-58fd2038eb97-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1321708f-c1c0-42f4-ab0b-58fd2038eb97" (UID: "1321708f-c1c0-42f4-ab0b-58fd2038eb97"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 02:56:00.555934 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:56:00.555542 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1321708f-c1c0-42f4-ab0b-58fd2038eb97-service-ca" (OuterVolumeSpecName: "service-ca") pod "1321708f-c1c0-42f4-ab0b-58fd2038eb97" (UID: "1321708f-c1c0-42f4-ab0b-58fd2038eb97"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 02:56:00.556119 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:56:00.555965 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1321708f-c1c0-42f4-ab0b-58fd2038eb97-console-config" (OuterVolumeSpecName: "console-config") pod "1321708f-c1c0-42f4-ab0b-58fd2038eb97" (UID: "1321708f-c1c0-42f4-ab0b-58fd2038eb97"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 02:56:00.557361 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:56:00.557331 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1321708f-c1c0-42f4-ab0b-58fd2038eb97-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1321708f-c1c0-42f4-ab0b-58fd2038eb97" (UID: "1321708f-c1c0-42f4-ab0b-58fd2038eb97"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 02:56:00.557448 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:56:00.557356 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1321708f-c1c0-42f4-ab0b-58fd2038eb97-kube-api-access-rzndf" (OuterVolumeSpecName: "kube-api-access-rzndf") pod "1321708f-c1c0-42f4-ab0b-58fd2038eb97" (UID: "1321708f-c1c0-42f4-ab0b-58fd2038eb97"). InnerVolumeSpecName "kube-api-access-rzndf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 02:56:00.557448 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:56:00.557387 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1321708f-c1c0-42f4-ab0b-58fd2038eb97-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1321708f-c1c0-42f4-ab0b-58fd2038eb97" (UID: "1321708f-c1c0-42f4-ab0b-58fd2038eb97"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 02:56:00.656202 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:56:00.656179 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1321708f-c1c0-42f4-ab0b-58fd2038eb97-console-oauth-config\") on node \"ip-10-0-138-210.ec2.internal\" DevicePath \"\"" Sep 11 02:56:00.656202 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:56:00.656199 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1321708f-c1c0-42f4-ab0b-58fd2038eb97-oauth-serving-cert\") on node \"ip-10-0-138-210.ec2.internal\" DevicePath \"\"" Sep 11 02:56:00.656342 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:56:00.656209 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1321708f-c1c0-42f4-ab0b-58fd2038eb97-service-ca\") on node \"ip-10-0-138-210.ec2.internal\" DevicePath \"\"" Sep 11 02:56:00.656342 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:56:00.656219 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1321708f-c1c0-42f4-ab0b-58fd2038eb97-console-config\") on node \"ip-10-0-138-210.ec2.internal\" DevicePath \"\"" Sep 11 02:56:00.656342 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:56:00.656227 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1321708f-c1c0-42f4-ab0b-58fd2038eb97-console-serving-cert\") on node \"ip-10-0-138-210.ec2.internal\" DevicePath \"\"" Sep 11 02:56:00.656342 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:56:00.656234 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rzndf\" (UniqueName: \"kubernetes.io/projected/1321708f-c1c0-42f4-ab0b-58fd2038eb97-kube-api-access-rzndf\") on node \"ip-10-0-138-210.ec2.internal\" DevicePath \"\"" Sep 11 02:56:00.656342 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:56:00.656242 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1321708f-c1c0-42f4-ab0b-58fd2038eb97-trusted-ca-bundle\") on node \"ip-10-0-138-210.ec2.internal\" DevicePath \"\"" Sep 11 02:56:01.225977 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:56:01.225944 2580 generic.go:356] "Generic (PLEG): container finished" podID="1321708f-c1c0-42f4-ab0b-58fd2038eb97" containerID="7ef959f3735101f06e89db13ce5441322272f7b1f8e1d7acee8c84ecb067e360" exitCode=0 Sep 11 02:56:01.226361 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:56:01.225982 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f8d566cc6-5mc96" Sep 11 02:56:01.226361 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:56:01.226021 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f8d566cc6-5mc96" event={"ID":"1321708f-c1c0-42f4-ab0b-58fd2038eb97","Type":"ContainerDied","Data":"7ef959f3735101f06e89db13ce5441322272f7b1f8e1d7acee8c84ecb067e360"} Sep 11 02:56:01.226361 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:56:01.226065 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f8d566cc6-5mc96" event={"ID":"1321708f-c1c0-42f4-ab0b-58fd2038eb97","Type":"ContainerDied","Data":"df679cd13bfec1cf2aef354bbf4568ce530c0e66884f3959fc34acb7a7aa223d"} Sep 11 02:56:01.226361 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:56:01.226084 2580 scope.go:117] "RemoveContainer" containerID="7ef959f3735101f06e89db13ce5441322272f7b1f8e1d7acee8c84ecb067e360" Sep 11 02:56:01.234792 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:56:01.234775 2580 scope.go:117] "RemoveContainer" containerID="7ef959f3735101f06e89db13ce5441322272f7b1f8e1d7acee8c84ecb067e360" Sep 11 02:56:01.235058 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:56:01.235042 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ef959f3735101f06e89db13ce5441322272f7b1f8e1d7acee8c84ecb067e360\": container with ID starting with 7ef959f3735101f06e89db13ce5441322272f7b1f8e1d7acee8c84ecb067e360 not found: ID does not exist" containerID="7ef959f3735101f06e89db13ce5441322272f7b1f8e1d7acee8c84ecb067e360" Sep 11 02:56:01.235113 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:56:01.235068 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ef959f3735101f06e89db13ce5441322272f7b1f8e1d7acee8c84ecb067e360"} err="failed to get container status \"7ef959f3735101f06e89db13ce5441322272f7b1f8e1d7acee8c84ecb067e360\": rpc error: code = NotFound desc = could not find container \"7ef959f3735101f06e89db13ce5441322272f7b1f8e1d7acee8c84ecb067e360\": container with ID starting with 7ef959f3735101f06e89db13ce5441322272f7b1f8e1d7acee8c84ecb067e360 not found: ID does not exist" Sep 11 02:56:01.246643 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:56:01.246609 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f8d566cc6-5mc96"] Sep 11 02:56:01.250221 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:56:01.250200 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-f8d566cc6-5mc96"] Sep 11 02:56:01.346328 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:56:01.343791 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1321708f-c1c0-42f4-ab0b-58fd2038eb97" path="/var/lib/kubelet/pods/1321708f-c1c0-42f4-ab0b-58fd2038eb97/volumes" Sep 11 02:56:21.716463 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:56:21.716428 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:56:21.731888 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:56:21.731864 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:56:22.318782 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:56:22.318755 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 02:56:50.738613 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:56:50.738575 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-76b7545c7-fs678"] Sep 11 02:56:50.739195 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:56:50.738998 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1321708f-c1c0-42f4-ab0b-58fd2038eb97" containerName="console" Sep 11 02:56:50.739195 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:56:50.739016 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1321708f-c1c0-42f4-ab0b-58fd2038eb97" containerName="console" Sep 11 02:56:50.739195 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:56:50.739084 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="1321708f-c1c0-42f4-ab0b-58fd2038eb97" containerName="console" Sep 11 02:56:50.741943 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:56:50.741924 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76b7545c7-fs678" Sep 11 02:56:50.760042 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:56:50.760019 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76b7545c7-fs678"] Sep 11 02:56:50.913556 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:56:50.913530 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0321ff70-e74d-4b40-80dd-d8c9fe1460a6-oauth-serving-cert\") pod \"console-76b7545c7-fs678\" (UID: \"0321ff70-e74d-4b40-80dd-d8c9fe1460a6\") " pod="openshift-console/console-76b7545c7-fs678" Sep 11 02:56:50.913714 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:56:50.913570 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgjhh\" (UniqueName: \"kubernetes.io/projected/0321ff70-e74d-4b40-80dd-d8c9fe1460a6-kube-api-access-bgjhh\") pod \"console-76b7545c7-fs678\" (UID: \"0321ff70-e74d-4b40-80dd-d8c9fe1460a6\") " pod="openshift-console/console-76b7545c7-fs678" Sep 11 02:56:50.913714 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:56:50.913589 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0321ff70-e74d-4b40-80dd-d8c9fe1460a6-console-config\") pod \"console-76b7545c7-fs678\" (UID: \"0321ff70-e74d-4b40-80dd-d8c9fe1460a6\") " pod="openshift-console/console-76b7545c7-fs678" Sep 11 02:56:50.913714 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:56:50.913654 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0321ff70-e74d-4b40-80dd-d8c9fe1460a6-console-oauth-config\") pod \"console-76b7545c7-fs678\" (UID: \"0321ff70-e74d-4b40-80dd-d8c9fe1460a6\") " pod="openshift-console/console-76b7545c7-fs678" Sep 11 02:56:50.913714 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:56:50.913674 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0321ff70-e74d-4b40-80dd-d8c9fe1460a6-service-ca\") pod \"console-76b7545c7-fs678\" (UID: \"0321ff70-e74d-4b40-80dd-d8c9fe1460a6\") " pod="openshift-console/console-76b7545c7-fs678" Sep 11 02:56:50.913854 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:56:50.913714 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0321ff70-e74d-4b40-80dd-d8c9fe1460a6-trusted-ca-bundle\") pod \"console-76b7545c7-fs678\" (UID: \"0321ff70-e74d-4b40-80dd-d8c9fe1460a6\") " pod="openshift-console/console-76b7545c7-fs678" Sep 11 02:56:50.913854 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:56:50.913739 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0321ff70-e74d-4b40-80dd-d8c9fe1460a6-console-serving-cert\") pod \"console-76b7545c7-fs678\" (UID: \"0321ff70-e74d-4b40-80dd-d8c9fe1460a6\") " pod="openshift-console/console-76b7545c7-fs678" Sep 11 02:56:51.014337 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:56:51.014284 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgjhh\" (UniqueName: \"kubernetes.io/projected/0321ff70-e74d-4b40-80dd-d8c9fe1460a6-kube-api-access-bgjhh\") pod \"console-76b7545c7-fs678\" (UID: \"0321ff70-e74d-4b40-80dd-d8c9fe1460a6\") " pod="openshift-console/console-76b7545c7-fs678" Sep 11 02:56:51.014337 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:56:51.014314 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0321ff70-e74d-4b40-80dd-d8c9fe1460a6-console-config\") pod \"console-76b7545c7-fs678\" (UID: \"0321ff70-e74d-4b40-80dd-d8c9fe1460a6\") " pod="openshift-console/console-76b7545c7-fs678" Sep 11 02:56:51.014337 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:56:51.014338 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0321ff70-e74d-4b40-80dd-d8c9fe1460a6-console-oauth-config\") pod \"console-76b7545c7-fs678\" (UID: \"0321ff70-e74d-4b40-80dd-d8c9fe1460a6\") " pod="openshift-console/console-76b7545c7-fs678" Sep 11 02:56:51.014547 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:56:51.014353 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0321ff70-e74d-4b40-80dd-d8c9fe1460a6-service-ca\") pod \"console-76b7545c7-fs678\" (UID: \"0321ff70-e74d-4b40-80dd-d8c9fe1460a6\") " pod="openshift-console/console-76b7545c7-fs678" Sep 11 02:56:51.014547 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:56:51.014370 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0321ff70-e74d-4b40-80dd-d8c9fe1460a6-trusted-ca-bundle\") pod \"console-76b7545c7-fs678\" (UID: \"0321ff70-e74d-4b40-80dd-d8c9fe1460a6\") " pod="openshift-console/console-76b7545c7-fs678" Sep 11 02:56:51.014547 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:56:51.014407 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0321ff70-e74d-4b40-80dd-d8c9fe1460a6-console-serving-cert\") pod \"console-76b7545c7-fs678\" (UID: \"0321ff70-e74d-4b40-80dd-d8c9fe1460a6\") " pod="openshift-console/console-76b7545c7-fs678" Sep 11 02:56:51.014547 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:56:51.014447 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0321ff70-e74d-4b40-80dd-d8c9fe1460a6-oauth-serving-cert\") pod \"console-76b7545c7-fs678\" (UID: \"0321ff70-e74d-4b40-80dd-d8c9fe1460a6\") " pod="openshift-console/console-76b7545c7-fs678" Sep 11 02:56:51.015153 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:56:51.015122 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0321ff70-e74d-4b40-80dd-d8c9fe1460a6-console-config\") pod \"console-76b7545c7-fs678\" (UID: \"0321ff70-e74d-4b40-80dd-d8c9fe1460a6\") " pod="openshift-console/console-76b7545c7-fs678" Sep 11 02:56:51.015263 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:56:51.015152 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0321ff70-e74d-4b40-80dd-d8c9fe1460a6-oauth-serving-cert\") pod \"console-76b7545c7-fs678\" (UID: \"0321ff70-e74d-4b40-80dd-d8c9fe1460a6\") " pod="openshift-console/console-76b7545c7-fs678" Sep 11 02:56:51.015263 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:56:51.015145 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0321ff70-e74d-4b40-80dd-d8c9fe1460a6-service-ca\") pod \"console-76b7545c7-fs678\" (UID: \"0321ff70-e74d-4b40-80dd-d8c9fe1460a6\") " pod="openshift-console/console-76b7545c7-fs678" Sep 11 02:56:51.015263 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:56:51.015249 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0321ff70-e74d-4b40-80dd-d8c9fe1460a6-trusted-ca-bundle\") pod \"console-76b7545c7-fs678\" (UID: \"0321ff70-e74d-4b40-80dd-d8c9fe1460a6\") " pod="openshift-console/console-76b7545c7-fs678" Sep 11 02:56:51.017058 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:56:51.017031 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0321ff70-e74d-4b40-80dd-d8c9fe1460a6-console-oauth-config\") pod \"console-76b7545c7-fs678\" (UID: \"0321ff70-e74d-4b40-80dd-d8c9fe1460a6\") " pod="openshift-console/console-76b7545c7-fs678" Sep 11 02:56:51.017129 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:56:51.017066 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0321ff70-e74d-4b40-80dd-d8c9fe1460a6-console-serving-cert\") pod \"console-76b7545c7-fs678\" (UID: \"0321ff70-e74d-4b40-80dd-d8c9fe1460a6\") " pod="openshift-console/console-76b7545c7-fs678" Sep 11 02:56:51.022948 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:56:51.022931 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgjhh\" (UniqueName: \"kubernetes.io/projected/0321ff70-e74d-4b40-80dd-d8c9fe1460a6-kube-api-access-bgjhh\") pod \"console-76b7545c7-fs678\" (UID: \"0321ff70-e74d-4b40-80dd-d8c9fe1460a6\") " pod="openshift-console/console-76b7545c7-fs678" Sep 11 02:56:51.050775 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:56:51.050752 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76b7545c7-fs678" Sep 11 02:56:51.324844 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:56:51.324768 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76b7545c7-fs678"] Sep 11 02:56:51.327588 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:56:51.327559 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0321ff70_e74d_4b40_80dd_d8c9fe1460a6.slice/crio-78585c0004a9370442d6afb8460f25156b14a11eba7b9dab0cebd1736704d26d WatchSource:0}: Error finding container 78585c0004a9370442d6afb8460f25156b14a11eba7b9dab0cebd1736704d26d: Status 404 returned error can't find the container with id 78585c0004a9370442d6afb8460f25156b14a11eba7b9dab0cebd1736704d26d Sep 11 02:56:51.402116 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:56:51.402088 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76b7545c7-fs678" event={"ID":"0321ff70-e74d-4b40-80dd-d8c9fe1460a6","Type":"ContainerStarted","Data":"05b8bbc7f9d338dc46fe862b6a25bb1ffc9ac24d067b2d18301b5e2ca164f017"} Sep 11 02:56:51.402223 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:56:51.402142 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76b7545c7-fs678" event={"ID":"0321ff70-e74d-4b40-80dd-d8c9fe1460a6","Type":"ContainerStarted","Data":"78585c0004a9370442d6afb8460f25156b14a11eba7b9dab0cebd1736704d26d"} Sep 11 02:56:51.421330 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:56:51.421287 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-76b7545c7-fs678" podStartSLOduration=1.421270879 podStartE2EDuration="1.421270879s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 02:56:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:56:51.41987195 +0000 UTC m=+236.559195178" watchObservedRunningTime="2026-09-11 02:56:51.421270879 +0000 UTC m=+236.560594070" Sep 11 02:57:01.051145 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:01.051110 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-76b7545c7-fs678" Sep 11 02:57:01.051523 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:01.051168 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-76b7545c7-fs678" Sep 11 02:57:01.055876 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:01.055854 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-76b7545c7-fs678" Sep 11 02:57:01.441814 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:01.441743 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-76b7545c7-fs678" Sep 11 02:57:01.487788 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:01.487754 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-864cdd6964-x4rpx"] Sep 11 02:57:19.494062 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:19.493993 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-h2th6_2e4f9c4a-e3a1-4ce8-b1c2-fdc15eef432a/global-pull-secret-syncer/0.log" Sep 11 02:57:19.562238 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:19.562209 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-tzxkr_c31501a3-cea9-47fd-af08-6fb89a5d3e6c/konnectivity-agent/0.log" Sep 11 02:57:19.657345 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:19.657319 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-210.ec2.internal_8374f836a1cb97d92580857849ff95ac/haproxy/0.log" Sep 11 02:57:23.003385 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:23.003357 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_32057561-68b9-4f96-b477-bb8f988a4dfa/alertmanager/0.log" Sep 11 02:57:23.037297 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:23.037273 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_32057561-68b9-4f96-b477-bb8f988a4dfa/config-reloader/0.log" Sep 11 02:57:23.066371 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:23.066348 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_32057561-68b9-4f96-b477-bb8f988a4dfa/kube-rbac-proxy-web/0.log" Sep 11 02:57:23.094539 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:23.094523 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_32057561-68b9-4f96-b477-bb8f988a4dfa/kube-rbac-proxy/0.log" Sep 11 02:57:23.131604 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:23.131584 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_32057561-68b9-4f96-b477-bb8f988a4dfa/kube-rbac-proxy-metric/0.log" Sep 11 02:57:23.164587 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:23.164566 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_32057561-68b9-4f96-b477-bb8f988a4dfa/prom-label-proxy/0.log" Sep 11 02:57:23.190650 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:23.190633 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_32057561-68b9-4f96-b477-bb8f988a4dfa/init-config-reloader/0.log" Sep 11 02:57:23.260153 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:23.260096 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-8kcmh_76cb2384-d3a5-4d57-a912-acdf2d2eee83/kube-state-metrics/0.log" Sep 11 02:57:23.286145 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:23.286117 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-8kcmh_76cb2384-d3a5-4d57-a912-acdf2d2eee83/kube-rbac-proxy-main/0.log" Sep 11 02:57:23.316017 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:23.315997 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-8kcmh_76cb2384-d3a5-4d57-a912-acdf2d2eee83/kube-rbac-proxy-self/0.log" Sep 11 02:57:23.498953 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:23.498919 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-j67df_f6cd68d6-662f-4fed-a498-9b33eeed647d/node-exporter/0.log" Sep 11 02:57:23.519435 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:23.519377 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-j67df_f6cd68d6-662f-4fed-a498-9b33eeed647d/kube-rbac-proxy/0.log" Sep 11 02:57:23.542868 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:23.542841 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-j67df_f6cd68d6-662f-4fed-a498-9b33eeed647d/init-textfile/0.log" Sep 11 02:57:23.739252 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:23.739228 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_00c935c0-4c70-484a-b76f-d353a4024ff5/prometheus/0.log" Sep 11 02:57:23.761262 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:23.761245 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_00c935c0-4c70-484a-b76f-d353a4024ff5/config-reloader/0.log" Sep 11 02:57:23.789281 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:23.789197 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_00c935c0-4c70-484a-b76f-d353a4024ff5/thanos-sidecar/0.log" Sep 11 02:57:23.806412 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:23.806389 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_00c935c0-4c70-484a-b76f-d353a4024ff5/kube-rbac-proxy-web/0.log" Sep 11 02:57:23.834773 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:23.834753 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_00c935c0-4c70-484a-b76f-d353a4024ff5/kube-rbac-proxy/0.log" Sep 11 02:57:23.858592 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:23.858573 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_00c935c0-4c70-484a-b76f-d353a4024ff5/kube-rbac-proxy-thanos/0.log" Sep 11 02:57:23.883434 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:23.883418 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_00c935c0-4c70-484a-b76f-d353a4024ff5/init-config-reloader/0.log" Sep 11 02:57:24.107480 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:24.107454 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78f8566f6f-tcrrf_f4a7a8df-9ef1-475d-a27a-696e65035073/thanos-query/0.log" Sep 11 02:57:24.128200 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:24.128183 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78f8566f6f-tcrrf_f4a7a8df-9ef1-475d-a27a-696e65035073/kube-rbac-proxy-web/0.log" Sep 11 02:57:24.148116 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:24.148097 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78f8566f6f-tcrrf_f4a7a8df-9ef1-475d-a27a-696e65035073/kube-rbac-proxy/0.log" Sep 11 02:57:24.168846 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:24.168824 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78f8566f6f-tcrrf_f4a7a8df-9ef1-475d-a27a-696e65035073/prom-label-proxy/0.log" Sep 11 02:57:24.188259 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:24.188239 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78f8566f6f-tcrrf_f4a7a8df-9ef1-475d-a27a-696e65035073/kube-rbac-proxy-rules/0.log" Sep 11 02:57:24.217297 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:24.217277 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78f8566f6f-tcrrf_f4a7a8df-9ef1-475d-a27a-696e65035073/kube-rbac-proxy-metrics/0.log" Sep 11 02:57:26.347016 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:26.346990 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-76b7545c7-fs678_0321ff70-e74d-4b40-80dd-d8c9fe1460a6/console/0.log" Sep 11 02:57:26.374315 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:26.374292 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-864cdd6964-x4rpx_b3a70bbb-728e-4e92-8055-d14dbb4cfe8c/console/0.log" Sep 11 02:57:26.509917 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:26.509865 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-864cdd6964-x4rpx" podUID="b3a70bbb-728e-4e92-8055-d14dbb4cfe8c" containerName="console" containerID="cri-o://bd0291d5cb9178953ba09b27ffdb83d85dcce06d4ad40c6305c3e3d5f68670f6" gracePeriod=15 Sep 11 02:57:26.748484 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:26.748463 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-864cdd6964-x4rpx" Sep 11 02:57:26.771240 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:26.771206 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b3a70bbb-728e-4e92-8055-d14dbb4cfe8c-console-oauth-config\") pod \"b3a70bbb-728e-4e92-8055-d14dbb4cfe8c\" (UID: \"b3a70bbb-728e-4e92-8055-d14dbb4cfe8c\") " Sep 11 02:57:26.771369 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:26.771267 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3a70bbb-728e-4e92-8055-d14dbb4cfe8c-trusted-ca-bundle\") pod \"b3a70bbb-728e-4e92-8055-d14dbb4cfe8c\" (UID: \"b3a70bbb-728e-4e92-8055-d14dbb4cfe8c\") " Sep 11 02:57:26.771449 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:26.771430 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b3a70bbb-728e-4e92-8055-d14dbb4cfe8c-oauth-serving-cert\") pod \"b3a70bbb-728e-4e92-8055-d14dbb4cfe8c\" (UID: \"b3a70bbb-728e-4e92-8055-d14dbb4cfe8c\") " Sep 11 02:57:26.771516 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:26.771467 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x6zrt\" (UniqueName: \"kubernetes.io/projected/b3a70bbb-728e-4e92-8055-d14dbb4cfe8c-kube-api-access-x6zrt\") pod \"b3a70bbb-728e-4e92-8055-d14dbb4cfe8c\" (UID: \"b3a70bbb-728e-4e92-8055-d14dbb4cfe8c\") " Sep 11 02:57:26.771573 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:26.771526 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b3a70bbb-728e-4e92-8055-d14dbb4cfe8c-console-config\") pod \"b3a70bbb-728e-4e92-8055-d14dbb4cfe8c\" (UID: \"b3a70bbb-728e-4e92-8055-d14dbb4cfe8c\") " Sep 11 02:57:26.771657 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:26.771570 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b3a70bbb-728e-4e92-8055-d14dbb4cfe8c-console-serving-cert\") pod \"b3a70bbb-728e-4e92-8055-d14dbb4cfe8c\" (UID: \"b3a70bbb-728e-4e92-8055-d14dbb4cfe8c\") " Sep 11 02:57:26.771657 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:26.771647 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b3a70bbb-728e-4e92-8055-d14dbb4cfe8c-service-ca\") pod \"b3a70bbb-728e-4e92-8055-d14dbb4cfe8c\" (UID: \"b3a70bbb-728e-4e92-8055-d14dbb4cfe8c\") " Sep 11 02:57:26.771754 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:26.771673 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3a70bbb-728e-4e92-8055-d14dbb4cfe8c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b3a70bbb-728e-4e92-8055-d14dbb4cfe8c" (UID: "b3a70bbb-728e-4e92-8055-d14dbb4cfe8c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 02:57:26.771899 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:26.771880 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3a70bbb-728e-4e92-8055-d14dbb4cfe8c-trusted-ca-bundle\") on node \"ip-10-0-138-210.ec2.internal\" DevicePath \"\"" Sep 11 02:57:26.772063 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:26.772043 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3a70bbb-728e-4e92-8055-d14dbb4cfe8c-console-config" (OuterVolumeSpecName: "console-config") pod "b3a70bbb-728e-4e92-8055-d14dbb4cfe8c" (UID: "b3a70bbb-728e-4e92-8055-d14dbb4cfe8c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 02:57:26.772126 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:26.772080 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3a70bbb-728e-4e92-8055-d14dbb4cfe8c-service-ca" (OuterVolumeSpecName: "service-ca") pod "b3a70bbb-728e-4e92-8055-d14dbb4cfe8c" (UID: "b3a70bbb-728e-4e92-8055-d14dbb4cfe8c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 02:57:26.772126 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:26.772084 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3a70bbb-728e-4e92-8055-d14dbb4cfe8c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b3a70bbb-728e-4e92-8055-d14dbb4cfe8c" (UID: "b3a70bbb-728e-4e92-8055-d14dbb4cfe8c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 02:57:26.773431 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:26.773401 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3a70bbb-728e-4e92-8055-d14dbb4cfe8c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b3a70bbb-728e-4e92-8055-d14dbb4cfe8c" (UID: "b3a70bbb-728e-4e92-8055-d14dbb4cfe8c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 02:57:26.774099 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:26.774075 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3a70bbb-728e-4e92-8055-d14dbb4cfe8c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b3a70bbb-728e-4e92-8055-d14dbb4cfe8c" (UID: "b3a70bbb-728e-4e92-8055-d14dbb4cfe8c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 02:57:26.774193 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:26.774171 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3a70bbb-728e-4e92-8055-d14dbb4cfe8c-kube-api-access-x6zrt" (OuterVolumeSpecName: "kube-api-access-x6zrt") pod "b3a70bbb-728e-4e92-8055-d14dbb4cfe8c" (UID: "b3a70bbb-728e-4e92-8055-d14dbb4cfe8c"). InnerVolumeSpecName "kube-api-access-x6zrt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 02:57:26.872263 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:26.872203 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b3a70bbb-728e-4e92-8055-d14dbb4cfe8c-oauth-serving-cert\") on node \"ip-10-0-138-210.ec2.internal\" DevicePath \"\"" Sep 11 02:57:26.872263 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:26.872233 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x6zrt\" (UniqueName: \"kubernetes.io/projected/b3a70bbb-728e-4e92-8055-d14dbb4cfe8c-kube-api-access-x6zrt\") on node \"ip-10-0-138-210.ec2.internal\" DevicePath \"\"" Sep 11 02:57:26.872263 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:26.872243 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b3a70bbb-728e-4e92-8055-d14dbb4cfe8c-console-config\") on node \"ip-10-0-138-210.ec2.internal\" DevicePath \"\"" Sep 11 02:57:26.872263 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:26.872251 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b3a70bbb-728e-4e92-8055-d14dbb4cfe8c-console-serving-cert\") on node \"ip-10-0-138-210.ec2.internal\" DevicePath \"\"" Sep 11 02:57:26.872263 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:26.872259 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b3a70bbb-728e-4e92-8055-d14dbb4cfe8c-service-ca\") on node \"ip-10-0-138-210.ec2.internal\" DevicePath \"\"" Sep 11 02:57:26.872263 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:26.872267 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b3a70bbb-728e-4e92-8055-d14dbb4cfe8c-console-oauth-config\") on node \"ip-10-0-138-210.ec2.internal\" DevicePath \"\"" Sep 11 02:57:27.456000 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:27.455969 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vx2l8/perf-node-gather-daemonset-4n8w5"] Sep 11 02:57:27.456333 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:27.456284 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3a70bbb-728e-4e92-8055-d14dbb4cfe8c" containerName="console" Sep 11 02:57:27.456333 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:27.456296 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3a70bbb-728e-4e92-8055-d14dbb4cfe8c" containerName="console" Sep 11 02:57:27.456402 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:27.456348 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3a70bbb-728e-4e92-8055-d14dbb4cfe8c" containerName="console" Sep 11 02:57:27.460284 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:27.460268 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vx2l8/perf-node-gather-daemonset-4n8w5" Sep 11 02:57:27.463139 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:27.463115 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-vx2l8\"/\"default-dockercfg-dx57p\"" Sep 11 02:57:27.464512 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:27.464374 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vx2l8\"/\"kube-root-ca.crt\"" Sep 11 02:57:27.464512 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:27.464437 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vx2l8\"/\"openshift-service-ca.crt\"" Sep 11 02:57:27.466450 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:27.466425 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vx2l8/perf-node-gather-daemonset-4n8w5"] Sep 11 02:57:27.477443 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:27.477424 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/532f41c8-51d0-42dd-9ec3-225ca7e423e2-sys\") pod \"perf-node-gather-daemonset-4n8w5\" (UID: \"532f41c8-51d0-42dd-9ec3-225ca7e423e2\") " pod="openshift-must-gather-vx2l8/perf-node-gather-daemonset-4n8w5" Sep 11 02:57:27.477540 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:27.477461 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/532f41c8-51d0-42dd-9ec3-225ca7e423e2-lib-modules\") pod \"perf-node-gather-daemonset-4n8w5\" (UID: \"532f41c8-51d0-42dd-9ec3-225ca7e423e2\") " pod="openshift-must-gather-vx2l8/perf-node-gather-daemonset-4n8w5" Sep 11 02:57:27.477540 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:27.477480 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79x2q\" (UniqueName: \"kubernetes.io/projected/532f41c8-51d0-42dd-9ec3-225ca7e423e2-kube-api-access-79x2q\") pod \"perf-node-gather-daemonset-4n8w5\" (UID: \"532f41c8-51d0-42dd-9ec3-225ca7e423e2\") " pod="openshift-must-gather-vx2l8/perf-node-gather-daemonset-4n8w5" Sep 11 02:57:27.477679 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:27.477575 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/532f41c8-51d0-42dd-9ec3-225ca7e423e2-podres\") pod \"perf-node-gather-daemonset-4n8w5\" (UID: \"532f41c8-51d0-42dd-9ec3-225ca7e423e2\") " pod="openshift-must-gather-vx2l8/perf-node-gather-daemonset-4n8w5" Sep 11 02:57:27.477679 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:27.477635 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/532f41c8-51d0-42dd-9ec3-225ca7e423e2-proc\") pod \"perf-node-gather-daemonset-4n8w5\" (UID: \"532f41c8-51d0-42dd-9ec3-225ca7e423e2\") " pod="openshift-must-gather-vx2l8/perf-node-gather-daemonset-4n8w5" Sep 11 02:57:27.529767 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:27.529741 2580 generic.go:356] "Generic (PLEG): container finished" podID="b3a70bbb-728e-4e92-8055-d14dbb4cfe8c" containerID="bd0291d5cb9178953ba09b27ffdb83d85dcce06d4ad40c6305c3e3d5f68670f6" exitCode=0 Sep 11 02:57:27.529854 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:27.529792 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-864cdd6964-x4rpx" event={"ID":"b3a70bbb-728e-4e92-8055-d14dbb4cfe8c","Type":"ContainerDied","Data":"bd0291d5cb9178953ba09b27ffdb83d85dcce06d4ad40c6305c3e3d5f68670f6"} Sep 11 02:57:27.529854 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:27.529800 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-864cdd6964-x4rpx" Sep 11 02:57:27.529854 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:27.529821 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-864cdd6964-x4rpx" event={"ID":"b3a70bbb-728e-4e92-8055-d14dbb4cfe8c","Type":"ContainerDied","Data":"fd4c0309ba86b5ef75ac33347f02ed7dbe1b96e7e154aa6beb8076f4de85217a"} Sep 11 02:57:27.529854 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:27.529839 2580 scope.go:117] "RemoveContainer" containerID="bd0291d5cb9178953ba09b27ffdb83d85dcce06d4ad40c6305c3e3d5f68670f6" Sep 11 02:57:27.537872 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:27.537855 2580 scope.go:117] "RemoveContainer" containerID="bd0291d5cb9178953ba09b27ffdb83d85dcce06d4ad40c6305c3e3d5f68670f6" Sep 11 02:57:27.538156 ip-10-0-138-210 kubenswrapper[2580]: E0911 02:57:27.538139 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd0291d5cb9178953ba09b27ffdb83d85dcce06d4ad40c6305c3e3d5f68670f6\": container with ID starting with bd0291d5cb9178953ba09b27ffdb83d85dcce06d4ad40c6305c3e3d5f68670f6 not found: ID does not exist" containerID="bd0291d5cb9178953ba09b27ffdb83d85dcce06d4ad40c6305c3e3d5f68670f6" Sep 11 02:57:27.538201 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:27.538164 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd0291d5cb9178953ba09b27ffdb83d85dcce06d4ad40c6305c3e3d5f68670f6"} err="failed to get container status \"bd0291d5cb9178953ba09b27ffdb83d85dcce06d4ad40c6305c3e3d5f68670f6\": rpc error: code = NotFound desc = could not find container \"bd0291d5cb9178953ba09b27ffdb83d85dcce06d4ad40c6305c3e3d5f68670f6\": container with ID starting with bd0291d5cb9178953ba09b27ffdb83d85dcce06d4ad40c6305c3e3d5f68670f6 not found: ID does not exist" Sep 11 02:57:27.546197 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:27.546166 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-864cdd6964-x4rpx"] Sep 11 02:57:27.552079 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:27.552060 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-864cdd6964-x4rpx"] Sep 11 02:57:27.578241 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:27.578218 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/532f41c8-51d0-42dd-9ec3-225ca7e423e2-sys\") pod \"perf-node-gather-daemonset-4n8w5\" (UID: \"532f41c8-51d0-42dd-9ec3-225ca7e423e2\") " pod="openshift-must-gather-vx2l8/perf-node-gather-daemonset-4n8w5" Sep 11 02:57:27.578328 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:27.578278 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/532f41c8-51d0-42dd-9ec3-225ca7e423e2-lib-modules\") pod \"perf-node-gather-daemonset-4n8w5\" (UID: \"532f41c8-51d0-42dd-9ec3-225ca7e423e2\") " pod="openshift-must-gather-vx2l8/perf-node-gather-daemonset-4n8w5" Sep 11 02:57:27.578328 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:27.578308 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79x2q\" (UniqueName: \"kubernetes.io/projected/532f41c8-51d0-42dd-9ec3-225ca7e423e2-kube-api-access-79x2q\") pod \"perf-node-gather-daemonset-4n8w5\" (UID: \"532f41c8-51d0-42dd-9ec3-225ca7e423e2\") " pod="openshift-must-gather-vx2l8/perf-node-gather-daemonset-4n8w5" Sep 11 02:57:27.578446 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:27.578333 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/532f41c8-51d0-42dd-9ec3-225ca7e423e2-sys\") pod \"perf-node-gather-daemonset-4n8w5\" (UID: \"532f41c8-51d0-42dd-9ec3-225ca7e423e2\") " pod="openshift-must-gather-vx2l8/perf-node-gather-daemonset-4n8w5" Sep 11 02:57:27.578446 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:27.578348 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/532f41c8-51d0-42dd-9ec3-225ca7e423e2-podres\") pod \"perf-node-gather-daemonset-4n8w5\" (UID: \"532f41c8-51d0-42dd-9ec3-225ca7e423e2\") " pod="openshift-must-gather-vx2l8/perf-node-gather-daemonset-4n8w5" Sep 11 02:57:27.578446 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:27.578385 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/532f41c8-51d0-42dd-9ec3-225ca7e423e2-proc\") pod \"perf-node-gather-daemonset-4n8w5\" (UID: \"532f41c8-51d0-42dd-9ec3-225ca7e423e2\") " pod="openshift-must-gather-vx2l8/perf-node-gather-daemonset-4n8w5" Sep 11 02:57:27.578446 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:27.578434 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/532f41c8-51d0-42dd-9ec3-225ca7e423e2-lib-modules\") pod \"perf-node-gather-daemonset-4n8w5\" (UID: \"532f41c8-51d0-42dd-9ec3-225ca7e423e2\") " pod="openshift-must-gather-vx2l8/perf-node-gather-daemonset-4n8w5" Sep 11 02:57:27.578600 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:27.578479 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/532f41c8-51d0-42dd-9ec3-225ca7e423e2-proc\") pod \"perf-node-gather-daemonset-4n8w5\" (UID: \"532f41c8-51d0-42dd-9ec3-225ca7e423e2\") " pod="openshift-must-gather-vx2l8/perf-node-gather-daemonset-4n8w5" Sep 11 02:57:27.578600 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:27.578489 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/532f41c8-51d0-42dd-9ec3-225ca7e423e2-podres\") pod \"perf-node-gather-daemonset-4n8w5\" (UID: \"532f41c8-51d0-42dd-9ec3-225ca7e423e2\") " pod="openshift-must-gather-vx2l8/perf-node-gather-daemonset-4n8w5" Sep 11 02:57:27.587116 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:27.587093 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79x2q\" (UniqueName: \"kubernetes.io/projected/532f41c8-51d0-42dd-9ec3-225ca7e423e2-kube-api-access-79x2q\") pod \"perf-node-gather-daemonset-4n8w5\" (UID: \"532f41c8-51d0-42dd-9ec3-225ca7e423e2\") " pod="openshift-must-gather-vx2l8/perf-node-gather-daemonset-4n8w5" Sep 11 02:57:27.732694 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:27.732673 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vf6hb_78189675-5274-4826-99e2-69c83a7b59e3/dns/0.log" Sep 11 02:57:27.752066 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:27.752037 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vf6hb_78189675-5274-4826-99e2-69c83a7b59e3/kube-rbac-proxy/0.log" Sep 11 02:57:27.770612 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:27.770594 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vx2l8/perf-node-gather-daemonset-4n8w5" Sep 11 02:57:27.797260 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:27.797241 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5qzk7_f5755599-e56c-401d-bec3-6543e0f8ab40/dns-node-resolver/0.log" Sep 11 02:57:28.040357 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:28.040333 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vx2l8/perf-node-gather-daemonset-4n8w5"] Sep 11 02:57:28.042940 ip-10-0-138-210 kubenswrapper[2580]: W0911 02:57:28.042901 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod532f41c8_51d0_42dd_9ec3_225ca7e423e2.slice/crio-52dc7158a8631c25b61d4bc2a3f9b61009a21018baecc52aad57057841cc2270 WatchSource:0}: Error finding container 52dc7158a8631c25b61d4bc2a3f9b61009a21018baecc52aad57057841cc2270: Status 404 returned error can't find the container with id 52dc7158a8631c25b61d4bc2a3f9b61009a21018baecc52aad57057841cc2270 Sep 11 02:57:28.218293 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:28.218269 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-d26rx_cad088c2-48c1-4e27-83e0-40244586b0c0/node-ca/0.log" Sep 11 02:57:28.535202 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:28.535176 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vx2l8/perf-node-gather-daemonset-4n8w5" event={"ID":"532f41c8-51d0-42dd-9ec3-225ca7e423e2","Type":"ContainerStarted","Data":"265555aa7aee63aea149295643f50936db250912c22f6c21206a40cfcdaff134"} Sep 11 02:57:28.535587 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:28.535221 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vx2l8/perf-node-gather-daemonset-4n8w5" event={"ID":"532f41c8-51d0-42dd-9ec3-225ca7e423e2","Type":"ContainerStarted","Data":"52dc7158a8631c25b61d4bc2a3f9b61009a21018baecc52aad57057841cc2270"} Sep 11 02:57:28.535587 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:28.535262 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-vx2l8/perf-node-gather-daemonset-4n8w5" Sep 11 02:57:28.550213 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:28.550112 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vx2l8/perf-node-gather-daemonset-4n8w5" podStartSLOduration=1.550096898 podStartE2EDuration="1.550096898s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 02:57:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 02:57:28.549722351 +0000 UTC m=+273.689045539" watchObservedRunningTime="2026-09-11 02:57:28.550096898 +0000 UTC m=+273.689420090" Sep 11 02:57:29.276216 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:29.276187 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vpgxz_c7169bef-9526-47a6-accd-4192623b9eca/serve-healthcheck-canary/0.log" Sep 11 02:57:29.342980 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:29.342952 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3a70bbb-728e-4e92-8055-d14dbb4cfe8c" path="/var/lib/kubelet/pods/b3a70bbb-728e-4e92-8055-d14dbb4cfe8c/volumes" Sep 11 02:57:29.601130 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:29.601068 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8chld_d361fc5b-5ed7-460a-ba3b-d1789ce6f25d/kube-rbac-proxy/0.log" Sep 11 02:57:29.650522 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:29.650498 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8chld_d361fc5b-5ed7-460a-ba3b-d1789ce6f25d/exporter/0.log" Sep 11 02:57:29.675092 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:29.675069 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8chld_d361fc5b-5ed7-460a-ba3b-d1789ce6f25d/extractor/0.log" Sep 11 02:57:34.548487 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:34.548458 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-vx2l8/perf-node-gather-daemonset-4n8w5" Sep 11 02:57:34.678158 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:34.678135 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lh4rj_7fba1324-3940-475b-9d4d-4557d2c7f603/kube-multus-additional-cni-plugins/0.log" Sep 11 02:57:34.704001 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:34.703976 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lh4rj_7fba1324-3940-475b-9d4d-4557d2c7f603/egress-router-binary-copy/0.log" Sep 11 02:57:34.729844 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:34.729828 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lh4rj_7fba1324-3940-475b-9d4d-4557d2c7f603/cni-plugins/0.log" Sep 11 02:57:34.750769 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:34.750755 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lh4rj_7fba1324-3940-475b-9d4d-4557d2c7f603/bond-cni-plugin/0.log" Sep 11 02:57:34.772292 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:34.772278 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lh4rj_7fba1324-3940-475b-9d4d-4557d2c7f603/routeoverride-cni/0.log" Sep 11 02:57:34.793343 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:34.793328 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lh4rj_7fba1324-3940-475b-9d4d-4557d2c7f603/whereabouts-cni-bincopy/0.log" Sep 11 02:57:34.813889 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:34.813841 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lh4rj_7fba1324-3940-475b-9d4d-4557d2c7f603/whereabouts-cni/0.log" Sep 11 02:57:34.997807 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:34.997783 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-j54mv_20839eea-3cc5-49bd-9112-ec0fe94ae537/kube-multus/0.log" Sep 11 02:57:35.180367 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:35.180306 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qb9m9_1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237/network-metrics-daemon/0.log" Sep 11 02:57:35.200174 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:35.200152 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qb9m9_1ce5d1e5-34a0-476f-a8b4-8d8aacb9b237/kube-rbac-proxy/0.log" Sep 11 02:57:35.914163 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:35.914131 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jv2sz_77be8a04-830c-44b1-b712-725ffff73a4e/ovn-controller/0.log" Sep 11 02:57:35.932897 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:35.932876 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jv2sz_77be8a04-830c-44b1-b712-725ffff73a4e/ovn-acl-logging/0.log" Sep 11 02:57:35.956393 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:35.956368 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jv2sz_77be8a04-830c-44b1-b712-725ffff73a4e/kube-rbac-proxy-node/0.log" Sep 11 02:57:35.978472 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:35.978451 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jv2sz_77be8a04-830c-44b1-b712-725ffff73a4e/kube-rbac-proxy-ovn-metrics/0.log" Sep 11 02:57:35.999032 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:35.999009 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jv2sz_77be8a04-830c-44b1-b712-725ffff73a4e/northd/0.log" Sep 11 02:57:36.024585 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:36.024563 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jv2sz_77be8a04-830c-44b1-b712-725ffff73a4e/nbdb/0.log" Sep 11 02:57:36.048696 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:36.048608 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jv2sz_77be8a04-830c-44b1-b712-725ffff73a4e/sbdb/0.log" Sep 11 02:57:36.083781 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:36.083763 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jv2sz_77be8a04-830c-44b1-b712-725ffff73a4e/ovnkube-controller/0.log" Sep 11 02:57:37.492362 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:37.492334 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-pxq8g_dffb443d-1d41-4705-a57d-1dbad16fff80/network-check-target-container/0.log" Sep 11 02:57:38.467277 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:38.467209 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-p5427_2167cf85-9290-4962-9f9c-ba69f4fd3866/iptables-alerter/0.log" Sep 11 02:57:39.081345 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:39.081321 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-x6s5v_958470e1-b0b5-42c0-a6ad-b81f134eb760/tuned/0.log" Sep 11 02:57:42.316211 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:42.316179 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-fncs7_f5cae9bb-577e-402b-a4be-e44745036dc9/csi-driver/0.log" Sep 11 02:57:42.361892 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:42.361870 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-fncs7_f5cae9bb-577e-402b-a4be-e44745036dc9/csi-node-driver-registrar/0.log" Sep 11 02:57:42.397761 ip-10-0-138-210 kubenswrapper[2580]: I0911 02:57:42.397731 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-fncs7_f5cae9bb-577e-402b-a4be-e44745036dc9/csi-liveness-probe/0.log"