Apr 22 17:34:10.436532 ip-10-0-138-38 systemd[1]: Starting Kubernetes Kubelet... Apr 22 17:34:10.855408 ip-10-0-138-38 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Apr 22 17:34:10.855408 ip-10-0-138-38 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Apr 22 17:34:10.855408 ip-10-0-138-38 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Apr 22 17:34:10.855408 ip-10-0-138-38 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Apr 22 17:34:10.855408 ip-10-0-138-38 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Apr 22 17:34:10.857602 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.857507 2576 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Apr 22 17:34:10.860879 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.860863 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Apr 22 17:34:10.860879 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.860880 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Apr 22 17:34:10.860943 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.860884 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Apr 22 17:34:10.860943 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.860888 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Apr 22 17:34:10.860943 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.860890 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Apr 22 17:34:10.860943 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.860894 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Apr 22 17:34:10.860943 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.860896 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Apr 22 17:34:10.860943 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.860899 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Apr 22 17:34:10.860943 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.860902 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Apr 22 17:34:10.860943 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.860905 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Apr 22 17:34:10.860943 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.860908 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Apr 22 17:34:10.860943 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.860910 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Apr 22 17:34:10.860943 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.860913 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Apr 22 17:34:10.860943 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.860916 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Apr 22 17:34:10.860943 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.860919 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Apr 22 17:34:10.860943 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.860921 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Apr 22 17:34:10.860943 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.860924 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Apr 22 17:34:10.860943 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.860947 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Apr 22 17:34:10.860943 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.860951 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Apr 22 17:34:10.861364 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.860954 2576 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Apr 22 17:34:10.861364 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.860956 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Apr 22 17:34:10.861364 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.860959 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Apr 22 17:34:10.861364 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.860961 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Apr 22 17:34:10.861364 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.860964 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Apr 22 17:34:10.861364 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.860966 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Apr 22 17:34:10.861364 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.860969 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Apr 22 17:34:10.861364 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.860971 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Apr 22 17:34:10.861364 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.860973 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Apr 22 17:34:10.861364 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.860976 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Apr 22 17:34:10.861364 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.860979 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Apr 22 17:34:10.861364 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.860981 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Apr 22 17:34:10.861364 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.860985 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Apr 22 17:34:10.861364 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.860987 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Apr 22 17:34:10.861364 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.860990 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Apr 22 17:34:10.861364 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.860992 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Apr 22 17:34:10.861364 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.860995 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Apr 22 17:34:10.861364 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.860997 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Apr 22 17:34:10.861364 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.861000 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Apr 22 17:34:10.861364 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.861002 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Apr 22 17:34:10.861862 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.861005 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Apr 22 17:34:10.861862 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.861008 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Apr 22 17:34:10.861862 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.861010 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Apr 22 17:34:10.861862 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.861012 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Apr 22 17:34:10.861862 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.861015 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Apr 22 17:34:10.861862 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.861017 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Apr 22 17:34:10.861862 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.861019 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Apr 22 17:34:10.861862 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.861022 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Apr 22 17:34:10.861862 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.861025 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Apr 22 17:34:10.861862 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.861027 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Apr 22 17:34:10.861862 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.861029 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Apr 22 17:34:10.861862 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.861032 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Apr 22 17:34:10.861862 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.861035 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Apr 22 17:34:10.861862 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.861038 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Apr 22 17:34:10.861862 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.861041 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Apr 22 17:34:10.861862 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.861043 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Apr 22 17:34:10.861862 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.861046 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Apr 22 17:34:10.861862 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.861048 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Apr 22 17:34:10.861862 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.861051 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Apr 22 17:34:10.862347 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.861054 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Apr 22 17:34:10.862347 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.861056 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Apr 22 17:34:10.862347 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.861059 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Apr 22 17:34:10.862347 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.861063 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Apr 22 17:34:10.862347 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.861065 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Apr 22 17:34:10.862347 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.861067 2576 feature_gate.go:328] unrecognized feature gate: Example2 Apr 22 17:34:10.862347 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.861070 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Apr 22 17:34:10.862347 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.861072 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Apr 22 17:34:10.862347 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.861074 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Apr 22 17:34:10.862347 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.861077 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Apr 22 17:34:10.862347 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.861079 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Apr 22 17:34:10.862347 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.861082 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Apr 22 17:34:10.862347 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.861084 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Apr 22 17:34:10.862347 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.861087 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Apr 22 17:34:10.862347 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.861089 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Apr 22 17:34:10.862347 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.861092 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Apr 22 17:34:10.862347 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.861094 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Apr 22 17:34:10.862347 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.861096 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Apr 22 17:34:10.862347 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.861099 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Apr 22 17:34:10.862347 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.861101 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Apr 22 17:34:10.862837 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.861104 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Apr 22 17:34:10.862837 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.861108 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Apr 22 17:34:10.862837 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.861113 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Apr 22 17:34:10.862837 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.861117 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Apr 22 17:34:10.862837 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.861122 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Apr 22 17:34:10.862837 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.861126 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Apr 22 17:34:10.862837 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.861129 2576 feature_gate.go:328] unrecognized feature gate: Example Apr 22 17:34:10.862837 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.861132 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Apr 22 17:34:10.863247 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863237 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Apr 22 17:34:10.863247 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863247 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Apr 22 17:34:10.863305 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863250 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Apr 22 17:34:10.863305 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863254 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Apr 22 17:34:10.863305 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863257 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Apr 22 17:34:10.863305 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863260 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Apr 22 17:34:10.863305 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863263 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Apr 22 17:34:10.863305 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863266 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Apr 22 17:34:10.863305 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863269 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Apr 22 17:34:10.863305 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863272 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Apr 22 17:34:10.863305 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863274 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Apr 22 17:34:10.863305 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863278 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Apr 22 17:34:10.863305 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863282 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Apr 22 17:34:10.863305 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863285 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Apr 22 17:34:10.863305 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863288 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Apr 22 17:34:10.863305 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863291 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Apr 22 17:34:10.863305 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863293 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Apr 22 17:34:10.863305 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863296 2576 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Apr 22 17:34:10.863305 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863298 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Apr 22 17:34:10.863305 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863301 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Apr 22 17:34:10.863305 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863303 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Apr 22 17:34:10.863305 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863306 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Apr 22 17:34:10.863803 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863309 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Apr 22 17:34:10.863803 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863311 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Apr 22 17:34:10.863803 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863314 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Apr 22 17:34:10.863803 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863317 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Apr 22 17:34:10.863803 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863320 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Apr 22 17:34:10.863803 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863322 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Apr 22 17:34:10.863803 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863325 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Apr 22 17:34:10.863803 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863328 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Apr 22 17:34:10.863803 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863330 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Apr 22 17:34:10.863803 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863333 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Apr 22 17:34:10.863803 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863335 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Apr 22 17:34:10.863803 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863337 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Apr 22 17:34:10.863803 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863340 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Apr 22 17:34:10.863803 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863343 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Apr 22 17:34:10.863803 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863346 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Apr 22 17:34:10.863803 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863348 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Apr 22 17:34:10.863803 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863351 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Apr 22 17:34:10.863803 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863353 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Apr 22 17:34:10.863803 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863355 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Apr 22 17:34:10.863803 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863358 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Apr 22 17:34:10.864398 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863360 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Apr 22 17:34:10.864398 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863363 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Apr 22 17:34:10.864398 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863365 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Apr 22 17:34:10.864398 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863367 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Apr 22 17:34:10.864398 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863370 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Apr 22 17:34:10.864398 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863372 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Apr 22 17:34:10.864398 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863374 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Apr 22 17:34:10.864398 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863377 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Apr 22 17:34:10.864398 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863379 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Apr 22 17:34:10.864398 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863381 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Apr 22 17:34:10.864398 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863384 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Apr 22 17:34:10.864398 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863386 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Apr 22 17:34:10.864398 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863389 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Apr 22 17:34:10.864398 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863392 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Apr 22 17:34:10.864398 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863394 2576 feature_gate.go:328] unrecognized feature gate: Example Apr 22 17:34:10.864398 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863397 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Apr 22 17:34:10.864398 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863399 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Apr 22 17:34:10.864398 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863402 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Apr 22 17:34:10.864398 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863404 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Apr 22 17:34:10.864398 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863406 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Apr 22 17:34:10.865194 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863410 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Apr 22 17:34:10.865194 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863412 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Apr 22 17:34:10.865194 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863416 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Apr 22 17:34:10.865194 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863418 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Apr 22 17:34:10.865194 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863421 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Apr 22 17:34:10.865194 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863424 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Apr 22 17:34:10.865194 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863428 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Apr 22 17:34:10.865194 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863430 2576 feature_gate.go:328] unrecognized feature gate: Example2 Apr 22 17:34:10.865194 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863433 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Apr 22 17:34:10.865194 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863436 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Apr 22 17:34:10.865194 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863439 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Apr 22 17:34:10.865194 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863441 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Apr 22 17:34:10.865194 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863444 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Apr 22 17:34:10.865194 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863447 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Apr 22 17:34:10.865194 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863449 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Apr 22 17:34:10.865194 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863452 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Apr 22 17:34:10.865194 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863454 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Apr 22 17:34:10.865194 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863457 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Apr 22 17:34:10.865194 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863459 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Apr 22 17:34:10.865686 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863462 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Apr 22 17:34:10.865686 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863464 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Apr 22 17:34:10.865686 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863466 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Apr 22 17:34:10.865686 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863469 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Apr 22 17:34:10.865686 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.863471 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Apr 22 17:34:10.865686 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863539 2576 flags.go:64] FLAG: --address="0.0.0.0" Apr 22 17:34:10.865686 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863547 2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Apr 22 17:34:10.865686 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863553 2576 flags.go:64] FLAG: --anonymous-auth="true" Apr 22 17:34:10.865686 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863559 2576 flags.go:64] FLAG: --application-metrics-count-limit="100" Apr 22 17:34:10.865686 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863563 2576 flags.go:64] FLAG: --authentication-token-webhook="false" Apr 22 17:34:10.865686 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863566 2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Apr 22 17:34:10.865686 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863571 2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Apr 22 17:34:10.865686 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863575 2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Apr 22 17:34:10.865686 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863578 2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Apr 22 17:34:10.865686 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863582 2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Apr 22 17:34:10.865686 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863585 2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Apr 22 17:34:10.865686 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863588 2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Apr 22 17:34:10.865686 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863591 2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Apr 22 17:34:10.865686 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863594 2576 flags.go:64] FLAG: --cgroup-root="" Apr 22 17:34:10.865686 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863597 2576 flags.go:64] FLAG: --cgroups-per-qos="true" Apr 22 17:34:10.865686 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863600 2576 flags.go:64] FLAG: --client-ca-file="" Apr 22 17:34:10.865686 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863603 2576 flags.go:64] FLAG: --cloud-config="" Apr 22 17:34:10.865686 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863606 2576 flags.go:64] FLAG: --cloud-provider="external" Apr 22 17:34:10.866273 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863609 2576 flags.go:64] FLAG: --cluster-dns="[]" Apr 22 17:34:10.866273 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863613 2576 flags.go:64] FLAG: --cluster-domain="" Apr 22 17:34:10.866273 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863616 2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Apr 22 17:34:10.866273 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863619 2576 flags.go:64] FLAG: --config-dir="" Apr 22 17:34:10.866273 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863622 2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Apr 22 17:34:10.866273 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863625 2576 flags.go:64] FLAG: --container-log-max-files="5" Apr 22 17:34:10.866273 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863629 2576 flags.go:64] FLAG: --container-log-max-size="10Mi" Apr 22 17:34:10.866273 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863632 2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Apr 22 17:34:10.866273 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863635 2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Apr 22 17:34:10.866273 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863638 2576 flags.go:64] FLAG: --containerd-namespace="k8s.io" Apr 22 17:34:10.866273 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863641 2576 flags.go:64] FLAG: --contention-profiling="false" Apr 22 17:34:10.866273 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863644 2576 flags.go:64] FLAG: --cpu-cfs-quota="true" Apr 22 17:34:10.866273 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863647 2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Apr 22 17:34:10.866273 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863650 2576 flags.go:64] FLAG: --cpu-manager-policy="none" Apr 22 17:34:10.866273 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863653 2576 flags.go:64] FLAG: --cpu-manager-policy-options="" Apr 22 17:34:10.866273 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863658 2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Apr 22 17:34:10.866273 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863661 2576 flags.go:64] FLAG: --enable-controller-attach-detach="true" Apr 22 17:34:10.866273 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863664 2576 flags.go:64] FLAG: --enable-debugging-handlers="true" Apr 22 17:34:10.866273 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863667 2576 flags.go:64] FLAG: --enable-load-reader="false" Apr 22 17:34:10.866273 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863670 2576 flags.go:64] FLAG: --enable-server="true" Apr 22 17:34:10.866273 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863673 2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Apr 22 17:34:10.866273 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863678 2576 flags.go:64] FLAG: --event-burst="100" Apr 22 17:34:10.866273 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863681 2576 flags.go:64] FLAG: --event-qps="50" Apr 22 17:34:10.866273 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863684 2576 flags.go:64] FLAG: --event-storage-age-limit="default=0" Apr 22 17:34:10.866273 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863687 2576 flags.go:64] FLAG: --event-storage-event-limit="default=0" Apr 22 17:34:10.866865 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863690 2576 flags.go:64] FLAG: --eviction-hard="" Apr 22 17:34:10.866865 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863694 2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Apr 22 17:34:10.866865 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863697 2576 flags.go:64] FLAG: --eviction-minimum-reclaim="" Apr 22 17:34:10.866865 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863700 2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Apr 22 17:34:10.866865 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863703 2576 flags.go:64] FLAG: --eviction-soft="" Apr 22 17:34:10.866865 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863706 2576 flags.go:64] FLAG: --eviction-soft-grace-period="" Apr 22 17:34:10.866865 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863709 2576 flags.go:64] FLAG: --exit-on-lock-contention="false" Apr 22 17:34:10.866865 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863711 2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Apr 22 17:34:10.866865 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863715 2576 flags.go:64] FLAG: --experimental-mounter-path="" Apr 22 17:34:10.866865 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863718 2576 flags.go:64] FLAG: --fail-cgroupv1="false" Apr 22 17:34:10.866865 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863720 2576 flags.go:64] FLAG: --fail-swap-on="true" Apr 22 17:34:10.866865 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863723 2576 flags.go:64] FLAG: --feature-gates="" Apr 22 17:34:10.866865 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863727 2576 flags.go:64] FLAG: --file-check-frequency="20s" Apr 22 17:34:10.866865 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863730 2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Apr 22 17:34:10.866865 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863733 2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Apr 22 17:34:10.866865 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863735 2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Apr 22 17:34:10.866865 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863738 2576 flags.go:64] FLAG: --healthz-port="10248" Apr 22 17:34:10.866865 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863741 2576 flags.go:64] FLAG: --help="false" Apr 22 17:34:10.866865 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863744 2576 flags.go:64] FLAG: --hostname-override="ip-10-0-138-38.ec2.internal" Apr 22 17:34:10.866865 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863747 2576 flags.go:64] FLAG: --housekeeping-interval="10s" Apr 22 17:34:10.866865 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863750 2576 flags.go:64] FLAG: --http-check-frequency="20s" Apr 22 17:34:10.866865 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863753 2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Apr 22 17:34:10.866865 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863757 2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Apr 22 17:34:10.866865 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863760 2576 flags.go:64] FLAG: --image-gc-high-threshold="85" Apr 22 17:34:10.867446 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863763 2576 flags.go:64] FLAG: --image-gc-low-threshold="80" Apr 22 17:34:10.867446 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863766 2576 flags.go:64] FLAG: --image-service-endpoint="" Apr 22 17:34:10.867446 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863769 2576 flags.go:64] FLAG: --kernel-memcg-notification="false" Apr 22 17:34:10.867446 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863771 2576 flags.go:64] FLAG: --kube-api-burst="100" Apr 22 17:34:10.867446 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863774 2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Apr 22 17:34:10.867446 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863777 2576 flags.go:64] FLAG: --kube-api-qps="50" Apr 22 17:34:10.867446 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863780 2576 flags.go:64] FLAG: --kube-reserved="" Apr 22 17:34:10.867446 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863782 2576 flags.go:64] FLAG: --kube-reserved-cgroup="" Apr 22 17:34:10.867446 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863785 2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Apr 22 17:34:10.867446 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863789 2576 flags.go:64] FLAG: --kubelet-cgroups="" Apr 22 17:34:10.867446 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863791 2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Apr 22 17:34:10.867446 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863794 2576 flags.go:64] FLAG: --lock-file="" Apr 22 17:34:10.867446 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863797 2576 flags.go:64] FLAG: --log-cadvisor-usage="false" Apr 22 17:34:10.867446 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863800 2576 flags.go:64] FLAG: --log-flush-frequency="5s" Apr 22 17:34:10.867446 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863802 2576 flags.go:64] FLAG: --log-json-info-buffer-size="0" Apr 22 17:34:10.867446 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863808 2576 flags.go:64] FLAG: --log-json-split-stream="false" Apr 22 17:34:10.867446 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863811 2576 flags.go:64] FLAG: --log-text-info-buffer-size="0" Apr 22 17:34:10.867446 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863814 2576 flags.go:64] FLAG: --log-text-split-stream="false" Apr 22 17:34:10.867446 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863817 2576 flags.go:64] FLAG: --logging-format="text" Apr 22 17:34:10.867446 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863819 2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Apr 22 17:34:10.867446 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863823 2576 flags.go:64] FLAG: --make-iptables-util-chains="true" Apr 22 17:34:10.867446 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863825 2576 flags.go:64] FLAG: --manifest-url="" Apr 22 17:34:10.867446 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863828 2576 flags.go:64] FLAG: --manifest-url-header="" Apr 22 17:34:10.867446 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863833 2576 flags.go:64] FLAG: --max-housekeeping-interval="15s" Apr 22 17:34:10.867446 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863836 2576 flags.go:64] FLAG: --max-open-files="1000000" Apr 22 17:34:10.868030 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863840 2576 flags.go:64] FLAG: --max-pods="110" Apr 22 17:34:10.868030 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863843 2576 flags.go:64] FLAG: --maximum-dead-containers="-1" Apr 22 17:34:10.868030 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863846 2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Apr 22 17:34:10.868030 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863848 2576 flags.go:64] FLAG: --memory-manager-policy="None" Apr 22 17:34:10.868030 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863851 2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Apr 22 17:34:10.868030 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863854 2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Apr 22 17:34:10.868030 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863857 2576 flags.go:64] FLAG: --node-ip="0.0.0.0" Apr 22 17:34:10.868030 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863860 2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Apr 22 17:34:10.868030 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863867 2576 flags.go:64] FLAG: --node-status-max-images="50" Apr 22 17:34:10.868030 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863870 2576 flags.go:64] FLAG: --node-status-update-frequency="10s" Apr 22 17:34:10.868030 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863873 2576 flags.go:64] FLAG: --oom-score-adj="-999" Apr 22 17:34:10.868030 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863876 2576 flags.go:64] FLAG: --pod-cidr="" Apr 22 17:34:10.868030 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863879 2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c8cfe89231412ff3ee8cb6207fa0be33cad0f08e88c9c0f1e9f7e8c6f14d6715" Apr 22 17:34:10.868030 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863885 2576 flags.go:64] FLAG: --pod-manifest-path="" Apr 22 17:34:10.868030 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863888 2576 flags.go:64] FLAG: --pod-max-pids="-1" Apr 22 17:34:10.868030 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863891 2576 flags.go:64] FLAG: --pods-per-core="0" Apr 22 17:34:10.868030 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863895 2576 flags.go:64] FLAG: --port="10250" Apr 22 17:34:10.868030 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863898 2576 flags.go:64] FLAG: --protect-kernel-defaults="false" Apr 22 17:34:10.868030 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863901 2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00ee280f4b1dabe5e" Apr 22 17:34:10.868030 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863904 2576 flags.go:64] FLAG: --qos-reserved="" Apr 22 17:34:10.868030 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863907 2576 flags.go:64] FLAG: --read-only-port="10255" Apr 22 17:34:10.868030 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863910 2576 flags.go:64] FLAG: --register-node="true" Apr 22 17:34:10.868030 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863913 2576 flags.go:64] FLAG: --register-schedulable="true" Apr 22 17:34:10.868030 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863916 2576 flags.go:64] FLAG: --register-with-taints="" Apr 22 17:34:10.868644 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863919 2576 flags.go:64] FLAG: --registry-burst="10" Apr 22 17:34:10.868644 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863922 2576 flags.go:64] FLAG: --registry-qps="5" Apr 22 17:34:10.868644 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863925 2576 flags.go:64] FLAG: --reserved-cpus="" Apr 22 17:34:10.868644 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863928 2576 flags.go:64] FLAG: --reserved-memory="" Apr 22 17:34:10.868644 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863935 2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Apr 22 17:34:10.868644 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863939 2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Apr 22 17:34:10.868644 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863942 2576 flags.go:64] FLAG: --rotate-certificates="false" Apr 22 17:34:10.868644 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863945 2576 flags.go:64] FLAG: --rotate-server-certificates="false" Apr 22 17:34:10.868644 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863948 2576 flags.go:64] FLAG: --runonce="false" Apr 22 17:34:10.868644 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863950 2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Apr 22 17:34:10.868644 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863954 2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Apr 22 17:34:10.868644 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863957 2576 flags.go:64] FLAG: --seccomp-default="false" Apr 22 17:34:10.868644 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863960 2576 flags.go:64] FLAG: --serialize-image-pulls="true" Apr 22 17:34:10.868644 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863963 2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Apr 22 17:34:10.868644 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863966 2576 flags.go:64] FLAG: --storage-driver-db="cadvisor" Apr 22 17:34:10.868644 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863969 2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Apr 22 17:34:10.868644 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863972 2576 flags.go:64] FLAG: --storage-driver-password="root" Apr 22 17:34:10.868644 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863974 2576 flags.go:64] FLAG: --storage-driver-secure="false" Apr 22 17:34:10.868644 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863977 2576 flags.go:64] FLAG: --storage-driver-table="stats" Apr 22 17:34:10.868644 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863980 2576 flags.go:64] FLAG: --storage-driver-user="root" Apr 22 17:34:10.868644 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863983 2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Apr 22 17:34:10.868644 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863985 2576 flags.go:64] FLAG: --sync-frequency="1m0s" Apr 22 17:34:10.868644 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863988 2576 flags.go:64] FLAG: --system-cgroups="" Apr 22 17:34:10.868644 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863991 2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Apr 22 17:34:10.868644 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863996 2576 flags.go:64] FLAG: --system-reserved-cgroup="" Apr 22 17:34:10.869252 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.863999 2576 flags.go:64] FLAG: --tls-cert-file="" Apr 22 17:34:10.869252 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.864002 2576 flags.go:64] FLAG: --tls-cipher-suites="[]" Apr 22 17:34:10.869252 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.864006 2576 flags.go:64] FLAG: --tls-min-version="" Apr 22 17:34:10.869252 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.864009 2576 flags.go:64] FLAG: --tls-private-key-file="" Apr 22 17:34:10.869252 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.864012 2576 flags.go:64] FLAG: --topology-manager-policy="none" Apr 22 17:34:10.869252 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.864015 2576 flags.go:64] FLAG: --topology-manager-policy-options="" Apr 22 17:34:10.869252 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.864018 2576 flags.go:64] FLAG: --topology-manager-scope="container" Apr 22 17:34:10.869252 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.864020 2576 flags.go:64] FLAG: --v="2" Apr 22 17:34:10.869252 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.864025 2576 flags.go:64] FLAG: --version="false" Apr 22 17:34:10.869252 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.864029 2576 flags.go:64] FLAG: --vmodule="" Apr 22 17:34:10.869252 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.864033 2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Apr 22 17:34:10.869252 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.864037 2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Apr 22 17:34:10.869252 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864516 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Apr 22 17:34:10.869252 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864531 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Apr 22 17:34:10.869252 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864536 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Apr 22 17:34:10.869252 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864541 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Apr 22 17:34:10.869252 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864545 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Apr 22 17:34:10.869252 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864550 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Apr 22 17:34:10.869252 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864554 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Apr 22 17:34:10.869252 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864558 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Apr 22 17:34:10.869252 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864563 2576 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Apr 22 17:34:10.869252 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864567 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Apr 22 17:34:10.869768 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864571 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Apr 22 17:34:10.869768 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864581 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Apr 22 17:34:10.869768 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864585 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Apr 22 17:34:10.869768 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864590 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Apr 22 17:34:10.869768 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864594 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Apr 22 17:34:10.869768 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864598 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Apr 22 17:34:10.869768 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864602 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Apr 22 17:34:10.869768 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864606 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Apr 22 17:34:10.869768 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864611 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Apr 22 17:34:10.869768 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864615 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Apr 22 17:34:10.869768 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864620 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Apr 22 17:34:10.869768 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864624 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Apr 22 17:34:10.869768 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864628 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Apr 22 17:34:10.869768 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864633 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Apr 22 17:34:10.869768 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864643 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Apr 22 17:34:10.869768 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864647 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Apr 22 17:34:10.869768 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864651 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Apr 22 17:34:10.869768 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864655 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Apr 22 17:34:10.869768 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864665 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Apr 22 17:34:10.869768 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864669 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Apr 22 17:34:10.870290 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864673 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Apr 22 17:34:10.870290 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864678 2576 feature_gate.go:328] unrecognized feature gate: Example2 Apr 22 17:34:10.870290 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864684 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Apr 22 17:34:10.870290 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864688 2576 feature_gate.go:328] unrecognized feature gate: Example Apr 22 17:34:10.870290 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864693 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Apr 22 17:34:10.870290 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864697 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Apr 22 17:34:10.870290 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864706 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Apr 22 17:34:10.870290 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864710 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Apr 22 17:34:10.870290 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864714 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Apr 22 17:34:10.870290 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864719 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Apr 22 17:34:10.870290 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864723 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Apr 22 17:34:10.870290 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864727 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Apr 22 17:34:10.870290 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864731 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Apr 22 17:34:10.870290 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864735 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Apr 22 17:34:10.870290 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864739 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Apr 22 17:34:10.870290 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864743 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Apr 22 17:34:10.870290 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864747 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Apr 22 17:34:10.870290 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864751 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Apr 22 17:34:10.870290 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864755 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Apr 22 17:34:10.870290 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864764 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Apr 22 17:34:10.870769 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864769 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Apr 22 17:34:10.870769 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864773 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Apr 22 17:34:10.870769 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864777 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Apr 22 17:34:10.870769 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864781 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Apr 22 17:34:10.870769 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864787 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Apr 22 17:34:10.870769 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864791 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Apr 22 17:34:10.870769 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864795 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Apr 22 17:34:10.870769 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864799 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Apr 22 17:34:10.870769 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864804 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Apr 22 17:34:10.870769 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864808 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Apr 22 17:34:10.870769 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864814 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Apr 22 17:34:10.870769 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864819 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Apr 22 17:34:10.870769 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864827 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Apr 22 17:34:10.870769 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864831 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Apr 22 17:34:10.870769 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864837 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Apr 22 17:34:10.870769 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864842 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Apr 22 17:34:10.870769 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864846 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Apr 22 17:34:10.870769 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864851 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Apr 22 17:34:10.870769 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864855 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Apr 22 17:34:10.870769 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864859 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Apr 22 17:34:10.871304 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864864 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Apr 22 17:34:10.871304 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864868 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Apr 22 17:34:10.871304 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864872 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Apr 22 17:34:10.871304 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864876 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Apr 22 17:34:10.871304 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864880 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Apr 22 17:34:10.871304 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864889 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Apr 22 17:34:10.871304 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864893 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Apr 22 17:34:10.871304 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864897 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Apr 22 17:34:10.871304 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864902 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Apr 22 17:34:10.871304 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864906 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Apr 22 17:34:10.871304 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864911 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Apr 22 17:34:10.871304 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864917 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Apr 22 17:34:10.871304 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864923 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Apr 22 17:34:10.871304 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864927 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Apr 22 17:34:10.871304 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864931 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Apr 22 17:34:10.871304 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.864937 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Apr 22 17:34:10.871703 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.865646 2576 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Apr 22 17:34:10.874360 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.874334 2576 server.go:530] "Kubelet version" kubeletVersion="v1.33.9" Apr 22 17:34:10.874360 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.874362 2576 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Apr 22 17:34:10.874439 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874414 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Apr 22 17:34:10.874439 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874418 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Apr 22 17:34:10.874439 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874422 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Apr 22 17:34:10.874439 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874425 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Apr 22 17:34:10.874439 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874427 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Apr 22 17:34:10.874439 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874430 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Apr 22 17:34:10.874439 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874433 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Apr 22 17:34:10.874439 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874435 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Apr 22 17:34:10.874439 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874438 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Apr 22 17:34:10.874439 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874441 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Apr 22 17:34:10.874439 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874445 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Apr 22 17:34:10.874715 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874448 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Apr 22 17:34:10.874715 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874450 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Apr 22 17:34:10.874715 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874453 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Apr 22 17:34:10.874715 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874456 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Apr 22 17:34:10.874715 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874458 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Apr 22 17:34:10.874715 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874461 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Apr 22 17:34:10.874715 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874464 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Apr 22 17:34:10.874715 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874467 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Apr 22 17:34:10.874715 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874469 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Apr 22 17:34:10.874715 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874472 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Apr 22 17:34:10.874715 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874475 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Apr 22 17:34:10.874715 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874477 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Apr 22 17:34:10.874715 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874480 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Apr 22 17:34:10.874715 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874483 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Apr 22 17:34:10.874715 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874485 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Apr 22 17:34:10.874715 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874488 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Apr 22 17:34:10.874715 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874492 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Apr 22 17:34:10.874715 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874497 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Apr 22 17:34:10.874715 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874500 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Apr 22 17:34:10.875227 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874503 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Apr 22 17:34:10.875227 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874505 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Apr 22 17:34:10.875227 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874508 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Apr 22 17:34:10.875227 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874511 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Apr 22 17:34:10.875227 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874513 2576 feature_gate.go:328] unrecognized feature gate: Example2 Apr 22 17:34:10.875227 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874516 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Apr 22 17:34:10.875227 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874518 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Apr 22 17:34:10.875227 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874521 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Apr 22 17:34:10.875227 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874523 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Apr 22 17:34:10.875227 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874525 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Apr 22 17:34:10.875227 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874528 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Apr 22 17:34:10.875227 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874530 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Apr 22 17:34:10.875227 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874533 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Apr 22 17:34:10.875227 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874536 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Apr 22 17:34:10.875227 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874540 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Apr 22 17:34:10.875227 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874543 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Apr 22 17:34:10.875227 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874545 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Apr 22 17:34:10.875227 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874548 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Apr 22 17:34:10.875227 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874551 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Apr 22 17:34:10.875227 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874553 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Apr 22 17:34:10.875707 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874556 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Apr 22 17:34:10.875707 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874559 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Apr 22 17:34:10.875707 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874562 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Apr 22 17:34:10.875707 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874565 2576 feature_gate.go:328] unrecognized feature gate: Example Apr 22 17:34:10.875707 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874567 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Apr 22 17:34:10.875707 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874570 2576 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Apr 22 17:34:10.875707 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874572 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Apr 22 17:34:10.875707 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874575 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Apr 22 17:34:10.875707 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874578 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Apr 22 17:34:10.875707 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874580 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Apr 22 17:34:10.875707 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874583 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Apr 22 17:34:10.875707 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874585 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Apr 22 17:34:10.875707 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874587 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Apr 22 17:34:10.875707 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874591 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Apr 22 17:34:10.875707 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874594 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Apr 22 17:34:10.875707 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874596 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Apr 22 17:34:10.875707 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874599 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Apr 22 17:34:10.875707 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874602 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Apr 22 17:34:10.875707 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874604 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Apr 22 17:34:10.875707 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874607 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Apr 22 17:34:10.876220 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874609 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Apr 22 17:34:10.876220 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874613 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Apr 22 17:34:10.876220 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874617 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Apr 22 17:34:10.876220 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874619 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Apr 22 17:34:10.876220 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874622 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Apr 22 17:34:10.876220 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874624 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Apr 22 17:34:10.876220 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874628 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Apr 22 17:34:10.876220 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874630 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Apr 22 17:34:10.876220 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874633 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Apr 22 17:34:10.876220 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874635 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Apr 22 17:34:10.876220 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874638 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Apr 22 17:34:10.876220 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874641 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Apr 22 17:34:10.876220 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874643 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Apr 22 17:34:10.876220 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874646 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Apr 22 17:34:10.876220 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874648 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Apr 22 17:34:10.876220 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874651 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Apr 22 17:34:10.876647 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.874656 2576 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Apr 22 17:34:10.876647 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874752 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Apr 22 17:34:10.876647 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874757 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Apr 22 17:34:10.876647 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874760 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Apr 22 17:34:10.876647 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874763 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Apr 22 17:34:10.876647 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874766 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Apr 22 17:34:10.876647 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874768 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Apr 22 17:34:10.876647 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874771 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Apr 22 17:34:10.876647 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874773 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Apr 22 17:34:10.876647 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874776 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Apr 22 17:34:10.876647 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874781 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Apr 22 17:34:10.876647 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874784 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Apr 22 17:34:10.876647 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874786 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Apr 22 17:34:10.876647 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874789 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Apr 22 17:34:10.876647 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874791 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Apr 22 17:34:10.877049 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874794 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Apr 22 17:34:10.877049 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874796 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Apr 22 17:34:10.877049 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874799 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Apr 22 17:34:10.877049 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874801 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Apr 22 17:34:10.877049 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874804 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Apr 22 17:34:10.877049 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874807 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Apr 22 17:34:10.877049 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874810 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Apr 22 17:34:10.877049 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874812 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Apr 22 17:34:10.877049 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874816 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Apr 22 17:34:10.877049 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874818 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Apr 22 17:34:10.877049 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874821 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Apr 22 17:34:10.877049 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874824 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Apr 22 17:34:10.877049 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874826 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Apr 22 17:34:10.877049 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874829 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Apr 22 17:34:10.877049 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874832 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Apr 22 17:34:10.877049 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874834 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Apr 22 17:34:10.877049 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874836 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Apr 22 17:34:10.877049 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874839 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Apr 22 17:34:10.877049 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874841 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Apr 22 17:34:10.877049 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874844 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Apr 22 17:34:10.877577 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874846 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Apr 22 17:34:10.877577 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874849 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Apr 22 17:34:10.877577 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874851 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Apr 22 17:34:10.877577 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874853 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Apr 22 17:34:10.877577 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874856 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Apr 22 17:34:10.877577 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874858 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Apr 22 17:34:10.877577 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874861 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Apr 22 17:34:10.877577 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874863 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Apr 22 17:34:10.877577 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874866 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Apr 22 17:34:10.877577 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874869 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Apr 22 17:34:10.877577 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874871 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Apr 22 17:34:10.877577 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874873 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Apr 22 17:34:10.877577 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874876 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Apr 22 17:34:10.877577 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874879 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Apr 22 17:34:10.877577 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874882 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Apr 22 17:34:10.877577 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874884 2576 feature_gate.go:328] unrecognized feature gate: Example Apr 22 17:34:10.877577 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874886 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Apr 22 17:34:10.877577 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874889 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Apr 22 17:34:10.877577 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874891 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Apr 22 17:34:10.877577 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874894 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Apr 22 17:34:10.878053 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874897 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Apr 22 17:34:10.878053 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874899 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Apr 22 17:34:10.878053 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874902 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Apr 22 17:34:10.878053 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874904 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Apr 22 17:34:10.878053 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874906 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Apr 22 17:34:10.878053 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874909 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Apr 22 17:34:10.878053 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874911 2576 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Apr 22 17:34:10.878053 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874914 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Apr 22 17:34:10.878053 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874916 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Apr 22 17:34:10.878053 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874919 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Apr 22 17:34:10.878053 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874922 2576 feature_gate.go:328] unrecognized feature gate: Example2 Apr 22 17:34:10.878053 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874925 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Apr 22 17:34:10.878053 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874927 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Apr 22 17:34:10.878053 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874930 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Apr 22 17:34:10.878053 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874934 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Apr 22 17:34:10.878053 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874937 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Apr 22 17:34:10.878053 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874939 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Apr 22 17:34:10.878053 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874942 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Apr 22 17:34:10.878053 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874944 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Apr 22 17:34:10.878053 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874946 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Apr 22 17:34:10.878561 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874950 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Apr 22 17:34:10.878561 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874954 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Apr 22 17:34:10.878561 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874957 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Apr 22 17:34:10.878561 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874960 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Apr 22 17:34:10.878561 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874963 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Apr 22 17:34:10.878561 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874965 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Apr 22 17:34:10.878561 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874968 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Apr 22 17:34:10.878561 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874970 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Apr 22 17:34:10.878561 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874973 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Apr 22 17:34:10.878561 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874975 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Apr 22 17:34:10.878561 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874978 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Apr 22 17:34:10.878561 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:10.874981 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Apr 22 17:34:10.878561 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.874985 2576 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Apr 22 17:34:10.878561 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.875537 2576 server.go:962] "Client rotation is on, will bootstrap in background" Apr 22 17:34:10.879965 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.879951 2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Apr 22 17:34:10.880673 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.880661 2576 server.go:1019] "Starting client certificate rotation" Apr 22 17:34:10.880776 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.880758 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Apr 22 17:34:10.880812 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.880799 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Apr 22 17:34:10.905384 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.905366 2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Apr 22 17:34:10.908477 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.908461 2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Apr 22 17:34:10.923019 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.922998 2576 log.go:25] "Validated CRI v1 runtime API" Apr 22 17:34:10.928427 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.928408 2576 log.go:25] "Validated CRI v1 image API" Apr 22 17:34:10.929730 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.929706 2576 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Apr 22 17:34:10.934672 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.934654 2576 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Apr 22 17:34:10.934827 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.934803 2576 fs.go:135] Filesystem UUIDs: map[29cbb50b-2bb2-41f0-8b78-738109344c0d:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 c69d660d-5d6f-47cb-926e-251526513f45:/dev/nvme0n1p3] Apr 22 17:34:10.934864 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.934829 2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Apr 22 17:34:10.940421 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.940295 2576 manager.go:217] Machine: {Timestamp:2026-04-22 17:34:10.938615454 +0000 UTC m=+0.383178632 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099686 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2622563f4f3b74e65e6b88e3bf69a1 SystemUUID:ec262256-3f4f-3b74-e65e-6b88e3bf69a1 BootID:390938ca-c62a-4637-95ab-519ee9e1a48d Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b9:d8:89:50:21 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b9:d8:89:50:21 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:da:81:4c:2f:25:ab Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Apr 22 17:34:10.940421 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.940414 2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Apr 22 17:34:10.940537 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.940516 2576 manager.go:233] Version: {KernelVersion:5.14.0-570.107.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260414-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Apr 22 17:34:10.941518 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.941492 2576 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Apr 22 17:34:10.941690 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.941521 2576 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-38.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Apr 22 17:34:10.941767 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.941704 2576 topology_manager.go:138] "Creating topology manager with none policy" Apr 22 17:34:10.941767 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.941717 2576 container_manager_linux.go:306] "Creating device plugin manager" Apr 22 17:34:10.941767 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.941735 2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Apr 22 17:34:10.942324 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.942312 2576 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Apr 22 17:34:10.943011 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.942998 2576 state_mem.go:36] "Initialized new in-memory state store" Apr 22 17:34:10.943344 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.943332 2576 server.go:1267] "Using root directory" path="/var/lib/kubelet" Apr 22 17:34:10.946313 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.946301 2576 kubelet.go:491] "Attempting to sync node with API server" Apr 22 17:34:10.946383 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.946320 2576 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Apr 22 17:34:10.946383 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.946343 2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Apr 22 17:34:10.946383 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.946360 2576 kubelet.go:397] "Adding apiserver pod source" Apr 22 17:34:10.946383 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.946372 2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Apr 22 17:34:10.947370 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.947357 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Apr 22 17:34:10.947434 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.947379 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Apr 22 17:34:10.950155 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.950139 2576 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.10-2.rhaos4.20.gita4d0894.el9" apiVersion="v1" Apr 22 17:34:10.951551 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.951538 2576 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Apr 22 17:34:10.953139 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.953125 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Apr 22 17:34:10.953229 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.953145 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Apr 22 17:34:10.953229 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.953152 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Apr 22 17:34:10.953229 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.953157 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Apr 22 17:34:10.953229 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.953164 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Apr 22 17:34:10.953229 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.953186 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Apr 22 17:34:10.953229 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.953196 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Apr 22 17:34:10.953229 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.953204 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Apr 22 17:34:10.953229 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.953213 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Apr 22 17:34:10.953229 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.953219 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Apr 22 17:34:10.953229 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.953227 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Apr 22 17:34:10.953485 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.953236 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Apr 22 17:34:10.954982 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.954972 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Apr 22 17:34:10.954982 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.954982 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Apr 22 17:34:10.956414 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.956392 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7hlb7" Apr 22 17:34:10.958641 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.958628 2576 watchdog_linux.go:99] "Systemd watchdog is not enabled" Apr 22 17:34:10.958721 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.958626 2576 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-38.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Apr 22 17:34:10.958721 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:10.958652 2576 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-38.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Apr 22 17:34:10.958721 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.958671 2576 server.go:1295] "Started kubelet" Apr 22 17:34:10.958721 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:10.958704 2576 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Apr 22 17:34:10.958899 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.958741 2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Apr 22 17:34:10.958899 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.958759 2576 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Apr 22 17:34:10.958899 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.958820 2576 server_v1.go:47] "podresources" method="list" useActivePods=true Apr 22 17:34:10.959690 ip-10-0-138-38 systemd[1]: Started Kubernetes Kubelet. Apr 22 17:34:10.959882 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.959867 2576 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Apr 22 17:34:10.963012 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.962995 2576 server.go:317] "Adding debug handlers to kubelet server" Apr 22 17:34:10.964469 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.964436 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7hlb7" Apr 22 17:34:10.967639 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:10.966043 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-38.ec2.internal.18a8be43b226fdfc default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-38.ec2.internal,UID:ip-10-0-138-38.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-38.ec2.internal,},FirstTimestamp:2026-04-22 17:34:10.95864678 +0000 UTC m=+0.403209954,LastTimestamp:2026-04-22 17:34:10.95864678 +0000 UTC m=+0.403209954,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-38.ec2.internal,}" Apr 22 17:34:10.968803 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.968786 2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Apr 22 17:34:10.968900 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.968807 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Apr 22 17:34:10.969406 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.969387 2576 volume_manager.go:295] "The desired_state_of_world populator starts" Apr 22 17:34:10.969486 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.969410 2576 volume_manager.go:297] "Starting Kubelet Volume Manager" Apr 22 17:34:10.969536 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.969514 2576 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Apr 22 17:34:10.969596 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.969584 2576 reconstruct.go:97] "Volume reconstruction finished" Apr 22 17:34:10.969648 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.969597 2576 reconciler.go:26] "Reconciler: start to sync state" Apr 22 17:34:10.969648 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.969622 2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Apr 22 17:34:10.969648 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.969634 2576 factory.go:55] Registering systemd factory Apr 22 17:34:10.969648 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.969641 2576 factory.go:223] Registration of the systemd container factory successfully Apr 22 17:34:10.969980 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.969850 2576 factory.go:153] Registering CRI-O factory Apr 22 17:34:10.969980 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.969863 2576 factory.go:223] Registration of the crio container factory successfully Apr 22 17:34:10.969980 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.969882 2576 factory.go:103] Registering Raw factory Apr 22 17:34:10.969980 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.969894 2576 manager.go:1196] Started watching for new ooms in manager Apr 22 17:34:10.970146 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:10.970037 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-38.ec2.internal\" not found" Apr 22 17:34:10.970328 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:10.970303 2576 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Apr 22 17:34:10.970412 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.970336 2576 manager.go:319] Starting recovery of all containers Apr 22 17:34:10.973330 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.973312 2576 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Apr 22 17:34:10.976581 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:10.976557 2576 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-138-38.ec2.internal\" not found" node="ip-10-0-138-38.ec2.internal" Apr 22 17:34:10.979682 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.979568 2576 manager.go:324] Recovery completed Apr 22 17:34:10.983908 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.983895 2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Apr 22 17:34:10.986485 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.986467 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-38.ec2.internal" event="NodeHasSufficientMemory" Apr 22 17:34:10.986540 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.986503 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-38.ec2.internal" event="NodeHasNoDiskPressure" Apr 22 17:34:10.986540 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.986516 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-38.ec2.internal" event="NodeHasSufficientPID" Apr 22 17:34:10.987031 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.987015 2576 cpu_manager.go:222] "Starting CPU manager" policy="none" Apr 22 17:34:10.987031 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.987028 2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Apr 22 17:34:10.987132 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.987044 2576 state_mem.go:36] "Initialized new in-memory state store" Apr 22 17:34:10.988957 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.988946 2576 policy_none.go:49] "None policy: Start" Apr 22 17:34:10.989000 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.988962 2576 memory_manager.go:186] "Starting memorymanager" policy="None" Apr 22 17:34:10.989000 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:10.988971 2576 state_mem.go:35] "Initializing new in-memory state store" Apr 22 17:34:11.024795 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:11.024778 2576 manager.go:341] "Starting Device Plugin manager" Apr 22 17:34:11.036667 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:11.024818 2576 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Apr 22 17:34:11.036667 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:11.024831 2576 server.go:85] "Starting device plugin registration server" Apr 22 17:34:11.036667 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:11.025121 2576 eviction_manager.go:189] "Eviction manager: starting control loop" Apr 22 17:34:11.036667 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:11.025133 2576 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Apr 22 17:34:11.036667 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:11.025242 2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Apr 22 17:34:11.036667 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:11.025338 2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Apr 22 17:34:11.036667 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:11.025381 2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Apr 22 17:34:11.036667 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:11.025980 2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Apr 22 17:34:11.036667 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:11.026030 2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-38.ec2.internal\" not found" Apr 22 17:34:11.066124 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:11.066085 2576 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Apr 22 17:34:11.067393 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:11.067377 2576 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Apr 22 17:34:11.067481 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:11.067407 2576 status_manager.go:230] "Starting to sync pod status with apiserver" Apr 22 17:34:11.067481 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:11.067434 2576 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Apr 22 17:34:11.067481 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:11.067444 2576 kubelet.go:2451] "Starting kubelet main sync loop" Apr 22 17:34:11.067610 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:11.067486 2576 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Apr 22 17:34:11.070986 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:11.070968 2576 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Apr 22 17:34:11.126001 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:11.125923 2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Apr 22 17:34:11.126906 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:11.126885 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-38.ec2.internal" event="NodeHasSufficientMemory" Apr 22 17:34:11.127004 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:11.126919 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-38.ec2.internal" event="NodeHasNoDiskPressure" Apr 22 17:34:11.127004 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:11.126931 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-38.ec2.internal" event="NodeHasSufficientPID" Apr 22 17:34:11.127004 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:11.126960 2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-38.ec2.internal" Apr 22 17:34:11.135144 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:11.135129 2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-38.ec2.internal" Apr 22 17:34:11.135202 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:11.135152 2576 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-38.ec2.internal\": node \"ip-10-0-138-38.ec2.internal\" not found" Apr 22 17:34:11.153806 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:11.153778 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-38.ec2.internal\" not found" Apr 22 17:34:11.167866 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:11.167836 2576 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-38.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-38.ec2.internal"] Apr 22 17:34:11.167972 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:11.167944 2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Apr 22 17:34:11.168866 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:11.168849 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-38.ec2.internal" event="NodeHasSufficientMemory" Apr 22 17:34:11.168939 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:11.168883 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-38.ec2.internal" event="NodeHasNoDiskPressure" Apr 22 17:34:11.168939 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:11.168893 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-38.ec2.internal" event="NodeHasSufficientPID" Apr 22 17:34:11.170254 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:11.170242 2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Apr 22 17:34:11.170405 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:11.170391 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-38.ec2.internal" Apr 22 17:34:11.170444 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:11.170423 2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Apr 22 17:34:11.170955 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:11.170941 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-38.ec2.internal" event="NodeHasSufficientMemory" Apr 22 17:34:11.171002 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:11.170976 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-38.ec2.internal" event="NodeHasNoDiskPressure" Apr 22 17:34:11.171002 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:11.170990 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-38.ec2.internal" event="NodeHasSufficientPID" Apr 22 17:34:11.171084 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:11.171046 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-38.ec2.internal" event="NodeHasSufficientMemory" Apr 22 17:34:11.171084 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:11.171072 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-38.ec2.internal" event="NodeHasNoDiskPressure" Apr 22 17:34:11.171084 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:11.171082 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-38.ec2.internal" event="NodeHasSufficientPID" Apr 22 17:34:11.172189 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:11.172160 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-38.ec2.internal" Apr 22 17:34:11.172273 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:11.172198 2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Apr 22 17:34:11.172829 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:11.172813 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-38.ec2.internal" event="NodeHasSufficientMemory" Apr 22 17:34:11.172913 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:11.172839 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-38.ec2.internal" event="NodeHasNoDiskPressure" Apr 22 17:34:11.172913 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:11.172853 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-38.ec2.internal" event="NodeHasSufficientPID" Apr 22 17:34:11.204002 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:11.203973 2576 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-38.ec2.internal\" not found" node="ip-10-0-138-38.ec2.internal" Apr 22 17:34:11.208669 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:11.208653 2576 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-38.ec2.internal\" not found" node="ip-10-0-138-38.ec2.internal" Apr 22 17:34:11.254279 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:11.254242 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-38.ec2.internal\" not found" Apr 22 17:34:11.270808 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:11.270779 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c001ae6ef4a4422d60602a8dc909d4db-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-38.ec2.internal\" (UID: \"c001ae6ef4a4422d60602a8dc909d4db\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-38.ec2.internal" Apr 22 17:34:11.270912 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:11.270810 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c001ae6ef4a4422d60602a8dc909d4db-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-38.ec2.internal\" (UID: \"c001ae6ef4a4422d60602a8dc909d4db\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-38.ec2.internal" Apr 22 17:34:11.270912 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:11.270828 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5e5501b20aff6c46dc26a040c562bb73-config\") pod \"kube-apiserver-proxy-ip-10-0-138-38.ec2.internal\" (UID: \"5e5501b20aff6c46dc26a040c562bb73\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-38.ec2.internal" Apr 22 17:34:11.354958 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:11.354924 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-38.ec2.internal\" not found" Apr 22 17:34:11.371273 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:11.371245 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c001ae6ef4a4422d60602a8dc909d4db-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-38.ec2.internal\" (UID: \"c001ae6ef4a4422d60602a8dc909d4db\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-38.ec2.internal" Apr 22 17:34:11.371324 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:11.371278 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c001ae6ef4a4422d60602a8dc909d4db-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-38.ec2.internal\" (UID: \"c001ae6ef4a4422d60602a8dc909d4db\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-38.ec2.internal" Apr 22 17:34:11.371324 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:11.371294 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5e5501b20aff6c46dc26a040c562bb73-config\") pod \"kube-apiserver-proxy-ip-10-0-138-38.ec2.internal\" (UID: \"5e5501b20aff6c46dc26a040c562bb73\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-38.ec2.internal" Apr 22 17:34:11.371387 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:11.371331 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c001ae6ef4a4422d60602a8dc909d4db-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-38.ec2.internal\" (UID: \"c001ae6ef4a4422d60602a8dc909d4db\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-38.ec2.internal" Apr 22 17:34:11.371387 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:11.371343 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c001ae6ef4a4422d60602a8dc909d4db-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-38.ec2.internal\" (UID: \"c001ae6ef4a4422d60602a8dc909d4db\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-38.ec2.internal" Apr 22 17:34:11.371387 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:11.371372 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5e5501b20aff6c46dc26a040c562bb73-config\") pod \"kube-apiserver-proxy-ip-10-0-138-38.ec2.internal\" (UID: \"5e5501b20aff6c46dc26a040c562bb73\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-38.ec2.internal" Apr 22 17:34:11.455727 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:11.455650 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-38.ec2.internal\" not found" Apr 22 17:34:11.506156 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:11.506125 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-38.ec2.internal" Apr 22 17:34:11.511559 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:11.511537 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-38.ec2.internal" Apr 22 17:34:11.556436 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:11.556399 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-38.ec2.internal\" not found" Apr 22 17:34:11.656945 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:11.656915 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-38.ec2.internal\" not found" Apr 22 17:34:11.757451 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:11.757416 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-38.ec2.internal\" not found" Apr 22 17:34:11.858040 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:11.858009 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-38.ec2.internal\" not found" Apr 22 17:34:11.880541 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:11.880511 2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Apr 22 17:34:11.880680 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:11.880640 2576 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Apr 22 17:34:11.880720 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:11.880672 2576 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Apr 22 17:34:11.958115 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:11.958082 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-38.ec2.internal\" not found" Apr 22 17:34:11.968824 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:11.968790 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-04-21 17:29:10 +0000 UTC" deadline="2028-01-11 11:06:19.90654862 +0000 UTC" Apr 22 17:34:11.968824 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:11.968819 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15089h32m7.937733265s" Apr 22 17:34:11.969770 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:11.969754 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Apr 22 17:34:11.978814 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:11.978789 2576 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Apr 22 17:34:12.002244 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.002217 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-w9nmb" Apr 22 17:34:12.010611 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:12.010533 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e5501b20aff6c46dc26a040c562bb73.slice/crio-c517ca4fb0a76ac8a832e4d5831d40b533e3677f34e166be40c1b900021cbd30 WatchSource:0}: Error finding container c517ca4fb0a76ac8a832e4d5831d40b533e3677f34e166be40c1b900021cbd30: Status 404 returned error can't find the container with id c517ca4fb0a76ac8a832e4d5831d40b533e3677f34e166be40c1b900021cbd30 Apr 22 17:34:12.010931 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:12.010917 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc001ae6ef4a4422d60602a8dc909d4db.slice/crio-fb43c4334fe8e8978cb94a806eaa9a0235d69b6d54e5dde5ed03aafa7d24dfa7 WatchSource:0}: Error finding container fb43c4334fe8e8978cb94a806eaa9a0235d69b6d54e5dde5ed03aafa7d24dfa7: Status 404 returned error can't find the container with id fb43c4334fe8e8978cb94a806eaa9a0235d69b6d54e5dde5ed03aafa7d24dfa7 Apr 22 17:34:12.012377 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.012360 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-w9nmb" Apr 22 17:34:12.015106 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.015093 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Apr 22 17:34:12.058608 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:12.058562 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-38.ec2.internal\" not found" Apr 22 17:34:12.070682 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.070628 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-38.ec2.internal" event={"ID":"5e5501b20aff6c46dc26a040c562bb73","Type":"ContainerStarted","Data":"c517ca4fb0a76ac8a832e4d5831d40b533e3677f34e166be40c1b900021cbd30"} Apr 22 17:34:12.071533 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.071514 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-38.ec2.internal" event={"ID":"c001ae6ef4a4422d60602a8dc909d4db","Type":"ContainerStarted","Data":"fb43c4334fe8e8978cb94a806eaa9a0235d69b6d54e5dde5ed03aafa7d24dfa7"} Apr 22 17:34:12.158939 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:12.158895 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-38.ec2.internal\" not found" Apr 22 17:34:12.217617 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.217585 2576 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Apr 22 17:34:12.269605 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.269529 2576 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-38.ec2.internal" Apr 22 17:34:12.285909 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.285886 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Apr 22 17:34:12.287609 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.287597 2576 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-38.ec2.internal" Apr 22 17:34:12.294584 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.294568 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Apr 22 17:34:12.559217 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.559123 2576 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Apr 22 17:34:12.732529 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.732498 2576 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Apr 22 17:34:12.942983 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.942910 2576 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Apr 22 17:34:12.946878 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.946852 2576 apiserver.go:52] "Watching apiserver" Apr 22 17:34:12.956034 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.956007 2576 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Apr 22 17:34:12.956876 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.956847 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-38.ec2.internal","openshift-multus/multus-6d99f","openshift-multus/multus-additional-cni-plugins-wbltv","openshift-multus/network-metrics-daemon-n4clb","kube-system/konnectivity-agent-tm9m2","openshift-dns/node-resolver-hfp87","openshift-network-diagnostics/network-check-target-p76lb","openshift-network-operator/iptables-alerter-mx4d8","openshift-ovn-kubernetes/ovnkube-node-k5q2p","kube-system/kube-apiserver-proxy-ip-10-0-138-38.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4cjq","openshift-cluster-node-tuning-operator/tuned-dkxmf","openshift-image-registry/node-ca-dxbhp"] Apr 22 17:34:12.958655 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.958634 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p76lb" Apr 22 17:34:12.958745 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:12.958726 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p76lb" podUID="473029a2-4794-4adf-8637-e61f8afbe3a4" Apr 22 17:34:12.959779 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.959757 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6d99f" Apr 22 17:34:12.961870 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.961844 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wbltv" Apr 22 17:34:12.962288 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.962095 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Apr 22 17:34:12.962288 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.962123 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-9sk4w\"" Apr 22 17:34:12.962288 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.962095 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Apr 22 17:34:12.962288 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.962194 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Apr 22 17:34:12.962498 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.962367 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Apr 22 17:34:12.963073 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.963057 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n4clb" Apr 22 17:34:12.963159 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:12.963131 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n4clb" podUID="4dbaf65e-c017-4ec0-bcc0-808342d2272b" Apr 22 17:34:12.964052 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.964030 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tm9m2" Apr 22 17:34:12.964138 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.964109 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Apr 22 17:34:12.964138 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.964118 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hfp87" Apr 22 17:34:12.964677 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.964659 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Apr 22 17:34:12.964770 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.964678 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-b9z47\"" Apr 22 17:34:12.965199 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.965166 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mx4d8" Apr 22 17:34:12.966161 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.966138 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Apr 22 17:34:12.966361 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.966345 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Apr 22 17:34:12.966435 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.966424 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-jcmgh\"" Apr 22 17:34:12.966536 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.966520 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Apr 22 17:34:12.966693 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.966677 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Apr 22 17:34:12.966754 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.966743 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-2jlgb\"" Apr 22 17:34:12.967006 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.966989 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Apr 22 17:34:12.967212 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.967192 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Apr 22 17:34:12.967388 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.967373 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-pfrnz\"" Apr 22 17:34:12.967501 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.967484 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Apr 22 17:34:12.967807 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.967789 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" Apr 22 17:34:12.968949 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.968932 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4cjq" Apr 22 17:34:12.969069 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.969056 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dkxmf" Apr 22 17:34:12.969835 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.969795 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Apr 22 17:34:12.969835 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.969829 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Apr 22 17:34:12.970304 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.970283 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dxbhp" Apr 22 17:34:12.970376 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.970341 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Apr 22 17:34:12.970662 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.970644 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wmgt6\"" Apr 22 17:34:12.970801 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.970781 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Apr 22 17:34:12.970944 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.970929 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Apr 22 17:34:12.971024 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.971008 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-wlfzg\"" Apr 22 17:34:12.971066 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.971050 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Apr 22 17:34:12.971066 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.971060 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Apr 22 17:34:12.971150 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.971137 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Apr 22 17:34:12.971263 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.971240 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Apr 22 17:34:12.971487 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.971467 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Apr 22 17:34:12.971544 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.971469 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9x4kg\"" Apr 22 17:34:12.971799 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.971781 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Apr 22 17:34:12.972380 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.972329 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Apr 22 17:34:12.972489 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.972431 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Apr 22 17:34:12.972652 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.972635 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-kc7pm\"" Apr 22 17:34:12.973062 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.973043 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Apr 22 17:34:12.979680 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.979659 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332-var-lib-kubelet\") pod \"tuned-dkxmf\" (UID: \"d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332\") " pod="openshift-cluster-node-tuning-operator/tuned-dkxmf" Apr 22 17:34:12.979778 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.979687 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/87846e27-279a-49b8-865a-3979451f84ba-host-run-multus-certs\") pod \"multus-6d99f\" (UID: \"87846e27-279a-49b8-865a-3979451f84ba\") " pod="openshift-multus/multus-6d99f" Apr 22 17:34:12.979778 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.979705 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/dace974d-6ce0-4a6d-9f8d-bde919b848c7-registration-dir\") pod \"aws-ebs-csi-driver-node-q4cjq\" (UID: \"dace974d-6ce0-4a6d-9f8d-bde919b848c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4cjq" Apr 22 17:34:12.979778 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.979727 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332-etc-sysctl-d\") pod \"tuned-dkxmf\" (UID: \"d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332\") " pod="openshift-cluster-node-tuning-operator/tuned-dkxmf" Apr 22 17:34:12.979778 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.979749 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87846e27-279a-49b8-865a-3979451f84ba-system-cni-dir\") pod \"multus-6d99f\" (UID: \"87846e27-279a-49b8-865a-3979451f84ba\") " pod="openshift-multus/multus-6d99f" Apr 22 17:34:12.979975 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.979787 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/87846e27-279a-49b8-865a-3979451f84ba-host-var-lib-cni-multus\") pod \"multus-6d99f\" (UID: \"87846e27-279a-49b8-865a-3979451f84ba\") " pod="openshift-multus/multus-6d99f" Apr 22 17:34:12.979975 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.979814 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/87846e27-279a-49b8-865a-3979451f84ba-multus-conf-dir\") pod \"multus-6d99f\" (UID: \"87846e27-279a-49b8-865a-3979451f84ba\") " pod="openshift-multus/multus-6d99f" Apr 22 17:34:12.979975 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.979846 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0d47dea1-b4c9-4c30-9592-ba829fe9f7d3-host-kubelet\") pod \"ovnkube-node-k5q2p\" (UID: \"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" Apr 22 17:34:12.979975 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.979869 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332-tmp\") pod \"tuned-dkxmf\" (UID: \"d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332\") " pod="openshift-cluster-node-tuning-operator/tuned-dkxmf" Apr 22 17:34:12.979975 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.979898 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24zn6\" (UniqueName: \"kubernetes.io/projected/87846e27-279a-49b8-865a-3979451f84ba-kube-api-access-24zn6\") pod \"multus-6d99f\" (UID: \"87846e27-279a-49b8-865a-3979451f84ba\") " pod="openshift-multus/multus-6d99f" Apr 22 17:34:12.979975 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.979919 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87846e27-279a-49b8-865a-3979451f84ba-multus-cni-dir\") pod \"multus-6d99f\" (UID: \"87846e27-279a-49b8-865a-3979451f84ba\") " pod="openshift-multus/multus-6d99f" Apr 22 17:34:12.979975 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.979966 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0d47dea1-b4c9-4c30-9592-ba829fe9f7d3-var-lib-openvswitch\") pod \"ovnkube-node-k5q2p\" (UID: \"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" Apr 22 17:34:12.980321 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.979993 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0d47dea1-b4c9-4c30-9592-ba829fe9f7d3-run-ovn\") pod \"ovnkube-node-k5q2p\" (UID: \"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" Apr 22 17:34:12.980321 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.980017 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332-etc-kubernetes\") pod \"tuned-dkxmf\" (UID: \"d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332\") " pod="openshift-cluster-node-tuning-operator/tuned-dkxmf" Apr 22 17:34:12.980321 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.980033 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332-etc-tuned\") pod \"tuned-dkxmf\" (UID: \"d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332\") " pod="openshift-cluster-node-tuning-operator/tuned-dkxmf" Apr 22 17:34:12.980321 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.980049 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/87846e27-279a-49b8-865a-3979451f84ba-host-var-lib-cni-bin\") pod \"multus-6d99f\" (UID: \"87846e27-279a-49b8-865a-3979451f84ba\") " pod="openshift-multus/multus-6d99f" Apr 22 17:34:12.980321 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.980116 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1359a64d-2417-42d6-918d-bba7d2d9b6e7-system-cni-dir\") pod \"multus-additional-cni-plugins-wbltv\" (UID: \"1359a64d-2417-42d6-918d-bba7d2d9b6e7\") " pod="openshift-multus/multus-additional-cni-plugins-wbltv" Apr 22 17:34:12.980321 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.980164 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1359a64d-2417-42d6-918d-bba7d2d9b6e7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wbltv\" (UID: \"1359a64d-2417-42d6-918d-bba7d2d9b6e7\") " pod="openshift-multus/multus-additional-cni-plugins-wbltv" Apr 22 17:34:12.980321 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.980208 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6b871faa-db8a-4a95-8c94-6fed862a9dc7-hosts-file\") pod \"node-resolver-hfp87\" (UID: \"6b871faa-db8a-4a95-8c94-6fed862a9dc7\") " pod="openshift-dns/node-resolver-hfp87" Apr 22 17:34:12.980321 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.980231 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m22w8\" (UniqueName: \"kubernetes.io/projected/6b871faa-db8a-4a95-8c94-6fed862a9dc7-kube-api-access-m22w8\") pod \"node-resolver-hfp87\" (UID: \"6b871faa-db8a-4a95-8c94-6fed862a9dc7\") " pod="openshift-dns/node-resolver-hfp87" Apr 22 17:34:12.980321 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.980247 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0d47dea1-b4c9-4c30-9592-ba829fe9f7d3-host-run-netns\") pod \"ovnkube-node-k5q2p\" (UID: \"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" Apr 22 17:34:12.980321 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.980267 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332-lib-modules\") pod \"tuned-dkxmf\" (UID: \"d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332\") " pod="openshift-cluster-node-tuning-operator/tuned-dkxmf" Apr 22 17:34:12.980321 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.980300 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/87846e27-279a-49b8-865a-3979451f84ba-host-run-netns\") pod \"multus-6d99f\" (UID: \"87846e27-279a-49b8-865a-3979451f84ba\") " pod="openshift-multus/multus-6d99f" Apr 22 17:34:12.980321 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.980323 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0d47dea1-b4c9-4c30-9592-ba829fe9f7d3-etc-openvswitch\") pod \"ovnkube-node-k5q2p\" (UID: \"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" Apr 22 17:34:12.980896 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.980340 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0d47dea1-b4c9-4c30-9592-ba829fe9f7d3-log-socket\") pod \"ovnkube-node-k5q2p\" (UID: \"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" Apr 22 17:34:12.980896 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.980358 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0d47dea1-b4c9-4c30-9592-ba829fe9f7d3-host-cni-bin\") pod \"ovnkube-node-k5q2p\" (UID: \"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" Apr 22 17:34:12.980896 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.980382 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0d47dea1-b4c9-4c30-9592-ba829fe9f7d3-host-cni-netd\") pod \"ovnkube-node-k5q2p\" (UID: \"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" Apr 22 17:34:12.980896 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.980406 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clmbw\" (UniqueName: \"kubernetes.io/projected/0d47dea1-b4c9-4c30-9592-ba829fe9f7d3-kube-api-access-clmbw\") pod \"ovnkube-node-k5q2p\" (UID: \"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" Apr 22 17:34:12.980896 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.980431 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7kcx\" (UniqueName: \"kubernetes.io/projected/d94afc06-594c-4cc6-a15f-473ec2fb5297-kube-api-access-f7kcx\") pod \"node-ca-dxbhp\" (UID: \"d94afc06-594c-4cc6-a15f-473ec2fb5297\") " pod="openshift-image-registry/node-ca-dxbhp" Apr 22 17:34:12.980896 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.980455 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1359a64d-2417-42d6-918d-bba7d2d9b6e7-cnibin\") pod \"multus-additional-cni-plugins-wbltv\" (UID: \"1359a64d-2417-42d6-918d-bba7d2d9b6e7\") " pod="openshift-multus/multus-additional-cni-plugins-wbltv" Apr 22 17:34:12.980896 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.980480 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7p6x7\" (UniqueName: \"kubernetes.io/projected/473029a2-4794-4adf-8637-e61f8afbe3a4-kube-api-access-7p6x7\") pod \"network-check-target-p76lb\" (UID: \"473029a2-4794-4adf-8637-e61f8afbe3a4\") " pod="openshift-network-diagnostics/network-check-target-p76lb" Apr 22 17:34:12.980896 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.980505 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332-host\") pod \"tuned-dkxmf\" (UID: \"d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332\") " pod="openshift-cluster-node-tuning-operator/tuned-dkxmf" Apr 22 17:34:12.980896 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.980528 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrbp2\" (UniqueName: \"kubernetes.io/projected/d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332-kube-api-access-jrbp2\") pod \"tuned-dkxmf\" (UID: \"d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332\") " pod="openshift-cluster-node-tuning-operator/tuned-dkxmf" Apr 22 17:34:12.980896 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.980570 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1359a64d-2417-42d6-918d-bba7d2d9b6e7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wbltv\" (UID: \"1359a64d-2417-42d6-918d-bba7d2d9b6e7\") " pod="openshift-multus/multus-additional-cni-plugins-wbltv" Apr 22 17:34:12.980896 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.980594 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0d47dea1-b4c9-4c30-9592-ba829fe9f7d3-node-log\") pod \"ovnkube-node-k5q2p\" (UID: \"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" Apr 22 17:34:12.980896 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.980612 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2af98b77-7b18-41bf-b19c-6788c06627ec-host-slash\") pod \"iptables-alerter-mx4d8\" (UID: \"2af98b77-7b18-41bf-b19c-6788c06627ec\") " pod="openshift-network-operator/iptables-alerter-mx4d8" Apr 22 17:34:12.980896 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.980636 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/dace974d-6ce0-4a6d-9f8d-bde919b848c7-socket-dir\") pod \"aws-ebs-csi-driver-node-q4cjq\" (UID: \"dace974d-6ce0-4a6d-9f8d-bde919b848c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4cjq" Apr 22 17:34:12.980896 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.980654 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/dace974d-6ce0-4a6d-9f8d-bde919b848c7-device-dir\") pod \"aws-ebs-csi-driver-node-q4cjq\" (UID: \"dace974d-6ce0-4a6d-9f8d-bde919b848c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4cjq" Apr 22 17:34:12.980896 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.980679 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/87846e27-279a-49b8-865a-3979451f84ba-host-var-lib-kubelet\") pod \"multus-6d99f\" (UID: \"87846e27-279a-49b8-865a-3979451f84ba\") " pod="openshift-multus/multus-6d99f" Apr 22 17:34:12.980896 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.980704 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/561f8fb8-766d-438c-80dc-eacb32a87265-agent-certs\") pod \"konnectivity-agent-tm9m2\" (UID: \"561f8fb8-766d-438c-80dc-eacb32a87265\") " pod="kube-system/konnectivity-agent-tm9m2" Apr 22 17:34:12.981635 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.980745 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0d47dea1-b4c9-4c30-9592-ba829fe9f7d3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k5q2p\" (UID: \"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" Apr 22 17:34:12.981635 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.980781 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0d47dea1-b4c9-4c30-9592-ba829fe9f7d3-env-overrides\") pod \"ovnkube-node-k5q2p\" (UID: \"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" Apr 22 17:34:12.981635 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.980808 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pmb6\" (UniqueName: \"kubernetes.io/projected/2af98b77-7b18-41bf-b19c-6788c06627ec-kube-api-access-2pmb6\") pod \"iptables-alerter-mx4d8\" (UID: \"2af98b77-7b18-41bf-b19c-6788c06627ec\") " pod="openshift-network-operator/iptables-alerter-mx4d8" Apr 22 17:34:12.981635 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.980836 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87846e27-279a-49b8-865a-3979451f84ba-etc-kubernetes\") pod \"multus-6d99f\" (UID: \"87846e27-279a-49b8-865a-3979451f84ba\") " pod="openshift-multus/multus-6d99f" Apr 22 17:34:12.981635 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.980859 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1359a64d-2417-42d6-918d-bba7d2d9b6e7-cni-binary-copy\") pod \"multus-additional-cni-plugins-wbltv\" (UID: \"1359a64d-2417-42d6-918d-bba7d2d9b6e7\") " pod="openshift-multus/multus-additional-cni-plugins-wbltv" Apr 22 17:34:12.981635 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.980882 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0d47dea1-b4c9-4c30-9592-ba829fe9f7d3-host-slash\") pod \"ovnkube-node-k5q2p\" (UID: \"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" Apr 22 17:34:12.981635 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.980908 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0d47dea1-b4c9-4c30-9592-ba829fe9f7d3-ovn-node-metrics-cert\") pod \"ovnkube-node-k5q2p\" (UID: \"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" Apr 22 17:34:12.981635 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.980932 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d94afc06-594c-4cc6-a15f-473ec2fb5297-serviceca\") pod \"node-ca-dxbhp\" (UID: \"d94afc06-594c-4cc6-a15f-473ec2fb5297\") " pod="openshift-image-registry/node-ca-dxbhp" Apr 22 17:34:12.981635 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.980956 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332-sys\") pod \"tuned-dkxmf\" (UID: \"d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332\") " pod="openshift-cluster-node-tuning-operator/tuned-dkxmf" Apr 22 17:34:12.981635 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.980977 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d94afc06-594c-4cc6-a15f-473ec2fb5297-host\") pod \"node-ca-dxbhp\" (UID: \"d94afc06-594c-4cc6-a15f-473ec2fb5297\") " pod="openshift-image-registry/node-ca-dxbhp" Apr 22 17:34:12.981635 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.981000 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/dace974d-6ce0-4a6d-9f8d-bde919b848c7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q4cjq\" (UID: \"dace974d-6ce0-4a6d-9f8d-bde919b848c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4cjq" Apr 22 17:34:12.981635 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.981032 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/dace974d-6ce0-4a6d-9f8d-bde919b848c7-sys-fs\") pod \"aws-ebs-csi-driver-node-q4cjq\" (UID: \"dace974d-6ce0-4a6d-9f8d-bde919b848c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4cjq" Apr 22 17:34:12.981635 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.981055 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332-etc-systemd\") pod \"tuned-dkxmf\" (UID: \"d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332\") " pod="openshift-cluster-node-tuning-operator/tuned-dkxmf" Apr 22 17:34:12.981635 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.981077 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/561f8fb8-766d-438c-80dc-eacb32a87265-konnectivity-ca\") pod \"konnectivity-agent-tm9m2\" (UID: \"561f8fb8-766d-438c-80dc-eacb32a87265\") " pod="kube-system/konnectivity-agent-tm9m2" Apr 22 17:34:12.981635 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.981100 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b871faa-db8a-4a95-8c94-6fed862a9dc7-tmp-dir\") pod \"node-resolver-hfp87\" (UID: \"6b871faa-db8a-4a95-8c94-6fed862a9dc7\") " pod="openshift-dns/node-resolver-hfp87" Apr 22 17:34:12.981635 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.981122 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0d47dea1-b4c9-4c30-9592-ba829fe9f7d3-host-run-ovn-kubernetes\") pod \"ovnkube-node-k5q2p\" (UID: \"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" Apr 22 17:34:12.982277 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.981149 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332-etc-sysctl-conf\") pod \"tuned-dkxmf\" (UID: \"d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332\") " pod="openshift-cluster-node-tuning-operator/tuned-dkxmf" Apr 22 17:34:12.982277 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.981191 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/87846e27-279a-49b8-865a-3979451f84ba-cni-binary-copy\") pod \"multus-6d99f\" (UID: \"87846e27-279a-49b8-865a-3979451f84ba\") " pod="openshift-multus/multus-6d99f" Apr 22 17:34:12.982277 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.981214 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgdns\" (UniqueName: \"kubernetes.io/projected/1359a64d-2417-42d6-918d-bba7d2d9b6e7-kube-api-access-jgdns\") pod \"multus-additional-cni-plugins-wbltv\" (UID: \"1359a64d-2417-42d6-918d-bba7d2d9b6e7\") " pod="openshift-multus/multus-additional-cni-plugins-wbltv" Apr 22 17:34:12.982277 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.981527 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0d47dea1-b4c9-4c30-9592-ba829fe9f7d3-run-openvswitch\") pod \"ovnkube-node-k5q2p\" (UID: \"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" Apr 22 17:34:12.982277 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.981566 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/dace974d-6ce0-4a6d-9f8d-bde919b848c7-etc-selinux\") pod \"aws-ebs-csi-driver-node-q4cjq\" (UID: \"dace974d-6ce0-4a6d-9f8d-bde919b848c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4cjq" Apr 22 17:34:12.982277 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.981600 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvkrw\" (UniqueName: \"kubernetes.io/projected/dace974d-6ce0-4a6d-9f8d-bde919b848c7-kube-api-access-kvkrw\") pod \"aws-ebs-csi-driver-node-q4cjq\" (UID: \"dace974d-6ce0-4a6d-9f8d-bde919b848c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4cjq" Apr 22 17:34:12.982277 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.981620 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332-etc-modprobe-d\") pod \"tuned-dkxmf\" (UID: \"d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332\") " pod="openshift-cluster-node-tuning-operator/tuned-dkxmf" Apr 22 17:34:12.982277 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.981641 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/87846e27-279a-49b8-865a-3979451f84ba-host-run-k8s-cni-cncf-io\") pod \"multus-6d99f\" (UID: \"87846e27-279a-49b8-865a-3979451f84ba\") " pod="openshift-multus/multus-6d99f" Apr 22 17:34:12.982277 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.981667 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/87846e27-279a-49b8-865a-3979451f84ba-multus-daemon-config\") pod \"multus-6d99f\" (UID: \"87846e27-279a-49b8-865a-3979451f84ba\") " pod="openshift-multus/multus-6d99f" Apr 22 17:34:12.982277 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.981705 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1359a64d-2417-42d6-918d-bba7d2d9b6e7-os-release\") pod \"multus-additional-cni-plugins-wbltv\" (UID: \"1359a64d-2417-42d6-918d-bba7d2d9b6e7\") " pod="openshift-multus/multus-additional-cni-plugins-wbltv" Apr 22 17:34:12.982277 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.981790 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1359a64d-2417-42d6-918d-bba7d2d9b6e7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wbltv\" (UID: \"1359a64d-2417-42d6-918d-bba7d2d9b6e7\") " pod="openshift-multus/multus-additional-cni-plugins-wbltv" Apr 22 17:34:12.982277 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.981820 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0d47dea1-b4c9-4c30-9592-ba829fe9f7d3-systemd-units\") pod \"ovnkube-node-k5q2p\" (UID: \"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" Apr 22 17:34:12.982277 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.981849 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4dbaf65e-c017-4ec0-bcc0-808342d2272b-metrics-certs\") pod \"network-metrics-daemon-n4clb\" (UID: \"4dbaf65e-c017-4ec0-bcc0-808342d2272b\") " pod="openshift-multus/network-metrics-daemon-n4clb" Apr 22 17:34:12.982277 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.981866 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9c8s\" (UniqueName: \"kubernetes.io/projected/4dbaf65e-c017-4ec0-bcc0-808342d2272b-kube-api-access-z9c8s\") pod \"network-metrics-daemon-n4clb\" (UID: \"4dbaf65e-c017-4ec0-bcc0-808342d2272b\") " pod="openshift-multus/network-metrics-daemon-n4clb" Apr 22 17:34:12.982277 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.981898 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2af98b77-7b18-41bf-b19c-6788c06627ec-iptables-alerter-script\") pod \"iptables-alerter-mx4d8\" (UID: \"2af98b77-7b18-41bf-b19c-6788c06627ec\") " pod="openshift-network-operator/iptables-alerter-mx4d8" Apr 22 17:34:12.982277 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.981928 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332-etc-sysconfig\") pod \"tuned-dkxmf\" (UID: \"d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332\") " pod="openshift-cluster-node-tuning-operator/tuned-dkxmf" Apr 22 17:34:12.982855 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.981960 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/87846e27-279a-49b8-865a-3979451f84ba-multus-socket-dir-parent\") pod \"multus-6d99f\" (UID: \"87846e27-279a-49b8-865a-3979451f84ba\") " pod="openshift-multus/multus-6d99f" Apr 22 17:34:12.982855 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.981977 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/87846e27-279a-49b8-865a-3979451f84ba-hostroot\") pod \"multus-6d99f\" (UID: \"87846e27-279a-49b8-865a-3979451f84ba\") " pod="openshift-multus/multus-6d99f" Apr 22 17:34:12.982855 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.981995 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332-run\") pod \"tuned-dkxmf\" (UID: \"d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332\") " pod="openshift-cluster-node-tuning-operator/tuned-dkxmf" Apr 22 17:34:12.982855 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.982027 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/87846e27-279a-49b8-865a-3979451f84ba-cnibin\") pod \"multus-6d99f\" (UID: \"87846e27-279a-49b8-865a-3979451f84ba\") " pod="openshift-multus/multus-6d99f" Apr 22 17:34:12.982855 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.982060 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/87846e27-279a-49b8-865a-3979451f84ba-os-release\") pod \"multus-6d99f\" (UID: \"87846e27-279a-49b8-865a-3979451f84ba\") " pod="openshift-multus/multus-6d99f" Apr 22 17:34:12.982855 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.982645 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0d47dea1-b4c9-4c30-9592-ba829fe9f7d3-run-systemd\") pod \"ovnkube-node-k5q2p\" (UID: \"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" Apr 22 17:34:12.982855 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.982697 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0d47dea1-b4c9-4c30-9592-ba829fe9f7d3-ovnkube-config\") pod \"ovnkube-node-k5q2p\" (UID: \"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" Apr 22 17:34:12.982855 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:12.982730 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0d47dea1-b4c9-4c30-9592-ba829fe9f7d3-ovnkube-script-lib\") pod \"ovnkube-node-k5q2p\" (UID: \"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" Apr 22 17:34:13.013669 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.013641 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-04-21 17:29:12 +0000 UTC" deadline="2027-10-12 04:10:08.342021638 +0000 UTC" Apr 22 17:34:13.013767 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.013669 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12898h35m55.328355385s" Apr 22 17:34:13.070303 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.070271 2576 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Apr 22 17:34:13.083839 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.083809 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1359a64d-2417-42d6-918d-bba7d2d9b6e7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wbltv\" (UID: \"1359a64d-2417-42d6-918d-bba7d2d9b6e7\") " pod="openshift-multus/multus-additional-cni-plugins-wbltv" Apr 22 17:34:13.083984 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.083847 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0d47dea1-b4c9-4c30-9592-ba829fe9f7d3-systemd-units\") pod \"ovnkube-node-k5q2p\" (UID: \"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" Apr 22 17:34:13.083984 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.083873 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4dbaf65e-c017-4ec0-bcc0-808342d2272b-metrics-certs\") pod \"network-metrics-daemon-n4clb\" (UID: \"4dbaf65e-c017-4ec0-bcc0-808342d2272b\") " pod="openshift-multus/network-metrics-daemon-n4clb" Apr 22 17:34:13.083984 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.083889 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z9c8s\" (UniqueName: \"kubernetes.io/projected/4dbaf65e-c017-4ec0-bcc0-808342d2272b-kube-api-access-z9c8s\") pod \"network-metrics-daemon-n4clb\" (UID: \"4dbaf65e-c017-4ec0-bcc0-808342d2272b\") " pod="openshift-multus/network-metrics-daemon-n4clb" Apr 22 17:34:13.083984 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.083909 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2af98b77-7b18-41bf-b19c-6788c06627ec-iptables-alerter-script\") pod \"iptables-alerter-mx4d8\" (UID: \"2af98b77-7b18-41bf-b19c-6788c06627ec\") " pod="openshift-network-operator/iptables-alerter-mx4d8" Apr 22 17:34:13.083984 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.083934 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332-etc-sysconfig\") pod \"tuned-dkxmf\" (UID: \"d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332\") " pod="openshift-cluster-node-tuning-operator/tuned-dkxmf" Apr 22 17:34:13.083984 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.083954 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/87846e27-279a-49b8-865a-3979451f84ba-multus-socket-dir-parent\") pod \"multus-6d99f\" (UID: \"87846e27-279a-49b8-865a-3979451f84ba\") " pod="openshift-multus/multus-6d99f" Apr 22 17:34:13.083984 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.083969 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/87846e27-279a-49b8-865a-3979451f84ba-hostroot\") pod \"multus-6d99f\" (UID: \"87846e27-279a-49b8-865a-3979451f84ba\") " pod="openshift-multus/multus-6d99f" Apr 22 17:34:13.083984 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.083984 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332-run\") pod \"tuned-dkxmf\" (UID: \"d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332\") " pod="openshift-cluster-node-tuning-operator/tuned-dkxmf" Apr 22 17:34:13.084253 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.084009 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/87846e27-279a-49b8-865a-3979451f84ba-cnibin\") pod \"multus-6d99f\" (UID: \"87846e27-279a-49b8-865a-3979451f84ba\") " pod="openshift-multus/multus-6d99f" Apr 22 17:34:13.084253 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.084035 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/87846e27-279a-49b8-865a-3979451f84ba-os-release\") pod \"multus-6d99f\" (UID: \"87846e27-279a-49b8-865a-3979451f84ba\") " pod="openshift-multus/multus-6d99f" Apr 22 17:34:13.084253 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.084049 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0d47dea1-b4c9-4c30-9592-ba829fe9f7d3-run-systemd\") pod \"ovnkube-node-k5q2p\" (UID: \"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" Apr 22 17:34:13.084253 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.084064 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0d47dea1-b4c9-4c30-9592-ba829fe9f7d3-ovnkube-config\") pod \"ovnkube-node-k5q2p\" (UID: \"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" Apr 22 17:34:13.084253 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.084079 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0d47dea1-b4c9-4c30-9592-ba829fe9f7d3-ovnkube-script-lib\") pod \"ovnkube-node-k5q2p\" (UID: \"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" Apr 22 17:34:13.084253 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.084114 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332-var-lib-kubelet\") pod \"tuned-dkxmf\" (UID: \"d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332\") " pod="openshift-cluster-node-tuning-operator/tuned-dkxmf" Apr 22 17:34:13.084253 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.084129 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/87846e27-279a-49b8-865a-3979451f84ba-host-run-multus-certs\") pod \"multus-6d99f\" (UID: \"87846e27-279a-49b8-865a-3979451f84ba\") " pod="openshift-multus/multus-6d99f" Apr 22 17:34:13.084253 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.084146 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/dace974d-6ce0-4a6d-9f8d-bde919b848c7-registration-dir\") pod \"aws-ebs-csi-driver-node-q4cjq\" (UID: \"dace974d-6ce0-4a6d-9f8d-bde919b848c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4cjq" Apr 22 17:34:13.084253 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.084185 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332-etc-sysctl-d\") pod \"tuned-dkxmf\" (UID: \"d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332\") " pod="openshift-cluster-node-tuning-operator/tuned-dkxmf" Apr 22 17:34:13.084253 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.084200 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87846e27-279a-49b8-865a-3979451f84ba-system-cni-dir\") pod \"multus-6d99f\" (UID: \"87846e27-279a-49b8-865a-3979451f84ba\") " pod="openshift-multus/multus-6d99f" Apr 22 17:34:13.084253 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.084217 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/87846e27-279a-49b8-865a-3979451f84ba-host-var-lib-cni-multus\") pod \"multus-6d99f\" (UID: \"87846e27-279a-49b8-865a-3979451f84ba\") " pod="openshift-multus/multus-6d99f" Apr 22 17:34:13.084253 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.084231 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/87846e27-279a-49b8-865a-3979451f84ba-multus-conf-dir\") pod \"multus-6d99f\" (UID: \"87846e27-279a-49b8-865a-3979451f84ba\") " pod="openshift-multus/multus-6d99f" Apr 22 17:34:13.084253 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.084245 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0d47dea1-b4c9-4c30-9592-ba829fe9f7d3-host-kubelet\") pod \"ovnkube-node-k5q2p\" (UID: \"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" Apr 22 17:34:13.084253 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.084259 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332-tmp\") pod \"tuned-dkxmf\" (UID: \"d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332\") " pod="openshift-cluster-node-tuning-operator/tuned-dkxmf" Apr 22 17:34:13.084819 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.084274 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-24zn6\" (UniqueName: \"kubernetes.io/projected/87846e27-279a-49b8-865a-3979451f84ba-kube-api-access-24zn6\") pod \"multus-6d99f\" (UID: \"87846e27-279a-49b8-865a-3979451f84ba\") " pod="openshift-multus/multus-6d99f" Apr 22 17:34:13.084819 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.084298 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87846e27-279a-49b8-865a-3979451f84ba-multus-cni-dir\") pod \"multus-6d99f\" (UID: \"87846e27-279a-49b8-865a-3979451f84ba\") " pod="openshift-multus/multus-6d99f" Apr 22 17:34:13.084819 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.084338 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0d47dea1-b4c9-4c30-9592-ba829fe9f7d3-var-lib-openvswitch\") pod \"ovnkube-node-k5q2p\" (UID: \"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" Apr 22 17:34:13.084819 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.084362 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0d47dea1-b4c9-4c30-9592-ba829fe9f7d3-run-ovn\") pod \"ovnkube-node-k5q2p\" (UID: \"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" Apr 22 17:34:13.084819 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.084386 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332-etc-kubernetes\") pod \"tuned-dkxmf\" (UID: \"d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332\") " pod="openshift-cluster-node-tuning-operator/tuned-dkxmf" Apr 22 17:34:13.084819 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.084411 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332-etc-tuned\") pod \"tuned-dkxmf\" (UID: \"d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332\") " pod="openshift-cluster-node-tuning-operator/tuned-dkxmf" Apr 22 17:34:13.084819 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.084427 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/87846e27-279a-49b8-865a-3979451f84ba-host-var-lib-cni-bin\") pod \"multus-6d99f\" (UID: \"87846e27-279a-49b8-865a-3979451f84ba\") " pod="openshift-multus/multus-6d99f" Apr 22 17:34:13.084819 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.084448 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1359a64d-2417-42d6-918d-bba7d2d9b6e7-system-cni-dir\") pod \"multus-additional-cni-plugins-wbltv\" (UID: \"1359a64d-2417-42d6-918d-bba7d2d9b6e7\") " pod="openshift-multus/multus-additional-cni-plugins-wbltv" Apr 22 17:34:13.084819 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.084473 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1359a64d-2417-42d6-918d-bba7d2d9b6e7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wbltv\" (UID: \"1359a64d-2417-42d6-918d-bba7d2d9b6e7\") " pod="openshift-multus/multus-additional-cni-plugins-wbltv" Apr 22 17:34:13.084819 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.084511 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6b871faa-db8a-4a95-8c94-6fed862a9dc7-hosts-file\") pod \"node-resolver-hfp87\" (UID: \"6b871faa-db8a-4a95-8c94-6fed862a9dc7\") " pod="openshift-dns/node-resolver-hfp87" Apr 22 17:34:13.084819 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.084533 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m22w8\" (UniqueName: \"kubernetes.io/projected/6b871faa-db8a-4a95-8c94-6fed862a9dc7-kube-api-access-m22w8\") pod \"node-resolver-hfp87\" (UID: \"6b871faa-db8a-4a95-8c94-6fed862a9dc7\") " pod="openshift-dns/node-resolver-hfp87" Apr 22 17:34:13.084819 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.084559 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0d47dea1-b4c9-4c30-9592-ba829fe9f7d3-host-run-netns\") pod \"ovnkube-node-k5q2p\" (UID: \"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" Apr 22 17:34:13.084819 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.084579 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332-lib-modules\") pod \"tuned-dkxmf\" (UID: \"d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332\") " pod="openshift-cluster-node-tuning-operator/tuned-dkxmf" Apr 22 17:34:13.084819 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.084596 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/87846e27-279a-49b8-865a-3979451f84ba-host-run-netns\") pod \"multus-6d99f\" (UID: \"87846e27-279a-49b8-865a-3979451f84ba\") " pod="openshift-multus/multus-6d99f" Apr 22 17:34:13.084819 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.084616 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0d47dea1-b4c9-4c30-9592-ba829fe9f7d3-etc-openvswitch\") pod \"ovnkube-node-k5q2p\" (UID: \"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" Apr 22 17:34:13.084819 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.084638 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0d47dea1-b4c9-4c30-9592-ba829fe9f7d3-log-socket\") pod \"ovnkube-node-k5q2p\" (UID: \"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" Apr 22 17:34:13.084819 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.084660 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0d47dea1-b4c9-4c30-9592-ba829fe9f7d3-host-cni-bin\") pod \"ovnkube-node-k5q2p\" (UID: \"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" Apr 22 17:34:13.085443 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.084676 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0d47dea1-b4c9-4c30-9592-ba829fe9f7d3-host-cni-netd\") pod \"ovnkube-node-k5q2p\" (UID: \"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" Apr 22 17:34:13.085443 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.084714 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-clmbw\" (UniqueName: \"kubernetes.io/projected/0d47dea1-b4c9-4c30-9592-ba829fe9f7d3-kube-api-access-clmbw\") pod \"ovnkube-node-k5q2p\" (UID: \"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" Apr 22 17:34:13.085443 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.084739 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f7kcx\" (UniqueName: \"kubernetes.io/projected/d94afc06-594c-4cc6-a15f-473ec2fb5297-kube-api-access-f7kcx\") pod \"node-ca-dxbhp\" (UID: \"d94afc06-594c-4cc6-a15f-473ec2fb5297\") " pod="openshift-image-registry/node-ca-dxbhp" Apr 22 17:34:13.085443 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.084764 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1359a64d-2417-42d6-918d-bba7d2d9b6e7-cnibin\") pod \"multus-additional-cni-plugins-wbltv\" (UID: \"1359a64d-2417-42d6-918d-bba7d2d9b6e7\") " pod="openshift-multus/multus-additional-cni-plugins-wbltv" Apr 22 17:34:13.085443 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.084790 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7p6x7\" (UniqueName: \"kubernetes.io/projected/473029a2-4794-4adf-8637-e61f8afbe3a4-kube-api-access-7p6x7\") pod \"network-check-target-p76lb\" (UID: \"473029a2-4794-4adf-8637-e61f8afbe3a4\") " pod="openshift-network-diagnostics/network-check-target-p76lb" Apr 22 17:34:13.085443 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.084796 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0d47dea1-b4c9-4c30-9592-ba829fe9f7d3-ovnkube-script-lib\") pod \"ovnkube-node-k5q2p\" (UID: \"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" Apr 22 17:34:13.085443 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.084816 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332-host\") pod \"tuned-dkxmf\" (UID: \"d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332\") " pod="openshift-cluster-node-tuning-operator/tuned-dkxmf" Apr 22 17:34:13.085443 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.084873 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0d47dea1-b4c9-4c30-9592-ba829fe9f7d3-systemd-units\") pod \"ovnkube-node-k5q2p\" (UID: \"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" Apr 22 17:34:13.085443 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.084895 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332-host\") pod \"tuned-dkxmf\" (UID: \"d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332\") " pod="openshift-cluster-node-tuning-operator/tuned-dkxmf" Apr 22 17:34:13.085443 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.084913 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jrbp2\" (UniqueName: \"kubernetes.io/projected/d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332-kube-api-access-jrbp2\") pod \"tuned-dkxmf\" (UID: \"d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332\") " pod="openshift-cluster-node-tuning-operator/tuned-dkxmf" Apr 22 17:34:13.085443 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.084946 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332-var-lib-kubelet\") pod \"tuned-dkxmf\" (UID: \"d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332\") " pod="openshift-cluster-node-tuning-operator/tuned-dkxmf" Apr 22 17:34:13.085443 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.084946 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1359a64d-2417-42d6-918d-bba7d2d9b6e7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wbltv\" (UID: \"1359a64d-2417-42d6-918d-bba7d2d9b6e7\") " pod="openshift-multus/multus-additional-cni-plugins-wbltv" Apr 22 17:34:13.085443 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.084994 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0d47dea1-b4c9-4c30-9592-ba829fe9f7d3-node-log\") pod \"ovnkube-node-k5q2p\" (UID: \"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" Apr 22 17:34:13.085443 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.085012 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2af98b77-7b18-41bf-b19c-6788c06627ec-host-slash\") pod \"iptables-alerter-mx4d8\" (UID: \"2af98b77-7b18-41bf-b19c-6788c06627ec\") " pod="openshift-network-operator/iptables-alerter-mx4d8" Apr 22 17:34:13.085443 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.085028 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/dace974d-6ce0-4a6d-9f8d-bde919b848c7-socket-dir\") pod \"aws-ebs-csi-driver-node-q4cjq\" (UID: \"dace974d-6ce0-4a6d-9f8d-bde919b848c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4cjq" Apr 22 17:34:13.085443 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.085051 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/dace974d-6ce0-4a6d-9f8d-bde919b848c7-device-dir\") pod \"aws-ebs-csi-driver-node-q4cjq\" (UID: \"dace974d-6ce0-4a6d-9f8d-bde919b848c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4cjq" Apr 22 17:34:13.085443 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.085079 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/87846e27-279a-49b8-865a-3979451f84ba-host-var-lib-kubelet\") pod \"multus-6d99f\" (UID: \"87846e27-279a-49b8-865a-3979451f84ba\") " pod="openshift-multus/multus-6d99f" Apr 22 17:34:13.086044 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.085107 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/561f8fb8-766d-438c-80dc-eacb32a87265-agent-certs\") pod \"konnectivity-agent-tm9m2\" (UID: \"561f8fb8-766d-438c-80dc-eacb32a87265\") " pod="kube-system/konnectivity-agent-tm9m2" Apr 22 17:34:13.086044 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.085123 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0d47dea1-b4c9-4c30-9592-ba829fe9f7d3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k5q2p\" (UID: \"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" Apr 22 17:34:13.086044 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.085141 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0d47dea1-b4c9-4c30-9592-ba829fe9f7d3-env-overrides\") pod \"ovnkube-node-k5q2p\" (UID: \"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" Apr 22 17:34:13.086044 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.085186 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2pmb6\" (UniqueName: \"kubernetes.io/projected/2af98b77-7b18-41bf-b19c-6788c06627ec-kube-api-access-2pmb6\") pod \"iptables-alerter-mx4d8\" (UID: \"2af98b77-7b18-41bf-b19c-6788c06627ec\") " pod="openshift-network-operator/iptables-alerter-mx4d8" Apr 22 17:34:13.086044 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.085211 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87846e27-279a-49b8-865a-3979451f84ba-etc-kubernetes\") pod \"multus-6d99f\" (UID: \"87846e27-279a-49b8-865a-3979451f84ba\") " pod="openshift-multus/multus-6d99f" Apr 22 17:34:13.086044 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.085238 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1359a64d-2417-42d6-918d-bba7d2d9b6e7-cni-binary-copy\") pod \"multus-additional-cni-plugins-wbltv\" (UID: \"1359a64d-2417-42d6-918d-bba7d2d9b6e7\") " pod="openshift-multus/multus-additional-cni-plugins-wbltv" Apr 22 17:34:13.086044 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.085266 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0d47dea1-b4c9-4c30-9592-ba829fe9f7d3-host-slash\") pod \"ovnkube-node-k5q2p\" (UID: \"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" Apr 22 17:34:13.086044 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.085285 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0d47dea1-b4c9-4c30-9592-ba829fe9f7d3-ovn-node-metrics-cert\") pod \"ovnkube-node-k5q2p\" (UID: \"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" Apr 22 17:34:13.086044 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.085310 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d94afc06-594c-4cc6-a15f-473ec2fb5297-serviceca\") pod \"node-ca-dxbhp\" (UID: \"d94afc06-594c-4cc6-a15f-473ec2fb5297\") " pod="openshift-image-registry/node-ca-dxbhp" Apr 22 17:34:13.086044 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.085338 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332-sys\") pod \"tuned-dkxmf\" (UID: \"d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332\") " pod="openshift-cluster-node-tuning-operator/tuned-dkxmf" Apr 22 17:34:13.086044 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.085362 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d94afc06-594c-4cc6-a15f-473ec2fb5297-host\") pod \"node-ca-dxbhp\" (UID: \"d94afc06-594c-4cc6-a15f-473ec2fb5297\") " pod="openshift-image-registry/node-ca-dxbhp" Apr 22 17:34:13.086044 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.085377 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1359a64d-2417-42d6-918d-bba7d2d9b6e7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wbltv\" (UID: \"1359a64d-2417-42d6-918d-bba7d2d9b6e7\") " pod="openshift-multus/multus-additional-cni-plugins-wbltv" Apr 22 17:34:13.086044 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.085397 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/dace974d-6ce0-4a6d-9f8d-bde919b848c7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q4cjq\" (UID: \"dace974d-6ce0-4a6d-9f8d-bde919b848c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4cjq" Apr 22 17:34:13.086044 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.085422 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/dace974d-6ce0-4a6d-9f8d-bde919b848c7-sys-fs\") pod \"aws-ebs-csi-driver-node-q4cjq\" (UID: \"dace974d-6ce0-4a6d-9f8d-bde919b848c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4cjq" Apr 22 17:34:13.086044 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.085438 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332-etc-systemd\") pod \"tuned-dkxmf\" (UID: \"d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332\") " pod="openshift-cluster-node-tuning-operator/tuned-dkxmf" Apr 22 17:34:13.086044 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.085463 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/561f8fb8-766d-438c-80dc-eacb32a87265-konnectivity-ca\") pod \"konnectivity-agent-tm9m2\" (UID: \"561f8fb8-766d-438c-80dc-eacb32a87265\") " pod="kube-system/konnectivity-agent-tm9m2" Apr 22 17:34:13.086044 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:13.085483 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Apr 22 17:34:13.086044 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.085488 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b871faa-db8a-4a95-8c94-6fed862a9dc7-tmp-dir\") pod \"node-resolver-hfp87\" (UID: \"6b871faa-db8a-4a95-8c94-6fed862a9dc7\") " pod="openshift-dns/node-resolver-hfp87" Apr 22 17:34:13.086726 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.085511 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0d47dea1-b4c9-4c30-9592-ba829fe9f7d3-host-run-ovn-kubernetes\") pod \"ovnkube-node-k5q2p\" (UID: \"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" Apr 22 17:34:13.086726 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.085541 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332-etc-sysctl-conf\") pod \"tuned-dkxmf\" (UID: \"d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332\") " pod="openshift-cluster-node-tuning-operator/tuned-dkxmf" Apr 22 17:34:13.086726 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.085561 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/87846e27-279a-49b8-865a-3979451f84ba-cni-binary-copy\") pod \"multus-6d99f\" (UID: \"87846e27-279a-49b8-865a-3979451f84ba\") " pod="openshift-multus/multus-6d99f" Apr 22 17:34:13.086726 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.085589 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jgdns\" (UniqueName: \"kubernetes.io/projected/1359a64d-2417-42d6-918d-bba7d2d9b6e7-kube-api-access-jgdns\") pod \"multus-additional-cni-plugins-wbltv\" (UID: \"1359a64d-2417-42d6-918d-bba7d2d9b6e7\") " pod="openshift-multus/multus-additional-cni-plugins-wbltv" Apr 22 17:34:13.086726 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.085632 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0d47dea1-b4c9-4c30-9592-ba829fe9f7d3-run-openvswitch\") pod \"ovnkube-node-k5q2p\" (UID: \"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" Apr 22 17:34:13.086726 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.085658 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/dace974d-6ce0-4a6d-9f8d-bde919b848c7-etc-selinux\") pod \"aws-ebs-csi-driver-node-q4cjq\" (UID: \"dace974d-6ce0-4a6d-9f8d-bde919b848c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4cjq" Apr 22 17:34:13.086726 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.085683 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kvkrw\" (UniqueName: \"kubernetes.io/projected/dace974d-6ce0-4a6d-9f8d-bde919b848c7-kube-api-access-kvkrw\") pod \"aws-ebs-csi-driver-node-q4cjq\" (UID: \"dace974d-6ce0-4a6d-9f8d-bde919b848c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4cjq" Apr 22 17:34:13.086726 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.085705 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332-etc-modprobe-d\") pod \"tuned-dkxmf\" (UID: \"d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332\") " pod="openshift-cluster-node-tuning-operator/tuned-dkxmf" Apr 22 17:34:13.086726 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.085723 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/87846e27-279a-49b8-865a-3979451f84ba-host-run-k8s-cni-cncf-io\") pod \"multus-6d99f\" (UID: \"87846e27-279a-49b8-865a-3979451f84ba\") " pod="openshift-multus/multus-6d99f" Apr 22 17:34:13.086726 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.085740 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/87846e27-279a-49b8-865a-3979451f84ba-multus-daemon-config\") pod \"multus-6d99f\" (UID: \"87846e27-279a-49b8-865a-3979451f84ba\") " pod="openshift-multus/multus-6d99f" Apr 22 17:34:13.086726 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.085768 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1359a64d-2417-42d6-918d-bba7d2d9b6e7-os-release\") pod \"multus-additional-cni-plugins-wbltv\" (UID: \"1359a64d-2417-42d6-918d-bba7d2d9b6e7\") " pod="openshift-multus/multus-additional-cni-plugins-wbltv" Apr 22 17:34:13.086726 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.085877 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1359a64d-2417-42d6-918d-bba7d2d9b6e7-os-release\") pod \"multus-additional-cni-plugins-wbltv\" (UID: \"1359a64d-2417-42d6-918d-bba7d2d9b6e7\") " pod="openshift-multus/multus-additional-cni-plugins-wbltv" Apr 22 17:34:13.086726 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.085922 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/87846e27-279a-49b8-865a-3979451f84ba-host-run-multus-certs\") pod \"multus-6d99f\" (UID: \"87846e27-279a-49b8-865a-3979451f84ba\") " pod="openshift-multus/multus-6d99f" Apr 22 17:34:13.086726 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.085969 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/dace974d-6ce0-4a6d-9f8d-bde919b848c7-registration-dir\") pod \"aws-ebs-csi-driver-node-q4cjq\" (UID: \"dace974d-6ce0-4a6d-9f8d-bde919b848c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4cjq" Apr 22 17:34:13.086726 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.086090 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332-etc-sysctl-d\") pod \"tuned-dkxmf\" (UID: \"d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332\") " pod="openshift-cluster-node-tuning-operator/tuned-dkxmf" Apr 22 17:34:13.086726 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.086134 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87846e27-279a-49b8-865a-3979451f84ba-system-cni-dir\") pod \"multus-6d99f\" (UID: \"87846e27-279a-49b8-865a-3979451f84ba\") " pod="openshift-multus/multus-6d99f" Apr 22 17:34:13.086726 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.086161 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/87846e27-279a-49b8-865a-3979451f84ba-host-var-lib-cni-multus\") pod \"multus-6d99f\" (UID: \"87846e27-279a-49b8-865a-3979451f84ba\") " pod="openshift-multus/multus-6d99f" Apr 22 17:34:13.087422 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.086209 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/87846e27-279a-49b8-865a-3979451f84ba-multus-conf-dir\") pod \"multus-6d99f\" (UID: \"87846e27-279a-49b8-865a-3979451f84ba\") " pod="openshift-multus/multus-6d99f" Apr 22 17:34:13.087422 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.086242 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0d47dea1-b4c9-4c30-9592-ba829fe9f7d3-host-kubelet\") pod \"ovnkube-node-k5q2p\" (UID: \"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" Apr 22 17:34:13.087422 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.086272 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2af98b77-7b18-41bf-b19c-6788c06627ec-iptables-alerter-script\") pod \"iptables-alerter-mx4d8\" (UID: \"2af98b77-7b18-41bf-b19c-6788c06627ec\") " pod="openshift-network-operator/iptables-alerter-mx4d8" Apr 22 17:34:13.087422 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.086338 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332-etc-sysconfig\") pod \"tuned-dkxmf\" (UID: \"d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332\") " pod="openshift-cluster-node-tuning-operator/tuned-dkxmf" Apr 22 17:34:13.087422 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.086384 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/87846e27-279a-49b8-865a-3979451f84ba-multus-socket-dir-parent\") pod \"multus-6d99f\" (UID: \"87846e27-279a-49b8-865a-3979451f84ba\") " pod="openshift-multus/multus-6d99f" Apr 22 17:34:13.087422 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.086422 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/87846e27-279a-49b8-865a-3979451f84ba-hostroot\") pod \"multus-6d99f\" (UID: \"87846e27-279a-49b8-865a-3979451f84ba\") " pod="openshift-multus/multus-6d99f" Apr 22 17:34:13.087422 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.086466 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332-run\") pod \"tuned-dkxmf\" (UID: \"d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332\") " pod="openshift-cluster-node-tuning-operator/tuned-dkxmf" Apr 22 17:34:13.087422 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.086498 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/87846e27-279a-49b8-865a-3979451f84ba-cnibin\") pod \"multus-6d99f\" (UID: \"87846e27-279a-49b8-865a-3979451f84ba\") " pod="openshift-multus/multus-6d99f" Apr 22 17:34:13.087422 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.086494 2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Apr 22 17:34:13.087422 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.086559 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/87846e27-279a-49b8-865a-3979451f84ba-os-release\") pod \"multus-6d99f\" (UID: \"87846e27-279a-49b8-865a-3979451f84ba\") " pod="openshift-multus/multus-6d99f" Apr 22 17:34:13.087422 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.086525 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/87846e27-279a-49b8-865a-3979451f84ba-host-var-lib-kubelet\") pod \"multus-6d99f\" (UID: \"87846e27-279a-49b8-865a-3979451f84ba\") " pod="openshift-multus/multus-6d99f" Apr 22 17:34:13.087422 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.086599 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0d47dea1-b4c9-4c30-9592-ba829fe9f7d3-run-systemd\") pod \"ovnkube-node-k5q2p\" (UID: \"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" Apr 22 17:34:13.087422 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.086843 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87846e27-279a-49b8-865a-3979451f84ba-multus-cni-dir\") pod \"multus-6d99f\" (UID: \"87846e27-279a-49b8-865a-3979451f84ba\") " pod="openshift-multus/multus-6d99f" Apr 22 17:34:13.087422 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.086900 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0d47dea1-b4c9-4c30-9592-ba829fe9f7d3-var-lib-openvswitch\") pod \"ovnkube-node-k5q2p\" (UID: \"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" Apr 22 17:34:13.087422 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.086944 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0d47dea1-b4c9-4c30-9592-ba829fe9f7d3-run-ovn\") pod \"ovnkube-node-k5q2p\" (UID: \"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" Apr 22 17:34:13.087422 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.084358 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1359a64d-2417-42d6-918d-bba7d2d9b6e7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wbltv\" (UID: \"1359a64d-2417-42d6-918d-bba7d2d9b6e7\") " pod="openshift-multus/multus-additional-cni-plugins-wbltv" Apr 22 17:34:13.087422 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.087005 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332-etc-kubernetes\") pod \"tuned-dkxmf\" (UID: \"d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332\") " pod="openshift-cluster-node-tuning-operator/tuned-dkxmf" Apr 22 17:34:13.087422 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.087038 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0d47dea1-b4c9-4c30-9592-ba829fe9f7d3-ovnkube-config\") pod \"ovnkube-node-k5q2p\" (UID: \"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" Apr 22 17:34:13.088214 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.087305 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332-etc-systemd\") pod \"tuned-dkxmf\" (UID: \"d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332\") " pod="openshift-cluster-node-tuning-operator/tuned-dkxmf" Apr 22 17:34:13.088214 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.087358 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0d47dea1-b4c9-4c30-9592-ba829fe9f7d3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k5q2p\" (UID: \"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" Apr 22 17:34:13.088214 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.087615 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/87846e27-279a-49b8-865a-3979451f84ba-host-var-lib-cni-bin\") pod \"multus-6d99f\" (UID: \"87846e27-279a-49b8-865a-3979451f84ba\") " pod="openshift-multus/multus-6d99f" Apr 22 17:34:13.088214 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.087674 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1359a64d-2417-42d6-918d-bba7d2d9b6e7-system-cni-dir\") pod \"multus-additional-cni-plugins-wbltv\" (UID: \"1359a64d-2417-42d6-918d-bba7d2d9b6e7\") " pod="openshift-multus/multus-additional-cni-plugins-wbltv" Apr 22 17:34:13.088214 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.087742 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0d47dea1-b4c9-4c30-9592-ba829fe9f7d3-env-overrides\") pod \"ovnkube-node-k5q2p\" (UID: \"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" Apr 22 17:34:13.088214 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.087828 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1359a64d-2417-42d6-918d-bba7d2d9b6e7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wbltv\" (UID: \"1359a64d-2417-42d6-918d-bba7d2d9b6e7\") " pod="openshift-multus/multus-additional-cni-plugins-wbltv" Apr 22 17:34:13.088214 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.087887 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6b871faa-db8a-4a95-8c94-6fed862a9dc7-hosts-file\") pod \"node-resolver-hfp87\" (UID: \"6b871faa-db8a-4a95-8c94-6fed862a9dc7\") " pod="openshift-dns/node-resolver-hfp87" Apr 22 17:34:13.088214 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.088101 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0d47dea1-b4c9-4c30-9592-ba829fe9f7d3-host-run-netns\") pod \"ovnkube-node-k5q2p\" (UID: \"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" Apr 22 17:34:13.088214 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.088206 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87846e27-279a-49b8-865a-3979451f84ba-etc-kubernetes\") pod \"multus-6d99f\" (UID: \"87846e27-279a-49b8-865a-3979451f84ba\") " pod="openshift-multus/multus-6d99f" Apr 22 17:34:13.088631 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.088258 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332-lib-modules\") pod \"tuned-dkxmf\" (UID: \"d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332\") " pod="openshift-cluster-node-tuning-operator/tuned-dkxmf" Apr 22 17:34:13.088631 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.088287 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/561f8fb8-766d-438c-80dc-eacb32a87265-konnectivity-ca\") pod \"konnectivity-agent-tm9m2\" (UID: \"561f8fb8-766d-438c-80dc-eacb32a87265\") " pod="kube-system/konnectivity-agent-tm9m2" Apr 22 17:34:13.088631 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.088309 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/87846e27-279a-49b8-865a-3979451f84ba-host-run-netns\") pod \"multus-6d99f\" (UID: \"87846e27-279a-49b8-865a-3979451f84ba\") " pod="openshift-multus/multus-6d99f" Apr 22 17:34:13.088631 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.088351 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0d47dea1-b4c9-4c30-9592-ba829fe9f7d3-etc-openvswitch\") pod \"ovnkube-node-k5q2p\" (UID: \"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" Apr 22 17:34:13.088631 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.088367 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0d47dea1-b4c9-4c30-9592-ba829fe9f7d3-host-run-ovn-kubernetes\") pod \"ovnkube-node-k5q2p\" (UID: \"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" Apr 22 17:34:13.088631 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.088492 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332-etc-sysctl-conf\") pod \"tuned-dkxmf\" (UID: \"d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332\") " pod="openshift-cluster-node-tuning-operator/tuned-dkxmf" Apr 22 17:34:13.088631 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.088495 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0d47dea1-b4c9-4c30-9592-ba829fe9f7d3-host-slash\") pod \"ovnkube-node-k5q2p\" (UID: \"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" Apr 22 17:34:13.088631 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:13.088541 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4dbaf65e-c017-4ec0-bcc0-808342d2272b-metrics-certs podName:4dbaf65e-c017-4ec0-bcc0-808342d2272b nodeName:}" failed. No retries permitted until 2026-04-22 17:34:13.588507928 +0000 UTC m=+3.033071098 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4dbaf65e-c017-4ec0-bcc0-808342d2272b-metrics-certs") pod "network-metrics-daemon-n4clb" (UID: "4dbaf65e-c017-4ec0-bcc0-808342d2272b") : object "openshift-multus"/"metrics-daemon-secret" not registered Apr 22 17:34:13.088631 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.088602 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b871faa-db8a-4a95-8c94-6fed862a9dc7-tmp-dir\") pod \"node-resolver-hfp87\" (UID: \"6b871faa-db8a-4a95-8c94-6fed862a9dc7\") " pod="openshift-dns/node-resolver-hfp87" Apr 22 17:34:13.089036 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.088688 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0d47dea1-b4c9-4c30-9592-ba829fe9f7d3-log-socket\") pod \"ovnkube-node-k5q2p\" (UID: \"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" Apr 22 17:34:13.089036 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.088732 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0d47dea1-b4c9-4c30-9592-ba829fe9f7d3-host-cni-bin\") pod \"ovnkube-node-k5q2p\" (UID: \"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" Apr 22 17:34:13.089036 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.088774 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0d47dea1-b4c9-4c30-9592-ba829fe9f7d3-host-cni-netd\") pod \"ovnkube-node-k5q2p\" (UID: \"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" Apr 22 17:34:13.089036 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.088888 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/87846e27-279a-49b8-865a-3979451f84ba-cni-binary-copy\") pod \"multus-6d99f\" (UID: \"87846e27-279a-49b8-865a-3979451f84ba\") " pod="openshift-multus/multus-6d99f" Apr 22 17:34:13.089248 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.089157 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0d47dea1-b4c9-4c30-9592-ba829fe9f7d3-run-openvswitch\") pod \"ovnkube-node-k5q2p\" (UID: \"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" Apr 22 17:34:13.089248 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.089223 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1359a64d-2417-42d6-918d-bba7d2d9b6e7-cnibin\") pod \"multus-additional-cni-plugins-wbltv\" (UID: \"1359a64d-2417-42d6-918d-bba7d2d9b6e7\") " pod="openshift-multus/multus-additional-cni-plugins-wbltv" Apr 22 17:34:13.089347 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.089265 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/dace974d-6ce0-4a6d-9f8d-bde919b848c7-etc-selinux\") pod \"aws-ebs-csi-driver-node-q4cjq\" (UID: \"dace974d-6ce0-4a6d-9f8d-bde919b848c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4cjq" Apr 22 17:34:13.089347 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.089263 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1359a64d-2417-42d6-918d-bba7d2d9b6e7-cni-binary-copy\") pod \"multus-additional-cni-plugins-wbltv\" (UID: \"1359a64d-2417-42d6-918d-bba7d2d9b6e7\") " pod="openshift-multus/multus-additional-cni-plugins-wbltv" Apr 22 17:34:13.089347 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.089328 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d94afc06-594c-4cc6-a15f-473ec2fb5297-host\") pod \"node-ca-dxbhp\" (UID: \"d94afc06-594c-4cc6-a15f-473ec2fb5297\") " pod="openshift-image-registry/node-ca-dxbhp" Apr 22 17:34:13.089487 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.089473 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0d47dea1-b4c9-4c30-9592-ba829fe9f7d3-node-log\") pod \"ovnkube-node-k5q2p\" (UID: \"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" Apr 22 17:34:13.090359 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.089600 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/dace974d-6ce0-4a6d-9f8d-bde919b848c7-socket-dir\") pod \"aws-ebs-csi-driver-node-q4cjq\" (UID: \"dace974d-6ce0-4a6d-9f8d-bde919b848c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4cjq" Apr 22 17:34:13.090359 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.089671 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/dace974d-6ce0-4a6d-9f8d-bde919b848c7-device-dir\") pod \"aws-ebs-csi-driver-node-q4cjq\" (UID: \"dace974d-6ce0-4a6d-9f8d-bde919b848c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4cjq" Apr 22 17:34:13.090359 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.089473 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332-etc-modprobe-d\") pod \"tuned-dkxmf\" (UID: \"d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332\") " pod="openshift-cluster-node-tuning-operator/tuned-dkxmf" Apr 22 17:34:13.090359 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.089694 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d94afc06-594c-4cc6-a15f-473ec2fb5297-serviceca\") pod \"node-ca-dxbhp\" (UID: \"d94afc06-594c-4cc6-a15f-473ec2fb5297\") " pod="openshift-image-registry/node-ca-dxbhp" Apr 22 17:34:13.090359 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.089749 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/dace974d-6ce0-4a6d-9f8d-bde919b848c7-sys-fs\") pod \"aws-ebs-csi-driver-node-q4cjq\" (UID: \"dace974d-6ce0-4a6d-9f8d-bde919b848c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4cjq" Apr 22 17:34:13.090359 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.089756 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332-sys\") pod \"tuned-dkxmf\" (UID: \"d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332\") " pod="openshift-cluster-node-tuning-operator/tuned-dkxmf" Apr 22 17:34:13.090359 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.089792 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/87846e27-279a-49b8-865a-3979451f84ba-host-run-k8s-cni-cncf-io\") pod \"multus-6d99f\" (UID: \"87846e27-279a-49b8-865a-3979451f84ba\") " pod="openshift-multus/multus-6d99f" Apr 22 17:34:13.090359 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.089829 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2af98b77-7b18-41bf-b19c-6788c06627ec-host-slash\") pod \"iptables-alerter-mx4d8\" (UID: \"2af98b77-7b18-41bf-b19c-6788c06627ec\") " pod="openshift-network-operator/iptables-alerter-mx4d8" Apr 22 17:34:13.090359 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.089995 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/87846e27-279a-49b8-865a-3979451f84ba-multus-daemon-config\") pod \"multus-6d99f\" (UID: \"87846e27-279a-49b8-865a-3979451f84ba\") " pod="openshift-multus/multus-6d99f" Apr 22 17:34:13.090359 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.090128 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/dace974d-6ce0-4a6d-9f8d-bde919b848c7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q4cjq\" (UID: \"dace974d-6ce0-4a6d-9f8d-bde919b848c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4cjq" Apr 22 17:34:13.090359 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.090332 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332-tmp\") pod \"tuned-dkxmf\" (UID: \"d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332\") " pod="openshift-cluster-node-tuning-operator/tuned-dkxmf" Apr 22 17:34:13.090885 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.090406 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/561f8fb8-766d-438c-80dc-eacb32a87265-agent-certs\") pod \"konnectivity-agent-tm9m2\" (UID: \"561f8fb8-766d-438c-80dc-eacb32a87265\") " pod="kube-system/konnectivity-agent-tm9m2" Apr 22 17:34:13.091032 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.090994 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0d47dea1-b4c9-4c30-9592-ba829fe9f7d3-ovn-node-metrics-cert\") pod \"ovnkube-node-k5q2p\" (UID: \"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" Apr 22 17:34:13.092039 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.092018 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332-etc-tuned\") pod \"tuned-dkxmf\" (UID: \"d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332\") " pod="openshift-cluster-node-tuning-operator/tuned-dkxmf" Apr 22 17:34:13.100194 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.099496 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9c8s\" (UniqueName: \"kubernetes.io/projected/4dbaf65e-c017-4ec0-bcc0-808342d2272b-kube-api-access-z9c8s\") pod \"network-metrics-daemon-n4clb\" (UID: \"4dbaf65e-c017-4ec0-bcc0-808342d2272b\") " pod="openshift-multus/network-metrics-daemon-n4clb" Apr 22 17:34:13.100290 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.100243 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m22w8\" (UniqueName: \"kubernetes.io/projected/6b871faa-db8a-4a95-8c94-6fed862a9dc7-kube-api-access-m22w8\") pod \"node-resolver-hfp87\" (UID: \"6b871faa-db8a-4a95-8c94-6fed862a9dc7\") " pod="openshift-dns/node-resolver-hfp87" Apr 22 17:34:13.100785 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:13.100711 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Apr 22 17:34:13.100882 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:13.100848 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Apr 22 17:34:13.100882 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:13.100874 2576 projected.go:194] Error preparing data for projected volume kube-api-access-7p6x7 for pod openshift-network-diagnostics/network-check-target-p76lb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 22 17:34:13.101012 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:13.100947 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/473029a2-4794-4adf-8637-e61f8afbe3a4-kube-api-access-7p6x7 podName:473029a2-4794-4adf-8637-e61f8afbe3a4 nodeName:}" failed. No retries permitted until 2026-04-22 17:34:13.600926368 +0000 UTC m=+3.045489530 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7p6x7" (UniqueName: "kubernetes.io/projected/473029a2-4794-4adf-8637-e61f8afbe3a4-kube-api-access-7p6x7") pod "network-check-target-p76lb" (UID: "473029a2-4794-4adf-8637-e61f8afbe3a4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 22 17:34:13.103953 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.101453 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pmb6\" (UniqueName: \"kubernetes.io/projected/2af98b77-7b18-41bf-b19c-6788c06627ec-kube-api-access-2pmb6\") pod \"iptables-alerter-mx4d8\" (UID: \"2af98b77-7b18-41bf-b19c-6788c06627ec\") " pod="openshift-network-operator/iptables-alerter-mx4d8" Apr 22 17:34:13.103953 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.101556 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clmbw\" (UniqueName: \"kubernetes.io/projected/0d47dea1-b4c9-4c30-9592-ba829fe9f7d3-kube-api-access-clmbw\") pod \"ovnkube-node-k5q2p\" (UID: \"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" Apr 22 17:34:13.103953 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.102757 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvkrw\" (UniqueName: \"kubernetes.io/projected/dace974d-6ce0-4a6d-9f8d-bde919b848c7-kube-api-access-kvkrw\") pod \"aws-ebs-csi-driver-node-q4cjq\" (UID: \"dace974d-6ce0-4a6d-9f8d-bde919b848c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4cjq" Apr 22 17:34:13.103953 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.103452 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-24zn6\" (UniqueName: \"kubernetes.io/projected/87846e27-279a-49b8-865a-3979451f84ba-kube-api-access-24zn6\") pod \"multus-6d99f\" (UID: \"87846e27-279a-49b8-865a-3979451f84ba\") " pod="openshift-multus/multus-6d99f" Apr 22 17:34:13.104810 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.104783 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrbp2\" (UniqueName: \"kubernetes.io/projected/d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332-kube-api-access-jrbp2\") pod \"tuned-dkxmf\" (UID: \"d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332\") " pod="openshift-cluster-node-tuning-operator/tuned-dkxmf" Apr 22 17:34:13.104934 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.104909 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7kcx\" (UniqueName: \"kubernetes.io/projected/d94afc06-594c-4cc6-a15f-473ec2fb5297-kube-api-access-f7kcx\") pod \"node-ca-dxbhp\" (UID: \"d94afc06-594c-4cc6-a15f-473ec2fb5297\") " pod="openshift-image-registry/node-ca-dxbhp" Apr 22 17:34:13.105914 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.105896 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgdns\" (UniqueName: \"kubernetes.io/projected/1359a64d-2417-42d6-918d-bba7d2d9b6e7-kube-api-access-jgdns\") pod \"multus-additional-cni-plugins-wbltv\" (UID: \"1359a64d-2417-42d6-918d-bba7d2d9b6e7\") " pod="openshift-multus/multus-additional-cni-plugins-wbltv" Apr 22 17:34:13.272988 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.272946 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6d99f" Apr 22 17:34:13.279703 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.279682 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wbltv" Apr 22 17:34:13.288357 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.288332 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tm9m2" Apr 22 17:34:13.293867 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.293844 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hfp87" Apr 22 17:34:13.300370 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.300352 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mx4d8" Apr 22 17:34:13.308023 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.308007 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" Apr 22 17:34:13.313613 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.313595 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4cjq" Apr 22 17:34:13.320103 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.320087 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dkxmf" Apr 22 17:34:13.325617 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.325598 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dxbhp" Apr 22 17:34:13.589618 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.589533 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4dbaf65e-c017-4ec0-bcc0-808342d2272b-metrics-certs\") pod \"network-metrics-daemon-n4clb\" (UID: \"4dbaf65e-c017-4ec0-bcc0-808342d2272b\") " pod="openshift-multus/network-metrics-daemon-n4clb" Apr 22 17:34:13.589777 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:13.589659 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Apr 22 17:34:13.589777 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:13.589724 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4dbaf65e-c017-4ec0-bcc0-808342d2272b-metrics-certs podName:4dbaf65e-c017-4ec0-bcc0-808342d2272b nodeName:}" failed. No retries permitted until 2026-04-22 17:34:14.58970355 +0000 UTC m=+4.034266716 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4dbaf65e-c017-4ec0-bcc0-808342d2272b-metrics-certs") pod "network-metrics-daemon-n4clb" (UID: "4dbaf65e-c017-4ec0-bcc0-808342d2272b") : object "openshift-multus"/"metrics-daemon-secret" not registered Apr 22 17:34:13.668641 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:13.668616 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b871faa_db8a_4a95_8c94_6fed862a9dc7.slice/crio-1d4707ab23a62d9e2e36b7a98ab1e592d6c2fea635f4dfc5a82fe2232c19e91b WatchSource:0}: Error finding container 1d4707ab23a62d9e2e36b7a98ab1e592d6c2fea635f4dfc5a82fe2232c19e91b: Status 404 returned error can't find the container with id 1d4707ab23a62d9e2e36b7a98ab1e592d6c2fea635f4dfc5a82fe2232c19e91b Apr 22 17:34:13.670732 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:13.670704 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d47dea1_b4c9_4c30_9592_ba829fe9f7d3.slice/crio-713bd48af694a948734383429db9442c4418625a13c6782861230ab4c329c82e WatchSource:0}: Error finding container 713bd48af694a948734383429db9442c4418625a13c6782861230ab4c329c82e: Status 404 returned error can't find the container with id 713bd48af694a948734383429db9442c4418625a13c6782861230ab4c329c82e Apr 22 17:34:13.673587 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:13.673564 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd94afc06_594c_4cc6_a15f_473ec2fb5297.slice/crio-bbbd21f90d12d2c3e28a9402327fa255452f9bcff47aca61539f0044abf02ad1 WatchSource:0}: Error finding container bbbd21f90d12d2c3e28a9402327fa255452f9bcff47aca61539f0044abf02ad1: Status 404 returned error can't find the container with id bbbd21f90d12d2c3e28a9402327fa255452f9bcff47aca61539f0044abf02ad1 Apr 22 17:34:13.674543 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:13.674512 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87846e27_279a_49b8_865a_3979451f84ba.slice/crio-49e63ab168f776c0104231417270df0c43d936b0a4a2994233aa164407a8303f WatchSource:0}: Error finding container 49e63ab168f776c0104231417270df0c43d936b0a4a2994233aa164407a8303f: Status 404 returned error can't find the container with id 49e63ab168f776c0104231417270df0c43d936b0a4a2994233aa164407a8303f Apr 22 17:34:13.675401 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:13.675377 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1359a64d_2417_42d6_918d_bba7d2d9b6e7.slice/crio-0a30c59f2d892eff05eaff1cfb84f3188663242662bf304e08dcbba3c6bc2f48 WatchSource:0}: Error finding container 0a30c59f2d892eff05eaff1cfb84f3188663242662bf304e08dcbba3c6bc2f48: Status 404 returned error can't find the container with id 0a30c59f2d892eff05eaff1cfb84f3188663242662bf304e08dcbba3c6bc2f48 Apr 22 17:34:13.676349 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:13.676232 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2af98b77_7b18_41bf_b19c_6788c06627ec.slice/crio-7cdcb403ba3fc28d5cff86d5e6d47e7ca398782dd32f8e165f212dc97a91273d WatchSource:0}: Error finding container 7cdcb403ba3fc28d5cff86d5e6d47e7ca398782dd32f8e165f212dc97a91273d: Status 404 returned error can't find the container with id 7cdcb403ba3fc28d5cff86d5e6d47e7ca398782dd32f8e165f212dc97a91273d Apr 22 17:34:13.690058 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:13.690036 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7p6x7\" (UniqueName: \"kubernetes.io/projected/473029a2-4794-4adf-8637-e61f8afbe3a4-kube-api-access-7p6x7\") pod \"network-check-target-p76lb\" (UID: \"473029a2-4794-4adf-8637-e61f8afbe3a4\") " pod="openshift-network-diagnostics/network-check-target-p76lb" Apr 22 17:34:13.690165 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:13.690139 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Apr 22 17:34:13.690165 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:13.690155 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Apr 22 17:34:13.690288 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:13.690167 2576 projected.go:194] Error preparing data for projected volume kube-api-access-7p6x7 for pod openshift-network-diagnostics/network-check-target-p76lb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 22 17:34:13.690288 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:13.690233 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/473029a2-4794-4adf-8637-e61f8afbe3a4-kube-api-access-7p6x7 podName:473029a2-4794-4adf-8637-e61f8afbe3a4 nodeName:}" failed. No retries permitted until 2026-04-22 17:34:14.690215465 +0000 UTC m=+4.134778642 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7p6x7" (UniqueName: "kubernetes.io/projected/473029a2-4794-4adf-8637-e61f8afbe3a4-kube-api-access-7p6x7") pod "network-check-target-p76lb" (UID: "473029a2-4794-4adf-8637-e61f8afbe3a4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 22 17:34:14.013938 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:14.013902 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-04-21 17:29:12 +0000 UTC" deadline="2027-09-20 14:32:38.968457182 +0000 UTC" Apr 22 17:34:14.013938 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:14.013933 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12380h58m24.954526572s" Apr 22 17:34:14.069121 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:14.068443 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p76lb" Apr 22 17:34:14.069121 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:14.068729 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p76lb" podUID="473029a2-4794-4adf-8637-e61f8afbe3a4" Apr 22 17:34:14.086879 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:14.086815 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dkxmf" event={"ID":"d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332","Type":"ContainerStarted","Data":"5ba9552853f5c61a603c28139565b44322fd4a4208c16c6480b04475c3170de2"} Apr 22 17:34:14.092381 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:14.092322 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mx4d8" event={"ID":"2af98b77-7b18-41bf-b19c-6788c06627ec","Type":"ContainerStarted","Data":"7cdcb403ba3fc28d5cff86d5e6d47e7ca398782dd32f8e165f212dc97a91273d"} Apr 22 17:34:14.095967 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:14.095934 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4cjq" event={"ID":"dace974d-6ce0-4a6d-9f8d-bde919b848c7","Type":"ContainerStarted","Data":"104c7c38dc7bc0aef1d0d5f81d9c77f93a1100495850378405a8e3bf8baab6a8"} Apr 22 17:34:14.106104 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:14.106060 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wbltv" event={"ID":"1359a64d-2417-42d6-918d-bba7d2d9b6e7","Type":"ContainerStarted","Data":"0a30c59f2d892eff05eaff1cfb84f3188663242662bf304e08dcbba3c6bc2f48"} Apr 22 17:34:14.110366 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:14.110315 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tm9m2" event={"ID":"561f8fb8-766d-438c-80dc-eacb32a87265","Type":"ContainerStarted","Data":"42f2995a938015cded624b6ac0eb59aa8e86eb848d87bef603013f0b7b1b850d"} Apr 22 17:34:14.112673 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:14.112610 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dxbhp" event={"ID":"d94afc06-594c-4cc6-a15f-473ec2fb5297","Type":"ContainerStarted","Data":"bbbd21f90d12d2c3e28a9402327fa255452f9bcff47aca61539f0044abf02ad1"} Apr 22 17:34:14.122236 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:14.122163 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6d99f" event={"ID":"87846e27-279a-49b8-865a-3979451f84ba","Type":"ContainerStarted","Data":"49e63ab168f776c0104231417270df0c43d936b0a4a2994233aa164407a8303f"} Apr 22 17:34:14.126124 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:14.126068 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" event={"ID":"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3","Type":"ContainerStarted","Data":"713bd48af694a948734383429db9442c4418625a13c6782861230ab4c329c82e"} Apr 22 17:34:14.129490 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:14.129464 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hfp87" event={"ID":"6b871faa-db8a-4a95-8c94-6fed862a9dc7","Type":"ContainerStarted","Data":"1d4707ab23a62d9e2e36b7a98ab1e592d6c2fea635f4dfc5a82fe2232c19e91b"} Apr 22 17:34:14.147488 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:14.145680 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-38.ec2.internal" event={"ID":"5e5501b20aff6c46dc26a040c562bb73","Type":"ContainerStarted","Data":"0dec8f08457729e63472cd9b16696226934c647e2ac99cf473b86397048c66a8"} Apr 22 17:34:14.159677 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:14.158828 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-38.ec2.internal" podStartSLOduration=2.158812059 podStartE2EDuration="2.158812059s" podCreationTimestamp="2026-04-22 17:34:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-22 17:34:14.158568238 +0000 UTC m=+3.603131427" watchObservedRunningTime="2026-04-22 17:34:14.158812059 +0000 UTC m=+3.603375246" Apr 22 17:34:14.596391 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:14.596341 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4dbaf65e-c017-4ec0-bcc0-808342d2272b-metrics-certs\") pod \"network-metrics-daemon-n4clb\" (UID: \"4dbaf65e-c017-4ec0-bcc0-808342d2272b\") " pod="openshift-multus/network-metrics-daemon-n4clb" Apr 22 17:34:14.596559 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:14.596488 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Apr 22 17:34:14.596559 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:14.596553 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4dbaf65e-c017-4ec0-bcc0-808342d2272b-metrics-certs podName:4dbaf65e-c017-4ec0-bcc0-808342d2272b nodeName:}" failed. No retries permitted until 2026-04-22 17:34:16.596533093 +0000 UTC m=+6.041096264 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4dbaf65e-c017-4ec0-bcc0-808342d2272b-metrics-certs") pod "network-metrics-daemon-n4clb" (UID: "4dbaf65e-c017-4ec0-bcc0-808342d2272b") : object "openshift-multus"/"metrics-daemon-secret" not registered Apr 22 17:34:14.697556 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:14.696858 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7p6x7\" (UniqueName: \"kubernetes.io/projected/473029a2-4794-4adf-8637-e61f8afbe3a4-kube-api-access-7p6x7\") pod \"network-check-target-p76lb\" (UID: \"473029a2-4794-4adf-8637-e61f8afbe3a4\") " pod="openshift-network-diagnostics/network-check-target-p76lb" Apr 22 17:34:14.697556 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:14.697010 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Apr 22 17:34:14.697556 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:14.697030 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Apr 22 17:34:14.697556 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:14.697044 2576 projected.go:194] Error preparing data for projected volume kube-api-access-7p6x7 for pod openshift-network-diagnostics/network-check-target-p76lb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 22 17:34:14.697556 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:14.697105 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/473029a2-4794-4adf-8637-e61f8afbe3a4-kube-api-access-7p6x7 podName:473029a2-4794-4adf-8637-e61f8afbe3a4 nodeName:}" failed. No retries permitted until 2026-04-22 17:34:16.697085621 +0000 UTC m=+6.141648788 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7p6x7" (UniqueName: "kubernetes.io/projected/473029a2-4794-4adf-8637-e61f8afbe3a4-kube-api-access-7p6x7") pod "network-check-target-p76lb" (UID: "473029a2-4794-4adf-8637-e61f8afbe3a4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 22 17:34:15.069037 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:15.068440 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n4clb" Apr 22 17:34:15.069037 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:15.068599 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n4clb" podUID="4dbaf65e-c017-4ec0-bcc0-808342d2272b" Apr 22 17:34:15.170216 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:15.169668 2576 generic.go:358] "Generic (PLEG): container finished" podID="c001ae6ef4a4422d60602a8dc909d4db" containerID="69749e753b3e4d681c21ffc2bd70c4f4db30288ad7c315a0d6afecf4339897f4" exitCode=0 Apr 22 17:34:15.170216 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:15.170151 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-38.ec2.internal" event={"ID":"c001ae6ef4a4422d60602a8dc909d4db","Type":"ContainerDied","Data":"69749e753b3e4d681c21ffc2bd70c4f4db30288ad7c315a0d6afecf4339897f4"} Apr 22 17:34:16.067834 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:16.067793 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p76lb" Apr 22 17:34:16.068027 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:16.067927 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p76lb" podUID="473029a2-4794-4adf-8637-e61f8afbe3a4" Apr 22 17:34:16.175914 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:16.175873 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-38.ec2.internal" event={"ID":"c001ae6ef4a4422d60602a8dc909d4db","Type":"ContainerStarted","Data":"ed8ce026b81176131b07f4ee16fdef5b8d82e6e465d7ada74d064ca3b2993599"} Apr 22 17:34:16.612480 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:16.612444 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4dbaf65e-c017-4ec0-bcc0-808342d2272b-metrics-certs\") pod \"network-metrics-daemon-n4clb\" (UID: \"4dbaf65e-c017-4ec0-bcc0-808342d2272b\") " pod="openshift-multus/network-metrics-daemon-n4clb" Apr 22 17:34:16.612645 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:16.612630 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Apr 22 17:34:16.612717 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:16.612688 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4dbaf65e-c017-4ec0-bcc0-808342d2272b-metrics-certs podName:4dbaf65e-c017-4ec0-bcc0-808342d2272b nodeName:}" failed. No retries permitted until 2026-04-22 17:34:20.612668746 +0000 UTC m=+10.057231908 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4dbaf65e-c017-4ec0-bcc0-808342d2272b-metrics-certs") pod "network-metrics-daemon-n4clb" (UID: "4dbaf65e-c017-4ec0-bcc0-808342d2272b") : object "openshift-multus"/"metrics-daemon-secret" not registered Apr 22 17:34:16.713650 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:16.713607 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7p6x7\" (UniqueName: \"kubernetes.io/projected/473029a2-4794-4adf-8637-e61f8afbe3a4-kube-api-access-7p6x7\") pod \"network-check-target-p76lb\" (UID: \"473029a2-4794-4adf-8637-e61f8afbe3a4\") " pod="openshift-network-diagnostics/network-check-target-p76lb" Apr 22 17:34:16.713811 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:16.713774 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Apr 22 17:34:16.713811 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:16.713795 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Apr 22 17:34:16.713811 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:16.713809 2576 projected.go:194] Error preparing data for projected volume kube-api-access-7p6x7 for pod openshift-network-diagnostics/network-check-target-p76lb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 22 17:34:16.713912 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:16.713857 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/473029a2-4794-4adf-8637-e61f8afbe3a4-kube-api-access-7p6x7 podName:473029a2-4794-4adf-8637-e61f8afbe3a4 nodeName:}" failed. No retries permitted until 2026-04-22 17:34:20.713844386 +0000 UTC m=+10.158407548 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7p6x7" (UniqueName: "kubernetes.io/projected/473029a2-4794-4adf-8637-e61f8afbe3a4-kube-api-access-7p6x7") pod "network-check-target-p76lb" (UID: "473029a2-4794-4adf-8637-e61f8afbe3a4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 22 17:34:17.068432 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:17.068397 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n4clb" Apr 22 17:34:17.068616 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:17.068540 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n4clb" podUID="4dbaf65e-c017-4ec0-bcc0-808342d2272b" Apr 22 17:34:18.068695 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:18.068664 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p76lb" Apr 22 17:34:18.069154 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:18.068803 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p76lb" podUID="473029a2-4794-4adf-8637-e61f8afbe3a4" Apr 22 17:34:19.071081 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:19.071051 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n4clb" Apr 22 17:34:19.071536 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:19.071205 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n4clb" podUID="4dbaf65e-c017-4ec0-bcc0-808342d2272b" Apr 22 17:34:20.068131 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:20.068092 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p76lb" Apr 22 17:34:20.068351 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:20.068247 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p76lb" podUID="473029a2-4794-4adf-8637-e61f8afbe3a4" Apr 22 17:34:20.645632 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:20.645593 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4dbaf65e-c017-4ec0-bcc0-808342d2272b-metrics-certs\") pod \"network-metrics-daemon-n4clb\" (UID: \"4dbaf65e-c017-4ec0-bcc0-808342d2272b\") " pod="openshift-multus/network-metrics-daemon-n4clb" Apr 22 17:34:20.646105 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:20.645755 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Apr 22 17:34:20.646105 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:20.645829 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4dbaf65e-c017-4ec0-bcc0-808342d2272b-metrics-certs podName:4dbaf65e-c017-4ec0-bcc0-808342d2272b nodeName:}" failed. No retries permitted until 2026-04-22 17:34:28.645807011 +0000 UTC m=+18.090370187 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4dbaf65e-c017-4ec0-bcc0-808342d2272b-metrics-certs") pod "network-metrics-daemon-n4clb" (UID: "4dbaf65e-c017-4ec0-bcc0-808342d2272b") : object "openshift-multus"/"metrics-daemon-secret" not registered Apr 22 17:34:20.746998 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:20.746958 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7p6x7\" (UniqueName: \"kubernetes.io/projected/473029a2-4794-4adf-8637-e61f8afbe3a4-kube-api-access-7p6x7\") pod \"network-check-target-p76lb\" (UID: \"473029a2-4794-4adf-8637-e61f8afbe3a4\") " pod="openshift-network-diagnostics/network-check-target-p76lb" Apr 22 17:34:20.747210 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:20.747116 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Apr 22 17:34:20.747210 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:20.747137 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Apr 22 17:34:20.747210 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:20.747150 2576 projected.go:194] Error preparing data for projected volume kube-api-access-7p6x7 for pod openshift-network-diagnostics/network-check-target-p76lb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 22 17:34:20.747372 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:20.747236 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/473029a2-4794-4adf-8637-e61f8afbe3a4-kube-api-access-7p6x7 podName:473029a2-4794-4adf-8637-e61f8afbe3a4 nodeName:}" failed. No retries permitted until 2026-04-22 17:34:28.747216245 +0000 UTC m=+18.191779407 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7p6x7" (UniqueName: "kubernetes.io/projected/473029a2-4794-4adf-8637-e61f8afbe3a4-kube-api-access-7p6x7") pod "network-check-target-p76lb" (UID: "473029a2-4794-4adf-8637-e61f8afbe3a4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 22 17:34:21.068388 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:21.068356 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n4clb" Apr 22 17:34:21.068553 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:21.068476 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n4clb" podUID="4dbaf65e-c017-4ec0-bcc0-808342d2272b" Apr 22 17:34:22.067885 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:22.067851 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p76lb" Apr 22 17:34:22.068357 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:22.067977 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p76lb" podUID="473029a2-4794-4adf-8637-e61f8afbe3a4" Apr 22 17:34:23.067702 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:23.067670 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n4clb" Apr 22 17:34:23.067878 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:23.067817 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n4clb" podUID="4dbaf65e-c017-4ec0-bcc0-808342d2272b" Apr 22 17:34:24.068586 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:24.068549 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p76lb" Apr 22 17:34:24.069093 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:24.068676 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p76lb" podUID="473029a2-4794-4adf-8637-e61f8afbe3a4" Apr 22 17:34:25.068465 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:25.068432 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n4clb" Apr 22 17:34:25.068669 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:25.068570 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n4clb" podUID="4dbaf65e-c017-4ec0-bcc0-808342d2272b" Apr 22 17:34:26.068582 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:26.068543 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p76lb" Apr 22 17:34:26.068782 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:26.068657 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p76lb" podUID="473029a2-4794-4adf-8637-e61f8afbe3a4" Apr 22 17:34:27.068084 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:27.068048 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n4clb" Apr 22 17:34:27.068295 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:27.068188 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n4clb" podUID="4dbaf65e-c017-4ec0-bcc0-808342d2272b" Apr 22 17:34:28.068635 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:28.068601 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p76lb" Apr 22 17:34:28.069049 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:28.068713 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p76lb" podUID="473029a2-4794-4adf-8637-e61f8afbe3a4" Apr 22 17:34:28.709858 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:28.709813 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4dbaf65e-c017-4ec0-bcc0-808342d2272b-metrics-certs\") pod \"network-metrics-daemon-n4clb\" (UID: \"4dbaf65e-c017-4ec0-bcc0-808342d2272b\") " pod="openshift-multus/network-metrics-daemon-n4clb" Apr 22 17:34:28.710344 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:28.710318 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Apr 22 17:34:28.710443 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:28.710399 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4dbaf65e-c017-4ec0-bcc0-808342d2272b-metrics-certs podName:4dbaf65e-c017-4ec0-bcc0-808342d2272b nodeName:}" failed. No retries permitted until 2026-04-22 17:34:44.710381742 +0000 UTC m=+34.154944908 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4dbaf65e-c017-4ec0-bcc0-808342d2272b-metrics-certs") pod "network-metrics-daemon-n4clb" (UID: "4dbaf65e-c017-4ec0-bcc0-808342d2272b") : object "openshift-multus"/"metrics-daemon-secret" not registered Apr 22 17:34:28.811008 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:28.810974 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7p6x7\" (UniqueName: \"kubernetes.io/projected/473029a2-4794-4adf-8637-e61f8afbe3a4-kube-api-access-7p6x7\") pod \"network-check-target-p76lb\" (UID: \"473029a2-4794-4adf-8637-e61f8afbe3a4\") " pod="openshift-network-diagnostics/network-check-target-p76lb" Apr 22 17:34:28.811194 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:28.811144 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Apr 22 17:34:28.811194 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:28.811189 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Apr 22 17:34:28.811296 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:28.811206 2576 projected.go:194] Error preparing data for projected volume kube-api-access-7p6x7 for pod openshift-network-diagnostics/network-check-target-p76lb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 22 17:34:28.811296 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:28.811273 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/473029a2-4794-4adf-8637-e61f8afbe3a4-kube-api-access-7p6x7 podName:473029a2-4794-4adf-8637-e61f8afbe3a4 nodeName:}" failed. No retries permitted until 2026-04-22 17:34:44.811255225 +0000 UTC m=+34.255818390 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7p6x7" (UniqueName: "kubernetes.io/projected/473029a2-4794-4adf-8637-e61f8afbe3a4-kube-api-access-7p6x7") pod "network-check-target-p76lb" (UID: "473029a2-4794-4adf-8637-e61f8afbe3a4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 22 17:34:29.068096 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:29.068066 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n4clb" Apr 22 17:34:29.068289 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:29.068229 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n4clb" podUID="4dbaf65e-c017-4ec0-bcc0-808342d2272b" Apr 22 17:34:30.068435 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:30.068400 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p76lb" Apr 22 17:34:30.068859 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:30.068514 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p76lb" podUID="473029a2-4794-4adf-8637-e61f8afbe3a4" Apr 22 17:34:31.069205 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:31.068937 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n4clb" Apr 22 17:34:31.069682 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:31.069294 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n4clb" podUID="4dbaf65e-c017-4ec0-bcc0-808342d2272b" Apr 22 17:34:31.201619 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:31.201589 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dkxmf" event={"ID":"d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332","Type":"ContainerStarted","Data":"57cdcd1ce55aee8f84e086e3bb7f406afe36d64578c86f66403f9cf00d53e19f"} Apr 22 17:34:31.202646 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:31.202624 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4cjq" event={"ID":"dace974d-6ce0-4a6d-9f8d-bde919b848c7","Type":"ContainerStarted","Data":"3eb0d58c2197d932f98d15bee0f0e90be102e4280cd6021ea5264089a41b94ec"} Apr 22 17:34:31.203693 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:31.203671 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wbltv" event={"ID":"1359a64d-2417-42d6-918d-bba7d2d9b6e7","Type":"ContainerStarted","Data":"b87ecb36ea876c0bdc956eae3aa12d48a0e8aad01a71e1d89cb7986ad3692804"} Apr 22 17:34:31.204780 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:31.204745 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tm9m2" event={"ID":"561f8fb8-766d-438c-80dc-eacb32a87265","Type":"ContainerStarted","Data":"d4f591702b8e642c3649c8050638f73b0ccb2e2622e85e7773872ec761861de6"} Apr 22 17:34:31.205926 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:31.205859 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dxbhp" event={"ID":"d94afc06-594c-4cc6-a15f-473ec2fb5297","Type":"ContainerStarted","Data":"a51d3f49639c62f3f1889e057e758c4d080f7cdf472204db1c95b723cf9a046c"} Apr 22 17:34:31.207048 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:31.207024 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6d99f" event={"ID":"87846e27-279a-49b8-865a-3979451f84ba","Type":"ContainerStarted","Data":"c9ee354d2191731026ffdc850c734f8aa2b769da9c30e297766c2452d1c264f8"} Apr 22 17:34:31.208186 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:31.208152 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" event={"ID":"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3","Type":"ContainerStarted","Data":"bb090436a6045b6efb313922248d2abaf03fe50b5f4524ea534321f1a1b8a63a"} Apr 22 17:34:31.209302 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:31.209255 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hfp87" event={"ID":"6b871faa-db8a-4a95-8c94-6fed862a9dc7","Type":"ContainerStarted","Data":"e2119f3da81c05cb7609ba661ba32c725049aa10850965605d7c7e2d47bdcd26"} Apr 22 17:34:31.228743 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:31.228689 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-38.ec2.internal" podStartSLOduration=19.22867243 podStartE2EDuration="19.22867243s" podCreationTimestamp="2026-04-22 17:34:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-22 17:34:16.190851355 +0000 UTC m=+5.635414541" watchObservedRunningTime="2026-04-22 17:34:31.22867243 +0000 UTC m=+20.673235615" Apr 22 17:34:31.243566 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:31.243520 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-tm9m2" podStartSLOduration=7.658876191 podStartE2EDuration="20.243504079s" podCreationTimestamp="2026-04-22 17:34:11 +0000 UTC" firstStartedPulling="2026-04-22 17:34:13.682704017 +0000 UTC m=+3.127267185" lastFinishedPulling="2026-04-22 17:34:26.267331895 +0000 UTC m=+15.711895073" observedRunningTime="2026-04-22 17:34:31.243276869 +0000 UTC m=+20.687840064" watchObservedRunningTime="2026-04-22 17:34:31.243504079 +0000 UTC m=+20.688067271" Apr 22 17:34:31.256739 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:31.256696 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-hfp87" podStartSLOduration=3.173492031 podStartE2EDuration="20.25668151s" podCreationTimestamp="2026-04-22 17:34:11 +0000 UTC" firstStartedPulling="2026-04-22 17:34:13.671001637 +0000 UTC m=+3.115564800" lastFinishedPulling="2026-04-22 17:34:30.75419111 +0000 UTC m=+20.198754279" observedRunningTime="2026-04-22 17:34:31.256282512 +0000 UTC m=+20.700845697" watchObservedRunningTime="2026-04-22 17:34:31.25668151 +0000 UTC m=+20.701244695" Apr 22 17:34:31.272335 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:31.272292 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-dkxmf" podStartSLOduration=3.200177982 podStartE2EDuration="20.272277474s" podCreationTimestamp="2026-04-22 17:34:11 +0000 UTC" firstStartedPulling="2026-04-22 17:34:13.683459604 +0000 UTC m=+3.128022767" lastFinishedPulling="2026-04-22 17:34:30.755559081 +0000 UTC m=+20.200122259" observedRunningTime="2026-04-22 17:34:31.272028389 +0000 UTC m=+20.716591575" watchObservedRunningTime="2026-04-22 17:34:31.272277474 +0000 UTC m=+20.716840657" Apr 22 17:34:31.289208 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:31.289133 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-6d99f" podStartSLOduration=3.1952971789999998 podStartE2EDuration="20.28911861s" podCreationTimestamp="2026-04-22 17:34:11 +0000 UTC" firstStartedPulling="2026-04-22 17:34:13.67699344 +0000 UTC m=+3.121556605" lastFinishedPulling="2026-04-22 17:34:30.770814867 +0000 UTC m=+20.215378036" observedRunningTime="2026-04-22 17:34:31.288638551 +0000 UTC m=+20.733201735" watchObservedRunningTime="2026-04-22 17:34:31.28911861 +0000 UTC m=+20.733681794" Apr 22 17:34:31.497678 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:31.497633 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-tm9m2" Apr 22 17:34:31.499133 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:31.498978 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-tm9m2" Apr 22 17:34:32.067870 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:32.067831 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p76lb" Apr 22 17:34:32.068057 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:32.067948 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p76lb" podUID="473029a2-4794-4adf-8637-e61f8afbe3a4" Apr 22 17:34:32.190636 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:32.190603 2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Apr 22 17:34:32.213300 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:32.213271 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5q2p_0d47dea1-b4c9-4c30-9592-ba829fe9f7d3/ovn-acl-logging/0.log" Apr 22 17:34:32.213569 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:32.213548 2576 generic.go:358] "Generic (PLEG): container finished" podID="0d47dea1-b4c9-4c30-9592-ba829fe9f7d3" containerID="42a18eb08f11bf0a499c8d73e5eaf46135e1b88486c45d5e3f3f2854d791fba0" exitCode=1 Apr 22 17:34:32.213639 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:32.213620 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" event={"ID":"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3","Type":"ContainerStarted","Data":"4045821941b9d315cfcd0cfb0c4bb4d827222f8a22bc3a223633520b7c611a5c"} Apr 22 17:34:32.213674 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:32.213652 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" event={"ID":"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3","Type":"ContainerStarted","Data":"1c6c6afefe931ae89f925337710d04787964175655acfb27ac36153b90c948b5"} Apr 22 17:34:32.213674 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:32.213662 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" event={"ID":"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3","Type":"ContainerStarted","Data":"3a76851928650f6d6ee12f650ad97fc841d5a6b4d5f6b03e8b17b4d6174a68f1"} Apr 22 17:34:32.213674 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:32.213670 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" event={"ID":"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3","Type":"ContainerStarted","Data":"214ce43d64f85d1df21c3000eacb66d42bd79731f8bf7469897a7fd46a448123"} Apr 22 17:34:32.213781 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:32.213680 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" event={"ID":"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3","Type":"ContainerDied","Data":"42a18eb08f11bf0a499c8d73e5eaf46135e1b88486c45d5e3f3f2854d791fba0"} Apr 22 17:34:32.215023 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:32.215001 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4cjq" event={"ID":"dace974d-6ce0-4a6d-9f8d-bde919b848c7","Type":"ContainerStarted","Data":"c35f01ee409d5cd335670d3db8ad783ce16c5d8fb65c084b19504dca21e48150"} Apr 22 17:34:32.216237 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:32.216216 2576 generic.go:358] "Generic (PLEG): container finished" podID="1359a64d-2417-42d6-918d-bba7d2d9b6e7" containerID="b87ecb36ea876c0bdc956eae3aa12d48a0e8aad01a71e1d89cb7986ad3692804" exitCode=0 Apr 22 17:34:32.216391 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:32.216349 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wbltv" event={"ID":"1359a64d-2417-42d6-918d-bba7d2d9b6e7","Type":"ContainerDied","Data":"b87ecb36ea876c0bdc956eae3aa12d48a0e8aad01a71e1d89cb7986ad3692804"} Apr 22 17:34:32.216567 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:32.216552 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-tm9m2" Apr 22 17:34:32.217149 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:32.217134 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-tm9m2" Apr 22 17:34:32.274114 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:32.274064 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-dxbhp" podStartSLOduration=4.195629649 podStartE2EDuration="21.274048217s" podCreationTimestamp="2026-04-22 17:34:11 +0000 UTC" firstStartedPulling="2026-04-22 17:34:13.675775439 +0000 UTC m=+3.120338604" lastFinishedPulling="2026-04-22 17:34:30.754194004 +0000 UTC m=+20.198757172" observedRunningTime="2026-04-22 17:34:32.273697905 +0000 UTC m=+21.718261089" watchObservedRunningTime="2026-04-22 17:34:32.274048217 +0000 UTC m=+21.718611400" Apr 22 17:34:33.043045 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:33.042925 2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-04-22T17:34:32.190628978Z","UUID":"74338e7d-7368-47a2-b2a2-5006fc8b1792","Handler":null,"Name":"","Endpoint":""} Apr 22 17:34:33.044814 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:33.044791 2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Apr 22 17:34:33.044814 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:33.044822 2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Apr 22 17:34:33.068681 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:33.068654 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n4clb" Apr 22 17:34:33.068835 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:33.068772 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n4clb" podUID="4dbaf65e-c017-4ec0-bcc0-808342d2272b" Apr 22 17:34:33.220145 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:33.219614 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mx4d8" event={"ID":"2af98b77-7b18-41bf-b19c-6788c06627ec","Type":"ContainerStarted","Data":"0b5810d316502d8ce84a48a660d84c4b5f455111390e27418e96b583a38a4e05"} Apr 22 17:34:33.249001 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:33.248941 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-mx4d8" podStartSLOduration=5.168982879 podStartE2EDuration="22.248918368s" podCreationTimestamp="2026-04-22 17:34:11 +0000 UTC" firstStartedPulling="2026-04-22 17:34:13.680412512 +0000 UTC m=+3.124975688" lastFinishedPulling="2026-04-22 17:34:30.760348012 +0000 UTC m=+20.204911177" observedRunningTime="2026-04-22 17:34:33.248316978 +0000 UTC m=+22.692880163" watchObservedRunningTime="2026-04-22 17:34:33.248918368 +0000 UTC m=+22.693481553" Apr 22 17:34:34.068624 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:34.068594 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p76lb" Apr 22 17:34:34.068773 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:34.068717 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p76lb" podUID="473029a2-4794-4adf-8637-e61f8afbe3a4" Apr 22 17:34:34.225132 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:34.225097 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5q2p_0d47dea1-b4c9-4c30-9592-ba829fe9f7d3/ovn-acl-logging/0.log" Apr 22 17:34:34.225611 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:34.225518 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" event={"ID":"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3","Type":"ContainerStarted","Data":"e9e903c5c4aefbedc296bd6d6d445c71dc7912c08b505956d28a70ff6cd6bd63"} Apr 22 17:34:34.227778 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:34.227691 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4cjq" event={"ID":"dace974d-6ce0-4a6d-9f8d-bde919b848c7","Type":"ContainerStarted","Data":"b546e9a3ef481372c2190c18ac87fdf9d5f863e07d4d47cd20c1dd85999ddfae"} Apr 22 17:34:35.068237 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:35.068201 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n4clb" Apr 22 17:34:35.068414 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:35.068344 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n4clb" podUID="4dbaf65e-c017-4ec0-bcc0-808342d2272b" Apr 22 17:34:36.068190 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:36.068146 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p76lb" Apr 22 17:34:36.068905 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:36.068275 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p76lb" podUID="473029a2-4794-4adf-8637-e61f8afbe3a4" Apr 22 17:34:36.234914 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:36.234889 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5q2p_0d47dea1-b4c9-4c30-9592-ba829fe9f7d3/ovn-acl-logging/0.log" Apr 22 17:34:37.068664 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:37.068637 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n4clb" Apr 22 17:34:37.069129 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:37.068739 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n4clb" podUID="4dbaf65e-c017-4ec0-bcc0-808342d2272b" Apr 22 17:34:37.242307 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:37.242276 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5q2p_0d47dea1-b4c9-4c30-9592-ba829fe9f7d3/ovn-acl-logging/0.log" Apr 22 17:34:37.242668 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:37.242636 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" event={"ID":"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3","Type":"ContainerStarted","Data":"0edbb5cfa83ec0215ed2328bfdb8b098a190f0389d60456e7fda464ed7b7eaad"} Apr 22 17:34:37.242967 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:37.242932 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" Apr 22 17:34:37.243119 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:37.243103 2576 scope.go:117] "RemoveContainer" containerID="42a18eb08f11bf0a499c8d73e5eaf46135e1b88486c45d5e3f3f2854d791fba0" Apr 22 17:34:37.244371 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:37.244346 2576 generic.go:358] "Generic (PLEG): container finished" podID="1359a64d-2417-42d6-918d-bba7d2d9b6e7" containerID="e672c9f01716c5551d4693c5c970cd8bed116d3bde2c9767d00dbcb803406a9c" exitCode=0 Apr 22 17:34:37.244430 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:37.244389 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wbltv" event={"ID":"1359a64d-2417-42d6-918d-bba7d2d9b6e7","Type":"ContainerDied","Data":"e672c9f01716c5551d4693c5c970cd8bed116d3bde2c9767d00dbcb803406a9c"} Apr 22 17:34:37.260076 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:37.260045 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" Apr 22 17:34:37.267117 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:37.267074 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4cjq" podStartSLOduration=6.7886880640000005 podStartE2EDuration="26.267059792s" podCreationTimestamp="2026-04-22 17:34:11 +0000 UTC" firstStartedPulling="2026-04-22 17:34:13.6823376 +0000 UTC m=+3.126900763" lastFinishedPulling="2026-04-22 17:34:33.160709325 +0000 UTC m=+22.605272491" observedRunningTime="2026-04-22 17:34:34.244783063 +0000 UTC m=+23.689346247" watchObservedRunningTime="2026-04-22 17:34:37.267059792 +0000 UTC m=+26.711622976" Apr 22 17:34:38.068392 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:38.068302 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p76lb" Apr 22 17:34:38.068537 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:38.068408 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p76lb" podUID="473029a2-4794-4adf-8637-e61f8afbe3a4" Apr 22 17:34:38.249025 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:38.248997 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5q2p_0d47dea1-b4c9-4c30-9592-ba829fe9f7d3/ovn-acl-logging/0.log" Apr 22 17:34:38.249449 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:38.249340 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" event={"ID":"0d47dea1-b4c9-4c30-9592-ba829fe9f7d3","Type":"ContainerStarted","Data":"4203ac9339074a8c28735d09ac20efbe25f042d3a1ab02c89bf77bdfc812fa0b"} Apr 22 17:34:38.249681 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:38.249651 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" Apr 22 17:34:38.249812 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:38.249698 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" Apr 22 17:34:38.251386 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:38.251363 2576 generic.go:358] "Generic (PLEG): container finished" podID="1359a64d-2417-42d6-918d-bba7d2d9b6e7" containerID="1d99cfdaf36f8f9149d4a438fe7b719f07428777fb092c6b196b74b3caac9313" exitCode=0 Apr 22 17:34:38.251496 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:38.251406 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wbltv" event={"ID":"1359a64d-2417-42d6-918d-bba7d2d9b6e7","Type":"ContainerDied","Data":"1d99cfdaf36f8f9149d4a438fe7b719f07428777fb092c6b196b74b3caac9313"} Apr 22 17:34:38.265382 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:38.265348 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" Apr 22 17:34:38.278105 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:38.277251 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" podStartSLOduration=9.897876488 podStartE2EDuration="27.277232915s" podCreationTimestamp="2026-04-22 17:34:11 +0000 UTC" firstStartedPulling="2026-04-22 17:34:13.673472004 +0000 UTC m=+3.118035171" lastFinishedPulling="2026-04-22 17:34:31.052828437 +0000 UTC m=+20.497391598" observedRunningTime="2026-04-22 17:34:38.2759407 +0000 UTC m=+27.720503880" watchObservedRunningTime="2026-04-22 17:34:38.277232915 +0000 UTC m=+27.721796105" Apr 22 17:34:39.068299 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:39.068265 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n4clb" Apr 22 17:34:39.068442 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:39.068374 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n4clb" podUID="4dbaf65e-c017-4ec0-bcc0-808342d2272b" Apr 22 17:34:39.255534 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:39.255502 2576 generic.go:358] "Generic (PLEG): container finished" podID="1359a64d-2417-42d6-918d-bba7d2d9b6e7" containerID="c7b59c7bf0d55458e7a44bf4ced442b2bdbebd104a0267ddabb70beb10cd2e69" exitCode=0 Apr 22 17:34:39.255916 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:39.255567 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wbltv" event={"ID":"1359a64d-2417-42d6-918d-bba7d2d9b6e7","Type":"ContainerDied","Data":"c7b59c7bf0d55458e7a44bf4ced442b2bdbebd104a0267ddabb70beb10cd2e69"} Apr 22 17:34:40.067746 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:40.067633 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p76lb" Apr 22 17:34:40.067930 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:40.067833 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p76lb" podUID="473029a2-4794-4adf-8637-e61f8afbe3a4" Apr 22 17:34:41.069666 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:41.069442 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n4clb" Apr 22 17:34:41.070441 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:41.070408 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n4clb" podUID="4dbaf65e-c017-4ec0-bcc0-808342d2272b" Apr 22 17:34:41.171716 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:41.171502 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-n4clb"] Apr 22 17:34:41.173567 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:41.172941 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-p76lb"] Apr 22 17:34:41.173567 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:41.173090 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p76lb" Apr 22 17:34:41.173567 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:41.173210 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p76lb" podUID="473029a2-4794-4adf-8637-e61f8afbe3a4" Apr 22 17:34:41.260225 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:41.260193 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n4clb" Apr 22 17:34:41.260416 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:41.260345 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n4clb" podUID="4dbaf65e-c017-4ec0-bcc0-808342d2272b" Apr 22 17:34:43.068658 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:43.068619 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p76lb" Apr 22 17:34:43.069511 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:43.068634 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n4clb" Apr 22 17:34:43.069511 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:43.068766 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p76lb" podUID="473029a2-4794-4adf-8637-e61f8afbe3a4" Apr 22 17:34:43.069511 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:43.068828 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n4clb" podUID="4dbaf65e-c017-4ec0-bcc0-808342d2272b" Apr 22 17:34:43.798888 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:43.798791 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-m74jz"] Apr 22 17:34:43.801314 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:43.801285 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m74jz" Apr 22 17:34:43.801466 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:43.801363 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m74jz" podUID="7c8e58bc-a87f-4688-8b70-16d3d2a086cc" Apr 22 17:34:43.813466 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:43.813429 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-m74jz"] Apr 22 17:34:43.922278 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:43.922244 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7c8e58bc-a87f-4688-8b70-16d3d2a086cc-dbus\") pod \"global-pull-secret-syncer-m74jz\" (UID: \"7c8e58bc-a87f-4688-8b70-16d3d2a086cc\") " pod="kube-system/global-pull-secret-syncer-m74jz" Apr 22 17:34:43.922278 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:43.922285 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7c8e58bc-a87f-4688-8b70-16d3d2a086cc-kubelet-config\") pod \"global-pull-secret-syncer-m74jz\" (UID: \"7c8e58bc-a87f-4688-8b70-16d3d2a086cc\") " pod="kube-system/global-pull-secret-syncer-m74jz" Apr 22 17:34:43.922507 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:43.922302 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7c8e58bc-a87f-4688-8b70-16d3d2a086cc-original-pull-secret\") pod \"global-pull-secret-syncer-m74jz\" (UID: \"7c8e58bc-a87f-4688-8b70-16d3d2a086cc\") " pod="kube-system/global-pull-secret-syncer-m74jz" Apr 22 17:34:44.023527 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:44.023487 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7c8e58bc-a87f-4688-8b70-16d3d2a086cc-dbus\") pod \"global-pull-secret-syncer-m74jz\" (UID: \"7c8e58bc-a87f-4688-8b70-16d3d2a086cc\") " pod="kube-system/global-pull-secret-syncer-m74jz" Apr 22 17:34:44.023527 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:44.023532 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7c8e58bc-a87f-4688-8b70-16d3d2a086cc-kubelet-config\") pod \"global-pull-secret-syncer-m74jz\" (UID: \"7c8e58bc-a87f-4688-8b70-16d3d2a086cc\") " pod="kube-system/global-pull-secret-syncer-m74jz" Apr 22 17:34:44.023761 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:44.023552 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7c8e58bc-a87f-4688-8b70-16d3d2a086cc-original-pull-secret\") pod \"global-pull-secret-syncer-m74jz\" (UID: \"7c8e58bc-a87f-4688-8b70-16d3d2a086cc\") " pod="kube-system/global-pull-secret-syncer-m74jz" Apr 22 17:34:44.023761 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:44.023629 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7c8e58bc-a87f-4688-8b70-16d3d2a086cc-kubelet-config\") pod \"global-pull-secret-syncer-m74jz\" (UID: \"7c8e58bc-a87f-4688-8b70-16d3d2a086cc\") " pod="kube-system/global-pull-secret-syncer-m74jz" Apr 22 17:34:44.023761 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:44.023668 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Apr 22 17:34:44.023761 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:44.023726 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c8e58bc-a87f-4688-8b70-16d3d2a086cc-original-pull-secret podName:7c8e58bc-a87f-4688-8b70-16d3d2a086cc nodeName:}" failed. No retries permitted until 2026-04-22 17:34:44.523708823 +0000 UTC m=+33.968272009 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7c8e58bc-a87f-4688-8b70-16d3d2a086cc-original-pull-secret") pod "global-pull-secret-syncer-m74jz" (UID: "7c8e58bc-a87f-4688-8b70-16d3d2a086cc") : object "kube-system"/"original-pull-secret" not registered Apr 22 17:34:44.023972 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:44.023789 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7c8e58bc-a87f-4688-8b70-16d3d2a086cc-dbus\") pod \"global-pull-secret-syncer-m74jz\" (UID: \"7c8e58bc-a87f-4688-8b70-16d3d2a086cc\") " pod="kube-system/global-pull-secret-syncer-m74jz" Apr 22 17:34:44.266319 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:44.266286 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m74jz" Apr 22 17:34:44.266736 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:44.266431 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m74jz" podUID="7c8e58bc-a87f-4688-8b70-16d3d2a086cc" Apr 22 17:34:44.527658 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:44.527559 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7c8e58bc-a87f-4688-8b70-16d3d2a086cc-original-pull-secret\") pod \"global-pull-secret-syncer-m74jz\" (UID: \"7c8e58bc-a87f-4688-8b70-16d3d2a086cc\") " pod="kube-system/global-pull-secret-syncer-m74jz" Apr 22 17:34:44.527812 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:44.527675 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Apr 22 17:34:44.527812 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:44.527751 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c8e58bc-a87f-4688-8b70-16d3d2a086cc-original-pull-secret podName:7c8e58bc-a87f-4688-8b70-16d3d2a086cc nodeName:}" failed. No retries permitted until 2026-04-22 17:34:45.527733044 +0000 UTC m=+34.972296211 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7c8e58bc-a87f-4688-8b70-16d3d2a086cc-original-pull-secret") pod "global-pull-secret-syncer-m74jz" (UID: "7c8e58bc-a87f-4688-8b70-16d3d2a086cc") : object "kube-system"/"original-pull-secret" not registered Apr 22 17:34:44.729042 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:44.729001 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4dbaf65e-c017-4ec0-bcc0-808342d2272b-metrics-certs\") pod \"network-metrics-daemon-n4clb\" (UID: \"4dbaf65e-c017-4ec0-bcc0-808342d2272b\") " pod="openshift-multus/network-metrics-daemon-n4clb" Apr 22 17:34:44.729259 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:44.729136 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Apr 22 17:34:44.729259 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:44.729233 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4dbaf65e-c017-4ec0-bcc0-808342d2272b-metrics-certs podName:4dbaf65e-c017-4ec0-bcc0-808342d2272b nodeName:}" failed. No retries permitted until 2026-04-22 17:35:16.729210484 +0000 UTC m=+66.173773657 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4dbaf65e-c017-4ec0-bcc0-808342d2272b-metrics-certs") pod "network-metrics-daemon-n4clb" (UID: "4dbaf65e-c017-4ec0-bcc0-808342d2272b") : object "openshift-multus"/"metrics-daemon-secret" not registered Apr 22 17:34:44.830187 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:44.830092 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7p6x7\" (UniqueName: \"kubernetes.io/projected/473029a2-4794-4adf-8637-e61f8afbe3a4-kube-api-access-7p6x7\") pod \"network-check-target-p76lb\" (UID: \"473029a2-4794-4adf-8637-e61f8afbe3a4\") " pod="openshift-network-diagnostics/network-check-target-p76lb" Apr 22 17:34:44.830327 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:44.830249 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Apr 22 17:34:44.830327 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:44.830268 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Apr 22 17:34:44.830327 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:44.830280 2576 projected.go:194] Error preparing data for projected volume kube-api-access-7p6x7 for pod openshift-network-diagnostics/network-check-target-p76lb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 22 17:34:44.830418 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:44.830331 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/473029a2-4794-4adf-8637-e61f8afbe3a4-kube-api-access-7p6x7 podName:473029a2-4794-4adf-8637-e61f8afbe3a4 nodeName:}" failed. No retries permitted until 2026-04-22 17:35:16.83031868 +0000 UTC m=+66.274881842 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7p6x7" (UniqueName: "kubernetes.io/projected/473029a2-4794-4adf-8637-e61f8afbe3a4-kube-api-access-7p6x7") pod "network-check-target-p76lb" (UID: "473029a2-4794-4adf-8637-e61f8afbe3a4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 22 17:34:44.896266 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:44.896237 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-38.ec2.internal" event="NodeReady" Apr 22 17:34:44.896445 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:44.896363 2576 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Apr 22 17:34:44.942941 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:44.942898 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-645b85c468-dz7n7"] Apr 22 17:34:44.953904 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:44.953872 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-645b85c468-dz7n7" Apr 22 17:34:44.955748 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:44.955718 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-g2t44"] Apr 22 17:34:44.956689 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:44.956667 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Apr 22 17:34:44.956817 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:44.956707 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Apr 22 17:34:44.956990 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:44.956973 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mmlbf\"" Apr 22 17:34:44.957064 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:44.956973 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Apr 22 17:34:44.969033 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:44.968990 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-r2v8q"] Apr 22 17:34:44.969233 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:44.969162 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-g2t44" Apr 22 17:34:44.981452 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:44.981422 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-645b85c468-dz7n7"] Apr 22 17:34:44.981596 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:44.981513 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r2v8q" Apr 22 17:34:44.982639 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:44.982610 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Apr 22 17:34:44.987907 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:44.987868 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Apr 22 17:34:44.988107 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:44.987923 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Apr 22 17:34:44.988107 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:44.987990 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Apr 22 17:34:44.988107 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:44.988062 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-g2t44"] Apr 22 17:34:44.988334 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:44.988274 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mtj7t\"" Apr 22 17:34:44.988334 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:44.988296 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Apr 22 17:34:44.988455 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:44.988361 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Apr 22 17:34:44.988542 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:44.988526 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Apr 22 17:34:44.988714 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:44.988555 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Apr 22 17:34:44.989346 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:44.988944 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-r2v8q"] Apr 22 17:34:44.989449 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:44.989387 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-k4t5h\"" Apr 22 17:34:45.004457 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.004425 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-cdrtz"] Apr 22 17:34:45.016534 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.016498 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cdrtz" Apr 22 17:34:45.021974 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.021953 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Apr 22 17:34:45.022404 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.022375 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ghfnt\"" Apr 22 17:34:45.022665 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.022636 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Apr 22 17:34:45.031802 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.031766 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/98eed4e9-c7c8-450d-b229-266b7e3fd1ec-ca-trust-extracted\") pod \"image-registry-645b85c468-dz7n7\" (UID: \"98eed4e9-c7c8-450d-b229-266b7e3fd1ec\") " pod="openshift-image-registry/image-registry-645b85c468-dz7n7" Apr 22 17:34:45.031802 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.031806 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/98eed4e9-c7c8-450d-b229-266b7e3fd1ec-registry-tls\") pod \"image-registry-645b85c468-dz7n7\" (UID: \"98eed4e9-c7c8-450d-b229-266b7e3fd1ec\") " pod="openshift-image-registry/image-registry-645b85c468-dz7n7" Apr 22 17:34:45.031987 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.031828 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mctm\" (UniqueName: \"kubernetes.io/projected/98eed4e9-c7c8-450d-b229-266b7e3fd1ec-kube-api-access-7mctm\") pod \"image-registry-645b85c468-dz7n7\" (UID: \"98eed4e9-c7c8-450d-b229-266b7e3fd1ec\") " pod="openshift-image-registry/image-registry-645b85c468-dz7n7" Apr 22 17:34:45.031987 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.031847 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/98eed4e9-c7c8-450d-b229-266b7e3fd1ec-bound-sa-token\") pod \"image-registry-645b85c468-dz7n7\" (UID: \"98eed4e9-c7c8-450d-b229-266b7e3fd1ec\") " pod="openshift-image-registry/image-registry-645b85c468-dz7n7" Apr 22 17:34:45.031987 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.031901 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/98eed4e9-c7c8-450d-b229-266b7e3fd1ec-registry-certificates\") pod \"image-registry-645b85c468-dz7n7\" (UID: \"98eed4e9-c7c8-450d-b229-266b7e3fd1ec\") " pod="openshift-image-registry/image-registry-645b85c468-dz7n7" Apr 22 17:34:45.031987 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.031953 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/98eed4e9-c7c8-450d-b229-266b7e3fd1ec-trusted-ca\") pod \"image-registry-645b85c468-dz7n7\" (UID: \"98eed4e9-c7c8-450d-b229-266b7e3fd1ec\") " pod="openshift-image-registry/image-registry-645b85c468-dz7n7" Apr 22 17:34:45.032129 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.031997 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/98eed4e9-c7c8-450d-b229-266b7e3fd1ec-installation-pull-secrets\") pod \"image-registry-645b85c468-dz7n7\" (UID: \"98eed4e9-c7c8-450d-b229-266b7e3fd1ec\") " pod="openshift-image-registry/image-registry-645b85c468-dz7n7" Apr 22 17:34:45.032129 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.032047 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/98eed4e9-c7c8-450d-b229-266b7e3fd1ec-image-registry-private-configuration\") pod \"image-registry-645b85c468-dz7n7\" (UID: \"98eed4e9-c7c8-450d-b229-266b7e3fd1ec\") " pod="openshift-image-registry/image-registry-645b85c468-dz7n7" Apr 22 17:34:45.040220 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.040185 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cdrtz"] Apr 22 17:34:45.068211 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.068160 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p76lb" Apr 22 17:34:45.068396 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.068167 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n4clb" Apr 22 17:34:45.072907 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.072876 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2ldpn\"" Apr 22 17:34:45.073078 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.072875 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Apr 22 17:34:45.073282 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.073244 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Apr 22 17:34:45.073282 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.073277 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Apr 22 17:34:45.073457 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.073366 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jqt69\"" Apr 22 17:34:45.132985 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.132955 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/98eed4e9-c7c8-450d-b229-266b7e3fd1ec-registry-tls\") pod \"image-registry-645b85c468-dz7n7\" (UID: \"98eed4e9-c7c8-450d-b229-266b7e3fd1ec\") " pod="openshift-image-registry/image-registry-645b85c468-dz7n7" Apr 22 17:34:45.133122 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.132995 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7mctm\" (UniqueName: \"kubernetes.io/projected/98eed4e9-c7c8-450d-b229-266b7e3fd1ec-kube-api-access-7mctm\") pod \"image-registry-645b85c468-dz7n7\" (UID: \"98eed4e9-c7c8-450d-b229-266b7e3fd1ec\") " pod="openshift-image-registry/image-registry-645b85c468-dz7n7" Apr 22 17:34:45.133122 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.133017 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ad210ce8-144f-41e7-b848-d6b10c18ca89-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g2t44\" (UID: \"ad210ce8-144f-41e7-b848-d6b10c18ca89\") " pod="openshift-insights/insights-runtime-extractor-g2t44" Apr 22 17:34:45.133122 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.133046 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/98eed4e9-c7c8-450d-b229-266b7e3fd1ec-bound-sa-token\") pod \"image-registry-645b85c468-dz7n7\" (UID: \"98eed4e9-c7c8-450d-b229-266b7e3fd1ec\") " pod="openshift-image-registry/image-registry-645b85c468-dz7n7" Apr 22 17:34:45.133122 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.133072 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/74ac233e-feee-4e49-9b50-3ad174fdd490-metrics-tls\") pod \"dns-default-cdrtz\" (UID: \"74ac233e-feee-4e49-9b50-3ad174fdd490\") " pod="openshift-dns/dns-default-cdrtz" Apr 22 17:34:45.133346 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.133228 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/98eed4e9-c7c8-450d-b229-266b7e3fd1ec-registry-certificates\") pod \"image-registry-645b85c468-dz7n7\" (UID: \"98eed4e9-c7c8-450d-b229-266b7e3fd1ec\") " pod="openshift-image-registry/image-registry-645b85c468-dz7n7" Apr 22 17:34:45.133346 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.133303 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ad210ce8-144f-41e7-b848-d6b10c18ca89-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g2t44\" (UID: \"ad210ce8-144f-41e7-b848-d6b10c18ca89\") " pod="openshift-insights/insights-runtime-extractor-g2t44" Apr 22 17:34:45.133346 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.133336 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5d47r\" (UniqueName: \"kubernetes.io/projected/ad210ce8-144f-41e7-b848-d6b10c18ca89-kube-api-access-5d47r\") pod \"insights-runtime-extractor-g2t44\" (UID: \"ad210ce8-144f-41e7-b848-d6b10c18ca89\") " pod="openshift-insights/insights-runtime-extractor-g2t44" Apr 22 17:34:45.133498 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.133372 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/98eed4e9-c7c8-450d-b229-266b7e3fd1ec-trusted-ca\") pod \"image-registry-645b85c468-dz7n7\" (UID: \"98eed4e9-c7c8-450d-b229-266b7e3fd1ec\") " pod="openshift-image-registry/image-registry-645b85c468-dz7n7" Apr 22 17:34:45.133498 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.133402 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/98eed4e9-c7c8-450d-b229-266b7e3fd1ec-installation-pull-secrets\") pod \"image-registry-645b85c468-dz7n7\" (UID: \"98eed4e9-c7c8-450d-b229-266b7e3fd1ec\") " pod="openshift-image-registry/image-registry-645b85c468-dz7n7" Apr 22 17:34:45.133498 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.133450 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/74ac233e-feee-4e49-9b50-3ad174fdd490-config-volume\") pod \"dns-default-cdrtz\" (UID: \"74ac233e-feee-4e49-9b50-3ad174fdd490\") " pod="openshift-dns/dns-default-cdrtz" Apr 22 17:34:45.133640 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.133507 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/98eed4e9-c7c8-450d-b229-266b7e3fd1ec-image-registry-private-configuration\") pod \"image-registry-645b85c468-dz7n7\" (UID: \"98eed4e9-c7c8-450d-b229-266b7e3fd1ec\") " pod="openshift-image-registry/image-registry-645b85c468-dz7n7" Apr 22 17:34:45.133640 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.133536 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ad210ce8-144f-41e7-b848-d6b10c18ca89-crio-socket\") pod \"insights-runtime-extractor-g2t44\" (UID: \"ad210ce8-144f-41e7-b848-d6b10c18ca89\") " pod="openshift-insights/insights-runtime-extractor-g2t44" Apr 22 17:34:45.133640 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.133561 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlccm\" (UniqueName: \"kubernetes.io/projected/74ac233e-feee-4e49-9b50-3ad174fdd490-kube-api-access-vlccm\") pod \"dns-default-cdrtz\" (UID: \"74ac233e-feee-4e49-9b50-3ad174fdd490\") " pod="openshift-dns/dns-default-cdrtz" Apr 22 17:34:45.133640 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.133586 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4c655f36-4618-49aa-8f46-cbd457bbf957-cert\") pod \"ingress-canary-r2v8q\" (UID: \"4c655f36-4618-49aa-8f46-cbd457bbf957\") " pod="openshift-ingress-canary/ingress-canary-r2v8q" Apr 22 17:34:45.133824 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.133642 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74ac233e-feee-4e49-9b50-3ad174fdd490-tmp-dir\") pod \"dns-default-cdrtz\" (UID: \"74ac233e-feee-4e49-9b50-3ad174fdd490\") " pod="openshift-dns/dns-default-cdrtz" Apr 22 17:34:45.133824 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.133668 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qshsr\" (UniqueName: \"kubernetes.io/projected/4c655f36-4618-49aa-8f46-cbd457bbf957-kube-api-access-qshsr\") pod \"ingress-canary-r2v8q\" (UID: \"4c655f36-4618-49aa-8f46-cbd457bbf957\") " pod="openshift-ingress-canary/ingress-canary-r2v8q" Apr 22 17:34:45.133824 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.133698 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/98eed4e9-c7c8-450d-b229-266b7e3fd1ec-ca-trust-extracted\") pod \"image-registry-645b85c468-dz7n7\" (UID: \"98eed4e9-c7c8-450d-b229-266b7e3fd1ec\") " pod="openshift-image-registry/image-registry-645b85c468-dz7n7" Apr 22 17:34:45.133824 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.133725 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ad210ce8-144f-41e7-b848-d6b10c18ca89-data-volume\") pod \"insights-runtime-extractor-g2t44\" (UID: \"ad210ce8-144f-41e7-b848-d6b10c18ca89\") " pod="openshift-insights/insights-runtime-extractor-g2t44" Apr 22 17:34:45.134145 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.134121 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/98eed4e9-c7c8-450d-b229-266b7e3fd1ec-registry-certificates\") pod \"image-registry-645b85c468-dz7n7\" (UID: \"98eed4e9-c7c8-450d-b229-266b7e3fd1ec\") " pod="openshift-image-registry/image-registry-645b85c468-dz7n7" Apr 22 17:34:45.134348 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.134132 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/98eed4e9-c7c8-450d-b229-266b7e3fd1ec-ca-trust-extracted\") pod \"image-registry-645b85c468-dz7n7\" (UID: \"98eed4e9-c7c8-450d-b229-266b7e3fd1ec\") " pod="openshift-image-registry/image-registry-645b85c468-dz7n7" Apr 22 17:34:45.134437 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.134159 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/98eed4e9-c7c8-450d-b229-266b7e3fd1ec-trusted-ca\") pod \"image-registry-645b85c468-dz7n7\" (UID: \"98eed4e9-c7c8-450d-b229-266b7e3fd1ec\") " pod="openshift-image-registry/image-registry-645b85c468-dz7n7" Apr 22 17:34:45.138059 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.138039 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/98eed4e9-c7c8-450d-b229-266b7e3fd1ec-image-registry-private-configuration\") pod \"image-registry-645b85c468-dz7n7\" (UID: \"98eed4e9-c7c8-450d-b229-266b7e3fd1ec\") " pod="openshift-image-registry/image-registry-645b85c468-dz7n7" Apr 22 17:34:45.138160 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.138136 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/98eed4e9-c7c8-450d-b229-266b7e3fd1ec-registry-tls\") pod \"image-registry-645b85c468-dz7n7\" (UID: \"98eed4e9-c7c8-450d-b229-266b7e3fd1ec\") " pod="openshift-image-registry/image-registry-645b85c468-dz7n7" Apr 22 17:34:45.141870 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.141826 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/98eed4e9-c7c8-450d-b229-266b7e3fd1ec-installation-pull-secrets\") pod \"image-registry-645b85c468-dz7n7\" (UID: \"98eed4e9-c7c8-450d-b229-266b7e3fd1ec\") " pod="openshift-image-registry/image-registry-645b85c468-dz7n7" Apr 22 17:34:45.148665 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.148635 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mctm\" (UniqueName: \"kubernetes.io/projected/98eed4e9-c7c8-450d-b229-266b7e3fd1ec-kube-api-access-7mctm\") pod \"image-registry-645b85c468-dz7n7\" (UID: \"98eed4e9-c7c8-450d-b229-266b7e3fd1ec\") " pod="openshift-image-registry/image-registry-645b85c468-dz7n7" Apr 22 17:34:45.148771 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.148684 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/98eed4e9-c7c8-450d-b229-266b7e3fd1ec-bound-sa-token\") pod \"image-registry-645b85c468-dz7n7\" (UID: \"98eed4e9-c7c8-450d-b229-266b7e3fd1ec\") " pod="openshift-image-registry/image-registry-645b85c468-dz7n7" Apr 22 17:34:45.234862 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.234585 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74ac233e-feee-4e49-9b50-3ad174fdd490-tmp-dir\") pod \"dns-default-cdrtz\" (UID: \"74ac233e-feee-4e49-9b50-3ad174fdd490\") " pod="openshift-dns/dns-default-cdrtz" Apr 22 17:34:45.234862 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.234852 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74ac233e-feee-4e49-9b50-3ad174fdd490-tmp-dir\") pod \"dns-default-cdrtz\" (UID: \"74ac233e-feee-4e49-9b50-3ad174fdd490\") " pod="openshift-dns/dns-default-cdrtz" Apr 22 17:34:45.235083 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.234897 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qshsr\" (UniqueName: \"kubernetes.io/projected/4c655f36-4618-49aa-8f46-cbd457bbf957-kube-api-access-qshsr\") pod \"ingress-canary-r2v8q\" (UID: \"4c655f36-4618-49aa-8f46-cbd457bbf957\") " pod="openshift-ingress-canary/ingress-canary-r2v8q" Apr 22 17:34:45.235083 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.234936 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ad210ce8-144f-41e7-b848-d6b10c18ca89-data-volume\") pod \"insights-runtime-extractor-g2t44\" (UID: \"ad210ce8-144f-41e7-b848-d6b10c18ca89\") " pod="openshift-insights/insights-runtime-extractor-g2t44" Apr 22 17:34:45.235083 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.234983 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ad210ce8-144f-41e7-b848-d6b10c18ca89-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g2t44\" (UID: \"ad210ce8-144f-41e7-b848-d6b10c18ca89\") " pod="openshift-insights/insights-runtime-extractor-g2t44" Apr 22 17:34:45.235083 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.235022 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/74ac233e-feee-4e49-9b50-3ad174fdd490-metrics-tls\") pod \"dns-default-cdrtz\" (UID: \"74ac233e-feee-4e49-9b50-3ad174fdd490\") " pod="openshift-dns/dns-default-cdrtz" Apr 22 17:34:45.235297 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.235274 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ad210ce8-144f-41e7-b848-d6b10c18ca89-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g2t44\" (UID: \"ad210ce8-144f-41e7-b848-d6b10c18ca89\") " pod="openshift-insights/insights-runtime-extractor-g2t44" Apr 22 17:34:45.235353 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.235311 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5d47r\" (UniqueName: \"kubernetes.io/projected/ad210ce8-144f-41e7-b848-d6b10c18ca89-kube-api-access-5d47r\") pod \"insights-runtime-extractor-g2t44\" (UID: \"ad210ce8-144f-41e7-b848-d6b10c18ca89\") " pod="openshift-insights/insights-runtime-extractor-g2t44" Apr 22 17:34:45.235402 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.235351 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/74ac233e-feee-4e49-9b50-3ad174fdd490-config-volume\") pod \"dns-default-cdrtz\" (UID: \"74ac233e-feee-4e49-9b50-3ad174fdd490\") " pod="openshift-dns/dns-default-cdrtz" Apr 22 17:34:45.235402 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.235397 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ad210ce8-144f-41e7-b848-d6b10c18ca89-crio-socket\") pod \"insights-runtime-extractor-g2t44\" (UID: \"ad210ce8-144f-41e7-b848-d6b10c18ca89\") " pod="openshift-insights/insights-runtime-extractor-g2t44" Apr 22 17:34:45.235502 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.235399 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ad210ce8-144f-41e7-b848-d6b10c18ca89-data-volume\") pod \"insights-runtime-extractor-g2t44\" (UID: \"ad210ce8-144f-41e7-b848-d6b10c18ca89\") " pod="openshift-insights/insights-runtime-extractor-g2t44" Apr 22 17:34:45.235502 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.235421 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vlccm\" (UniqueName: \"kubernetes.io/projected/74ac233e-feee-4e49-9b50-3ad174fdd490-kube-api-access-vlccm\") pod \"dns-default-cdrtz\" (UID: \"74ac233e-feee-4e49-9b50-3ad174fdd490\") " pod="openshift-dns/dns-default-cdrtz" Apr 22 17:34:45.235502 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.235445 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4c655f36-4618-49aa-8f46-cbd457bbf957-cert\") pod \"ingress-canary-r2v8q\" (UID: \"4c655f36-4618-49aa-8f46-cbd457bbf957\") " pod="openshift-ingress-canary/ingress-canary-r2v8q" Apr 22 17:34:45.235660 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.235620 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ad210ce8-144f-41e7-b848-d6b10c18ca89-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g2t44\" (UID: \"ad210ce8-144f-41e7-b848-d6b10c18ca89\") " pod="openshift-insights/insights-runtime-extractor-g2t44" Apr 22 17:34:45.236018 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.235814 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ad210ce8-144f-41e7-b848-d6b10c18ca89-crio-socket\") pod \"insights-runtime-extractor-g2t44\" (UID: \"ad210ce8-144f-41e7-b848-d6b10c18ca89\") " pod="openshift-insights/insights-runtime-extractor-g2t44" Apr 22 17:34:45.236308 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.236269 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/74ac233e-feee-4e49-9b50-3ad174fdd490-config-volume\") pod \"dns-default-cdrtz\" (UID: \"74ac233e-feee-4e49-9b50-3ad174fdd490\") " pod="openshift-dns/dns-default-cdrtz" Apr 22 17:34:45.238403 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.238377 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ad210ce8-144f-41e7-b848-d6b10c18ca89-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g2t44\" (UID: \"ad210ce8-144f-41e7-b848-d6b10c18ca89\") " pod="openshift-insights/insights-runtime-extractor-g2t44" Apr 22 17:34:45.238885 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.238855 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/74ac233e-feee-4e49-9b50-3ad174fdd490-metrics-tls\") pod \"dns-default-cdrtz\" (UID: \"74ac233e-feee-4e49-9b50-3ad174fdd490\") " pod="openshift-dns/dns-default-cdrtz" Apr 22 17:34:45.238885 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.238874 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4c655f36-4618-49aa-8f46-cbd457bbf957-cert\") pod \"ingress-canary-r2v8q\" (UID: \"4c655f36-4618-49aa-8f46-cbd457bbf957\") " pod="openshift-ingress-canary/ingress-canary-r2v8q" Apr 22 17:34:45.253529 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.253490 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlccm\" (UniqueName: \"kubernetes.io/projected/74ac233e-feee-4e49-9b50-3ad174fdd490-kube-api-access-vlccm\") pod \"dns-default-cdrtz\" (UID: \"74ac233e-feee-4e49-9b50-3ad174fdd490\") " pod="openshift-dns/dns-default-cdrtz" Apr 22 17:34:45.253668 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.253495 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5d47r\" (UniqueName: \"kubernetes.io/projected/ad210ce8-144f-41e7-b848-d6b10c18ca89-kube-api-access-5d47r\") pod \"insights-runtime-extractor-g2t44\" (UID: \"ad210ce8-144f-41e7-b848-d6b10c18ca89\") " pod="openshift-insights/insights-runtime-extractor-g2t44" Apr 22 17:34:45.254155 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.254135 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qshsr\" (UniqueName: \"kubernetes.io/projected/4c655f36-4618-49aa-8f46-cbd457bbf957-kube-api-access-qshsr\") pod \"ingress-canary-r2v8q\" (UID: \"4c655f36-4618-49aa-8f46-cbd457bbf957\") " pod="openshift-ingress-canary/ingress-canary-r2v8q" Apr 22 17:34:45.264063 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.264032 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-645b85c468-dz7n7" Apr 22 17:34:45.271447 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.271416 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wbltv" event={"ID":"1359a64d-2417-42d6-918d-bba7d2d9b6e7","Type":"ContainerStarted","Data":"ee8ad50e6b65b68fa4c6ee072fab6418b964e116e10a378b0edb04c5e695f082"} Apr 22 17:34:45.278320 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.278288 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-g2t44" Apr 22 17:34:45.292039 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.292001 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r2v8q" Apr 22 17:34:45.325610 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.325549 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cdrtz" Apr 22 17:34:45.477240 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.477207 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-645b85c468-dz7n7"] Apr 22 17:34:45.488834 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.488803 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-g2t44"] Apr 22 17:34:45.497910 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.497883 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-r2v8q"] Apr 22 17:34:45.517731 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.517670 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cdrtz"] Apr 22 17:34:45.526709 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:45.526671 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad210ce8_144f_41e7_b848_d6b10c18ca89.slice/crio-6f97a9aea36aae8cb9869b7e75fe71d87c048aafea4cddc44690c5f4aa2bd112 WatchSource:0}: Error finding container 6f97a9aea36aae8cb9869b7e75fe71d87c048aafea4cddc44690c5f4aa2bd112: Status 404 returned error can't find the container with id 6f97a9aea36aae8cb9869b7e75fe71d87c048aafea4cddc44690c5f4aa2bd112 Apr 22 17:34:45.529144 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:45.528811 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74ac233e_feee_4e49_9b50_3ad174fdd490.slice/crio-ef506715ad680ec6d8f708d28ccab0556798e0162f454a0316c899e8f08b86e4 WatchSource:0}: Error finding container ef506715ad680ec6d8f708d28ccab0556798e0162f454a0316c899e8f08b86e4: Status 404 returned error can't find the container with id ef506715ad680ec6d8f708d28ccab0556798e0162f454a0316c899e8f08b86e4 Apr 22 17:34:45.539304 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.539271 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7c8e58bc-a87f-4688-8b70-16d3d2a086cc-original-pull-secret\") pod \"global-pull-secret-syncer-m74jz\" (UID: \"7c8e58bc-a87f-4688-8b70-16d3d2a086cc\") " pod="kube-system/global-pull-secret-syncer-m74jz" Apr 22 17:34:45.539438 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:45.539420 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Apr 22 17:34:45.539610 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:45.539492 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c8e58bc-a87f-4688-8b70-16d3d2a086cc-original-pull-secret podName:7c8e58bc-a87f-4688-8b70-16d3d2a086cc nodeName:}" failed. No retries permitted until 2026-04-22 17:34:47.539472688 +0000 UTC m=+36.984035851 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7c8e58bc-a87f-4688-8b70-16d3d2a086cc-original-pull-secret") pod "global-pull-secret-syncer-m74jz" (UID: "7c8e58bc-a87f-4688-8b70-16d3d2a086cc") : object "kube-system"/"original-pull-secret" not registered Apr 22 17:34:45.754526 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.754490 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-nz2jb"] Apr 22 17:34:45.757738 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.757704 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-nz2jb" Apr 22 17:34:45.760258 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.760229 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Apr 22 17:34:45.760373 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.760329 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-9mzrh\"" Apr 22 17:34:45.768801 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.768766 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-nz2jb"] Apr 22 17:34:45.841214 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.841149 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1a4af5d4-b1b5-4051-9aec-19e9cd20994d-tls-certificates\") pod \"prometheus-operator-admission-webhook-57cf98b594-nz2jb\" (UID: \"1a4af5d4-b1b5-4051-9aec-19e9cd20994d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-nz2jb" Apr 22 17:34:45.942394 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:45.942293 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1a4af5d4-b1b5-4051-9aec-19e9cd20994d-tls-certificates\") pod \"prometheus-operator-admission-webhook-57cf98b594-nz2jb\" (UID: \"1a4af5d4-b1b5-4051-9aec-19e9cd20994d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-nz2jb" Apr 22 17:34:45.942552 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:45.942407 2576 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Apr 22 17:34:45.942552 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:45.942463 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a4af5d4-b1b5-4051-9aec-19e9cd20994d-tls-certificates podName:1a4af5d4-b1b5-4051-9aec-19e9cd20994d nodeName:}" failed. No retries permitted until 2026-04-22 17:34:46.442450269 +0000 UTC m=+35.887013431 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/1a4af5d4-b1b5-4051-9aec-19e9cd20994d-tls-certificates") pod "prometheus-operator-admission-webhook-57cf98b594-nz2jb" (UID: "1a4af5d4-b1b5-4051-9aec-19e9cd20994d") : secret "prometheus-operator-admission-webhook-tls" not found Apr 22 17:34:46.068343 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:46.068311 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m74jz" Apr 22 17:34:46.071228 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:46.071202 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Apr 22 17:34:46.278112 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:46.278073 2576 generic.go:358] "Generic (PLEG): container finished" podID="1359a64d-2417-42d6-918d-bba7d2d9b6e7" containerID="ee8ad50e6b65b68fa4c6ee072fab6418b964e116e10a378b0edb04c5e695f082" exitCode=0 Apr 22 17:34:46.278576 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:46.278159 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wbltv" event={"ID":"1359a64d-2417-42d6-918d-bba7d2d9b6e7","Type":"ContainerDied","Data":"ee8ad50e6b65b68fa4c6ee072fab6418b964e116e10a378b0edb04c5e695f082"} Apr 22 17:34:46.280727 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:46.280697 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-645b85c468-dz7n7" event={"ID":"98eed4e9-c7c8-450d-b229-266b7e3fd1ec","Type":"ContainerStarted","Data":"0bae4180339970d0ef6ee2caa961846fb0e41e9bfd32f0ee7f02a12bf6251f72"} Apr 22 17:34:46.280819 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:46.280738 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-645b85c468-dz7n7" event={"ID":"98eed4e9-c7c8-450d-b229-266b7e3fd1ec","Type":"ContainerStarted","Data":"7dc227ba756fe73df7510e4ccb6002f9c0fbf12cd34c72359ec6c17aca6bbc04"} Apr 22 17:34:46.281252 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:46.281233 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-645b85c468-dz7n7" Apr 22 17:34:46.283486 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:46.283432 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g2t44" event={"ID":"ad210ce8-144f-41e7-b848-d6b10c18ca89","Type":"ContainerStarted","Data":"41952c225237cceee002a519433977bb5f24ce8e6a3347012a3d417a8f463b1c"} Apr 22 17:34:46.283486 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:46.283468 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g2t44" event={"ID":"ad210ce8-144f-41e7-b848-d6b10c18ca89","Type":"ContainerStarted","Data":"6f97a9aea36aae8cb9869b7e75fe71d87c048aafea4cddc44690c5f4aa2bd112"} Apr 22 17:34:46.285098 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:46.285079 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-r2v8q" event={"ID":"4c655f36-4618-49aa-8f46-cbd457bbf957","Type":"ContainerStarted","Data":"f471563563a6eb5cae96d02c5ad5eecabb949421c9d671cae7ae1504619fd006"} Apr 22 17:34:46.287888 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:46.287798 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cdrtz" event={"ID":"74ac233e-feee-4e49-9b50-3ad174fdd490","Type":"ContainerStarted","Data":"ef506715ad680ec6d8f708d28ccab0556798e0162f454a0316c899e8f08b86e4"} Apr 22 17:34:46.326467 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:46.326407 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-645b85c468-dz7n7" podStartSLOduration=7.326388512 podStartE2EDuration="7.326388512s" podCreationTimestamp="2026-04-22 17:34:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-22 17:34:46.324401589 +0000 UTC m=+35.768964773" watchObservedRunningTime="2026-04-22 17:34:46.326388512 +0000 UTC m=+35.770951698" Apr 22 17:34:46.446358 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:46.446316 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1a4af5d4-b1b5-4051-9aec-19e9cd20994d-tls-certificates\") pod \"prometheus-operator-admission-webhook-57cf98b594-nz2jb\" (UID: \"1a4af5d4-b1b5-4051-9aec-19e9cd20994d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-nz2jb" Apr 22 17:34:46.450744 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:46.450713 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1a4af5d4-b1b5-4051-9aec-19e9cd20994d-tls-certificates\") pod \"prometheus-operator-admission-webhook-57cf98b594-nz2jb\" (UID: \"1a4af5d4-b1b5-4051-9aec-19e9cd20994d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-nz2jb" Apr 22 17:34:46.557626 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:46.557594 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-544759c6c4-vtcbn"] Apr 22 17:34:46.568383 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:46.568350 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-544759c6c4-vtcbn" Apr 22 17:34:46.571847 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:46.571820 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Apr 22 17:34:46.572712 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:46.572262 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Apr 22 17:34:46.572712 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:46.572598 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Apr 22 17:34:46.572935 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:46.572875 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Apr 22 17:34:46.572935 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:46.572886 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-544759c6c4-vtcbn"] Apr 22 17:34:46.572935 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:46.572916 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Apr 22 17:34:46.573111 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:46.572945 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Apr 22 17:34:46.573111 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:46.572958 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Apr 22 17:34:46.573111 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:46.572875 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-jrwhj\"" Apr 22 17:34:46.649068 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:46.649035 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/18e08482-c36e-401e-962d-668b99942463-console-oauth-config\") pod \"console-544759c6c4-vtcbn\" (UID: \"18e08482-c36e-401e-962d-668b99942463\") " pod="openshift-console/console-544759c6c4-vtcbn" Apr 22 17:34:46.649285 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:46.649078 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/18e08482-c36e-401e-962d-668b99942463-oauth-serving-cert\") pod \"console-544759c6c4-vtcbn\" (UID: \"18e08482-c36e-401e-962d-668b99942463\") " pod="openshift-console/console-544759c6c4-vtcbn" Apr 22 17:34:46.649285 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:46.649129 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/18e08482-c36e-401e-962d-668b99942463-console-serving-cert\") pod \"console-544759c6c4-vtcbn\" (UID: \"18e08482-c36e-401e-962d-668b99942463\") " pod="openshift-console/console-544759c6c4-vtcbn" Apr 22 17:34:46.649285 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:46.649275 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hprvb\" (UniqueName: \"kubernetes.io/projected/18e08482-c36e-401e-962d-668b99942463-kube-api-access-hprvb\") pod \"console-544759c6c4-vtcbn\" (UID: \"18e08482-c36e-401e-962d-668b99942463\") " pod="openshift-console/console-544759c6c4-vtcbn" Apr 22 17:34:46.649494 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:46.649321 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/18e08482-c36e-401e-962d-668b99942463-service-ca\") pod \"console-544759c6c4-vtcbn\" (UID: \"18e08482-c36e-401e-962d-668b99942463\") " pod="openshift-console/console-544759c6c4-vtcbn" Apr 22 17:34:46.649494 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:46.649366 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/18e08482-c36e-401e-962d-668b99942463-console-config\") pod \"console-544759c6c4-vtcbn\" (UID: \"18e08482-c36e-401e-962d-668b99942463\") " pod="openshift-console/console-544759c6c4-vtcbn" Apr 22 17:34:46.672511 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:46.672046 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-nz2jb" Apr 22 17:34:46.750595 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:46.750563 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hprvb\" (UniqueName: \"kubernetes.io/projected/18e08482-c36e-401e-962d-668b99942463-kube-api-access-hprvb\") pod \"console-544759c6c4-vtcbn\" (UID: \"18e08482-c36e-401e-962d-668b99942463\") " pod="openshift-console/console-544759c6c4-vtcbn" Apr 22 17:34:46.750595 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:46.750601 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/18e08482-c36e-401e-962d-668b99942463-service-ca\") pod \"console-544759c6c4-vtcbn\" (UID: \"18e08482-c36e-401e-962d-668b99942463\") " pod="openshift-console/console-544759c6c4-vtcbn" Apr 22 17:34:46.751467 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:46.750628 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/18e08482-c36e-401e-962d-668b99942463-console-config\") pod \"console-544759c6c4-vtcbn\" (UID: \"18e08482-c36e-401e-962d-668b99942463\") " pod="openshift-console/console-544759c6c4-vtcbn" Apr 22 17:34:46.751467 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:46.750675 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/18e08482-c36e-401e-962d-668b99942463-console-oauth-config\") pod \"console-544759c6c4-vtcbn\" (UID: \"18e08482-c36e-401e-962d-668b99942463\") " pod="openshift-console/console-544759c6c4-vtcbn" Apr 22 17:34:46.751467 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:46.750698 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/18e08482-c36e-401e-962d-668b99942463-oauth-serving-cert\") pod \"console-544759c6c4-vtcbn\" (UID: \"18e08482-c36e-401e-962d-668b99942463\") " pod="openshift-console/console-544759c6c4-vtcbn" Apr 22 17:34:46.751467 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:46.750743 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/18e08482-c36e-401e-962d-668b99942463-console-serving-cert\") pod \"console-544759c6c4-vtcbn\" (UID: \"18e08482-c36e-401e-962d-668b99942463\") " pod="openshift-console/console-544759c6c4-vtcbn" Apr 22 17:34:46.751834 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:46.751560 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/18e08482-c36e-401e-962d-668b99942463-service-ca\") pod \"console-544759c6c4-vtcbn\" (UID: \"18e08482-c36e-401e-962d-668b99942463\") " pod="openshift-console/console-544759c6c4-vtcbn" Apr 22 17:34:46.751883 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:46.751855 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/18e08482-c36e-401e-962d-668b99942463-oauth-serving-cert\") pod \"console-544759c6c4-vtcbn\" (UID: \"18e08482-c36e-401e-962d-668b99942463\") " pod="openshift-console/console-544759c6c4-vtcbn" Apr 22 17:34:46.752355 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:46.752297 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/18e08482-c36e-401e-962d-668b99942463-console-config\") pod \"console-544759c6c4-vtcbn\" (UID: \"18e08482-c36e-401e-962d-668b99942463\") " pod="openshift-console/console-544759c6c4-vtcbn" Apr 22 17:34:46.754464 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:46.754437 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/18e08482-c36e-401e-962d-668b99942463-console-oauth-config\") pod \"console-544759c6c4-vtcbn\" (UID: \"18e08482-c36e-401e-962d-668b99942463\") " pod="openshift-console/console-544759c6c4-vtcbn" Apr 22 17:34:46.754614 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:46.754519 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/18e08482-c36e-401e-962d-668b99942463-console-serving-cert\") pod \"console-544759c6c4-vtcbn\" (UID: \"18e08482-c36e-401e-962d-668b99942463\") " pod="openshift-console/console-544759c6c4-vtcbn" Apr 22 17:34:46.759407 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:46.759381 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hprvb\" (UniqueName: \"kubernetes.io/projected/18e08482-c36e-401e-962d-668b99942463-kube-api-access-hprvb\") pod \"console-544759c6c4-vtcbn\" (UID: \"18e08482-c36e-401e-962d-668b99942463\") " pod="openshift-console/console-544759c6c4-vtcbn" Apr 22 17:34:46.830287 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:46.829982 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-nz2jb"] Apr 22 17:34:46.888033 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:46.888001 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a4af5d4_b1b5_4051_9aec_19e9cd20994d.slice/crio-7947c108572730a3e62a6b37dfae52acade2a1aceb9c015189a7cbf50df0b3ee WatchSource:0}: Error finding container 7947c108572730a3e62a6b37dfae52acade2a1aceb9c015189a7cbf50df0b3ee: Status 404 returned error can't find the container with id 7947c108572730a3e62a6b37dfae52acade2a1aceb9c015189a7cbf50df0b3ee Apr 22 17:34:46.893585 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:46.893556 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-544759c6c4-vtcbn" Apr 22 17:34:47.299673 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:47.294894 2576 generic.go:358] "Generic (PLEG): container finished" podID="1359a64d-2417-42d6-918d-bba7d2d9b6e7" containerID="cbcb95a4fb62b5c016c605dc33bde3c70c29278263e9b78e522c59d8267e7ee4" exitCode=0 Apr 22 17:34:47.299673 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:47.295002 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wbltv" event={"ID":"1359a64d-2417-42d6-918d-bba7d2d9b6e7","Type":"ContainerDied","Data":"cbcb95a4fb62b5c016c605dc33bde3c70c29278263e9b78e522c59d8267e7ee4"} Apr 22 17:34:47.299673 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:47.296469 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-nz2jb" event={"ID":"1a4af5d4-b1b5-4051-9aec-19e9cd20994d","Type":"ContainerStarted","Data":"7947c108572730a3e62a6b37dfae52acade2a1aceb9c015189a7cbf50df0b3ee"} Apr 22 17:34:47.557598 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:47.556865 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7c8e58bc-a87f-4688-8b70-16d3d2a086cc-original-pull-secret\") pod \"global-pull-secret-syncer-m74jz\" (UID: \"7c8e58bc-a87f-4688-8b70-16d3d2a086cc\") " pod="kube-system/global-pull-secret-syncer-m74jz" Apr 22 17:34:47.561894 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:47.561868 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7c8e58bc-a87f-4688-8b70-16d3d2a086cc-original-pull-secret\") pod \"global-pull-secret-syncer-m74jz\" (UID: \"7c8e58bc-a87f-4688-8b70-16d3d2a086cc\") " pod="kube-system/global-pull-secret-syncer-m74jz" Apr 22 17:34:47.576237 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:47.576201 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m74jz" Apr 22 17:34:47.643512 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:47.643456 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-544759c6c4-vtcbn"] Apr 22 17:34:47.652414 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:47.651977 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18e08482_c36e_401e_962d_668b99942463.slice/crio-70baf449d0224eb4a07110ab47cd6b47c74a0c430bfe6b97bfea43d8e214105a WatchSource:0}: Error finding container 70baf449d0224eb4a07110ab47cd6b47c74a0c430bfe6b97bfea43d8e214105a: Status 404 returned error can't find the container with id 70baf449d0224eb4a07110ab47cd6b47c74a0c430bfe6b97bfea43d8e214105a Apr 22 17:34:47.725098 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:47.725067 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-m74jz"] Apr 22 17:34:48.243545 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:48.243512 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c8e58bc_a87f_4688_8b70_16d3d2a086cc.slice/crio-25d02c9445085545b9b1a06471ebd5e87ce07d867b9fe7436140f92997316319 WatchSource:0}: Error finding container 25d02c9445085545b9b1a06471ebd5e87ce07d867b9fe7436140f92997316319: Status 404 returned error can't find the container with id 25d02c9445085545b9b1a06471ebd5e87ce07d867b9fe7436140f92997316319 Apr 22 17:34:48.300400 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:48.300364 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-544759c6c4-vtcbn" event={"ID":"18e08482-c36e-401e-962d-668b99942463","Type":"ContainerStarted","Data":"70baf449d0224eb4a07110ab47cd6b47c74a0c430bfe6b97bfea43d8e214105a"} Apr 22 17:34:48.303830 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:48.303797 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wbltv" event={"ID":"1359a64d-2417-42d6-918d-bba7d2d9b6e7","Type":"ContainerStarted","Data":"8adc7383464cb9acfff2c5fafeb0ede5774f18b8858172fbebb94fe2fe0ad647"} Apr 22 17:34:48.306063 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:48.306037 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g2t44" event={"ID":"ad210ce8-144f-41e7-b848-d6b10c18ca89","Type":"ContainerStarted","Data":"d319a9908df63dc1c55171eb26e4bf6fcfa89d29bb618a358011facb26d4674a"} Apr 22 17:34:48.307164 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:48.307138 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-m74jz" event={"ID":"7c8e58bc-a87f-4688-8b70-16d3d2a086cc","Type":"ContainerStarted","Data":"25d02c9445085545b9b1a06471ebd5e87ce07d867b9fe7436140f92997316319"} Apr 22 17:34:48.329198 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:48.329119 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-wbltv" podStartSLOduration=5.90469872 podStartE2EDuration="37.329098424s" podCreationTimestamp="2026-04-22 17:34:11 +0000 UTC" firstStartedPulling="2026-04-22 17:34:13.677571338 +0000 UTC m=+3.122134513" lastFinishedPulling="2026-04-22 17:34:45.10197104 +0000 UTC m=+34.546534217" observedRunningTime="2026-04-22 17:34:48.327380131 +0000 UTC m=+37.771943328" watchObservedRunningTime="2026-04-22 17:34:48.329098424 +0000 UTC m=+37.773661609" Apr 22 17:34:49.314317 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:49.313364 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-r2v8q" event={"ID":"4c655f36-4618-49aa-8f46-cbd457bbf957","Type":"ContainerStarted","Data":"f77db7909c30ed7ebb5f50acf8032078a595e045c05a2efc85bcf685d758570d"} Apr 22 17:34:49.316383 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:49.316314 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cdrtz" event={"ID":"74ac233e-feee-4e49-9b50-3ad174fdd490","Type":"ContainerStarted","Data":"b4a47f251118bb20d91c4f32aee1cb80d3bacb36130d0586f4fce7a88357fafd"} Apr 22 17:34:49.316383 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:49.316349 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cdrtz" event={"ID":"74ac233e-feee-4e49-9b50-3ad174fdd490","Type":"ContainerStarted","Data":"a39ffe7fd5fe37ddb9aa07849de637e4d48773a6d70341cdcd2138c80d0886c1"} Apr 22 17:34:49.316638 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:49.316463 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-cdrtz" Apr 22 17:34:49.319312 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:49.319269 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-nz2jb" event={"ID":"1a4af5d4-b1b5-4051-9aec-19e9cd20994d","Type":"ContainerStarted","Data":"922f115fbdc79c56a8933506f1907cfbafadb8447a78f3ba96ccddce1567e0ef"} Apr 22 17:34:49.319525 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:49.319499 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-nz2jb" Apr 22 17:34:49.325818 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:49.325790 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-nz2jb" Apr 22 17:34:49.331273 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:49.331076 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-r2v8q" podStartSLOduration=2.229752965 podStartE2EDuration="5.331059888s" podCreationTimestamp="2026-04-22 17:34:44 +0000 UTC" firstStartedPulling="2026-04-22 17:34:45.532481485 +0000 UTC m=+34.977044650" lastFinishedPulling="2026-04-22 17:34:48.633788394 +0000 UTC m=+38.078351573" observedRunningTime="2026-04-22 17:34:49.330680249 +0000 UTC m=+38.775243434" watchObservedRunningTime="2026-04-22 17:34:49.331059888 +0000 UTC m=+38.775623072" Apr 22 17:34:49.368093 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:49.367807 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-cdrtz" podStartSLOduration=2.108333436 podStartE2EDuration="5.367784546s" podCreationTimestamp="2026-04-22 17:34:44 +0000 UTC" firstStartedPulling="2026-04-22 17:34:45.530144688 +0000 UTC m=+34.974707853" lastFinishedPulling="2026-04-22 17:34:48.789595788 +0000 UTC m=+38.234158963" observedRunningTime="2026-04-22 17:34:49.349704811 +0000 UTC m=+38.794267996" watchObservedRunningTime="2026-04-22 17:34:49.367784546 +0000 UTC m=+38.812347710" Apr 22 17:34:49.368093 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:49.367935 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-nz2jb" podStartSLOduration=2.483426635 podStartE2EDuration="4.367926745s" podCreationTimestamp="2026-04-22 17:34:45 +0000 UTC" firstStartedPulling="2026-04-22 17:34:46.906219384 +0000 UTC m=+36.350782549" lastFinishedPulling="2026-04-22 17:34:48.79071948 +0000 UTC m=+38.235282659" observedRunningTime="2026-04-22 17:34:49.366687633 +0000 UTC m=+38.811250817" watchObservedRunningTime="2026-04-22 17:34:49.367926745 +0000 UTC m=+38.812489930" Apr 22 17:34:49.824706 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:49.823747 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5676c8c784-9rzr5"] Apr 22 17:34:49.854658 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:49.854619 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5676c8c784-9rzr5"] Apr 22 17:34:49.854835 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:49.854807 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5676c8c784-9rzr5" Apr 22 17:34:49.857461 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:49.857437 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Apr 22 17:34:49.857591 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:49.857525 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-4b9t4\"" Apr 22 17:34:49.858061 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:49.858009 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Apr 22 17:34:49.858696 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:49.858307 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Apr 22 17:34:49.858696 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:49.858530 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Apr 22 17:34:49.859293 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:49.859113 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Apr 22 17:34:49.978086 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:49.978048 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31f5fdd1-4354-411c-b806-4d84fd417eac-metrics-client-ca\") pod \"prometheus-operator-5676c8c784-9rzr5\" (UID: \"31f5fdd1-4354-411c-b806-4d84fd417eac\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-9rzr5" Apr 22 17:34:49.978290 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:49.978130 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/31f5fdd1-4354-411c-b806-4d84fd417eac-prometheus-operator-tls\") pod \"prometheus-operator-5676c8c784-9rzr5\" (UID: \"31f5fdd1-4354-411c-b806-4d84fd417eac\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-9rzr5" Apr 22 17:34:49.978290 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:49.978220 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/31f5fdd1-4354-411c-b806-4d84fd417eac-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5676c8c784-9rzr5\" (UID: \"31f5fdd1-4354-411c-b806-4d84fd417eac\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-9rzr5" Apr 22 17:34:49.978290 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:49.978284 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2t9z2\" (UniqueName: \"kubernetes.io/projected/31f5fdd1-4354-411c-b806-4d84fd417eac-kube-api-access-2t9z2\") pod \"prometheus-operator-5676c8c784-9rzr5\" (UID: \"31f5fdd1-4354-411c-b806-4d84fd417eac\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-9rzr5" Apr 22 17:34:50.079545 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:50.079462 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2t9z2\" (UniqueName: \"kubernetes.io/projected/31f5fdd1-4354-411c-b806-4d84fd417eac-kube-api-access-2t9z2\") pod \"prometheus-operator-5676c8c784-9rzr5\" (UID: \"31f5fdd1-4354-411c-b806-4d84fd417eac\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-9rzr5" Apr 22 17:34:50.079706 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:50.079541 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31f5fdd1-4354-411c-b806-4d84fd417eac-metrics-client-ca\") pod \"prometheus-operator-5676c8c784-9rzr5\" (UID: \"31f5fdd1-4354-411c-b806-4d84fd417eac\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-9rzr5" Apr 22 17:34:50.079706 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:50.079598 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/31f5fdd1-4354-411c-b806-4d84fd417eac-prometheus-operator-tls\") pod \"prometheus-operator-5676c8c784-9rzr5\" (UID: \"31f5fdd1-4354-411c-b806-4d84fd417eac\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-9rzr5" Apr 22 17:34:50.079706 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:50.079647 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/31f5fdd1-4354-411c-b806-4d84fd417eac-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5676c8c784-9rzr5\" (UID: \"31f5fdd1-4354-411c-b806-4d84fd417eac\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-9rzr5" Apr 22 17:34:50.080919 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:50.080892 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31f5fdd1-4354-411c-b806-4d84fd417eac-metrics-client-ca\") pod \"prometheus-operator-5676c8c784-9rzr5\" (UID: \"31f5fdd1-4354-411c-b806-4d84fd417eac\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-9rzr5" Apr 22 17:34:50.084114 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:50.084086 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/31f5fdd1-4354-411c-b806-4d84fd417eac-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5676c8c784-9rzr5\" (UID: \"31f5fdd1-4354-411c-b806-4d84fd417eac\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-9rzr5" Apr 22 17:34:50.084255 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:50.084218 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/31f5fdd1-4354-411c-b806-4d84fd417eac-prometheus-operator-tls\") pod \"prometheus-operator-5676c8c784-9rzr5\" (UID: \"31f5fdd1-4354-411c-b806-4d84fd417eac\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-9rzr5" Apr 22 17:34:50.089579 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:50.089553 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2t9z2\" (UniqueName: \"kubernetes.io/projected/31f5fdd1-4354-411c-b806-4d84fd417eac-kube-api-access-2t9z2\") pod \"prometheus-operator-5676c8c784-9rzr5\" (UID: \"31f5fdd1-4354-411c-b806-4d84fd417eac\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-9rzr5" Apr 22 17:34:50.167410 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:50.167375 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5676c8c784-9rzr5" Apr 22 17:34:50.473694 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:50.473661 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5676c8c784-9rzr5"] Apr 22 17:34:51.327521 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:51.327479 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g2t44" event={"ID":"ad210ce8-144f-41e7-b848-d6b10c18ca89","Type":"ContainerStarted","Data":"85db0f734a6ca0a8ed9cc0ef12a35c22aa286b121f19803359f9fbc5312bab41"} Apr 22 17:34:51.328911 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:51.328821 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5676c8c784-9rzr5" event={"ID":"31f5fdd1-4354-411c-b806-4d84fd417eac","Type":"ContainerStarted","Data":"af6bf94e753bc2f948a2430139bf99067e3ab885a26c5ec2e52e74dab97b752d"} Apr 22 17:34:51.346895 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:51.346845 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-g2t44" podStartSLOduration=2.673237338 podStartE2EDuration="7.34682856s" podCreationTimestamp="2026-04-22 17:34:44 +0000 UTC" firstStartedPulling="2026-04-22 17:34:45.644060009 +0000 UTC m=+35.088623174" lastFinishedPulling="2026-04-22 17:34:50.31765122 +0000 UTC m=+39.762214396" observedRunningTime="2026-04-22 17:34:51.345881033 +0000 UTC m=+40.790444217" watchObservedRunningTime="2026-04-22 17:34:51.34682856 +0000 UTC m=+40.791391741" Apr 22 17:34:53.934356 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:53.934321 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-755667c6d-5m8bf"] Apr 22 17:34:53.947697 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:53.947666 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-755667c6d-5m8bf"] Apr 22 17:34:53.947879 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:53.947808 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-755667c6d-5m8bf" Apr 22 17:34:53.956325 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:53.956153 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Apr 22 17:34:54.117279 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:54.117231 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dcde6eda-f52a-4c3a-8740-a82e865872c2-console-serving-cert\") pod \"console-755667c6d-5m8bf\" (UID: \"dcde6eda-f52a-4c3a-8740-a82e865872c2\") " pod="openshift-console/console-755667c6d-5m8bf" Apr 22 17:34:54.117279 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:54.117283 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dcde6eda-f52a-4c3a-8740-a82e865872c2-service-ca\") pod \"console-755667c6d-5m8bf\" (UID: \"dcde6eda-f52a-4c3a-8740-a82e865872c2\") " pod="openshift-console/console-755667c6d-5m8bf" Apr 22 17:34:54.117518 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:54.117312 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dcde6eda-f52a-4c3a-8740-a82e865872c2-console-oauth-config\") pod \"console-755667c6d-5m8bf\" (UID: \"dcde6eda-f52a-4c3a-8740-a82e865872c2\") " pod="openshift-console/console-755667c6d-5m8bf" Apr 22 17:34:54.117518 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:54.117334 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dcde6eda-f52a-4c3a-8740-a82e865872c2-trusted-ca-bundle\") pod \"console-755667c6d-5m8bf\" (UID: \"dcde6eda-f52a-4c3a-8740-a82e865872c2\") " pod="openshift-console/console-755667c6d-5m8bf" Apr 22 17:34:54.117518 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:54.117365 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dcde6eda-f52a-4c3a-8740-a82e865872c2-oauth-serving-cert\") pod \"console-755667c6d-5m8bf\" (UID: \"dcde6eda-f52a-4c3a-8740-a82e865872c2\") " pod="openshift-console/console-755667c6d-5m8bf" Apr 22 17:34:54.117518 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:54.117436 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dcde6eda-f52a-4c3a-8740-a82e865872c2-console-config\") pod \"console-755667c6d-5m8bf\" (UID: \"dcde6eda-f52a-4c3a-8740-a82e865872c2\") " pod="openshift-console/console-755667c6d-5m8bf" Apr 22 17:34:54.117518 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:54.117471 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwfq8\" (UniqueName: \"kubernetes.io/projected/dcde6eda-f52a-4c3a-8740-a82e865872c2-kube-api-access-wwfq8\") pod \"console-755667c6d-5m8bf\" (UID: \"dcde6eda-f52a-4c3a-8740-a82e865872c2\") " pod="openshift-console/console-755667c6d-5m8bf" Apr 22 17:34:54.218050 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:54.218014 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dcde6eda-f52a-4c3a-8740-a82e865872c2-trusted-ca-bundle\") pod \"console-755667c6d-5m8bf\" (UID: \"dcde6eda-f52a-4c3a-8740-a82e865872c2\") " pod="openshift-console/console-755667c6d-5m8bf" Apr 22 17:34:54.218248 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:54.218090 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dcde6eda-f52a-4c3a-8740-a82e865872c2-oauth-serving-cert\") pod \"console-755667c6d-5m8bf\" (UID: \"dcde6eda-f52a-4c3a-8740-a82e865872c2\") " pod="openshift-console/console-755667c6d-5m8bf" Apr 22 17:34:54.218248 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:54.218146 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dcde6eda-f52a-4c3a-8740-a82e865872c2-console-config\") pod \"console-755667c6d-5m8bf\" (UID: \"dcde6eda-f52a-4c3a-8740-a82e865872c2\") " pod="openshift-console/console-755667c6d-5m8bf" Apr 22 17:34:54.218248 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:54.218201 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wwfq8\" (UniqueName: \"kubernetes.io/projected/dcde6eda-f52a-4c3a-8740-a82e865872c2-kube-api-access-wwfq8\") pod \"console-755667c6d-5m8bf\" (UID: \"dcde6eda-f52a-4c3a-8740-a82e865872c2\") " pod="openshift-console/console-755667c6d-5m8bf" Apr 22 17:34:54.218417 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:54.218255 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dcde6eda-f52a-4c3a-8740-a82e865872c2-console-serving-cert\") pod \"console-755667c6d-5m8bf\" (UID: \"dcde6eda-f52a-4c3a-8740-a82e865872c2\") " pod="openshift-console/console-755667c6d-5m8bf" Apr 22 17:34:54.218417 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:54.218283 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dcde6eda-f52a-4c3a-8740-a82e865872c2-service-ca\") pod \"console-755667c6d-5m8bf\" (UID: \"dcde6eda-f52a-4c3a-8740-a82e865872c2\") " pod="openshift-console/console-755667c6d-5m8bf" Apr 22 17:34:54.218417 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:54.218328 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dcde6eda-f52a-4c3a-8740-a82e865872c2-console-oauth-config\") pod \"console-755667c6d-5m8bf\" (UID: \"dcde6eda-f52a-4c3a-8740-a82e865872c2\") " pod="openshift-console/console-755667c6d-5m8bf" Apr 22 17:34:54.219865 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:54.219428 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dcde6eda-f52a-4c3a-8740-a82e865872c2-trusted-ca-bundle\") pod \"console-755667c6d-5m8bf\" (UID: \"dcde6eda-f52a-4c3a-8740-a82e865872c2\") " pod="openshift-console/console-755667c6d-5m8bf" Apr 22 17:34:54.222243 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:54.222162 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dcde6eda-f52a-4c3a-8740-a82e865872c2-console-serving-cert\") pod \"console-755667c6d-5m8bf\" (UID: \"dcde6eda-f52a-4c3a-8740-a82e865872c2\") " pod="openshift-console/console-755667c6d-5m8bf" Apr 22 17:34:54.223600 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:54.223558 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dcde6eda-f52a-4c3a-8740-a82e865872c2-console-oauth-config\") pod \"console-755667c6d-5m8bf\" (UID: \"dcde6eda-f52a-4c3a-8740-a82e865872c2\") " pod="openshift-console/console-755667c6d-5m8bf" Apr 22 17:34:54.228349 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:54.227516 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dcde6eda-f52a-4c3a-8740-a82e865872c2-oauth-serving-cert\") pod \"console-755667c6d-5m8bf\" (UID: \"dcde6eda-f52a-4c3a-8740-a82e865872c2\") " pod="openshift-console/console-755667c6d-5m8bf" Apr 22 17:34:54.228349 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:54.227592 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dcde6eda-f52a-4c3a-8740-a82e865872c2-console-config\") pod \"console-755667c6d-5m8bf\" (UID: \"dcde6eda-f52a-4c3a-8740-a82e865872c2\") " pod="openshift-console/console-755667c6d-5m8bf" Apr 22 17:34:54.228349 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:54.228242 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dcde6eda-f52a-4c3a-8740-a82e865872c2-service-ca\") pod \"console-755667c6d-5m8bf\" (UID: \"dcde6eda-f52a-4c3a-8740-a82e865872c2\") " pod="openshift-console/console-755667c6d-5m8bf" Apr 22 17:34:54.230252 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:54.230229 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwfq8\" (UniqueName: \"kubernetes.io/projected/dcde6eda-f52a-4c3a-8740-a82e865872c2-kube-api-access-wwfq8\") pod \"console-755667c6d-5m8bf\" (UID: \"dcde6eda-f52a-4c3a-8740-a82e865872c2\") " pod="openshift-console/console-755667c6d-5m8bf" Apr 22 17:34:54.261632 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:54.261605 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-755667c6d-5m8bf" Apr 22 17:34:54.342692 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:54.342649 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-544759c6c4-vtcbn" event={"ID":"18e08482-c36e-401e-962d-668b99942463","Type":"ContainerStarted","Data":"63c5854ec4d7e754ed619e8a9d63ee37789bd4c4d5c45b9e2c0b2475a95dd7bc"} Apr 22 17:34:54.344337 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:54.344307 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5676c8c784-9rzr5" event={"ID":"31f5fdd1-4354-411c-b806-4d84fd417eac","Type":"ContainerStarted","Data":"6f765dccfc6ab15dd3fec9b58fe8cc78b1c3844650f5c4dbfd86014a0922f777"} Apr 22 17:34:54.345800 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:54.345775 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-m74jz" event={"ID":"7c8e58bc-a87f-4688-8b70-16d3d2a086cc","Type":"ContainerStarted","Data":"73d897fd8e85e9f626872d1f49cae885e4ac13f7fc65ae41fb43594ea93d1852"} Apr 22 17:34:54.364894 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:54.364854 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-544759c6c4-vtcbn" podStartSLOduration=1.8743324449999998 podStartE2EDuration="8.36483968s" podCreationTimestamp="2026-04-22 17:34:46 +0000 UTC" firstStartedPulling="2026-04-22 17:34:47.654404361 +0000 UTC m=+37.098967522" lastFinishedPulling="2026-04-22 17:34:54.144911581 +0000 UTC m=+43.589474757" observedRunningTime="2026-04-22 17:34:54.364243987 +0000 UTC m=+43.808807185" watchObservedRunningTime="2026-04-22 17:34:54.36483968 +0000 UTC m=+43.809402864" Apr 22 17:34:54.383799 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:54.383723 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-m74jz" podStartSLOduration=5.491803336 podStartE2EDuration="11.383702782s" podCreationTimestamp="2026-04-22 17:34:43 +0000 UTC" firstStartedPulling="2026-04-22 17:34:48.25308142 +0000 UTC m=+37.697644622" lastFinishedPulling="2026-04-22 17:34:54.144980905 +0000 UTC m=+43.589544068" observedRunningTime="2026-04-22 17:34:54.382790452 +0000 UTC m=+43.827353637" watchObservedRunningTime="2026-04-22 17:34:54.383702782 +0000 UTC m=+43.828265967" Apr 22 17:34:54.409869 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:54.409791 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-755667c6d-5m8bf"] Apr 22 17:34:54.415949 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:54.415916 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcde6eda_f52a_4c3a_8740_a82e865872c2.slice/crio-0e6f1c84efd605cf8beca83fcc8ccaacaaaf766b2474b9918d199b32d2a42876 WatchSource:0}: Error finding container 0e6f1c84efd605cf8beca83fcc8ccaacaaaf766b2474b9918d199b32d2a42876: Status 404 returned error can't find the container with id 0e6f1c84efd605cf8beca83fcc8ccaacaaaf766b2474b9918d199b32d2a42876 Apr 22 17:34:55.351707 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:55.351325 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5676c8c784-9rzr5" event={"ID":"31f5fdd1-4354-411c-b806-4d84fd417eac","Type":"ContainerStarted","Data":"93dc2aca2cd170584534ea43f901a296a3bcff0dd6650a2cb31c1ec24bb5ff7e"} Apr 22 17:34:55.353161 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:55.353124 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-755667c6d-5m8bf" event={"ID":"dcde6eda-f52a-4c3a-8740-a82e865872c2","Type":"ContainerStarted","Data":"8ae4d196be0e46e46199f6ff93ce67a750e3a12860db7cfca8d4c0490138981c"} Apr 22 17:34:55.353292 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:55.353192 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-755667c6d-5m8bf" event={"ID":"dcde6eda-f52a-4c3a-8740-a82e865872c2","Type":"ContainerStarted","Data":"0e6f1c84efd605cf8beca83fcc8ccaacaaaf766b2474b9918d199b32d2a42876"} Apr 22 17:34:55.368559 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:55.368509 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5676c8c784-9rzr5" podStartSLOduration=2.702439363 podStartE2EDuration="6.368493455s" podCreationTimestamp="2026-04-22 17:34:49 +0000 UTC" firstStartedPulling="2026-04-22 17:34:50.48110703 +0000 UTC m=+39.925670207" lastFinishedPulling="2026-04-22 17:34:54.147161133 +0000 UTC m=+43.591724299" observedRunningTime="2026-04-22 17:34:55.367432933 +0000 UTC m=+44.811996131" watchObservedRunningTime="2026-04-22 17:34:55.368493455 +0000 UTC m=+44.813056640" Apr 22 17:34:55.392232 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:55.392147 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-755667c6d-5m8bf" podStartSLOduration=2.392119671 podStartE2EDuration="2.392119671s" podCreationTimestamp="2026-04-22 17:34:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-22 17:34:55.391391384 +0000 UTC m=+44.835954569" watchObservedRunningTime="2026-04-22 17:34:55.392119671 +0000 UTC m=+44.836682855" Apr 22 17:34:56.894156 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:56.894118 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-544759c6c4-vtcbn" Apr 22 17:34:56.894547 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:56.894164 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-544759c6c4-vtcbn" Apr 22 17:34:56.895411 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:56.895385 2576 patch_prober.go:28] interesting pod/console-544759c6c4-vtcbn container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.11:8443/health\": dial tcp 10.133.0.11:8443: connect: connection refused" start-of-body= Apr 22 17:34:56.895544 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:56.895436 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-544759c6c4-vtcbn" podUID="18e08482-c36e-401e-962d-668b99942463" containerName="console" probeResult="failure" output="Get \"https://10.133.0.11:8443/health\": dial tcp 10.133.0.11:8443: connect: connection refused" Apr 22 17:34:57.184019 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.183939 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9d44df66c-5z68s"] Apr 22 17:34:57.188334 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.188318 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9d44df66c-5z68s" Apr 22 17:34:57.190836 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.190813 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-49sm5\"" Apr 22 17:34:57.191613 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.191599 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Apr 22 17:34:57.191932 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.191915 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Apr 22 17:34:57.198982 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.198949 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9d44df66c-5z68s"] Apr 22 17:34:57.205477 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.205450 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-69db897b98-wn6cz"] Apr 22 17:34:57.209924 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.209906 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-69db897b98-wn6cz" Apr 22 17:34:57.212584 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.212561 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Apr 22 17:34:57.212691 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.212582 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-dpvns\"" Apr 22 17:34:57.212691 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.212630 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Apr 22 17:34:57.212691 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.212563 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Apr 22 17:34:57.227033 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.226998 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-69db897b98-wn6cz"] Apr 22 17:34:57.237117 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.237088 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-z9pps"] Apr 22 17:34:57.241353 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.241332 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-z9pps" Apr 22 17:34:57.243987 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.243963 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Apr 22 17:34:57.244115 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.243968 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-mbnkh\"" Apr 22 17:34:57.244415 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.244398 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Apr 22 17:34:57.244661 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.244647 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Apr 22 17:34:57.346031 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.345990 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/95a6851e-a8cd-4616-b68e-e5b995ea6bd7-node-exporter-wtmp\") pod \"node-exporter-z9pps\" (UID: \"95a6851e-a8cd-4616-b68e-e5b995ea6bd7\") " pod="openshift-monitoring/node-exporter-z9pps" Apr 22 17:34:57.346193 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.346058 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de748dd6-d39d-448f-bd35-1602c06041cc-metrics-client-ca\") pod \"kube-state-metrics-69db897b98-wn6cz\" (UID: \"de748dd6-d39d-448f-bd35-1602c06041cc\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-wn6cz" Apr 22 17:34:57.346193 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.346089 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73c9b011-6e25-4fb7-88db-47782660f515-metrics-client-ca\") pod \"openshift-state-metrics-9d44df66c-5z68s\" (UID: \"73c9b011-6e25-4fb7-88db-47782660f515\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-5z68s" Apr 22 17:34:57.346193 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.346103 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/95a6851e-a8cd-4616-b68e-e5b995ea6bd7-root\") pod \"node-exporter-z9pps\" (UID: \"95a6851e-a8cd-4616-b68e-e5b995ea6bd7\") " pod="openshift-monitoring/node-exporter-z9pps" Apr 22 17:34:57.346193 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.346121 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/de748dd6-d39d-448f-bd35-1602c06041cc-kube-state-metrics-tls\") pod \"kube-state-metrics-69db897b98-wn6cz\" (UID: \"de748dd6-d39d-448f-bd35-1602c06041cc\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-wn6cz" Apr 22 17:34:57.346193 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.346144 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/95a6851e-a8cd-4616-b68e-e5b995ea6bd7-node-exporter-tls\") pod \"node-exporter-z9pps\" (UID: \"95a6851e-a8cd-4616-b68e-e5b995ea6bd7\") " pod="openshift-monitoring/node-exporter-z9pps" Apr 22 17:34:57.346379 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.346226 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95a6851e-a8cd-4616-b68e-e5b995ea6bd7-sys\") pod \"node-exporter-z9pps\" (UID: \"95a6851e-a8cd-4616-b68e-e5b995ea6bd7\") " pod="openshift-monitoring/node-exporter-z9pps" Apr 22 17:34:57.346379 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.346255 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/95a6851e-a8cd-4616-b68e-e5b995ea6bd7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z9pps\" (UID: \"95a6851e-a8cd-4616-b68e-e5b995ea6bd7\") " pod="openshift-monitoring/node-exporter-z9pps" Apr 22 17:34:57.346379 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.346286 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/73c9b011-6e25-4fb7-88db-47782660f515-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9d44df66c-5z68s\" (UID: \"73c9b011-6e25-4fb7-88db-47782660f515\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-5z68s" Apr 22 17:34:57.346379 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.346303 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-899wv\" (UniqueName: \"kubernetes.io/projected/de748dd6-d39d-448f-bd35-1602c06041cc-kube-api-access-899wv\") pod \"kube-state-metrics-69db897b98-wn6cz\" (UID: \"de748dd6-d39d-448f-bd35-1602c06041cc\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-wn6cz" Apr 22 17:34:57.346379 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.346322 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/73c9b011-6e25-4fb7-88db-47782660f515-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9d44df66c-5z68s\" (UID: \"73c9b011-6e25-4fb7-88db-47782660f515\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-5z68s" Apr 22 17:34:57.346379 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.346338 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/95a6851e-a8cd-4616-b68e-e5b995ea6bd7-node-exporter-accelerators-collector-config\") pod \"node-exporter-z9pps\" (UID: \"95a6851e-a8cd-4616-b68e-e5b995ea6bd7\") " pod="openshift-monitoring/node-exporter-z9pps" Apr 22 17:34:57.346379 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.346376 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/de748dd6-d39d-448f-bd35-1602c06041cc-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-69db897b98-wn6cz\" (UID: \"de748dd6-d39d-448f-bd35-1602c06041cc\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-wn6cz" Apr 22 17:34:57.346574 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.346402 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tcsz\" (UniqueName: \"kubernetes.io/projected/73c9b011-6e25-4fb7-88db-47782660f515-kube-api-access-8tcsz\") pod \"openshift-state-metrics-9d44df66c-5z68s\" (UID: \"73c9b011-6e25-4fb7-88db-47782660f515\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-5z68s" Apr 22 17:34:57.346574 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.346418 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/95a6851e-a8cd-4616-b68e-e5b995ea6bd7-node-exporter-textfile\") pod \"node-exporter-z9pps\" (UID: \"95a6851e-a8cd-4616-b68e-e5b995ea6bd7\") " pod="openshift-monitoring/node-exporter-z9pps" Apr 22 17:34:57.346574 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.346436 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpmxz\" (UniqueName: \"kubernetes.io/projected/95a6851e-a8cd-4616-b68e-e5b995ea6bd7-kube-api-access-mpmxz\") pod \"node-exporter-z9pps\" (UID: \"95a6851e-a8cd-4616-b68e-e5b995ea6bd7\") " pod="openshift-monitoring/node-exporter-z9pps" Apr 22 17:34:57.346574 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.346454 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95a6851e-a8cd-4616-b68e-e5b995ea6bd7-metrics-client-ca\") pod \"node-exporter-z9pps\" (UID: \"95a6851e-a8cd-4616-b68e-e5b995ea6bd7\") " pod="openshift-monitoring/node-exporter-z9pps" Apr 22 17:34:57.346574 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.346475 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/de748dd6-d39d-448f-bd35-1602c06041cc-volume-directive-shadow\") pod \"kube-state-metrics-69db897b98-wn6cz\" (UID: \"de748dd6-d39d-448f-bd35-1602c06041cc\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-wn6cz" Apr 22 17:34:57.346574 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.346502 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/de748dd6-d39d-448f-bd35-1602c06041cc-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-69db897b98-wn6cz\" (UID: \"de748dd6-d39d-448f-bd35-1602c06041cc\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-wn6cz" Apr 22 17:34:57.447089 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.447001 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/95a6851e-a8cd-4616-b68e-e5b995ea6bd7-node-exporter-wtmp\") pod \"node-exporter-z9pps\" (UID: \"95a6851e-a8cd-4616-b68e-e5b995ea6bd7\") " pod="openshift-monitoring/node-exporter-z9pps" Apr 22 17:34:57.447089 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.447070 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de748dd6-d39d-448f-bd35-1602c06041cc-metrics-client-ca\") pod \"kube-state-metrics-69db897b98-wn6cz\" (UID: \"de748dd6-d39d-448f-bd35-1602c06041cc\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-wn6cz" Apr 22 17:34:57.447324 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.447099 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73c9b011-6e25-4fb7-88db-47782660f515-metrics-client-ca\") pod \"openshift-state-metrics-9d44df66c-5z68s\" (UID: \"73c9b011-6e25-4fb7-88db-47782660f515\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-5z68s" Apr 22 17:34:57.447324 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.447123 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/95a6851e-a8cd-4616-b68e-e5b995ea6bd7-root\") pod \"node-exporter-z9pps\" (UID: \"95a6851e-a8cd-4616-b68e-e5b995ea6bd7\") " pod="openshift-monitoring/node-exporter-z9pps" Apr 22 17:34:57.447324 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.447144 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/de748dd6-d39d-448f-bd35-1602c06041cc-kube-state-metrics-tls\") pod \"kube-state-metrics-69db897b98-wn6cz\" (UID: \"de748dd6-d39d-448f-bd35-1602c06041cc\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-wn6cz" Apr 22 17:34:57.447324 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.447202 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/95a6851e-a8cd-4616-b68e-e5b995ea6bd7-node-exporter-tls\") pod \"node-exporter-z9pps\" (UID: \"95a6851e-a8cd-4616-b68e-e5b995ea6bd7\") " pod="openshift-monitoring/node-exporter-z9pps" Apr 22 17:34:57.447324 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.447225 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/95a6851e-a8cd-4616-b68e-e5b995ea6bd7-node-exporter-wtmp\") pod \"node-exporter-z9pps\" (UID: \"95a6851e-a8cd-4616-b68e-e5b995ea6bd7\") " pod="openshift-monitoring/node-exporter-z9pps" Apr 22 17:34:57.447324 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.447241 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95a6851e-a8cd-4616-b68e-e5b995ea6bd7-sys\") pod \"node-exporter-z9pps\" (UID: \"95a6851e-a8cd-4616-b68e-e5b995ea6bd7\") " pod="openshift-monitoring/node-exporter-z9pps" Apr 22 17:34:57.447324 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.447266 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/95a6851e-a8cd-4616-b68e-e5b995ea6bd7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z9pps\" (UID: \"95a6851e-a8cd-4616-b68e-e5b995ea6bd7\") " pod="openshift-monitoring/node-exporter-z9pps" Apr 22 17:34:57.447324 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.447240 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/95a6851e-a8cd-4616-b68e-e5b995ea6bd7-root\") pod \"node-exporter-z9pps\" (UID: \"95a6851e-a8cd-4616-b68e-e5b995ea6bd7\") " pod="openshift-monitoring/node-exporter-z9pps" Apr 22 17:34:57.447324 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.447295 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95a6851e-a8cd-4616-b68e-e5b995ea6bd7-sys\") pod \"node-exporter-z9pps\" (UID: \"95a6851e-a8cd-4616-b68e-e5b995ea6bd7\") " pod="openshift-monitoring/node-exporter-z9pps" Apr 22 17:34:57.447727 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.447352 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/73c9b011-6e25-4fb7-88db-47782660f515-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9d44df66c-5z68s\" (UID: \"73c9b011-6e25-4fb7-88db-47782660f515\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-5z68s" Apr 22 17:34:57.447727 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.447384 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-899wv\" (UniqueName: \"kubernetes.io/projected/de748dd6-d39d-448f-bd35-1602c06041cc-kube-api-access-899wv\") pod \"kube-state-metrics-69db897b98-wn6cz\" (UID: \"de748dd6-d39d-448f-bd35-1602c06041cc\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-wn6cz" Apr 22 17:34:57.447727 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:57.447359 2576 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Apr 22 17:34:57.447727 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.447439 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/73c9b011-6e25-4fb7-88db-47782660f515-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9d44df66c-5z68s\" (UID: \"73c9b011-6e25-4fb7-88db-47782660f515\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-5z68s" Apr 22 17:34:57.447727 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.447469 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/95a6851e-a8cd-4616-b68e-e5b995ea6bd7-node-exporter-accelerators-collector-config\") pod \"node-exporter-z9pps\" (UID: \"95a6851e-a8cd-4616-b68e-e5b995ea6bd7\") " pod="openshift-monitoring/node-exporter-z9pps" Apr 22 17:34:57.447727 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:57.447487 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de748dd6-d39d-448f-bd35-1602c06041cc-kube-state-metrics-tls podName:de748dd6-d39d-448f-bd35-1602c06041cc nodeName:}" failed. No retries permitted until 2026-04-22 17:34:57.947464993 +0000 UTC m=+47.392028161 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/de748dd6-d39d-448f-bd35-1602c06041cc-kube-state-metrics-tls") pod "kube-state-metrics-69db897b98-wn6cz" (UID: "de748dd6-d39d-448f-bd35-1602c06041cc") : secret "kube-state-metrics-tls" not found Apr 22 17:34:57.447727 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.447533 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/de748dd6-d39d-448f-bd35-1602c06041cc-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-69db897b98-wn6cz\" (UID: \"de748dd6-d39d-448f-bd35-1602c06041cc\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-wn6cz" Apr 22 17:34:57.447727 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:57.447559 2576 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Apr 22 17:34:57.447727 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.447573 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8tcsz\" (UniqueName: \"kubernetes.io/projected/73c9b011-6e25-4fb7-88db-47782660f515-kube-api-access-8tcsz\") pod \"openshift-state-metrics-9d44df66c-5z68s\" (UID: \"73c9b011-6e25-4fb7-88db-47782660f515\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-5z68s" Apr 22 17:34:57.447727 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.447603 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/95a6851e-a8cd-4616-b68e-e5b995ea6bd7-node-exporter-textfile\") pod \"node-exporter-z9pps\" (UID: \"95a6851e-a8cd-4616-b68e-e5b995ea6bd7\") " pod="openshift-monitoring/node-exporter-z9pps" Apr 22 17:34:57.447727 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:57.447619 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73c9b011-6e25-4fb7-88db-47782660f515-openshift-state-metrics-tls podName:73c9b011-6e25-4fb7-88db-47782660f515 nodeName:}" failed. No retries permitted until 2026-04-22 17:34:57.947602356 +0000 UTC m=+47.392165518 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/73c9b011-6e25-4fb7-88db-47782660f515-openshift-state-metrics-tls") pod "openshift-state-metrics-9d44df66c-5z68s" (UID: "73c9b011-6e25-4fb7-88db-47782660f515") : secret "openshift-state-metrics-tls" not found Apr 22 17:34:57.447727 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.447652 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mpmxz\" (UniqueName: \"kubernetes.io/projected/95a6851e-a8cd-4616-b68e-e5b995ea6bd7-kube-api-access-mpmxz\") pod \"node-exporter-z9pps\" (UID: \"95a6851e-a8cd-4616-b68e-e5b995ea6bd7\") " pod="openshift-monitoring/node-exporter-z9pps" Apr 22 17:34:57.447727 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.447680 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95a6851e-a8cd-4616-b68e-e5b995ea6bd7-metrics-client-ca\") pod \"node-exporter-z9pps\" (UID: \"95a6851e-a8cd-4616-b68e-e5b995ea6bd7\") " pod="openshift-monitoring/node-exporter-z9pps" Apr 22 17:34:57.447727 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.447703 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/de748dd6-d39d-448f-bd35-1602c06041cc-volume-directive-shadow\") pod \"kube-state-metrics-69db897b98-wn6cz\" (UID: \"de748dd6-d39d-448f-bd35-1602c06041cc\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-wn6cz" Apr 22 17:34:57.448633 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.447745 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/de748dd6-d39d-448f-bd35-1602c06041cc-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-69db897b98-wn6cz\" (UID: \"de748dd6-d39d-448f-bd35-1602c06041cc\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-wn6cz" Apr 22 17:34:57.448633 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.448399 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/95a6851e-a8cd-4616-b68e-e5b995ea6bd7-node-exporter-textfile\") pod \"node-exporter-z9pps\" (UID: \"95a6851e-a8cd-4616-b68e-e5b995ea6bd7\") " pod="openshift-monitoring/node-exporter-z9pps" Apr 22 17:34:57.448633 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.448489 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73c9b011-6e25-4fb7-88db-47782660f515-metrics-client-ca\") pod \"openshift-state-metrics-9d44df66c-5z68s\" (UID: \"73c9b011-6e25-4fb7-88db-47782660f515\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-5z68s" Apr 22 17:34:57.448787 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.448686 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/de748dd6-d39d-448f-bd35-1602c06041cc-volume-directive-shadow\") pod \"kube-state-metrics-69db897b98-wn6cz\" (UID: \"de748dd6-d39d-448f-bd35-1602c06041cc\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-wn6cz" Apr 22 17:34:57.448787 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.448774 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/95a6851e-a8cd-4616-b68e-e5b995ea6bd7-node-exporter-accelerators-collector-config\") pod \"node-exporter-z9pps\" (UID: \"95a6851e-a8cd-4616-b68e-e5b995ea6bd7\") " pod="openshift-monitoring/node-exporter-z9pps" Apr 22 17:34:57.449274 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.449249 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95a6851e-a8cd-4616-b68e-e5b995ea6bd7-metrics-client-ca\") pod \"node-exporter-z9pps\" (UID: \"95a6851e-a8cd-4616-b68e-e5b995ea6bd7\") " pod="openshift-monitoring/node-exporter-z9pps" Apr 22 17:34:57.449381 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.449249 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/de748dd6-d39d-448f-bd35-1602c06041cc-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-69db897b98-wn6cz\" (UID: \"de748dd6-d39d-448f-bd35-1602c06041cc\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-wn6cz" Apr 22 17:34:57.449381 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.449328 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de748dd6-d39d-448f-bd35-1602c06041cc-metrics-client-ca\") pod \"kube-state-metrics-69db897b98-wn6cz\" (UID: \"de748dd6-d39d-448f-bd35-1602c06041cc\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-wn6cz" Apr 22 17:34:57.450075 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.450050 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/95a6851e-a8cd-4616-b68e-e5b995ea6bd7-node-exporter-tls\") pod \"node-exporter-z9pps\" (UID: \"95a6851e-a8cd-4616-b68e-e5b995ea6bd7\") " pod="openshift-monitoring/node-exporter-z9pps" Apr 22 17:34:57.450383 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.450364 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/95a6851e-a8cd-4616-b68e-e5b995ea6bd7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z9pps\" (UID: \"95a6851e-a8cd-4616-b68e-e5b995ea6bd7\") " pod="openshift-monitoring/node-exporter-z9pps" Apr 22 17:34:57.450539 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.450512 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/73c9b011-6e25-4fb7-88db-47782660f515-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9d44df66c-5z68s\" (UID: \"73c9b011-6e25-4fb7-88db-47782660f515\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-5z68s" Apr 22 17:34:57.450815 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.450797 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/de748dd6-d39d-448f-bd35-1602c06041cc-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-69db897b98-wn6cz\" (UID: \"de748dd6-d39d-448f-bd35-1602c06041cc\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-wn6cz" Apr 22 17:34:57.456532 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.456482 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tcsz\" (UniqueName: \"kubernetes.io/projected/73c9b011-6e25-4fb7-88db-47782660f515-kube-api-access-8tcsz\") pod \"openshift-state-metrics-9d44df66c-5z68s\" (UID: \"73c9b011-6e25-4fb7-88db-47782660f515\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-5z68s" Apr 22 17:34:57.456661 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.456540 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-899wv\" (UniqueName: \"kubernetes.io/projected/de748dd6-d39d-448f-bd35-1602c06041cc-kube-api-access-899wv\") pod \"kube-state-metrics-69db897b98-wn6cz\" (UID: \"de748dd6-d39d-448f-bd35-1602c06041cc\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-wn6cz" Apr 22 17:34:57.456661 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.456642 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpmxz\" (UniqueName: \"kubernetes.io/projected/95a6851e-a8cd-4616-b68e-e5b995ea6bd7-kube-api-access-mpmxz\") pod \"node-exporter-z9pps\" (UID: \"95a6851e-a8cd-4616-b68e-e5b995ea6bd7\") " pod="openshift-monitoring/node-exporter-z9pps" Apr 22 17:34:57.550769 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.550737 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-z9pps" Apr 22 17:34:57.559677 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:57.559643 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95a6851e_a8cd_4616_b68e_e5b995ea6bd7.slice/crio-b5fce1aafe4e3047c1c57f66f80f65108fcc89654ae61fb0737d76b197a1406e WatchSource:0}: Error finding container b5fce1aafe4e3047c1c57f66f80f65108fcc89654ae61fb0737d76b197a1406e: Status 404 returned error can't find the container with id b5fce1aafe4e3047c1c57f66f80f65108fcc89654ae61fb0737d76b197a1406e Apr 22 17:34:57.951796 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.951762 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/de748dd6-d39d-448f-bd35-1602c06041cc-kube-state-metrics-tls\") pod \"kube-state-metrics-69db897b98-wn6cz\" (UID: \"de748dd6-d39d-448f-bd35-1602c06041cc\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-wn6cz" Apr 22 17:34:57.952211 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.951820 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/73c9b011-6e25-4fb7-88db-47782660f515-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9d44df66c-5z68s\" (UID: \"73c9b011-6e25-4fb7-88db-47782660f515\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-5z68s" Apr 22 17:34:57.954491 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.954466 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/73c9b011-6e25-4fb7-88db-47782660f515-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9d44df66c-5z68s\" (UID: \"73c9b011-6e25-4fb7-88db-47782660f515\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-5z68s" Apr 22 17:34:57.954651 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:57.954469 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/de748dd6-d39d-448f-bd35-1602c06041cc-kube-state-metrics-tls\") pod \"kube-state-metrics-69db897b98-wn6cz\" (UID: \"de748dd6-d39d-448f-bd35-1602c06041cc\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-wn6cz" Apr 22 17:34:58.096985 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:58.096945 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9d44df66c-5z68s" Apr 22 17:34:58.118825 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:58.118794 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-69db897b98-wn6cz" Apr 22 17:34:58.255114 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:58.255043 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9d44df66c-5z68s"] Apr 22 17:34:58.263110 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:58.263073 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73c9b011_6e25_4fb7_88db_47782660f515.slice/crio-fdc03e1a51da471d6ebc84cb35145aeb34dd98a724c741d118c4bca693a38165 WatchSource:0}: Error finding container fdc03e1a51da471d6ebc84cb35145aeb34dd98a724c741d118c4bca693a38165: Status 404 returned error can't find the container with id fdc03e1a51da471d6ebc84cb35145aeb34dd98a724c741d118c4bca693a38165 Apr 22 17:34:58.279480 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:58.279456 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Apr 22 17:34:58.284022 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:58.284001 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:34:58.286650 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:58.286630 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Apr 22 17:34:58.286872 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:58.286854 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Apr 22 17:34:58.287257 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:58.287235 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Apr 22 17:34:58.287462 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:58.287444 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Apr 22 17:34:58.287697 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:58.287678 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Apr 22 17:34:58.287851 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:58.287839 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Apr 22 17:34:58.287972 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:58.287953 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-69db897b98-wn6cz"] Apr 22 17:34:58.288007 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:58.287985 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Apr 22 17:34:58.288236 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:58.288217 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-gjcbn\"" Apr 22 17:34:58.288847 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:58.288510 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Apr 22 17:34:58.288847 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:58.288704 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Apr 22 17:34:58.293309 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:34:58.293283 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde748dd6_d39d_448f_bd35_1602c06041cc.slice/crio-5b633dd8069cbe6cff8bf2b1ac792d3de0a3d413590936292e0bda995dfbd68d WatchSource:0}: Error finding container 5b633dd8069cbe6cff8bf2b1ac792d3de0a3d413590936292e0bda995dfbd68d: Status 404 returned error can't find the container with id 5b633dd8069cbe6cff8bf2b1ac792d3de0a3d413590936292e0bda995dfbd68d Apr 22 17:34:58.295532 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:58.295489 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Apr 22 17:34:58.367752 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:58.363438 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z9pps" event={"ID":"95a6851e-a8cd-4616-b68e-e5b995ea6bd7","Type":"ContainerStarted","Data":"b5fce1aafe4e3047c1c57f66f80f65108fcc89654ae61fb0737d76b197a1406e"} Apr 22 17:34:58.367752 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:58.364571 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-69db897b98-wn6cz" event={"ID":"de748dd6-d39d-448f-bd35-1602c06041cc","Type":"ContainerStarted","Data":"5b633dd8069cbe6cff8bf2b1ac792d3de0a3d413590936292e0bda995dfbd68d"} Apr 22 17:34:58.367752 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:58.366125 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9d44df66c-5z68s" event={"ID":"73c9b011-6e25-4fb7-88db-47782660f515","Type":"ContainerStarted","Data":"a17cd3fbbccbab6635b3c905f3e3c4196bd73266e7587218b14ee612610f088a"} Apr 22 17:34:58.367752 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:58.366154 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9d44df66c-5z68s" event={"ID":"73c9b011-6e25-4fb7-88db-47782660f515","Type":"ContainerStarted","Data":"fdc03e1a51da471d6ebc84cb35145aeb34dd98a724c741d118c4bca693a38165"} Apr 22 17:34:58.457295 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:58.457256 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/199c16a5-4ca0-4ffc-85d7-049b85038db0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"199c16a5-4ca0-4ffc-85d7-049b85038db0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:34:58.457434 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:58.457339 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/199c16a5-4ca0-4ffc-85d7-049b85038db0-config-out\") pod \"alertmanager-main-0\" (UID: \"199c16a5-4ca0-4ffc-85d7-049b85038db0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:34:58.457434 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:58.457408 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/199c16a5-4ca0-4ffc-85d7-049b85038db0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"199c16a5-4ca0-4ffc-85d7-049b85038db0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:34:58.457595 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:58.457484 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/199c16a5-4ca0-4ffc-85d7-049b85038db0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"199c16a5-4ca0-4ffc-85d7-049b85038db0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:34:58.457595 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:58.457528 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/199c16a5-4ca0-4ffc-85d7-049b85038db0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"199c16a5-4ca0-4ffc-85d7-049b85038db0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:34:58.457595 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:58.457565 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdmkt\" (UniqueName: \"kubernetes.io/projected/199c16a5-4ca0-4ffc-85d7-049b85038db0-kube-api-access-zdmkt\") pod \"alertmanager-main-0\" (UID: \"199c16a5-4ca0-4ffc-85d7-049b85038db0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:34:58.457748 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:58.457625 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/199c16a5-4ca0-4ffc-85d7-049b85038db0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"199c16a5-4ca0-4ffc-85d7-049b85038db0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:34:58.457748 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:58.457670 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/199c16a5-4ca0-4ffc-85d7-049b85038db0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"199c16a5-4ca0-4ffc-85d7-049b85038db0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:34:58.457748 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:58.457705 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/199c16a5-4ca0-4ffc-85d7-049b85038db0-config-volume\") pod \"alertmanager-main-0\" (UID: \"199c16a5-4ca0-4ffc-85d7-049b85038db0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:34:58.457748 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:58.457731 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/199c16a5-4ca0-4ffc-85d7-049b85038db0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"199c16a5-4ca0-4ffc-85d7-049b85038db0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:34:58.457886 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:58.457782 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/199c16a5-4ca0-4ffc-85d7-049b85038db0-web-config\") pod \"alertmanager-main-0\" (UID: \"199c16a5-4ca0-4ffc-85d7-049b85038db0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:34:58.457886 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:58.457824 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/199c16a5-4ca0-4ffc-85d7-049b85038db0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"199c16a5-4ca0-4ffc-85d7-049b85038db0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:34:58.457886 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:58.457849 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/199c16a5-4ca0-4ffc-85d7-049b85038db0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"199c16a5-4ca0-4ffc-85d7-049b85038db0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:34:58.559054 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:58.559027 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/199c16a5-4ca0-4ffc-85d7-049b85038db0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"199c16a5-4ca0-4ffc-85d7-049b85038db0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:34:58.559222 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:58.559068 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/199c16a5-4ca0-4ffc-85d7-049b85038db0-web-config\") pod \"alertmanager-main-0\" (UID: \"199c16a5-4ca0-4ffc-85d7-049b85038db0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:34:58.559222 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:58.559095 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/199c16a5-4ca0-4ffc-85d7-049b85038db0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"199c16a5-4ca0-4ffc-85d7-049b85038db0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:34:58.559222 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:58.559119 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/199c16a5-4ca0-4ffc-85d7-049b85038db0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"199c16a5-4ca0-4ffc-85d7-049b85038db0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:34:58.559366 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:58.559240 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/199c16a5-4ca0-4ffc-85d7-049b85038db0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"199c16a5-4ca0-4ffc-85d7-049b85038db0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:34:58.559366 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:58.559293 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/199c16a5-4ca0-4ffc-85d7-049b85038db0-config-out\") pod \"alertmanager-main-0\" (UID: \"199c16a5-4ca0-4ffc-85d7-049b85038db0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:34:58.559469 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:58.559291 2576 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Apr 22 17:34:58.559469 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:58.559327 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/199c16a5-4ca0-4ffc-85d7-049b85038db0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"199c16a5-4ca0-4ffc-85d7-049b85038db0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:34:58.559469 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:34:58.559469 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/199c16a5-4ca0-4ffc-85d7-049b85038db0-secret-alertmanager-main-tls podName:199c16a5-4ca0-4ffc-85d7-049b85038db0 nodeName:}" failed. No retries permitted until 2026-04-22 17:34:59.059431317 +0000 UTC m=+48.503994498 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/199c16a5-4ca0-4ffc-85d7-049b85038db0-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "199c16a5-4ca0-4ffc-85d7-049b85038db0") : secret "alertmanager-main-tls" not found Apr 22 17:34:58.559624 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:58.559505 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/199c16a5-4ca0-4ffc-85d7-049b85038db0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"199c16a5-4ca0-4ffc-85d7-049b85038db0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:34:58.559624 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:58.559535 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/199c16a5-4ca0-4ffc-85d7-049b85038db0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"199c16a5-4ca0-4ffc-85d7-049b85038db0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:34:58.559624 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:58.559555 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zdmkt\" (UniqueName: \"kubernetes.io/projected/199c16a5-4ca0-4ffc-85d7-049b85038db0-kube-api-access-zdmkt\") pod \"alertmanager-main-0\" (UID: \"199c16a5-4ca0-4ffc-85d7-049b85038db0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:34:58.559624 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:58.559608 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/199c16a5-4ca0-4ffc-85d7-049b85038db0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"199c16a5-4ca0-4ffc-85d7-049b85038db0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:34:58.559802 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:58.559654 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/199c16a5-4ca0-4ffc-85d7-049b85038db0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"199c16a5-4ca0-4ffc-85d7-049b85038db0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:34:58.559802 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:58.559689 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/199c16a5-4ca0-4ffc-85d7-049b85038db0-config-volume\") pod \"alertmanager-main-0\" (UID: \"199c16a5-4ca0-4ffc-85d7-049b85038db0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:34:58.560115 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:58.560074 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/199c16a5-4ca0-4ffc-85d7-049b85038db0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"199c16a5-4ca0-4ffc-85d7-049b85038db0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:34:58.561151 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:58.560862 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/199c16a5-4ca0-4ffc-85d7-049b85038db0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"199c16a5-4ca0-4ffc-85d7-049b85038db0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:34:58.561151 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:58.561104 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/199c16a5-4ca0-4ffc-85d7-049b85038db0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"199c16a5-4ca0-4ffc-85d7-049b85038db0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:34:58.562128 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:58.561868 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/199c16a5-4ca0-4ffc-85d7-049b85038db0-config-out\") pod \"alertmanager-main-0\" (UID: \"199c16a5-4ca0-4ffc-85d7-049b85038db0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:34:58.562279 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:58.562255 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/199c16a5-4ca0-4ffc-85d7-049b85038db0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"199c16a5-4ca0-4ffc-85d7-049b85038db0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:34:58.562744 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:58.562696 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/199c16a5-4ca0-4ffc-85d7-049b85038db0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"199c16a5-4ca0-4ffc-85d7-049b85038db0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:34:58.563754 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:58.563716 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/199c16a5-4ca0-4ffc-85d7-049b85038db0-web-config\") pod \"alertmanager-main-0\" (UID: \"199c16a5-4ca0-4ffc-85d7-049b85038db0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:34:58.563754 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:58.563723 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/199c16a5-4ca0-4ffc-85d7-049b85038db0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"199c16a5-4ca0-4ffc-85d7-049b85038db0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:34:58.563994 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:58.563971 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/199c16a5-4ca0-4ffc-85d7-049b85038db0-config-volume\") pod \"alertmanager-main-0\" (UID: \"199c16a5-4ca0-4ffc-85d7-049b85038db0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:34:58.564381 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:58.564359 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/199c16a5-4ca0-4ffc-85d7-049b85038db0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"199c16a5-4ca0-4ffc-85d7-049b85038db0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:34:58.564499 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:58.564482 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/199c16a5-4ca0-4ffc-85d7-049b85038db0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"199c16a5-4ca0-4ffc-85d7-049b85038db0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:34:58.567988 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:58.567969 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdmkt\" (UniqueName: \"kubernetes.io/projected/199c16a5-4ca0-4ffc-85d7-049b85038db0-kube-api-access-zdmkt\") pod \"alertmanager-main-0\" (UID: \"199c16a5-4ca0-4ffc-85d7-049b85038db0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:34:59.064522 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:59.064483 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/199c16a5-4ca0-4ffc-85d7-049b85038db0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"199c16a5-4ca0-4ffc-85d7-049b85038db0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:34:59.067562 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:59.067533 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/199c16a5-4ca0-4ffc-85d7-049b85038db0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"199c16a5-4ca0-4ffc-85d7-049b85038db0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:34:59.211856 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:59.211812 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:34:59.274499 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:59.274468 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5bfbf857f6-2p9lx"] Apr 22 17:34:59.281605 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:59.281578 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5bfbf857f6-2p9lx" Apr 22 17:34:59.284576 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:59.284327 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Apr 22 17:34:59.284576 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:59.284377 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-e7i83ou7rsg65\"" Apr 22 17:34:59.284576 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:59.284406 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Apr 22 17:34:59.284576 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:59.284334 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-ndzfq\"" Apr 22 17:34:59.284902 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:59.284650 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Apr 22 17:34:59.284902 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:59.284875 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Apr 22 17:34:59.285098 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:59.285061 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Apr 22 17:34:59.290735 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:59.290694 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5bfbf857f6-2p9lx"] Apr 22 17:34:59.325710 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:59.325626 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-cdrtz" Apr 22 17:34:59.366842 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:59.366809 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Apr 22 17:34:59.371560 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:59.369906 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/058893ce-7657-414f-874b-f5aed2040e2c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5bfbf857f6-2p9lx\" (UID: \"058893ce-7657-414f-874b-f5aed2040e2c\") " pod="openshift-monitoring/thanos-querier-5bfbf857f6-2p9lx" Apr 22 17:34:59.371769 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:59.371749 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/058893ce-7657-414f-874b-f5aed2040e2c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5bfbf857f6-2p9lx\" (UID: \"058893ce-7657-414f-874b-f5aed2040e2c\") " pod="openshift-monitoring/thanos-querier-5bfbf857f6-2p9lx" Apr 22 17:34:59.372053 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:59.372033 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/058893ce-7657-414f-874b-f5aed2040e2c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5bfbf857f6-2p9lx\" (UID: \"058893ce-7657-414f-874b-f5aed2040e2c\") " pod="openshift-monitoring/thanos-querier-5bfbf857f6-2p9lx" Apr 22 17:34:59.372627 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:59.372607 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/058893ce-7657-414f-874b-f5aed2040e2c-metrics-client-ca\") pod \"thanos-querier-5bfbf857f6-2p9lx\" (UID: \"058893ce-7657-414f-874b-f5aed2040e2c\") " pod="openshift-monitoring/thanos-querier-5bfbf857f6-2p9lx" Apr 22 17:34:59.373602 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:59.373316 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/058893ce-7657-414f-874b-f5aed2040e2c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5bfbf857f6-2p9lx\" (UID: \"058893ce-7657-414f-874b-f5aed2040e2c\") " pod="openshift-monitoring/thanos-querier-5bfbf857f6-2p9lx" Apr 22 17:34:59.373602 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:59.373377 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/058893ce-7657-414f-874b-f5aed2040e2c-secret-grpc-tls\") pod \"thanos-querier-5bfbf857f6-2p9lx\" (UID: \"058893ce-7657-414f-874b-f5aed2040e2c\") " pod="openshift-monitoring/thanos-querier-5bfbf857f6-2p9lx" Apr 22 17:34:59.373602 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:59.373401 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drgpq\" (UniqueName: \"kubernetes.io/projected/058893ce-7657-414f-874b-f5aed2040e2c-kube-api-access-drgpq\") pod \"thanos-querier-5bfbf857f6-2p9lx\" (UID: \"058893ce-7657-414f-874b-f5aed2040e2c\") " pod="openshift-monitoring/thanos-querier-5bfbf857f6-2p9lx" Apr 22 17:34:59.373602 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:59.373439 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/058893ce-7657-414f-874b-f5aed2040e2c-secret-thanos-querier-tls\") pod \"thanos-querier-5bfbf857f6-2p9lx\" (UID: \"058893ce-7657-414f-874b-f5aed2040e2c\") " pod="openshift-monitoring/thanos-querier-5bfbf857f6-2p9lx" Apr 22 17:34:59.376393 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:59.376364 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9d44df66c-5z68s" event={"ID":"73c9b011-6e25-4fb7-88db-47782660f515","Type":"ContainerStarted","Data":"718956da4954c1cc790299cccd2cc6d110e46066c99703824a3d18cfc422ee02"} Apr 22 17:34:59.378757 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:59.378727 2576 generic.go:358] "Generic (PLEG): container finished" podID="95a6851e-a8cd-4616-b68e-e5b995ea6bd7" containerID="7a049c051082d2045826ec9b1223b0ea9a9676cc0f3efbef2795c76109fcd581" exitCode=0 Apr 22 17:34:59.378858 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:59.378807 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z9pps" event={"ID":"95a6851e-a8cd-4616-b68e-e5b995ea6bd7","Type":"ContainerDied","Data":"7a049c051082d2045826ec9b1223b0ea9a9676cc0f3efbef2795c76109fcd581"} Apr 22 17:34:59.477865 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:59.476603 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/058893ce-7657-414f-874b-f5aed2040e2c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5bfbf857f6-2p9lx\" (UID: \"058893ce-7657-414f-874b-f5aed2040e2c\") " pod="openshift-monitoring/thanos-querier-5bfbf857f6-2p9lx" Apr 22 17:34:59.477865 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:59.476674 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/058893ce-7657-414f-874b-f5aed2040e2c-secret-grpc-tls\") pod \"thanos-querier-5bfbf857f6-2p9lx\" (UID: \"058893ce-7657-414f-874b-f5aed2040e2c\") " pod="openshift-monitoring/thanos-querier-5bfbf857f6-2p9lx" Apr 22 17:34:59.477865 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:59.476700 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-drgpq\" (UniqueName: \"kubernetes.io/projected/058893ce-7657-414f-874b-f5aed2040e2c-kube-api-access-drgpq\") pod \"thanos-querier-5bfbf857f6-2p9lx\" (UID: \"058893ce-7657-414f-874b-f5aed2040e2c\") " pod="openshift-monitoring/thanos-querier-5bfbf857f6-2p9lx" Apr 22 17:34:59.477865 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:59.476750 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/058893ce-7657-414f-874b-f5aed2040e2c-secret-thanos-querier-tls\") pod \"thanos-querier-5bfbf857f6-2p9lx\" (UID: \"058893ce-7657-414f-874b-f5aed2040e2c\") " pod="openshift-monitoring/thanos-querier-5bfbf857f6-2p9lx" Apr 22 17:34:59.477865 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:59.476791 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/058893ce-7657-414f-874b-f5aed2040e2c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5bfbf857f6-2p9lx\" (UID: \"058893ce-7657-414f-874b-f5aed2040e2c\") " pod="openshift-monitoring/thanos-querier-5bfbf857f6-2p9lx" Apr 22 17:34:59.477865 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:59.476818 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/058893ce-7657-414f-874b-f5aed2040e2c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5bfbf857f6-2p9lx\" (UID: \"058893ce-7657-414f-874b-f5aed2040e2c\") " pod="openshift-monitoring/thanos-querier-5bfbf857f6-2p9lx" Apr 22 17:34:59.477865 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:59.476878 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/058893ce-7657-414f-874b-f5aed2040e2c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5bfbf857f6-2p9lx\" (UID: \"058893ce-7657-414f-874b-f5aed2040e2c\") " pod="openshift-monitoring/thanos-querier-5bfbf857f6-2p9lx" Apr 22 17:34:59.477865 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:59.476908 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/058893ce-7657-414f-874b-f5aed2040e2c-metrics-client-ca\") pod \"thanos-querier-5bfbf857f6-2p9lx\" (UID: \"058893ce-7657-414f-874b-f5aed2040e2c\") " pod="openshift-monitoring/thanos-querier-5bfbf857f6-2p9lx" Apr 22 17:34:59.481030 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:59.479973 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/058893ce-7657-414f-874b-f5aed2040e2c-metrics-client-ca\") pod \"thanos-querier-5bfbf857f6-2p9lx\" (UID: \"058893ce-7657-414f-874b-f5aed2040e2c\") " pod="openshift-monitoring/thanos-querier-5bfbf857f6-2p9lx" Apr 22 17:34:59.496986 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:59.496923 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/058893ce-7657-414f-874b-f5aed2040e2c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5bfbf857f6-2p9lx\" (UID: \"058893ce-7657-414f-874b-f5aed2040e2c\") " pod="openshift-monitoring/thanos-querier-5bfbf857f6-2p9lx" Apr 22 17:34:59.497393 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:59.497368 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/058893ce-7657-414f-874b-f5aed2040e2c-secret-grpc-tls\") pod \"thanos-querier-5bfbf857f6-2p9lx\" (UID: \"058893ce-7657-414f-874b-f5aed2040e2c\") " pod="openshift-monitoring/thanos-querier-5bfbf857f6-2p9lx" Apr 22 17:34:59.497763 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:59.497729 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/058893ce-7657-414f-874b-f5aed2040e2c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5bfbf857f6-2p9lx\" (UID: \"058893ce-7657-414f-874b-f5aed2040e2c\") " pod="openshift-monitoring/thanos-querier-5bfbf857f6-2p9lx" Apr 22 17:34:59.498863 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:59.498817 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/058893ce-7657-414f-874b-f5aed2040e2c-secret-thanos-querier-tls\") pod \"thanos-querier-5bfbf857f6-2p9lx\" (UID: \"058893ce-7657-414f-874b-f5aed2040e2c\") " pod="openshift-monitoring/thanos-querier-5bfbf857f6-2p9lx" Apr 22 17:34:59.498964 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:59.498938 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/058893ce-7657-414f-874b-f5aed2040e2c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5bfbf857f6-2p9lx\" (UID: \"058893ce-7657-414f-874b-f5aed2040e2c\") " pod="openshift-monitoring/thanos-querier-5bfbf857f6-2p9lx" Apr 22 17:34:59.499108 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:59.499066 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-drgpq\" (UniqueName: \"kubernetes.io/projected/058893ce-7657-414f-874b-f5aed2040e2c-kube-api-access-drgpq\") pod \"thanos-querier-5bfbf857f6-2p9lx\" (UID: \"058893ce-7657-414f-874b-f5aed2040e2c\") " pod="openshift-monitoring/thanos-querier-5bfbf857f6-2p9lx" Apr 22 17:34:59.499709 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:59.499689 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/058893ce-7657-414f-874b-f5aed2040e2c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5bfbf857f6-2p9lx\" (UID: \"058893ce-7657-414f-874b-f5aed2040e2c\") " pod="openshift-monitoring/thanos-querier-5bfbf857f6-2p9lx" Apr 22 17:34:59.593087 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:34:59.592996 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5bfbf857f6-2p9lx" Apr 22 17:35:00.169158 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:00.169037 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5bfbf857f6-2p9lx"] Apr 22 17:35:00.174099 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:35:00.174065 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod058893ce_7657_414f_874b_f5aed2040e2c.slice/crio-5ee979e0a0f81c354f46229c2ec7ad487dbca99db474b57453456a4c7827e91f WatchSource:0}: Error finding container 5ee979e0a0f81c354f46229c2ec7ad487dbca99db474b57453456a4c7827e91f: Status 404 returned error can't find the container with id 5ee979e0a0f81c354f46229c2ec7ad487dbca99db474b57453456a4c7827e91f Apr 22 17:35:00.385056 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:00.385015 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bfbf857f6-2p9lx" event={"ID":"058893ce-7657-414f-874b-f5aed2040e2c","Type":"ContainerStarted","Data":"5ee979e0a0f81c354f46229c2ec7ad487dbca99db474b57453456a4c7827e91f"} Apr 22 17:35:00.386826 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:00.386778 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"199c16a5-4ca0-4ffc-85d7-049b85038db0","Type":"ContainerStarted","Data":"a6919cecb13b52f55fd0075a3d43358aa2e589ec356e224501beaff167d6ecd3"} Apr 22 17:35:00.392405 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:00.392373 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-69db897b98-wn6cz" event={"ID":"de748dd6-d39d-448f-bd35-1602c06041cc","Type":"ContainerStarted","Data":"2a00440c8380a973edd63e3a20c6f8de22e4ad6228bce020137978bc7744d8dd"} Apr 22 17:35:00.392405 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:00.392407 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-69db897b98-wn6cz" event={"ID":"de748dd6-d39d-448f-bd35-1602c06041cc","Type":"ContainerStarted","Data":"12cf2d26e69b94870937c94aaa52acc53f6565fb34d20666757cb21ca8d05599"} Apr 22 17:35:00.392611 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:00.392421 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-69db897b98-wn6cz" event={"ID":"de748dd6-d39d-448f-bd35-1602c06041cc","Type":"ContainerStarted","Data":"71686070f92e1023ecb3ca3d578a3521729af9a054e0c803339089a1207c64e1"} Apr 22 17:35:00.394899 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:00.394867 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9d44df66c-5z68s" event={"ID":"73c9b011-6e25-4fb7-88db-47782660f515","Type":"ContainerStarted","Data":"a0618cbf682568b2e2d8e836d20c811f2113c6832da03960683d1a4991bff7aa"} Apr 22 17:35:00.397966 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:00.397373 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z9pps" event={"ID":"95a6851e-a8cd-4616-b68e-e5b995ea6bd7","Type":"ContainerStarted","Data":"9040df946c8cbd4c234c0165bb12f062199248be2266f7f41a0dd1ea420633b1"} Apr 22 17:35:00.397966 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:00.397428 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z9pps" event={"ID":"95a6851e-a8cd-4616-b68e-e5b995ea6bd7","Type":"ContainerStarted","Data":"b40cdae92cdffbfe630c7cda2fe0e94cf4a03ab9b4645732f32bef62dcb1f226"} Apr 22 17:35:00.412549 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:00.412498 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-69db897b98-wn6cz" podStartSLOduration=1.697877642 podStartE2EDuration="3.412483623s" podCreationTimestamp="2026-04-22 17:34:57 +0000 UTC" firstStartedPulling="2026-04-22 17:34:58.29582098 +0000 UTC m=+47.740384141" lastFinishedPulling="2026-04-22 17:35:00.010426961 +0000 UTC m=+49.454990122" observedRunningTime="2026-04-22 17:35:00.4111228 +0000 UTC m=+49.855685987" watchObservedRunningTime="2026-04-22 17:35:00.412483623 +0000 UTC m=+49.857046801" Apr 22 17:35:00.429494 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:00.429398 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9d44df66c-5z68s" podStartSLOduration=1.947021152 podStartE2EDuration="3.429380658s" podCreationTimestamp="2026-04-22 17:34:57 +0000 UTC" firstStartedPulling="2026-04-22 17:34:58.525076645 +0000 UTC m=+47.969639814" lastFinishedPulling="2026-04-22 17:35:00.007436157 +0000 UTC m=+49.451999320" observedRunningTime="2026-04-22 17:35:00.427884586 +0000 UTC m=+49.872447770" watchObservedRunningTime="2026-04-22 17:35:00.429380658 +0000 UTC m=+49.873943843" Apr 22 17:35:00.445409 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:00.445357 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-z9pps" podStartSLOduration=2.497451988 podStartE2EDuration="3.445340632s" podCreationTimestamp="2026-04-22 17:34:57 +0000 UTC" firstStartedPulling="2026-04-22 17:34:57.56194219 +0000 UTC m=+47.006505352" lastFinishedPulling="2026-04-22 17:34:58.509830832 +0000 UTC m=+47.954393996" observedRunningTime="2026-04-22 17:35:00.444466402 +0000 UTC m=+49.889029587" watchObservedRunningTime="2026-04-22 17:35:00.445340632 +0000 UTC m=+49.889903815" Apr 22 17:35:01.401193 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:01.401088 2576 generic.go:358] "Generic (PLEG): container finished" podID="199c16a5-4ca0-4ffc-85d7-049b85038db0" containerID="614e974ec1594a23e9d31b853236dbaaea9528e65eeb3140498e7724c4410342" exitCode=0 Apr 22 17:35:01.401612 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:01.401195 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"199c16a5-4ca0-4ffc-85d7-049b85038db0","Type":"ContainerDied","Data":"614e974ec1594a23e9d31b853236dbaaea9528e65eeb3140498e7724c4410342"} Apr 22 17:35:01.584745 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:01.584704 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-c765d567f-47zkv"] Apr 22 17:35:01.604457 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:01.604420 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-c765d567f-47zkv"] Apr 22 17:35:01.604604 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:01.604551 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-c765d567f-47zkv" Apr 22 17:35:01.607155 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:01.607125 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-qcf89\"" Apr 22 17:35:01.607306 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:01.607126 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Apr 22 17:35:01.607306 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:01.607128 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Apr 22 17:35:01.607306 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:01.607129 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Apr 22 17:35:01.607306 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:01.607133 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Apr 22 17:35:01.607306 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:01.607137 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-8qvvqi5oiccn9\"" Apr 22 17:35:01.700495 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:01.700397 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6aaaecf2-7fa0-4f32-be14-4350ca401d77-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-c765d567f-47zkv\" (UID: \"6aaaecf2-7fa0-4f32-be14-4350ca401d77\") " pod="openshift-monitoring/metrics-server-c765d567f-47zkv" Apr 22 17:35:01.700495 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:01.700462 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/6aaaecf2-7fa0-4f32-be14-4350ca401d77-secret-metrics-server-tls\") pod \"metrics-server-c765d567f-47zkv\" (UID: \"6aaaecf2-7fa0-4f32-be14-4350ca401d77\") " pod="openshift-monitoring/metrics-server-c765d567f-47zkv" Apr 22 17:35:01.700728 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:01.700584 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/6aaaecf2-7fa0-4f32-be14-4350ca401d77-secret-metrics-server-client-certs\") pod \"metrics-server-c765d567f-47zkv\" (UID: \"6aaaecf2-7fa0-4f32-be14-4350ca401d77\") " pod="openshift-monitoring/metrics-server-c765d567f-47zkv" Apr 22 17:35:01.700728 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:01.700640 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/6aaaecf2-7fa0-4f32-be14-4350ca401d77-metrics-server-audit-profiles\") pod \"metrics-server-c765d567f-47zkv\" (UID: \"6aaaecf2-7fa0-4f32-be14-4350ca401d77\") " pod="openshift-monitoring/metrics-server-c765d567f-47zkv" Apr 22 17:35:01.700728 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:01.700673 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/6aaaecf2-7fa0-4f32-be14-4350ca401d77-audit-log\") pod \"metrics-server-c765d567f-47zkv\" (UID: \"6aaaecf2-7fa0-4f32-be14-4350ca401d77\") " pod="openshift-monitoring/metrics-server-c765d567f-47zkv" Apr 22 17:35:01.700728 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:01.700695 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6aaaecf2-7fa0-4f32-be14-4350ca401d77-client-ca-bundle\") pod \"metrics-server-c765d567f-47zkv\" (UID: \"6aaaecf2-7fa0-4f32-be14-4350ca401d77\") " pod="openshift-monitoring/metrics-server-c765d567f-47zkv" Apr 22 17:35:01.700728 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:01.700717 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4k9gl\" (UniqueName: \"kubernetes.io/projected/6aaaecf2-7fa0-4f32-be14-4350ca401d77-kube-api-access-4k9gl\") pod \"metrics-server-c765d567f-47zkv\" (UID: \"6aaaecf2-7fa0-4f32-be14-4350ca401d77\") " pod="openshift-monitoring/metrics-server-c765d567f-47zkv" Apr 22 17:35:01.801633 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:01.801591 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6aaaecf2-7fa0-4f32-be14-4350ca401d77-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-c765d567f-47zkv\" (UID: \"6aaaecf2-7fa0-4f32-be14-4350ca401d77\") " pod="openshift-monitoring/metrics-server-c765d567f-47zkv" Apr 22 17:35:01.801849 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:01.801664 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/6aaaecf2-7fa0-4f32-be14-4350ca401d77-secret-metrics-server-tls\") pod \"metrics-server-c765d567f-47zkv\" (UID: \"6aaaecf2-7fa0-4f32-be14-4350ca401d77\") " pod="openshift-monitoring/metrics-server-c765d567f-47zkv" Apr 22 17:35:01.801849 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:01.801727 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/6aaaecf2-7fa0-4f32-be14-4350ca401d77-secret-metrics-server-client-certs\") pod \"metrics-server-c765d567f-47zkv\" (UID: \"6aaaecf2-7fa0-4f32-be14-4350ca401d77\") " pod="openshift-monitoring/metrics-server-c765d567f-47zkv" Apr 22 17:35:01.801849 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:01.801777 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/6aaaecf2-7fa0-4f32-be14-4350ca401d77-metrics-server-audit-profiles\") pod \"metrics-server-c765d567f-47zkv\" (UID: \"6aaaecf2-7fa0-4f32-be14-4350ca401d77\") " pod="openshift-monitoring/metrics-server-c765d567f-47zkv" Apr 22 17:35:01.801849 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:01.801804 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/6aaaecf2-7fa0-4f32-be14-4350ca401d77-audit-log\") pod \"metrics-server-c765d567f-47zkv\" (UID: \"6aaaecf2-7fa0-4f32-be14-4350ca401d77\") " pod="openshift-monitoring/metrics-server-c765d567f-47zkv" Apr 22 17:35:01.801849 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:01.801826 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6aaaecf2-7fa0-4f32-be14-4350ca401d77-client-ca-bundle\") pod \"metrics-server-c765d567f-47zkv\" (UID: \"6aaaecf2-7fa0-4f32-be14-4350ca401d77\") " pod="openshift-monitoring/metrics-server-c765d567f-47zkv" Apr 22 17:35:01.801849 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:01.801848 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4k9gl\" (UniqueName: \"kubernetes.io/projected/6aaaecf2-7fa0-4f32-be14-4350ca401d77-kube-api-access-4k9gl\") pod \"metrics-server-c765d567f-47zkv\" (UID: \"6aaaecf2-7fa0-4f32-be14-4350ca401d77\") " pod="openshift-monitoring/metrics-server-c765d567f-47zkv" Apr 22 17:35:01.802357 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:01.802321 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/6aaaecf2-7fa0-4f32-be14-4350ca401d77-audit-log\") pod \"metrics-server-c765d567f-47zkv\" (UID: \"6aaaecf2-7fa0-4f32-be14-4350ca401d77\") " pod="openshift-monitoring/metrics-server-c765d567f-47zkv" Apr 22 17:35:01.802653 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:01.802418 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6aaaecf2-7fa0-4f32-be14-4350ca401d77-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-c765d567f-47zkv\" (UID: \"6aaaecf2-7fa0-4f32-be14-4350ca401d77\") " pod="openshift-monitoring/metrics-server-c765d567f-47zkv" Apr 22 17:35:01.803236 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:01.803207 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/6aaaecf2-7fa0-4f32-be14-4350ca401d77-metrics-server-audit-profiles\") pod \"metrics-server-c765d567f-47zkv\" (UID: \"6aaaecf2-7fa0-4f32-be14-4350ca401d77\") " pod="openshift-monitoring/metrics-server-c765d567f-47zkv" Apr 22 17:35:01.804285 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:01.804261 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/6aaaecf2-7fa0-4f32-be14-4350ca401d77-secret-metrics-server-tls\") pod \"metrics-server-c765d567f-47zkv\" (UID: \"6aaaecf2-7fa0-4f32-be14-4350ca401d77\") " pod="openshift-monitoring/metrics-server-c765d567f-47zkv" Apr 22 17:35:01.804601 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:01.804579 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6aaaecf2-7fa0-4f32-be14-4350ca401d77-client-ca-bundle\") pod \"metrics-server-c765d567f-47zkv\" (UID: \"6aaaecf2-7fa0-4f32-be14-4350ca401d77\") " pod="openshift-monitoring/metrics-server-c765d567f-47zkv" Apr 22 17:35:01.804639 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:01.804630 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/6aaaecf2-7fa0-4f32-be14-4350ca401d77-secret-metrics-server-client-certs\") pod \"metrics-server-c765d567f-47zkv\" (UID: \"6aaaecf2-7fa0-4f32-be14-4350ca401d77\") " pod="openshift-monitoring/metrics-server-c765d567f-47zkv" Apr 22 17:35:01.810572 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:01.810548 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k9gl\" (UniqueName: \"kubernetes.io/projected/6aaaecf2-7fa0-4f32-be14-4350ca401d77-kube-api-access-4k9gl\") pod \"metrics-server-c765d567f-47zkv\" (UID: \"6aaaecf2-7fa0-4f32-be14-4350ca401d77\") " pod="openshift-monitoring/metrics-server-c765d567f-47zkv" Apr 22 17:35:01.918373 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:01.918333 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-c765d567f-47zkv" Apr 22 17:35:02.001186 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:02.001139 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7dccd58f55-kvtjb"] Apr 22 17:35:02.026343 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:02.026312 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7dccd58f55-kvtjb"] Apr 22 17:35:02.026505 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:02.026443 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7dccd58f55-kvtjb" Apr 22 17:35:02.029375 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:02.029350 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Apr 22 17:35:02.029375 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:02.029368 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-q8wld\"" Apr 22 17:35:02.104668 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:02.104622 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2b142c1a-eb25-4dde-ae49-12d2cc01c628-monitoring-plugin-cert\") pod \"monitoring-plugin-7dccd58f55-kvtjb\" (UID: \"2b142c1a-eb25-4dde-ae49-12d2cc01c628\") " pod="openshift-monitoring/monitoring-plugin-7dccd58f55-kvtjb" Apr 22 17:35:02.205648 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:02.205610 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2b142c1a-eb25-4dde-ae49-12d2cc01c628-monitoring-plugin-cert\") pod \"monitoring-plugin-7dccd58f55-kvtjb\" (UID: \"2b142c1a-eb25-4dde-ae49-12d2cc01c628\") " pod="openshift-monitoring/monitoring-plugin-7dccd58f55-kvtjb" Apr 22 17:35:02.205833 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:35:02.205784 2576 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Apr 22 17:35:02.205884 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:35:02.205857 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b142c1a-eb25-4dde-ae49-12d2cc01c628-monitoring-plugin-cert podName:2b142c1a-eb25-4dde-ae49-12d2cc01c628 nodeName:}" failed. No retries permitted until 2026-04-22 17:35:02.705838171 +0000 UTC m=+52.150401349 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/2b142c1a-eb25-4dde-ae49-12d2cc01c628-monitoring-plugin-cert") pod "monitoring-plugin-7dccd58f55-kvtjb" (UID: "2b142c1a-eb25-4dde-ae49-12d2cc01c628") : secret "monitoring-plugin-cert" not found Apr 22 17:35:02.534859 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:02.534838 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-c765d567f-47zkv"] Apr 22 17:35:02.537203 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:35:02.537154 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6aaaecf2_7fa0_4f32_be14_4350ca401d77.slice/crio-7710e2ade8cbeee00254ac59a521e63af1f67947f49e876b5b4bfab407c4dac8 WatchSource:0}: Error finding container 7710e2ade8cbeee00254ac59a521e63af1f67947f49e876b5b4bfab407c4dac8: Status 404 returned error can't find the container with id 7710e2ade8cbeee00254ac59a521e63af1f67947f49e876b5b4bfab407c4dac8 Apr 22 17:35:02.709150 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:02.709062 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2b142c1a-eb25-4dde-ae49-12d2cc01c628-monitoring-plugin-cert\") pod \"monitoring-plugin-7dccd58f55-kvtjb\" (UID: \"2b142c1a-eb25-4dde-ae49-12d2cc01c628\") " pod="openshift-monitoring/monitoring-plugin-7dccd58f55-kvtjb" Apr 22 17:35:02.711690 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:02.711669 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2b142c1a-eb25-4dde-ae49-12d2cc01c628-monitoring-plugin-cert\") pod \"monitoring-plugin-7dccd58f55-kvtjb\" (UID: \"2b142c1a-eb25-4dde-ae49-12d2cc01c628\") " pod="openshift-monitoring/monitoring-plugin-7dccd58f55-kvtjb" Apr 22 17:35:02.937358 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:02.937331 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7dccd58f55-kvtjb" Apr 22 17:35:03.082486 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.082455 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7dccd58f55-kvtjb"] Apr 22 17:35:03.086450 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:35:03.086422 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b142c1a_eb25_4dde_ae49_12d2cc01c628.slice/crio-8803ccf9fcbb0dae542e56b4f06635072524af3ac32a7836104968dc70651aa1 WatchSource:0}: Error finding container 8803ccf9fcbb0dae542e56b4f06635072524af3ac32a7836104968dc70651aa1: Status 404 returned error can't find the container with id 8803ccf9fcbb0dae542e56b4f06635072524af3ac32a7836104968dc70651aa1 Apr 22 17:35:03.155391 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.154502 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-544759c6c4-vtcbn"] Apr 22 17:35:03.189009 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.188975 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-684878565-rm8pn"] Apr 22 17:35:03.216930 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.216896 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-684878565-rm8pn"] Apr 22 17:35:03.217101 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.217032 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-684878565-rm8pn" Apr 22 17:35:03.314634 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.314197 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7-console-serving-cert\") pod \"console-684878565-rm8pn\" (UID: \"53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7\") " pod="openshift-console/console-684878565-rm8pn" Apr 22 17:35:03.314634 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.314252 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7-console-oauth-config\") pod \"console-684878565-rm8pn\" (UID: \"53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7\") " pod="openshift-console/console-684878565-rm8pn" Apr 22 17:35:03.314634 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.314283 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7-trusted-ca-bundle\") pod \"console-684878565-rm8pn\" (UID: \"53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7\") " pod="openshift-console/console-684878565-rm8pn" Apr 22 17:35:03.314634 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.314377 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7-service-ca\") pod \"console-684878565-rm8pn\" (UID: \"53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7\") " pod="openshift-console/console-684878565-rm8pn" Apr 22 17:35:03.314634 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.314407 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6t5x9\" (UniqueName: \"kubernetes.io/projected/53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7-kube-api-access-6t5x9\") pod \"console-684878565-rm8pn\" (UID: \"53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7\") " pod="openshift-console/console-684878565-rm8pn" Apr 22 17:35:03.314634 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.314462 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7-console-config\") pod \"console-684878565-rm8pn\" (UID: \"53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7\") " pod="openshift-console/console-684878565-rm8pn" Apr 22 17:35:03.314634 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.314516 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7-oauth-serving-cert\") pod \"console-684878565-rm8pn\" (UID: \"53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7\") " pod="openshift-console/console-684878565-rm8pn" Apr 22 17:35:03.413953 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.413887 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bfbf857f6-2p9lx" event={"ID":"058893ce-7657-414f-874b-f5aed2040e2c","Type":"ContainerStarted","Data":"3505f639a7cbcb1e3a0cfbc1c4bb2ad4bdc038b8ac1e49e9df12fec17eee15bc"} Apr 22 17:35:03.413953 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.413948 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bfbf857f6-2p9lx" event={"ID":"058893ce-7657-414f-874b-f5aed2040e2c","Type":"ContainerStarted","Data":"0260491edb0a65ee5e6b05d6fbb1d300f25c2a9383d5085d8b6e0affc150a891"} Apr 22 17:35:03.414261 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.413967 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bfbf857f6-2p9lx" event={"ID":"058893ce-7657-414f-874b-f5aed2040e2c","Type":"ContainerStarted","Data":"1f88e4ba71584feb253722c831618b1a3e641934a4685869ad6dc52dab777705"} Apr 22 17:35:03.415108 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.415084 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7-console-oauth-config\") pod \"console-684878565-rm8pn\" (UID: \"53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7\") " pod="openshift-console/console-684878565-rm8pn" Apr 22 17:35:03.415243 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.415118 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7-trusted-ca-bundle\") pod \"console-684878565-rm8pn\" (UID: \"53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7\") " pod="openshift-console/console-684878565-rm8pn" Apr 22 17:35:03.415243 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.415161 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7dccd58f55-kvtjb" event={"ID":"2b142c1a-eb25-4dde-ae49-12d2cc01c628","Type":"ContainerStarted","Data":"8803ccf9fcbb0dae542e56b4f06635072524af3ac32a7836104968dc70651aa1"} Apr 22 17:35:03.415243 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.415195 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7-service-ca\") pod \"console-684878565-rm8pn\" (UID: \"53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7\") " pod="openshift-console/console-684878565-rm8pn" Apr 22 17:35:03.415417 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.415259 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6t5x9\" (UniqueName: \"kubernetes.io/projected/53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7-kube-api-access-6t5x9\") pod \"console-684878565-rm8pn\" (UID: \"53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7\") " pod="openshift-console/console-684878565-rm8pn" Apr 22 17:35:03.415417 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.415328 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7-console-config\") pod \"console-684878565-rm8pn\" (UID: \"53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7\") " pod="openshift-console/console-684878565-rm8pn" Apr 22 17:35:03.415417 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.415395 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7-oauth-serving-cert\") pod \"console-684878565-rm8pn\" (UID: \"53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7\") " pod="openshift-console/console-684878565-rm8pn" Apr 22 17:35:03.415556 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.415467 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7-console-serving-cert\") pod \"console-684878565-rm8pn\" (UID: \"53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7\") " pod="openshift-console/console-684878565-rm8pn" Apr 22 17:35:03.416219 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.415898 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7-service-ca\") pod \"console-684878565-rm8pn\" (UID: \"53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7\") " pod="openshift-console/console-684878565-rm8pn" Apr 22 17:35:03.416219 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.416068 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7-trusted-ca-bundle\") pod \"console-684878565-rm8pn\" (UID: \"53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7\") " pod="openshift-console/console-684878565-rm8pn" Apr 22 17:35:03.416384 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.416312 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7-console-config\") pod \"console-684878565-rm8pn\" (UID: \"53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7\") " pod="openshift-console/console-684878565-rm8pn" Apr 22 17:35:03.416722 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.416671 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7-oauth-serving-cert\") pod \"console-684878565-rm8pn\" (UID: \"53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7\") " pod="openshift-console/console-684878565-rm8pn" Apr 22 17:35:03.418263 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.418217 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-c765d567f-47zkv" event={"ID":"6aaaecf2-7fa0-4f32-be14-4350ca401d77","Type":"ContainerStarted","Data":"7710e2ade8cbeee00254ac59a521e63af1f67947f49e876b5b4bfab407c4dac8"} Apr 22 17:35:03.418581 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.418555 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7-console-oauth-config\") pod \"console-684878565-rm8pn\" (UID: \"53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7\") " pod="openshift-console/console-684878565-rm8pn" Apr 22 17:35:03.419059 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.419040 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7-console-serving-cert\") pod \"console-684878565-rm8pn\" (UID: \"53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7\") " pod="openshift-console/console-684878565-rm8pn" Apr 22 17:35:03.427655 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.427628 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6t5x9\" (UniqueName: \"kubernetes.io/projected/53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7-kube-api-access-6t5x9\") pod \"console-684878565-rm8pn\" (UID: \"53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7\") " pod="openshift-console/console-684878565-rm8pn" Apr 22 17:35:03.504269 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.502208 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Apr 22 17:35:03.530237 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.530193 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-684878565-rm8pn" Apr 22 17:35:03.533561 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.533531 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Apr 22 17:35:03.533739 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.533725 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:03.538638 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.536373 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Apr 22 17:35:03.538638 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.536538 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Apr 22 17:35:03.538638 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.536666 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-v8wmx\"" Apr 22 17:35:03.538638 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.536824 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-dcfa05smk114j\"" Apr 22 17:35:03.538638 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.537008 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Apr 22 17:35:03.538638 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.537071 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Apr 22 17:35:03.538638 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.537227 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Apr 22 17:35:03.538638 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.537335 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Apr 22 17:35:03.538638 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.537469 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Apr 22 17:35:03.538638 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.537679 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Apr 22 17:35:03.538638 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.537893 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Apr 22 17:35:03.538638 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.538256 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Apr 22 17:35:03.544413 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.542781 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Apr 22 17:35:03.545448 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.545428 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Apr 22 17:35:03.616676 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.616638 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rldrr\" (UniqueName: \"kubernetes.io/projected/2415aeb6-b8ca-4064-b680-9c27f1406bb9-kube-api-access-rldrr\") pod \"prometheus-k8s-0\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:03.616856 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.616724 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2415aeb6-b8ca-4064-b680-9c27f1406bb9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:03.616856 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.616782 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2415aeb6-b8ca-4064-b680-9c27f1406bb9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:03.616974 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.616881 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2415aeb6-b8ca-4064-b680-9c27f1406bb9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:03.616974 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.616916 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2415aeb6-b8ca-4064-b680-9c27f1406bb9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:03.616974 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.616948 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2415aeb6-b8ca-4064-b680-9c27f1406bb9-web-config\") pod \"prometheus-k8s-0\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:03.617113 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.616974 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2415aeb6-b8ca-4064-b680-9c27f1406bb9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:03.617113 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.617004 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2415aeb6-b8ca-4064-b680-9c27f1406bb9-config\") pod \"prometheus-k8s-0\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:03.617113 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.617028 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2415aeb6-b8ca-4064-b680-9c27f1406bb9-config-out\") pod \"prometheus-k8s-0\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:03.617113 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.617061 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2415aeb6-b8ca-4064-b680-9c27f1406bb9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:03.617304 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.617127 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2415aeb6-b8ca-4064-b680-9c27f1406bb9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:03.617304 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.617156 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2415aeb6-b8ca-4064-b680-9c27f1406bb9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:03.617304 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.617237 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2415aeb6-b8ca-4064-b680-9c27f1406bb9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:03.617304 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.617267 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2415aeb6-b8ca-4064-b680-9c27f1406bb9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:03.617304 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.617293 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2415aeb6-b8ca-4064-b680-9c27f1406bb9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:03.617454 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.617330 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2415aeb6-b8ca-4064-b680-9c27f1406bb9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:03.617454 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.617395 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2415aeb6-b8ca-4064-b680-9c27f1406bb9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:03.617454 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.617424 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2415aeb6-b8ca-4064-b680-9c27f1406bb9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:03.720480 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.719338 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2415aeb6-b8ca-4064-b680-9c27f1406bb9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:03.720480 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.719392 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rldrr\" (UniqueName: \"kubernetes.io/projected/2415aeb6-b8ca-4064-b680-9c27f1406bb9-kube-api-access-rldrr\") pod \"prometheus-k8s-0\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:03.720480 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.719463 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2415aeb6-b8ca-4064-b680-9c27f1406bb9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:03.720480 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.719489 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2415aeb6-b8ca-4064-b680-9c27f1406bb9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:03.720480 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.719535 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2415aeb6-b8ca-4064-b680-9c27f1406bb9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:03.720480 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.719566 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2415aeb6-b8ca-4064-b680-9c27f1406bb9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:03.720480 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.719607 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2415aeb6-b8ca-4064-b680-9c27f1406bb9-web-config\") pod \"prometheus-k8s-0\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:03.720480 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.719634 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2415aeb6-b8ca-4064-b680-9c27f1406bb9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:03.720480 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.719663 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2415aeb6-b8ca-4064-b680-9c27f1406bb9-config\") pod \"prometheus-k8s-0\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:03.720480 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.719688 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2415aeb6-b8ca-4064-b680-9c27f1406bb9-config-out\") pod \"prometheus-k8s-0\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:03.720480 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.719720 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2415aeb6-b8ca-4064-b680-9c27f1406bb9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:03.720480 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.719755 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2415aeb6-b8ca-4064-b680-9c27f1406bb9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:03.720480 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.719783 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2415aeb6-b8ca-4064-b680-9c27f1406bb9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:03.720480 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.719811 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2415aeb6-b8ca-4064-b680-9c27f1406bb9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:03.720480 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.719836 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2415aeb6-b8ca-4064-b680-9c27f1406bb9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:03.720480 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.719866 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2415aeb6-b8ca-4064-b680-9c27f1406bb9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:03.720480 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.719906 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2415aeb6-b8ca-4064-b680-9c27f1406bb9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:03.721464 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.719994 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2415aeb6-b8ca-4064-b680-9c27f1406bb9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:03.723731 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.723705 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2415aeb6-b8ca-4064-b680-9c27f1406bb9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:03.723859 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.723751 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2415aeb6-b8ca-4064-b680-9c27f1406bb9-web-config\") pod \"prometheus-k8s-0\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:03.723859 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.720159 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2415aeb6-b8ca-4064-b680-9c27f1406bb9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:03.724647 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.724626 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2415aeb6-b8ca-4064-b680-9c27f1406bb9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:03.729385 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.727993 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2415aeb6-b8ca-4064-b680-9c27f1406bb9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:03.729385 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.728626 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2415aeb6-b8ca-4064-b680-9c27f1406bb9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:03.731354 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.730455 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2415aeb6-b8ca-4064-b680-9c27f1406bb9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:03.731354 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.730763 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2415aeb6-b8ca-4064-b680-9c27f1406bb9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:03.731354 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.730891 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2415aeb6-b8ca-4064-b680-9c27f1406bb9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:03.731354 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.730902 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2415aeb6-b8ca-4064-b680-9c27f1406bb9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:03.731354 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.731254 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/2415aeb6-b8ca-4064-b680-9c27f1406bb9-config\") pod \"prometheus-k8s-0\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:03.731636 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.731577 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2415aeb6-b8ca-4064-b680-9c27f1406bb9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:03.732366 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.732343 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2415aeb6-b8ca-4064-b680-9c27f1406bb9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:03.732366 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.732355 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2415aeb6-b8ca-4064-b680-9c27f1406bb9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:03.732754 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.732728 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2415aeb6-b8ca-4064-b680-9c27f1406bb9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:03.733058 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.733013 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2415aeb6-b8ca-4064-b680-9c27f1406bb9-config-out\") pod \"prometheus-k8s-0\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:03.741131 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.741085 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2415aeb6-b8ca-4064-b680-9c27f1406bb9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:03.741925 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.741905 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rldrr\" (UniqueName: \"kubernetes.io/projected/2415aeb6-b8ca-4064-b680-9c27f1406bb9-kube-api-access-rldrr\") pod \"prometheus-k8s-0\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:03.849729 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:03.849640 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:04.262522 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:04.262485 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-755667c6d-5m8bf" Apr 22 17:35:04.262698 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:04.262538 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-755667c6d-5m8bf" Apr 22 17:35:04.267669 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:04.267641 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-755667c6d-5m8bf" Apr 22 17:35:04.425524 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:04.425495 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-755667c6d-5m8bf" Apr 22 17:35:04.985252 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:04.985193 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Apr 22 17:35:04.991920 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:04.991609 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-684878565-rm8pn"] Apr 22 17:35:04.991920 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:35:04.991835 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2415aeb6_b8ca_4064_b680_9c27f1406bb9.slice/crio-4955ccb64c62cf996bc5ab4349ecf2d7f37700a404aa0870e7e19cc338b4ef5a WatchSource:0}: Error finding container 4955ccb64c62cf996bc5ab4349ecf2d7f37700a404aa0870e7e19cc338b4ef5a: Status 404 returned error can't find the container with id 4955ccb64c62cf996bc5ab4349ecf2d7f37700a404aa0870e7e19cc338b4ef5a Apr 22 17:35:04.995997 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:35:04.995233 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53dbfc2e_9a41_43aa_9feb_ff34e0c2f0b7.slice/crio-e17d214cc4f4f71ed10c6c2ea96ad0e2206babdda4e0e6b502f921beea065b47 WatchSource:0}: Error finding container e17d214cc4f4f71ed10c6c2ea96ad0e2206babdda4e0e6b502f921beea065b47: Status 404 returned error can't find the container with id e17d214cc4f4f71ed10c6c2ea96ad0e2206babdda4e0e6b502f921beea065b47 Apr 22 17:35:05.428297 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:05.428255 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"199c16a5-4ca0-4ffc-85d7-049b85038db0","Type":"ContainerStarted","Data":"f3ef20bda4e16e5c4dbd062a65db2e40283babe321740947769aab4ecb3b3547"} Apr 22 17:35:05.428297 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:05.428299 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"199c16a5-4ca0-4ffc-85d7-049b85038db0","Type":"ContainerStarted","Data":"30d0ebc6d0958d50895912aa102ee47850b79875e9c8898aa3c04b5d7b784d86"} Apr 22 17:35:05.428565 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:05.428313 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"199c16a5-4ca0-4ffc-85d7-049b85038db0","Type":"ContainerStarted","Data":"8c0ce7f837ed4c9ca3e2867a660f605e54be572a69f54f14ff18f16ce2dfec7d"} Apr 22 17:35:05.429868 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:05.429837 2576 generic.go:358] "Generic (PLEG): container finished" podID="2415aeb6-b8ca-4064-b680-9c27f1406bb9" containerID="5f769fa941eb685c32e6bcb70428b2e5af17ae67a875b609e48c1527876f82a0" exitCode=0 Apr 22 17:35:05.430001 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:05.429930 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2415aeb6-b8ca-4064-b680-9c27f1406bb9","Type":"ContainerDied","Data":"5f769fa941eb685c32e6bcb70428b2e5af17ae67a875b609e48c1527876f82a0"} Apr 22 17:35:05.430001 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:05.429955 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2415aeb6-b8ca-4064-b680-9c27f1406bb9","Type":"ContainerStarted","Data":"4955ccb64c62cf996bc5ab4349ecf2d7f37700a404aa0870e7e19cc338b4ef5a"} Apr 22 17:35:05.432469 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:05.431820 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-684878565-rm8pn" event={"ID":"53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7","Type":"ContainerStarted","Data":"51ee1c4d2ed46beafb8d6392f2bfcc5f75c25aef14d5c285f8d74f2f195f224d"} Apr 22 17:35:05.432469 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:05.431847 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-684878565-rm8pn" event={"ID":"53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7","Type":"ContainerStarted","Data":"e17d214cc4f4f71ed10c6c2ea96ad0e2206babdda4e0e6b502f921beea065b47"} Apr 22 17:35:05.435074 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:05.435047 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-c765d567f-47zkv" event={"ID":"6aaaecf2-7fa0-4f32-be14-4350ca401d77","Type":"ContainerStarted","Data":"71d75114ad887f9e3c5c1196e30fd130844b16d915ce6ebc0a3ffb79fefcc2d4"} Apr 22 17:35:05.489000 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:05.488949 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-c765d567f-47zkv" podStartSLOduration=2.195974139 podStartE2EDuration="4.488932369s" podCreationTimestamp="2026-04-22 17:35:01 +0000 UTC" firstStartedPulling="2026-04-22 17:35:02.53929261 +0000 UTC m=+51.983855774" lastFinishedPulling="2026-04-22 17:35:04.832250838 +0000 UTC m=+54.276814004" observedRunningTime="2026-04-22 17:35:05.486539263 +0000 UTC m=+54.931102452" watchObservedRunningTime="2026-04-22 17:35:05.488932369 +0000 UTC m=+54.933495553" Apr 22 17:35:05.509698 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:05.509645 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-684878565-rm8pn" podStartSLOduration=2.509627064 podStartE2EDuration="2.509627064s" podCreationTimestamp="2026-04-22 17:35:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-22 17:35:05.50866924 +0000 UTC m=+54.953232435" watchObservedRunningTime="2026-04-22 17:35:05.509627064 +0000 UTC m=+54.954190252" Apr 22 17:35:06.441133 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:06.441090 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"199c16a5-4ca0-4ffc-85d7-049b85038db0","Type":"ContainerStarted","Data":"4c7232ad825980121d48c7f0f7884a4ae4977564caed72de6eb048911415c0f3"} Apr 22 17:35:06.441133 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:06.441136 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"199c16a5-4ca0-4ffc-85d7-049b85038db0","Type":"ContainerStarted","Data":"5c2e3dbb91907ea5c2bee00c91629f5dbc479d7ce410d286c9725e8d1c6b179d"} Apr 22 17:35:06.441578 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:06.441146 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"199c16a5-4ca0-4ffc-85d7-049b85038db0","Type":"ContainerStarted","Data":"c70c7854d7c6118f06b8b4128761d513ebff756f095f9910ef33ade51eb5fd82"} Apr 22 17:35:06.445282 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:06.445159 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bfbf857f6-2p9lx" event={"ID":"058893ce-7657-414f-874b-f5aed2040e2c","Type":"ContainerStarted","Data":"c15ac14769245fa8aca8421707559af5c438775378ef3f235492a475ad57dd36"} Apr 22 17:35:06.445282 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:06.445225 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bfbf857f6-2p9lx" event={"ID":"058893ce-7657-414f-874b-f5aed2040e2c","Type":"ContainerStarted","Data":"3e8f6b37c538a776286064a909186ecc497834e2aafceee6888d000bb69870af"} Apr 22 17:35:06.445282 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:06.445241 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bfbf857f6-2p9lx" event={"ID":"058893ce-7657-414f-874b-f5aed2040e2c","Type":"ContainerStarted","Data":"8d5ed1c0b28a1ae821c71f368f4a5e9b966e3e0089fca3ef408e9051ecd79af7"} Apr 22 17:35:06.445551 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:06.445352 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5bfbf857f6-2p9lx" Apr 22 17:35:06.446770 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:06.446734 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7dccd58f55-kvtjb" event={"ID":"2b142c1a-eb25-4dde-ae49-12d2cc01c628","Type":"ContainerStarted","Data":"fce241a954ca5251a4f711176a28b0cc6082b1bfbca70fa98a5c2b434707d0a1"} Apr 22 17:35:06.447532 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:06.447138 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7dccd58f55-kvtjb" Apr 22 17:35:06.452311 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:06.452290 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7dccd58f55-kvtjb" Apr 22 17:35:06.473519 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:06.473465 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.01641859 podStartE2EDuration="8.473449621s" podCreationTimestamp="2026-04-22 17:34:58 +0000 UTC" firstStartedPulling="2026-04-22 17:34:59.373470851 +0000 UTC m=+48.818034015" lastFinishedPulling="2026-04-22 17:35:04.830501877 +0000 UTC m=+54.275065046" observedRunningTime="2026-04-22 17:35:06.470998555 +0000 UTC m=+55.915561738" watchObservedRunningTime="2026-04-22 17:35:06.473449621 +0000 UTC m=+55.918012811" Apr 22 17:35:06.495267 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:06.495208 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5bfbf857f6-2p9lx" podStartSLOduration=1.601723365 podStartE2EDuration="7.495187748s" podCreationTimestamp="2026-04-22 17:34:59 +0000 UTC" firstStartedPulling="2026-04-22 17:35:00.176976433 +0000 UTC m=+49.621539594" lastFinishedPulling="2026-04-22 17:35:06.070440813 +0000 UTC m=+55.515003977" observedRunningTime="2026-04-22 17:35:06.494828774 +0000 UTC m=+55.939391963" watchObservedRunningTime="2026-04-22 17:35:06.495187748 +0000 UTC m=+55.939750924" Apr 22 17:35:06.512401 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:06.512342 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7dccd58f55-kvtjb" podStartSLOduration=2.52881075 podStartE2EDuration="5.512321813s" podCreationTimestamp="2026-04-22 17:35:01 +0000 UTC" firstStartedPulling="2026-04-22 17:35:03.088365442 +0000 UTC m=+52.532928630" lastFinishedPulling="2026-04-22 17:35:06.071876513 +0000 UTC m=+55.516439693" observedRunningTime="2026-04-22 17:35:06.510010326 +0000 UTC m=+55.954573512" watchObservedRunningTime="2026-04-22 17:35:06.512321813 +0000 UTC m=+55.956885004" Apr 22 17:35:08.310927 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:08.310897 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-645b85c468-dz7n7" Apr 22 17:35:09.461073 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:09.461037 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2415aeb6-b8ca-4064-b680-9c27f1406bb9","Type":"ContainerStarted","Data":"9052fd90e8f6b6815d33f832884da8d03a2a9e2849fd9f5d52d8a1124e0f3179"} Apr 22 17:35:09.461073 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:09.461073 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2415aeb6-b8ca-4064-b680-9c27f1406bb9","Type":"ContainerStarted","Data":"cd865d7f5795a395040e1b9b2e940c8fb0fd77c10986bf6da87dd11089efa037"} Apr 22 17:35:09.461476 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:09.461082 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2415aeb6-b8ca-4064-b680-9c27f1406bb9","Type":"ContainerStarted","Data":"53f18a1f96fb91bf0b27680034f0b6ae6e82910b2370807695fa72304208f0a9"} Apr 22 17:35:09.461476 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:09.461090 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2415aeb6-b8ca-4064-b680-9c27f1406bb9","Type":"ContainerStarted","Data":"0522b67d7bdff833cd68ad2271fc25d922352963028a6372169ad58161bd58b7"} Apr 22 17:35:09.461476 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:09.461098 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2415aeb6-b8ca-4064-b680-9c27f1406bb9","Type":"ContainerStarted","Data":"ba81f69c5729e8b2a9fbe1f01e2879472bda0ab8227bd17fc036e211645ab9e9"} Apr 22 17:35:09.461476 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:09.461106 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2415aeb6-b8ca-4064-b680-9c27f1406bb9","Type":"ContainerStarted","Data":"48c3cbe5406026f574072fc1368effd11ebca2ed1341e24f7b443285e8d65cf1"} Apr 22 17:35:09.492720 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:09.492671 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.5565197729999998 podStartE2EDuration="6.492653485s" podCreationTimestamp="2026-04-22 17:35:03 +0000 UTC" firstStartedPulling="2026-04-22 17:35:05.431309761 +0000 UTC m=+54.875872938" lastFinishedPulling="2026-04-22 17:35:08.367443486 +0000 UTC m=+57.812006650" observedRunningTime="2026-04-22 17:35:09.491490515 +0000 UTC m=+58.936053711" watchObservedRunningTime="2026-04-22 17:35:09.492653485 +0000 UTC m=+58.937216671" Apr 22 17:35:10.271604 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:10.271576 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k5q2p" Apr 22 17:35:12.455867 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:12.455837 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5bfbf857f6-2p9lx" Apr 22 17:35:13.531572 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:13.530912 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-684878565-rm8pn" Apr 22 17:35:13.531572 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:13.531245 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-684878565-rm8pn" Apr 22 17:35:13.536091 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:13.536066 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-684878565-rm8pn" Apr 22 17:35:13.850392 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:13.850313 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:14.486078 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:14.486049 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-684878565-rm8pn" Apr 22 17:35:14.545673 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:14.545644 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-755667c6d-5m8bf"] Apr 22 17:35:16.757871 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:16.757833 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4dbaf65e-c017-4ec0-bcc0-808342d2272b-metrics-certs\") pod \"network-metrics-daemon-n4clb\" (UID: \"4dbaf65e-c017-4ec0-bcc0-808342d2272b\") " pod="openshift-multus/network-metrics-daemon-n4clb" Apr 22 17:35:16.760617 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:16.760592 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Apr 22 17:35:16.771030 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:16.770997 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4dbaf65e-c017-4ec0-bcc0-808342d2272b-metrics-certs\") pod \"network-metrics-daemon-n4clb\" (UID: \"4dbaf65e-c017-4ec0-bcc0-808342d2272b\") " pod="openshift-multus/network-metrics-daemon-n4clb" Apr 22 17:35:16.858782 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:16.858747 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7p6x7\" (UniqueName: \"kubernetes.io/projected/473029a2-4794-4adf-8637-e61f8afbe3a4-kube-api-access-7p6x7\") pod \"network-check-target-p76lb\" (UID: \"473029a2-4794-4adf-8637-e61f8afbe3a4\") " pod="openshift-network-diagnostics/network-check-target-p76lb" Apr 22 17:35:16.861879 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:16.861856 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Apr 22 17:35:16.871819 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:16.871788 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Apr 22 17:35:16.882414 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:16.882382 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7p6x7\" (UniqueName: \"kubernetes.io/projected/473029a2-4794-4adf-8637-e61f8afbe3a4-kube-api-access-7p6x7\") pod \"network-check-target-p76lb\" (UID: \"473029a2-4794-4adf-8637-e61f8afbe3a4\") " pod="openshift-network-diagnostics/network-check-target-p76lb" Apr 22 17:35:16.889070 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:16.889041 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jqt69\"" Apr 22 17:35:16.896601 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:16.896571 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n4clb" Apr 22 17:35:17.034452 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:17.034376 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-n4clb"] Apr 22 17:35:17.037549 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:35:17.037517 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dbaf65e_c017_4ec0_bcc0_808342d2272b.slice/crio-a7117f319dd70cd26fd3424c5c590b3e5f22c802eab8ebe4b3135f6395ffad57 WatchSource:0}: Error finding container a7117f319dd70cd26fd3424c5c590b3e5f22c802eab8ebe4b3135f6395ffad57: Status 404 returned error can't find the container with id a7117f319dd70cd26fd3424c5c590b3e5f22c802eab8ebe4b3135f6395ffad57 Apr 22 17:35:17.184541 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:17.184509 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2ldpn\"" Apr 22 17:35:17.191320 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:17.191299 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p76lb" Apr 22 17:35:17.346472 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:17.346444 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-p76lb"] Apr 22 17:35:17.349936 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:35:17.349910 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod473029a2_4794_4adf_8637_e61f8afbe3a4.slice/crio-334da95d23cbcc442ba0e8ba86d41837dfe9c9db2528665280e140273ca4c1b7 WatchSource:0}: Error finding container 334da95d23cbcc442ba0e8ba86d41837dfe9c9db2528665280e140273ca4c1b7: Status 404 returned error can't find the container with id 334da95d23cbcc442ba0e8ba86d41837dfe9c9db2528665280e140273ca4c1b7 Apr 22 17:35:17.492894 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:17.492854 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-p76lb" event={"ID":"473029a2-4794-4adf-8637-e61f8afbe3a4","Type":"ContainerStarted","Data":"334da95d23cbcc442ba0e8ba86d41837dfe9c9db2528665280e140273ca4c1b7"} Apr 22 17:35:17.493935 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:17.493902 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-n4clb" event={"ID":"4dbaf65e-c017-4ec0-bcc0-808342d2272b","Type":"ContainerStarted","Data":"a7117f319dd70cd26fd3424c5c590b3e5f22c802eab8ebe4b3135f6395ffad57"} Apr 22 17:35:19.502017 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:19.501972 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-n4clb" event={"ID":"4dbaf65e-c017-4ec0-bcc0-808342d2272b","Type":"ContainerStarted","Data":"be5637be2868cf8b0de5d6be92e1b2d9ebc4f6518d0c6a9cee656a2a886ec602"} Apr 22 17:35:19.502017 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:19.502017 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-n4clb" event={"ID":"4dbaf65e-c017-4ec0-bcc0-808342d2272b","Type":"ContainerStarted","Data":"2a47bd81397254b85008a83d448f7f93c96436635dd9d82ca742ab53ce3b2666"} Apr 22 17:35:19.518567 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:19.518514 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-n4clb" podStartSLOduration=66.960171452 podStartE2EDuration="1m8.518495726s" podCreationTimestamp="2026-04-22 17:34:11 +0000 UTC" firstStartedPulling="2026-04-22 17:35:17.039567082 +0000 UTC m=+66.484130259" lastFinishedPulling="2026-04-22 17:35:18.597891358 +0000 UTC m=+68.042454533" observedRunningTime="2026-04-22 17:35:19.518212051 +0000 UTC m=+68.962775234" watchObservedRunningTime="2026-04-22 17:35:19.518495726 +0000 UTC m=+68.963058912" Apr 22 17:35:21.919396 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:21.919354 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-c765d567f-47zkv" Apr 22 17:35:21.919793 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:21.919413 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-c765d567f-47zkv" Apr 22 17:35:22.514318 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:22.514283 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-p76lb" event={"ID":"473029a2-4794-4adf-8637-e61f8afbe3a4","Type":"ContainerStarted","Data":"adb981fdcd3c1d8abcb9445b245e34275ccedce8e82f1ebdb56656916df63437"} Apr 22 17:35:22.514476 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:22.514348 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-p76lb" Apr 22 17:35:22.546207 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:22.546066 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-p76lb" podStartSLOduration=66.603033881 podStartE2EDuration="1m11.546045049s" podCreationTimestamp="2026-04-22 17:34:11 +0000 UTC" firstStartedPulling="2026-04-22 17:35:17.351912199 +0000 UTC m=+66.796475368" lastFinishedPulling="2026-04-22 17:35:22.29492336 +0000 UTC m=+71.739486536" observedRunningTime="2026-04-22 17:35:22.544145715 +0000 UTC m=+71.988708899" watchObservedRunningTime="2026-04-22 17:35:22.546045049 +0000 UTC m=+71.990608233" Apr 22 17:35:22.563650 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:22.563618 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-r2v8q_4c655f36-4618-49aa-8f46-cbd457bbf957/serve-healthcheck-canary/0.log" Apr 22 17:35:28.186413 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:28.186278 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-544759c6c4-vtcbn" podUID="18e08482-c36e-401e-962d-668b99942463" containerName="console" containerID="cri-o://63c5854ec4d7e754ed619e8a9d63ee37789bd4c4d5c45b9e2c0b2475a95dd7bc" gracePeriod=15 Apr 22 17:35:28.431978 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:28.431951 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-544759c6c4-vtcbn_18e08482-c36e-401e-962d-668b99942463/console/0.log" Apr 22 17:35:28.432117 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:28.432030 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-544759c6c4-vtcbn" Apr 22 17:35:28.532627 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:28.532601 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-544759c6c4-vtcbn_18e08482-c36e-401e-962d-668b99942463/console/0.log" Apr 22 17:35:28.532825 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:28.532641 2576 generic.go:358] "Generic (PLEG): container finished" podID="18e08482-c36e-401e-962d-668b99942463" containerID="63c5854ec4d7e754ed619e8a9d63ee37789bd4c4d5c45b9e2c0b2475a95dd7bc" exitCode=2 Apr 22 17:35:28.532825 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:28.532722 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-544759c6c4-vtcbn" Apr 22 17:35:28.532825 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:28.532735 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-544759c6c4-vtcbn" event={"ID":"18e08482-c36e-401e-962d-668b99942463","Type":"ContainerDied","Data":"63c5854ec4d7e754ed619e8a9d63ee37789bd4c4d5c45b9e2c0b2475a95dd7bc"} Apr 22 17:35:28.532825 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:28.532776 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-544759c6c4-vtcbn" event={"ID":"18e08482-c36e-401e-962d-668b99942463","Type":"ContainerDied","Data":"70baf449d0224eb4a07110ab47cd6b47c74a0c430bfe6b97bfea43d8e214105a"} Apr 22 17:35:28.532825 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:28.532792 2576 scope.go:117] "RemoveContainer" containerID="63c5854ec4d7e754ed619e8a9d63ee37789bd4c4d5c45b9e2c0b2475a95dd7bc" Apr 22 17:35:28.540958 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:28.540940 2576 scope.go:117] "RemoveContainer" containerID="63c5854ec4d7e754ed619e8a9d63ee37789bd4c4d5c45b9e2c0b2475a95dd7bc" Apr 22 17:35:28.541266 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:35:28.541243 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63c5854ec4d7e754ed619e8a9d63ee37789bd4c4d5c45b9e2c0b2475a95dd7bc\": container with ID starting with 63c5854ec4d7e754ed619e8a9d63ee37789bd4c4d5c45b9e2c0b2475a95dd7bc not found: ID does not exist" containerID="63c5854ec4d7e754ed619e8a9d63ee37789bd4c4d5c45b9e2c0b2475a95dd7bc" Apr 22 17:35:28.541341 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:28.541276 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63c5854ec4d7e754ed619e8a9d63ee37789bd4c4d5c45b9e2c0b2475a95dd7bc"} err="failed to get container status \"63c5854ec4d7e754ed619e8a9d63ee37789bd4c4d5c45b9e2c0b2475a95dd7bc\": rpc error: code = NotFound desc = could not find container \"63c5854ec4d7e754ed619e8a9d63ee37789bd4c4d5c45b9e2c0b2475a95dd7bc\": container with ID starting with 63c5854ec4d7e754ed619e8a9d63ee37789bd4c4d5c45b9e2c0b2475a95dd7bc not found: ID does not exist" Apr 22 17:35:28.575283 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:28.575251 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/18e08482-c36e-401e-962d-668b99942463-oauth-serving-cert\") pod \"18e08482-c36e-401e-962d-668b99942463\" (UID: \"18e08482-c36e-401e-962d-668b99942463\") " Apr 22 17:35:28.575434 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:28.575326 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hprvb\" (UniqueName: \"kubernetes.io/projected/18e08482-c36e-401e-962d-668b99942463-kube-api-access-hprvb\") pod \"18e08482-c36e-401e-962d-668b99942463\" (UID: \"18e08482-c36e-401e-962d-668b99942463\") " Apr 22 17:35:28.575434 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:28.575366 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/18e08482-c36e-401e-962d-668b99942463-console-serving-cert\") pod \"18e08482-c36e-401e-962d-668b99942463\" (UID: \"18e08482-c36e-401e-962d-668b99942463\") " Apr 22 17:35:28.575434 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:28.575407 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/18e08482-c36e-401e-962d-668b99942463-service-ca\") pod \"18e08482-c36e-401e-962d-668b99942463\" (UID: \"18e08482-c36e-401e-962d-668b99942463\") " Apr 22 17:35:28.575580 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:28.575454 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/18e08482-c36e-401e-962d-668b99942463-console-config\") pod \"18e08482-c36e-401e-962d-668b99942463\" (UID: \"18e08482-c36e-401e-962d-668b99942463\") " Apr 22 17:35:28.575580 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:28.575486 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/18e08482-c36e-401e-962d-668b99942463-console-oauth-config\") pod \"18e08482-c36e-401e-962d-668b99942463\" (UID: \"18e08482-c36e-401e-962d-668b99942463\") " Apr 22 17:35:28.575803 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:28.575776 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18e08482-c36e-401e-962d-668b99942463-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "18e08482-c36e-401e-962d-668b99942463" (UID: "18e08482-c36e-401e-962d-668b99942463"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 22 17:35:28.575911 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:28.575806 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18e08482-c36e-401e-962d-668b99942463-service-ca" (OuterVolumeSpecName: "service-ca") pod "18e08482-c36e-401e-962d-668b99942463" (UID: "18e08482-c36e-401e-962d-668b99942463"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 22 17:35:28.575911 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:28.575854 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18e08482-c36e-401e-962d-668b99942463-console-config" (OuterVolumeSpecName: "console-config") pod "18e08482-c36e-401e-962d-668b99942463" (UID: "18e08482-c36e-401e-962d-668b99942463"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 22 17:35:28.578054 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:28.578026 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18e08482-c36e-401e-962d-668b99942463-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "18e08482-c36e-401e-962d-668b99942463" (UID: "18e08482-c36e-401e-962d-668b99942463"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 22 17:35:28.578164 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:28.578078 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18e08482-c36e-401e-962d-668b99942463-kube-api-access-hprvb" (OuterVolumeSpecName: "kube-api-access-hprvb") pod "18e08482-c36e-401e-962d-668b99942463" (UID: "18e08482-c36e-401e-962d-668b99942463"). InnerVolumeSpecName "kube-api-access-hprvb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 22 17:35:28.578164 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:28.578116 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18e08482-c36e-401e-962d-668b99942463-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "18e08482-c36e-401e-962d-668b99942463" (UID: "18e08482-c36e-401e-962d-668b99942463"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 22 17:35:28.676142 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:28.676103 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/18e08482-c36e-401e-962d-668b99942463-oauth-serving-cert\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Apr 22 17:35:28.676142 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:28.676134 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hprvb\" (UniqueName: \"kubernetes.io/projected/18e08482-c36e-401e-962d-668b99942463-kube-api-access-hprvb\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Apr 22 17:35:28.676142 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:28.676145 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/18e08482-c36e-401e-962d-668b99942463-console-serving-cert\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Apr 22 17:35:28.676142 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:28.676155 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/18e08482-c36e-401e-962d-668b99942463-service-ca\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Apr 22 17:35:28.676439 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:28.676164 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/18e08482-c36e-401e-962d-668b99942463-console-config\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Apr 22 17:35:28.676439 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:28.676203 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/18e08482-c36e-401e-962d-668b99942463-console-oauth-config\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Apr 22 17:35:28.856329 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:28.856300 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-544759c6c4-vtcbn"] Apr 22 17:35:28.863338 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:28.863308 2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-544759c6c4-vtcbn"] Apr 22 17:35:29.072782 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:29.072743 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18e08482-c36e-401e-962d-668b99942463" path="/var/lib/kubelet/pods/18e08482-c36e-401e-962d-668b99942463/volumes" Apr 22 17:35:34.114757 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:34.114718 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:34.152535 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:34.152502 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:34.578359 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:34.578327 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:39.566074 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:39.566031 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-755667c6d-5m8bf" podUID="dcde6eda-f52a-4c3a-8740-a82e865872c2" containerName="console" containerID="cri-o://8ae4d196be0e46e46199f6ff93ce67a750e3a12860db7cfca8d4c0490138981c" gracePeriod=15 Apr 22 17:35:39.817223 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:39.817158 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-755667c6d-5m8bf_dcde6eda-f52a-4c3a-8740-a82e865872c2/console/0.log" Apr 22 17:35:39.817326 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:39.817240 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-755667c6d-5m8bf" Apr 22 17:35:39.883016 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:39.882975 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wwfq8\" (UniqueName: \"kubernetes.io/projected/dcde6eda-f52a-4c3a-8740-a82e865872c2-kube-api-access-wwfq8\") pod \"dcde6eda-f52a-4c3a-8740-a82e865872c2\" (UID: \"dcde6eda-f52a-4c3a-8740-a82e865872c2\") " Apr 22 17:35:39.883016 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:39.883017 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dcde6eda-f52a-4c3a-8740-a82e865872c2-console-oauth-config\") pod \"dcde6eda-f52a-4c3a-8740-a82e865872c2\" (UID: \"dcde6eda-f52a-4c3a-8740-a82e865872c2\") " Apr 22 17:35:39.883279 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:39.883054 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dcde6eda-f52a-4c3a-8740-a82e865872c2-service-ca\") pod \"dcde6eda-f52a-4c3a-8740-a82e865872c2\" (UID: \"dcde6eda-f52a-4c3a-8740-a82e865872c2\") " Apr 22 17:35:39.883279 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:39.883079 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dcde6eda-f52a-4c3a-8740-a82e865872c2-console-config\") pod \"dcde6eda-f52a-4c3a-8740-a82e865872c2\" (UID: \"dcde6eda-f52a-4c3a-8740-a82e865872c2\") " Apr 22 17:35:39.883279 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:39.883110 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dcde6eda-f52a-4c3a-8740-a82e865872c2-oauth-serving-cert\") pod \"dcde6eda-f52a-4c3a-8740-a82e865872c2\" (UID: \"dcde6eda-f52a-4c3a-8740-a82e865872c2\") " Apr 22 17:35:39.883279 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:39.883140 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dcde6eda-f52a-4c3a-8740-a82e865872c2-console-serving-cert\") pod \"dcde6eda-f52a-4c3a-8740-a82e865872c2\" (UID: \"dcde6eda-f52a-4c3a-8740-a82e865872c2\") " Apr 22 17:35:39.883279 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:39.883210 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dcde6eda-f52a-4c3a-8740-a82e865872c2-trusted-ca-bundle\") pod \"dcde6eda-f52a-4c3a-8740-a82e865872c2\" (UID: \"dcde6eda-f52a-4c3a-8740-a82e865872c2\") " Apr 22 17:35:39.883585 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:39.883560 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dcde6eda-f52a-4c3a-8740-a82e865872c2-console-config" (OuterVolumeSpecName: "console-config") pod "dcde6eda-f52a-4c3a-8740-a82e865872c2" (UID: "dcde6eda-f52a-4c3a-8740-a82e865872c2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 22 17:35:39.883677 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:39.883577 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dcde6eda-f52a-4c3a-8740-a82e865872c2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "dcde6eda-f52a-4c3a-8740-a82e865872c2" (UID: "dcde6eda-f52a-4c3a-8740-a82e865872c2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 22 17:35:39.883725 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:39.883569 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dcde6eda-f52a-4c3a-8740-a82e865872c2-service-ca" (OuterVolumeSpecName: "service-ca") pod "dcde6eda-f52a-4c3a-8740-a82e865872c2" (UID: "dcde6eda-f52a-4c3a-8740-a82e865872c2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 22 17:35:39.883767 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:39.883732 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dcde6eda-f52a-4c3a-8740-a82e865872c2-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "dcde6eda-f52a-4c3a-8740-a82e865872c2" (UID: "dcde6eda-f52a-4c3a-8740-a82e865872c2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 22 17:35:39.885518 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:39.885488 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcde6eda-f52a-4c3a-8740-a82e865872c2-kube-api-access-wwfq8" (OuterVolumeSpecName: "kube-api-access-wwfq8") pod "dcde6eda-f52a-4c3a-8740-a82e865872c2" (UID: "dcde6eda-f52a-4c3a-8740-a82e865872c2"). InnerVolumeSpecName "kube-api-access-wwfq8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 22 17:35:39.885829 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:39.885811 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcde6eda-f52a-4c3a-8740-a82e865872c2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "dcde6eda-f52a-4c3a-8740-a82e865872c2" (UID: "dcde6eda-f52a-4c3a-8740-a82e865872c2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 22 17:35:39.885925 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:39.885901 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcde6eda-f52a-4c3a-8740-a82e865872c2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "dcde6eda-f52a-4c3a-8740-a82e865872c2" (UID: "dcde6eda-f52a-4c3a-8740-a82e865872c2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 22 17:35:39.984594 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:39.984557 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dcde6eda-f52a-4c3a-8740-a82e865872c2-console-config\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Apr 22 17:35:39.984594 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:39.984588 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dcde6eda-f52a-4c3a-8740-a82e865872c2-oauth-serving-cert\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Apr 22 17:35:39.984594 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:39.984599 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dcde6eda-f52a-4c3a-8740-a82e865872c2-console-serving-cert\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Apr 22 17:35:39.984818 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:39.984609 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dcde6eda-f52a-4c3a-8740-a82e865872c2-trusted-ca-bundle\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Apr 22 17:35:39.984818 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:39.984618 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wwfq8\" (UniqueName: \"kubernetes.io/projected/dcde6eda-f52a-4c3a-8740-a82e865872c2-kube-api-access-wwfq8\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Apr 22 17:35:39.984818 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:39.984627 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dcde6eda-f52a-4c3a-8740-a82e865872c2-console-oauth-config\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Apr 22 17:35:39.984818 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:39.984636 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dcde6eda-f52a-4c3a-8740-a82e865872c2-service-ca\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Apr 22 17:35:40.579874 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:40.579847 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-755667c6d-5m8bf_dcde6eda-f52a-4c3a-8740-a82e865872c2/console/0.log" Apr 22 17:35:40.580294 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:40.579889 2576 generic.go:358] "Generic (PLEG): container finished" podID="dcde6eda-f52a-4c3a-8740-a82e865872c2" containerID="8ae4d196be0e46e46199f6ff93ce67a750e3a12860db7cfca8d4c0490138981c" exitCode=2 Apr 22 17:35:40.580294 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:40.579952 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-755667c6d-5m8bf" Apr 22 17:35:40.580294 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:40.579983 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-755667c6d-5m8bf" event={"ID":"dcde6eda-f52a-4c3a-8740-a82e865872c2","Type":"ContainerDied","Data":"8ae4d196be0e46e46199f6ff93ce67a750e3a12860db7cfca8d4c0490138981c"} Apr 22 17:35:40.580294 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:40.580022 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-755667c6d-5m8bf" event={"ID":"dcde6eda-f52a-4c3a-8740-a82e865872c2","Type":"ContainerDied","Data":"0e6f1c84efd605cf8beca83fcc8ccaacaaaf766b2474b9918d199b32d2a42876"} Apr 22 17:35:40.580294 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:40.580038 2576 scope.go:117] "RemoveContainer" containerID="8ae4d196be0e46e46199f6ff93ce67a750e3a12860db7cfca8d4c0490138981c" Apr 22 17:35:40.593042 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:40.593024 2576 scope.go:117] "RemoveContainer" containerID="8ae4d196be0e46e46199f6ff93ce67a750e3a12860db7cfca8d4c0490138981c" Apr 22 17:35:40.593322 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:35:40.593304 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ae4d196be0e46e46199f6ff93ce67a750e3a12860db7cfca8d4c0490138981c\": container with ID starting with 8ae4d196be0e46e46199f6ff93ce67a750e3a12860db7cfca8d4c0490138981c not found: ID does not exist" containerID="8ae4d196be0e46e46199f6ff93ce67a750e3a12860db7cfca8d4c0490138981c" Apr 22 17:35:40.593370 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:40.593331 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ae4d196be0e46e46199f6ff93ce67a750e3a12860db7cfca8d4c0490138981c"} err="failed to get container status \"8ae4d196be0e46e46199f6ff93ce67a750e3a12860db7cfca8d4c0490138981c\": rpc error: code = NotFound desc = could not find container \"8ae4d196be0e46e46199f6ff93ce67a750e3a12860db7cfca8d4c0490138981c\": container with ID starting with 8ae4d196be0e46e46199f6ff93ce67a750e3a12860db7cfca8d4c0490138981c not found: ID does not exist" Apr 22 17:35:40.603219 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:40.603195 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-755667c6d-5m8bf"] Apr 22 17:35:40.607364 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:40.607344 2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-755667c6d-5m8bf"] Apr 22 17:35:41.071861 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:41.071826 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dcde6eda-f52a-4c3a-8740-a82e865872c2" path="/var/lib/kubelet/pods/dcde6eda-f52a-4c3a-8740-a82e865872c2/volumes" Apr 22 17:35:41.924843 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:41.924811 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-c765d567f-47zkv" Apr 22 17:35:41.929067 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:41.929043 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-c765d567f-47zkv" Apr 22 17:35:47.530536 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:47.530496 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Apr 22 17:35:47.530962 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:47.530936 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="199c16a5-4ca0-4ffc-85d7-049b85038db0" containerName="alertmanager" containerID="cri-o://8c0ce7f837ed4c9ca3e2867a660f605e54be572a69f54f14ff18f16ce2dfec7d" gracePeriod=120 Apr 22 17:35:47.531024 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:47.530998 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="199c16a5-4ca0-4ffc-85d7-049b85038db0" containerName="kube-rbac-proxy-metric" containerID="cri-o://5c2e3dbb91907ea5c2bee00c91629f5dbc479d7ce410d286c9725e8d1c6b179d" gracePeriod=120 Apr 22 17:35:47.531117 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:47.531063 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="199c16a5-4ca0-4ffc-85d7-049b85038db0" containerName="kube-rbac-proxy" containerID="cri-o://c70c7854d7c6118f06b8b4128761d513ebff756f095f9910ef33ade51eb5fd82" gracePeriod=120 Apr 22 17:35:47.531117 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:47.531059 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="199c16a5-4ca0-4ffc-85d7-049b85038db0" containerName="kube-rbac-proxy-web" containerID="cri-o://f3ef20bda4e16e5c4dbd062a65db2e40283babe321740947769aab4ecb3b3547" gracePeriod=120 Apr 22 17:35:47.531117 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:47.531073 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="199c16a5-4ca0-4ffc-85d7-049b85038db0" containerName="config-reloader" containerID="cri-o://30d0ebc6d0958d50895912aa102ee47850b79875e9c8898aa3c04b5d7b784d86" gracePeriod=120 Apr 22 17:35:47.531967 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:47.531055 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="199c16a5-4ca0-4ffc-85d7-049b85038db0" containerName="prom-label-proxy" containerID="cri-o://4c7232ad825980121d48c7f0f7884a4ae4977564caed72de6eb048911415c0f3" gracePeriod=120 Apr 22 17:35:48.609994 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:48.609960 2576 generic.go:358] "Generic (PLEG): container finished" podID="199c16a5-4ca0-4ffc-85d7-049b85038db0" containerID="4c7232ad825980121d48c7f0f7884a4ae4977564caed72de6eb048911415c0f3" exitCode=0 Apr 22 17:35:48.609994 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:48.609985 2576 generic.go:358] "Generic (PLEG): container finished" podID="199c16a5-4ca0-4ffc-85d7-049b85038db0" containerID="5c2e3dbb91907ea5c2bee00c91629f5dbc479d7ce410d286c9725e8d1c6b179d" exitCode=0 Apr 22 17:35:48.609994 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:48.609995 2576 generic.go:358] "Generic (PLEG): container finished" podID="199c16a5-4ca0-4ffc-85d7-049b85038db0" containerID="c70c7854d7c6118f06b8b4128761d513ebff756f095f9910ef33ade51eb5fd82" exitCode=0 Apr 22 17:35:48.609994 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:48.610003 2576 generic.go:358] "Generic (PLEG): container finished" podID="199c16a5-4ca0-4ffc-85d7-049b85038db0" containerID="30d0ebc6d0958d50895912aa102ee47850b79875e9c8898aa3c04b5d7b784d86" exitCode=0 Apr 22 17:35:48.610508 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:48.610011 2576 generic.go:358] "Generic (PLEG): container finished" podID="199c16a5-4ca0-4ffc-85d7-049b85038db0" containerID="8c0ce7f837ed4c9ca3e2867a660f605e54be572a69f54f14ff18f16ce2dfec7d" exitCode=0 Apr 22 17:35:48.610508 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:48.610029 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"199c16a5-4ca0-4ffc-85d7-049b85038db0","Type":"ContainerDied","Data":"4c7232ad825980121d48c7f0f7884a4ae4977564caed72de6eb048911415c0f3"} Apr 22 17:35:48.610508 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:48.610062 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"199c16a5-4ca0-4ffc-85d7-049b85038db0","Type":"ContainerDied","Data":"5c2e3dbb91907ea5c2bee00c91629f5dbc479d7ce410d286c9725e8d1c6b179d"} Apr 22 17:35:48.610508 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:48.610072 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"199c16a5-4ca0-4ffc-85d7-049b85038db0","Type":"ContainerDied","Data":"c70c7854d7c6118f06b8b4128761d513ebff756f095f9910ef33ade51eb5fd82"} Apr 22 17:35:48.610508 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:48.610083 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"199c16a5-4ca0-4ffc-85d7-049b85038db0","Type":"ContainerDied","Data":"30d0ebc6d0958d50895912aa102ee47850b79875e9c8898aa3c04b5d7b784d86"} Apr 22 17:35:48.610508 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:48.610092 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"199c16a5-4ca0-4ffc-85d7-049b85038db0","Type":"ContainerDied","Data":"8c0ce7f837ed4c9ca3e2867a660f605e54be572a69f54f14ff18f16ce2dfec7d"} Apr 22 17:35:48.806077 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:48.806056 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:35:48.868312 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:48.868238 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/199c16a5-4ca0-4ffc-85d7-049b85038db0-secret-alertmanager-kube-rbac-proxy\") pod \"199c16a5-4ca0-4ffc-85d7-049b85038db0\" (UID: \"199c16a5-4ca0-4ffc-85d7-049b85038db0\") " Apr 22 17:35:48.868312 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:48.868293 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/199c16a5-4ca0-4ffc-85d7-049b85038db0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"199c16a5-4ca0-4ffc-85d7-049b85038db0\" (UID: \"199c16a5-4ca0-4ffc-85d7-049b85038db0\") " Apr 22 17:35:48.868512 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:48.868323 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/199c16a5-4ca0-4ffc-85d7-049b85038db0-cluster-tls-config\") pod \"199c16a5-4ca0-4ffc-85d7-049b85038db0\" (UID: \"199c16a5-4ca0-4ffc-85d7-049b85038db0\") " Apr 22 17:35:48.868512 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:48.868355 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/199c16a5-4ca0-4ffc-85d7-049b85038db0-secret-alertmanager-kube-rbac-proxy-web\") pod \"199c16a5-4ca0-4ffc-85d7-049b85038db0\" (UID: \"199c16a5-4ca0-4ffc-85d7-049b85038db0\") " Apr 22 17:35:48.868512 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:48.868382 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/199c16a5-4ca0-4ffc-85d7-049b85038db0-metrics-client-ca\") pod \"199c16a5-4ca0-4ffc-85d7-049b85038db0\" (UID: \"199c16a5-4ca0-4ffc-85d7-049b85038db0\") " Apr 22 17:35:48.868512 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:48.868415 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/199c16a5-4ca0-4ffc-85d7-049b85038db0-secret-alertmanager-main-tls\") pod \"199c16a5-4ca0-4ffc-85d7-049b85038db0\" (UID: \"199c16a5-4ca0-4ffc-85d7-049b85038db0\") " Apr 22 17:35:48.868512 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:48.868445 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/199c16a5-4ca0-4ffc-85d7-049b85038db0-config-out\") pod \"199c16a5-4ca0-4ffc-85d7-049b85038db0\" (UID: \"199c16a5-4ca0-4ffc-85d7-049b85038db0\") " Apr 22 17:35:48.868512 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:48.868482 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/199c16a5-4ca0-4ffc-85d7-049b85038db0-alertmanager-main-db\") pod \"199c16a5-4ca0-4ffc-85d7-049b85038db0\" (UID: \"199c16a5-4ca0-4ffc-85d7-049b85038db0\") " Apr 22 17:35:48.868512 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:48.868506 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/199c16a5-4ca0-4ffc-85d7-049b85038db0-web-config\") pod \"199c16a5-4ca0-4ffc-85d7-049b85038db0\" (UID: \"199c16a5-4ca0-4ffc-85d7-049b85038db0\") " Apr 22 17:35:48.868825 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:48.868537 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/199c16a5-4ca0-4ffc-85d7-049b85038db0-alertmanager-trusted-ca-bundle\") pod \"199c16a5-4ca0-4ffc-85d7-049b85038db0\" (UID: \"199c16a5-4ca0-4ffc-85d7-049b85038db0\") " Apr 22 17:35:48.868825 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:48.868566 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/199c16a5-4ca0-4ffc-85d7-049b85038db0-config-volume\") pod \"199c16a5-4ca0-4ffc-85d7-049b85038db0\" (UID: \"199c16a5-4ca0-4ffc-85d7-049b85038db0\") " Apr 22 17:35:48.868825 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:48.868606 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/199c16a5-4ca0-4ffc-85d7-049b85038db0-tls-assets\") pod \"199c16a5-4ca0-4ffc-85d7-049b85038db0\" (UID: \"199c16a5-4ca0-4ffc-85d7-049b85038db0\") " Apr 22 17:35:48.868825 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:48.868649 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zdmkt\" (UniqueName: \"kubernetes.io/projected/199c16a5-4ca0-4ffc-85d7-049b85038db0-kube-api-access-zdmkt\") pod \"199c16a5-4ca0-4ffc-85d7-049b85038db0\" (UID: \"199c16a5-4ca0-4ffc-85d7-049b85038db0\") " Apr 22 17:35:48.869033 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:48.869004 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/199c16a5-4ca0-4ffc-85d7-049b85038db0-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "199c16a5-4ca0-4ffc-85d7-049b85038db0" (UID: "199c16a5-4ca0-4ffc-85d7-049b85038db0"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 22 17:35:48.869099 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:48.869017 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/199c16a5-4ca0-4ffc-85d7-049b85038db0-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "199c16a5-4ca0-4ffc-85d7-049b85038db0" (UID: "199c16a5-4ca0-4ffc-85d7-049b85038db0"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 22 17:35:48.869575 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:48.869530 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/199c16a5-4ca0-4ffc-85d7-049b85038db0-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "199c16a5-4ca0-4ffc-85d7-049b85038db0" (UID: "199c16a5-4ca0-4ffc-85d7-049b85038db0"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Apr 22 17:35:48.872535 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:48.872498 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/199c16a5-4ca0-4ffc-85d7-049b85038db0-config-volume" (OuterVolumeSpecName: "config-volume") pod "199c16a5-4ca0-4ffc-85d7-049b85038db0" (UID: "199c16a5-4ca0-4ffc-85d7-049b85038db0"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 22 17:35:48.872848 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:48.872811 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/199c16a5-4ca0-4ffc-85d7-049b85038db0-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "199c16a5-4ca0-4ffc-85d7-049b85038db0" (UID: "199c16a5-4ca0-4ffc-85d7-049b85038db0"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 22 17:35:48.873314 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:48.873247 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/199c16a5-4ca0-4ffc-85d7-049b85038db0-kube-api-access-zdmkt" (OuterVolumeSpecName: "kube-api-access-zdmkt") pod "199c16a5-4ca0-4ffc-85d7-049b85038db0" (UID: "199c16a5-4ca0-4ffc-85d7-049b85038db0"). InnerVolumeSpecName "kube-api-access-zdmkt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 22 17:35:48.873314 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:48.873248 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/199c16a5-4ca0-4ffc-85d7-049b85038db0-config-out" (OuterVolumeSpecName: "config-out") pod "199c16a5-4ca0-4ffc-85d7-049b85038db0" (UID: "199c16a5-4ca0-4ffc-85d7-049b85038db0"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Apr 22 17:35:48.873314 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:48.873248 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/199c16a5-4ca0-4ffc-85d7-049b85038db0-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "199c16a5-4ca0-4ffc-85d7-049b85038db0" (UID: "199c16a5-4ca0-4ffc-85d7-049b85038db0"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 22 17:35:48.873702 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:48.873661 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/199c16a5-4ca0-4ffc-85d7-049b85038db0-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "199c16a5-4ca0-4ffc-85d7-049b85038db0" (UID: "199c16a5-4ca0-4ffc-85d7-049b85038db0"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 22 17:35:48.874476 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:48.874446 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/199c16a5-4ca0-4ffc-85d7-049b85038db0-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "199c16a5-4ca0-4ffc-85d7-049b85038db0" (UID: "199c16a5-4ca0-4ffc-85d7-049b85038db0"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 22 17:35:48.875059 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:48.875027 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/199c16a5-4ca0-4ffc-85d7-049b85038db0-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "199c16a5-4ca0-4ffc-85d7-049b85038db0" (UID: "199c16a5-4ca0-4ffc-85d7-049b85038db0"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 22 17:35:48.878118 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:48.878088 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/199c16a5-4ca0-4ffc-85d7-049b85038db0-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "199c16a5-4ca0-4ffc-85d7-049b85038db0" (UID: "199c16a5-4ca0-4ffc-85d7-049b85038db0"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 22 17:35:48.886053 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:48.886022 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/199c16a5-4ca0-4ffc-85d7-049b85038db0-web-config" (OuterVolumeSpecName: "web-config") pod "199c16a5-4ca0-4ffc-85d7-049b85038db0" (UID: "199c16a5-4ca0-4ffc-85d7-049b85038db0"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 22 17:35:48.969740 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:48.969709 2576 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/199c16a5-4ca0-4ffc-85d7-049b85038db0-alertmanager-main-db\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Apr 22 17:35:48.969740 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:48.969734 2576 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/199c16a5-4ca0-4ffc-85d7-049b85038db0-web-config\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Apr 22 17:35:48.969740 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:48.969744 2576 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/199c16a5-4ca0-4ffc-85d7-049b85038db0-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Apr 22 17:35:48.969941 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:48.969756 2576 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/199c16a5-4ca0-4ffc-85d7-049b85038db0-config-volume\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Apr 22 17:35:48.969941 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:48.969766 2576 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/199c16a5-4ca0-4ffc-85d7-049b85038db0-tls-assets\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Apr 22 17:35:48.969941 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:48.969774 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zdmkt\" (UniqueName: \"kubernetes.io/projected/199c16a5-4ca0-4ffc-85d7-049b85038db0-kube-api-access-zdmkt\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Apr 22 17:35:48.969941 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:48.969783 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/199c16a5-4ca0-4ffc-85d7-049b85038db0-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Apr 22 17:35:48.969941 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:48.969793 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/199c16a5-4ca0-4ffc-85d7-049b85038db0-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Apr 22 17:35:48.969941 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:48.969802 2576 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/199c16a5-4ca0-4ffc-85d7-049b85038db0-cluster-tls-config\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Apr 22 17:35:48.969941 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:48.969812 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/199c16a5-4ca0-4ffc-85d7-049b85038db0-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Apr 22 17:35:48.969941 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:48.969820 2576 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/199c16a5-4ca0-4ffc-85d7-049b85038db0-metrics-client-ca\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Apr 22 17:35:48.969941 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:48.969828 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/199c16a5-4ca0-4ffc-85d7-049b85038db0-secret-alertmanager-main-tls\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Apr 22 17:35:48.969941 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:48.969836 2576 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/199c16a5-4ca0-4ffc-85d7-049b85038db0-config-out\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Apr 22 17:35:49.616263 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.616218 2576 generic.go:358] "Generic (PLEG): container finished" podID="199c16a5-4ca0-4ffc-85d7-049b85038db0" containerID="f3ef20bda4e16e5c4dbd062a65db2e40283babe321740947769aab4ecb3b3547" exitCode=0 Apr 22 17:35:49.616717 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.616306 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"199c16a5-4ca0-4ffc-85d7-049b85038db0","Type":"ContainerDied","Data":"f3ef20bda4e16e5c4dbd062a65db2e40283babe321740947769aab4ecb3b3547"} Apr 22 17:35:49.616717 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.616360 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"199c16a5-4ca0-4ffc-85d7-049b85038db0","Type":"ContainerDied","Data":"a6919cecb13b52f55fd0075a3d43358aa2e589ec356e224501beaff167d6ecd3"} Apr 22 17:35:49.616717 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.616365 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:35:49.616717 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.616385 2576 scope.go:117] "RemoveContainer" containerID="4c7232ad825980121d48c7f0f7884a4ae4977564caed72de6eb048911415c0f3" Apr 22 17:35:49.624157 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.624141 2576 scope.go:117] "RemoveContainer" containerID="5c2e3dbb91907ea5c2bee00c91629f5dbc479d7ce410d286c9725e8d1c6b179d" Apr 22 17:35:49.630947 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.630929 2576 scope.go:117] "RemoveContainer" containerID="c70c7854d7c6118f06b8b4128761d513ebff756f095f9910ef33ade51eb5fd82" Apr 22 17:35:49.637566 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.637541 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Apr 22 17:35:49.640932 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.639296 2576 scope.go:117] "RemoveContainer" containerID="f3ef20bda4e16e5c4dbd062a65db2e40283babe321740947769aab4ecb3b3547" Apr 22 17:35:49.642691 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.642669 2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Apr 22 17:35:49.649352 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.649140 2576 scope.go:117] "RemoveContainer" containerID="30d0ebc6d0958d50895912aa102ee47850b79875e9c8898aa3c04b5d7b784d86" Apr 22 17:35:49.656294 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.656276 2576 scope.go:117] "RemoveContainer" containerID="8c0ce7f837ed4c9ca3e2867a660f605e54be572a69f54f14ff18f16ce2dfec7d" Apr 22 17:35:49.663699 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.663681 2576 scope.go:117] "RemoveContainer" containerID="614e974ec1594a23e9d31b853236dbaaea9528e65eeb3140498e7724c4410342" Apr 22 17:35:49.671371 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.671205 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Apr 22 17:35:49.671452 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.671394 2576 scope.go:117] "RemoveContainer" containerID="4c7232ad825980121d48c7f0f7884a4ae4977564caed72de6eb048911415c0f3" Apr 22 17:35:49.671633 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.671615 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="199c16a5-4ca0-4ffc-85d7-049b85038db0" containerName="kube-rbac-proxy-web" Apr 22 17:35:49.671694 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.671636 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="199c16a5-4ca0-4ffc-85d7-049b85038db0" containerName="kube-rbac-proxy-web" Apr 22 17:35:49.671694 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.671646 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="199c16a5-4ca0-4ffc-85d7-049b85038db0" containerName="init-config-reloader" Apr 22 17:35:49.671694 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.671652 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="199c16a5-4ca0-4ffc-85d7-049b85038db0" containerName="init-config-reloader" Apr 22 17:35:49.671694 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.671658 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="199c16a5-4ca0-4ffc-85d7-049b85038db0" containerName="kube-rbac-proxy-metric" Apr 22 17:35:49.671694 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.671663 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="199c16a5-4ca0-4ffc-85d7-049b85038db0" containerName="kube-rbac-proxy-metric" Apr 22 17:35:49.671694 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.671676 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="199c16a5-4ca0-4ffc-85d7-049b85038db0" containerName="kube-rbac-proxy" Apr 22 17:35:49.671694 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.671682 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="199c16a5-4ca0-4ffc-85d7-049b85038db0" containerName="kube-rbac-proxy" Apr 22 17:35:49.671694 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.671694 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18e08482-c36e-401e-962d-668b99942463" containerName="console" Apr 22 17:35:49.672024 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.671702 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="18e08482-c36e-401e-962d-668b99942463" containerName="console" Apr 22 17:35:49.672024 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.671708 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="199c16a5-4ca0-4ffc-85d7-049b85038db0" containerName="alertmanager" Apr 22 17:35:49.672024 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.671713 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="199c16a5-4ca0-4ffc-85d7-049b85038db0" containerName="alertmanager" Apr 22 17:35:49.672024 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.671720 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="199c16a5-4ca0-4ffc-85d7-049b85038db0" containerName="config-reloader" Apr 22 17:35:49.672024 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.671725 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="199c16a5-4ca0-4ffc-85d7-049b85038db0" containerName="config-reloader" Apr 22 17:35:49.672024 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.671733 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcde6eda-f52a-4c3a-8740-a82e865872c2" containerName="console" Apr 22 17:35:49.672024 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.671738 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcde6eda-f52a-4c3a-8740-a82e865872c2" containerName="console" Apr 22 17:35:49.672024 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.671745 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="199c16a5-4ca0-4ffc-85d7-049b85038db0" containerName="prom-label-proxy" Apr 22 17:35:49.672024 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.671750 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="199c16a5-4ca0-4ffc-85d7-049b85038db0" containerName="prom-label-proxy" Apr 22 17:35:49.672024 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:35:49.671714 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c7232ad825980121d48c7f0f7884a4ae4977564caed72de6eb048911415c0f3\": container with ID starting with 4c7232ad825980121d48c7f0f7884a4ae4977564caed72de6eb048911415c0f3 not found: ID does not exist" containerID="4c7232ad825980121d48c7f0f7884a4ae4977564caed72de6eb048911415c0f3" Apr 22 17:35:49.672024 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.671801 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="199c16a5-4ca0-4ffc-85d7-049b85038db0" containerName="alertmanager" Apr 22 17:35:49.672024 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.671809 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="199c16a5-4ca0-4ffc-85d7-049b85038db0" containerName="kube-rbac-proxy" Apr 22 17:35:49.672024 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.671816 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="199c16a5-4ca0-4ffc-85d7-049b85038db0" containerName="kube-rbac-proxy-metric" Apr 22 17:35:49.672024 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.671822 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="199c16a5-4ca0-4ffc-85d7-049b85038db0" containerName="prom-label-proxy" Apr 22 17:35:49.672024 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.671828 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="18e08482-c36e-401e-962d-668b99942463" containerName="console" Apr 22 17:35:49.672024 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.671817 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c7232ad825980121d48c7f0f7884a4ae4977564caed72de6eb048911415c0f3"} err="failed to get container status \"4c7232ad825980121d48c7f0f7884a4ae4977564caed72de6eb048911415c0f3\": rpc error: code = NotFound desc = could not find container \"4c7232ad825980121d48c7f0f7884a4ae4977564caed72de6eb048911415c0f3\": container with ID starting with 4c7232ad825980121d48c7f0f7884a4ae4977564caed72de6eb048911415c0f3 not found: ID does not exist" Apr 22 17:35:49.672024 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.671855 2576 scope.go:117] "RemoveContainer" containerID="5c2e3dbb91907ea5c2bee00c91629f5dbc479d7ce410d286c9725e8d1c6b179d" Apr 22 17:35:49.672024 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.671836 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="199c16a5-4ca0-4ffc-85d7-049b85038db0" containerName="config-reloader" Apr 22 17:35:49.672024 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.671927 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="dcde6eda-f52a-4c3a-8740-a82e865872c2" containerName="console" Apr 22 17:35:49.672024 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.671941 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="199c16a5-4ca0-4ffc-85d7-049b85038db0" containerName="kube-rbac-proxy-web" Apr 22 17:35:49.672956 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:35:49.672132 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c2e3dbb91907ea5c2bee00c91629f5dbc479d7ce410d286c9725e8d1c6b179d\": container with ID starting with 5c2e3dbb91907ea5c2bee00c91629f5dbc479d7ce410d286c9725e8d1c6b179d not found: ID does not exist" containerID="5c2e3dbb91907ea5c2bee00c91629f5dbc479d7ce410d286c9725e8d1c6b179d" Apr 22 17:35:49.672956 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.672155 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c2e3dbb91907ea5c2bee00c91629f5dbc479d7ce410d286c9725e8d1c6b179d"} err="failed to get container status \"5c2e3dbb91907ea5c2bee00c91629f5dbc479d7ce410d286c9725e8d1c6b179d\": rpc error: code = NotFound desc = could not find container \"5c2e3dbb91907ea5c2bee00c91629f5dbc479d7ce410d286c9725e8d1c6b179d\": container with ID starting with 5c2e3dbb91907ea5c2bee00c91629f5dbc479d7ce410d286c9725e8d1c6b179d not found: ID does not exist" Apr 22 17:35:49.672956 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.672370 2576 scope.go:117] "RemoveContainer" containerID="c70c7854d7c6118f06b8b4128761d513ebff756f095f9910ef33ade51eb5fd82" Apr 22 17:35:49.672956 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:35:49.672718 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c70c7854d7c6118f06b8b4128761d513ebff756f095f9910ef33ade51eb5fd82\": container with ID starting with c70c7854d7c6118f06b8b4128761d513ebff756f095f9910ef33ade51eb5fd82 not found: ID does not exist" containerID="c70c7854d7c6118f06b8b4128761d513ebff756f095f9910ef33ade51eb5fd82" Apr 22 17:35:49.672956 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.672751 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c70c7854d7c6118f06b8b4128761d513ebff756f095f9910ef33ade51eb5fd82"} err="failed to get container status \"c70c7854d7c6118f06b8b4128761d513ebff756f095f9910ef33ade51eb5fd82\": rpc error: code = NotFound desc = could not find container \"c70c7854d7c6118f06b8b4128761d513ebff756f095f9910ef33ade51eb5fd82\": container with ID starting with c70c7854d7c6118f06b8b4128761d513ebff756f095f9910ef33ade51eb5fd82 not found: ID does not exist" Apr 22 17:35:49.672956 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.672772 2576 scope.go:117] "RemoveContainer" containerID="f3ef20bda4e16e5c4dbd062a65db2e40283babe321740947769aab4ecb3b3547" Apr 22 17:35:49.673271 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:35:49.673045 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3ef20bda4e16e5c4dbd062a65db2e40283babe321740947769aab4ecb3b3547\": container with ID starting with f3ef20bda4e16e5c4dbd062a65db2e40283babe321740947769aab4ecb3b3547 not found: ID does not exist" containerID="f3ef20bda4e16e5c4dbd062a65db2e40283babe321740947769aab4ecb3b3547" Apr 22 17:35:49.673271 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.673066 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3ef20bda4e16e5c4dbd062a65db2e40283babe321740947769aab4ecb3b3547"} err="failed to get container status \"f3ef20bda4e16e5c4dbd062a65db2e40283babe321740947769aab4ecb3b3547\": rpc error: code = NotFound desc = could not find container \"f3ef20bda4e16e5c4dbd062a65db2e40283babe321740947769aab4ecb3b3547\": container with ID starting with f3ef20bda4e16e5c4dbd062a65db2e40283babe321740947769aab4ecb3b3547 not found: ID does not exist" Apr 22 17:35:49.673271 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.673081 2576 scope.go:117] "RemoveContainer" containerID="30d0ebc6d0958d50895912aa102ee47850b79875e9c8898aa3c04b5d7b784d86" Apr 22 17:35:49.673409 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:35:49.673314 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30d0ebc6d0958d50895912aa102ee47850b79875e9c8898aa3c04b5d7b784d86\": container with ID starting with 30d0ebc6d0958d50895912aa102ee47850b79875e9c8898aa3c04b5d7b784d86 not found: ID does not exist" containerID="30d0ebc6d0958d50895912aa102ee47850b79875e9c8898aa3c04b5d7b784d86" Apr 22 17:35:49.673409 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.673334 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30d0ebc6d0958d50895912aa102ee47850b79875e9c8898aa3c04b5d7b784d86"} err="failed to get container status \"30d0ebc6d0958d50895912aa102ee47850b79875e9c8898aa3c04b5d7b784d86\": rpc error: code = NotFound desc = could not find container \"30d0ebc6d0958d50895912aa102ee47850b79875e9c8898aa3c04b5d7b784d86\": container with ID starting with 30d0ebc6d0958d50895912aa102ee47850b79875e9c8898aa3c04b5d7b784d86 not found: ID does not exist" Apr 22 17:35:49.673409 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.673347 2576 scope.go:117] "RemoveContainer" containerID="8c0ce7f837ed4c9ca3e2867a660f605e54be572a69f54f14ff18f16ce2dfec7d" Apr 22 17:35:49.673569 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:35:49.673547 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c0ce7f837ed4c9ca3e2867a660f605e54be572a69f54f14ff18f16ce2dfec7d\": container with ID starting with 8c0ce7f837ed4c9ca3e2867a660f605e54be572a69f54f14ff18f16ce2dfec7d not found: ID does not exist" containerID="8c0ce7f837ed4c9ca3e2867a660f605e54be572a69f54f14ff18f16ce2dfec7d" Apr 22 17:35:49.673619 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.673575 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c0ce7f837ed4c9ca3e2867a660f605e54be572a69f54f14ff18f16ce2dfec7d"} err="failed to get container status \"8c0ce7f837ed4c9ca3e2867a660f605e54be572a69f54f14ff18f16ce2dfec7d\": rpc error: code = NotFound desc = could not find container \"8c0ce7f837ed4c9ca3e2867a660f605e54be572a69f54f14ff18f16ce2dfec7d\": container with ID starting with 8c0ce7f837ed4c9ca3e2867a660f605e54be572a69f54f14ff18f16ce2dfec7d not found: ID does not exist" Apr 22 17:35:49.673619 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.673591 2576 scope.go:117] "RemoveContainer" containerID="614e974ec1594a23e9d31b853236dbaaea9528e65eeb3140498e7724c4410342" Apr 22 17:35:49.673854 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:35:49.673832 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"614e974ec1594a23e9d31b853236dbaaea9528e65eeb3140498e7724c4410342\": container with ID starting with 614e974ec1594a23e9d31b853236dbaaea9528e65eeb3140498e7724c4410342 not found: ID does not exist" containerID="614e974ec1594a23e9d31b853236dbaaea9528e65eeb3140498e7724c4410342" Apr 22 17:35:49.673925 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.673855 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"614e974ec1594a23e9d31b853236dbaaea9528e65eeb3140498e7724c4410342"} err="failed to get container status \"614e974ec1594a23e9d31b853236dbaaea9528e65eeb3140498e7724c4410342\": rpc error: code = NotFound desc = could not find container \"614e974ec1594a23e9d31b853236dbaaea9528e65eeb3140498e7724c4410342\": container with ID starting with 614e974ec1594a23e9d31b853236dbaaea9528e65eeb3140498e7724c4410342 not found: ID does not exist" Apr 22 17:35:49.676158 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.676140 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:35:49.678488 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.678470 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Apr 22 17:35:49.678691 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.678677 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Apr 22 17:35:49.678781 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.678718 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Apr 22 17:35:49.678781 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.678774 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Apr 22 17:35:49.678900 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.678886 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Apr 22 17:35:49.678957 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.678889 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Apr 22 17:35:49.679011 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.678959 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Apr 22 17:35:49.679287 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.679268 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-gjcbn\"" Apr 22 17:35:49.679412 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.679390 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Apr 22 17:35:49.684908 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.684891 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Apr 22 17:35:49.695538 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.695515 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Apr 22 17:35:49.775162 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.775129 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9976dfee-1fd7-40c0-a1d6-ca27f66142a0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9976dfee-1fd7-40c0-a1d6-ca27f66142a0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:35:49.775345 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.775204 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9976dfee-1fd7-40c0-a1d6-ca27f66142a0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9976dfee-1fd7-40c0-a1d6-ca27f66142a0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:35:49.775345 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.775280 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9976dfee-1fd7-40c0-a1d6-ca27f66142a0-config-out\") pod \"alertmanager-main-0\" (UID: \"9976dfee-1fd7-40c0-a1d6-ca27f66142a0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:35:49.775345 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.775323 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9976dfee-1fd7-40c0-a1d6-ca27f66142a0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9976dfee-1fd7-40c0-a1d6-ca27f66142a0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:35:49.775345 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.775345 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9976dfee-1fd7-40c0-a1d6-ca27f66142a0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9976dfee-1fd7-40c0-a1d6-ca27f66142a0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:35:49.775508 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.775365 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9976dfee-1fd7-40c0-a1d6-ca27f66142a0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9976dfee-1fd7-40c0-a1d6-ca27f66142a0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:35:49.775508 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.775436 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9976dfee-1fd7-40c0-a1d6-ca27f66142a0-web-config\") pod \"alertmanager-main-0\" (UID: \"9976dfee-1fd7-40c0-a1d6-ca27f66142a0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:35:49.775508 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.775464 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9976dfee-1fd7-40c0-a1d6-ca27f66142a0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9976dfee-1fd7-40c0-a1d6-ca27f66142a0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:35:49.775508 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.775484 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6drj\" (UniqueName: \"kubernetes.io/projected/9976dfee-1fd7-40c0-a1d6-ca27f66142a0-kube-api-access-c6drj\") pod \"alertmanager-main-0\" (UID: \"9976dfee-1fd7-40c0-a1d6-ca27f66142a0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:35:49.775642 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.775511 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9976dfee-1fd7-40c0-a1d6-ca27f66142a0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9976dfee-1fd7-40c0-a1d6-ca27f66142a0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:35:49.775642 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.775563 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9976dfee-1fd7-40c0-a1d6-ca27f66142a0-config-volume\") pod \"alertmanager-main-0\" (UID: \"9976dfee-1fd7-40c0-a1d6-ca27f66142a0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:35:49.775642 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.775616 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9976dfee-1fd7-40c0-a1d6-ca27f66142a0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9976dfee-1fd7-40c0-a1d6-ca27f66142a0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:35:49.775642 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.775635 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9976dfee-1fd7-40c0-a1d6-ca27f66142a0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9976dfee-1fd7-40c0-a1d6-ca27f66142a0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:35:49.876419 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.876330 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9976dfee-1fd7-40c0-a1d6-ca27f66142a0-config-out\") pod \"alertmanager-main-0\" (UID: \"9976dfee-1fd7-40c0-a1d6-ca27f66142a0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:35:49.876419 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.876370 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9976dfee-1fd7-40c0-a1d6-ca27f66142a0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9976dfee-1fd7-40c0-a1d6-ca27f66142a0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:35:49.876419 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.876397 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9976dfee-1fd7-40c0-a1d6-ca27f66142a0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9976dfee-1fd7-40c0-a1d6-ca27f66142a0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:35:49.876680 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.876426 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9976dfee-1fd7-40c0-a1d6-ca27f66142a0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9976dfee-1fd7-40c0-a1d6-ca27f66142a0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:35:49.876680 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.876460 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9976dfee-1fd7-40c0-a1d6-ca27f66142a0-web-config\") pod \"alertmanager-main-0\" (UID: \"9976dfee-1fd7-40c0-a1d6-ca27f66142a0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:35:49.876680 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.876477 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9976dfee-1fd7-40c0-a1d6-ca27f66142a0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9976dfee-1fd7-40c0-a1d6-ca27f66142a0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:35:49.876680 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.876495 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c6drj\" (UniqueName: \"kubernetes.io/projected/9976dfee-1fd7-40c0-a1d6-ca27f66142a0-kube-api-access-c6drj\") pod \"alertmanager-main-0\" (UID: \"9976dfee-1fd7-40c0-a1d6-ca27f66142a0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:35:49.876680 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.876519 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9976dfee-1fd7-40c0-a1d6-ca27f66142a0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9976dfee-1fd7-40c0-a1d6-ca27f66142a0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:35:49.876680 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.876543 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9976dfee-1fd7-40c0-a1d6-ca27f66142a0-config-volume\") pod \"alertmanager-main-0\" (UID: \"9976dfee-1fd7-40c0-a1d6-ca27f66142a0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:35:49.876680 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.876589 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9976dfee-1fd7-40c0-a1d6-ca27f66142a0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9976dfee-1fd7-40c0-a1d6-ca27f66142a0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:35:49.876680 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.876612 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9976dfee-1fd7-40c0-a1d6-ca27f66142a0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9976dfee-1fd7-40c0-a1d6-ca27f66142a0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:35:49.876680 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.876643 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9976dfee-1fd7-40c0-a1d6-ca27f66142a0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9976dfee-1fd7-40c0-a1d6-ca27f66142a0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:35:49.876680 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.876672 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9976dfee-1fd7-40c0-a1d6-ca27f66142a0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9976dfee-1fd7-40c0-a1d6-ca27f66142a0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:35:49.877098 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.876798 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9976dfee-1fd7-40c0-a1d6-ca27f66142a0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9976dfee-1fd7-40c0-a1d6-ca27f66142a0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:35:49.877873 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.877842 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9976dfee-1fd7-40c0-a1d6-ca27f66142a0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9976dfee-1fd7-40c0-a1d6-ca27f66142a0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:35:49.879561 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.879529 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9976dfee-1fd7-40c0-a1d6-ca27f66142a0-config-out\") pod \"alertmanager-main-0\" (UID: \"9976dfee-1fd7-40c0-a1d6-ca27f66142a0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:35:49.879848 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.879824 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9976dfee-1fd7-40c0-a1d6-ca27f66142a0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9976dfee-1fd7-40c0-a1d6-ca27f66142a0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:35:49.879947 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.879926 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9976dfee-1fd7-40c0-a1d6-ca27f66142a0-web-config\") pod \"alertmanager-main-0\" (UID: \"9976dfee-1fd7-40c0-a1d6-ca27f66142a0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:35:49.880102 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.880074 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9976dfee-1fd7-40c0-a1d6-ca27f66142a0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9976dfee-1fd7-40c0-a1d6-ca27f66142a0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:35:49.880244 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.880110 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9976dfee-1fd7-40c0-a1d6-ca27f66142a0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9976dfee-1fd7-40c0-a1d6-ca27f66142a0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:35:49.880411 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.880382 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9976dfee-1fd7-40c0-a1d6-ca27f66142a0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9976dfee-1fd7-40c0-a1d6-ca27f66142a0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:35:49.880497 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.880423 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9976dfee-1fd7-40c0-a1d6-ca27f66142a0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9976dfee-1fd7-40c0-a1d6-ca27f66142a0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:35:49.880672 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.880654 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9976dfee-1fd7-40c0-a1d6-ca27f66142a0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9976dfee-1fd7-40c0-a1d6-ca27f66142a0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:35:49.881497 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.881480 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9976dfee-1fd7-40c0-a1d6-ca27f66142a0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9976dfee-1fd7-40c0-a1d6-ca27f66142a0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:35:49.882062 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.882044 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9976dfee-1fd7-40c0-a1d6-ca27f66142a0-config-volume\") pod \"alertmanager-main-0\" (UID: \"9976dfee-1fd7-40c0-a1d6-ca27f66142a0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:35:49.884521 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.884501 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6drj\" (UniqueName: \"kubernetes.io/projected/9976dfee-1fd7-40c0-a1d6-ca27f66142a0-kube-api-access-c6drj\") pod \"alertmanager-main-0\" (UID: \"9976dfee-1fd7-40c0-a1d6-ca27f66142a0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:35:49.986058 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:49.986010 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Apr 22 17:35:50.116538 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:50.116508 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Apr 22 17:35:50.119118 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:35:50.119088 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9976dfee_1fd7_40c0_a1d6_ca27f66142a0.slice/crio-a2be82387e6625570a8aac87dd5d499d308f5e0b7511c3464c35faf1709de173 WatchSource:0}: Error finding container a2be82387e6625570a8aac87dd5d499d308f5e0b7511c3464c35faf1709de173: Status 404 returned error can't find the container with id a2be82387e6625570a8aac87dd5d499d308f5e0b7511c3464c35faf1709de173 Apr 22 17:35:50.621590 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:50.621555 2576 generic.go:358] "Generic (PLEG): container finished" podID="9976dfee-1fd7-40c0-a1d6-ca27f66142a0" containerID="1cbe7205b8ae117dd640f691dcb293856f5800df71d02dfd50249d98a8c3c7d6" exitCode=0 Apr 22 17:35:50.621959 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:50.621608 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9976dfee-1fd7-40c0-a1d6-ca27f66142a0","Type":"ContainerDied","Data":"1cbe7205b8ae117dd640f691dcb293856f5800df71d02dfd50249d98a8c3c7d6"} Apr 22 17:35:50.621959 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:50.621629 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9976dfee-1fd7-40c0-a1d6-ca27f66142a0","Type":"ContainerStarted","Data":"a2be82387e6625570a8aac87dd5d499d308f5e0b7511c3464c35faf1709de173"} Apr 22 17:35:51.072879 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:51.072843 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="199c16a5-4ca0-4ffc-85d7-049b85038db0" path="/var/lib/kubelet/pods/199c16a5-4ca0-4ffc-85d7-049b85038db0/volumes" Apr 22 17:35:51.629881 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:51.629842 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9976dfee-1fd7-40c0-a1d6-ca27f66142a0","Type":"ContainerStarted","Data":"d9b84dc62d75e7a1b7765a297193e0583b79443d48c552840344379156a2fbde"} Apr 22 17:35:51.630279 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:51.629888 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9976dfee-1fd7-40c0-a1d6-ca27f66142a0","Type":"ContainerStarted","Data":"194eb1334f14125f1f78acd1360959bc2139bb8ac4511e4fe4b2bcc45e1b5308"} Apr 22 17:35:51.630279 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:51.629906 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9976dfee-1fd7-40c0-a1d6-ca27f66142a0","Type":"ContainerStarted","Data":"3eb885f22b8705a51e3aaf2fc6d1f445fb6f0b47ecd9e3de75b9b4bb9f78acc1"} Apr 22 17:35:51.630279 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:51.629920 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9976dfee-1fd7-40c0-a1d6-ca27f66142a0","Type":"ContainerStarted","Data":"5ab301edbde49c1a706e6a236e77c5f88965d675c7ad7e53c6f5bffa0e7a9ed0"} Apr 22 17:35:51.630279 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:51.629933 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9976dfee-1fd7-40c0-a1d6-ca27f66142a0","Type":"ContainerStarted","Data":"ccc12d35192d94cfdee4c1ce1e4861ef0f0486599c4ebe73e35b6158856bc39b"} Apr 22 17:35:51.630279 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:51.629947 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9976dfee-1fd7-40c0-a1d6-ca27f66142a0","Type":"ContainerStarted","Data":"926dc9437a25fce87618eb356bad37327479b2d6acbb89c3fd9a8de8124faedb"} Apr 22 17:35:51.660470 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:51.660411 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.660391534 podStartE2EDuration="2.660391534s" podCreationTimestamp="2026-04-22 17:35:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-22 17:35:51.658157362 +0000 UTC m=+101.102720584" watchObservedRunningTime="2026-04-22 17:35:51.660391534 +0000 UTC m=+101.104954721" Apr 22 17:35:51.821619 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:51.821573 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Apr 22 17:35:51.822256 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:51.822219 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2415aeb6-b8ca-4064-b680-9c27f1406bb9" containerName="prometheus" containerID="cri-o://48c3cbe5406026f574072fc1368effd11ebca2ed1341e24f7b443285e8d65cf1" gracePeriod=600 Apr 22 17:35:51.822383 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:51.822254 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2415aeb6-b8ca-4064-b680-9c27f1406bb9" containerName="kube-rbac-proxy-web" containerID="cri-o://53f18a1f96fb91bf0b27680034f0b6ae6e82910b2370807695fa72304208f0a9" gracePeriod=600 Apr 22 17:35:51.822383 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:51.822265 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2415aeb6-b8ca-4064-b680-9c27f1406bb9" containerName="kube-rbac-proxy" containerID="cri-o://cd865d7f5795a395040e1b9b2e940c8fb0fd77c10986bf6da87dd11089efa037" gracePeriod=600 Apr 22 17:35:51.822383 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:51.822338 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2415aeb6-b8ca-4064-b680-9c27f1406bb9" containerName="thanos-sidecar" containerID="cri-o://0522b67d7bdff833cd68ad2271fc25d922352963028a6372169ad58161bd58b7" gracePeriod=600 Apr 22 17:35:51.822565 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:51.822387 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2415aeb6-b8ca-4064-b680-9c27f1406bb9" containerName="config-reloader" containerID="cri-o://ba81f69c5729e8b2a9fbe1f01e2879472bda0ab8227bd17fc036e211645ab9e9" gracePeriod=600 Apr 22 17:35:51.822565 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:51.822536 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2415aeb6-b8ca-4064-b680-9c27f1406bb9" containerName="kube-rbac-proxy-thanos" containerID="cri-o://9052fd90e8f6b6815d33f832884da8d03a2a9e2849fd9f5d52d8a1124e0f3179" gracePeriod=600 Apr 22 17:35:52.641107 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:52.641077 2576 generic.go:358] "Generic (PLEG): container finished" podID="2415aeb6-b8ca-4064-b680-9c27f1406bb9" containerID="9052fd90e8f6b6815d33f832884da8d03a2a9e2849fd9f5d52d8a1124e0f3179" exitCode=0 Apr 22 17:35:52.641107 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:52.641101 2576 generic.go:358] "Generic (PLEG): container finished" podID="2415aeb6-b8ca-4064-b680-9c27f1406bb9" containerID="cd865d7f5795a395040e1b9b2e940c8fb0fd77c10986bf6da87dd11089efa037" exitCode=0 Apr 22 17:35:52.641107 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:52.641107 2576 generic.go:358] "Generic (PLEG): container finished" podID="2415aeb6-b8ca-4064-b680-9c27f1406bb9" containerID="0522b67d7bdff833cd68ad2271fc25d922352963028a6372169ad58161bd58b7" exitCode=0 Apr 22 17:35:52.641107 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:52.641112 2576 generic.go:358] "Generic (PLEG): container finished" podID="2415aeb6-b8ca-4064-b680-9c27f1406bb9" containerID="ba81f69c5729e8b2a9fbe1f01e2879472bda0ab8227bd17fc036e211645ab9e9" exitCode=0 Apr 22 17:35:52.641107 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:52.641117 2576 generic.go:358] "Generic (PLEG): container finished" podID="2415aeb6-b8ca-4064-b680-9c27f1406bb9" containerID="48c3cbe5406026f574072fc1368effd11ebca2ed1341e24f7b443285e8d65cf1" exitCode=0 Apr 22 17:35:52.641604 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:52.641154 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2415aeb6-b8ca-4064-b680-9c27f1406bb9","Type":"ContainerDied","Data":"9052fd90e8f6b6815d33f832884da8d03a2a9e2849fd9f5d52d8a1124e0f3179"} Apr 22 17:35:52.641604 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:52.641209 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2415aeb6-b8ca-4064-b680-9c27f1406bb9","Type":"ContainerDied","Data":"cd865d7f5795a395040e1b9b2e940c8fb0fd77c10986bf6da87dd11089efa037"} Apr 22 17:35:52.641604 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:52.641223 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2415aeb6-b8ca-4064-b680-9c27f1406bb9","Type":"ContainerDied","Data":"0522b67d7bdff833cd68ad2271fc25d922352963028a6372169ad58161bd58b7"} Apr 22 17:35:52.641604 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:52.641236 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2415aeb6-b8ca-4064-b680-9c27f1406bb9","Type":"ContainerDied","Data":"ba81f69c5729e8b2a9fbe1f01e2879472bda0ab8227bd17fc036e211645ab9e9"} Apr 22 17:35:52.641604 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:52.641248 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2415aeb6-b8ca-4064-b680-9c27f1406bb9","Type":"ContainerDied","Data":"48c3cbe5406026f574072fc1368effd11ebca2ed1341e24f7b443285e8d65cf1"} Apr 22 17:35:53.059156 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.059135 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:53.109379 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.109353 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2415aeb6-b8ca-4064-b680-9c27f1406bb9-secret-prometheus-k8s-tls\") pod \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " Apr 22 17:35:53.109522 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.109395 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2415aeb6-b8ca-4064-b680-9c27f1406bb9-tls-assets\") pod \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " Apr 22 17:35:53.109522 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.109413 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2415aeb6-b8ca-4064-b680-9c27f1406bb9-config\") pod \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " Apr 22 17:35:53.109522 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.109443 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2415aeb6-b8ca-4064-b680-9c27f1406bb9-secret-grpc-tls\") pod \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " Apr 22 17:35:53.109522 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.109477 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2415aeb6-b8ca-4064-b680-9c27f1406bb9-configmap-serving-certs-ca-bundle\") pod \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " Apr 22 17:35:53.109771 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.109517 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2415aeb6-b8ca-4064-b680-9c27f1406bb9-prometheus-trusted-ca-bundle\") pod \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " Apr 22 17:35:53.109771 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.109575 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2415aeb6-b8ca-4064-b680-9c27f1406bb9-secret-kube-rbac-proxy\") pod \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " Apr 22 17:35:53.109771 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.109600 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2415aeb6-b8ca-4064-b680-9c27f1406bb9-configmap-kubelet-serving-ca-bundle\") pod \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " Apr 22 17:35:53.109771 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.109623 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2415aeb6-b8ca-4064-b680-9c27f1406bb9-configmap-metrics-client-ca\") pod \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " Apr 22 17:35:53.109771 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.109652 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2415aeb6-b8ca-4064-b680-9c27f1406bb9-prometheus-k8s-db\") pod \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " Apr 22 17:35:53.109771 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.109696 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rldrr\" (UniqueName: \"kubernetes.io/projected/2415aeb6-b8ca-4064-b680-9c27f1406bb9-kube-api-access-rldrr\") pod \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " Apr 22 17:35:53.109771 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.109722 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2415aeb6-b8ca-4064-b680-9c27f1406bb9-web-config\") pod \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " Apr 22 17:35:53.110108 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.109852 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2415aeb6-b8ca-4064-b680-9c27f1406bb9-secret-metrics-client-certs\") pod \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " Apr 22 17:35:53.110108 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.109935 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2415aeb6-b8ca-4064-b680-9c27f1406bb9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " Apr 22 17:35:53.110108 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.109979 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2415aeb6-b8ca-4064-b680-9c27f1406bb9-prometheus-k8s-rulefiles-0\") pod \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " Apr 22 17:35:53.110108 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.110043 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2415aeb6-b8ca-4064-b680-9c27f1406bb9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " Apr 22 17:35:53.110108 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.110070 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2415aeb6-b8ca-4064-b680-9c27f1406bb9-thanos-prometheus-http-client-file\") pod \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " Apr 22 17:35:53.110108 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.110083 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2415aeb6-b8ca-4064-b680-9c27f1406bb9-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "2415aeb6-b8ca-4064-b680-9c27f1406bb9" (UID: "2415aeb6-b8ca-4064-b680-9c27f1406bb9"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 22 17:35:53.112553 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.110114 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2415aeb6-b8ca-4064-b680-9c27f1406bb9-config-out\") pod \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\" (UID: \"2415aeb6-b8ca-4064-b680-9c27f1406bb9\") " Apr 22 17:35:53.112553 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.110614 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2415aeb6-b8ca-4064-b680-9c27f1406bb9-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "2415aeb6-b8ca-4064-b680-9c27f1406bb9" (UID: "2415aeb6-b8ca-4064-b680-9c27f1406bb9"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 22 17:35:53.112553 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.111046 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2415aeb6-b8ca-4064-b680-9c27f1406bb9-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "2415aeb6-b8ca-4064-b680-9c27f1406bb9" (UID: "2415aeb6-b8ca-4064-b680-9c27f1406bb9"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 22 17:35:53.112553 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.111518 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2415aeb6-b8ca-4064-b680-9c27f1406bb9-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "2415aeb6-b8ca-4064-b680-9c27f1406bb9" (UID: "2415aeb6-b8ca-4064-b680-9c27f1406bb9"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 22 17:35:53.113656 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.113610 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2415aeb6-b8ca-4064-b680-9c27f1406bb9-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "2415aeb6-b8ca-4064-b680-9c27f1406bb9" (UID: "2415aeb6-b8ca-4064-b680-9c27f1406bb9"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Apr 22 17:35:53.113955 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.113927 2576 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2415aeb6-b8ca-4064-b680-9c27f1406bb9-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Apr 22 17:35:53.114823 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.114785 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2415aeb6-b8ca-4064-b680-9c27f1406bb9-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "2415aeb6-b8ca-4064-b680-9c27f1406bb9" (UID: "2415aeb6-b8ca-4064-b680-9c27f1406bb9"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 22 17:35:53.115793 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.115755 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2415aeb6-b8ca-4064-b680-9c27f1406bb9-kube-api-access-rldrr" (OuterVolumeSpecName: "kube-api-access-rldrr") pod "2415aeb6-b8ca-4064-b680-9c27f1406bb9" (UID: "2415aeb6-b8ca-4064-b680-9c27f1406bb9"). InnerVolumeSpecName "kube-api-access-rldrr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 22 17:35:53.116144 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.116119 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2415aeb6-b8ca-4064-b680-9c27f1406bb9-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "2415aeb6-b8ca-4064-b680-9c27f1406bb9" (UID: "2415aeb6-b8ca-4064-b680-9c27f1406bb9"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 22 17:35:53.116960 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.116932 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2415aeb6-b8ca-4064-b680-9c27f1406bb9-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "2415aeb6-b8ca-4064-b680-9c27f1406bb9" (UID: "2415aeb6-b8ca-4064-b680-9c27f1406bb9"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 22 17:35:53.117058 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.116956 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2415aeb6-b8ca-4064-b680-9c27f1406bb9-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "2415aeb6-b8ca-4064-b680-9c27f1406bb9" (UID: "2415aeb6-b8ca-4064-b680-9c27f1406bb9"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 22 17:35:53.117058 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.117010 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2415aeb6-b8ca-4064-b680-9c27f1406bb9-config" (OuterVolumeSpecName: "config") pod "2415aeb6-b8ca-4064-b680-9c27f1406bb9" (UID: "2415aeb6-b8ca-4064-b680-9c27f1406bb9"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 22 17:35:53.117343 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.117064 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2415aeb6-b8ca-4064-b680-9c27f1406bb9-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "2415aeb6-b8ca-4064-b680-9c27f1406bb9" (UID: "2415aeb6-b8ca-4064-b680-9c27f1406bb9"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 22 17:35:53.117343 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.117291 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2415aeb6-b8ca-4064-b680-9c27f1406bb9-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "2415aeb6-b8ca-4064-b680-9c27f1406bb9" (UID: "2415aeb6-b8ca-4064-b680-9c27f1406bb9"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 22 17:35:53.117634 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.117605 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2415aeb6-b8ca-4064-b680-9c27f1406bb9-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "2415aeb6-b8ca-4064-b680-9c27f1406bb9" (UID: "2415aeb6-b8ca-4064-b680-9c27f1406bb9"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 22 17:35:53.117777 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.117650 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2415aeb6-b8ca-4064-b680-9c27f1406bb9-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "2415aeb6-b8ca-4064-b680-9c27f1406bb9" (UID: "2415aeb6-b8ca-4064-b680-9c27f1406bb9"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 22 17:35:53.117931 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.117896 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2415aeb6-b8ca-4064-b680-9c27f1406bb9-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "2415aeb6-b8ca-4064-b680-9c27f1406bb9" (UID: "2415aeb6-b8ca-4064-b680-9c27f1406bb9"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 22 17:35:53.118665 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.118639 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2415aeb6-b8ca-4064-b680-9c27f1406bb9-config-out" (OuterVolumeSpecName: "config-out") pod "2415aeb6-b8ca-4064-b680-9c27f1406bb9" (UID: "2415aeb6-b8ca-4064-b680-9c27f1406bb9"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Apr 22 17:35:53.129787 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.129758 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2415aeb6-b8ca-4064-b680-9c27f1406bb9-web-config" (OuterVolumeSpecName: "web-config") pod "2415aeb6-b8ca-4064-b680-9c27f1406bb9" (UID: "2415aeb6-b8ca-4064-b680-9c27f1406bb9"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 22 17:35:53.214970 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.214915 2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2415aeb6-b8ca-4064-b680-9c27f1406bb9-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Apr 22 17:35:53.214970 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.214939 2576 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2415aeb6-b8ca-4064-b680-9c27f1406bb9-thanos-prometheus-http-client-file\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Apr 22 17:35:53.214970 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.214951 2576 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2415aeb6-b8ca-4064-b680-9c27f1406bb9-config-out\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Apr 22 17:35:53.214970 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.214960 2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2415aeb6-b8ca-4064-b680-9c27f1406bb9-secret-prometheus-k8s-tls\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Apr 22 17:35:53.214970 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.214969 2576 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2415aeb6-b8ca-4064-b680-9c27f1406bb9-tls-assets\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Apr 22 17:35:53.215167 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.214978 2576 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/2415aeb6-b8ca-4064-b680-9c27f1406bb9-config\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Apr 22 17:35:53.215167 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.214986 2576 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2415aeb6-b8ca-4064-b680-9c27f1406bb9-secret-grpc-tls\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Apr 22 17:35:53.215167 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.214993 2576 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2415aeb6-b8ca-4064-b680-9c27f1406bb9-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Apr 22 17:35:53.215167 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.215003 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2415aeb6-b8ca-4064-b680-9c27f1406bb9-prometheus-trusted-ca-bundle\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Apr 22 17:35:53.215167 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.215011 2576 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2415aeb6-b8ca-4064-b680-9c27f1406bb9-secret-kube-rbac-proxy\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Apr 22 17:35:53.215167 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.215020 2576 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2415aeb6-b8ca-4064-b680-9c27f1406bb9-configmap-metrics-client-ca\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Apr 22 17:35:53.215167 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.215028 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2415aeb6-b8ca-4064-b680-9c27f1406bb9-prometheus-k8s-db\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Apr 22 17:35:53.215167 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.215037 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rldrr\" (UniqueName: \"kubernetes.io/projected/2415aeb6-b8ca-4064-b680-9c27f1406bb9-kube-api-access-rldrr\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Apr 22 17:35:53.215167 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.215045 2576 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2415aeb6-b8ca-4064-b680-9c27f1406bb9-web-config\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Apr 22 17:35:53.215167 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.215053 2576 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2415aeb6-b8ca-4064-b680-9c27f1406bb9-secret-metrics-client-certs\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Apr 22 17:35:53.215167 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.215061 2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2415aeb6-b8ca-4064-b680-9c27f1406bb9-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Apr 22 17:35:53.215167 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.215070 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2415aeb6-b8ca-4064-b680-9c27f1406bb9-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Apr 22 17:35:53.519998 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.519972 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-p76lb" Apr 22 17:35:53.646996 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.646969 2576 generic.go:358] "Generic (PLEG): container finished" podID="2415aeb6-b8ca-4064-b680-9c27f1406bb9" containerID="53f18a1f96fb91bf0b27680034f0b6ae6e82910b2370807695fa72304208f0a9" exitCode=0 Apr 22 17:35:53.647324 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.647029 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2415aeb6-b8ca-4064-b680-9c27f1406bb9","Type":"ContainerDied","Data":"53f18a1f96fb91bf0b27680034f0b6ae6e82910b2370807695fa72304208f0a9"} Apr 22 17:35:53.647324 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.647057 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2415aeb6-b8ca-4064-b680-9c27f1406bb9","Type":"ContainerDied","Data":"4955ccb64c62cf996bc5ab4349ecf2d7f37700a404aa0870e7e19cc338b4ef5a"} Apr 22 17:35:53.647324 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.647069 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:53.647324 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.647073 2576 scope.go:117] "RemoveContainer" containerID="9052fd90e8f6b6815d33f832884da8d03a2a9e2849fd9f5d52d8a1124e0f3179" Apr 22 17:35:53.655375 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.655359 2576 scope.go:117] "RemoveContainer" containerID="cd865d7f5795a395040e1b9b2e940c8fb0fd77c10986bf6da87dd11089efa037" Apr 22 17:35:53.663764 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.663740 2576 scope.go:117] "RemoveContainer" containerID="53f18a1f96fb91bf0b27680034f0b6ae6e82910b2370807695fa72304208f0a9" Apr 22 17:35:53.670791 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.670773 2576 scope.go:117] "RemoveContainer" containerID="0522b67d7bdff833cd68ad2271fc25d922352963028a6372169ad58161bd58b7" Apr 22 17:35:53.671458 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.671438 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Apr 22 17:35:53.675718 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.675689 2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Apr 22 17:35:53.678059 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.678045 2576 scope.go:117] "RemoveContainer" containerID="ba81f69c5729e8b2a9fbe1f01e2879472bda0ab8227bd17fc036e211645ab9e9" Apr 22 17:35:53.684190 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.684157 2576 scope.go:117] "RemoveContainer" containerID="48c3cbe5406026f574072fc1368effd11ebca2ed1341e24f7b443285e8d65cf1" Apr 22 17:35:53.690946 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.690933 2576 scope.go:117] "RemoveContainer" containerID="5f769fa941eb685c32e6bcb70428b2e5af17ae67a875b609e48c1527876f82a0" Apr 22 17:35:53.698137 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.698122 2576 scope.go:117] "RemoveContainer" containerID="9052fd90e8f6b6815d33f832884da8d03a2a9e2849fd9f5d52d8a1124e0f3179" Apr 22 17:35:53.698424 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:35:53.698403 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9052fd90e8f6b6815d33f832884da8d03a2a9e2849fd9f5d52d8a1124e0f3179\": container with ID starting with 9052fd90e8f6b6815d33f832884da8d03a2a9e2849fd9f5d52d8a1124e0f3179 not found: ID does not exist" containerID="9052fd90e8f6b6815d33f832884da8d03a2a9e2849fd9f5d52d8a1124e0f3179" Apr 22 17:35:53.698466 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.698432 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9052fd90e8f6b6815d33f832884da8d03a2a9e2849fd9f5d52d8a1124e0f3179"} err="failed to get container status \"9052fd90e8f6b6815d33f832884da8d03a2a9e2849fd9f5d52d8a1124e0f3179\": rpc error: code = NotFound desc = could not find container \"9052fd90e8f6b6815d33f832884da8d03a2a9e2849fd9f5d52d8a1124e0f3179\": container with ID starting with 9052fd90e8f6b6815d33f832884da8d03a2a9e2849fd9f5d52d8a1124e0f3179 not found: ID does not exist" Apr 22 17:35:53.698466 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.698452 2576 scope.go:117] "RemoveContainer" containerID="cd865d7f5795a395040e1b9b2e940c8fb0fd77c10986bf6da87dd11089efa037" Apr 22 17:35:53.698684 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:35:53.698668 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd865d7f5795a395040e1b9b2e940c8fb0fd77c10986bf6da87dd11089efa037\": container with ID starting with cd865d7f5795a395040e1b9b2e940c8fb0fd77c10986bf6da87dd11089efa037 not found: ID does not exist" containerID="cd865d7f5795a395040e1b9b2e940c8fb0fd77c10986bf6da87dd11089efa037" Apr 22 17:35:53.698727 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.698689 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd865d7f5795a395040e1b9b2e940c8fb0fd77c10986bf6da87dd11089efa037"} err="failed to get container status \"cd865d7f5795a395040e1b9b2e940c8fb0fd77c10986bf6da87dd11089efa037\": rpc error: code = NotFound desc = could not find container \"cd865d7f5795a395040e1b9b2e940c8fb0fd77c10986bf6da87dd11089efa037\": container with ID starting with cd865d7f5795a395040e1b9b2e940c8fb0fd77c10986bf6da87dd11089efa037 not found: ID does not exist" Apr 22 17:35:53.698727 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.698706 2576 scope.go:117] "RemoveContainer" containerID="53f18a1f96fb91bf0b27680034f0b6ae6e82910b2370807695fa72304208f0a9" Apr 22 17:35:53.698931 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:35:53.698913 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53f18a1f96fb91bf0b27680034f0b6ae6e82910b2370807695fa72304208f0a9\": container with ID starting with 53f18a1f96fb91bf0b27680034f0b6ae6e82910b2370807695fa72304208f0a9 not found: ID does not exist" containerID="53f18a1f96fb91bf0b27680034f0b6ae6e82910b2370807695fa72304208f0a9" Apr 22 17:35:53.698964 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.698938 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53f18a1f96fb91bf0b27680034f0b6ae6e82910b2370807695fa72304208f0a9"} err="failed to get container status \"53f18a1f96fb91bf0b27680034f0b6ae6e82910b2370807695fa72304208f0a9\": rpc error: code = NotFound desc = could not find container \"53f18a1f96fb91bf0b27680034f0b6ae6e82910b2370807695fa72304208f0a9\": container with ID starting with 53f18a1f96fb91bf0b27680034f0b6ae6e82910b2370807695fa72304208f0a9 not found: ID does not exist" Apr 22 17:35:53.698964 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.698953 2576 scope.go:117] "RemoveContainer" containerID="0522b67d7bdff833cd68ad2271fc25d922352963028a6372169ad58161bd58b7" Apr 22 17:35:53.699166 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:35:53.699153 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0522b67d7bdff833cd68ad2271fc25d922352963028a6372169ad58161bd58b7\": container with ID starting with 0522b67d7bdff833cd68ad2271fc25d922352963028a6372169ad58161bd58b7 not found: ID does not exist" containerID="0522b67d7bdff833cd68ad2271fc25d922352963028a6372169ad58161bd58b7" Apr 22 17:35:53.699232 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.699183 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0522b67d7bdff833cd68ad2271fc25d922352963028a6372169ad58161bd58b7"} err="failed to get container status \"0522b67d7bdff833cd68ad2271fc25d922352963028a6372169ad58161bd58b7\": rpc error: code = NotFound desc = could not find container \"0522b67d7bdff833cd68ad2271fc25d922352963028a6372169ad58161bd58b7\": container with ID starting with 0522b67d7bdff833cd68ad2271fc25d922352963028a6372169ad58161bd58b7 not found: ID does not exist" Apr 22 17:35:53.699232 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.699201 2576 scope.go:117] "RemoveContainer" containerID="ba81f69c5729e8b2a9fbe1f01e2879472bda0ab8227bd17fc036e211645ab9e9" Apr 22 17:35:53.699415 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:35:53.699399 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba81f69c5729e8b2a9fbe1f01e2879472bda0ab8227bd17fc036e211645ab9e9\": container with ID starting with ba81f69c5729e8b2a9fbe1f01e2879472bda0ab8227bd17fc036e211645ab9e9 not found: ID does not exist" containerID="ba81f69c5729e8b2a9fbe1f01e2879472bda0ab8227bd17fc036e211645ab9e9" Apr 22 17:35:53.699454 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.699424 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba81f69c5729e8b2a9fbe1f01e2879472bda0ab8227bd17fc036e211645ab9e9"} err="failed to get container status \"ba81f69c5729e8b2a9fbe1f01e2879472bda0ab8227bd17fc036e211645ab9e9\": rpc error: code = NotFound desc = could not find container \"ba81f69c5729e8b2a9fbe1f01e2879472bda0ab8227bd17fc036e211645ab9e9\": container with ID starting with ba81f69c5729e8b2a9fbe1f01e2879472bda0ab8227bd17fc036e211645ab9e9 not found: ID does not exist" Apr 22 17:35:53.699454 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.699440 2576 scope.go:117] "RemoveContainer" containerID="48c3cbe5406026f574072fc1368effd11ebca2ed1341e24f7b443285e8d65cf1" Apr 22 17:35:53.699656 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:35:53.699640 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48c3cbe5406026f574072fc1368effd11ebca2ed1341e24f7b443285e8d65cf1\": container with ID starting with 48c3cbe5406026f574072fc1368effd11ebca2ed1341e24f7b443285e8d65cf1 not found: ID does not exist" containerID="48c3cbe5406026f574072fc1368effd11ebca2ed1341e24f7b443285e8d65cf1" Apr 22 17:35:53.699691 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.699660 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48c3cbe5406026f574072fc1368effd11ebca2ed1341e24f7b443285e8d65cf1"} err="failed to get container status \"48c3cbe5406026f574072fc1368effd11ebca2ed1341e24f7b443285e8d65cf1\": rpc error: code = NotFound desc = could not find container \"48c3cbe5406026f574072fc1368effd11ebca2ed1341e24f7b443285e8d65cf1\": container with ID starting with 48c3cbe5406026f574072fc1368effd11ebca2ed1341e24f7b443285e8d65cf1 not found: ID does not exist" Apr 22 17:35:53.699691 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.699673 2576 scope.go:117] "RemoveContainer" containerID="5f769fa941eb685c32e6bcb70428b2e5af17ae67a875b609e48c1527876f82a0" Apr 22 17:35:53.699859 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:35:53.699844 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f769fa941eb685c32e6bcb70428b2e5af17ae67a875b609e48c1527876f82a0\": container with ID starting with 5f769fa941eb685c32e6bcb70428b2e5af17ae67a875b609e48c1527876f82a0 not found: ID does not exist" containerID="5f769fa941eb685c32e6bcb70428b2e5af17ae67a875b609e48c1527876f82a0" Apr 22 17:35:53.699898 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.699863 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f769fa941eb685c32e6bcb70428b2e5af17ae67a875b609e48c1527876f82a0"} err="failed to get container status \"5f769fa941eb685c32e6bcb70428b2e5af17ae67a875b609e48c1527876f82a0\": rpc error: code = NotFound desc = could not find container \"5f769fa941eb685c32e6bcb70428b2e5af17ae67a875b609e48c1527876f82a0\": container with ID starting with 5f769fa941eb685c32e6bcb70428b2e5af17ae67a875b609e48c1527876f82a0 not found: ID does not exist" Apr 22 17:35:53.703733 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.703704 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Apr 22 17:35:53.704038 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.704024 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2415aeb6-b8ca-4064-b680-9c27f1406bb9" containerName="init-config-reloader" Apr 22 17:35:53.704102 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.704041 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2415aeb6-b8ca-4064-b680-9c27f1406bb9" containerName="init-config-reloader" Apr 22 17:35:53.704102 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.704069 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2415aeb6-b8ca-4064-b680-9c27f1406bb9" containerName="prometheus" Apr 22 17:35:53.704102 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.704078 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2415aeb6-b8ca-4064-b680-9c27f1406bb9" containerName="prometheus" Apr 22 17:35:53.704102 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.704088 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2415aeb6-b8ca-4064-b680-9c27f1406bb9" containerName="config-reloader" Apr 22 17:35:53.704102 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.704097 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2415aeb6-b8ca-4064-b680-9c27f1406bb9" containerName="config-reloader" Apr 22 17:35:53.704373 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.704115 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2415aeb6-b8ca-4064-b680-9c27f1406bb9" containerName="kube-rbac-proxy-thanos" Apr 22 17:35:53.704373 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.704123 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2415aeb6-b8ca-4064-b680-9c27f1406bb9" containerName="kube-rbac-proxy-thanos" Apr 22 17:35:53.704373 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.704134 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2415aeb6-b8ca-4064-b680-9c27f1406bb9" containerName="kube-rbac-proxy" Apr 22 17:35:53.704373 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.704142 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2415aeb6-b8ca-4064-b680-9c27f1406bb9" containerName="kube-rbac-proxy" Apr 22 17:35:53.704373 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.704156 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2415aeb6-b8ca-4064-b680-9c27f1406bb9" containerName="thanos-sidecar" Apr 22 17:35:53.704373 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.704165 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2415aeb6-b8ca-4064-b680-9c27f1406bb9" containerName="thanos-sidecar" Apr 22 17:35:53.704373 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.704191 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2415aeb6-b8ca-4064-b680-9c27f1406bb9" containerName="kube-rbac-proxy-web" Apr 22 17:35:53.704373 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.704200 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2415aeb6-b8ca-4064-b680-9c27f1406bb9" containerName="kube-rbac-proxy-web" Apr 22 17:35:53.704373 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.704280 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="2415aeb6-b8ca-4064-b680-9c27f1406bb9" containerName="prometheus" Apr 22 17:35:53.704373 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.704294 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="2415aeb6-b8ca-4064-b680-9c27f1406bb9" containerName="kube-rbac-proxy-thanos" Apr 22 17:35:53.704373 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.704305 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="2415aeb6-b8ca-4064-b680-9c27f1406bb9" containerName="kube-rbac-proxy" Apr 22 17:35:53.704373 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.704317 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="2415aeb6-b8ca-4064-b680-9c27f1406bb9" containerName="thanos-sidecar" Apr 22 17:35:53.704373 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.704330 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="2415aeb6-b8ca-4064-b680-9c27f1406bb9" containerName="config-reloader" Apr 22 17:35:53.704373 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.704341 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="2415aeb6-b8ca-4064-b680-9c27f1406bb9" containerName="kube-rbac-proxy-web" Apr 22 17:35:53.740441 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.740419 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Apr 22 17:35:53.740551 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.740511 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:53.745885 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.744062 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Apr 22 17:35:53.745885 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.744509 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-v8wmx\"" Apr 22 17:35:53.745885 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.744711 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-dcfa05smk114j\"" Apr 22 17:35:53.745885 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.744862 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Apr 22 17:35:53.745885 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.744894 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Apr 22 17:35:53.745885 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.745071 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Apr 22 17:35:53.745885 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.745143 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Apr 22 17:35:53.745885 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.745453 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Apr 22 17:35:53.745885 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.745712 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Apr 22 17:35:53.745885 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.745799 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Apr 22 17:35:53.746454 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.746128 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Apr 22 17:35:53.746958 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.746942 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Apr 22 17:35:53.747927 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.747909 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Apr 22 17:35:53.750956 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.750935 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Apr 22 17:35:53.820681 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.820625 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lmph\" (UniqueName: \"kubernetes.io/projected/4e13e257-1a99-4503-bba4-118666490485-kube-api-access-4lmph\") pod \"prometheus-k8s-0\" (UID: \"4e13e257-1a99-4503-bba4-118666490485\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:53.820681 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.820665 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4e13e257-1a99-4503-bba4-118666490485-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4e13e257-1a99-4503-bba4-118666490485\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:53.820807 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.820708 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4e13e257-1a99-4503-bba4-118666490485-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4e13e257-1a99-4503-bba4-118666490485\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:53.820807 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.820727 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4e13e257-1a99-4503-bba4-118666490485-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4e13e257-1a99-4503-bba4-118666490485\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:53.820807 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.820751 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4e13e257-1a99-4503-bba4-118666490485-config\") pod \"prometheus-k8s-0\" (UID: \"4e13e257-1a99-4503-bba4-118666490485\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:53.820807 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.820775 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4e13e257-1a99-4503-bba4-118666490485-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4e13e257-1a99-4503-bba4-118666490485\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:53.820807 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.820790 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4e13e257-1a99-4503-bba4-118666490485-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4e13e257-1a99-4503-bba4-118666490485\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:53.820954 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.820810 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4e13e257-1a99-4503-bba4-118666490485-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4e13e257-1a99-4503-bba4-118666490485\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:53.820954 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.820830 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4e13e257-1a99-4503-bba4-118666490485-web-config\") pod \"prometheus-k8s-0\" (UID: \"4e13e257-1a99-4503-bba4-118666490485\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:53.820954 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.820858 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4e13e257-1a99-4503-bba4-118666490485-config-out\") pod \"prometheus-k8s-0\" (UID: \"4e13e257-1a99-4503-bba4-118666490485\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:53.820954 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.820895 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e13e257-1a99-4503-bba4-118666490485-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4e13e257-1a99-4503-bba4-118666490485\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:53.820954 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.820915 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4e13e257-1a99-4503-bba4-118666490485-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4e13e257-1a99-4503-bba4-118666490485\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:53.820954 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.820932 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e13e257-1a99-4503-bba4-118666490485-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4e13e257-1a99-4503-bba4-118666490485\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:53.821119 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.820963 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4e13e257-1a99-4503-bba4-118666490485-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4e13e257-1a99-4503-bba4-118666490485\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:53.821119 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.820988 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4e13e257-1a99-4503-bba4-118666490485-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4e13e257-1a99-4503-bba4-118666490485\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:53.821119 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.821006 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e13e257-1a99-4503-bba4-118666490485-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4e13e257-1a99-4503-bba4-118666490485\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:53.821119 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.821031 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4e13e257-1a99-4503-bba4-118666490485-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4e13e257-1a99-4503-bba4-118666490485\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:53.821119 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.821050 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e13e257-1a99-4503-bba4-118666490485-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4e13e257-1a99-4503-bba4-118666490485\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:53.921516 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.921486 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4e13e257-1a99-4503-bba4-118666490485-config\") pod \"prometheus-k8s-0\" (UID: \"4e13e257-1a99-4503-bba4-118666490485\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:53.921634 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.921520 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4e13e257-1a99-4503-bba4-118666490485-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4e13e257-1a99-4503-bba4-118666490485\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:53.921676 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.921631 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4e13e257-1a99-4503-bba4-118666490485-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4e13e257-1a99-4503-bba4-118666490485\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:53.921706 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.921673 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4e13e257-1a99-4503-bba4-118666490485-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4e13e257-1a99-4503-bba4-118666490485\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:53.921747 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.921708 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4e13e257-1a99-4503-bba4-118666490485-web-config\") pod \"prometheus-k8s-0\" (UID: \"4e13e257-1a99-4503-bba4-118666490485\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:53.921796 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.921745 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4e13e257-1a99-4503-bba4-118666490485-config-out\") pod \"prometheus-k8s-0\" (UID: \"4e13e257-1a99-4503-bba4-118666490485\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:53.921796 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.921773 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e13e257-1a99-4503-bba4-118666490485-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4e13e257-1a99-4503-bba4-118666490485\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:53.921888 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.921801 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4e13e257-1a99-4503-bba4-118666490485-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4e13e257-1a99-4503-bba4-118666490485\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:53.922764 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.922734 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e13e257-1a99-4503-bba4-118666490485-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4e13e257-1a99-4503-bba4-118666490485\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:53.922860 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.922802 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e13e257-1a99-4503-bba4-118666490485-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4e13e257-1a99-4503-bba4-118666490485\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:53.922860 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.922838 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4e13e257-1a99-4503-bba4-118666490485-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4e13e257-1a99-4503-bba4-118666490485\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:53.922979 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.922869 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4e13e257-1a99-4503-bba4-118666490485-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4e13e257-1a99-4503-bba4-118666490485\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:53.922979 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.922893 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e13e257-1a99-4503-bba4-118666490485-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4e13e257-1a99-4503-bba4-118666490485\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:53.922979 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.922929 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4e13e257-1a99-4503-bba4-118666490485-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4e13e257-1a99-4503-bba4-118666490485\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:53.922979 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.922959 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e13e257-1a99-4503-bba4-118666490485-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4e13e257-1a99-4503-bba4-118666490485\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:53.923201 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.923018 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4lmph\" (UniqueName: \"kubernetes.io/projected/4e13e257-1a99-4503-bba4-118666490485-kube-api-access-4lmph\") pod \"prometheus-k8s-0\" (UID: \"4e13e257-1a99-4503-bba4-118666490485\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:53.923201 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.923069 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4e13e257-1a99-4503-bba4-118666490485-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4e13e257-1a99-4503-bba4-118666490485\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:53.923201 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.923106 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4e13e257-1a99-4503-bba4-118666490485-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4e13e257-1a99-4503-bba4-118666490485\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:53.923201 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.923135 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4e13e257-1a99-4503-bba4-118666490485-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4e13e257-1a99-4503-bba4-118666490485\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:53.924427 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.924401 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/4e13e257-1a99-4503-bba4-118666490485-config\") pod \"prometheus-k8s-0\" (UID: \"4e13e257-1a99-4503-bba4-118666490485\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:53.924695 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.924667 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4e13e257-1a99-4503-bba4-118666490485-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4e13e257-1a99-4503-bba4-118666490485\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:53.924813 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.924788 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4e13e257-1a99-4503-bba4-118666490485-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4e13e257-1a99-4503-bba4-118666490485\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:53.924878 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.924829 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4e13e257-1a99-4503-bba4-118666490485-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4e13e257-1a99-4503-bba4-118666490485\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:53.925598 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.925516 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e13e257-1a99-4503-bba4-118666490485-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4e13e257-1a99-4503-bba4-118666490485\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:53.925928 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.925903 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e13e257-1a99-4503-bba4-118666490485-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4e13e257-1a99-4503-bba4-118666490485\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:53.925928 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.925920 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4e13e257-1a99-4503-bba4-118666490485-config-out\") pod \"prometheus-k8s-0\" (UID: \"4e13e257-1a99-4503-bba4-118666490485\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:53.926261 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.926157 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4e13e257-1a99-4503-bba4-118666490485-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4e13e257-1a99-4503-bba4-118666490485\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:53.926791 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.926619 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4e13e257-1a99-4503-bba4-118666490485-web-config\") pod \"prometheus-k8s-0\" (UID: \"4e13e257-1a99-4503-bba4-118666490485\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:53.926791 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.926756 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4e13e257-1a99-4503-bba4-118666490485-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4e13e257-1a99-4503-bba4-118666490485\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:53.926791 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.926788 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e13e257-1a99-4503-bba4-118666490485-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4e13e257-1a99-4503-bba4-118666490485\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:53.927066 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.927039 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4e13e257-1a99-4503-bba4-118666490485-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4e13e257-1a99-4503-bba4-118666490485\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:53.927148 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.927105 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4e13e257-1a99-4503-bba4-118666490485-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4e13e257-1a99-4503-bba4-118666490485\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:53.927818 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.927787 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4e13e257-1a99-4503-bba4-118666490485-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4e13e257-1a99-4503-bba4-118666490485\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:53.927884 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.927867 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4e13e257-1a99-4503-bba4-118666490485-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4e13e257-1a99-4503-bba4-118666490485\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:53.928807 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.928791 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4e13e257-1a99-4503-bba4-118666490485-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4e13e257-1a99-4503-bba4-118666490485\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:53.936527 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:53.936498 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lmph\" (UniqueName: \"kubernetes.io/projected/4e13e257-1a99-4503-bba4-118666490485-kube-api-access-4lmph\") pod \"prometheus-k8s-0\" (UID: \"4e13e257-1a99-4503-bba4-118666490485\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:54.053294 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:54.053265 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:35:54.182792 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:54.180340 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Apr 22 17:35:54.186516 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:35:54.186487 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e13e257_1a99_4503_bba4_118666490485.slice/crio-fb3c49762662d3af03777e49b385de297747366bc3cbb339b852a494bc1eaa51 WatchSource:0}: Error finding container fb3c49762662d3af03777e49b385de297747366bc3cbb339b852a494bc1eaa51: Status 404 returned error can't find the container with id fb3c49762662d3af03777e49b385de297747366bc3cbb339b852a494bc1eaa51 Apr 22 17:35:54.652591 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:54.652556 2576 generic.go:358] "Generic (PLEG): container finished" podID="4e13e257-1a99-4503-bba4-118666490485" containerID="d5dd6ce81bce861290b1dd0f8753405f19cd09edbb612c5d3a46009599c6fecf" exitCode=0 Apr 22 17:35:54.652909 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:54.652613 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4e13e257-1a99-4503-bba4-118666490485","Type":"ContainerDied","Data":"d5dd6ce81bce861290b1dd0f8753405f19cd09edbb612c5d3a46009599c6fecf"} Apr 22 17:35:54.652909 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:54.652644 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4e13e257-1a99-4503-bba4-118666490485","Type":"ContainerStarted","Data":"fb3c49762662d3af03777e49b385de297747366bc3cbb339b852a494bc1eaa51"} Apr 22 17:35:55.072606 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:55.072579 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2415aeb6-b8ca-4064-b680-9c27f1406bb9" path="/var/lib/kubelet/pods/2415aeb6-b8ca-4064-b680-9c27f1406bb9/volumes" Apr 22 17:35:55.659637 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:55.659611 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4e13e257-1a99-4503-bba4-118666490485","Type":"ContainerStarted","Data":"bf1da99fa89788833959cf911e642905328d01f556fc36d810cae497a44b6139"} Apr 22 17:35:55.659637 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:55.659641 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4e13e257-1a99-4503-bba4-118666490485","Type":"ContainerStarted","Data":"c11fece5c2b699beef02f3282bc3178aec5ca0d15f50618c7f99abf82dad290c"} Apr 22 17:35:55.660010 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:55.659652 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4e13e257-1a99-4503-bba4-118666490485","Type":"ContainerStarted","Data":"0a0527c3c9dfc71f12efcc4f44aaef1da7bdeb786b9410df72c3f10b05b5715a"} Apr 22 17:35:55.660010 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:55.659661 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4e13e257-1a99-4503-bba4-118666490485","Type":"ContainerStarted","Data":"4007f09c6074b380a4ac97a647975bcdda747d2294d767ccd9359ec2f1294721"} Apr 22 17:35:55.660010 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:55.659669 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4e13e257-1a99-4503-bba4-118666490485","Type":"ContainerStarted","Data":"b0aeb5800450ea9ae1c5bfc3594db20a0d1ae95ad4d152c1eec2076e0b55bb7f"} Apr 22 17:35:55.660010 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:55.659677 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4e13e257-1a99-4503-bba4-118666490485","Type":"ContainerStarted","Data":"d5bc1be931c903b6c48835e58f9491e122e0ee7a6a34aaa805a7c6f523aa23a4"} Apr 22 17:35:55.690817 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:55.690774 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.690759169 podStartE2EDuration="2.690759169s" podCreationTimestamp="2026-04-22 17:35:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-22 17:35:55.687962557 +0000 UTC m=+105.132525767" watchObservedRunningTime="2026-04-22 17:35:55.690759169 +0000 UTC m=+105.135322353" Apr 22 17:35:56.552938 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:56.552901 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-cf445f8f7-p7qvh"] Apr 22 17:35:56.561416 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:56.561382 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cf445f8f7-p7qvh" Apr 22 17:35:56.565119 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:56.565087 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cf445f8f7-p7qvh"] Apr 22 17:35:56.646627 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:56.646595 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0755e577-7f88-430f-b8cc-07cd680a80ba-oauth-serving-cert\") pod \"console-cf445f8f7-p7qvh\" (UID: \"0755e577-7f88-430f-b8cc-07cd680a80ba\") " pod="openshift-console/console-cf445f8f7-p7qvh" Apr 22 17:35:56.646795 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:56.646657 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0755e577-7f88-430f-b8cc-07cd680a80ba-console-oauth-config\") pod \"console-cf445f8f7-p7qvh\" (UID: \"0755e577-7f88-430f-b8cc-07cd680a80ba\") " pod="openshift-console/console-cf445f8f7-p7qvh" Apr 22 17:35:56.646795 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:56.646682 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0755e577-7f88-430f-b8cc-07cd680a80ba-service-ca\") pod \"console-cf445f8f7-p7qvh\" (UID: \"0755e577-7f88-430f-b8cc-07cd680a80ba\") " pod="openshift-console/console-cf445f8f7-p7qvh" Apr 22 17:35:56.646795 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:56.646698 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tq2ch\" (UniqueName: \"kubernetes.io/projected/0755e577-7f88-430f-b8cc-07cd680a80ba-kube-api-access-tq2ch\") pod \"console-cf445f8f7-p7qvh\" (UID: \"0755e577-7f88-430f-b8cc-07cd680a80ba\") " pod="openshift-console/console-cf445f8f7-p7qvh" Apr 22 17:35:56.646795 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:56.646729 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0755e577-7f88-430f-b8cc-07cd680a80ba-console-serving-cert\") pod \"console-cf445f8f7-p7qvh\" (UID: \"0755e577-7f88-430f-b8cc-07cd680a80ba\") " pod="openshift-console/console-cf445f8f7-p7qvh" Apr 22 17:35:56.646795 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:56.646778 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0755e577-7f88-430f-b8cc-07cd680a80ba-console-config\") pod \"console-cf445f8f7-p7qvh\" (UID: \"0755e577-7f88-430f-b8cc-07cd680a80ba\") " pod="openshift-console/console-cf445f8f7-p7qvh" Apr 22 17:35:56.646964 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:56.646812 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0755e577-7f88-430f-b8cc-07cd680a80ba-trusted-ca-bundle\") pod \"console-cf445f8f7-p7qvh\" (UID: \"0755e577-7f88-430f-b8cc-07cd680a80ba\") " pod="openshift-console/console-cf445f8f7-p7qvh" Apr 22 17:35:56.748302 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:56.748262 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0755e577-7f88-430f-b8cc-07cd680a80ba-oauth-serving-cert\") pod \"console-cf445f8f7-p7qvh\" (UID: \"0755e577-7f88-430f-b8cc-07cd680a80ba\") " pod="openshift-console/console-cf445f8f7-p7qvh" Apr 22 17:35:56.748751 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:56.748354 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0755e577-7f88-430f-b8cc-07cd680a80ba-console-oauth-config\") pod \"console-cf445f8f7-p7qvh\" (UID: \"0755e577-7f88-430f-b8cc-07cd680a80ba\") " pod="openshift-console/console-cf445f8f7-p7qvh" Apr 22 17:35:56.748751 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:56.748380 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0755e577-7f88-430f-b8cc-07cd680a80ba-service-ca\") pod \"console-cf445f8f7-p7qvh\" (UID: \"0755e577-7f88-430f-b8cc-07cd680a80ba\") " pod="openshift-console/console-cf445f8f7-p7qvh" Apr 22 17:35:56.748751 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:56.748403 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tq2ch\" (UniqueName: \"kubernetes.io/projected/0755e577-7f88-430f-b8cc-07cd680a80ba-kube-api-access-tq2ch\") pod \"console-cf445f8f7-p7qvh\" (UID: \"0755e577-7f88-430f-b8cc-07cd680a80ba\") " pod="openshift-console/console-cf445f8f7-p7qvh" Apr 22 17:35:56.748751 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:56.748440 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0755e577-7f88-430f-b8cc-07cd680a80ba-console-serving-cert\") pod \"console-cf445f8f7-p7qvh\" (UID: \"0755e577-7f88-430f-b8cc-07cd680a80ba\") " pod="openshift-console/console-cf445f8f7-p7qvh" Apr 22 17:35:56.748751 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:56.748499 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0755e577-7f88-430f-b8cc-07cd680a80ba-console-config\") pod \"console-cf445f8f7-p7qvh\" (UID: \"0755e577-7f88-430f-b8cc-07cd680a80ba\") " pod="openshift-console/console-cf445f8f7-p7qvh" Apr 22 17:35:56.748751 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:56.748553 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0755e577-7f88-430f-b8cc-07cd680a80ba-trusted-ca-bundle\") pod \"console-cf445f8f7-p7qvh\" (UID: \"0755e577-7f88-430f-b8cc-07cd680a80ba\") " pod="openshift-console/console-cf445f8f7-p7qvh" Apr 22 17:35:56.750079 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:56.750045 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0755e577-7f88-430f-b8cc-07cd680a80ba-oauth-serving-cert\") pod \"console-cf445f8f7-p7qvh\" (UID: \"0755e577-7f88-430f-b8cc-07cd680a80ba\") " pod="openshift-console/console-cf445f8f7-p7qvh" Apr 22 17:35:56.750992 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:56.750963 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0755e577-7f88-430f-b8cc-07cd680a80ba-service-ca\") pod \"console-cf445f8f7-p7qvh\" (UID: \"0755e577-7f88-430f-b8cc-07cd680a80ba\") " pod="openshift-console/console-cf445f8f7-p7qvh" Apr 22 17:35:56.751094 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:56.751033 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0755e577-7f88-430f-b8cc-07cd680a80ba-console-config\") pod \"console-cf445f8f7-p7qvh\" (UID: \"0755e577-7f88-430f-b8cc-07cd680a80ba\") " pod="openshift-console/console-cf445f8f7-p7qvh" Apr 22 17:35:56.751725 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:56.751697 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0755e577-7f88-430f-b8cc-07cd680a80ba-trusted-ca-bundle\") pod \"console-cf445f8f7-p7qvh\" (UID: \"0755e577-7f88-430f-b8cc-07cd680a80ba\") " pod="openshift-console/console-cf445f8f7-p7qvh" Apr 22 17:35:56.752888 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:56.752865 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0755e577-7f88-430f-b8cc-07cd680a80ba-console-oauth-config\") pod \"console-cf445f8f7-p7qvh\" (UID: \"0755e577-7f88-430f-b8cc-07cd680a80ba\") " pod="openshift-console/console-cf445f8f7-p7qvh" Apr 22 17:35:56.753148 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:56.753125 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0755e577-7f88-430f-b8cc-07cd680a80ba-console-serving-cert\") pod \"console-cf445f8f7-p7qvh\" (UID: \"0755e577-7f88-430f-b8cc-07cd680a80ba\") " pod="openshift-console/console-cf445f8f7-p7qvh" Apr 22 17:35:56.759003 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:56.758884 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tq2ch\" (UniqueName: \"kubernetes.io/projected/0755e577-7f88-430f-b8cc-07cd680a80ba-kube-api-access-tq2ch\") pod \"console-cf445f8f7-p7qvh\" (UID: \"0755e577-7f88-430f-b8cc-07cd680a80ba\") " pod="openshift-console/console-cf445f8f7-p7qvh" Apr 22 17:35:56.874858 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:56.874773 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cf445f8f7-p7qvh" Apr 22 17:35:57.011313 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:57.011288 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cf445f8f7-p7qvh"] Apr 22 17:35:57.013165 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:35:57.013136 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0755e577_7f88_430f_b8cc_07cd680a80ba.slice/crio-1ce75e564df391368fd5d17c6a9fc7483060510d7098792835cd214cb3755e99 WatchSource:0}: Error finding container 1ce75e564df391368fd5d17c6a9fc7483060510d7098792835cd214cb3755e99: Status 404 returned error can't find the container with id 1ce75e564df391368fd5d17c6a9fc7483060510d7098792835cd214cb3755e99 Apr 22 17:35:57.669023 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:57.668988 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cf445f8f7-p7qvh" event={"ID":"0755e577-7f88-430f-b8cc-07cd680a80ba","Type":"ContainerStarted","Data":"63ff937258b2fd36a171c663f8284ed4f325a4d697b71f48e6fc8a4eb793fb59"} Apr 22 17:35:57.669023 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:57.669024 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cf445f8f7-p7qvh" event={"ID":"0755e577-7f88-430f-b8cc-07cd680a80ba","Type":"ContainerStarted","Data":"1ce75e564df391368fd5d17c6a9fc7483060510d7098792835cd214cb3755e99"} Apr 22 17:35:57.689115 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:57.689061 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-cf445f8f7-p7qvh" podStartSLOduration=1.6890450270000001 podStartE2EDuration="1.689045027s" podCreationTimestamp="2026-04-22 17:35:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-22 17:35:57.687214414 +0000 UTC m=+107.131777589" watchObservedRunningTime="2026-04-22 17:35:57.689045027 +0000 UTC m=+107.133608212" Apr 22 17:35:59.053613 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:35:59.053573 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:36:06.875843 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:36:06.875791 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-cf445f8f7-p7qvh" Apr 22 17:36:06.875843 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:36:06.875847 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-cf445f8f7-p7qvh" Apr 22 17:36:06.880465 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:36:06.880444 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-cf445f8f7-p7qvh" Apr 22 17:36:07.703714 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:36:07.703688 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-cf445f8f7-p7qvh" Apr 22 17:36:07.761624 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:36:07.761595 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-684878565-rm8pn"] Apr 22 17:36:32.783602 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:36:32.783553 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-684878565-rm8pn" podUID="53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7" containerName="console" containerID="cri-o://51ee1c4d2ed46beafb8d6392f2bfcc5f75c25aef14d5c285f8d74f2f195f224d" gracePeriod=15 Apr 22 17:36:33.034842 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:36:33.034779 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-684878565-rm8pn_53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7/console/0.log" Apr 22 17:36:33.034842 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:36:33.034841 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-684878565-rm8pn" Apr 22 17:36:33.069602 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:36:33.069570 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6t5x9\" (UniqueName: \"kubernetes.io/projected/53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7-kube-api-access-6t5x9\") pod \"53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7\" (UID: \"53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7\") " Apr 22 17:36:33.069768 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:36:33.069627 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7-trusted-ca-bundle\") pod \"53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7\" (UID: \"53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7\") " Apr 22 17:36:33.069768 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:36:33.069683 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7-console-serving-cert\") pod \"53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7\" (UID: \"53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7\") " Apr 22 17:36:33.069768 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:36:33.069715 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7-console-config\") pod \"53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7\" (UID: \"53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7\") " Apr 22 17:36:33.069768 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:36:33.069741 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7-oauth-serving-cert\") pod \"53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7\" (UID: \"53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7\") " Apr 22 17:36:33.069768 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:36:33.069766 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7-console-oauth-config\") pod \"53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7\" (UID: \"53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7\") " Apr 22 17:36:33.070019 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:36:33.069812 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7-service-ca\") pod \"53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7\" (UID: \"53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7\") " Apr 22 17:36:33.070252 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:36:33.070217 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7-console-config" (OuterVolumeSpecName: "console-config") pod "53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7" (UID: "53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 22 17:36:33.070391 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:36:33.070271 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7" (UID: "53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 22 17:36:33.070391 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:36:33.070379 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7-service-ca" (OuterVolumeSpecName: "service-ca") pod "53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7" (UID: "53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 22 17:36:33.070570 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:36:33.070540 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7" (UID: "53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 22 17:36:33.072352 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:36:33.072314 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7" (UID: "53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 22 17:36:33.072480 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:36:33.072452 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7-kube-api-access-6t5x9" (OuterVolumeSpecName: "kube-api-access-6t5x9") pod "53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7" (UID: "53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7"). InnerVolumeSpecName "kube-api-access-6t5x9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 22 17:36:33.072540 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:36:33.072481 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7" (UID: "53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 22 17:36:33.170964 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:36:33.170930 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7-console-serving-cert\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Apr 22 17:36:33.170964 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:36:33.170962 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7-console-config\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Apr 22 17:36:33.170964 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:36:33.170971 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7-oauth-serving-cert\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Apr 22 17:36:33.171213 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:36:33.170982 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7-console-oauth-config\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Apr 22 17:36:33.171213 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:36:33.170992 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7-service-ca\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Apr 22 17:36:33.171213 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:36:33.171000 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6t5x9\" (UniqueName: \"kubernetes.io/projected/53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7-kube-api-access-6t5x9\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Apr 22 17:36:33.171213 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:36:33.171010 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7-trusted-ca-bundle\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Apr 22 17:36:33.781585 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:36:33.781556 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-684878565-rm8pn_53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7/console/0.log" Apr 22 17:36:33.781757 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:36:33.781597 2576 generic.go:358] "Generic (PLEG): container finished" podID="53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7" containerID="51ee1c4d2ed46beafb8d6392f2bfcc5f75c25aef14d5c285f8d74f2f195f224d" exitCode=2 Apr 22 17:36:33.781757 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:36:33.781678 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-684878565-rm8pn" Apr 22 17:36:33.781825 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:36:33.781680 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-684878565-rm8pn" event={"ID":"53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7","Type":"ContainerDied","Data":"51ee1c4d2ed46beafb8d6392f2bfcc5f75c25aef14d5c285f8d74f2f195f224d"} Apr 22 17:36:33.781825 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:36:33.781780 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-684878565-rm8pn" event={"ID":"53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7","Type":"ContainerDied","Data":"e17d214cc4f4f71ed10c6c2ea96ad0e2206babdda4e0e6b502f921beea065b47"} Apr 22 17:36:33.781825 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:36:33.781795 2576 scope.go:117] "RemoveContainer" containerID="51ee1c4d2ed46beafb8d6392f2bfcc5f75c25aef14d5c285f8d74f2f195f224d" Apr 22 17:36:33.789861 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:36:33.789727 2576 scope.go:117] "RemoveContainer" containerID="51ee1c4d2ed46beafb8d6392f2bfcc5f75c25aef14d5c285f8d74f2f195f224d" Apr 22 17:36:33.790088 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:36:33.790017 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51ee1c4d2ed46beafb8d6392f2bfcc5f75c25aef14d5c285f8d74f2f195f224d\": container with ID starting with 51ee1c4d2ed46beafb8d6392f2bfcc5f75c25aef14d5c285f8d74f2f195f224d not found: ID does not exist" containerID="51ee1c4d2ed46beafb8d6392f2bfcc5f75c25aef14d5c285f8d74f2f195f224d" Apr 22 17:36:33.790088 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:36:33.790041 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51ee1c4d2ed46beafb8d6392f2bfcc5f75c25aef14d5c285f8d74f2f195f224d"} err="failed to get container status \"51ee1c4d2ed46beafb8d6392f2bfcc5f75c25aef14d5c285f8d74f2f195f224d\": rpc error: code = NotFound desc = could not find container \"51ee1c4d2ed46beafb8d6392f2bfcc5f75c25aef14d5c285f8d74f2f195f224d\": container with ID starting with 51ee1c4d2ed46beafb8d6392f2bfcc5f75c25aef14d5c285f8d74f2f195f224d not found: ID does not exist" Apr 22 17:36:33.799106 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:36:33.799074 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-684878565-rm8pn"] Apr 22 17:36:33.802619 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:36:33.802591 2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-684878565-rm8pn"] Apr 22 17:36:35.072726 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:36:35.072687 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7" path="/var/lib/kubelet/pods/53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7/volumes" Apr 22 17:36:54.053820 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:36:54.053768 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:36:54.070037 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:36:54.070012 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:36:54.867313 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:36:54.867282 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Apr 22 17:37:26.077368 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:37:26.077332 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-657f6d548f-l6pfm"] Apr 22 17:37:26.077876 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:37:26.077849 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7" containerName="console" Apr 22 17:37:26.077876 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:37:26.077871 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7" containerName="console" Apr 22 17:37:26.077989 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:37:26.077976 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="53dbfc2e-9a41-43aa-9feb-ff34e0c2f0b7" containerName="console" Apr 22 17:37:26.080964 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:37:26.080944 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-657f6d548f-l6pfm" Apr 22 17:37:26.089942 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:37:26.089920 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-657f6d548f-l6pfm"] Apr 22 17:37:26.125626 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:37:26.125593 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62m9d\" (UniqueName: \"kubernetes.io/projected/b54345ca-be95-4801-82d8-5a6105e55b1a-kube-api-access-62m9d\") pod \"console-657f6d548f-l6pfm\" (UID: \"b54345ca-be95-4801-82d8-5a6105e55b1a\") " pod="openshift-console/console-657f6d548f-l6pfm" Apr 22 17:37:26.125798 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:37:26.125636 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b54345ca-be95-4801-82d8-5a6105e55b1a-service-ca\") pod \"console-657f6d548f-l6pfm\" (UID: \"b54345ca-be95-4801-82d8-5a6105e55b1a\") " pod="openshift-console/console-657f6d548f-l6pfm" Apr 22 17:37:26.125798 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:37:26.125657 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b54345ca-be95-4801-82d8-5a6105e55b1a-trusted-ca-bundle\") pod \"console-657f6d548f-l6pfm\" (UID: \"b54345ca-be95-4801-82d8-5a6105e55b1a\") " pod="openshift-console/console-657f6d548f-l6pfm" Apr 22 17:37:26.125798 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:37:26.125725 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b54345ca-be95-4801-82d8-5a6105e55b1a-console-config\") pod \"console-657f6d548f-l6pfm\" (UID: \"b54345ca-be95-4801-82d8-5a6105e55b1a\") " pod="openshift-console/console-657f6d548f-l6pfm" Apr 22 17:37:26.125798 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:37:26.125779 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b54345ca-be95-4801-82d8-5a6105e55b1a-console-serving-cert\") pod \"console-657f6d548f-l6pfm\" (UID: \"b54345ca-be95-4801-82d8-5a6105e55b1a\") " pod="openshift-console/console-657f6d548f-l6pfm" Apr 22 17:37:26.125948 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:37:26.125810 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b54345ca-be95-4801-82d8-5a6105e55b1a-console-oauth-config\") pod \"console-657f6d548f-l6pfm\" (UID: \"b54345ca-be95-4801-82d8-5a6105e55b1a\") " pod="openshift-console/console-657f6d548f-l6pfm" Apr 22 17:37:26.125948 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:37:26.125848 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b54345ca-be95-4801-82d8-5a6105e55b1a-oauth-serving-cert\") pod \"console-657f6d548f-l6pfm\" (UID: \"b54345ca-be95-4801-82d8-5a6105e55b1a\") " pod="openshift-console/console-657f6d548f-l6pfm" Apr 22 17:37:26.227118 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:37:26.227080 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-62m9d\" (UniqueName: \"kubernetes.io/projected/b54345ca-be95-4801-82d8-5a6105e55b1a-kube-api-access-62m9d\") pod \"console-657f6d548f-l6pfm\" (UID: \"b54345ca-be95-4801-82d8-5a6105e55b1a\") " pod="openshift-console/console-657f6d548f-l6pfm" Apr 22 17:37:26.227369 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:37:26.227128 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b54345ca-be95-4801-82d8-5a6105e55b1a-service-ca\") pod \"console-657f6d548f-l6pfm\" (UID: \"b54345ca-be95-4801-82d8-5a6105e55b1a\") " pod="openshift-console/console-657f6d548f-l6pfm" Apr 22 17:37:26.227369 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:37:26.227146 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b54345ca-be95-4801-82d8-5a6105e55b1a-trusted-ca-bundle\") pod \"console-657f6d548f-l6pfm\" (UID: \"b54345ca-be95-4801-82d8-5a6105e55b1a\") " pod="openshift-console/console-657f6d548f-l6pfm" Apr 22 17:37:26.227369 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:37:26.227197 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b54345ca-be95-4801-82d8-5a6105e55b1a-console-config\") pod \"console-657f6d548f-l6pfm\" (UID: \"b54345ca-be95-4801-82d8-5a6105e55b1a\") " pod="openshift-console/console-657f6d548f-l6pfm" Apr 22 17:37:26.227369 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:37:26.227324 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b54345ca-be95-4801-82d8-5a6105e55b1a-console-serving-cert\") pod \"console-657f6d548f-l6pfm\" (UID: \"b54345ca-be95-4801-82d8-5a6105e55b1a\") " pod="openshift-console/console-657f6d548f-l6pfm" Apr 22 17:37:26.227622 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:37:26.227386 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b54345ca-be95-4801-82d8-5a6105e55b1a-console-oauth-config\") pod \"console-657f6d548f-l6pfm\" (UID: \"b54345ca-be95-4801-82d8-5a6105e55b1a\") " pod="openshift-console/console-657f6d548f-l6pfm" Apr 22 17:37:26.227622 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:37:26.227428 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b54345ca-be95-4801-82d8-5a6105e55b1a-oauth-serving-cert\") pod \"console-657f6d548f-l6pfm\" (UID: \"b54345ca-be95-4801-82d8-5a6105e55b1a\") " pod="openshift-console/console-657f6d548f-l6pfm" Apr 22 17:37:26.227969 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:37:26.227944 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b54345ca-be95-4801-82d8-5a6105e55b1a-console-config\") pod \"console-657f6d548f-l6pfm\" (UID: \"b54345ca-be95-4801-82d8-5a6105e55b1a\") " pod="openshift-console/console-657f6d548f-l6pfm" Apr 22 17:37:26.228084 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:37:26.227970 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b54345ca-be95-4801-82d8-5a6105e55b1a-service-ca\") pod \"console-657f6d548f-l6pfm\" (UID: \"b54345ca-be95-4801-82d8-5a6105e55b1a\") " pod="openshift-console/console-657f6d548f-l6pfm" Apr 22 17:37:26.228084 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:37:26.228078 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b54345ca-be95-4801-82d8-5a6105e55b1a-oauth-serving-cert\") pod \"console-657f6d548f-l6pfm\" (UID: \"b54345ca-be95-4801-82d8-5a6105e55b1a\") " pod="openshift-console/console-657f6d548f-l6pfm" Apr 22 17:37:26.228196 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:37:26.228127 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b54345ca-be95-4801-82d8-5a6105e55b1a-trusted-ca-bundle\") pod \"console-657f6d548f-l6pfm\" (UID: \"b54345ca-be95-4801-82d8-5a6105e55b1a\") " pod="openshift-console/console-657f6d548f-l6pfm" Apr 22 17:37:26.230040 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:37:26.230016 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b54345ca-be95-4801-82d8-5a6105e55b1a-console-oauth-config\") pod \"console-657f6d548f-l6pfm\" (UID: \"b54345ca-be95-4801-82d8-5a6105e55b1a\") " pod="openshift-console/console-657f6d548f-l6pfm" Apr 22 17:37:26.230185 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:37:26.230148 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b54345ca-be95-4801-82d8-5a6105e55b1a-console-serving-cert\") pod \"console-657f6d548f-l6pfm\" (UID: \"b54345ca-be95-4801-82d8-5a6105e55b1a\") " pod="openshift-console/console-657f6d548f-l6pfm" Apr 22 17:37:26.235951 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:37:26.235930 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62m9d\" (UniqueName: \"kubernetes.io/projected/b54345ca-be95-4801-82d8-5a6105e55b1a-kube-api-access-62m9d\") pod \"console-657f6d548f-l6pfm\" (UID: \"b54345ca-be95-4801-82d8-5a6105e55b1a\") " pod="openshift-console/console-657f6d548f-l6pfm" Apr 22 17:37:26.390852 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:37:26.390762 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-657f6d548f-l6pfm" Apr 22 17:37:26.514800 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:37:26.514765 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-657f6d548f-l6pfm"] Apr 22 17:37:26.518642 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:37:26.518616 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb54345ca_be95_4801_82d8_5a6105e55b1a.slice/crio-e21ad08e743380502c4e4bd38cfb91f451157410afab468a5279606097f23fee WatchSource:0}: Error finding container e21ad08e743380502c4e4bd38cfb91f451157410afab468a5279606097f23fee: Status 404 returned error can't find the container with id e21ad08e743380502c4e4bd38cfb91f451157410afab468a5279606097f23fee Apr 22 17:37:26.949014 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:37:26.948975 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-657f6d548f-l6pfm" event={"ID":"b54345ca-be95-4801-82d8-5a6105e55b1a","Type":"ContainerStarted","Data":"86a5e7badfc62bda025b4ad8c793415e699fdb474d7ee4c93092c500a562560a"} Apr 22 17:37:26.949014 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:37:26.949011 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-657f6d548f-l6pfm" event={"ID":"b54345ca-be95-4801-82d8-5a6105e55b1a","Type":"ContainerStarted","Data":"e21ad08e743380502c4e4bd38cfb91f451157410afab468a5279606097f23fee"} Apr 22 17:37:26.967064 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:37:26.967009 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-657f6d548f-l6pfm" podStartSLOduration=0.966989488 podStartE2EDuration="966.989488ms" podCreationTimestamp="2026-04-22 17:37:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-22 17:37:26.96593757 +0000 UTC m=+196.410500755" watchObservedRunningTime="2026-04-22 17:37:26.966989488 +0000 UTC m=+196.411552673" Apr 22 17:37:36.391380 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:37:36.391324 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-657f6d548f-l6pfm" Apr 22 17:37:36.391380 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:37:36.391390 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-657f6d548f-l6pfm" Apr 22 17:37:36.396312 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:37:36.396278 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-657f6d548f-l6pfm" Apr 22 17:37:36.982523 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:37:36.982495 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-657f6d548f-l6pfm" Apr 22 17:37:37.034033 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:37:37.034000 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cf445f8f7-p7qvh"] Apr 22 17:38:02.059921 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:38:02.059861 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-cf445f8f7-p7qvh" podUID="0755e577-7f88-430f-b8cc-07cd680a80ba" containerName="console" containerID="cri-o://63ff937258b2fd36a171c663f8284ed4f325a4d697b71f48e6fc8a4eb793fb59" gracePeriod=15 Apr 22 17:38:02.307285 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:38:02.307259 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-cf445f8f7-p7qvh_0755e577-7f88-430f-b8cc-07cd680a80ba/console/0.log" Apr 22 17:38:02.307431 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:38:02.307324 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cf445f8f7-p7qvh" Apr 22 17:38:02.342408 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:38:02.342318 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0755e577-7f88-430f-b8cc-07cd680a80ba-service-ca\") pod \"0755e577-7f88-430f-b8cc-07cd680a80ba\" (UID: \"0755e577-7f88-430f-b8cc-07cd680a80ba\") " Apr 22 17:38:02.342408 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:38:02.342364 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0755e577-7f88-430f-b8cc-07cd680a80ba-trusted-ca-bundle\") pod \"0755e577-7f88-430f-b8cc-07cd680a80ba\" (UID: \"0755e577-7f88-430f-b8cc-07cd680a80ba\") " Apr 22 17:38:02.342633 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:38:02.342409 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0755e577-7f88-430f-b8cc-07cd680a80ba-oauth-serving-cert\") pod \"0755e577-7f88-430f-b8cc-07cd680a80ba\" (UID: \"0755e577-7f88-430f-b8cc-07cd680a80ba\") " Apr 22 17:38:02.342633 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:38:02.342454 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0755e577-7f88-430f-b8cc-07cd680a80ba-console-config\") pod \"0755e577-7f88-430f-b8cc-07cd680a80ba\" (UID: \"0755e577-7f88-430f-b8cc-07cd680a80ba\") " Apr 22 17:38:02.342786 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:38:02.342683 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0755e577-7f88-430f-b8cc-07cd680a80ba-service-ca" (OuterVolumeSpecName: "service-ca") pod "0755e577-7f88-430f-b8cc-07cd680a80ba" (UID: "0755e577-7f88-430f-b8cc-07cd680a80ba"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 22 17:38:02.342895 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:38:02.342872 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0755e577-7f88-430f-b8cc-07cd680a80ba-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0755e577-7f88-430f-b8cc-07cd680a80ba" (UID: "0755e577-7f88-430f-b8cc-07cd680a80ba"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 22 17:38:02.342943 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:38:02.342890 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0755e577-7f88-430f-b8cc-07cd680a80ba-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0755e577-7f88-430f-b8cc-07cd680a80ba" (UID: "0755e577-7f88-430f-b8cc-07cd680a80ba"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 22 17:38:02.342943 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:38:02.342910 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0755e577-7f88-430f-b8cc-07cd680a80ba-console-config" (OuterVolumeSpecName: "console-config") pod "0755e577-7f88-430f-b8cc-07cd680a80ba" (UID: "0755e577-7f88-430f-b8cc-07cd680a80ba"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 22 17:38:02.443673 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:38:02.443630 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0755e577-7f88-430f-b8cc-07cd680a80ba-console-oauth-config\") pod \"0755e577-7f88-430f-b8cc-07cd680a80ba\" (UID: \"0755e577-7f88-430f-b8cc-07cd680a80ba\") " Apr 22 17:38:02.443868 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:38:02.443675 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tq2ch\" (UniqueName: \"kubernetes.io/projected/0755e577-7f88-430f-b8cc-07cd680a80ba-kube-api-access-tq2ch\") pod \"0755e577-7f88-430f-b8cc-07cd680a80ba\" (UID: \"0755e577-7f88-430f-b8cc-07cd680a80ba\") " Apr 22 17:38:02.443868 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:38:02.443744 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0755e577-7f88-430f-b8cc-07cd680a80ba-console-serving-cert\") pod \"0755e577-7f88-430f-b8cc-07cd680a80ba\" (UID: \"0755e577-7f88-430f-b8cc-07cd680a80ba\") " Apr 22 17:38:02.443995 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:38:02.443962 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0755e577-7f88-430f-b8cc-07cd680a80ba-service-ca\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Apr 22 17:38:02.443995 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:38:02.443981 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0755e577-7f88-430f-b8cc-07cd680a80ba-trusted-ca-bundle\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Apr 22 17:38:02.444093 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:38:02.443995 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0755e577-7f88-430f-b8cc-07cd680a80ba-oauth-serving-cert\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Apr 22 17:38:02.444093 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:38:02.444009 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0755e577-7f88-430f-b8cc-07cd680a80ba-console-config\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Apr 22 17:38:02.445923 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:38:02.445888 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0755e577-7f88-430f-b8cc-07cd680a80ba-kube-api-access-tq2ch" (OuterVolumeSpecName: "kube-api-access-tq2ch") pod "0755e577-7f88-430f-b8cc-07cd680a80ba" (UID: "0755e577-7f88-430f-b8cc-07cd680a80ba"). InnerVolumeSpecName "kube-api-access-tq2ch". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 22 17:38:02.445923 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:38:02.445919 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0755e577-7f88-430f-b8cc-07cd680a80ba-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0755e577-7f88-430f-b8cc-07cd680a80ba" (UID: "0755e577-7f88-430f-b8cc-07cd680a80ba"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 22 17:38:02.446071 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:38:02.445937 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0755e577-7f88-430f-b8cc-07cd680a80ba-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0755e577-7f88-430f-b8cc-07cd680a80ba" (UID: "0755e577-7f88-430f-b8cc-07cd680a80ba"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 22 17:38:02.544575 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:38:02.544540 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0755e577-7f88-430f-b8cc-07cd680a80ba-console-oauth-config\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Apr 22 17:38:02.544575 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:38:02.544571 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tq2ch\" (UniqueName: \"kubernetes.io/projected/0755e577-7f88-430f-b8cc-07cd680a80ba-kube-api-access-tq2ch\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Apr 22 17:38:02.544781 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:38:02.544581 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0755e577-7f88-430f-b8cc-07cd680a80ba-console-serving-cert\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Apr 22 17:38:03.056940 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:38:03.056914 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-cf445f8f7-p7qvh_0755e577-7f88-430f-b8cc-07cd680a80ba/console/0.log" Apr 22 17:38:03.057117 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:38:03.056953 2576 generic.go:358] "Generic (PLEG): container finished" podID="0755e577-7f88-430f-b8cc-07cd680a80ba" containerID="63ff937258b2fd36a171c663f8284ed4f325a4d697b71f48e6fc8a4eb793fb59" exitCode=2 Apr 22 17:38:03.057117 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:38:03.056989 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cf445f8f7-p7qvh" event={"ID":"0755e577-7f88-430f-b8cc-07cd680a80ba","Type":"ContainerDied","Data":"63ff937258b2fd36a171c663f8284ed4f325a4d697b71f48e6fc8a4eb793fb59"} Apr 22 17:38:03.057117 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:38:03.057016 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cf445f8f7-p7qvh" Apr 22 17:38:03.057117 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:38:03.057025 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cf445f8f7-p7qvh" event={"ID":"0755e577-7f88-430f-b8cc-07cd680a80ba","Type":"ContainerDied","Data":"1ce75e564df391368fd5d17c6a9fc7483060510d7098792835cd214cb3755e99"} Apr 22 17:38:03.057117 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:38:03.057045 2576 scope.go:117] "RemoveContainer" containerID="63ff937258b2fd36a171c663f8284ed4f325a4d697b71f48e6fc8a4eb793fb59" Apr 22 17:38:03.065578 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:38:03.065410 2576 scope.go:117] "RemoveContainer" containerID="63ff937258b2fd36a171c663f8284ed4f325a4d697b71f48e6fc8a4eb793fb59" Apr 22 17:38:03.065778 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:38:03.065656 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63ff937258b2fd36a171c663f8284ed4f325a4d697b71f48e6fc8a4eb793fb59\": container with ID starting with 63ff937258b2fd36a171c663f8284ed4f325a4d697b71f48e6fc8a4eb793fb59 not found: ID does not exist" containerID="63ff937258b2fd36a171c663f8284ed4f325a4d697b71f48e6fc8a4eb793fb59" Apr 22 17:38:03.065778 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:38:03.065677 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63ff937258b2fd36a171c663f8284ed4f325a4d697b71f48e6fc8a4eb793fb59"} err="failed to get container status \"63ff937258b2fd36a171c663f8284ed4f325a4d697b71f48e6fc8a4eb793fb59\": rpc error: code = NotFound desc = could not find container \"63ff937258b2fd36a171c663f8284ed4f325a4d697b71f48e6fc8a4eb793fb59\": container with ID starting with 63ff937258b2fd36a171c663f8284ed4f325a4d697b71f48e6fc8a4eb793fb59 not found: ID does not exist" Apr 22 17:38:03.091902 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:38:03.091872 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cf445f8f7-p7qvh"] Apr 22 17:38:03.101393 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:38:03.101372 2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-cf445f8f7-p7qvh"] Apr 22 17:38:05.071866 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:38:05.071829 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0755e577-7f88-430f-b8cc-07cd680a80ba" path="/var/lib/kubelet/pods/0755e577-7f88-430f-b8cc-07cd680a80ba/volumes" Apr 22 17:39:10.993829 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:39:10.993804 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5q2p_0d47dea1-b4c9-4c30-9592-ba829fe9f7d3/ovn-acl-logging/0.log" Apr 22 17:39:10.993829 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:39:10.993819 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5q2p_0d47dea1-b4c9-4c30-9592-ba829fe9f7d3/ovn-acl-logging/0.log" Apr 22 17:39:10.996571 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:39:10.996556 2576 kubelet.go:1628] "Image garbage collection succeeded" Apr 22 17:40:59.509969 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:40:59.509936 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-55c4c45587-xcbdf"] Apr 22 17:40:59.510404 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:40:59.510306 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0755e577-7f88-430f-b8cc-07cd680a80ba" containerName="console" Apr 22 17:40:59.510404 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:40:59.510322 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0755e577-7f88-430f-b8cc-07cd680a80ba" containerName="console" Apr 22 17:40:59.510404 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:40:59.510384 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="0755e577-7f88-430f-b8cc-07cd680a80ba" containerName="console" Apr 22 17:40:59.513581 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:40:59.513558 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55c4c45587-xcbdf" Apr 22 17:40:59.526474 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:40:59.526449 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55c4c45587-xcbdf"] Apr 22 17:40:59.561793 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:40:59.561753 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ac4a1bcf-92ae-41a0-9126-a9427c9f0d7c-console-oauth-config\") pod \"console-55c4c45587-xcbdf\" (UID: \"ac4a1bcf-92ae-41a0-9126-a9427c9f0d7c\") " pod="openshift-console/console-55c4c45587-xcbdf" Apr 22 17:40:59.561793 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:40:59.561799 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ac4a1bcf-92ae-41a0-9126-a9427c9f0d7c-service-ca\") pod \"console-55c4c45587-xcbdf\" (UID: \"ac4a1bcf-92ae-41a0-9126-a9427c9f0d7c\") " pod="openshift-console/console-55c4c45587-xcbdf" Apr 22 17:40:59.562007 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:40:59.561824 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ac4a1bcf-92ae-41a0-9126-a9427c9f0d7c-console-serving-cert\") pod \"console-55c4c45587-xcbdf\" (UID: \"ac4a1bcf-92ae-41a0-9126-a9427c9f0d7c\") " pod="openshift-console/console-55c4c45587-xcbdf" Apr 22 17:40:59.562007 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:40:59.561841 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gx9c\" (UniqueName: \"kubernetes.io/projected/ac4a1bcf-92ae-41a0-9126-a9427c9f0d7c-kube-api-access-9gx9c\") pod \"console-55c4c45587-xcbdf\" (UID: \"ac4a1bcf-92ae-41a0-9126-a9427c9f0d7c\") " pod="openshift-console/console-55c4c45587-xcbdf" Apr 22 17:40:59.562007 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:40:59.561968 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ac4a1bcf-92ae-41a0-9126-a9427c9f0d7c-console-config\") pod \"console-55c4c45587-xcbdf\" (UID: \"ac4a1bcf-92ae-41a0-9126-a9427c9f0d7c\") " pod="openshift-console/console-55c4c45587-xcbdf" Apr 22 17:40:59.562007 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:40:59.562000 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ac4a1bcf-92ae-41a0-9126-a9427c9f0d7c-oauth-serving-cert\") pod \"console-55c4c45587-xcbdf\" (UID: \"ac4a1bcf-92ae-41a0-9126-a9427c9f0d7c\") " pod="openshift-console/console-55c4c45587-xcbdf" Apr 22 17:40:59.562133 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:40:59.562030 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac4a1bcf-92ae-41a0-9126-a9427c9f0d7c-trusted-ca-bundle\") pod \"console-55c4c45587-xcbdf\" (UID: \"ac4a1bcf-92ae-41a0-9126-a9427c9f0d7c\") " pod="openshift-console/console-55c4c45587-xcbdf" Apr 22 17:40:59.663052 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:40:59.663014 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ac4a1bcf-92ae-41a0-9126-a9427c9f0d7c-console-oauth-config\") pod \"console-55c4c45587-xcbdf\" (UID: \"ac4a1bcf-92ae-41a0-9126-a9427c9f0d7c\") " pod="openshift-console/console-55c4c45587-xcbdf" Apr 22 17:40:59.663052 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:40:59.663050 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ac4a1bcf-92ae-41a0-9126-a9427c9f0d7c-service-ca\") pod \"console-55c4c45587-xcbdf\" (UID: \"ac4a1bcf-92ae-41a0-9126-a9427c9f0d7c\") " pod="openshift-console/console-55c4c45587-xcbdf" Apr 22 17:40:59.663329 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:40:59.663078 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ac4a1bcf-92ae-41a0-9126-a9427c9f0d7c-console-serving-cert\") pod \"console-55c4c45587-xcbdf\" (UID: \"ac4a1bcf-92ae-41a0-9126-a9427c9f0d7c\") " pod="openshift-console/console-55c4c45587-xcbdf" Apr 22 17:40:59.663329 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:40:59.663096 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9gx9c\" (UniqueName: \"kubernetes.io/projected/ac4a1bcf-92ae-41a0-9126-a9427c9f0d7c-kube-api-access-9gx9c\") pod \"console-55c4c45587-xcbdf\" (UID: \"ac4a1bcf-92ae-41a0-9126-a9427c9f0d7c\") " pod="openshift-console/console-55c4c45587-xcbdf" Apr 22 17:40:59.663329 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:40:59.663152 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ac4a1bcf-92ae-41a0-9126-a9427c9f0d7c-console-config\") pod \"console-55c4c45587-xcbdf\" (UID: \"ac4a1bcf-92ae-41a0-9126-a9427c9f0d7c\") " pod="openshift-console/console-55c4c45587-xcbdf" Apr 22 17:40:59.663329 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:40:59.663214 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ac4a1bcf-92ae-41a0-9126-a9427c9f0d7c-oauth-serving-cert\") pod \"console-55c4c45587-xcbdf\" (UID: \"ac4a1bcf-92ae-41a0-9126-a9427c9f0d7c\") " pod="openshift-console/console-55c4c45587-xcbdf" Apr 22 17:40:59.663329 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:40:59.663253 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac4a1bcf-92ae-41a0-9126-a9427c9f0d7c-trusted-ca-bundle\") pod \"console-55c4c45587-xcbdf\" (UID: \"ac4a1bcf-92ae-41a0-9126-a9427c9f0d7c\") " pod="openshift-console/console-55c4c45587-xcbdf" Apr 22 17:40:59.663897 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:40:59.663870 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ac4a1bcf-92ae-41a0-9126-a9427c9f0d7c-service-ca\") pod \"console-55c4c45587-xcbdf\" (UID: \"ac4a1bcf-92ae-41a0-9126-a9427c9f0d7c\") " pod="openshift-console/console-55c4c45587-xcbdf" Apr 22 17:40:59.664020 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:40:59.663976 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ac4a1bcf-92ae-41a0-9126-a9427c9f0d7c-oauth-serving-cert\") pod \"console-55c4c45587-xcbdf\" (UID: \"ac4a1bcf-92ae-41a0-9126-a9427c9f0d7c\") " pod="openshift-console/console-55c4c45587-xcbdf" Apr 22 17:40:59.664150 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:40:59.664012 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ac4a1bcf-92ae-41a0-9126-a9427c9f0d7c-console-config\") pod \"console-55c4c45587-xcbdf\" (UID: \"ac4a1bcf-92ae-41a0-9126-a9427c9f0d7c\") " pod="openshift-console/console-55c4c45587-xcbdf" Apr 22 17:40:59.664352 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:40:59.664335 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac4a1bcf-92ae-41a0-9126-a9427c9f0d7c-trusted-ca-bundle\") pod \"console-55c4c45587-xcbdf\" (UID: \"ac4a1bcf-92ae-41a0-9126-a9427c9f0d7c\") " pod="openshift-console/console-55c4c45587-xcbdf" Apr 22 17:40:59.665754 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:40:59.665731 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ac4a1bcf-92ae-41a0-9126-a9427c9f0d7c-console-oauth-config\") pod \"console-55c4c45587-xcbdf\" (UID: \"ac4a1bcf-92ae-41a0-9126-a9427c9f0d7c\") " pod="openshift-console/console-55c4c45587-xcbdf" Apr 22 17:40:59.665872 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:40:59.665850 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ac4a1bcf-92ae-41a0-9126-a9427c9f0d7c-console-serving-cert\") pod \"console-55c4c45587-xcbdf\" (UID: \"ac4a1bcf-92ae-41a0-9126-a9427c9f0d7c\") " pod="openshift-console/console-55c4c45587-xcbdf" Apr 22 17:40:59.673828 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:40:59.673803 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gx9c\" (UniqueName: \"kubernetes.io/projected/ac4a1bcf-92ae-41a0-9126-a9427c9f0d7c-kube-api-access-9gx9c\") pod \"console-55c4c45587-xcbdf\" (UID: \"ac4a1bcf-92ae-41a0-9126-a9427c9f0d7c\") " pod="openshift-console/console-55c4c45587-xcbdf" Apr 22 17:40:59.822412 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:40:59.822314 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55c4c45587-xcbdf" Apr 22 17:40:59.942832 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:40:59.942769 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55c4c45587-xcbdf"] Apr 22 17:40:59.945583 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:40:59.945553 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac4a1bcf_92ae_41a0_9126_a9427c9f0d7c.slice/crio-9df30f1112a88e7f75def8c7abee19d4ad43d33c185d410127aea9a7a5707c98 WatchSource:0}: Error finding container 9df30f1112a88e7f75def8c7abee19d4ad43d33c185d410127aea9a7a5707c98: Status 404 returned error can't find the container with id 9df30f1112a88e7f75def8c7abee19d4ad43d33c185d410127aea9a7a5707c98 Apr 22 17:40:59.947285 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:40:59.947270 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Apr 22 17:41:00.598417 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:41:00.598381 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55c4c45587-xcbdf" event={"ID":"ac4a1bcf-92ae-41a0-9126-a9427c9f0d7c","Type":"ContainerStarted","Data":"ba3efe380d96df716f0e80143cb144378af67226e9bd2bab2e57e2ea1e0f56be"} Apr 22 17:41:00.598417 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:41:00.598422 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55c4c45587-xcbdf" event={"ID":"ac4a1bcf-92ae-41a0-9126-a9427c9f0d7c","Type":"ContainerStarted","Data":"9df30f1112a88e7f75def8c7abee19d4ad43d33c185d410127aea9a7a5707c98"} Apr 22 17:41:00.615155 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:41:00.615103 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-55c4c45587-xcbdf" podStartSLOduration=1.6150841740000002 podStartE2EDuration="1.615084174s" podCreationTimestamp="2026-04-22 17:40:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-22 17:41:00.614617045 +0000 UTC m=+410.059180230" watchObservedRunningTime="2026-04-22 17:41:00.615084174 +0000 UTC m=+410.059647356" Apr 22 17:41:09.541970 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:41:09.541930 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve/s3-init-6dhfk"] Apr 22 17:41:09.545538 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:41:09.545515 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-6dhfk" Apr 22 17:41:09.548775 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:41:09.548754 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-9x9jd\"" Apr 22 17:41:09.548896 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:41:09.548756 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Apr 22 17:41:09.548896 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:41:09.548795 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Apr 22 17:41:09.549683 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:41:09.549667 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Apr 22 17:41:09.561645 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:41:09.561624 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-6dhfk"] Apr 22 17:41:09.656358 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:41:09.656327 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grg2c\" (UniqueName: \"kubernetes.io/projected/2d43a9b4-6abc-4416-9150-4394675434ac-kube-api-access-grg2c\") pod \"s3-init-6dhfk\" (UID: \"2d43a9b4-6abc-4416-9150-4394675434ac\") " pod="kserve/s3-init-6dhfk" Apr 22 17:41:09.757325 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:41:09.757294 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-grg2c\" (UniqueName: \"kubernetes.io/projected/2d43a9b4-6abc-4416-9150-4394675434ac-kube-api-access-grg2c\") pod \"s3-init-6dhfk\" (UID: \"2d43a9b4-6abc-4416-9150-4394675434ac\") " pod="kserve/s3-init-6dhfk" Apr 22 17:41:09.767523 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:41:09.767497 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-grg2c\" (UniqueName: \"kubernetes.io/projected/2d43a9b4-6abc-4416-9150-4394675434ac-kube-api-access-grg2c\") pod \"s3-init-6dhfk\" (UID: \"2d43a9b4-6abc-4416-9150-4394675434ac\") " pod="kserve/s3-init-6dhfk" Apr 22 17:41:09.823435 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:41:09.823339 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-55c4c45587-xcbdf" Apr 22 17:41:09.823435 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:41:09.823377 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-55c4c45587-xcbdf" Apr 22 17:41:09.828338 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:41:09.828317 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-55c4c45587-xcbdf" Apr 22 17:41:09.869888 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:41:09.869865 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-6dhfk" Apr 22 17:41:09.998507 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:41:09.998476 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-6dhfk"] Apr 22 17:41:10.001413 ip-10-0-138-38 kubenswrapper[2576]: W0422 17:41:10.001384 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2d43a9b4_6abc_4416_9150_4394675434ac.slice/crio-e74076ffd9f9b41731025cdd3e88ceda8cd7fee2162afe06cc0427df400bf3b9 WatchSource:0}: Error finding container e74076ffd9f9b41731025cdd3e88ceda8cd7fee2162afe06cc0427df400bf3b9: Status 404 returned error can't find the container with id e74076ffd9f9b41731025cdd3e88ceda8cd7fee2162afe06cc0427df400bf3b9 Apr 22 17:41:10.633582 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:41:10.633528 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-6dhfk" event={"ID":"2d43a9b4-6abc-4416-9150-4394675434ac","Type":"ContainerStarted","Data":"e74076ffd9f9b41731025cdd3e88ceda8cd7fee2162afe06cc0427df400bf3b9"} Apr 22 17:41:10.639233 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:41:10.639202 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-55c4c45587-xcbdf" Apr 22 17:41:10.719003 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:41:10.718968 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-657f6d548f-l6pfm"] Apr 22 17:41:14.460772 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:41:14.460750 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Apr 22 17:41:14.649466 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:41:14.649426 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-6dhfk" event={"ID":"2d43a9b4-6abc-4416-9150-4394675434ac","Type":"ContainerStarted","Data":"16445e522e10bfb2226e9964a3cfad3d713d00a742ed4ddd1e4298a8325c172f"} Apr 22 17:41:14.666637 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:41:14.666583 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve/s3-init-6dhfk" podStartSLOduration=1.215590054 podStartE2EDuration="5.666569118s" podCreationTimestamp="2026-04-22 17:41:09 +0000 UTC" firstStartedPulling="2026-04-22 17:41:10.006977282 +0000 UTC m=+419.451540450" lastFinishedPulling="2026-04-22 17:41:14.457956339 +0000 UTC m=+423.902519514" observedRunningTime="2026-04-22 17:41:14.665289175 +0000 UTC m=+424.109852351" watchObservedRunningTime="2026-04-22 17:41:14.666569118 +0000 UTC m=+424.111132301" Apr 22 17:41:17.659821 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:41:17.659789 2576 generic.go:358] "Generic (PLEG): container finished" podID="2d43a9b4-6abc-4416-9150-4394675434ac" containerID="16445e522e10bfb2226e9964a3cfad3d713d00a742ed4ddd1e4298a8325c172f" exitCode=0 Apr 22 17:41:17.660256 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:41:17.659836 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-6dhfk" event={"ID":"2d43a9b4-6abc-4416-9150-4394675434ac","Type":"ContainerDied","Data":"16445e522e10bfb2226e9964a3cfad3d713d00a742ed4ddd1e4298a8325c172f"} Apr 22 17:41:18.792741 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:41:18.792719 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-6dhfk" Apr 22 17:41:18.938035 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:41:18.937948 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-grg2c\" (UniqueName: \"kubernetes.io/projected/2d43a9b4-6abc-4416-9150-4394675434ac-kube-api-access-grg2c\") pod \"2d43a9b4-6abc-4416-9150-4394675434ac\" (UID: \"2d43a9b4-6abc-4416-9150-4394675434ac\") " Apr 22 17:41:18.940276 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:41:18.940254 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d43a9b4-6abc-4416-9150-4394675434ac-kube-api-access-grg2c" (OuterVolumeSpecName: "kube-api-access-grg2c") pod "2d43a9b4-6abc-4416-9150-4394675434ac" (UID: "2d43a9b4-6abc-4416-9150-4394675434ac"). InnerVolumeSpecName "kube-api-access-grg2c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 22 17:41:19.038778 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:41:19.038740 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-grg2c\" (UniqueName: \"kubernetes.io/projected/2d43a9b4-6abc-4416-9150-4394675434ac-kube-api-access-grg2c\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Apr 22 17:41:19.667314 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:41:19.667288 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-6dhfk" Apr 22 17:41:19.667498 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:41:19.667288 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-6dhfk" event={"ID":"2d43a9b4-6abc-4416-9150-4394675434ac","Type":"ContainerDied","Data":"e74076ffd9f9b41731025cdd3e88ceda8cd7fee2162afe06cc0427df400bf3b9"} Apr 22 17:41:19.667498 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:41:19.667400 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e74076ffd9f9b41731025cdd3e88ceda8cd7fee2162afe06cc0427df400bf3b9" Apr 22 17:41:35.751826 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:41:35.751725 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-657f6d548f-l6pfm" podUID="b54345ca-be95-4801-82d8-5a6105e55b1a" containerName="console" containerID="cri-o://86a5e7badfc62bda025b4ad8c793415e699fdb474d7ee4c93092c500a562560a" gracePeriod=15 Apr 22 17:41:35.989510 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:41:35.989487 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-657f6d548f-l6pfm_b54345ca-be95-4801-82d8-5a6105e55b1a/console/0.log" Apr 22 17:41:35.989636 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:41:35.989556 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-657f6d548f-l6pfm" Apr 22 17:41:36.089074 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:41:36.088984 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b54345ca-be95-4801-82d8-5a6105e55b1a-console-config\") pod \"b54345ca-be95-4801-82d8-5a6105e55b1a\" (UID: \"b54345ca-be95-4801-82d8-5a6105e55b1a\") " Apr 22 17:41:36.089074 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:41:36.089024 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b54345ca-be95-4801-82d8-5a6105e55b1a-console-oauth-config\") pod \"b54345ca-be95-4801-82d8-5a6105e55b1a\" (UID: \"b54345ca-be95-4801-82d8-5a6105e55b1a\") " Apr 22 17:41:36.089074 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:41:36.089064 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b54345ca-be95-4801-82d8-5a6105e55b1a-service-ca\") pod \"b54345ca-be95-4801-82d8-5a6105e55b1a\" (UID: \"b54345ca-be95-4801-82d8-5a6105e55b1a\") " Apr 22 17:41:36.089395 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:41:36.089090 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b54345ca-be95-4801-82d8-5a6105e55b1a-oauth-serving-cert\") pod \"b54345ca-be95-4801-82d8-5a6105e55b1a\" (UID: \"b54345ca-be95-4801-82d8-5a6105e55b1a\") " Apr 22 17:41:36.089395 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:41:36.089118 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-62m9d\" (UniqueName: \"kubernetes.io/projected/b54345ca-be95-4801-82d8-5a6105e55b1a-kube-api-access-62m9d\") pod \"b54345ca-be95-4801-82d8-5a6105e55b1a\" (UID: \"b54345ca-be95-4801-82d8-5a6105e55b1a\") " Apr 22 17:41:36.089395 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:41:36.089256 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b54345ca-be95-4801-82d8-5a6105e55b1a-console-serving-cert\") pod \"b54345ca-be95-4801-82d8-5a6105e55b1a\" (UID: \"b54345ca-be95-4801-82d8-5a6105e55b1a\") " Apr 22 17:41:36.089395 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:41:36.089369 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b54345ca-be95-4801-82d8-5a6105e55b1a-trusted-ca-bundle\") pod \"b54345ca-be95-4801-82d8-5a6105e55b1a\" (UID: \"b54345ca-be95-4801-82d8-5a6105e55b1a\") " Apr 22 17:41:36.089617 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:41:36.089456 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b54345ca-be95-4801-82d8-5a6105e55b1a-console-config" (OuterVolumeSpecName: "console-config") pod "b54345ca-be95-4801-82d8-5a6105e55b1a" (UID: "b54345ca-be95-4801-82d8-5a6105e55b1a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 22 17:41:36.089617 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:41:36.089542 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b54345ca-be95-4801-82d8-5a6105e55b1a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b54345ca-be95-4801-82d8-5a6105e55b1a" (UID: "b54345ca-be95-4801-82d8-5a6105e55b1a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 22 17:41:36.089617 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:41:36.089547 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b54345ca-be95-4801-82d8-5a6105e55b1a-service-ca" (OuterVolumeSpecName: "service-ca") pod "b54345ca-be95-4801-82d8-5a6105e55b1a" (UID: "b54345ca-be95-4801-82d8-5a6105e55b1a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 22 17:41:36.089758 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:41:36.089727 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b54345ca-be95-4801-82d8-5a6105e55b1a-console-config\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Apr 22 17:41:36.089758 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:41:36.089748 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b54345ca-be95-4801-82d8-5a6105e55b1a-service-ca\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Apr 22 17:41:36.089922 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:41:36.089763 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b54345ca-be95-4801-82d8-5a6105e55b1a-oauth-serving-cert\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Apr 22 17:41:36.090145 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:41:36.090118 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b54345ca-be95-4801-82d8-5a6105e55b1a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b54345ca-be95-4801-82d8-5a6105e55b1a" (UID: "b54345ca-be95-4801-82d8-5a6105e55b1a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 22 17:41:36.091468 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:41:36.091445 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b54345ca-be95-4801-82d8-5a6105e55b1a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b54345ca-be95-4801-82d8-5a6105e55b1a" (UID: "b54345ca-be95-4801-82d8-5a6105e55b1a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 22 17:41:36.091557 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:41:36.091512 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b54345ca-be95-4801-82d8-5a6105e55b1a-kube-api-access-62m9d" (OuterVolumeSpecName: "kube-api-access-62m9d") pod "b54345ca-be95-4801-82d8-5a6105e55b1a" (UID: "b54345ca-be95-4801-82d8-5a6105e55b1a"). InnerVolumeSpecName "kube-api-access-62m9d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 22 17:41:36.091714 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:41:36.091696 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b54345ca-be95-4801-82d8-5a6105e55b1a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b54345ca-be95-4801-82d8-5a6105e55b1a" (UID: "b54345ca-be95-4801-82d8-5a6105e55b1a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 22 17:41:36.190707 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:41:36.190676 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-62m9d\" (UniqueName: \"kubernetes.io/projected/b54345ca-be95-4801-82d8-5a6105e55b1a-kube-api-access-62m9d\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Apr 22 17:41:36.190707 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:41:36.190701 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b54345ca-be95-4801-82d8-5a6105e55b1a-console-serving-cert\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Apr 22 17:41:36.190707 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:41:36.190711 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b54345ca-be95-4801-82d8-5a6105e55b1a-trusted-ca-bundle\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Apr 22 17:41:36.190930 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:41:36.190720 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b54345ca-be95-4801-82d8-5a6105e55b1a-console-oauth-config\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Apr 22 17:41:36.717377 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:41:36.717349 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-657f6d548f-l6pfm_b54345ca-be95-4801-82d8-5a6105e55b1a/console/0.log" Apr 22 17:41:36.717542 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:41:36.717386 2576 generic.go:358] "Generic (PLEG): container finished" podID="b54345ca-be95-4801-82d8-5a6105e55b1a" containerID="86a5e7badfc62bda025b4ad8c793415e699fdb474d7ee4c93092c500a562560a" exitCode=2 Apr 22 17:41:36.717542 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:41:36.717444 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-657f6d548f-l6pfm" event={"ID":"b54345ca-be95-4801-82d8-5a6105e55b1a","Type":"ContainerDied","Data":"86a5e7badfc62bda025b4ad8c793415e699fdb474d7ee4c93092c500a562560a"} Apr 22 17:41:36.717542 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:41:36.717466 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-657f6d548f-l6pfm" event={"ID":"b54345ca-be95-4801-82d8-5a6105e55b1a","Type":"ContainerDied","Data":"e21ad08e743380502c4e4bd38cfb91f451157410afab468a5279606097f23fee"} Apr 22 17:41:36.717542 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:41:36.717471 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-657f6d548f-l6pfm" Apr 22 17:41:36.717542 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:41:36.717486 2576 scope.go:117] "RemoveContainer" containerID="86a5e7badfc62bda025b4ad8c793415e699fdb474d7ee4c93092c500a562560a" Apr 22 17:41:36.725729 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:41:36.725707 2576 scope.go:117] "RemoveContainer" containerID="86a5e7badfc62bda025b4ad8c793415e699fdb474d7ee4c93092c500a562560a" Apr 22 17:41:36.725989 ip-10-0-138-38 kubenswrapper[2576]: E0422 17:41:36.725970 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86a5e7badfc62bda025b4ad8c793415e699fdb474d7ee4c93092c500a562560a\": container with ID starting with 86a5e7badfc62bda025b4ad8c793415e699fdb474d7ee4c93092c500a562560a not found: ID does not exist" containerID="86a5e7badfc62bda025b4ad8c793415e699fdb474d7ee4c93092c500a562560a" Apr 22 17:41:36.726042 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:41:36.725997 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86a5e7badfc62bda025b4ad8c793415e699fdb474d7ee4c93092c500a562560a"} err="failed to get container status \"86a5e7badfc62bda025b4ad8c793415e699fdb474d7ee4c93092c500a562560a\": rpc error: code = NotFound desc = could not find container \"86a5e7badfc62bda025b4ad8c793415e699fdb474d7ee4c93092c500a562560a\": container with ID starting with 86a5e7badfc62bda025b4ad8c793415e699fdb474d7ee4c93092c500a562560a not found: ID does not exist" Apr 22 17:41:36.757439 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:41:36.757415 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-657f6d548f-l6pfm"] Apr 22 17:41:36.759229 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:41:36.759210 2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-657f6d548f-l6pfm"] Apr 22 17:41:37.072047 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:41:37.072018 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b54345ca-be95-4801-82d8-5a6105e55b1a" path="/var/lib/kubelet/pods/b54345ca-be95-4801-82d8-5a6105e55b1a/volumes" Apr 22 17:44:11.016329 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:44:11.016299 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5q2p_0d47dea1-b4c9-4c30-9592-ba829fe9f7d3/ovn-acl-logging/0.log" Apr 22 17:44:11.017634 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:44:11.017617 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5q2p_0d47dea1-b4c9-4c30-9592-ba829fe9f7d3/ovn-acl-logging/0.log" Apr 22 17:49:11.041353 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:49:11.041326 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5q2p_0d47dea1-b4c9-4c30-9592-ba829fe9f7d3/ovn-acl-logging/0.log" Apr 22 17:49:11.043683 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:49:11.043659 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5q2p_0d47dea1-b4c9-4c30-9592-ba829fe9f7d3/ovn-acl-logging/0.log" Apr 22 17:54:11.064189 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:54:11.064139 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5q2p_0d47dea1-b4c9-4c30-9592-ba829fe9f7d3/ovn-acl-logging/0.log" Apr 22 17:54:11.066767 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:54:11.066752 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5q2p_0d47dea1-b4c9-4c30-9592-ba829fe9f7d3/ovn-acl-logging/0.log" Apr 22 17:59:11.096667 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:59:11.096542 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5q2p_0d47dea1-b4c9-4c30-9592-ba829fe9f7d3/ovn-acl-logging/0.log" Apr 22 17:59:11.100605 ip-10-0-138-38 kubenswrapper[2576]: I0422 17:59:11.099235 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5q2p_0d47dea1-b4c9-4c30-9592-ba829fe9f7d3/ovn-acl-logging/0.log" Apr 22 18:04:11.119379 ip-10-0-138-38 kubenswrapper[2576]: I0422 18:04:11.119250 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5q2p_0d47dea1-b4c9-4c30-9592-ba829fe9f7d3/ovn-acl-logging/0.log" Apr 22 18:04:11.123376 ip-10-0-138-38 kubenswrapper[2576]: I0422 18:04:11.122646 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5q2p_0d47dea1-b4c9-4c30-9592-ba829fe9f7d3/ovn-acl-logging/0.log" Apr 22 18:09:11.141420 ip-10-0-138-38 kubenswrapper[2576]: I0422 18:09:11.141295 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5q2p_0d47dea1-b4c9-4c30-9592-ba829fe9f7d3/ovn-acl-logging/0.log" Apr 22 18:09:11.145481 ip-10-0-138-38 kubenswrapper[2576]: I0422 18:09:11.145463 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5q2p_0d47dea1-b4c9-4c30-9592-ba829fe9f7d3/ovn-acl-logging/0.log" Apr 22 18:14:11.163487 ip-10-0-138-38 kubenswrapper[2576]: I0422 18:14:11.163375 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5q2p_0d47dea1-b4c9-4c30-9592-ba829fe9f7d3/ovn-acl-logging/0.log" Apr 22 18:14:11.167780 ip-10-0-138-38 kubenswrapper[2576]: I0422 18:14:11.167034 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5q2p_0d47dea1-b4c9-4c30-9592-ba829fe9f7d3/ovn-acl-logging/0.log" Apr 22 18:19:11.186671 ip-10-0-138-38 kubenswrapper[2576]: I0422 18:19:11.186562 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5q2p_0d47dea1-b4c9-4c30-9592-ba829fe9f7d3/ovn-acl-logging/0.log" Apr 22 18:19:11.191378 ip-10-0-138-38 kubenswrapper[2576]: I0422 18:19:11.191359 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5q2p_0d47dea1-b4c9-4c30-9592-ba829fe9f7d3/ovn-acl-logging/0.log" Apr 22 18:24:11.210357 ip-10-0-138-38 kubenswrapper[2576]: I0422 18:24:11.210242 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5q2p_0d47dea1-b4c9-4c30-9592-ba829fe9f7d3/ovn-acl-logging/0.log" Apr 22 18:24:11.215654 ip-10-0-138-38 kubenswrapper[2576]: I0422 18:24:11.215630 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5q2p_0d47dea1-b4c9-4c30-9592-ba829fe9f7d3/ovn-acl-logging/0.log" Apr 22 18:29:11.232284 ip-10-0-138-38 kubenswrapper[2576]: I0422 18:29:11.232161 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5q2p_0d47dea1-b4c9-4c30-9592-ba829fe9f7d3/ovn-acl-logging/0.log" Apr 22 18:29:11.238034 ip-10-0-138-38 kubenswrapper[2576]: I0422 18:29:11.238013 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5q2p_0d47dea1-b4c9-4c30-9592-ba829fe9f7d3/ovn-acl-logging/0.log" Apr 22 18:34:11.257167 ip-10-0-138-38 kubenswrapper[2576]: I0422 18:34:11.257143 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5q2p_0d47dea1-b4c9-4c30-9592-ba829fe9f7d3/ovn-acl-logging/0.log" Apr 22 18:34:11.263608 ip-10-0-138-38 kubenswrapper[2576]: I0422 18:34:11.263588 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5q2p_0d47dea1-b4c9-4c30-9592-ba829fe9f7d3/ovn-acl-logging/0.log" Apr 22 18:39:11.281731 ip-10-0-138-38 kubenswrapper[2576]: I0422 18:39:11.281612 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5q2p_0d47dea1-b4c9-4c30-9592-ba829fe9f7d3/ovn-acl-logging/0.log" Apr 22 18:39:11.290024 ip-10-0-138-38 kubenswrapper[2576]: I0422 18:39:11.290003 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5q2p_0d47dea1-b4c9-4c30-9592-ba829fe9f7d3/ovn-acl-logging/0.log" Apr 22 18:44:11.303339 ip-10-0-138-38 kubenswrapper[2576]: I0422 18:44:11.303237 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5q2p_0d47dea1-b4c9-4c30-9592-ba829fe9f7d3/ovn-acl-logging/0.log" Apr 22 18:44:11.312844 ip-10-0-138-38 kubenswrapper[2576]: I0422 18:44:11.312822 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5q2p_0d47dea1-b4c9-4c30-9592-ba829fe9f7d3/ovn-acl-logging/0.log" Apr 22 18:49:11.326081 ip-10-0-138-38 kubenswrapper[2576]: I0422 18:49:11.325959 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5q2p_0d47dea1-b4c9-4c30-9592-ba829fe9f7d3/ovn-acl-logging/0.log" Apr 22 18:49:11.335986 ip-10-0-138-38 kubenswrapper[2576]: I0422 18:49:11.335967 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5q2p_0d47dea1-b4c9-4c30-9592-ba829fe9f7d3/ovn-acl-logging/0.log" Apr 22 18:54:11.351870 ip-10-0-138-38 kubenswrapper[2576]: I0422 18:54:11.351761 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5q2p_0d47dea1-b4c9-4c30-9592-ba829fe9f7d3/ovn-acl-logging/0.log" Apr 22 18:54:11.362591 ip-10-0-138-38 kubenswrapper[2576]: I0422 18:54:11.362572 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5q2p_0d47dea1-b4c9-4c30-9592-ba829fe9f7d3/ovn-acl-logging/0.log" Apr 22 18:59:11.374128 ip-10-0-138-38 kubenswrapper[2576]: I0422 18:59:11.374005 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5q2p_0d47dea1-b4c9-4c30-9592-ba829fe9f7d3/ovn-acl-logging/0.log" Apr 22 18:59:11.385717 ip-10-0-138-38 kubenswrapper[2576]: I0422 18:59:11.385688 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5q2p_0d47dea1-b4c9-4c30-9592-ba829fe9f7d3/ovn-acl-logging/0.log" Apr 22 19:04:11.397729 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:04:11.397608 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5q2p_0d47dea1-b4c9-4c30-9592-ba829fe9f7d3/ovn-acl-logging/0.log" Apr 22 19:04:11.409653 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:04:11.409625 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5q2p_0d47dea1-b4c9-4c30-9592-ba829fe9f7d3/ovn-acl-logging/0.log" Apr 22 19:04:35.092600 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:04:35.092559 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-82dfm/must-gather-dm82d"] Apr 22 19:04:35.092999 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:04:35.092890 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d43a9b4-6abc-4416-9150-4394675434ac" containerName="s3-init" Apr 22 19:04:35.092999 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:04:35.092901 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d43a9b4-6abc-4416-9150-4394675434ac" containerName="s3-init" Apr 22 19:04:35.092999 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:04:35.092924 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b54345ca-be95-4801-82d8-5a6105e55b1a" containerName="console" Apr 22 19:04:35.092999 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:04:35.092929 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b54345ca-be95-4801-82d8-5a6105e55b1a" containerName="console" Apr 22 19:04:35.092999 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:04:35.092980 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="b54345ca-be95-4801-82d8-5a6105e55b1a" containerName="console" Apr 22 19:04:35.092999 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:04:35.092988 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="2d43a9b4-6abc-4416-9150-4394675434ac" containerName="s3-init" Apr 22 19:04:35.096218 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:04:35.096164 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-82dfm/must-gather-dm82d" Apr 22 19:04:35.098767 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:04:35.098744 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-82dfm\"/\"kube-root-ca.crt\"" Apr 22 19:04:35.098894 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:04:35.098795 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-82dfm\"/\"openshift-service-ca.crt\"" Apr 22 19:04:35.098894 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:04:35.098838 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-82dfm\"/\"default-dockercfg-z99nx\"" Apr 22 19:04:35.110616 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:04:35.110589 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-82dfm/must-gather-dm82d"] Apr 22 19:04:35.215159 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:04:35.215117 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/23cbc9b6-ae72-41aa-a355-8c9182eb8c6f-must-gather-output\") pod \"must-gather-dm82d\" (UID: \"23cbc9b6-ae72-41aa-a355-8c9182eb8c6f\") " pod="openshift-must-gather-82dfm/must-gather-dm82d" Apr 22 19:04:35.215346 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:04:35.215257 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnhj9\" (UniqueName: \"kubernetes.io/projected/23cbc9b6-ae72-41aa-a355-8c9182eb8c6f-kube-api-access-wnhj9\") pod \"must-gather-dm82d\" (UID: \"23cbc9b6-ae72-41aa-a355-8c9182eb8c6f\") " pod="openshift-must-gather-82dfm/must-gather-dm82d" Apr 22 19:04:35.316454 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:04:35.316419 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wnhj9\" (UniqueName: \"kubernetes.io/projected/23cbc9b6-ae72-41aa-a355-8c9182eb8c6f-kube-api-access-wnhj9\") pod \"must-gather-dm82d\" (UID: \"23cbc9b6-ae72-41aa-a355-8c9182eb8c6f\") " pod="openshift-must-gather-82dfm/must-gather-dm82d" Apr 22 19:04:35.316672 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:04:35.316475 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/23cbc9b6-ae72-41aa-a355-8c9182eb8c6f-must-gather-output\") pod \"must-gather-dm82d\" (UID: \"23cbc9b6-ae72-41aa-a355-8c9182eb8c6f\") " pod="openshift-must-gather-82dfm/must-gather-dm82d" Apr 22 19:04:35.316803 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:04:35.316785 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/23cbc9b6-ae72-41aa-a355-8c9182eb8c6f-must-gather-output\") pod \"must-gather-dm82d\" (UID: \"23cbc9b6-ae72-41aa-a355-8c9182eb8c6f\") " pod="openshift-must-gather-82dfm/must-gather-dm82d" Apr 22 19:04:35.324714 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:04:35.324686 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnhj9\" (UniqueName: \"kubernetes.io/projected/23cbc9b6-ae72-41aa-a355-8c9182eb8c6f-kube-api-access-wnhj9\") pod \"must-gather-dm82d\" (UID: \"23cbc9b6-ae72-41aa-a355-8c9182eb8c6f\") " pod="openshift-must-gather-82dfm/must-gather-dm82d" Apr 22 19:04:35.414985 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:04:35.414884 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-82dfm/must-gather-dm82d" Apr 22 19:04:35.542021 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:04:35.537207 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-82dfm/must-gather-dm82d"] Apr 22 19:04:35.544249 ip-10-0-138-38 kubenswrapper[2576]: W0422 19:04:35.544218 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod23cbc9b6_ae72_41aa_a355_8c9182eb8c6f.slice/crio-295e4bd96abaae863fd7b43c12df747762ab386adbc58bd8fd04be5c58b81280 WatchSource:0}: Error finding container 295e4bd96abaae863fd7b43c12df747762ab386adbc58bd8fd04be5c58b81280: Status 404 returned error can't find the container with id 295e4bd96abaae863fd7b43c12df747762ab386adbc58bd8fd04be5c58b81280 Apr 22 19:04:35.546407 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:04:35.546380 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Apr 22 19:04:35.762123 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:04:35.762082 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-82dfm/must-gather-dm82d" event={"ID":"23cbc9b6-ae72-41aa-a355-8c9182eb8c6f","Type":"ContainerStarted","Data":"295e4bd96abaae863fd7b43c12df747762ab386adbc58bd8fd04be5c58b81280"} Apr 22 19:04:40.783034 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:04:40.782990 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-82dfm/must-gather-dm82d" event={"ID":"23cbc9b6-ae72-41aa-a355-8c9182eb8c6f","Type":"ContainerStarted","Data":"4edc4833b99e76bbca8bd403976ba2638030c3959e42e58b331574ae76c03b99"} Apr 22 19:04:40.783034 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:04:40.783037 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-82dfm/must-gather-dm82d" event={"ID":"23cbc9b6-ae72-41aa-a355-8c9182eb8c6f","Type":"ContainerStarted","Data":"ad4bd69c2364e4f7ef79081c005d1ce30949fa4def7f24888b5742988a18e769"} Apr 22 19:04:40.799595 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:04:40.799542 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-82dfm/must-gather-dm82d" podStartSLOduration=1.528758175 podStartE2EDuration="5.799526891s" podCreationTimestamp="2026-04-22 19:04:35 +0000 UTC" firstStartedPulling="2026-04-22 19:04:35.546548574 +0000 UTC m=+5424.991111739" lastFinishedPulling="2026-04-22 19:04:39.817317289 +0000 UTC m=+5429.261880455" observedRunningTime="2026-04-22 19:04:40.797917331 +0000 UTC m=+5430.242480516" watchObservedRunningTime="2026-04-22 19:04:40.799526891 +0000 UTC m=+5430.244090074" Apr 22 19:04:59.852686 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:04:59.852648 2576 generic.go:358] "Generic (PLEG): container finished" podID="23cbc9b6-ae72-41aa-a355-8c9182eb8c6f" containerID="ad4bd69c2364e4f7ef79081c005d1ce30949fa4def7f24888b5742988a18e769" exitCode=0 Apr 22 19:04:59.853129 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:04:59.852726 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-82dfm/must-gather-dm82d" event={"ID":"23cbc9b6-ae72-41aa-a355-8c9182eb8c6f","Type":"ContainerDied","Data":"ad4bd69c2364e4f7ef79081c005d1ce30949fa4def7f24888b5742988a18e769"} Apr 22 19:04:59.853129 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:04:59.853091 2576 scope.go:117] "RemoveContainer" containerID="ad4bd69c2364e4f7ef79081c005d1ce30949fa4def7f24888b5742988a18e769" Apr 22 19:05:00.261481 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:00.261444 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-82dfm_must-gather-dm82d_23cbc9b6-ae72-41aa-a355-8c9182eb8c6f/gather/0.log" Apr 22 19:05:00.803572 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:00.803537 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-b8m7m/must-gather-5pd7g"] Apr 22 19:05:00.807260 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:00.807236 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b8m7m/must-gather-5pd7g" Apr 22 19:05:00.809727 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:00.809700 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-b8m7m\"/\"kube-root-ca.crt\"" Apr 22 19:05:00.809727 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:00.809723 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-b8m7m\"/\"openshift-service-ca.crt\"" Apr 22 19:05:00.809909 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:00.809745 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-b8m7m\"/\"default-dockercfg-vckz5\"" Apr 22 19:05:00.815327 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:00.815304 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b8m7m/must-gather-5pd7g"] Apr 22 19:05:00.847776 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:00.847738 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d30d03e9-3b61-4b77-ab87-38dd2d8bb7d6-must-gather-output\") pod \"must-gather-5pd7g\" (UID: \"d30d03e9-3b61-4b77-ab87-38dd2d8bb7d6\") " pod="openshift-must-gather-b8m7m/must-gather-5pd7g" Apr 22 19:05:00.847952 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:00.847852 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssjl8\" (UniqueName: \"kubernetes.io/projected/d30d03e9-3b61-4b77-ab87-38dd2d8bb7d6-kube-api-access-ssjl8\") pod \"must-gather-5pd7g\" (UID: \"d30d03e9-3b61-4b77-ab87-38dd2d8bb7d6\") " pod="openshift-must-gather-b8m7m/must-gather-5pd7g" Apr 22 19:05:00.949111 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:00.949069 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d30d03e9-3b61-4b77-ab87-38dd2d8bb7d6-must-gather-output\") pod \"must-gather-5pd7g\" (UID: \"d30d03e9-3b61-4b77-ab87-38dd2d8bb7d6\") " pod="openshift-must-gather-b8m7m/must-gather-5pd7g" Apr 22 19:05:00.949604 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:00.949146 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ssjl8\" (UniqueName: \"kubernetes.io/projected/d30d03e9-3b61-4b77-ab87-38dd2d8bb7d6-kube-api-access-ssjl8\") pod \"must-gather-5pd7g\" (UID: \"d30d03e9-3b61-4b77-ab87-38dd2d8bb7d6\") " pod="openshift-must-gather-b8m7m/must-gather-5pd7g" Apr 22 19:05:00.949604 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:00.949458 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d30d03e9-3b61-4b77-ab87-38dd2d8bb7d6-must-gather-output\") pod \"must-gather-5pd7g\" (UID: \"d30d03e9-3b61-4b77-ab87-38dd2d8bb7d6\") " pod="openshift-must-gather-b8m7m/must-gather-5pd7g" Apr 22 19:05:00.958340 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:00.958308 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssjl8\" (UniqueName: \"kubernetes.io/projected/d30d03e9-3b61-4b77-ab87-38dd2d8bb7d6-kube-api-access-ssjl8\") pod \"must-gather-5pd7g\" (UID: \"d30d03e9-3b61-4b77-ab87-38dd2d8bb7d6\") " pod="openshift-must-gather-b8m7m/must-gather-5pd7g" Apr 22 19:05:01.117464 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:01.117365 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b8m7m/must-gather-5pd7g" Apr 22 19:05:01.244531 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:01.244487 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b8m7m/must-gather-5pd7g"] Apr 22 19:05:01.246933 ip-10-0-138-38 kubenswrapper[2576]: W0422 19:05:01.246904 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd30d03e9_3b61_4b77_ab87_38dd2d8bb7d6.slice/crio-2f47fdf04c89defc87f745735d2519138a14ca4bc7e4b80e5d9c3e21913ce5b6 WatchSource:0}: Error finding container 2f47fdf04c89defc87f745735d2519138a14ca4bc7e4b80e5d9c3e21913ce5b6: Status 404 returned error can't find the container with id 2f47fdf04c89defc87f745735d2519138a14ca4bc7e4b80e5d9c3e21913ce5b6 Apr 22 19:05:01.861225 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:01.861158 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b8m7m/must-gather-5pd7g" event={"ID":"d30d03e9-3b61-4b77-ab87-38dd2d8bb7d6","Type":"ContainerStarted","Data":"2f47fdf04c89defc87f745735d2519138a14ca4bc7e4b80e5d9c3e21913ce5b6"} Apr 22 19:05:02.867686 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:02.867645 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b8m7m/must-gather-5pd7g" event={"ID":"d30d03e9-3b61-4b77-ab87-38dd2d8bb7d6","Type":"ContainerStarted","Data":"071b8a37b3af9e5fb04ff898ae536929fb9401cebd59583c9c03c0f7c48300c1"} Apr 22 19:05:02.867686 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:02.867678 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b8m7m/must-gather-5pd7g" event={"ID":"d30d03e9-3b61-4b77-ab87-38dd2d8bb7d6","Type":"ContainerStarted","Data":"47d540ce9b51bdac2875effb8815dbfc161ee7eb77ba5c1ddaad84f7ba119bf2"} Apr 22 19:05:02.883248 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:02.883191 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-b8m7m/must-gather-5pd7g" podStartSLOduration=2.026328796 podStartE2EDuration="2.883151033s" podCreationTimestamp="2026-04-22 19:05:00 +0000 UTC" firstStartedPulling="2026-04-22 19:05:01.248619596 +0000 UTC m=+5450.693182760" lastFinishedPulling="2026-04-22 19:05:02.105441824 +0000 UTC m=+5451.550004997" observedRunningTime="2026-04-22 19:05:02.882187924 +0000 UTC m=+5452.326751102" watchObservedRunningTime="2026-04-22 19:05:02.883151033 +0000 UTC m=+5452.327714217" Apr 22 19:05:03.467447 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:03.467406 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-m74jz_7c8e58bc-a87f-4688-8b70-16d3d2a086cc/global-pull-secret-syncer/0.log" Apr 22 19:05:03.719013 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:03.718924 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-tm9m2_561f8fb8-766d-438c-80dc-eacb32a87265/konnectivity-agent/0.log" Apr 22 19:05:03.799241 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:03.799202 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-38.ec2.internal_5e5501b20aff6c46dc26a040c562bb73/haproxy/0.log" Apr 22 19:05:05.635196 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:05.635144 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-82dfm/must-gather-dm82d"] Apr 22 19:05:05.635796 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:05.635761 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-must-gather-82dfm/must-gather-dm82d" podUID="23cbc9b6-ae72-41aa-a355-8c9182eb8c6f" containerName="copy" containerID="cri-o://4edc4833b99e76bbca8bd403976ba2638030c3959e42e58b331574ae76c03b99" gracePeriod=2 Apr 22 19:05:05.642634 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:05.642608 2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-82dfm/must-gather-dm82d"] Apr 22 19:05:05.882027 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:05.882001 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-82dfm_must-gather-dm82d_23cbc9b6-ae72-41aa-a355-8c9182eb8c6f/copy/0.log" Apr 22 19:05:05.882637 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:05.882592 2576 generic.go:358] "Generic (PLEG): container finished" podID="23cbc9b6-ae72-41aa-a355-8c9182eb8c6f" containerID="4edc4833b99e76bbca8bd403976ba2638030c3959e42e58b331574ae76c03b99" exitCode=143 Apr 22 19:05:06.144848 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:06.144712 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-82dfm_must-gather-dm82d_23cbc9b6-ae72-41aa-a355-8c9182eb8c6f/copy/0.log" Apr 22 19:05:06.145282 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:06.145262 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-82dfm/must-gather-dm82d" Apr 22 19:05:06.148559 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:06.148528 2576 status_manager.go:895] "Failed to get status for pod" podUID="23cbc9b6-ae72-41aa-a355-8c9182eb8c6f" pod="openshift-must-gather-82dfm/must-gather-dm82d" err="pods \"must-gather-dm82d\" is forbidden: User \"system:node:ip-10-0-138-38.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-82dfm\": no relationship found between node 'ip-10-0-138-38.ec2.internal' and this object" Apr 22 19:05:06.208528 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:06.208492 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/23cbc9b6-ae72-41aa-a355-8c9182eb8c6f-must-gather-output\") pod \"23cbc9b6-ae72-41aa-a355-8c9182eb8c6f\" (UID: \"23cbc9b6-ae72-41aa-a355-8c9182eb8c6f\") " Apr 22 19:05:06.210608 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:06.210580 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wnhj9\" (UniqueName: \"kubernetes.io/projected/23cbc9b6-ae72-41aa-a355-8c9182eb8c6f-kube-api-access-wnhj9\") pod \"23cbc9b6-ae72-41aa-a355-8c9182eb8c6f\" (UID: \"23cbc9b6-ae72-41aa-a355-8c9182eb8c6f\") " Apr 22 19:05:06.211076 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:06.210453 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23cbc9b6-ae72-41aa-a355-8c9182eb8c6f-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "23cbc9b6-ae72-41aa-a355-8c9182eb8c6f" (UID: "23cbc9b6-ae72-41aa-a355-8c9182eb8c6f"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Apr 22 19:05:06.216196 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:06.214089 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23cbc9b6-ae72-41aa-a355-8c9182eb8c6f-kube-api-access-wnhj9" (OuterVolumeSpecName: "kube-api-access-wnhj9") pod "23cbc9b6-ae72-41aa-a355-8c9182eb8c6f" (UID: "23cbc9b6-ae72-41aa-a355-8c9182eb8c6f"). InnerVolumeSpecName "kube-api-access-wnhj9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 22 19:05:06.312482 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:06.312414 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wnhj9\" (UniqueName: \"kubernetes.io/projected/23cbc9b6-ae72-41aa-a355-8c9182eb8c6f-kube-api-access-wnhj9\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Apr 22 19:05:06.312482 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:06.312454 2576 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/23cbc9b6-ae72-41aa-a355-8c9182eb8c6f-must-gather-output\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Apr 22 19:05:06.888773 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:06.888746 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-82dfm_must-gather-dm82d_23cbc9b6-ae72-41aa-a355-8c9182eb8c6f/copy/0.log" Apr 22 19:05:06.889795 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:06.889776 2576 scope.go:117] "RemoveContainer" containerID="4edc4833b99e76bbca8bd403976ba2638030c3959e42e58b331574ae76c03b99" Apr 22 19:05:06.890067 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:06.890052 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-82dfm/must-gather-dm82d" Apr 22 19:05:06.903502 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:06.903470 2576 status_manager.go:895] "Failed to get status for pod" podUID="23cbc9b6-ae72-41aa-a355-8c9182eb8c6f" pod="openshift-must-gather-82dfm/must-gather-dm82d" err="pods \"must-gather-dm82d\" is forbidden: User \"system:node:ip-10-0-138-38.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-82dfm\": no relationship found between node 'ip-10-0-138-38.ec2.internal' and this object" Apr 22 19:05:06.914342 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:06.914316 2576 scope.go:117] "RemoveContainer" containerID="ad4bd69c2364e4f7ef79081c005d1ce30949fa4def7f24888b5742988a18e769" Apr 22 19:05:06.914549 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:06.914422 2576 status_manager.go:895] "Failed to get status for pod" podUID="23cbc9b6-ae72-41aa-a355-8c9182eb8c6f" pod="openshift-must-gather-82dfm/must-gather-dm82d" err="pods \"must-gather-dm82d\" is forbidden: User \"system:node:ip-10-0-138-38.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-82dfm\": no relationship found between node 'ip-10-0-138-38.ec2.internal' and this object" Apr 22 19:05:07.075115 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:07.075071 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23cbc9b6-ae72-41aa-a355-8c9182eb8c6f" path="/var/lib/kubelet/pods/23cbc9b6-ae72-41aa-a355-8c9182eb8c6f/volumes" Apr 22 19:05:07.274817 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:07.274789 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9976dfee-1fd7-40c0-a1d6-ca27f66142a0/alertmanager/0.log" Apr 22 19:05:07.297881 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:07.297857 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9976dfee-1fd7-40c0-a1d6-ca27f66142a0/config-reloader/0.log" Apr 22 19:05:07.322142 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:07.322110 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9976dfee-1fd7-40c0-a1d6-ca27f66142a0/kube-rbac-proxy-web/0.log" Apr 22 19:05:07.343076 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:07.343042 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9976dfee-1fd7-40c0-a1d6-ca27f66142a0/kube-rbac-proxy/0.log" Apr 22 19:05:07.373899 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:07.373864 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9976dfee-1fd7-40c0-a1d6-ca27f66142a0/kube-rbac-proxy-metric/0.log" Apr 22 19:05:07.396484 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:07.396458 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9976dfee-1fd7-40c0-a1d6-ca27f66142a0/prom-label-proxy/0.log" Apr 22 19:05:07.429357 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:07.429305 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9976dfee-1fd7-40c0-a1d6-ca27f66142a0/init-config-reloader/0.log" Apr 22 19:05:07.519083 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:07.519045 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-69db897b98-wn6cz_de748dd6-d39d-448f-bd35-1602c06041cc/kube-state-metrics/0.log" Apr 22 19:05:07.541466 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:07.541379 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-69db897b98-wn6cz_de748dd6-d39d-448f-bd35-1602c06041cc/kube-rbac-proxy-main/0.log" Apr 22 19:05:07.561639 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:07.561603 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-69db897b98-wn6cz_de748dd6-d39d-448f-bd35-1602c06041cc/kube-rbac-proxy-self/0.log" Apr 22 19:05:07.593096 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:07.593070 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-c765d567f-47zkv_6aaaecf2-7fa0-4f32-be14-4350ca401d77/metrics-server/0.log" Apr 22 19:05:07.621707 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:07.621673 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7dccd58f55-kvtjb_2b142c1a-eb25-4dde-ae49-12d2cc01c628/monitoring-plugin/0.log" Apr 22 19:05:07.724357 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:07.724305 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z9pps_95a6851e-a8cd-4616-b68e-e5b995ea6bd7/node-exporter/0.log" Apr 22 19:05:07.743910 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:07.743871 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z9pps_95a6851e-a8cd-4616-b68e-e5b995ea6bd7/kube-rbac-proxy/0.log" Apr 22 19:05:07.764527 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:07.764490 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z9pps_95a6851e-a8cd-4616-b68e-e5b995ea6bd7/init-textfile/0.log" Apr 22 19:05:07.862574 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:07.862499 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9d44df66c-5z68s_73c9b011-6e25-4fb7-88db-47782660f515/kube-rbac-proxy-main/0.log" Apr 22 19:05:07.885570 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:07.885539 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9d44df66c-5z68s_73c9b011-6e25-4fb7-88db-47782660f515/kube-rbac-proxy-self/0.log" Apr 22 19:05:07.911902 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:07.911872 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9d44df66c-5z68s_73c9b011-6e25-4fb7-88db-47782660f515/openshift-state-metrics/0.log" Apr 22 19:05:07.972752 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:07.972713 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4e13e257-1a99-4503-bba4-118666490485/prometheus/0.log" Apr 22 19:05:07.989346 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:07.989319 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4e13e257-1a99-4503-bba4-118666490485/config-reloader/0.log" Apr 22 19:05:08.011437 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:08.011403 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4e13e257-1a99-4503-bba4-118666490485/thanos-sidecar/0.log" Apr 22 19:05:08.033282 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:08.033247 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4e13e257-1a99-4503-bba4-118666490485/kube-rbac-proxy-web/0.log" Apr 22 19:05:08.059940 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:08.059901 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4e13e257-1a99-4503-bba4-118666490485/kube-rbac-proxy/0.log" Apr 22 19:05:08.079364 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:08.079333 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4e13e257-1a99-4503-bba4-118666490485/kube-rbac-proxy-thanos/0.log" Apr 22 19:05:08.102038 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:08.101998 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4e13e257-1a99-4503-bba4-118666490485/init-config-reloader/0.log" Apr 22 19:05:08.136740 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:08.136642 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5676c8c784-9rzr5_31f5fdd1-4354-411c-b806-4d84fd417eac/prometheus-operator/0.log" Apr 22 19:05:08.155732 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:08.155695 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5676c8c784-9rzr5_31f5fdd1-4354-411c-b806-4d84fd417eac/kube-rbac-proxy/0.log" Apr 22 19:05:08.180057 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:08.180026 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-57cf98b594-nz2jb_1a4af5d4-b1b5-4051-9aec-19e9cd20994d/prometheus-operator-admission-webhook/0.log" Apr 22 19:05:08.291991 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:08.291957 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5bfbf857f6-2p9lx_058893ce-7657-414f-874b-f5aed2040e2c/thanos-query/0.log" Apr 22 19:05:08.327866 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:08.327829 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5bfbf857f6-2p9lx_058893ce-7657-414f-874b-f5aed2040e2c/kube-rbac-proxy-web/0.log" Apr 22 19:05:08.362738 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:08.362703 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5bfbf857f6-2p9lx_058893ce-7657-414f-874b-f5aed2040e2c/kube-rbac-proxy/0.log" Apr 22 19:05:08.393464 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:08.393384 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5bfbf857f6-2p9lx_058893ce-7657-414f-874b-f5aed2040e2c/prom-label-proxy/0.log" Apr 22 19:05:08.427428 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:08.427396 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5bfbf857f6-2p9lx_058893ce-7657-414f-874b-f5aed2040e2c/kube-rbac-proxy-rules/0.log" Apr 22 19:05:08.469391 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:08.469357 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5bfbf857f6-2p9lx_058893ce-7657-414f-874b-f5aed2040e2c/kube-rbac-proxy-metrics/0.log" Apr 22 19:05:10.320361 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:10.320329 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-55c4c45587-xcbdf_ac4a1bcf-92ae-41a0-9126-a9427c9f0d7c/console/0.log" Apr 22 19:05:10.788470 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:10.788437 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-b8m7m/perf-node-gather-daemonset-r7vtt"] Apr 22 19:05:10.788950 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:10.788931 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23cbc9b6-ae72-41aa-a355-8c9182eb8c6f" containerName="gather" Apr 22 19:05:10.788998 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:10.788957 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="23cbc9b6-ae72-41aa-a355-8c9182eb8c6f" containerName="gather" Apr 22 19:05:10.788998 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:10.788978 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23cbc9b6-ae72-41aa-a355-8c9182eb8c6f" containerName="copy" Apr 22 19:05:10.788998 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:10.788987 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="23cbc9b6-ae72-41aa-a355-8c9182eb8c6f" containerName="copy" Apr 22 19:05:10.789099 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:10.789087 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="23cbc9b6-ae72-41aa-a355-8c9182eb8c6f" containerName="copy" Apr 22 19:05:10.789134 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:10.789108 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="23cbc9b6-ae72-41aa-a355-8c9182eb8c6f" containerName="gather" Apr 22 19:05:10.792336 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:10.792315 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b8m7m/perf-node-gather-daemonset-r7vtt" Apr 22 19:05:10.797644 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:10.797615 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b8m7m/perf-node-gather-daemonset-r7vtt"] Apr 22 19:05:10.855765 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:10.855731 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9010fcc6-e4c3-4bf9-be0c-37c9630174d6-lib-modules\") pod \"perf-node-gather-daemonset-r7vtt\" (UID: \"9010fcc6-e4c3-4bf9-be0c-37c9630174d6\") " pod="openshift-must-gather-b8m7m/perf-node-gather-daemonset-r7vtt" Apr 22 19:05:10.856077 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:10.856041 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9010fcc6-e4c3-4bf9-be0c-37c9630174d6-proc\") pod \"perf-node-gather-daemonset-r7vtt\" (UID: \"9010fcc6-e4c3-4bf9-be0c-37c9630174d6\") " pod="openshift-must-gather-b8m7m/perf-node-gather-daemonset-r7vtt" Apr 22 19:05:10.856231 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:10.856107 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9010fcc6-e4c3-4bf9-be0c-37c9630174d6-sys\") pod \"perf-node-gather-daemonset-r7vtt\" (UID: \"9010fcc6-e4c3-4bf9-be0c-37c9630174d6\") " pod="openshift-must-gather-b8m7m/perf-node-gather-daemonset-r7vtt" Apr 22 19:05:10.856231 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:10.856128 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tp4gj\" (UniqueName: \"kubernetes.io/projected/9010fcc6-e4c3-4bf9-be0c-37c9630174d6-kube-api-access-tp4gj\") pod \"perf-node-gather-daemonset-r7vtt\" (UID: \"9010fcc6-e4c3-4bf9-be0c-37c9630174d6\") " pod="openshift-must-gather-b8m7m/perf-node-gather-daemonset-r7vtt" Apr 22 19:05:10.856231 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:10.856165 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9010fcc6-e4c3-4bf9-be0c-37c9630174d6-podres\") pod \"perf-node-gather-daemonset-r7vtt\" (UID: \"9010fcc6-e4c3-4bf9-be0c-37c9630174d6\") " pod="openshift-must-gather-b8m7m/perf-node-gather-daemonset-r7vtt" Apr 22 19:05:10.957285 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:10.957251 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9010fcc6-e4c3-4bf9-be0c-37c9630174d6-lib-modules\") pod \"perf-node-gather-daemonset-r7vtt\" (UID: \"9010fcc6-e4c3-4bf9-be0c-37c9630174d6\") " pod="openshift-must-gather-b8m7m/perf-node-gather-daemonset-r7vtt" Apr 22 19:05:10.957474 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:10.957308 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9010fcc6-e4c3-4bf9-be0c-37c9630174d6-proc\") pod \"perf-node-gather-daemonset-r7vtt\" (UID: \"9010fcc6-e4c3-4bf9-be0c-37c9630174d6\") " pod="openshift-must-gather-b8m7m/perf-node-gather-daemonset-r7vtt" Apr 22 19:05:10.957474 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:10.957351 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9010fcc6-e4c3-4bf9-be0c-37c9630174d6-sys\") pod \"perf-node-gather-daemonset-r7vtt\" (UID: \"9010fcc6-e4c3-4bf9-be0c-37c9630174d6\") " pod="openshift-must-gather-b8m7m/perf-node-gather-daemonset-r7vtt" Apr 22 19:05:10.957474 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:10.957377 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tp4gj\" (UniqueName: \"kubernetes.io/projected/9010fcc6-e4c3-4bf9-be0c-37c9630174d6-kube-api-access-tp4gj\") pod \"perf-node-gather-daemonset-r7vtt\" (UID: \"9010fcc6-e4c3-4bf9-be0c-37c9630174d6\") " pod="openshift-must-gather-b8m7m/perf-node-gather-daemonset-r7vtt" Apr 22 19:05:10.957474 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:10.957409 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9010fcc6-e4c3-4bf9-be0c-37c9630174d6-proc\") pod \"perf-node-gather-daemonset-r7vtt\" (UID: \"9010fcc6-e4c3-4bf9-be0c-37c9630174d6\") " pod="openshift-must-gather-b8m7m/perf-node-gather-daemonset-r7vtt" Apr 22 19:05:10.957474 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:10.957420 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9010fcc6-e4c3-4bf9-be0c-37c9630174d6-podres\") pod \"perf-node-gather-daemonset-r7vtt\" (UID: \"9010fcc6-e4c3-4bf9-be0c-37c9630174d6\") " pod="openshift-must-gather-b8m7m/perf-node-gather-daemonset-r7vtt" Apr 22 19:05:10.957474 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:10.957434 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9010fcc6-e4c3-4bf9-be0c-37c9630174d6-sys\") pod \"perf-node-gather-daemonset-r7vtt\" (UID: \"9010fcc6-e4c3-4bf9-be0c-37c9630174d6\") " pod="openshift-must-gather-b8m7m/perf-node-gather-daemonset-r7vtt" Apr 22 19:05:10.957474 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:10.957438 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9010fcc6-e4c3-4bf9-be0c-37c9630174d6-lib-modules\") pod \"perf-node-gather-daemonset-r7vtt\" (UID: \"9010fcc6-e4c3-4bf9-be0c-37c9630174d6\") " pod="openshift-must-gather-b8m7m/perf-node-gather-daemonset-r7vtt" Apr 22 19:05:10.957744 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:10.957490 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9010fcc6-e4c3-4bf9-be0c-37c9630174d6-podres\") pod \"perf-node-gather-daemonset-r7vtt\" (UID: \"9010fcc6-e4c3-4bf9-be0c-37c9630174d6\") " pod="openshift-must-gather-b8m7m/perf-node-gather-daemonset-r7vtt" Apr 22 19:05:10.969229 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:10.969201 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tp4gj\" (UniqueName: \"kubernetes.io/projected/9010fcc6-e4c3-4bf9-be0c-37c9630174d6-kube-api-access-tp4gj\") pod \"perf-node-gather-daemonset-r7vtt\" (UID: \"9010fcc6-e4c3-4bf9-be0c-37c9630174d6\") " pod="openshift-must-gather-b8m7m/perf-node-gather-daemonset-r7vtt" Apr 22 19:05:11.105734 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:11.105641 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b8m7m/perf-node-gather-daemonset-r7vtt" Apr 22 19:05:11.255120 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:11.255090 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b8m7m/perf-node-gather-daemonset-r7vtt"] Apr 22 19:05:11.258102 ip-10-0-138-38 kubenswrapper[2576]: W0422 19:05:11.258076 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9010fcc6_e4c3_4bf9_be0c_37c9630174d6.slice/crio-e380d8858596d0424e48008210a1b28f3f1f3dd517268d5d8b63c05075a86397 WatchSource:0}: Error finding container e380d8858596d0424e48008210a1b28f3f1f3dd517268d5d8b63c05075a86397: Status 404 returned error can't find the container with id e380d8858596d0424e48008210a1b28f3f1f3dd517268d5d8b63c05075a86397 Apr 22 19:05:11.459525 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:11.459462 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cdrtz_74ac233e-feee-4e49-9b50-3ad174fdd490/dns/0.log" Apr 22 19:05:11.478712 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:11.478682 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cdrtz_74ac233e-feee-4e49-9b50-3ad174fdd490/kube-rbac-proxy/0.log" Apr 22 19:05:11.597141 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:11.597083 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hfp87_6b871faa-db8a-4a95-8c94-6fed862a9dc7/dns-node-resolver/0.log" Apr 22 19:05:11.909337 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:11.909303 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b8m7m/perf-node-gather-daemonset-r7vtt" event={"ID":"9010fcc6-e4c3-4bf9-be0c-37c9630174d6","Type":"ContainerStarted","Data":"49fee62b9ad38f5c9f7cb190d6941a1b9ec6509368c82f8ff6085ff1454326f9"} Apr 22 19:05:11.909337 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:11.909340 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b8m7m/perf-node-gather-daemonset-r7vtt" event={"ID":"9010fcc6-e4c3-4bf9-be0c-37c9630174d6","Type":"ContainerStarted","Data":"e380d8858596d0424e48008210a1b28f3f1f3dd517268d5d8b63c05075a86397"} Apr 22 19:05:11.909540 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:11.909431 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-b8m7m/perf-node-gather-daemonset-r7vtt" Apr 22 19:05:11.927014 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:11.926968 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-b8m7m/perf-node-gather-daemonset-r7vtt" podStartSLOduration=1.926951646 podStartE2EDuration="1.926951646s" podCreationTimestamp="2026-04-22 19:05:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-22 19:05:11.924240412 +0000 UTC m=+5461.368803597" watchObservedRunningTime="2026-04-22 19:05:11.926951646 +0000 UTC m=+5461.371514829" Apr 22 19:05:12.069036 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:12.069001 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-645b85c468-dz7n7_98eed4e9-c7c8-450d-b229-266b7e3fd1ec/registry/0.log" Apr 22 19:05:12.119453 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:12.119418 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dxbhp_d94afc06-594c-4cc6-a15f-473ec2fb5297/node-ca/0.log" Apr 22 19:05:13.153454 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:13.153408 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-r2v8q_4c655f36-4618-49aa-8f46-cbd457bbf957/serve-healthcheck-canary/0.log" Apr 22 19:05:13.630444 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:13.630412 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-g2t44_ad210ce8-144f-41e7-b848-d6b10c18ca89/kube-rbac-proxy/0.log" Apr 22 19:05:13.648557 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:13.648532 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-g2t44_ad210ce8-144f-41e7-b848-d6b10c18ca89/exporter/0.log" Apr 22 19:05:13.668397 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:13.668376 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-g2t44_ad210ce8-144f-41e7-b848-d6b10c18ca89/extractor/0.log" Apr 22 19:05:15.758000 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:15.757951 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-6dhfk_2d43a9b4-6abc-4416-9150-4394675434ac/s3-init/0.log" Apr 22 19:05:17.923222 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:17.923192 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-b8m7m/perf-node-gather-daemonset-r7vtt" Apr 22 19:05:20.861848 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:20.861822 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-6d99f_87846e27-279a-49b8-865a-3979451f84ba/kube-multus/0.log" Apr 22 19:05:21.213744 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:21.213672 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wbltv_1359a64d-2417-42d6-918d-bba7d2d9b6e7/kube-multus-additional-cni-plugins/0.log" Apr 22 19:05:21.233299 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:21.233258 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wbltv_1359a64d-2417-42d6-918d-bba7d2d9b6e7/egress-router-binary-copy/0.log" Apr 22 19:05:21.251936 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:21.251900 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wbltv_1359a64d-2417-42d6-918d-bba7d2d9b6e7/cni-plugins/0.log" Apr 22 19:05:21.270586 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:21.270559 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wbltv_1359a64d-2417-42d6-918d-bba7d2d9b6e7/bond-cni-plugin/0.log" Apr 22 19:05:21.289197 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:21.289154 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wbltv_1359a64d-2417-42d6-918d-bba7d2d9b6e7/routeoverride-cni/0.log" Apr 22 19:05:21.309357 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:21.309330 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wbltv_1359a64d-2417-42d6-918d-bba7d2d9b6e7/whereabouts-cni-bincopy/0.log" Apr 22 19:05:21.331653 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:21.331626 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wbltv_1359a64d-2417-42d6-918d-bba7d2d9b6e7/whereabouts-cni/0.log" Apr 22 19:05:21.385161 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:21.385116 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-n4clb_4dbaf65e-c017-4ec0-bcc0-808342d2272b/network-metrics-daemon/0.log" Apr 22 19:05:21.402003 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:21.401973 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-n4clb_4dbaf65e-c017-4ec0-bcc0-808342d2272b/kube-rbac-proxy/0.log" Apr 22 19:05:22.264530 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:22.264497 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5q2p_0d47dea1-b4c9-4c30-9592-ba829fe9f7d3/ovn-controller/0.log" Apr 22 19:05:22.281524 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:22.281496 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5q2p_0d47dea1-b4c9-4c30-9592-ba829fe9f7d3/ovn-acl-logging/0.log" Apr 22 19:05:22.330214 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:22.330160 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5q2p_0d47dea1-b4c9-4c30-9592-ba829fe9f7d3/ovn-acl-logging/1.log" Apr 22 19:05:22.346973 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:22.346947 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5q2p_0d47dea1-b4c9-4c30-9592-ba829fe9f7d3/kube-rbac-proxy-node/0.log" Apr 22 19:05:22.366486 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:22.366460 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5q2p_0d47dea1-b4c9-4c30-9592-ba829fe9f7d3/kube-rbac-proxy-ovn-metrics/0.log" Apr 22 19:05:22.388408 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:22.388378 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5q2p_0d47dea1-b4c9-4c30-9592-ba829fe9f7d3/northd/0.log" Apr 22 19:05:22.405738 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:22.405713 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5q2p_0d47dea1-b4c9-4c30-9592-ba829fe9f7d3/nbdb/0.log" Apr 22 19:05:22.423076 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:22.423048 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5q2p_0d47dea1-b4c9-4c30-9592-ba829fe9f7d3/sbdb/0.log" Apr 22 19:05:22.592333 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:22.592257 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5q2p_0d47dea1-b4c9-4c30-9592-ba829fe9f7d3/ovnkube-controller/0.log" Apr 22 19:05:24.233763 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:24.233722 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-p76lb_473029a2-4794-4adf-8637-e61f8afbe3a4/network-check-target-container/0.log" Apr 22 19:05:25.097149 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:25.097121 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-mx4d8_2af98b77-7b18-41bf-b19c-6788c06627ec/iptables-alerter/0.log" Apr 22 19:05:25.701074 ip-10-0-138-38 kubenswrapper[2576]: I0422 19:05:25.701050 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-dkxmf_d6d5b140-d25a-4fa9-9f3f-ba8aa1b16332/tuned/0.log"