Apr 21 00:00:43.460769 ip-10-0-136-1 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Apr 21 00:00:43.460781 ip-10-0-136-1 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Apr 21 00:00:43.460788 ip-10-0-136-1 systemd[1]: kubelet.service: Failed with result 'resources'. Apr 21 00:00:43.461034 ip-10-0-136-1 systemd[1]: Failed to start Kubernetes Kubelet. Apr 21 00:00:54.678133 ip-10-0-136-1 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Apr 21 00:00:54.678155 ip-10-0-136-1 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot a374e0a558d74cc292a2602663f8d873 -- Apr 21 00:03:27.437692 ip-10-0-136-1 systemd[1]: Starting Kubernetes Kubelet... Apr 21 00:03:27.934407 ip-10-0-136-1 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Apr 21 00:03:27.934407 ip-10-0-136-1 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Apr 21 00:03:27.934407 ip-10-0-136-1 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Apr 21 00:03:27.934407 ip-10-0-136-1 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Apr 21 00:03:27.934407 ip-10-0-136-1 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Apr 21 00:03:27.936062 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.935977 2576 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Apr 21 00:03:27.938407 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938387 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Apr 21 00:03:27.938407 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938406 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Apr 21 00:03:27.938407 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938409 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Apr 21 00:03:27.938506 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938414 2576 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Apr 21 00:03:27.938506 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938418 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Apr 21 00:03:27.938506 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938421 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Apr 21 00:03:27.938506 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938424 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Apr 21 00:03:27.938506 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938428 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Apr 21 00:03:27.938506 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938431 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Apr 21 00:03:27.938506 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938434 2576 feature_gate.go:328] unrecognized feature gate: Example2 Apr 21 00:03:27.938506 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938437 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Apr 21 00:03:27.938506 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938441 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Apr 21 00:03:27.938506 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938444 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Apr 21 00:03:27.938506 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938447 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Apr 21 00:03:27.938506 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938450 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Apr 21 00:03:27.938506 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938452 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Apr 21 00:03:27.938506 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938455 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Apr 21 00:03:27.938506 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938457 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Apr 21 00:03:27.938506 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938460 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Apr 21 00:03:27.938506 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938462 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Apr 21 00:03:27.938506 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938465 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Apr 21 00:03:27.938506 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938467 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Apr 21 00:03:27.938506 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938469 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Apr 21 00:03:27.938975 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938472 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Apr 21 00:03:27.938975 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938474 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Apr 21 00:03:27.938975 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938477 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Apr 21 00:03:27.938975 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938479 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Apr 21 00:03:27.938975 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938482 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Apr 21 00:03:27.938975 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938484 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Apr 21 00:03:27.938975 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938487 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Apr 21 00:03:27.938975 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938489 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Apr 21 00:03:27.938975 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938491 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Apr 21 00:03:27.938975 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938494 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Apr 21 00:03:27.938975 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938498 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Apr 21 00:03:27.938975 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938502 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Apr 21 00:03:27.938975 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938505 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Apr 21 00:03:27.938975 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938509 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Apr 21 00:03:27.938975 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938512 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Apr 21 00:03:27.938975 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938517 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Apr 21 00:03:27.938975 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938537 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Apr 21 00:03:27.938975 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938540 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Apr 21 00:03:27.938975 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938544 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Apr 21 00:03:27.939461 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938547 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Apr 21 00:03:27.939461 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938551 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Apr 21 00:03:27.939461 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938555 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Apr 21 00:03:27.939461 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938560 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Apr 21 00:03:27.939461 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938563 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Apr 21 00:03:27.939461 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938566 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Apr 21 00:03:27.939461 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938569 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Apr 21 00:03:27.939461 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938571 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Apr 21 00:03:27.939461 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938575 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Apr 21 00:03:27.939461 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938577 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Apr 21 00:03:27.939461 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938580 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Apr 21 00:03:27.939461 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938582 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Apr 21 00:03:27.939461 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938585 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Apr 21 00:03:27.939461 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938587 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Apr 21 00:03:27.939461 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938590 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Apr 21 00:03:27.939461 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938593 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Apr 21 00:03:27.939461 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938595 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Apr 21 00:03:27.939461 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938600 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Apr 21 00:03:27.939461 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938602 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Apr 21 00:03:27.939942 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938605 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Apr 21 00:03:27.939942 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938608 2576 feature_gate.go:328] unrecognized feature gate: Example Apr 21 00:03:27.939942 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938610 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Apr 21 00:03:27.939942 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938613 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Apr 21 00:03:27.939942 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938615 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Apr 21 00:03:27.939942 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938618 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Apr 21 00:03:27.939942 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938620 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Apr 21 00:03:27.939942 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938623 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Apr 21 00:03:27.939942 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938626 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Apr 21 00:03:27.939942 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938628 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Apr 21 00:03:27.939942 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938631 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Apr 21 00:03:27.939942 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938633 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Apr 21 00:03:27.939942 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938636 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Apr 21 00:03:27.939942 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938639 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Apr 21 00:03:27.939942 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938641 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Apr 21 00:03:27.939942 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938646 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Apr 21 00:03:27.939942 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938649 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Apr 21 00:03:27.939942 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938652 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Apr 21 00:03:27.939942 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938654 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Apr 21 00:03:27.939942 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938657 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Apr 21 00:03:27.940439 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938659 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Apr 21 00:03:27.940439 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938662 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Apr 21 00:03:27.940439 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938664 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Apr 21 00:03:27.940439 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938667 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Apr 21 00:03:27.940439 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.938669 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Apr 21 00:03:27.940439 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939079 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Apr 21 00:03:27.940439 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939084 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Apr 21 00:03:27.940439 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939087 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Apr 21 00:03:27.940439 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939090 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Apr 21 00:03:27.940439 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939092 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Apr 21 00:03:27.940439 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939095 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Apr 21 00:03:27.940439 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939097 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Apr 21 00:03:27.940439 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939100 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Apr 21 00:03:27.940439 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939102 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Apr 21 00:03:27.940439 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939104 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Apr 21 00:03:27.940439 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939107 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Apr 21 00:03:27.940439 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939110 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Apr 21 00:03:27.940439 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939112 2576 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Apr 21 00:03:27.940439 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939114 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Apr 21 00:03:27.940891 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939117 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Apr 21 00:03:27.940891 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939120 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Apr 21 00:03:27.940891 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939122 2576 feature_gate.go:328] unrecognized feature gate: Example Apr 21 00:03:27.940891 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939125 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Apr 21 00:03:27.940891 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939128 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Apr 21 00:03:27.940891 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939130 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Apr 21 00:03:27.940891 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939134 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Apr 21 00:03:27.940891 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939137 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Apr 21 00:03:27.940891 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939140 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Apr 21 00:03:27.940891 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939142 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Apr 21 00:03:27.940891 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939144 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Apr 21 00:03:27.940891 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939147 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Apr 21 00:03:27.940891 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939149 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Apr 21 00:03:27.940891 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939152 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Apr 21 00:03:27.940891 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939155 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Apr 21 00:03:27.940891 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939159 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Apr 21 00:03:27.940891 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939162 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Apr 21 00:03:27.940891 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939166 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Apr 21 00:03:27.940891 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939168 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Apr 21 00:03:27.940891 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939171 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Apr 21 00:03:27.941416 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939173 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Apr 21 00:03:27.941416 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939176 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Apr 21 00:03:27.941416 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939178 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Apr 21 00:03:27.941416 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939180 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Apr 21 00:03:27.941416 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939183 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Apr 21 00:03:27.941416 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939185 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Apr 21 00:03:27.941416 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939188 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Apr 21 00:03:27.941416 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939190 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Apr 21 00:03:27.941416 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939192 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Apr 21 00:03:27.941416 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939195 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Apr 21 00:03:27.941416 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939198 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Apr 21 00:03:27.941416 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939200 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Apr 21 00:03:27.941416 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939203 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Apr 21 00:03:27.941416 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939205 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Apr 21 00:03:27.941416 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939207 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Apr 21 00:03:27.941416 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939210 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Apr 21 00:03:27.941416 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939212 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Apr 21 00:03:27.941416 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939215 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Apr 21 00:03:27.941416 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939219 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Apr 21 00:03:27.941416 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939222 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Apr 21 00:03:27.941938 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939224 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Apr 21 00:03:27.941938 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939227 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Apr 21 00:03:27.941938 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939229 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Apr 21 00:03:27.941938 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939232 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Apr 21 00:03:27.941938 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939234 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Apr 21 00:03:27.941938 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939237 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Apr 21 00:03:27.941938 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939240 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Apr 21 00:03:27.941938 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939243 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Apr 21 00:03:27.941938 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939245 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Apr 21 00:03:27.941938 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939248 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Apr 21 00:03:27.941938 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939250 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Apr 21 00:03:27.941938 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939252 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Apr 21 00:03:27.941938 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939255 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Apr 21 00:03:27.941938 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939257 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Apr 21 00:03:27.941938 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939260 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Apr 21 00:03:27.941938 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939262 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Apr 21 00:03:27.941938 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939265 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Apr 21 00:03:27.941938 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939267 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Apr 21 00:03:27.941938 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939269 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Apr 21 00:03:27.941938 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939272 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Apr 21 00:03:27.942440 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939274 2576 feature_gate.go:328] unrecognized feature gate: Example2 Apr 21 00:03:27.942440 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939277 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Apr 21 00:03:27.942440 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939281 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Apr 21 00:03:27.942440 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939283 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Apr 21 00:03:27.942440 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939286 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Apr 21 00:03:27.942440 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939288 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Apr 21 00:03:27.942440 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939291 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Apr 21 00:03:27.942440 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939293 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Apr 21 00:03:27.942440 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939296 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Apr 21 00:03:27.942440 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939298 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Apr 21 00:03:27.942440 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939300 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Apr 21 00:03:27.942440 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.939303 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Apr 21 00:03:27.942440 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939401 2576 flags.go:64] FLAG: --address="0.0.0.0" Apr 21 00:03:27.942440 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939409 2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Apr 21 00:03:27.942440 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939416 2576 flags.go:64] FLAG: --anonymous-auth="true" Apr 21 00:03:27.942440 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939420 2576 flags.go:64] FLAG: --application-metrics-count-limit="100" Apr 21 00:03:27.942440 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939425 2576 flags.go:64] FLAG: --authentication-token-webhook="false" Apr 21 00:03:27.942440 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939429 2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Apr 21 00:03:27.942440 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939433 2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Apr 21 00:03:27.942440 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939442 2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Apr 21 00:03:27.942440 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939445 2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Apr 21 00:03:27.943001 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939448 2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Apr 21 00:03:27.943001 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939452 2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Apr 21 00:03:27.943001 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939455 2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Apr 21 00:03:27.943001 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939458 2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Apr 21 00:03:27.943001 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939461 2576 flags.go:64] FLAG: --cgroup-root="" Apr 21 00:03:27.943001 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939464 2576 flags.go:64] FLAG: --cgroups-per-qos="true" Apr 21 00:03:27.943001 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939467 2576 flags.go:64] FLAG: --client-ca-file="" Apr 21 00:03:27.943001 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939470 2576 flags.go:64] FLAG: --cloud-config="" Apr 21 00:03:27.943001 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939472 2576 flags.go:64] FLAG: --cloud-provider="external" Apr 21 00:03:27.943001 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939475 2576 flags.go:64] FLAG: --cluster-dns="[]" Apr 21 00:03:27.943001 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939479 2576 flags.go:64] FLAG: --cluster-domain="" Apr 21 00:03:27.943001 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939482 2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Apr 21 00:03:27.943001 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939485 2576 flags.go:64] FLAG: --config-dir="" Apr 21 00:03:27.943001 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939488 2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Apr 21 00:03:27.943001 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939492 2576 flags.go:64] FLAG: --container-log-max-files="5" Apr 21 00:03:27.943001 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939496 2576 flags.go:64] FLAG: --container-log-max-size="10Mi" Apr 21 00:03:27.943001 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939499 2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Apr 21 00:03:27.943001 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939502 2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Apr 21 00:03:27.943001 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939505 2576 flags.go:64] FLAG: --containerd-namespace="k8s.io" Apr 21 00:03:27.943001 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939508 2576 flags.go:64] FLAG: --contention-profiling="false" Apr 21 00:03:27.943001 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939511 2576 flags.go:64] FLAG: --cpu-cfs-quota="true" Apr 21 00:03:27.943001 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939515 2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Apr 21 00:03:27.943001 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939518 2576 flags.go:64] FLAG: --cpu-manager-policy="none" Apr 21 00:03:27.943001 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939521 2576 flags.go:64] FLAG: --cpu-manager-policy-options="" Apr 21 00:03:27.943001 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939526 2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Apr 21 00:03:27.943627 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939529 2576 flags.go:64] FLAG: --enable-controller-attach-detach="true" Apr 21 00:03:27.943627 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939533 2576 flags.go:64] FLAG: --enable-debugging-handlers="true" Apr 21 00:03:27.943627 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939535 2576 flags.go:64] FLAG: --enable-load-reader="false" Apr 21 00:03:27.943627 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939539 2576 flags.go:64] FLAG: --enable-server="true" Apr 21 00:03:27.943627 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939542 2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Apr 21 00:03:27.943627 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939546 2576 flags.go:64] FLAG: --event-burst="100" Apr 21 00:03:27.943627 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939549 2576 flags.go:64] FLAG: --event-qps="50" Apr 21 00:03:27.943627 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939552 2576 flags.go:64] FLAG: --event-storage-age-limit="default=0" Apr 21 00:03:27.943627 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939555 2576 flags.go:64] FLAG: --event-storage-event-limit="default=0" Apr 21 00:03:27.943627 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939559 2576 flags.go:64] FLAG: --eviction-hard="" Apr 21 00:03:27.943627 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939562 2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Apr 21 00:03:27.943627 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939565 2576 flags.go:64] FLAG: --eviction-minimum-reclaim="" Apr 21 00:03:27.943627 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939568 2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Apr 21 00:03:27.943627 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939571 2576 flags.go:64] FLAG: --eviction-soft="" Apr 21 00:03:27.943627 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939574 2576 flags.go:64] FLAG: --eviction-soft-grace-period="" Apr 21 00:03:27.943627 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939577 2576 flags.go:64] FLAG: --exit-on-lock-contention="false" Apr 21 00:03:27.943627 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939579 2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Apr 21 00:03:27.943627 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939582 2576 flags.go:64] FLAG: --experimental-mounter-path="" Apr 21 00:03:27.943627 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939585 2576 flags.go:64] FLAG: --fail-cgroupv1="false" Apr 21 00:03:27.943627 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939588 2576 flags.go:64] FLAG: --fail-swap-on="true" Apr 21 00:03:27.943627 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939591 2576 flags.go:64] FLAG: --feature-gates="" Apr 21 00:03:27.943627 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939595 2576 flags.go:64] FLAG: --file-check-frequency="20s" Apr 21 00:03:27.943627 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939598 2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Apr 21 00:03:27.943627 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939601 2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Apr 21 00:03:27.943627 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939604 2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Apr 21 00:03:27.944252 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939608 2576 flags.go:64] FLAG: --healthz-port="10248" Apr 21 00:03:27.944252 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939610 2576 flags.go:64] FLAG: --help="false" Apr 21 00:03:27.944252 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939613 2576 flags.go:64] FLAG: --hostname-override="ip-10-0-136-1.ec2.internal" Apr 21 00:03:27.944252 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939616 2576 flags.go:64] FLAG: --housekeeping-interval="10s" Apr 21 00:03:27.944252 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939620 2576 flags.go:64] FLAG: --http-check-frequency="20s" Apr 21 00:03:27.944252 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939622 2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Apr 21 00:03:27.944252 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939626 2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Apr 21 00:03:27.944252 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939629 2576 flags.go:64] FLAG: --image-gc-high-threshold="85" Apr 21 00:03:27.944252 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939632 2576 flags.go:64] FLAG: --image-gc-low-threshold="80" Apr 21 00:03:27.944252 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939635 2576 flags.go:64] FLAG: --image-service-endpoint="" Apr 21 00:03:27.944252 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939639 2576 flags.go:64] FLAG: --kernel-memcg-notification="false" Apr 21 00:03:27.944252 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939642 2576 flags.go:64] FLAG: --kube-api-burst="100" Apr 21 00:03:27.944252 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939645 2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Apr 21 00:03:27.944252 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939648 2576 flags.go:64] FLAG: --kube-api-qps="50" Apr 21 00:03:27.944252 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939651 2576 flags.go:64] FLAG: --kube-reserved="" Apr 21 00:03:27.944252 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939654 2576 flags.go:64] FLAG: --kube-reserved-cgroup="" Apr 21 00:03:27.944252 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939656 2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Apr 21 00:03:27.944252 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939659 2576 flags.go:64] FLAG: --kubelet-cgroups="" Apr 21 00:03:27.944252 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939662 2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Apr 21 00:03:27.944252 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939665 2576 flags.go:64] FLAG: --lock-file="" Apr 21 00:03:27.944252 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939667 2576 flags.go:64] FLAG: --log-cadvisor-usage="false" Apr 21 00:03:27.944252 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939670 2576 flags.go:64] FLAG: --log-flush-frequency="5s" Apr 21 00:03:27.944252 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939674 2576 flags.go:64] FLAG: --log-json-info-buffer-size="0" Apr 21 00:03:27.944252 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939679 2576 flags.go:64] FLAG: --log-json-split-stream="false" Apr 21 00:03:27.944899 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939682 2576 flags.go:64] FLAG: --log-text-info-buffer-size="0" Apr 21 00:03:27.944899 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939685 2576 flags.go:64] FLAG: --log-text-split-stream="false" Apr 21 00:03:27.944899 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939688 2576 flags.go:64] FLAG: --logging-format="text" Apr 21 00:03:27.944899 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939691 2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Apr 21 00:03:27.944899 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939694 2576 flags.go:64] FLAG: --make-iptables-util-chains="true" Apr 21 00:03:27.944899 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939697 2576 flags.go:64] FLAG: --manifest-url="" Apr 21 00:03:27.944899 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939700 2576 flags.go:64] FLAG: --manifest-url-header="" Apr 21 00:03:27.944899 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939704 2576 flags.go:64] FLAG: --max-housekeeping-interval="15s" Apr 21 00:03:27.944899 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939707 2576 flags.go:64] FLAG: --max-open-files="1000000" Apr 21 00:03:27.944899 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939711 2576 flags.go:64] FLAG: --max-pods="110" Apr 21 00:03:27.944899 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939714 2576 flags.go:64] FLAG: --maximum-dead-containers="-1" Apr 21 00:03:27.944899 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939716 2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Apr 21 00:03:27.944899 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939719 2576 flags.go:64] FLAG: --memory-manager-policy="None" Apr 21 00:03:27.944899 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939722 2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Apr 21 00:03:27.944899 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939725 2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Apr 21 00:03:27.944899 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939728 2576 flags.go:64] FLAG: --node-ip="0.0.0.0" Apr 21 00:03:27.944899 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939731 2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Apr 21 00:03:27.944899 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939740 2576 flags.go:64] FLAG: --node-status-max-images="50" Apr 21 00:03:27.944899 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939747 2576 flags.go:64] FLAG: --node-status-update-frequency="10s" Apr 21 00:03:27.944899 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939750 2576 flags.go:64] FLAG: --oom-score-adj="-999" Apr 21 00:03:27.944899 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939753 2576 flags.go:64] FLAG: --pod-cidr="" Apr 21 00:03:27.944899 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939756 2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c8cfe89231412ff3ee8cb6207fa0be33cad0f08e88c9c0f1e9f7e8c6f14d6715" Apr 21 00:03:27.944899 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939762 2576 flags.go:64] FLAG: --pod-manifest-path="" Apr 21 00:03:27.945483 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939764 2576 flags.go:64] FLAG: --pod-max-pids="-1" Apr 21 00:03:27.945483 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939768 2576 flags.go:64] FLAG: --pods-per-core="0" Apr 21 00:03:27.945483 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939770 2576 flags.go:64] FLAG: --port="10250" Apr 21 00:03:27.945483 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939773 2576 flags.go:64] FLAG: --protect-kernel-defaults="false" Apr 21 00:03:27.945483 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939779 2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0fa2947983299707e" Apr 21 00:03:27.945483 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939783 2576 flags.go:64] FLAG: --qos-reserved="" Apr 21 00:03:27.945483 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939786 2576 flags.go:64] FLAG: --read-only-port="10255" Apr 21 00:03:27.945483 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939789 2576 flags.go:64] FLAG: --register-node="true" Apr 21 00:03:27.945483 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939792 2576 flags.go:64] FLAG: --register-schedulable="true" Apr 21 00:03:27.945483 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939795 2576 flags.go:64] FLAG: --register-with-taints="" Apr 21 00:03:27.945483 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939799 2576 flags.go:64] FLAG: --registry-burst="10" Apr 21 00:03:27.945483 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939813 2576 flags.go:64] FLAG: --registry-qps="5" Apr 21 00:03:27.945483 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939816 2576 flags.go:64] FLAG: --reserved-cpus="" Apr 21 00:03:27.945483 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939819 2576 flags.go:64] FLAG: --reserved-memory="" Apr 21 00:03:27.945483 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939823 2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Apr 21 00:03:27.945483 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939826 2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Apr 21 00:03:27.945483 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939829 2576 flags.go:64] FLAG: --rotate-certificates="false" Apr 21 00:03:27.945483 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939832 2576 flags.go:64] FLAG: --rotate-server-certificates="false" Apr 21 00:03:27.945483 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939835 2576 flags.go:64] FLAG: --runonce="false" Apr 21 00:03:27.945483 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939837 2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Apr 21 00:03:27.945483 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939840 2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Apr 21 00:03:27.945483 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939843 2576 flags.go:64] FLAG: --seccomp-default="false" Apr 21 00:03:27.945483 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939846 2576 flags.go:64] FLAG: --serialize-image-pulls="true" Apr 21 00:03:27.945483 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939849 2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Apr 21 00:03:27.945483 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939852 2576 flags.go:64] FLAG: --storage-driver-db="cadvisor" Apr 21 00:03:27.945483 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939855 2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Apr 21 00:03:27.946101 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939859 2576 flags.go:64] FLAG: --storage-driver-password="root" Apr 21 00:03:27.946101 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939865 2576 flags.go:64] FLAG: --storage-driver-secure="false" Apr 21 00:03:27.946101 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939869 2576 flags.go:64] FLAG: --storage-driver-table="stats" Apr 21 00:03:27.946101 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939872 2576 flags.go:64] FLAG: --storage-driver-user="root" Apr 21 00:03:27.946101 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939875 2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Apr 21 00:03:27.946101 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939878 2576 flags.go:64] FLAG: --sync-frequency="1m0s" Apr 21 00:03:27.946101 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939881 2576 flags.go:64] FLAG: --system-cgroups="" Apr 21 00:03:27.946101 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939884 2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Apr 21 00:03:27.946101 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939889 2576 flags.go:64] FLAG: --system-reserved-cgroup="" Apr 21 00:03:27.946101 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939892 2576 flags.go:64] FLAG: --tls-cert-file="" Apr 21 00:03:27.946101 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939896 2576 flags.go:64] FLAG: --tls-cipher-suites="[]" Apr 21 00:03:27.946101 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939900 2576 flags.go:64] FLAG: --tls-min-version="" Apr 21 00:03:27.946101 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939902 2576 flags.go:64] FLAG: --tls-private-key-file="" Apr 21 00:03:27.946101 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939905 2576 flags.go:64] FLAG: --topology-manager-policy="none" Apr 21 00:03:27.946101 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939908 2576 flags.go:64] FLAG: --topology-manager-policy-options="" Apr 21 00:03:27.946101 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939911 2576 flags.go:64] FLAG: --topology-manager-scope="container" Apr 21 00:03:27.946101 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939914 2576 flags.go:64] FLAG: --v="2" Apr 21 00:03:27.946101 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939918 2576 flags.go:64] FLAG: --version="false" Apr 21 00:03:27.946101 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939922 2576 flags.go:64] FLAG: --vmodule="" Apr 21 00:03:27.946101 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939927 2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Apr 21 00:03:27.946101 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.939930 2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Apr 21 00:03:27.946101 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940028 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Apr 21 00:03:27.946101 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940032 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Apr 21 00:03:27.946101 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940035 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Apr 21 00:03:27.946943 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940038 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Apr 21 00:03:27.946943 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940040 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Apr 21 00:03:27.946943 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940043 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Apr 21 00:03:27.946943 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940045 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Apr 21 00:03:27.946943 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940048 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Apr 21 00:03:27.946943 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940051 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Apr 21 00:03:27.946943 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940053 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Apr 21 00:03:27.946943 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940057 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Apr 21 00:03:27.946943 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940061 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Apr 21 00:03:27.946943 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940065 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Apr 21 00:03:27.946943 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940068 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Apr 21 00:03:27.946943 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940073 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Apr 21 00:03:27.946943 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940076 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Apr 21 00:03:27.946943 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940079 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Apr 21 00:03:27.946943 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940082 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Apr 21 00:03:27.946943 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940084 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Apr 21 00:03:27.946943 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940087 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Apr 21 00:03:27.946943 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940089 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Apr 21 00:03:27.946943 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940092 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Apr 21 00:03:27.947774 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940095 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Apr 21 00:03:27.947774 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940097 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Apr 21 00:03:27.947774 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940100 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Apr 21 00:03:27.947774 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940103 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Apr 21 00:03:27.947774 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940105 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Apr 21 00:03:27.947774 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940107 2576 feature_gate.go:328] unrecognized feature gate: Example Apr 21 00:03:27.947774 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940110 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Apr 21 00:03:27.947774 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940112 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Apr 21 00:03:27.947774 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940115 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Apr 21 00:03:27.947774 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940117 2576 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Apr 21 00:03:27.947774 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940120 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Apr 21 00:03:27.947774 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940122 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Apr 21 00:03:27.947774 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940125 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Apr 21 00:03:27.947774 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940127 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Apr 21 00:03:27.947774 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940129 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Apr 21 00:03:27.947774 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940132 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Apr 21 00:03:27.947774 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940136 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Apr 21 00:03:27.947774 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940138 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Apr 21 00:03:27.947774 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940141 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Apr 21 00:03:27.947774 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940143 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Apr 21 00:03:27.948463 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940146 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Apr 21 00:03:27.948463 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940148 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Apr 21 00:03:27.948463 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940152 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Apr 21 00:03:27.948463 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940154 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Apr 21 00:03:27.948463 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940156 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Apr 21 00:03:27.948463 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940163 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Apr 21 00:03:27.948463 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940166 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Apr 21 00:03:27.948463 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940168 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Apr 21 00:03:27.948463 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940171 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Apr 21 00:03:27.948463 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940173 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Apr 21 00:03:27.948463 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940175 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Apr 21 00:03:27.948463 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940179 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Apr 21 00:03:27.948463 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940182 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Apr 21 00:03:27.948463 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940184 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Apr 21 00:03:27.948463 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940187 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Apr 21 00:03:27.948463 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940189 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Apr 21 00:03:27.948463 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940191 2576 feature_gate.go:328] unrecognized feature gate: Example2 Apr 21 00:03:27.948463 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940194 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Apr 21 00:03:27.948463 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940196 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Apr 21 00:03:27.948463 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940199 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Apr 21 00:03:27.949006 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940201 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Apr 21 00:03:27.949006 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940204 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Apr 21 00:03:27.949006 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940206 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Apr 21 00:03:27.949006 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940209 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Apr 21 00:03:27.949006 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940211 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Apr 21 00:03:27.949006 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940214 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Apr 21 00:03:27.949006 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940216 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Apr 21 00:03:27.949006 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940218 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Apr 21 00:03:27.949006 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940221 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Apr 21 00:03:27.949006 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940223 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Apr 21 00:03:27.949006 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940225 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Apr 21 00:03:27.949006 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940228 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Apr 21 00:03:27.949006 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940230 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Apr 21 00:03:27.949006 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940233 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Apr 21 00:03:27.949006 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940236 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Apr 21 00:03:27.949006 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940239 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Apr 21 00:03:27.949006 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940241 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Apr 21 00:03:27.949006 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940244 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Apr 21 00:03:27.949006 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940247 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Apr 21 00:03:27.949516 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940249 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Apr 21 00:03:27.949516 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940252 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Apr 21 00:03:27.949516 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940254 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Apr 21 00:03:27.949516 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940257 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Apr 21 00:03:27.949516 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.940260 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Apr 21 00:03:27.949516 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.941037 2576 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Apr 21 00:03:27.949516 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.949038 2576 server.go:530] "Kubelet version" kubeletVersion="v1.33.9" Apr 21 00:03:27.949516 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.949060 2576 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Apr 21 00:03:27.949516 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949113 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Apr 21 00:03:27.949516 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949119 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Apr 21 00:03:27.949516 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949122 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Apr 21 00:03:27.949516 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949125 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Apr 21 00:03:27.949516 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949128 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Apr 21 00:03:27.949516 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949131 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Apr 21 00:03:27.949516 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949134 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Apr 21 00:03:27.949516 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949137 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Apr 21 00:03:27.949915 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949142 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Apr 21 00:03:27.949915 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949147 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Apr 21 00:03:27.949915 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949150 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Apr 21 00:03:27.949915 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949153 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Apr 21 00:03:27.949915 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949156 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Apr 21 00:03:27.949915 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949159 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Apr 21 00:03:27.949915 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949161 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Apr 21 00:03:27.949915 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949164 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Apr 21 00:03:27.949915 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949166 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Apr 21 00:03:27.949915 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949169 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Apr 21 00:03:27.949915 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949172 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Apr 21 00:03:27.949915 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949174 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Apr 21 00:03:27.949915 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949177 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Apr 21 00:03:27.949915 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949184 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Apr 21 00:03:27.949915 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949187 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Apr 21 00:03:27.949915 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949189 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Apr 21 00:03:27.949915 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949192 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Apr 21 00:03:27.949915 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949195 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Apr 21 00:03:27.949915 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949197 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Apr 21 00:03:27.950400 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949200 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Apr 21 00:03:27.950400 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949203 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Apr 21 00:03:27.950400 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949206 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Apr 21 00:03:27.950400 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949210 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Apr 21 00:03:27.950400 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949214 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Apr 21 00:03:27.950400 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949217 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Apr 21 00:03:27.950400 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949219 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Apr 21 00:03:27.950400 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949222 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Apr 21 00:03:27.950400 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949225 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Apr 21 00:03:27.950400 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949227 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Apr 21 00:03:27.950400 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949230 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Apr 21 00:03:27.950400 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949232 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Apr 21 00:03:27.950400 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949235 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Apr 21 00:03:27.950400 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949238 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Apr 21 00:03:27.950400 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949240 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Apr 21 00:03:27.950400 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949242 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Apr 21 00:03:27.950400 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949245 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Apr 21 00:03:27.950400 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949248 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Apr 21 00:03:27.950400 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949251 2576 feature_gate.go:328] unrecognized feature gate: Example Apr 21 00:03:27.950861 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949253 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Apr 21 00:03:27.950861 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949255 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Apr 21 00:03:27.950861 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949258 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Apr 21 00:03:27.950861 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949260 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Apr 21 00:03:27.950861 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949263 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Apr 21 00:03:27.950861 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949266 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Apr 21 00:03:27.950861 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949268 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Apr 21 00:03:27.950861 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949270 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Apr 21 00:03:27.950861 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949273 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Apr 21 00:03:27.950861 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949276 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Apr 21 00:03:27.950861 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949278 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Apr 21 00:03:27.950861 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949281 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Apr 21 00:03:27.950861 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949283 2576 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Apr 21 00:03:27.950861 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949286 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Apr 21 00:03:27.950861 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949288 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Apr 21 00:03:27.950861 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949291 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Apr 21 00:03:27.950861 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949293 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Apr 21 00:03:27.950861 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949297 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Apr 21 00:03:27.950861 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949299 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Apr 21 00:03:27.950861 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949302 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Apr 21 00:03:27.951342 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949304 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Apr 21 00:03:27.951342 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949307 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Apr 21 00:03:27.951342 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949310 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Apr 21 00:03:27.951342 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949312 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Apr 21 00:03:27.951342 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949315 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Apr 21 00:03:27.951342 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949317 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Apr 21 00:03:27.951342 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949320 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Apr 21 00:03:27.951342 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949322 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Apr 21 00:03:27.951342 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949325 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Apr 21 00:03:27.951342 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949328 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Apr 21 00:03:27.951342 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949331 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Apr 21 00:03:27.951342 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949334 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Apr 21 00:03:27.951342 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949337 2576 feature_gate.go:328] unrecognized feature gate: Example2 Apr 21 00:03:27.951342 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949339 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Apr 21 00:03:27.951342 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949342 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Apr 21 00:03:27.951342 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949344 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Apr 21 00:03:27.951342 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949347 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Apr 21 00:03:27.951342 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949349 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Apr 21 00:03:27.951342 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949351 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Apr 21 00:03:27.951847 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949354 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Apr 21 00:03:27.951847 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.949377 2576 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Apr 21 00:03:27.951847 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949485 2576 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Apr 21 00:03:27.951847 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949491 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Apr 21 00:03:27.951847 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949494 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Apr 21 00:03:27.951847 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949497 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Apr 21 00:03:27.951847 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949500 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Apr 21 00:03:27.951847 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949503 2576 feature_gate.go:328] unrecognized feature gate: Example Apr 21 00:03:27.951847 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949506 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Apr 21 00:03:27.951847 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949508 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Apr 21 00:03:27.951847 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949511 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Apr 21 00:03:27.951847 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949515 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Apr 21 00:03:27.951847 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949518 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Apr 21 00:03:27.951847 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949520 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Apr 21 00:03:27.951847 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949523 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Apr 21 00:03:27.952220 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949526 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Apr 21 00:03:27.952220 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949528 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Apr 21 00:03:27.952220 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949531 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Apr 21 00:03:27.952220 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949534 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Apr 21 00:03:27.952220 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949538 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Apr 21 00:03:27.952220 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949540 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Apr 21 00:03:27.952220 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949543 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Apr 21 00:03:27.952220 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949545 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Apr 21 00:03:27.952220 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949548 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Apr 21 00:03:27.952220 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949551 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Apr 21 00:03:27.952220 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949554 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Apr 21 00:03:27.952220 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949557 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Apr 21 00:03:27.952220 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949559 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Apr 21 00:03:27.952220 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949562 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Apr 21 00:03:27.952220 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949564 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Apr 21 00:03:27.952220 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949567 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Apr 21 00:03:27.952220 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949571 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Apr 21 00:03:27.952220 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949574 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Apr 21 00:03:27.952220 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949577 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Apr 21 00:03:27.952689 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949580 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Apr 21 00:03:27.952689 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949582 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Apr 21 00:03:27.952689 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949585 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Apr 21 00:03:27.952689 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949587 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Apr 21 00:03:27.952689 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949590 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Apr 21 00:03:27.952689 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949592 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Apr 21 00:03:27.952689 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949595 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Apr 21 00:03:27.952689 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949598 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Apr 21 00:03:27.952689 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949601 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Apr 21 00:03:27.952689 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949604 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Apr 21 00:03:27.952689 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949606 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Apr 21 00:03:27.952689 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949609 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Apr 21 00:03:27.952689 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949611 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Apr 21 00:03:27.952689 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949614 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Apr 21 00:03:27.952689 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949617 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Apr 21 00:03:27.952689 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949620 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Apr 21 00:03:27.952689 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949623 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Apr 21 00:03:27.952689 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949626 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Apr 21 00:03:27.952689 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949629 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Apr 21 00:03:27.952689 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949632 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Apr 21 00:03:27.953182 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949634 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Apr 21 00:03:27.953182 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949637 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Apr 21 00:03:27.953182 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949639 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Apr 21 00:03:27.953182 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949643 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Apr 21 00:03:27.953182 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949646 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Apr 21 00:03:27.953182 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949648 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Apr 21 00:03:27.953182 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949650 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Apr 21 00:03:27.953182 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949653 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Apr 21 00:03:27.953182 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949655 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Apr 21 00:03:27.953182 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949658 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Apr 21 00:03:27.953182 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949660 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Apr 21 00:03:27.953182 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949663 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Apr 21 00:03:27.953182 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949665 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Apr 21 00:03:27.953182 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949668 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Apr 21 00:03:27.953182 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949670 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Apr 21 00:03:27.953182 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949672 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Apr 21 00:03:27.953182 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949675 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Apr 21 00:03:27.953182 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949678 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Apr 21 00:03:27.953182 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949680 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Apr 21 00:03:27.953182 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949683 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Apr 21 00:03:27.953736 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949686 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Apr 21 00:03:27.953736 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949688 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Apr 21 00:03:27.953736 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949691 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Apr 21 00:03:27.953736 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949693 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Apr 21 00:03:27.953736 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949696 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Apr 21 00:03:27.953736 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949698 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Apr 21 00:03:27.953736 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949700 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Apr 21 00:03:27.953736 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949703 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Apr 21 00:03:27.953736 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949705 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Apr 21 00:03:27.953736 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949708 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Apr 21 00:03:27.953736 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949711 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Apr 21 00:03:27.953736 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949713 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Apr 21 00:03:27.953736 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949716 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Apr 21 00:03:27.953736 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:27.949718 2576 feature_gate.go:328] unrecognized feature gate: Example2 Apr 21 00:03:27.953736 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.949723 2576 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Apr 21 00:03:27.953736 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.950498 2576 server.go:962] "Client rotation is on, will bootstrap in background" Apr 21 00:03:27.954155 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.953490 2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Apr 21 00:03:27.954521 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.954498 2576 server.go:1019] "Starting client certificate rotation" Apr 21 00:03:27.954646 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.954625 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Apr 21 00:03:27.954687 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.954677 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Apr 21 00:03:27.977933 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.977908 2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Apr 21 00:03:27.980771 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:27.980738 2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Apr 21 00:03:28.001094 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.001064 2576 log.go:25] "Validated CRI v1 runtime API" Apr 21 00:03:28.008697 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.008670 2576 log.go:25] "Validated CRI v1 image API" Apr 21 00:03:28.010013 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.009986 2576 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Apr 21 00:03:28.014498 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.014477 2576 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Apr 21 00:03:28.017978 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.017953 2576 fs.go:135] Filesystem UUIDs: map[6babdd06-b632-4670-baab-c714df52c257:/dev/nvme0n1p3 773e115a-69db-4091-81a5-548cbd5f2011:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Apr 21 00:03:28.018041 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.017979 2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Apr 21 00:03:28.025381 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.025235 2576 manager.go:217] Machine: {Timestamp:2026-04-21 00:03:28.02302591 +0000 UTC m=+0.458364132 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099155 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec243c00f44e098b9fb4bb0cbcf27839 SystemUUID:ec243c00-f44e-098b-9fb4-bb0cbcf27839 BootID:a374e0a5-58d7-4cc2-92a2-602663f8d873 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:11:8f:c0:b5:05 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:11:8f:c0:b5:05 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0e:2f:a6:31:28:4d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Apr 21 00:03:28.026117 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.026103 2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Apr 21 00:03:28.026221 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.026207 2576 manager.go:233] Version: {KernelVersion:5.14.0-570.107.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260414-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Apr 21 00:03:28.026682 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.026656 2576 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Apr 21 00:03:28.026830 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.026683 2576 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-1.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Apr 21 00:03:28.026880 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.026841 2576 topology_manager.go:138] "Creating topology manager with none policy" Apr 21 00:03:28.026880 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.026851 2576 container_manager_linux.go:306] "Creating device plugin manager" Apr 21 00:03:28.026880 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.026865 2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Apr 21 00:03:28.028460 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.028447 2576 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Apr 21 00:03:28.030001 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.029987 2576 state_mem.go:36] "Initialized new in-memory state store" Apr 21 00:03:28.030137 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.030126 2576 server.go:1267] "Using root directory" path="/var/lib/kubelet" Apr 21 00:03:28.032519 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.032505 2576 kubelet.go:491] "Attempting to sync node with API server" Apr 21 00:03:28.032572 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.032522 2576 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Apr 21 00:03:28.032572 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.032537 2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Apr 21 00:03:28.032572 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.032548 2576 kubelet.go:397] "Adding apiserver pod source" Apr 21 00:03:28.032572 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.032558 2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Apr 21 00:03:28.033575 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.033559 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Apr 21 00:03:28.033575 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.033578 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Apr 21 00:03:28.036695 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.036671 2576 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.10-2.rhaos4.20.gita4d0894.el9" apiVersion="v1" Apr 21 00:03:28.038324 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.038309 2576 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Apr 21 00:03:28.040295 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.040278 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Apr 21 00:03:28.040295 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.040275 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hmrrs" Apr 21 00:03:28.040452 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.040300 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Apr 21 00:03:28.040452 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.040323 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Apr 21 00:03:28.040452 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.040333 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Apr 21 00:03:28.040452 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.040342 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Apr 21 00:03:28.040452 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.040351 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Apr 21 00:03:28.040452 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.040369 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Apr 21 00:03:28.040452 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.040376 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Apr 21 00:03:28.040452 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.040383 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Apr 21 00:03:28.040452 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.040389 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Apr 21 00:03:28.040452 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.040398 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Apr 21 00:03:28.040452 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.040408 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Apr 21 00:03:28.041329 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.041317 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Apr 21 00:03:28.041381 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.041330 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Apr 21 00:03:28.045477 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.045461 2576 watchdog_linux.go:99] "Systemd watchdog is not enabled" Apr 21 00:03:28.045544 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.045502 2576 server.go:1295] "Started kubelet" Apr 21 00:03:28.045622 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.045568 2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Apr 21 00:03:28.045655 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.045596 2576 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Apr 21 00:03:28.045732 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.045658 2576 server_v1.go:47] "podresources" method="list" useActivePods=true Apr 21 00:03:28.046395 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.046374 2576 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-1.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Apr 21 00:03:28.046515 ip-10-0-136-1 systemd[1]: Started Kubernetes Kubelet. Apr 21 00:03:28.047054 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.046917 2576 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Apr 21 00:03:28.048137 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.048124 2576 server.go:317] "Adding debug handlers to kubelet server" Apr 21 00:03:28.053688 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:28.053660 2576 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-1.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Apr 21 00:03:28.053688 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:28.053662 2576 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Apr 21 00:03:28.054352 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.054329 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Apr 21 00:03:28.054352 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.054342 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hmrrs" Apr 21 00:03:28.054714 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:28.054694 2576 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Apr 21 00:03:28.055265 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.055250 2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Apr 21 00:03:28.055920 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.055849 2576 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Apr 21 00:03:28.055920 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.055855 2576 volume_manager.go:295] "The desired_state_of_world populator starts" Apr 21 00:03:28.055920 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.055876 2576 volume_manager.go:297] "Starting Kubelet Volume Manager" Apr 21 00:03:28.056252 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:28.056234 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-1.ec2.internal\" not found" Apr 21 00:03:28.056542 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.056528 2576 reconstruct.go:97] "Volume reconstruction finished" Apr 21 00:03:28.056542 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.056543 2576 reconciler.go:26] "Reconciler: start to sync state" Apr 21 00:03:28.056741 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:28.054999 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-1.ec2.internal.18a83658ce660728 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-1.ec2.internal,UID:ip-10-0-136-1.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-1.ec2.internal,},FirstTimestamp:2026-04-21 00:03:28.045475624 +0000 UTC m=+0.480813842,LastTimestamp:2026-04-21 00:03:28.045475624 +0000 UTC m=+0.480813842,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-1.ec2.internal,}" Apr 21 00:03:28.056837 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.056822 2576 factory.go:153] Registering CRI-O factory Apr 21 00:03:28.056885 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.056844 2576 factory.go:223] Registration of the crio container factory successfully Apr 21 00:03:28.056924 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.056909 2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Apr 21 00:03:28.056924 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.056919 2576 factory.go:55] Registering systemd factory Apr 21 00:03:28.056991 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.056928 2576 factory.go:223] Registration of the systemd container factory successfully Apr 21 00:03:28.056991 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.056953 2576 factory.go:103] Registering Raw factory Apr 21 00:03:28.056991 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.056967 2576 manager.go:1196] Started watching for new ooms in manager Apr 21 00:03:28.057403 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.057390 2576 manager.go:319] Starting recovery of all containers Apr 21 00:03:28.058023 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:28.057994 2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-1.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Apr 21 00:03:28.059330 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:28.059302 2576 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Apr 21 00:03:28.067919 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.067231 2576 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Apr 21 00:03:28.069005 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.068985 2576 manager.go:324] Recovery completed Apr 21 00:03:28.073562 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.073547 2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Apr 21 00:03:28.076233 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.076211 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-1.ec2.internal" event="NodeHasSufficientMemory" Apr 21 00:03:28.076340 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.076245 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-1.ec2.internal" event="NodeHasNoDiskPressure" Apr 21 00:03:28.076340 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.076258 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-1.ec2.internal" event="NodeHasSufficientPID" Apr 21 00:03:28.076831 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.076813 2576 cpu_manager.go:222] "Starting CPU manager" policy="none" Apr 21 00:03:28.076831 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.076830 2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Apr 21 00:03:28.076928 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.076851 2576 state_mem.go:36] "Initialized new in-memory state store" Apr 21 00:03:28.080324 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.080308 2576 policy_none.go:49] "None policy: Start" Apr 21 00:03:28.080395 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.080328 2576 memory_manager.go:186] "Starting memorymanager" policy="None" Apr 21 00:03:28.080395 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.080338 2576 state_mem.go:35] "Initializing new in-memory state store" Apr 21 00:03:28.121411 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.120008 2576 manager.go:341] "Starting Device Plugin manager" Apr 21 00:03:28.121411 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:28.120043 2576 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Apr 21 00:03:28.121411 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.120057 2576 server.go:85] "Starting device plugin registration server" Apr 21 00:03:28.121411 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.120320 2576 eviction_manager.go:189] "Eviction manager: starting control loop" Apr 21 00:03:28.121411 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.120330 2576 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Apr 21 00:03:28.121411 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.120567 2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Apr 21 00:03:28.121411 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.120650 2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Apr 21 00:03:28.121411 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.120662 2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Apr 21 00:03:28.121411 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:28.121182 2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Apr 21 00:03:28.121411 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:28.121223 2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-1.ec2.internal\" not found" Apr 21 00:03:28.204758 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.204676 2576 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Apr 21 00:03:28.204758 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.204713 2576 status_manager.go:230] "Starting to sync pod status with apiserver" Apr 21 00:03:28.204758 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.204732 2576 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Apr 21 00:03:28.204758 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.204739 2576 kubelet.go:2451] "Starting kubelet main sync loop" Apr 21 00:03:28.206266 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:28.204774 2576 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Apr 21 00:03:28.209004 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.208979 2576 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Apr 21 00:03:28.221040 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.221016 2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Apr 21 00:03:28.223162 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.223145 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-1.ec2.internal" event="NodeHasSufficientMemory" Apr 21 00:03:28.223244 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.223176 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-1.ec2.internal" event="NodeHasNoDiskPressure" Apr 21 00:03:28.223244 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.223191 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-1.ec2.internal" event="NodeHasSufficientPID" Apr 21 00:03:28.223244 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.223242 2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-1.ec2.internal" Apr 21 00:03:28.235045 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.235019 2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-1.ec2.internal" Apr 21 00:03:28.235108 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:28.235049 2576 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-1.ec2.internal\": node \"ip-10-0-136-1.ec2.internal\" not found" Apr 21 00:03:28.252604 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:28.252574 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-1.ec2.internal\" not found" Apr 21 00:03:28.305911 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.305861 2576 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-1.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-1.ec2.internal"] Apr 21 00:03:28.306002 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.305993 2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Apr 21 00:03:28.308057 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.308041 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-1.ec2.internal" event="NodeHasSufficientMemory" Apr 21 00:03:28.308152 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.308070 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-1.ec2.internal" event="NodeHasNoDiskPressure" Apr 21 00:03:28.308152 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.308079 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-1.ec2.internal" event="NodeHasSufficientPID" Apr 21 00:03:28.309579 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.309566 2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Apr 21 00:03:28.309790 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.309777 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-1.ec2.internal" Apr 21 00:03:28.309823 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.309805 2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Apr 21 00:03:28.310743 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.310727 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-1.ec2.internal" event="NodeHasSufficientMemory" Apr 21 00:03:28.310826 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.310754 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-1.ec2.internal" event="NodeHasNoDiskPressure" Apr 21 00:03:28.310826 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.310770 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-1.ec2.internal" event="NodeHasSufficientPID" Apr 21 00:03:28.310929 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.310867 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-1.ec2.internal" event="NodeHasSufficientMemory" Apr 21 00:03:28.310929 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.310894 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-1.ec2.internal" event="NodeHasNoDiskPressure" Apr 21 00:03:28.310929 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.310911 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-1.ec2.internal" event="NodeHasSufficientPID" Apr 21 00:03:28.312474 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.312456 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-1.ec2.internal" Apr 21 00:03:28.312566 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.312487 2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Apr 21 00:03:28.313284 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.313268 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-1.ec2.internal" event="NodeHasSufficientMemory" Apr 21 00:03:28.313347 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.313304 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-1.ec2.internal" event="NodeHasNoDiskPressure" Apr 21 00:03:28.313347 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.313314 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-1.ec2.internal" event="NodeHasSufficientPID" Apr 21 00:03:28.340234 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:28.340206 2576 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-1.ec2.internal\" not found" node="ip-10-0-136-1.ec2.internal" Apr 21 00:03:28.344983 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:28.344966 2576 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-1.ec2.internal\" not found" node="ip-10-0-136-1.ec2.internal" Apr 21 00:03:28.353027 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:28.353006 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-1.ec2.internal\" not found" Apr 21 00:03:28.358493 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.358473 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7803e06bf1575842c2662501b98b3432-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-1.ec2.internal\" (UID: \"7803e06bf1575842c2662501b98b3432\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-1.ec2.internal" Apr 21 00:03:28.358556 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.358503 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7803e06bf1575842c2662501b98b3432-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-1.ec2.internal\" (UID: \"7803e06bf1575842c2662501b98b3432\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-1.ec2.internal" Apr 21 00:03:28.358556 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.358520 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/893ed304dbbaa7472e9062bd86be8331-config\") pod \"kube-apiserver-proxy-ip-10-0-136-1.ec2.internal\" (UID: \"893ed304dbbaa7472e9062bd86be8331\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-1.ec2.internal" Apr 21 00:03:28.454056 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:28.454020 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-1.ec2.internal\" not found" Apr 21 00:03:28.459663 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.459605 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7803e06bf1575842c2662501b98b3432-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-1.ec2.internal\" (UID: \"7803e06bf1575842c2662501b98b3432\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-1.ec2.internal" Apr 21 00:03:28.459663 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.459636 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7803e06bf1575842c2662501b98b3432-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-1.ec2.internal\" (UID: \"7803e06bf1575842c2662501b98b3432\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-1.ec2.internal" Apr 21 00:03:28.459794 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.459661 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/893ed304dbbaa7472e9062bd86be8331-config\") pod \"kube-apiserver-proxy-ip-10-0-136-1.ec2.internal\" (UID: \"893ed304dbbaa7472e9062bd86be8331\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-1.ec2.internal" Apr 21 00:03:28.459794 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.459694 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/893ed304dbbaa7472e9062bd86be8331-config\") pod \"kube-apiserver-proxy-ip-10-0-136-1.ec2.internal\" (UID: \"893ed304dbbaa7472e9062bd86be8331\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-1.ec2.internal" Apr 21 00:03:28.459794 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.459696 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7803e06bf1575842c2662501b98b3432-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-1.ec2.internal\" (UID: \"7803e06bf1575842c2662501b98b3432\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-1.ec2.internal" Apr 21 00:03:28.459794 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.459720 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7803e06bf1575842c2662501b98b3432-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-1.ec2.internal\" (UID: \"7803e06bf1575842c2662501b98b3432\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-1.ec2.internal" Apr 21 00:03:28.554991 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:28.554945 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-1.ec2.internal\" not found" Apr 21 00:03:28.642470 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.642443 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-1.ec2.internal" Apr 21 00:03:28.649123 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.649097 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-1.ec2.internal" Apr 21 00:03:28.655695 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:28.655674 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-1.ec2.internal\" not found" Apr 21 00:03:28.756208 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:28.756117 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-1.ec2.internal\" not found" Apr 21 00:03:28.856612 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:28.856574 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-1.ec2.internal\" not found" Apr 21 00:03:28.879527 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.879498 2576 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Apr 21 00:03:28.954709 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.954680 2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Apr 21 00:03:28.955250 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.954834 2576 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Apr 21 00:03:28.955250 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.954870 2576 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Apr 21 00:03:28.955805 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.955791 2576 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-1.ec2.internal" Apr 21 00:03:28.977503 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.977475 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Apr 21 00:03:28.978899 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.978884 2576 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-1.ec2.internal" Apr 21 00:03:28.986985 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:28.986962 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Apr 21 00:03:29.033194 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.033102 2576 apiserver.go:52] "Watching apiserver" Apr 21 00:03:29.047548 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.047510 2576 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Apr 21 00:03:29.048459 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.048430 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-mw27t","kube-system/kube-apiserver-proxy-ip-10-0-136-1.ec2.internal","openshift-cluster-node-tuning-operator/tuned-fnp85","openshift-dns/node-resolver-twj7c","openshift-image-registry/node-ca-84h5p","openshift-multus/multus-additional-cni-plugins-k959w","openshift-multus/network-metrics-daemon-lr9hq","openshift-network-diagnostics/network-check-target-d5vdn","openshift-ovn-kubernetes/ovnkube-node-wmfb9","kube-system/konnectivity-agent-fbsp9","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wn8j","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-1.ec2.internal","openshift-multus/multus-lfxrt"] Apr 21 00:03:29.051259 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.051233 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mw27t" Apr 21 00:03:29.052927 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.052900 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fnp85" Apr 21 00:03:29.053688 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.053671 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Apr 21 00:03:29.053771 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.053692 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-p6d6z\"" Apr 21 00:03:29.053771 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.053692 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Apr 21 00:03:29.053771 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.053718 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Apr 21 00:03:29.054477 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.054460 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Apr 21 00:03:29.055241 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.055221 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-c7dbj\"" Apr 21 00:03:29.055318 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.055265 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Apr 21 00:03:29.055318 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.055299 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Apr 21 00:03:29.056154 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.056137 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-twj7c" Apr 21 00:03:29.056255 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.056168 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-84h5p" Apr 21 00:03:29.056549 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.056516 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-04-19 23:58:28 +0000 UTC" deadline="2028-01-04 21:16:08.054189046 +0000 UTC" Apr 21 00:03:29.056549 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.056539 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14973h12m38.997652282s" Apr 21 00:03:29.057663 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.057646 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-k959w" Apr 21 00:03:29.059211 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.059191 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Apr 21 00:03:29.059346 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.059244 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Apr 21 00:03:29.059346 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.059321 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qfhfx\"" Apr 21 00:03:29.059346 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.059341 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Apr 21 00:03:29.059508 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.059395 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Apr 21 00:03:29.059508 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.059412 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Apr 21 00:03:29.059777 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.059761 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lr9hq" Apr 21 00:03:29.059849 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:29.059830 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lr9hq" podUID="65f5aca2-9fa7-4b19-b02f-0dd809899f41" Apr 21 00:03:29.059967 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.059953 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Apr 21 00:03:29.060092 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.060077 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jsxbx\"" Apr 21 00:03:29.060413 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.060396 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Apr 21 00:03:29.060469 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.060418 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Apr 21 00:03:29.060469 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.060451 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-dhzhp\"" Apr 21 00:03:29.060534 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.060526 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Apr 21 00:03:29.060936 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.060918 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Apr 21 00:03:29.060936 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.060927 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d5vdn" Apr 21 00:03:29.061075 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:29.060991 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d5vdn" podUID="526918a6-6456-4ee9-b13d-ca26cfea5695" Apr 21 00:03:29.062326 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.062309 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/705da41f-2875-4893-9f4e-f88eb450d247-etc-modprobe-d\") pod \"tuned-fnp85\" (UID: \"705da41f-2875-4893-9f4e-f88eb450d247\") " pod="openshift-cluster-node-tuning-operator/tuned-fnp85" Apr 21 00:03:29.062434 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.062338 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/705da41f-2875-4893-9f4e-f88eb450d247-etc-kubernetes\") pod \"tuned-fnp85\" (UID: \"705da41f-2875-4893-9f4e-f88eb450d247\") " pod="openshift-cluster-node-tuning-operator/tuned-fnp85" Apr 21 00:03:29.062434 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.062381 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/705da41f-2875-4893-9f4e-f88eb450d247-etc-sysctl-conf\") pod \"tuned-fnp85\" (UID: \"705da41f-2875-4893-9f4e-f88eb450d247\") " pod="openshift-cluster-node-tuning-operator/tuned-fnp85" Apr 21 00:03:29.062434 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.062403 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/705da41f-2875-4893-9f4e-f88eb450d247-sys\") pod \"tuned-fnp85\" (UID: \"705da41f-2875-4893-9f4e-f88eb450d247\") " pod="openshift-cluster-node-tuning-operator/tuned-fnp85" Apr 21 00:03:29.062591 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.062433 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/705da41f-2875-4893-9f4e-f88eb450d247-etc-tuned\") pod \"tuned-fnp85\" (UID: \"705da41f-2875-4893-9f4e-f88eb450d247\") " pod="openshift-cluster-node-tuning-operator/tuned-fnp85" Apr 21 00:03:29.062591 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.062455 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xt2h6\" (UniqueName: \"kubernetes.io/projected/705da41f-2875-4893-9f4e-f88eb450d247-kube-api-access-xt2h6\") pod \"tuned-fnp85\" (UID: \"705da41f-2875-4893-9f4e-f88eb450d247\") " pod="openshift-cluster-node-tuning-operator/tuned-fnp85" Apr 21 00:03:29.062591 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.062491 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/705da41f-2875-4893-9f4e-f88eb450d247-etc-sysconfig\") pod \"tuned-fnp85\" (UID: \"705da41f-2875-4893-9f4e-f88eb450d247\") " pod="openshift-cluster-node-tuning-operator/tuned-fnp85" Apr 21 00:03:29.062591 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.062524 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/705da41f-2875-4893-9f4e-f88eb450d247-run\") pod \"tuned-fnp85\" (UID: \"705da41f-2875-4893-9f4e-f88eb450d247\") " pod="openshift-cluster-node-tuning-operator/tuned-fnp85" Apr 21 00:03:29.062591 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.062548 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/705da41f-2875-4893-9f4e-f88eb450d247-lib-modules\") pod \"tuned-fnp85\" (UID: \"705da41f-2875-4893-9f4e-f88eb450d247\") " pod="openshift-cluster-node-tuning-operator/tuned-fnp85" Apr 21 00:03:29.062591 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.062582 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/705da41f-2875-4893-9f4e-f88eb450d247-host\") pod \"tuned-fnp85\" (UID: \"705da41f-2875-4893-9f4e-f88eb450d247\") " pod="openshift-cluster-node-tuning-operator/tuned-fnp85" Apr 21 00:03:29.062866 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.062604 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/705da41f-2875-4893-9f4e-f88eb450d247-tmp\") pod \"tuned-fnp85\" (UID: \"705da41f-2875-4893-9f4e-f88eb450d247\") " pod="openshift-cluster-node-tuning-operator/tuned-fnp85" Apr 21 00:03:29.062866 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.062631 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/30356905-73c1-4fa1-a700-5d499f482647-hosts-file\") pod \"node-resolver-twj7c\" (UID: \"30356905-73c1-4fa1-a700-5d499f482647\") " pod="openshift-dns/node-resolver-twj7c" Apr 21 00:03:29.062866 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.062647 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" Apr 21 00:03:29.062866 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.062657 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30356905-73c1-4fa1-a700-5d499f482647-tmp-dir\") pod \"node-resolver-twj7c\" (UID: \"30356905-73c1-4fa1-a700-5d499f482647\") " pod="openshift-dns/node-resolver-twj7c" Apr 21 00:03:29.062866 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.062684 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/705da41f-2875-4893-9f4e-f88eb450d247-etc-sysctl-d\") pod \"tuned-fnp85\" (UID: \"705da41f-2875-4893-9f4e-f88eb450d247\") " pod="openshift-cluster-node-tuning-operator/tuned-fnp85" Apr 21 00:03:29.062866 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.062710 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/945c8a71-f620-4cdb-89b7-0f17fbd8ab5b-serviceca\") pod \"node-ca-84h5p\" (UID: \"945c8a71-f620-4cdb-89b7-0f17fbd8ab5b\") " pod="openshift-image-registry/node-ca-84h5p" Apr 21 00:03:29.062866 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.062736 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9k6xp\" (UniqueName: \"kubernetes.io/projected/945c8a71-f620-4cdb-89b7-0f17fbd8ab5b-kube-api-access-9k6xp\") pod \"node-ca-84h5p\" (UID: \"945c8a71-f620-4cdb-89b7-0f17fbd8ab5b\") " pod="openshift-image-registry/node-ca-84h5p" Apr 21 00:03:29.062866 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.062768 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/44cc2f5b-b5d5-4fc4-a690-b4ad1f8bf4c7-host-slash\") pod \"iptables-alerter-mw27t\" (UID: \"44cc2f5b-b5d5-4fc4-a690-b4ad1f8bf4c7\") " pod="openshift-network-operator/iptables-alerter-mw27t" Apr 21 00:03:29.062866 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.062796 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/705da41f-2875-4893-9f4e-f88eb450d247-etc-systemd\") pod \"tuned-fnp85\" (UID: \"705da41f-2875-4893-9f4e-f88eb450d247\") " pod="openshift-cluster-node-tuning-operator/tuned-fnp85" Apr 21 00:03:29.062866 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.062823 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/705da41f-2875-4893-9f4e-f88eb450d247-var-lib-kubelet\") pod \"tuned-fnp85\" (UID: \"705da41f-2875-4893-9f4e-f88eb450d247\") " pod="openshift-cluster-node-tuning-operator/tuned-fnp85" Apr 21 00:03:29.062866 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.062852 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkwps\" (UniqueName: \"kubernetes.io/projected/30356905-73c1-4fa1-a700-5d499f482647-kube-api-access-kkwps\") pod \"node-resolver-twj7c\" (UID: \"30356905-73c1-4fa1-a700-5d499f482647\") " pod="openshift-dns/node-resolver-twj7c" Apr 21 00:03:29.063250 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.062873 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/945c8a71-f620-4cdb-89b7-0f17fbd8ab5b-host\") pod \"node-ca-84h5p\" (UID: \"945c8a71-f620-4cdb-89b7-0f17fbd8ab5b\") " pod="openshift-image-registry/node-ca-84h5p" Apr 21 00:03:29.063250 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.062906 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/44cc2f5b-b5d5-4fc4-a690-b4ad1f8bf4c7-iptables-alerter-script\") pod \"iptables-alerter-mw27t\" (UID: \"44cc2f5b-b5d5-4fc4-a690-b4ad1f8bf4c7\") " pod="openshift-network-operator/iptables-alerter-mw27t" Apr 21 00:03:29.063250 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.062935 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rtfj\" (UniqueName: \"kubernetes.io/projected/44cc2f5b-b5d5-4fc4-a690-b4ad1f8bf4c7-kube-api-access-7rtfj\") pod \"iptables-alerter-mw27t\" (UID: \"44cc2f5b-b5d5-4fc4-a690-b4ad1f8bf4c7\") " pod="openshift-network-operator/iptables-alerter-mw27t" Apr 21 00:03:29.064591 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.064575 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fbsp9" Apr 21 00:03:29.064671 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.064648 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Apr 21 00:03:29.064671 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.064664 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Apr 21 00:03:29.064793 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.064699 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Apr 21 00:03:29.065065 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.065047 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Apr 21 00:03:29.065065 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.065052 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Apr 21 00:03:29.065184 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.065168 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Apr 21 00:03:29.065250 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.065208 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-tljr2\"" Apr 21 00:03:29.066309 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.066289 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wn8j" Apr 21 00:03:29.066916 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.066900 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Apr 21 00:03:29.067008 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.066989 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Apr 21 00:03:29.067076 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.067008 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-sprp8\"" Apr 21 00:03:29.068159 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.068143 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lfxrt" Apr 21 00:03:29.069719 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.068724 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Apr 21 00:03:29.069719 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.069186 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zt6jn\"" Apr 21 00:03:29.069719 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.069526 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Apr 21 00:03:29.069719 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.069568 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Apr 21 00:03:29.072437 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.072290 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Apr 21 00:03:29.072437 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.072335 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-sgq7g\"" Apr 21 00:03:29.074437 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.074418 2576 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Apr 21 00:03:29.092970 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.092941 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-827vm" Apr 21 00:03:29.100522 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.100490 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-827vm" Apr 21 00:03:29.157213 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.157184 2576 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Apr 21 00:03:29.163113 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.163085 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1479bc73-6541-435b-a311-d48731be8d51-var-lib-openvswitch\") pod \"ovnkube-node-wmfb9\" (UID: \"1479bc73-6541-435b-a311-d48731be8d51\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" Apr 21 00:03:29.163252 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.163116 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3f41362d-51f9-4dde-9796-2752b85d50ee-multus-daemon-config\") pod \"multus-lfxrt\" (UID: \"3f41362d-51f9-4dde-9796-2752b85d50ee\") " pod="openshift-multus/multus-lfxrt" Apr 21 00:03:29.163252 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.163140 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/705da41f-2875-4893-9f4e-f88eb450d247-etc-sysctl-d\") pod \"tuned-fnp85\" (UID: \"705da41f-2875-4893-9f4e-f88eb450d247\") " pod="openshift-cluster-node-tuning-operator/tuned-fnp85" Apr 21 00:03:29.163252 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.163161 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9k6xp\" (UniqueName: \"kubernetes.io/projected/945c8a71-f620-4cdb-89b7-0f17fbd8ab5b-kube-api-access-9k6xp\") pod \"node-ca-84h5p\" (UID: \"945c8a71-f620-4cdb-89b7-0f17fbd8ab5b\") " pod="openshift-image-registry/node-ca-84h5p" Apr 21 00:03:29.163252 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.163185 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1479bc73-6541-435b-a311-d48731be8d51-ovnkube-script-lib\") pod \"ovnkube-node-wmfb9\" (UID: \"1479bc73-6541-435b-a311-d48731be8d51\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" Apr 21 00:03:29.163252 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.163208 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3f41362d-51f9-4dde-9796-2752b85d50ee-cnibin\") pod \"multus-lfxrt\" (UID: \"3f41362d-51f9-4dde-9796-2752b85d50ee\") " pod="openshift-multus/multus-lfxrt" Apr 21 00:03:29.163500 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.163246 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/705da41f-2875-4893-9f4e-f88eb450d247-etc-systemd\") pod \"tuned-fnp85\" (UID: \"705da41f-2875-4893-9f4e-f88eb450d247\") " pod="openshift-cluster-node-tuning-operator/tuned-fnp85" Apr 21 00:03:29.163500 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.163282 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/705da41f-2875-4893-9f4e-f88eb450d247-etc-sysctl-d\") pod \"tuned-fnp85\" (UID: \"705da41f-2875-4893-9f4e-f88eb450d247\") " pod="openshift-cluster-node-tuning-operator/tuned-fnp85" Apr 21 00:03:29.163500 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.163315 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kkwps\" (UniqueName: \"kubernetes.io/projected/30356905-73c1-4fa1-a700-5d499f482647-kube-api-access-kkwps\") pod \"node-resolver-twj7c\" (UID: \"30356905-73c1-4fa1-a700-5d499f482647\") " pod="openshift-dns/node-resolver-twj7c" Apr 21 00:03:29.163500 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.163344 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/705da41f-2875-4893-9f4e-f88eb450d247-etc-systemd\") pod \"tuned-fnp85\" (UID: \"705da41f-2875-4893-9f4e-f88eb450d247\") " pod="openshift-cluster-node-tuning-operator/tuned-fnp85" Apr 21 00:03:29.163500 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.163438 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7rtfj\" (UniqueName: \"kubernetes.io/projected/44cc2f5b-b5d5-4fc4-a690-b4ad1f8bf4c7-kube-api-access-7rtfj\") pod \"iptables-alerter-mw27t\" (UID: \"44cc2f5b-b5d5-4fc4-a690-b4ad1f8bf4c7\") " pod="openshift-network-operator/iptables-alerter-mw27t" Apr 21 00:03:29.163717 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.163497 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3abd03e7-2e8f-48a2-b63d-5eddab0cb80a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k959w\" (UID: \"3abd03e7-2e8f-48a2-b63d-5eddab0cb80a\") " pod="openshift-multus/multus-additional-cni-plugins-k959w" Apr 21 00:03:29.163717 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.163612 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9bb1c9b4-978f-43ae-ba01-558601306bb0-registration-dir\") pod \"aws-ebs-csi-driver-node-9wn8j\" (UID: \"9bb1c9b4-978f-43ae-ba01-558601306bb0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wn8j" Apr 21 00:03:29.163717 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.163643 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3f41362d-51f9-4dde-9796-2752b85d50ee-cni-binary-copy\") pod \"multus-lfxrt\" (UID: \"3f41362d-51f9-4dde-9796-2752b85d50ee\") " pod="openshift-multus/multus-lfxrt" Apr 21 00:03:29.163717 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.163670 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3f41362d-51f9-4dde-9796-2752b85d50ee-host-var-lib-cni-multus\") pod \"multus-lfxrt\" (UID: \"3f41362d-51f9-4dde-9796-2752b85d50ee\") " pod="openshift-multus/multus-lfxrt" Apr 21 00:03:29.163717 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.163707 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3f41362d-51f9-4dde-9796-2752b85d50ee-host-run-multus-certs\") pod \"multus-lfxrt\" (UID: \"3f41362d-51f9-4dde-9796-2752b85d50ee\") " pod="openshift-multus/multus-lfxrt" Apr 21 00:03:29.163903 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.163734 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9bb1c9b4-978f-43ae-ba01-558601306bb0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9wn8j\" (UID: \"9bb1c9b4-978f-43ae-ba01-558601306bb0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wn8j" Apr 21 00:03:29.163903 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.163771 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1479bc73-6541-435b-a311-d48731be8d51-ovn-node-metrics-cert\") pod \"ovnkube-node-wmfb9\" (UID: \"1479bc73-6541-435b-a311-d48731be8d51\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" Apr 21 00:03:29.163903 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.163795 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3f41362d-51f9-4dde-9796-2752b85d50ee-host-run-netns\") pod \"multus-lfxrt\" (UID: \"3f41362d-51f9-4dde-9796-2752b85d50ee\") " pod="openshift-multus/multus-lfxrt" Apr 21 00:03:29.163903 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.163819 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/705da41f-2875-4893-9f4e-f88eb450d247-etc-sysconfig\") pod \"tuned-fnp85\" (UID: \"705da41f-2875-4893-9f4e-f88eb450d247\") " pod="openshift-cluster-node-tuning-operator/tuned-fnp85" Apr 21 00:03:29.163903 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.163843 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/705da41f-2875-4893-9f4e-f88eb450d247-lib-modules\") pod \"tuned-fnp85\" (UID: \"705da41f-2875-4893-9f4e-f88eb450d247\") " pod="openshift-cluster-node-tuning-operator/tuned-fnp85" Apr 21 00:03:29.163903 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.163869 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkd94\" (UniqueName: \"kubernetes.io/projected/9bb1c9b4-978f-43ae-ba01-558601306bb0-kube-api-access-lkd94\") pod \"aws-ebs-csi-driver-node-9wn8j\" (UID: \"9bb1c9b4-978f-43ae-ba01-558601306bb0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wn8j" Apr 21 00:03:29.163903 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.163891 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1479bc73-6541-435b-a311-d48731be8d51-run-systemd\") pod \"ovnkube-node-wmfb9\" (UID: \"1479bc73-6541-435b-a311-d48731be8d51\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" Apr 21 00:03:29.163903 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.163893 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/705da41f-2875-4893-9f4e-f88eb450d247-etc-sysconfig\") pod \"tuned-fnp85\" (UID: \"705da41f-2875-4893-9f4e-f88eb450d247\") " pod="openshift-cluster-node-tuning-operator/tuned-fnp85" Apr 21 00:03:29.164238 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.163915 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1479bc73-6541-435b-a311-d48731be8d51-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wmfb9\" (UID: \"1479bc73-6541-435b-a311-d48731be8d51\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" Apr 21 00:03:29.164238 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.163939 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1479bc73-6541-435b-a311-d48731be8d51-env-overrides\") pod \"ovnkube-node-wmfb9\" (UID: \"1479bc73-6541-435b-a311-d48731be8d51\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" Apr 21 00:03:29.164238 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.163963 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3f41362d-51f9-4dde-9796-2752b85d50ee-host-var-lib-cni-bin\") pod \"multus-lfxrt\" (UID: \"3f41362d-51f9-4dde-9796-2752b85d50ee\") " pod="openshift-multus/multus-lfxrt" Apr 21 00:03:29.164238 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.163987 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/945c8a71-f620-4cdb-89b7-0f17fbd8ab5b-serviceca\") pod \"node-ca-84h5p\" (UID: \"945c8a71-f620-4cdb-89b7-0f17fbd8ab5b\") " pod="openshift-image-registry/node-ca-84h5p" Apr 21 00:03:29.164238 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.164024 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/705da41f-2875-4893-9f4e-f88eb450d247-lib-modules\") pod \"tuned-fnp85\" (UID: \"705da41f-2875-4893-9f4e-f88eb450d247\") " pod="openshift-cluster-node-tuning-operator/tuned-fnp85" Apr 21 00:03:29.164238 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.164028 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3abd03e7-2e8f-48a2-b63d-5eddab0cb80a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k959w\" (UID: \"3abd03e7-2e8f-48a2-b63d-5eddab0cb80a\") " pod="openshift-multus/multus-additional-cni-plugins-k959w" Apr 21 00:03:29.164238 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.164073 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfqsx\" (UniqueName: \"kubernetes.io/projected/3abd03e7-2e8f-48a2-b63d-5eddab0cb80a-kube-api-access-sfqsx\") pod \"multus-additional-cni-plugins-k959w\" (UID: \"3abd03e7-2e8f-48a2-b63d-5eddab0cb80a\") " pod="openshift-multus/multus-additional-cni-plugins-k959w" Apr 21 00:03:29.164238 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.164099 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9bb1c9b4-978f-43ae-ba01-558601306bb0-device-dir\") pod \"aws-ebs-csi-driver-node-9wn8j\" (UID: \"9bb1c9b4-978f-43ae-ba01-558601306bb0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wn8j" Apr 21 00:03:29.164238 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.164123 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9bb1c9b4-978f-43ae-ba01-558601306bb0-sys-fs\") pod \"aws-ebs-csi-driver-node-9wn8j\" (UID: \"9bb1c9b4-978f-43ae-ba01-558601306bb0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wn8j" Apr 21 00:03:29.164238 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.164147 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1479bc73-6541-435b-a311-d48731be8d51-etc-openvswitch\") pod \"ovnkube-node-wmfb9\" (UID: \"1479bc73-6541-435b-a311-d48731be8d51\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" Apr 21 00:03:29.164238 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.164188 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3f41362d-51f9-4dde-9796-2752b85d50ee-multus-conf-dir\") pod \"multus-lfxrt\" (UID: \"3f41362d-51f9-4dde-9796-2752b85d50ee\") " pod="openshift-multus/multus-lfxrt" Apr 21 00:03:29.164798 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.164238 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/44cc2f5b-b5d5-4fc4-a690-b4ad1f8bf4c7-iptables-alerter-script\") pod \"iptables-alerter-mw27t\" (UID: \"44cc2f5b-b5d5-4fc4-a690-b4ad1f8bf4c7\") " pod="openshift-network-operator/iptables-alerter-mw27t" Apr 21 00:03:29.164798 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.164263 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3abd03e7-2e8f-48a2-b63d-5eddab0cb80a-cni-binary-copy\") pod \"multus-additional-cni-plugins-k959w\" (UID: \"3abd03e7-2e8f-48a2-b63d-5eddab0cb80a\") " pod="openshift-multus/multus-additional-cni-plugins-k959w" Apr 21 00:03:29.164798 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.164280 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/39e13056-9209-4845-838d-9d46aa0dae95-agent-certs\") pod \"konnectivity-agent-fbsp9\" (UID: \"39e13056-9209-4845-838d-9d46aa0dae95\") " pod="kube-system/konnectivity-agent-fbsp9" Apr 21 00:03:29.164798 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.164300 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f41362d-51f9-4dde-9796-2752b85d50ee-multus-cni-dir\") pod \"multus-lfxrt\" (UID: \"3f41362d-51f9-4dde-9796-2752b85d50ee\") " pod="openshift-multus/multus-lfxrt" Apr 21 00:03:29.164798 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.164349 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3f41362d-51f9-4dde-9796-2752b85d50ee-hostroot\") pod \"multus-lfxrt\" (UID: \"3f41362d-51f9-4dde-9796-2752b85d50ee\") " pod="openshift-multus/multus-lfxrt" Apr 21 00:03:29.164798 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.164403 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f41362d-51f9-4dde-9796-2752b85d50ee-etc-kubernetes\") pod \"multus-lfxrt\" (UID: \"3f41362d-51f9-4dde-9796-2752b85d50ee\") " pod="openshift-multus/multus-lfxrt" Apr 21 00:03:29.164798 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.164437 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1479bc73-6541-435b-a311-d48731be8d51-node-log\") pod \"ovnkube-node-wmfb9\" (UID: \"1479bc73-6541-435b-a311-d48731be8d51\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" Apr 21 00:03:29.164798 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.164474 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/705da41f-2875-4893-9f4e-f88eb450d247-etc-modprobe-d\") pod \"tuned-fnp85\" (UID: \"705da41f-2875-4893-9f4e-f88eb450d247\") " pod="openshift-cluster-node-tuning-operator/tuned-fnp85" Apr 21 00:03:29.164798 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.164483 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/945c8a71-f620-4cdb-89b7-0f17fbd8ab5b-serviceca\") pod \"node-ca-84h5p\" (UID: \"945c8a71-f620-4cdb-89b7-0f17fbd8ab5b\") " pod="openshift-image-registry/node-ca-84h5p" Apr 21 00:03:29.164798 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.164504 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/705da41f-2875-4893-9f4e-f88eb450d247-etc-sysctl-conf\") pod \"tuned-fnp85\" (UID: \"705da41f-2875-4893-9f4e-f88eb450d247\") " pod="openshift-cluster-node-tuning-operator/tuned-fnp85" Apr 21 00:03:29.164798 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.164560 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/705da41f-2875-4893-9f4e-f88eb450d247-etc-tuned\") pod \"tuned-fnp85\" (UID: \"705da41f-2875-4893-9f4e-f88eb450d247\") " pod="openshift-cluster-node-tuning-operator/tuned-fnp85" Apr 21 00:03:29.164798 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.164622 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/705da41f-2875-4893-9f4e-f88eb450d247-etc-modprobe-d\") pod \"tuned-fnp85\" (UID: \"705da41f-2875-4893-9f4e-f88eb450d247\") " pod="openshift-cluster-node-tuning-operator/tuned-fnp85" Apr 21 00:03:29.164798 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.164660 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f41362d-51f9-4dde-9796-2752b85d50ee-system-cni-dir\") pod \"multus-lfxrt\" (UID: \"3f41362d-51f9-4dde-9796-2752b85d50ee\") " pod="openshift-multus/multus-lfxrt" Apr 21 00:03:29.164798 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.164700 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/705da41f-2875-4893-9f4e-f88eb450d247-run\") pod \"tuned-fnp85\" (UID: \"705da41f-2875-4893-9f4e-f88eb450d247\") " pod="openshift-cluster-node-tuning-operator/tuned-fnp85" Apr 21 00:03:29.164798 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.164725 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/705da41f-2875-4893-9f4e-f88eb450d247-tmp\") pod \"tuned-fnp85\" (UID: \"705da41f-2875-4893-9f4e-f88eb450d247\") " pod="openshift-cluster-node-tuning-operator/tuned-fnp85" Apr 21 00:03:29.164798 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.164734 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/705da41f-2875-4893-9f4e-f88eb450d247-etc-sysctl-conf\") pod \"tuned-fnp85\" (UID: \"705da41f-2875-4893-9f4e-f88eb450d247\") " pod="openshift-cluster-node-tuning-operator/tuned-fnp85" Apr 21 00:03:29.164798 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.164751 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30356905-73c1-4fa1-a700-5d499f482647-tmp-dir\") pod \"node-resolver-twj7c\" (UID: \"30356905-73c1-4fa1-a700-5d499f482647\") " pod="openshift-dns/node-resolver-twj7c" Apr 21 00:03:29.165589 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.164794 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3abd03e7-2e8f-48a2-b63d-5eddab0cb80a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k959w\" (UID: \"3abd03e7-2e8f-48a2-b63d-5eddab0cb80a\") " pod="openshift-multus/multus-additional-cni-plugins-k959w" Apr 21 00:03:29.165589 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.164823 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1479bc73-6541-435b-a311-d48731be8d51-host-run-ovn-kubernetes\") pod \"ovnkube-node-wmfb9\" (UID: \"1479bc73-6541-435b-a311-d48731be8d51\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" Apr 21 00:03:29.165589 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.164827 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/44cc2f5b-b5d5-4fc4-a690-b4ad1f8bf4c7-iptables-alerter-script\") pod \"iptables-alerter-mw27t\" (UID: \"44cc2f5b-b5d5-4fc4-a690-b4ad1f8bf4c7\") " pod="openshift-network-operator/iptables-alerter-mw27t" Apr 21 00:03:29.165589 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.164867 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3abd03e7-2e8f-48a2-b63d-5eddab0cb80a-system-cni-dir\") pod \"multus-additional-cni-plugins-k959w\" (UID: \"3abd03e7-2e8f-48a2-b63d-5eddab0cb80a\") " pod="openshift-multus/multus-additional-cni-plugins-k959w" Apr 21 00:03:29.165589 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.164858 2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Apr 21 00:03:29.165589 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.164920 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/705da41f-2875-4893-9f4e-f88eb450d247-run\") pod \"tuned-fnp85\" (UID: \"705da41f-2875-4893-9f4e-f88eb450d247\") " pod="openshift-cluster-node-tuning-operator/tuned-fnp85" Apr 21 00:03:29.165589 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.164952 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99mvh\" (UniqueName: \"kubernetes.io/projected/65f5aca2-9fa7-4b19-b02f-0dd809899f41-kube-api-access-99mvh\") pod \"network-metrics-daemon-lr9hq\" (UID: \"65f5aca2-9fa7-4b19-b02f-0dd809899f41\") " pod="openshift-multus/network-metrics-daemon-lr9hq" Apr 21 00:03:29.165589 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.165011 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1479bc73-6541-435b-a311-d48731be8d51-host-slash\") pod \"ovnkube-node-wmfb9\" (UID: \"1479bc73-6541-435b-a311-d48731be8d51\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" Apr 21 00:03:29.165589 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.165031 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30356905-73c1-4fa1-a700-5d499f482647-tmp-dir\") pod \"node-resolver-twj7c\" (UID: \"30356905-73c1-4fa1-a700-5d499f482647\") " pod="openshift-dns/node-resolver-twj7c" Apr 21 00:03:29.165589 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.165057 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1479bc73-6541-435b-a311-d48731be8d51-run-openvswitch\") pod \"ovnkube-node-wmfb9\" (UID: \"1479bc73-6541-435b-a311-d48731be8d51\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" Apr 21 00:03:29.165589 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.165097 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t99nb\" (UniqueName: \"kubernetes.io/projected/3f41362d-51f9-4dde-9796-2752b85d50ee-kube-api-access-t99nb\") pod \"multus-lfxrt\" (UID: \"3f41362d-51f9-4dde-9796-2752b85d50ee\") " pod="openshift-multus/multus-lfxrt" Apr 21 00:03:29.165589 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.165147 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65f5aca2-9fa7-4b19-b02f-0dd809899f41-metrics-certs\") pod \"network-metrics-daemon-lr9hq\" (UID: \"65f5aca2-9fa7-4b19-b02f-0dd809899f41\") " pod="openshift-multus/network-metrics-daemon-lr9hq" Apr 21 00:03:29.165589 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.165180 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1479bc73-6541-435b-a311-d48731be8d51-log-socket\") pod \"ovnkube-node-wmfb9\" (UID: \"1479bc73-6541-435b-a311-d48731be8d51\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" Apr 21 00:03:29.165589 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.165229 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/30356905-73c1-4fa1-a700-5d499f482647-hosts-file\") pod \"node-resolver-twj7c\" (UID: \"30356905-73c1-4fa1-a700-5d499f482647\") " pod="openshift-dns/node-resolver-twj7c" Apr 21 00:03:29.165589 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.165258 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xt2h6\" (UniqueName: \"kubernetes.io/projected/705da41f-2875-4893-9f4e-f88eb450d247-kube-api-access-xt2h6\") pod \"tuned-fnp85\" (UID: \"705da41f-2875-4893-9f4e-f88eb450d247\") " pod="openshift-cluster-node-tuning-operator/tuned-fnp85" Apr 21 00:03:29.165589 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.165294 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qbl8\" (UniqueName: \"kubernetes.io/projected/526918a6-6456-4ee9-b13d-ca26cfea5695-kube-api-access-4qbl8\") pod \"network-check-target-d5vdn\" (UID: \"526918a6-6456-4ee9-b13d-ca26cfea5695\") " pod="openshift-network-diagnostics/network-check-target-d5vdn" Apr 21 00:03:29.165589 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.165297 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/30356905-73c1-4fa1-a700-5d499f482647-hosts-file\") pod \"node-resolver-twj7c\" (UID: \"30356905-73c1-4fa1-a700-5d499f482647\") " pod="openshift-dns/node-resolver-twj7c" Apr 21 00:03:29.166385 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.165331 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1479bc73-6541-435b-a311-d48731be8d51-host-cni-netd\") pod \"ovnkube-node-wmfb9\" (UID: \"1479bc73-6541-435b-a311-d48731be8d51\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" Apr 21 00:03:29.166385 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.165479 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgqlw\" (UniqueName: \"kubernetes.io/projected/1479bc73-6541-435b-a311-d48731be8d51-kube-api-access-fgqlw\") pod \"ovnkube-node-wmfb9\" (UID: \"1479bc73-6541-435b-a311-d48731be8d51\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" Apr 21 00:03:29.166385 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.165519 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3f41362d-51f9-4dde-9796-2752b85d50ee-multus-socket-dir-parent\") pod \"multus-lfxrt\" (UID: \"3f41362d-51f9-4dde-9796-2752b85d50ee\") " pod="openshift-multus/multus-lfxrt" Apr 21 00:03:29.166385 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.165555 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1479bc73-6541-435b-a311-d48731be8d51-run-ovn\") pod \"ovnkube-node-wmfb9\" (UID: \"1479bc73-6541-435b-a311-d48731be8d51\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" Apr 21 00:03:29.166385 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.165579 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1479bc73-6541-435b-a311-d48731be8d51-systemd-units\") pod \"ovnkube-node-wmfb9\" (UID: \"1479bc73-6541-435b-a311-d48731be8d51\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" Apr 21 00:03:29.166385 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.165606 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3f41362d-51f9-4dde-9796-2752b85d50ee-os-release\") pod \"multus-lfxrt\" (UID: \"3f41362d-51f9-4dde-9796-2752b85d50ee\") " pod="openshift-multus/multus-lfxrt" Apr 21 00:03:29.166385 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.165634 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/705da41f-2875-4893-9f4e-f88eb450d247-var-lib-kubelet\") pod \"tuned-fnp85\" (UID: \"705da41f-2875-4893-9f4e-f88eb450d247\") " pod="openshift-cluster-node-tuning-operator/tuned-fnp85" Apr 21 00:03:29.166385 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.165660 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3abd03e7-2e8f-48a2-b63d-5eddab0cb80a-cnibin\") pod \"multus-additional-cni-plugins-k959w\" (UID: \"3abd03e7-2e8f-48a2-b63d-5eddab0cb80a\") " pod="openshift-multus/multus-additional-cni-plugins-k959w" Apr 21 00:03:29.166385 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.165683 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1479bc73-6541-435b-a311-d48731be8d51-host-cni-bin\") pod \"ovnkube-node-wmfb9\" (UID: \"1479bc73-6541-435b-a311-d48731be8d51\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" Apr 21 00:03:29.166385 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.165708 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f41362d-51f9-4dde-9796-2752b85d50ee-host-var-lib-kubelet\") pod \"multus-lfxrt\" (UID: \"3f41362d-51f9-4dde-9796-2752b85d50ee\") " pod="openshift-multus/multus-lfxrt" Apr 21 00:03:29.166385 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.165735 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/945c8a71-f620-4cdb-89b7-0f17fbd8ab5b-host\") pod \"node-ca-84h5p\" (UID: \"945c8a71-f620-4cdb-89b7-0f17fbd8ab5b\") " pod="openshift-image-registry/node-ca-84h5p" Apr 21 00:03:29.166385 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.165761 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/705da41f-2875-4893-9f4e-f88eb450d247-etc-kubernetes\") pod \"tuned-fnp85\" (UID: \"705da41f-2875-4893-9f4e-f88eb450d247\") " pod="openshift-cluster-node-tuning-operator/tuned-fnp85" Apr 21 00:03:29.166385 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.165784 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/705da41f-2875-4893-9f4e-f88eb450d247-sys\") pod \"tuned-fnp85\" (UID: \"705da41f-2875-4893-9f4e-f88eb450d247\") " pod="openshift-cluster-node-tuning-operator/tuned-fnp85" Apr 21 00:03:29.166385 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.165812 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9bb1c9b4-978f-43ae-ba01-558601306bb0-socket-dir\") pod \"aws-ebs-csi-driver-node-9wn8j\" (UID: \"9bb1c9b4-978f-43ae-ba01-558601306bb0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wn8j" Apr 21 00:03:29.166385 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.165838 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1479bc73-6541-435b-a311-d48731be8d51-host-kubelet\") pod \"ovnkube-node-wmfb9\" (UID: \"1479bc73-6541-435b-a311-d48731be8d51\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" Apr 21 00:03:29.166385 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.165878 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1479bc73-6541-435b-a311-d48731be8d51-host-run-netns\") pod \"ovnkube-node-wmfb9\" (UID: \"1479bc73-6541-435b-a311-d48731be8d51\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" Apr 21 00:03:29.166385 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.165900 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1479bc73-6541-435b-a311-d48731be8d51-ovnkube-config\") pod \"ovnkube-node-wmfb9\" (UID: \"1479bc73-6541-435b-a311-d48731be8d51\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" Apr 21 00:03:29.167186 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.165925 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3f41362d-51f9-4dde-9796-2752b85d50ee-host-run-k8s-cni-cncf-io\") pod \"multus-lfxrt\" (UID: \"3f41362d-51f9-4dde-9796-2752b85d50ee\") " pod="openshift-multus/multus-lfxrt" Apr 21 00:03:29.167186 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.165957 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/705da41f-2875-4893-9f4e-f88eb450d247-host\") pod \"tuned-fnp85\" (UID: \"705da41f-2875-4893-9f4e-f88eb450d247\") " pod="openshift-cluster-node-tuning-operator/tuned-fnp85" Apr 21 00:03:29.167186 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.165959 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/705da41f-2875-4893-9f4e-f88eb450d247-var-lib-kubelet\") pod \"tuned-fnp85\" (UID: \"705da41f-2875-4893-9f4e-f88eb450d247\") " pod="openshift-cluster-node-tuning-operator/tuned-fnp85" Apr 21 00:03:29.167186 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.165984 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/44cc2f5b-b5d5-4fc4-a690-b4ad1f8bf4c7-host-slash\") pod \"iptables-alerter-mw27t\" (UID: \"44cc2f5b-b5d5-4fc4-a690-b4ad1f8bf4c7\") " pod="openshift-network-operator/iptables-alerter-mw27t" Apr 21 00:03:29.167186 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.166014 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3abd03e7-2e8f-48a2-b63d-5eddab0cb80a-os-release\") pod \"multus-additional-cni-plugins-k959w\" (UID: \"3abd03e7-2e8f-48a2-b63d-5eddab0cb80a\") " pod="openshift-multus/multus-additional-cni-plugins-k959w" Apr 21 00:03:29.167186 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.166049 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/945c8a71-f620-4cdb-89b7-0f17fbd8ab5b-host\") pod \"node-ca-84h5p\" (UID: \"945c8a71-f620-4cdb-89b7-0f17fbd8ab5b\") " pod="openshift-image-registry/node-ca-84h5p" Apr 21 00:03:29.167186 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.166053 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/39e13056-9209-4845-838d-9d46aa0dae95-konnectivity-ca\") pod \"konnectivity-agent-fbsp9\" (UID: \"39e13056-9209-4845-838d-9d46aa0dae95\") " pod="kube-system/konnectivity-agent-fbsp9" Apr 21 00:03:29.167186 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.166094 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/705da41f-2875-4893-9f4e-f88eb450d247-etc-kubernetes\") pod \"tuned-fnp85\" (UID: \"705da41f-2875-4893-9f4e-f88eb450d247\") " pod="openshift-cluster-node-tuning-operator/tuned-fnp85" Apr 21 00:03:29.167186 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.166112 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9bb1c9b4-978f-43ae-ba01-558601306bb0-etc-selinux\") pod \"aws-ebs-csi-driver-node-9wn8j\" (UID: \"9bb1c9b4-978f-43ae-ba01-558601306bb0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wn8j" Apr 21 00:03:29.167186 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.166147 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/44cc2f5b-b5d5-4fc4-a690-b4ad1f8bf4c7-host-slash\") pod \"iptables-alerter-mw27t\" (UID: \"44cc2f5b-b5d5-4fc4-a690-b4ad1f8bf4c7\") " pod="openshift-network-operator/iptables-alerter-mw27t" Apr 21 00:03:29.167186 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.166204 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/705da41f-2875-4893-9f4e-f88eb450d247-host\") pod \"tuned-fnp85\" (UID: \"705da41f-2875-4893-9f4e-f88eb450d247\") " pod="openshift-cluster-node-tuning-operator/tuned-fnp85" Apr 21 00:03:29.167792 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.166103 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/705da41f-2875-4893-9f4e-f88eb450d247-sys\") pod \"tuned-fnp85\" (UID: \"705da41f-2875-4893-9f4e-f88eb450d247\") " pod="openshift-cluster-node-tuning-operator/tuned-fnp85" Apr 21 00:03:29.168009 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.167992 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/705da41f-2875-4893-9f4e-f88eb450d247-etc-tuned\") pod \"tuned-fnp85\" (UID: \"705da41f-2875-4893-9f4e-f88eb450d247\") " pod="openshift-cluster-node-tuning-operator/tuned-fnp85" Apr 21 00:03:29.168076 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.168029 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/705da41f-2875-4893-9f4e-f88eb450d247-tmp\") pod \"tuned-fnp85\" (UID: \"705da41f-2875-4893-9f4e-f88eb450d247\") " pod="openshift-cluster-node-tuning-operator/tuned-fnp85" Apr 21 00:03:29.171844 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.171818 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9k6xp\" (UniqueName: \"kubernetes.io/projected/945c8a71-f620-4cdb-89b7-0f17fbd8ab5b-kube-api-access-9k6xp\") pod \"node-ca-84h5p\" (UID: \"945c8a71-f620-4cdb-89b7-0f17fbd8ab5b\") " pod="openshift-image-registry/node-ca-84h5p" Apr 21 00:03:29.171944 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.171859 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rtfj\" (UniqueName: \"kubernetes.io/projected/44cc2f5b-b5d5-4fc4-a690-b4ad1f8bf4c7-kube-api-access-7rtfj\") pod \"iptables-alerter-mw27t\" (UID: \"44cc2f5b-b5d5-4fc4-a690-b4ad1f8bf4c7\") " pod="openshift-network-operator/iptables-alerter-mw27t" Apr 21 00:03:29.171987 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.171966 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkwps\" (UniqueName: \"kubernetes.io/projected/30356905-73c1-4fa1-a700-5d499f482647-kube-api-access-kkwps\") pod \"node-resolver-twj7c\" (UID: \"30356905-73c1-4fa1-a700-5d499f482647\") " pod="openshift-dns/node-resolver-twj7c" Apr 21 00:03:29.173348 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.173331 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xt2h6\" (UniqueName: \"kubernetes.io/projected/705da41f-2875-4893-9f4e-f88eb450d247-kube-api-access-xt2h6\") pod \"tuned-fnp85\" (UID: \"705da41f-2875-4893-9f4e-f88eb450d247\") " pod="openshift-cluster-node-tuning-operator/tuned-fnp85" Apr 21 00:03:29.187909 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:29.187874 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod893ed304dbbaa7472e9062bd86be8331.slice/crio-5ca9abf309873eaf3d9d7725d9d9c66276a467921df3ac18c1ceaf60ff637df4 WatchSource:0}: Error finding container 5ca9abf309873eaf3d9d7725d9d9c66276a467921df3ac18c1ceaf60ff637df4: Status 404 returned error can't find the container with id 5ca9abf309873eaf3d9d7725d9d9c66276a467921df3ac18c1ceaf60ff637df4 Apr 21 00:03:29.188109 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:29.188091 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7803e06bf1575842c2662501b98b3432.slice/crio-6a65e43242dc550b162a37d41cef1eb574f57947b43c80470d1078e9dc1ebcb9 WatchSource:0}: Error finding container 6a65e43242dc550b162a37d41cef1eb574f57947b43c80470d1078e9dc1ebcb9: Status 404 returned error can't find the container with id 6a65e43242dc550b162a37d41cef1eb574f57947b43c80470d1078e9dc1ebcb9 Apr 21 00:03:29.194230 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.194203 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Apr 21 00:03:29.209444 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.209394 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-1.ec2.internal" event={"ID":"893ed304dbbaa7472e9062bd86be8331","Type":"ContainerStarted","Data":"5ca9abf309873eaf3d9d7725d9d9c66276a467921df3ac18c1ceaf60ff637df4"} Apr 21 00:03:29.211058 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.211030 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-1.ec2.internal" event={"ID":"7803e06bf1575842c2662501b98b3432","Type":"ContainerStarted","Data":"6a65e43242dc550b162a37d41cef1eb574f57947b43c80470d1078e9dc1ebcb9"} Apr 21 00:03:29.267149 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.267110 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1479bc73-6541-435b-a311-d48731be8d51-ovnkube-script-lib\") pod \"ovnkube-node-wmfb9\" (UID: \"1479bc73-6541-435b-a311-d48731be8d51\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" Apr 21 00:03:29.267149 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.267149 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3f41362d-51f9-4dde-9796-2752b85d50ee-cnibin\") pod \"multus-lfxrt\" (UID: \"3f41362d-51f9-4dde-9796-2752b85d50ee\") " pod="openshift-multus/multus-lfxrt" Apr 21 00:03:29.268222 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.267170 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3abd03e7-2e8f-48a2-b63d-5eddab0cb80a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k959w\" (UID: \"3abd03e7-2e8f-48a2-b63d-5eddab0cb80a\") " pod="openshift-multus/multus-additional-cni-plugins-k959w" Apr 21 00:03:29.268222 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.267189 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9bb1c9b4-978f-43ae-ba01-558601306bb0-registration-dir\") pod \"aws-ebs-csi-driver-node-9wn8j\" (UID: \"9bb1c9b4-978f-43ae-ba01-558601306bb0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wn8j" Apr 21 00:03:29.268222 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.267205 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3f41362d-51f9-4dde-9796-2752b85d50ee-cni-binary-copy\") pod \"multus-lfxrt\" (UID: \"3f41362d-51f9-4dde-9796-2752b85d50ee\") " pod="openshift-multus/multus-lfxrt" Apr 21 00:03:29.268222 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.267219 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3f41362d-51f9-4dde-9796-2752b85d50ee-host-var-lib-cni-multus\") pod \"multus-lfxrt\" (UID: \"3f41362d-51f9-4dde-9796-2752b85d50ee\") " pod="openshift-multus/multus-lfxrt" Apr 21 00:03:29.268222 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.267233 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3f41362d-51f9-4dde-9796-2752b85d50ee-host-run-multus-certs\") pod \"multus-lfxrt\" (UID: \"3f41362d-51f9-4dde-9796-2752b85d50ee\") " pod="openshift-multus/multus-lfxrt" Apr 21 00:03:29.268222 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.267256 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9bb1c9b4-978f-43ae-ba01-558601306bb0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9wn8j\" (UID: \"9bb1c9b4-978f-43ae-ba01-558601306bb0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wn8j" Apr 21 00:03:29.268222 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.267271 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3f41362d-51f9-4dde-9796-2752b85d50ee-cnibin\") pod \"multus-lfxrt\" (UID: \"3f41362d-51f9-4dde-9796-2752b85d50ee\") " pod="openshift-multus/multus-lfxrt" Apr 21 00:03:29.268222 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.267280 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1479bc73-6541-435b-a311-d48731be8d51-ovn-node-metrics-cert\") pod \"ovnkube-node-wmfb9\" (UID: \"1479bc73-6541-435b-a311-d48731be8d51\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" Apr 21 00:03:29.268222 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.267315 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9bb1c9b4-978f-43ae-ba01-558601306bb0-registration-dir\") pod \"aws-ebs-csi-driver-node-9wn8j\" (UID: \"9bb1c9b4-978f-43ae-ba01-558601306bb0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wn8j" Apr 21 00:03:29.268222 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.267323 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3f41362d-51f9-4dde-9796-2752b85d50ee-host-run-netns\") pod \"multus-lfxrt\" (UID: \"3f41362d-51f9-4dde-9796-2752b85d50ee\") " pod="openshift-multus/multus-lfxrt" Apr 21 00:03:29.268222 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.267331 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3f41362d-51f9-4dde-9796-2752b85d50ee-host-var-lib-cni-multus\") pod \"multus-lfxrt\" (UID: \"3f41362d-51f9-4dde-9796-2752b85d50ee\") " pod="openshift-multus/multus-lfxrt" Apr 21 00:03:29.268222 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.267335 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3f41362d-51f9-4dde-9796-2752b85d50ee-host-run-multus-certs\") pod \"multus-lfxrt\" (UID: \"3f41362d-51f9-4dde-9796-2752b85d50ee\") " pod="openshift-multus/multus-lfxrt" Apr 21 00:03:29.268222 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.267381 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lkd94\" (UniqueName: \"kubernetes.io/projected/9bb1c9b4-978f-43ae-ba01-558601306bb0-kube-api-access-lkd94\") pod \"aws-ebs-csi-driver-node-9wn8j\" (UID: \"9bb1c9b4-978f-43ae-ba01-558601306bb0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wn8j" Apr 21 00:03:29.268222 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.267393 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3f41362d-51f9-4dde-9796-2752b85d50ee-host-run-netns\") pod \"multus-lfxrt\" (UID: \"3f41362d-51f9-4dde-9796-2752b85d50ee\") " pod="openshift-multus/multus-lfxrt" Apr 21 00:03:29.268222 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.267426 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9bb1c9b4-978f-43ae-ba01-558601306bb0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9wn8j\" (UID: \"9bb1c9b4-978f-43ae-ba01-558601306bb0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wn8j" Apr 21 00:03:29.268222 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.267507 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1479bc73-6541-435b-a311-d48731be8d51-run-systemd\") pod \"ovnkube-node-wmfb9\" (UID: \"1479bc73-6541-435b-a311-d48731be8d51\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" Apr 21 00:03:29.268222 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.267541 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1479bc73-6541-435b-a311-d48731be8d51-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wmfb9\" (UID: \"1479bc73-6541-435b-a311-d48731be8d51\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" Apr 21 00:03:29.268975 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.267546 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1479bc73-6541-435b-a311-d48731be8d51-run-systemd\") pod \"ovnkube-node-wmfb9\" (UID: \"1479bc73-6541-435b-a311-d48731be8d51\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" Apr 21 00:03:29.268975 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.267569 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1479bc73-6541-435b-a311-d48731be8d51-env-overrides\") pod \"ovnkube-node-wmfb9\" (UID: \"1479bc73-6541-435b-a311-d48731be8d51\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" Apr 21 00:03:29.268975 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.267595 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3f41362d-51f9-4dde-9796-2752b85d50ee-host-var-lib-cni-bin\") pod \"multus-lfxrt\" (UID: \"3f41362d-51f9-4dde-9796-2752b85d50ee\") " pod="openshift-multus/multus-lfxrt" Apr 21 00:03:29.268975 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.267605 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1479bc73-6541-435b-a311-d48731be8d51-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wmfb9\" (UID: \"1479bc73-6541-435b-a311-d48731be8d51\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" Apr 21 00:03:29.268975 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.267622 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3abd03e7-2e8f-48a2-b63d-5eddab0cb80a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k959w\" (UID: \"3abd03e7-2e8f-48a2-b63d-5eddab0cb80a\") " pod="openshift-multus/multus-additional-cni-plugins-k959w" Apr 21 00:03:29.268975 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.267648 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sfqsx\" (UniqueName: \"kubernetes.io/projected/3abd03e7-2e8f-48a2-b63d-5eddab0cb80a-kube-api-access-sfqsx\") pod \"multus-additional-cni-plugins-k959w\" (UID: \"3abd03e7-2e8f-48a2-b63d-5eddab0cb80a\") " pod="openshift-multus/multus-additional-cni-plugins-k959w" Apr 21 00:03:29.268975 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.267662 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3f41362d-51f9-4dde-9796-2752b85d50ee-host-var-lib-cni-bin\") pod \"multus-lfxrt\" (UID: \"3f41362d-51f9-4dde-9796-2752b85d50ee\") " pod="openshift-multus/multus-lfxrt" Apr 21 00:03:29.268975 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.267670 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9bb1c9b4-978f-43ae-ba01-558601306bb0-device-dir\") pod \"aws-ebs-csi-driver-node-9wn8j\" (UID: \"9bb1c9b4-978f-43ae-ba01-558601306bb0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wn8j" Apr 21 00:03:29.268975 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.267697 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9bb1c9b4-978f-43ae-ba01-558601306bb0-sys-fs\") pod \"aws-ebs-csi-driver-node-9wn8j\" (UID: \"9bb1c9b4-978f-43ae-ba01-558601306bb0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wn8j" Apr 21 00:03:29.268975 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.267719 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1479bc73-6541-435b-a311-d48731be8d51-etc-openvswitch\") pod \"ovnkube-node-wmfb9\" (UID: \"1479bc73-6541-435b-a311-d48731be8d51\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" Apr 21 00:03:29.268975 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.267751 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3f41362d-51f9-4dde-9796-2752b85d50ee-multus-conf-dir\") pod \"multus-lfxrt\" (UID: \"3f41362d-51f9-4dde-9796-2752b85d50ee\") " pod="openshift-multus/multus-lfxrt" Apr 21 00:03:29.268975 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.267771 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9bb1c9b4-978f-43ae-ba01-558601306bb0-device-dir\") pod \"aws-ebs-csi-driver-node-9wn8j\" (UID: \"9bb1c9b4-978f-43ae-ba01-558601306bb0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wn8j" Apr 21 00:03:29.268975 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.267779 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3abd03e7-2e8f-48a2-b63d-5eddab0cb80a-cni-binary-copy\") pod \"multus-additional-cni-plugins-k959w\" (UID: \"3abd03e7-2e8f-48a2-b63d-5eddab0cb80a\") " pod="openshift-multus/multus-additional-cni-plugins-k959w" Apr 21 00:03:29.268975 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.267827 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/39e13056-9209-4845-838d-9d46aa0dae95-agent-certs\") pod \"konnectivity-agent-fbsp9\" (UID: \"39e13056-9209-4845-838d-9d46aa0dae95\") " pod="kube-system/konnectivity-agent-fbsp9" Apr 21 00:03:29.268975 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.267882 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f41362d-51f9-4dde-9796-2752b85d50ee-multus-cni-dir\") pod \"multus-lfxrt\" (UID: \"3f41362d-51f9-4dde-9796-2752b85d50ee\") " pod="openshift-multus/multus-lfxrt" Apr 21 00:03:29.268975 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.267884 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3f41362d-51f9-4dde-9796-2752b85d50ee-cni-binary-copy\") pod \"multus-lfxrt\" (UID: \"3f41362d-51f9-4dde-9796-2752b85d50ee\") " pod="openshift-multus/multus-lfxrt" Apr 21 00:03:29.268975 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.267900 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1479bc73-6541-435b-a311-d48731be8d51-ovnkube-script-lib\") pod \"ovnkube-node-wmfb9\" (UID: \"1479bc73-6541-435b-a311-d48731be8d51\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" Apr 21 00:03:29.269729 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.267913 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9bb1c9b4-978f-43ae-ba01-558601306bb0-sys-fs\") pod \"aws-ebs-csi-driver-node-9wn8j\" (UID: \"9bb1c9b4-978f-43ae-ba01-558601306bb0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wn8j" Apr 21 00:03:29.269729 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.267907 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3f41362d-51f9-4dde-9796-2752b85d50ee-hostroot\") pod \"multus-lfxrt\" (UID: \"3f41362d-51f9-4dde-9796-2752b85d50ee\") " pod="openshift-multus/multus-lfxrt" Apr 21 00:03:29.269729 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.267884 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1479bc73-6541-435b-a311-d48731be8d51-etc-openvswitch\") pod \"ovnkube-node-wmfb9\" (UID: \"1479bc73-6541-435b-a311-d48731be8d51\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" Apr 21 00:03:29.269729 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.267938 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3f41362d-51f9-4dde-9796-2752b85d50ee-multus-conf-dir\") pod \"multus-lfxrt\" (UID: \"3f41362d-51f9-4dde-9796-2752b85d50ee\") " pod="openshift-multus/multus-lfxrt" Apr 21 00:03:29.269729 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.267951 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f41362d-51f9-4dde-9796-2752b85d50ee-etc-kubernetes\") pod \"multus-lfxrt\" (UID: \"3f41362d-51f9-4dde-9796-2752b85d50ee\") " pod="openshift-multus/multus-lfxrt" Apr 21 00:03:29.269729 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.267967 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f41362d-51f9-4dde-9796-2752b85d50ee-multus-cni-dir\") pod \"multus-lfxrt\" (UID: \"3f41362d-51f9-4dde-9796-2752b85d50ee\") " pod="openshift-multus/multus-lfxrt" Apr 21 00:03:29.269729 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.267973 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3f41362d-51f9-4dde-9796-2752b85d50ee-hostroot\") pod \"multus-lfxrt\" (UID: \"3f41362d-51f9-4dde-9796-2752b85d50ee\") " pod="openshift-multus/multus-lfxrt" Apr 21 00:03:29.269729 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.267976 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1479bc73-6541-435b-a311-d48731be8d51-node-log\") pod \"ovnkube-node-wmfb9\" (UID: \"1479bc73-6541-435b-a311-d48731be8d51\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" Apr 21 00:03:29.269729 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.268009 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f41362d-51f9-4dde-9796-2752b85d50ee-system-cni-dir\") pod \"multus-lfxrt\" (UID: \"3f41362d-51f9-4dde-9796-2752b85d50ee\") " pod="openshift-multus/multus-lfxrt" Apr 21 00:03:29.269729 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.268035 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1479bc73-6541-435b-a311-d48731be8d51-node-log\") pod \"ovnkube-node-wmfb9\" (UID: \"1479bc73-6541-435b-a311-d48731be8d51\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" Apr 21 00:03:29.269729 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.268039 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3abd03e7-2e8f-48a2-b63d-5eddab0cb80a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k959w\" (UID: \"3abd03e7-2e8f-48a2-b63d-5eddab0cb80a\") " pod="openshift-multus/multus-additional-cni-plugins-k959w" Apr 21 00:03:29.269729 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.268010 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f41362d-51f9-4dde-9796-2752b85d50ee-etc-kubernetes\") pod \"multus-lfxrt\" (UID: \"3f41362d-51f9-4dde-9796-2752b85d50ee\") " pod="openshift-multus/multus-lfxrt" Apr 21 00:03:29.269729 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.268048 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f41362d-51f9-4dde-9796-2752b85d50ee-system-cni-dir\") pod \"multus-lfxrt\" (UID: \"3f41362d-51f9-4dde-9796-2752b85d50ee\") " pod="openshift-multus/multus-lfxrt" Apr 21 00:03:29.269729 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.268067 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1479bc73-6541-435b-a311-d48731be8d51-host-run-ovn-kubernetes\") pod \"ovnkube-node-wmfb9\" (UID: \"1479bc73-6541-435b-a311-d48731be8d51\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" Apr 21 00:03:29.269729 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.268106 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1479bc73-6541-435b-a311-d48731be8d51-env-overrides\") pod \"ovnkube-node-wmfb9\" (UID: \"1479bc73-6541-435b-a311-d48731be8d51\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" Apr 21 00:03:29.269729 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.268161 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3abd03e7-2e8f-48a2-b63d-5eddab0cb80a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k959w\" (UID: \"3abd03e7-2e8f-48a2-b63d-5eddab0cb80a\") " pod="openshift-multus/multus-additional-cni-plugins-k959w" Apr 21 00:03:29.269729 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.268166 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3abd03e7-2e8f-48a2-b63d-5eddab0cb80a-system-cni-dir\") pod \"multus-additional-cni-plugins-k959w\" (UID: \"3abd03e7-2e8f-48a2-b63d-5eddab0cb80a\") " pod="openshift-multus/multus-additional-cni-plugins-k959w" Apr 21 00:03:29.269729 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.268201 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-99mvh\" (UniqueName: \"kubernetes.io/projected/65f5aca2-9fa7-4b19-b02f-0dd809899f41-kube-api-access-99mvh\") pod \"network-metrics-daemon-lr9hq\" (UID: \"65f5aca2-9fa7-4b19-b02f-0dd809899f41\") " pod="openshift-multus/network-metrics-daemon-lr9hq" Apr 21 00:03:29.270281 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.268228 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1479bc73-6541-435b-a311-d48731be8d51-host-slash\") pod \"ovnkube-node-wmfb9\" (UID: \"1479bc73-6541-435b-a311-d48731be8d51\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" Apr 21 00:03:29.270281 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.268253 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1479bc73-6541-435b-a311-d48731be8d51-run-openvswitch\") pod \"ovnkube-node-wmfb9\" (UID: \"1479bc73-6541-435b-a311-d48731be8d51\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" Apr 21 00:03:29.270281 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.268280 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t99nb\" (UniqueName: \"kubernetes.io/projected/3f41362d-51f9-4dde-9796-2752b85d50ee-kube-api-access-t99nb\") pod \"multus-lfxrt\" (UID: \"3f41362d-51f9-4dde-9796-2752b85d50ee\") " pod="openshift-multus/multus-lfxrt" Apr 21 00:03:29.270281 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.268306 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65f5aca2-9fa7-4b19-b02f-0dd809899f41-metrics-certs\") pod \"network-metrics-daemon-lr9hq\" (UID: \"65f5aca2-9fa7-4b19-b02f-0dd809899f41\") " pod="openshift-multus/network-metrics-daemon-lr9hq" Apr 21 00:03:29.270281 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.268332 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1479bc73-6541-435b-a311-d48731be8d51-log-socket\") pod \"ovnkube-node-wmfb9\" (UID: \"1479bc73-6541-435b-a311-d48731be8d51\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" Apr 21 00:03:29.270281 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.268384 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4qbl8\" (UniqueName: \"kubernetes.io/projected/526918a6-6456-4ee9-b13d-ca26cfea5695-kube-api-access-4qbl8\") pod \"network-check-target-d5vdn\" (UID: \"526918a6-6456-4ee9-b13d-ca26cfea5695\") " pod="openshift-network-diagnostics/network-check-target-d5vdn" Apr 21 00:03:29.270281 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.268409 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1479bc73-6541-435b-a311-d48731be8d51-host-cni-netd\") pod \"ovnkube-node-wmfb9\" (UID: \"1479bc73-6541-435b-a311-d48731be8d51\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" Apr 21 00:03:29.270281 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.268434 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fgqlw\" (UniqueName: \"kubernetes.io/projected/1479bc73-6541-435b-a311-d48731be8d51-kube-api-access-fgqlw\") pod \"ovnkube-node-wmfb9\" (UID: \"1479bc73-6541-435b-a311-d48731be8d51\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" Apr 21 00:03:29.270281 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.268460 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3f41362d-51f9-4dde-9796-2752b85d50ee-multus-socket-dir-parent\") pod \"multus-lfxrt\" (UID: \"3f41362d-51f9-4dde-9796-2752b85d50ee\") " pod="openshift-multus/multus-lfxrt" Apr 21 00:03:29.270281 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.268487 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1479bc73-6541-435b-a311-d48731be8d51-run-ovn\") pod \"ovnkube-node-wmfb9\" (UID: \"1479bc73-6541-435b-a311-d48731be8d51\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" Apr 21 00:03:29.270281 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.268510 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1479bc73-6541-435b-a311-d48731be8d51-systemd-units\") pod \"ovnkube-node-wmfb9\" (UID: \"1479bc73-6541-435b-a311-d48731be8d51\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" Apr 21 00:03:29.270281 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.268538 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3f41362d-51f9-4dde-9796-2752b85d50ee-os-release\") pod \"multus-lfxrt\" (UID: \"3f41362d-51f9-4dde-9796-2752b85d50ee\") " pod="openshift-multus/multus-lfxrt" Apr 21 00:03:29.270281 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.268543 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3abd03e7-2e8f-48a2-b63d-5eddab0cb80a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k959w\" (UID: \"3abd03e7-2e8f-48a2-b63d-5eddab0cb80a\") " pod="openshift-multus/multus-additional-cni-plugins-k959w" Apr 21 00:03:29.270281 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.268601 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1479bc73-6541-435b-a311-d48731be8d51-log-socket\") pod \"ovnkube-node-wmfb9\" (UID: \"1479bc73-6541-435b-a311-d48731be8d51\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" Apr 21 00:03:29.270281 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:29.268642 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Apr 21 00:03:29.270281 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.268663 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3f41362d-51f9-4dde-9796-2752b85d50ee-os-release\") pod \"multus-lfxrt\" (UID: \"3f41362d-51f9-4dde-9796-2752b85d50ee\") " pod="openshift-multus/multus-lfxrt" Apr 21 00:03:29.270281 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.268204 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1479bc73-6541-435b-a311-d48731be8d51-host-run-ovn-kubernetes\") pod \"ovnkube-node-wmfb9\" (UID: \"1479bc73-6541-435b-a311-d48731be8d51\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" Apr 21 00:03:29.270281 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.268678 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3abd03e7-2e8f-48a2-b63d-5eddab0cb80a-system-cni-dir\") pod \"multus-additional-cni-plugins-k959w\" (UID: \"3abd03e7-2e8f-48a2-b63d-5eddab0cb80a\") " pod="openshift-multus/multus-additional-cni-plugins-k959w" Apr 21 00:03:29.270905 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.268714 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1479bc73-6541-435b-a311-d48731be8d51-host-slash\") pod \"ovnkube-node-wmfb9\" (UID: \"1479bc73-6541-435b-a311-d48731be8d51\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" Apr 21 00:03:29.270905 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.268716 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1479bc73-6541-435b-a311-d48731be8d51-run-openvswitch\") pod \"ovnkube-node-wmfb9\" (UID: \"1479bc73-6541-435b-a311-d48731be8d51\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" Apr 21 00:03:29.270905 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.268733 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3abd03e7-2e8f-48a2-b63d-5eddab0cb80a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k959w\" (UID: \"3abd03e7-2e8f-48a2-b63d-5eddab0cb80a\") " pod="openshift-multus/multus-additional-cni-plugins-k959w" Apr 21 00:03:29.270905 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:29.268781 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65f5aca2-9fa7-4b19-b02f-0dd809899f41-metrics-certs podName:65f5aca2-9fa7-4b19-b02f-0dd809899f41 nodeName:}" failed. No retries permitted until 2026-04-21 00:03:29.768720284 +0000 UTC m=+2.204058510 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65f5aca2-9fa7-4b19-b02f-0dd809899f41-metrics-certs") pod "network-metrics-daemon-lr9hq" (UID: "65f5aca2-9fa7-4b19-b02f-0dd809899f41") : object "openshift-multus"/"metrics-daemon-secret" not registered Apr 21 00:03:29.270905 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.268818 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1479bc73-6541-435b-a311-d48731be8d51-systemd-units\") pod \"ovnkube-node-wmfb9\" (UID: \"1479bc73-6541-435b-a311-d48731be8d51\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" Apr 21 00:03:29.270905 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.268641 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3abd03e7-2e8f-48a2-b63d-5eddab0cb80a-cni-binary-copy\") pod \"multus-additional-cni-plugins-k959w\" (UID: \"3abd03e7-2e8f-48a2-b63d-5eddab0cb80a\") " pod="openshift-multus/multus-additional-cni-plugins-k959w" Apr 21 00:03:29.270905 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.268824 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1479bc73-6541-435b-a311-d48731be8d51-host-cni-netd\") pod \"ovnkube-node-wmfb9\" (UID: \"1479bc73-6541-435b-a311-d48731be8d51\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" Apr 21 00:03:29.270905 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.268778 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3f41362d-51f9-4dde-9796-2752b85d50ee-multus-socket-dir-parent\") pod \"multus-lfxrt\" (UID: \"3f41362d-51f9-4dde-9796-2752b85d50ee\") " pod="openshift-multus/multus-lfxrt" Apr 21 00:03:29.270905 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.268868 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3abd03e7-2e8f-48a2-b63d-5eddab0cb80a-cnibin\") pod \"multus-additional-cni-plugins-k959w\" (UID: \"3abd03e7-2e8f-48a2-b63d-5eddab0cb80a\") " pod="openshift-multus/multus-additional-cni-plugins-k959w" Apr 21 00:03:29.270905 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.268819 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3abd03e7-2e8f-48a2-b63d-5eddab0cb80a-cnibin\") pod \"multus-additional-cni-plugins-k959w\" (UID: \"3abd03e7-2e8f-48a2-b63d-5eddab0cb80a\") " pod="openshift-multus/multus-additional-cni-plugins-k959w" Apr 21 00:03:29.270905 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.268895 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1479bc73-6541-435b-a311-d48731be8d51-run-ovn\") pod \"ovnkube-node-wmfb9\" (UID: \"1479bc73-6541-435b-a311-d48731be8d51\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" Apr 21 00:03:29.270905 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.268933 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1479bc73-6541-435b-a311-d48731be8d51-host-cni-bin\") pod \"ovnkube-node-wmfb9\" (UID: \"1479bc73-6541-435b-a311-d48731be8d51\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" Apr 21 00:03:29.270905 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.268962 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f41362d-51f9-4dde-9796-2752b85d50ee-host-var-lib-kubelet\") pod \"multus-lfxrt\" (UID: \"3f41362d-51f9-4dde-9796-2752b85d50ee\") " pod="openshift-multus/multus-lfxrt" Apr 21 00:03:29.270905 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.268988 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9bb1c9b4-978f-43ae-ba01-558601306bb0-socket-dir\") pod \"aws-ebs-csi-driver-node-9wn8j\" (UID: \"9bb1c9b4-978f-43ae-ba01-558601306bb0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wn8j" Apr 21 00:03:29.270905 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.269013 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f41362d-51f9-4dde-9796-2752b85d50ee-host-var-lib-kubelet\") pod \"multus-lfxrt\" (UID: \"3f41362d-51f9-4dde-9796-2752b85d50ee\") " pod="openshift-multus/multus-lfxrt" Apr 21 00:03:29.270905 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.269014 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1479bc73-6541-435b-a311-d48731be8d51-host-cni-bin\") pod \"ovnkube-node-wmfb9\" (UID: \"1479bc73-6541-435b-a311-d48731be8d51\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" Apr 21 00:03:29.270905 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.269029 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1479bc73-6541-435b-a311-d48731be8d51-host-kubelet\") pod \"ovnkube-node-wmfb9\" (UID: \"1479bc73-6541-435b-a311-d48731be8d51\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" Apr 21 00:03:29.271383 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.269052 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1479bc73-6541-435b-a311-d48731be8d51-host-run-netns\") pod \"ovnkube-node-wmfb9\" (UID: \"1479bc73-6541-435b-a311-d48731be8d51\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" Apr 21 00:03:29.271383 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.269085 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1479bc73-6541-435b-a311-d48731be8d51-host-kubelet\") pod \"ovnkube-node-wmfb9\" (UID: \"1479bc73-6541-435b-a311-d48731be8d51\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" Apr 21 00:03:29.271383 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.269091 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1479bc73-6541-435b-a311-d48731be8d51-ovnkube-config\") pod \"ovnkube-node-wmfb9\" (UID: \"1479bc73-6541-435b-a311-d48731be8d51\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" Apr 21 00:03:29.271383 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.269120 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9bb1c9b4-978f-43ae-ba01-558601306bb0-socket-dir\") pod \"aws-ebs-csi-driver-node-9wn8j\" (UID: \"9bb1c9b4-978f-43ae-ba01-558601306bb0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wn8j" Apr 21 00:03:29.271383 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.269119 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1479bc73-6541-435b-a311-d48731be8d51-host-run-netns\") pod \"ovnkube-node-wmfb9\" (UID: \"1479bc73-6541-435b-a311-d48731be8d51\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" Apr 21 00:03:29.271383 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.269119 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3f41362d-51f9-4dde-9796-2752b85d50ee-host-run-k8s-cni-cncf-io\") pod \"multus-lfxrt\" (UID: \"3f41362d-51f9-4dde-9796-2752b85d50ee\") " pod="openshift-multus/multus-lfxrt" Apr 21 00:03:29.271383 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.269147 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3f41362d-51f9-4dde-9796-2752b85d50ee-host-run-k8s-cni-cncf-io\") pod \"multus-lfxrt\" (UID: \"3f41362d-51f9-4dde-9796-2752b85d50ee\") " pod="openshift-multus/multus-lfxrt" Apr 21 00:03:29.271383 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.269187 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3abd03e7-2e8f-48a2-b63d-5eddab0cb80a-os-release\") pod \"multus-additional-cni-plugins-k959w\" (UID: \"3abd03e7-2e8f-48a2-b63d-5eddab0cb80a\") " pod="openshift-multus/multus-additional-cni-plugins-k959w" Apr 21 00:03:29.271383 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.269236 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/39e13056-9209-4845-838d-9d46aa0dae95-konnectivity-ca\") pod \"konnectivity-agent-fbsp9\" (UID: \"39e13056-9209-4845-838d-9d46aa0dae95\") " pod="kube-system/konnectivity-agent-fbsp9" Apr 21 00:03:29.271383 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.269249 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3abd03e7-2e8f-48a2-b63d-5eddab0cb80a-os-release\") pod \"multus-additional-cni-plugins-k959w\" (UID: \"3abd03e7-2e8f-48a2-b63d-5eddab0cb80a\") " pod="openshift-multus/multus-additional-cni-plugins-k959w" Apr 21 00:03:29.271383 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.269265 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9bb1c9b4-978f-43ae-ba01-558601306bb0-etc-selinux\") pod \"aws-ebs-csi-driver-node-9wn8j\" (UID: \"9bb1c9b4-978f-43ae-ba01-558601306bb0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wn8j" Apr 21 00:03:29.271383 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.269282 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1479bc73-6541-435b-a311-d48731be8d51-var-lib-openvswitch\") pod \"ovnkube-node-wmfb9\" (UID: \"1479bc73-6541-435b-a311-d48731be8d51\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" Apr 21 00:03:29.271383 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.269302 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3f41362d-51f9-4dde-9796-2752b85d50ee-multus-daemon-config\") pod \"multus-lfxrt\" (UID: \"3f41362d-51f9-4dde-9796-2752b85d50ee\") " pod="openshift-multus/multus-lfxrt" Apr 21 00:03:29.271383 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.269411 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9bb1c9b4-978f-43ae-ba01-558601306bb0-etc-selinux\") pod \"aws-ebs-csi-driver-node-9wn8j\" (UID: \"9bb1c9b4-978f-43ae-ba01-558601306bb0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wn8j" Apr 21 00:03:29.271383 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.269462 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1479bc73-6541-435b-a311-d48731be8d51-var-lib-openvswitch\") pod \"ovnkube-node-wmfb9\" (UID: \"1479bc73-6541-435b-a311-d48731be8d51\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" Apr 21 00:03:29.271383 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.269619 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1479bc73-6541-435b-a311-d48731be8d51-ovnkube-config\") pod \"ovnkube-node-wmfb9\" (UID: \"1479bc73-6541-435b-a311-d48731be8d51\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" Apr 21 00:03:29.271383 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.269715 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3f41362d-51f9-4dde-9796-2752b85d50ee-multus-daemon-config\") pod \"multus-lfxrt\" (UID: \"3f41362d-51f9-4dde-9796-2752b85d50ee\") " pod="openshift-multus/multus-lfxrt" Apr 21 00:03:29.271848 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.269783 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/39e13056-9209-4845-838d-9d46aa0dae95-konnectivity-ca\") pod \"konnectivity-agent-fbsp9\" (UID: \"39e13056-9209-4845-838d-9d46aa0dae95\") " pod="kube-system/konnectivity-agent-fbsp9" Apr 21 00:03:29.271848 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.270000 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1479bc73-6541-435b-a311-d48731be8d51-ovn-node-metrics-cert\") pod \"ovnkube-node-wmfb9\" (UID: \"1479bc73-6541-435b-a311-d48731be8d51\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" Apr 21 00:03:29.271848 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.270431 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/39e13056-9209-4845-838d-9d46aa0dae95-agent-certs\") pod \"konnectivity-agent-fbsp9\" (UID: \"39e13056-9209-4845-838d-9d46aa0dae95\") " pod="kube-system/konnectivity-agent-fbsp9" Apr 21 00:03:29.284638 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:29.284565 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Apr 21 00:03:29.284638 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:29.284589 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Apr 21 00:03:29.284638 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:29.284600 2576 projected.go:194] Error preparing data for projected volume kube-api-access-4qbl8 for pod openshift-network-diagnostics/network-check-target-d5vdn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 21 00:03:29.284808 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:29.284665 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/526918a6-6456-4ee9-b13d-ca26cfea5695-kube-api-access-4qbl8 podName:526918a6-6456-4ee9-b13d-ca26cfea5695 nodeName:}" failed. No retries permitted until 2026-04-21 00:03:29.784649765 +0000 UTC m=+2.219987966 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4qbl8" (UniqueName: "kubernetes.io/projected/526918a6-6456-4ee9-b13d-ca26cfea5695-kube-api-access-4qbl8") pod "network-check-target-d5vdn" (UID: "526918a6-6456-4ee9-b13d-ca26cfea5695") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 21 00:03:29.294076 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.294040 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfqsx\" (UniqueName: \"kubernetes.io/projected/3abd03e7-2e8f-48a2-b63d-5eddab0cb80a-kube-api-access-sfqsx\") pod \"multus-additional-cni-plugins-k959w\" (UID: \"3abd03e7-2e8f-48a2-b63d-5eddab0cb80a\") " pod="openshift-multus/multus-additional-cni-plugins-k959w" Apr 21 00:03:29.294209 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.294115 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99mvh\" (UniqueName: \"kubernetes.io/projected/65f5aca2-9fa7-4b19-b02f-0dd809899f41-kube-api-access-99mvh\") pod \"network-metrics-daemon-lr9hq\" (UID: \"65f5aca2-9fa7-4b19-b02f-0dd809899f41\") " pod="openshift-multus/network-metrics-daemon-lr9hq" Apr 21 00:03:29.294561 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.294544 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgqlw\" (UniqueName: \"kubernetes.io/projected/1479bc73-6541-435b-a311-d48731be8d51-kube-api-access-fgqlw\") pod \"ovnkube-node-wmfb9\" (UID: \"1479bc73-6541-435b-a311-d48731be8d51\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" Apr 21 00:03:29.294958 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.294938 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkd94\" (UniqueName: \"kubernetes.io/projected/9bb1c9b4-978f-43ae-ba01-558601306bb0-kube-api-access-lkd94\") pod \"aws-ebs-csi-driver-node-9wn8j\" (UID: \"9bb1c9b4-978f-43ae-ba01-558601306bb0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wn8j" Apr 21 00:03:29.295082 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.295055 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t99nb\" (UniqueName: \"kubernetes.io/projected/3f41362d-51f9-4dde-9796-2752b85d50ee-kube-api-access-t99nb\") pod \"multus-lfxrt\" (UID: \"3f41362d-51f9-4dde-9796-2752b85d50ee\") " pod="openshift-multus/multus-lfxrt" Apr 21 00:03:29.345566 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.345529 2576 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Apr 21 00:03:29.392132 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.392070 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mw27t" Apr 21 00:03:29.398722 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:29.398688 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44cc2f5b_b5d5_4fc4_a690_b4ad1f8bf4c7.slice/crio-8b2c209caf2aee59a6cae13080d8ac47b0c996950021b5f012a64993bdb33d55 WatchSource:0}: Error finding container 8b2c209caf2aee59a6cae13080d8ac47b0c996950021b5f012a64993bdb33d55: Status 404 returned error can't find the container with id 8b2c209caf2aee59a6cae13080d8ac47b0c996950021b5f012a64993bdb33d55 Apr 21 00:03:29.412465 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.412438 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fnp85" Apr 21 00:03:29.421493 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:29.421463 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod705da41f_2875_4893_9f4e_f88eb450d247.slice/crio-8def7b81fd5acab9d1b75fc2e4c465a68a3cf55e4ca5e151fd9b1429a74651dd WatchSource:0}: Error finding container 8def7b81fd5acab9d1b75fc2e4c465a68a3cf55e4ca5e151fd9b1429a74651dd: Status 404 returned error can't find the container with id 8def7b81fd5acab9d1b75fc2e4c465a68a3cf55e4ca5e151fd9b1429a74651dd Apr 21 00:03:29.425910 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.425890 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-twj7c" Apr 21 00:03:29.432187 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:29.432147 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30356905_73c1_4fa1_a700_5d499f482647.slice/crio-31960857e9d7a943f580cd4414f2bc4beb29920c605756e7a77135eec61ff3f6 WatchSource:0}: Error finding container 31960857e9d7a943f580cd4414f2bc4beb29920c605756e7a77135eec61ff3f6: Status 404 returned error can't find the container with id 31960857e9d7a943f580cd4414f2bc4beb29920c605756e7a77135eec61ff3f6 Apr 21 00:03:29.445105 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.445079 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-84h5p" Apr 21 00:03:29.453526 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:29.453499 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod945c8a71_f620_4cdb_89b7_0f17fbd8ab5b.slice/crio-20eefeb8d3dd1e27a9c3c67ca753c5bc5ee9a848afb9b37a0f8df67aad8bb06b WatchSource:0}: Error finding container 20eefeb8d3dd1e27a9c3c67ca753c5bc5ee9a848afb9b37a0f8df67aad8bb06b: Status 404 returned error can't find the container with id 20eefeb8d3dd1e27a9c3c67ca753c5bc5ee9a848afb9b37a0f8df67aad8bb06b Apr 21 00:03:29.464900 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.464877 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-k959w" Apr 21 00:03:29.471398 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:29.471354 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3abd03e7_2e8f_48a2_b63d_5eddab0cb80a.slice/crio-9372c69bf7da16c844aa49cb091ceaec4608b23820c84e965fc83e24e1929889 WatchSource:0}: Error finding container 9372c69bf7da16c844aa49cb091ceaec4608b23820c84e965fc83e24e1929889: Status 404 returned error can't find the container with id 9372c69bf7da16c844aa49cb091ceaec4608b23820c84e965fc83e24e1929889 Apr 21 00:03:29.489979 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.489947 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" Apr 21 00:03:29.496558 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.496531 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fbsp9" Apr 21 00:03:29.497671 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:29.497646 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1479bc73_6541_435b_a311_d48731be8d51.slice/crio-b5a11768d897f9f2a26f89cf06fb5fba36b40185a5e61a96ae4cea3e4b8e4fe4 WatchSource:0}: Error finding container b5a11768d897f9f2a26f89cf06fb5fba36b40185a5e61a96ae4cea3e4b8e4fe4: Status 404 returned error can't find the container with id b5a11768d897f9f2a26f89cf06fb5fba36b40185a5e61a96ae4cea3e4b8e4fe4 Apr 21 00:03:29.502916 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.502883 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wn8j" Apr 21 00:03:29.503085 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:29.503064 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39e13056_9209_4845_838d_9d46aa0dae95.slice/crio-51a2ee9796be4c0b80415318c2f39deeb59b091d5432d56a2102b2f3cb70e7b6 WatchSource:0}: Error finding container 51a2ee9796be4c0b80415318c2f39deeb59b091d5432d56a2102b2f3cb70e7b6: Status 404 returned error can't find the container with id 51a2ee9796be4c0b80415318c2f39deeb59b091d5432d56a2102b2f3cb70e7b6 Apr 21 00:03:29.507453 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.507435 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lfxrt" Apr 21 00:03:29.509780 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:29.509757 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bb1c9b4_978f_43ae_ba01_558601306bb0.slice/crio-efb0d60a31294f329550107961fb59ebefd741f57539e7cc8be118a3842c24de WatchSource:0}: Error finding container efb0d60a31294f329550107961fb59ebefd741f57539e7cc8be118a3842c24de: Status 404 returned error can't find the container with id efb0d60a31294f329550107961fb59ebefd741f57539e7cc8be118a3842c24de Apr 21 00:03:29.514690 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:03:29.514661 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f41362d_51f9_4dde_9796_2752b85d50ee.slice/crio-d346730782d4c0c48a5b0e4a83d89529e6b3440fa0ec2d8e89a960ade5c1368c WatchSource:0}: Error finding container d346730782d4c0c48a5b0e4a83d89529e6b3440fa0ec2d8e89a960ade5c1368c: Status 404 returned error can't find the container with id d346730782d4c0c48a5b0e4a83d89529e6b3440fa0ec2d8e89a960ade5c1368c Apr 21 00:03:29.615987 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.615902 2576 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Apr 21 00:03:29.772832 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.772794 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65f5aca2-9fa7-4b19-b02f-0dd809899f41-metrics-certs\") pod \"network-metrics-daemon-lr9hq\" (UID: \"65f5aca2-9fa7-4b19-b02f-0dd809899f41\") " pod="openshift-multus/network-metrics-daemon-lr9hq" Apr 21 00:03:29.773020 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:29.772998 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Apr 21 00:03:29.773081 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:29.773060 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65f5aca2-9fa7-4b19-b02f-0dd809899f41-metrics-certs podName:65f5aca2-9fa7-4b19-b02f-0dd809899f41 nodeName:}" failed. No retries permitted until 2026-04-21 00:03:30.773040456 +0000 UTC m=+3.208378664 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65f5aca2-9fa7-4b19-b02f-0dd809899f41-metrics-certs") pod "network-metrics-daemon-lr9hq" (UID: "65f5aca2-9fa7-4b19-b02f-0dd809899f41") : object "openshift-multus"/"metrics-daemon-secret" not registered Apr 21 00:03:29.874135 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:29.874057 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4qbl8\" (UniqueName: \"kubernetes.io/projected/526918a6-6456-4ee9-b13d-ca26cfea5695-kube-api-access-4qbl8\") pod \"network-check-target-d5vdn\" (UID: \"526918a6-6456-4ee9-b13d-ca26cfea5695\") " pod="openshift-network-diagnostics/network-check-target-d5vdn" Apr 21 00:03:29.874382 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:29.874256 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Apr 21 00:03:29.874382 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:29.874277 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Apr 21 00:03:29.874382 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:29.874288 2576 projected.go:194] Error preparing data for projected volume kube-api-access-4qbl8 for pod openshift-network-diagnostics/network-check-target-d5vdn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 21 00:03:29.874382 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:29.874347 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/526918a6-6456-4ee9-b13d-ca26cfea5695-kube-api-access-4qbl8 podName:526918a6-6456-4ee9-b13d-ca26cfea5695 nodeName:}" failed. No retries permitted until 2026-04-21 00:03:30.874332128 +0000 UTC m=+3.309670329 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-4qbl8" (UniqueName: "kubernetes.io/projected/526918a6-6456-4ee9-b13d-ca26cfea5695-kube-api-access-4qbl8") pod "network-check-target-d5vdn" (UID: "526918a6-6456-4ee9-b13d-ca26cfea5695") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 21 00:03:30.101768 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:30.101718 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-04-19 23:58:29 +0000 UTC" deadline="2027-11-16 16:23:21.620453705 +0000 UTC" Apr 21 00:03:30.101768 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:30.101764 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13792h19m51.518692913s" Apr 21 00:03:30.206432 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:30.206327 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d5vdn" Apr 21 00:03:30.206602 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:30.206485 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d5vdn" podUID="526918a6-6456-4ee9-b13d-ca26cfea5695" Apr 21 00:03:30.239672 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:30.239581 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lfxrt" event={"ID":"3f41362d-51f9-4dde-9796-2752b85d50ee","Type":"ContainerStarted","Data":"d346730782d4c0c48a5b0e4a83d89529e6b3440fa0ec2d8e89a960ade5c1368c"} Apr 21 00:03:30.244517 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:30.244486 2576 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Apr 21 00:03:30.245807 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:30.245695 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wn8j" event={"ID":"9bb1c9b4-978f-43ae-ba01-558601306bb0","Type":"ContainerStarted","Data":"efb0d60a31294f329550107961fb59ebefd741f57539e7cc8be118a3842c24de"} Apr 21 00:03:30.251335 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:30.251298 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" event={"ID":"1479bc73-6541-435b-a311-d48731be8d51","Type":"ContainerStarted","Data":"b5a11768d897f9f2a26f89cf06fb5fba36b40185a5e61a96ae4cea3e4b8e4fe4"} Apr 21 00:03:30.291785 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:30.291733 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-84h5p" event={"ID":"945c8a71-f620-4cdb-89b7-0f17fbd8ab5b","Type":"ContainerStarted","Data":"20eefeb8d3dd1e27a9c3c67ca753c5bc5ee9a848afb9b37a0f8df67aad8bb06b"} Apr 21 00:03:30.320230 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:30.320023 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-twj7c" event={"ID":"30356905-73c1-4fa1-a700-5d499f482647","Type":"ContainerStarted","Data":"31960857e9d7a943f580cd4414f2bc4beb29920c605756e7a77135eec61ff3f6"} Apr 21 00:03:30.353061 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:30.352664 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fnp85" event={"ID":"705da41f-2875-4893-9f4e-f88eb450d247","Type":"ContainerStarted","Data":"8def7b81fd5acab9d1b75fc2e4c465a68a3cf55e4ca5e151fd9b1429a74651dd"} Apr 21 00:03:30.370627 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:30.370586 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fbsp9" event={"ID":"39e13056-9209-4845-838d-9d46aa0dae95","Type":"ContainerStarted","Data":"51a2ee9796be4c0b80415318c2f39deeb59b091d5432d56a2102b2f3cb70e7b6"} Apr 21 00:03:30.397439 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:30.397167 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k959w" event={"ID":"3abd03e7-2e8f-48a2-b63d-5eddab0cb80a","Type":"ContainerStarted","Data":"9372c69bf7da16c844aa49cb091ceaec4608b23820c84e965fc83e24e1929889"} Apr 21 00:03:30.408442 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:30.406540 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mw27t" event={"ID":"44cc2f5b-b5d5-4fc4-a690-b4ad1f8bf4c7","Type":"ContainerStarted","Data":"8b2c209caf2aee59a6cae13080d8ac47b0c996950021b5f012a64993bdb33d55"} Apr 21 00:03:30.782201 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:30.782136 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65f5aca2-9fa7-4b19-b02f-0dd809899f41-metrics-certs\") pod \"network-metrics-daemon-lr9hq\" (UID: \"65f5aca2-9fa7-4b19-b02f-0dd809899f41\") " pod="openshift-multus/network-metrics-daemon-lr9hq" Apr 21 00:03:30.782434 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:30.782307 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Apr 21 00:03:30.782434 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:30.782395 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65f5aca2-9fa7-4b19-b02f-0dd809899f41-metrics-certs podName:65f5aca2-9fa7-4b19-b02f-0dd809899f41 nodeName:}" failed. No retries permitted until 2026-04-21 00:03:32.782374767 +0000 UTC m=+5.217712983 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65f5aca2-9fa7-4b19-b02f-0dd809899f41-metrics-certs") pod "network-metrics-daemon-lr9hq" (UID: "65f5aca2-9fa7-4b19-b02f-0dd809899f41") : object "openshift-multus"/"metrics-daemon-secret" not registered Apr 21 00:03:30.882917 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:30.882876 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4qbl8\" (UniqueName: \"kubernetes.io/projected/526918a6-6456-4ee9-b13d-ca26cfea5695-kube-api-access-4qbl8\") pod \"network-check-target-d5vdn\" (UID: \"526918a6-6456-4ee9-b13d-ca26cfea5695\") " pod="openshift-network-diagnostics/network-check-target-d5vdn" Apr 21 00:03:30.883086 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:30.883041 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Apr 21 00:03:30.883086 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:30.883059 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Apr 21 00:03:30.883086 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:30.883071 2576 projected.go:194] Error preparing data for projected volume kube-api-access-4qbl8 for pod openshift-network-diagnostics/network-check-target-d5vdn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 21 00:03:30.883320 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:30.883145 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/526918a6-6456-4ee9-b13d-ca26cfea5695-kube-api-access-4qbl8 podName:526918a6-6456-4ee9-b13d-ca26cfea5695 nodeName:}" failed. No retries permitted until 2026-04-21 00:03:32.883114556 +0000 UTC m=+5.318452782 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-4qbl8" (UniqueName: "kubernetes.io/projected/526918a6-6456-4ee9-b13d-ca26cfea5695-kube-api-access-4qbl8") pod "network-check-target-d5vdn" (UID: "526918a6-6456-4ee9-b13d-ca26cfea5695") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 21 00:03:31.102732 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:31.102632 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-04-19 23:58:29 +0000 UTC" deadline="2027-10-07 10:19:44.318725642 +0000 UTC" Apr 21 00:03:31.102732 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:31.102677 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12826h16m13.216053879s" Apr 21 00:03:31.205388 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:31.205299 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lr9hq" Apr 21 00:03:31.205548 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:31.205483 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lr9hq" podUID="65f5aca2-9fa7-4b19-b02f-0dd809899f41" Apr 21 00:03:31.278699 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:31.278664 2576 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Apr 21 00:03:32.206790 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:32.206497 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d5vdn" Apr 21 00:03:32.207229 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:32.206861 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d5vdn" podUID="526918a6-6456-4ee9-b13d-ca26cfea5695" Apr 21 00:03:32.801381 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:32.801277 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65f5aca2-9fa7-4b19-b02f-0dd809899f41-metrics-certs\") pod \"network-metrics-daemon-lr9hq\" (UID: \"65f5aca2-9fa7-4b19-b02f-0dd809899f41\") " pod="openshift-multus/network-metrics-daemon-lr9hq" Apr 21 00:03:32.801562 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:32.801449 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Apr 21 00:03:32.801562 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:32.801519 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65f5aca2-9fa7-4b19-b02f-0dd809899f41-metrics-certs podName:65f5aca2-9fa7-4b19-b02f-0dd809899f41 nodeName:}" failed. No retries permitted until 2026-04-21 00:03:36.801500073 +0000 UTC m=+9.236838307 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65f5aca2-9fa7-4b19-b02f-0dd809899f41-metrics-certs") pod "network-metrics-daemon-lr9hq" (UID: "65f5aca2-9fa7-4b19-b02f-0dd809899f41") : object "openshift-multus"/"metrics-daemon-secret" not registered Apr 21 00:03:32.902571 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:32.902523 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4qbl8\" (UniqueName: \"kubernetes.io/projected/526918a6-6456-4ee9-b13d-ca26cfea5695-kube-api-access-4qbl8\") pod \"network-check-target-d5vdn\" (UID: \"526918a6-6456-4ee9-b13d-ca26cfea5695\") " pod="openshift-network-diagnostics/network-check-target-d5vdn" Apr 21 00:03:32.902745 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:32.902722 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Apr 21 00:03:32.902821 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:32.902752 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Apr 21 00:03:32.902821 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:32.902767 2576 projected.go:194] Error preparing data for projected volume kube-api-access-4qbl8 for pod openshift-network-diagnostics/network-check-target-d5vdn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 21 00:03:32.902933 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:32.902836 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/526918a6-6456-4ee9-b13d-ca26cfea5695-kube-api-access-4qbl8 podName:526918a6-6456-4ee9-b13d-ca26cfea5695 nodeName:}" failed. No retries permitted until 2026-04-21 00:03:36.902817664 +0000 UTC m=+9.338155870 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4qbl8" (UniqueName: "kubernetes.io/projected/526918a6-6456-4ee9-b13d-ca26cfea5695-kube-api-access-4qbl8") pod "network-check-target-d5vdn" (UID: "526918a6-6456-4ee9-b13d-ca26cfea5695") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 21 00:03:33.205215 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:33.205116 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lr9hq" Apr 21 00:03:33.205440 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:33.205256 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lr9hq" podUID="65f5aca2-9fa7-4b19-b02f-0dd809899f41" Apr 21 00:03:34.205532 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:34.205491 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d5vdn" Apr 21 00:03:34.205911 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:34.205622 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d5vdn" podUID="526918a6-6456-4ee9-b13d-ca26cfea5695" Apr 21 00:03:35.205239 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:35.205196 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lr9hq" Apr 21 00:03:35.205452 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:35.205375 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lr9hq" podUID="65f5aca2-9fa7-4b19-b02f-0dd809899f41" Apr 21 00:03:36.206568 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:36.206531 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d5vdn" Apr 21 00:03:36.207035 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:36.206643 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d5vdn" podUID="526918a6-6456-4ee9-b13d-ca26cfea5695" Apr 21 00:03:36.835805 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:36.835766 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65f5aca2-9fa7-4b19-b02f-0dd809899f41-metrics-certs\") pod \"network-metrics-daemon-lr9hq\" (UID: \"65f5aca2-9fa7-4b19-b02f-0dd809899f41\") " pod="openshift-multus/network-metrics-daemon-lr9hq" Apr 21 00:03:36.835981 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:36.835947 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Apr 21 00:03:36.836095 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:36.836082 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65f5aca2-9fa7-4b19-b02f-0dd809899f41-metrics-certs podName:65f5aca2-9fa7-4b19-b02f-0dd809899f41 nodeName:}" failed. No retries permitted until 2026-04-21 00:03:44.835994693 +0000 UTC m=+17.271332906 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65f5aca2-9fa7-4b19-b02f-0dd809899f41-metrics-certs") pod "network-metrics-daemon-lr9hq" (UID: "65f5aca2-9fa7-4b19-b02f-0dd809899f41") : object "openshift-multus"/"metrics-daemon-secret" not registered Apr 21 00:03:36.936408 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:36.936349 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4qbl8\" (UniqueName: \"kubernetes.io/projected/526918a6-6456-4ee9-b13d-ca26cfea5695-kube-api-access-4qbl8\") pod \"network-check-target-d5vdn\" (UID: \"526918a6-6456-4ee9-b13d-ca26cfea5695\") " pod="openshift-network-diagnostics/network-check-target-d5vdn" Apr 21 00:03:36.936596 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:36.936577 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Apr 21 00:03:36.936649 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:36.936602 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Apr 21 00:03:36.936649 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:36.936611 2576 projected.go:194] Error preparing data for projected volume kube-api-access-4qbl8 for pod openshift-network-diagnostics/network-check-target-d5vdn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 21 00:03:36.936714 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:36.936668 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/526918a6-6456-4ee9-b13d-ca26cfea5695-kube-api-access-4qbl8 podName:526918a6-6456-4ee9-b13d-ca26cfea5695 nodeName:}" failed. No retries permitted until 2026-04-21 00:03:44.936648659 +0000 UTC m=+17.371986867 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-4qbl8" (UniqueName: "kubernetes.io/projected/526918a6-6456-4ee9-b13d-ca26cfea5695-kube-api-access-4qbl8") pod "network-check-target-d5vdn" (UID: "526918a6-6456-4ee9-b13d-ca26cfea5695") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 21 00:03:37.205086 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:37.204964 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lr9hq" Apr 21 00:03:37.205245 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:37.205115 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lr9hq" podUID="65f5aca2-9fa7-4b19-b02f-0dd809899f41" Apr 21 00:03:38.206810 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:38.206640 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d5vdn" Apr 21 00:03:38.206810 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:38.206762 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d5vdn" podUID="526918a6-6456-4ee9-b13d-ca26cfea5695" Apr 21 00:03:39.205072 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:39.205038 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lr9hq" Apr 21 00:03:39.205244 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:39.205168 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lr9hq" podUID="65f5aca2-9fa7-4b19-b02f-0dd809899f41" Apr 21 00:03:40.205515 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:40.205473 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d5vdn" Apr 21 00:03:40.205931 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:40.205624 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d5vdn" podUID="526918a6-6456-4ee9-b13d-ca26cfea5695" Apr 21 00:03:41.205094 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:41.205056 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lr9hq" Apr 21 00:03:41.205284 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:41.205187 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lr9hq" podUID="65f5aca2-9fa7-4b19-b02f-0dd809899f41" Apr 21 00:03:42.205226 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:42.205185 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d5vdn" Apr 21 00:03:42.205673 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:42.205331 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d5vdn" podUID="526918a6-6456-4ee9-b13d-ca26cfea5695" Apr 21 00:03:43.205453 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:43.205415 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lr9hq" Apr 21 00:03:43.205894 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:43.205560 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lr9hq" podUID="65f5aca2-9fa7-4b19-b02f-0dd809899f41" Apr 21 00:03:44.205404 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:44.205355 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d5vdn" Apr 21 00:03:44.205606 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:44.205539 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d5vdn" podUID="526918a6-6456-4ee9-b13d-ca26cfea5695" Apr 21 00:03:44.892060 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:44.892013 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65f5aca2-9fa7-4b19-b02f-0dd809899f41-metrics-certs\") pod \"network-metrics-daemon-lr9hq\" (UID: \"65f5aca2-9fa7-4b19-b02f-0dd809899f41\") " pod="openshift-multus/network-metrics-daemon-lr9hq" Apr 21 00:03:44.892296 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:44.892187 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Apr 21 00:03:44.892296 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:44.892284 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65f5aca2-9fa7-4b19-b02f-0dd809899f41-metrics-certs podName:65f5aca2-9fa7-4b19-b02f-0dd809899f41 nodeName:}" failed. No retries permitted until 2026-04-21 00:04:00.892265341 +0000 UTC m=+33.327603552 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65f5aca2-9fa7-4b19-b02f-0dd809899f41-metrics-certs") pod "network-metrics-daemon-lr9hq" (UID: "65f5aca2-9fa7-4b19-b02f-0dd809899f41") : object "openshift-multus"/"metrics-daemon-secret" not registered Apr 21 00:03:44.993295 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:44.993250 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4qbl8\" (UniqueName: \"kubernetes.io/projected/526918a6-6456-4ee9-b13d-ca26cfea5695-kube-api-access-4qbl8\") pod \"network-check-target-d5vdn\" (UID: \"526918a6-6456-4ee9-b13d-ca26cfea5695\") " pod="openshift-network-diagnostics/network-check-target-d5vdn" Apr 21 00:03:44.993488 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:44.993444 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Apr 21 00:03:44.993488 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:44.993472 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Apr 21 00:03:44.993488 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:44.993488 2576 projected.go:194] Error preparing data for projected volume kube-api-access-4qbl8 for pod openshift-network-diagnostics/network-check-target-d5vdn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 21 00:03:44.993632 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:44.993548 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/526918a6-6456-4ee9-b13d-ca26cfea5695-kube-api-access-4qbl8 podName:526918a6-6456-4ee9-b13d-ca26cfea5695 nodeName:}" failed. No retries permitted until 2026-04-21 00:04:00.99353321 +0000 UTC m=+33.428871418 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-4qbl8" (UniqueName: "kubernetes.io/projected/526918a6-6456-4ee9-b13d-ca26cfea5695-kube-api-access-4qbl8") pod "network-check-target-d5vdn" (UID: "526918a6-6456-4ee9-b13d-ca26cfea5695") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 21 00:03:45.205804 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:45.205712 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lr9hq" Apr 21 00:03:45.206221 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:45.205861 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lr9hq" podUID="65f5aca2-9fa7-4b19-b02f-0dd809899f41" Apr 21 00:03:46.205449 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:46.205408 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d5vdn" Apr 21 00:03:46.205665 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:46.205519 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d5vdn" podUID="526918a6-6456-4ee9-b13d-ca26cfea5695" Apr 21 00:03:47.205927 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:47.205892 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lr9hq" Apr 21 00:03:47.206379 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:47.206045 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lr9hq" podUID="65f5aca2-9fa7-4b19-b02f-0dd809899f41" Apr 21 00:03:48.205900 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:48.205872 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d5vdn" Apr 21 00:03:48.206031 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:48.205953 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d5vdn" podUID="526918a6-6456-4ee9-b13d-ca26cfea5695" Apr 21 00:03:48.456331 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:48.456154 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-1.ec2.internal" event={"ID":"893ed304dbbaa7472e9062bd86be8331","Type":"ContainerStarted","Data":"d393d319c7c7cfdd39483febe5b6d72e47f35b11a4693724e7068c5aef329fc4"} Apr 21 00:03:48.457609 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:48.457578 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lfxrt" event={"ID":"3f41362d-51f9-4dde-9796-2752b85d50ee","Type":"ContainerStarted","Data":"a14b8b8cf725fe846cc66178ff2220a90faa92ecd4a05b1d46c90faae868a222"} Apr 21 00:03:48.459780 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:48.459658 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" event={"ID":"1479bc73-6541-435b-a311-d48731be8d51","Type":"ContainerStarted","Data":"03527a7c7e5677b127f92c58c1a6ceb7be130c589606275ad8d7aac4bdf0377c"} Apr 21 00:03:48.459780 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:48.459684 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" event={"ID":"1479bc73-6541-435b-a311-d48731be8d51","Type":"ContainerStarted","Data":"48ebe1deac3baec383833f8945044c2dead7e5af1c1290bfce1da8f18592dfa0"} Apr 21 00:03:48.459780 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:48.459697 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" event={"ID":"1479bc73-6541-435b-a311-d48731be8d51","Type":"ContainerStarted","Data":"f2903adf923e1eaf42fc061a9199640ae3feb96e9adfdef49e082b79e6969c40"} Apr 21 00:03:48.470246 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:48.470160 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-1.ec2.internal" podStartSLOduration=20.470144795 podStartE2EDuration="20.470144795s" podCreationTimestamp="2026-04-21 00:03:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-21 00:03:48.469634952 +0000 UTC m=+20.904973177" watchObservedRunningTime="2026-04-21 00:03:48.470144795 +0000 UTC m=+20.905483018" Apr 21 00:03:48.478080 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:48.476520 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fnp85" event={"ID":"705da41f-2875-4893-9f4e-f88eb450d247","Type":"ContainerStarted","Data":"e927cc51f75a8025ee5798bc28af0b44116076113e5e4a3795a8fafe1c5ca08b"} Apr 21 00:03:48.486051 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:48.485981 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-lfxrt" podStartSLOduration=1.8165722739999999 podStartE2EDuration="20.485959499s" podCreationTimestamp="2026-04-21 00:03:28 +0000 UTC" firstStartedPulling="2026-04-21 00:03:29.516124599 +0000 UTC m=+1.951462802" lastFinishedPulling="2026-04-21 00:03:48.185511822 +0000 UTC m=+20.620850027" observedRunningTime="2026-04-21 00:03:48.485255759 +0000 UTC m=+20.920593997" watchObservedRunningTime="2026-04-21 00:03:48.485959499 +0000 UTC m=+20.921297728" Apr 21 00:03:48.502604 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:48.502498 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-fnp85" podStartSLOduration=2.111317105 podStartE2EDuration="20.502476832s" podCreationTimestamp="2026-04-21 00:03:28 +0000 UTC" firstStartedPulling="2026-04-21 00:03:29.42349374 +0000 UTC m=+1.858831942" lastFinishedPulling="2026-04-21 00:03:47.814653467 +0000 UTC m=+20.249991669" observedRunningTime="2026-04-21 00:03:48.501613714 +0000 UTC m=+20.936951938" watchObservedRunningTime="2026-04-21 00:03:48.502476832 +0000 UTC m=+20.937815057" Apr 21 00:03:49.205526 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:49.205337 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lr9hq" Apr 21 00:03:49.205685 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:49.205607 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lr9hq" podUID="65f5aca2-9fa7-4b19-b02f-0dd809899f41" Apr 21 00:03:49.480085 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:49.479984 2576 generic.go:358] "Generic (PLEG): container finished" podID="7803e06bf1575842c2662501b98b3432" containerID="daa0a97c0ce3b40262e86549ebdd6e15f0a48e53c6de7dc0ae98e30ff26b0eb0" exitCode=0 Apr 21 00:03:49.480085 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:49.480030 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-1.ec2.internal" event={"ID":"7803e06bf1575842c2662501b98b3432","Type":"ContainerDied","Data":"daa0a97c0ce3b40262e86549ebdd6e15f0a48e53c6de7dc0ae98e30ff26b0eb0"} Apr 21 00:03:49.481384 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:49.481338 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fbsp9" event={"ID":"39e13056-9209-4845-838d-9d46aa0dae95","Type":"ContainerStarted","Data":"ebd07d21d2679003c65cd3cfb77f54d88ffdd383d3828fca457f4cfffffa9db3"} Apr 21 00:03:49.482474 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:49.482450 2576 generic.go:358] "Generic (PLEG): container finished" podID="3abd03e7-2e8f-48a2-b63d-5eddab0cb80a" containerID="fff1e67c556f59049432dc93ebe271365086f79a8dd05c4d235ca644e66d17cd" exitCode=0 Apr 21 00:03:49.482585 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:49.482505 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k959w" event={"ID":"3abd03e7-2e8f-48a2-b63d-5eddab0cb80a","Type":"ContainerDied","Data":"fff1e67c556f59049432dc93ebe271365086f79a8dd05c4d235ca644e66d17cd"} Apr 21 00:03:49.483838 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:49.483779 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mw27t" event={"ID":"44cc2f5b-b5d5-4fc4-a690-b4ad1f8bf4c7","Type":"ContainerStarted","Data":"12f806f73af2be7e6b47e936ca9b060009279103b34e7dbbdccab46e6a752759"} Apr 21 00:03:49.486786 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:49.485687 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wn8j" event={"ID":"9bb1c9b4-978f-43ae-ba01-558601306bb0","Type":"ContainerStarted","Data":"a942593aa5a8f5255a2f4460b7b84db69d4ce87baadef609b61422badd52cafb"} Apr 21 00:03:49.489131 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:49.489101 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" event={"ID":"1479bc73-6541-435b-a311-d48731be8d51","Type":"ContainerStarted","Data":"aacf7fd0ca40961f04aa7ee8447abd0f56e19964deaeb829fa06208c6384c9c0"} Apr 21 00:03:49.489223 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:49.489136 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" event={"ID":"1479bc73-6541-435b-a311-d48731be8d51","Type":"ContainerStarted","Data":"c80f492d44417a6044f7b2811f56c8fe90776ca295404919fb7ca40fd3ba8090"} Apr 21 00:03:49.489223 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:49.489150 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" event={"ID":"1479bc73-6541-435b-a311-d48731be8d51","Type":"ContainerStarted","Data":"c44e71b8be7791dbe73fb6e8e37cf4c2c45aa37c625e37509cb3811cba7fbdbb"} Apr 21 00:03:49.490340 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:49.490307 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-84h5p" event={"ID":"945c8a71-f620-4cdb-89b7-0f17fbd8ab5b","Type":"ContainerStarted","Data":"81b2eb33f5bbbad6dd101b3fe4f6b982e90ff79df09b625d4d04332ac19dcd3f"} Apr 21 00:03:49.491780 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:49.491754 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-twj7c" event={"ID":"30356905-73c1-4fa1-a700-5d499f482647","Type":"ContainerStarted","Data":"53c20bd01c7a15690bfdae53d1730749afa4a6e479d8398840b40b2b8ab3bd1b"} Apr 21 00:03:49.510610 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:49.510556 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-mw27t" podStartSLOduration=3.127976199 podStartE2EDuration="21.510537854s" podCreationTimestamp="2026-04-21 00:03:28 +0000 UTC" firstStartedPulling="2026-04-21 00:03:29.40072379 +0000 UTC m=+1.836061991" lastFinishedPulling="2026-04-21 00:03:47.783285438 +0000 UTC m=+20.218623646" observedRunningTime="2026-04-21 00:03:49.510251957 +0000 UTC m=+21.945590181" watchObservedRunningTime="2026-04-21 00:03:49.510537854 +0000 UTC m=+21.945876082" Apr 21 00:03:49.523114 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:49.523068 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-twj7c" podStartSLOduration=3.137371061 podStartE2EDuration="21.523051165s" podCreationTimestamp="2026-04-21 00:03:28 +0000 UTC" firstStartedPulling="2026-04-21 00:03:29.433856672 +0000 UTC m=+1.869194874" lastFinishedPulling="2026-04-21 00:03:47.819536762 +0000 UTC m=+20.254874978" observedRunningTime="2026-04-21 00:03:49.522989127 +0000 UTC m=+21.958327352" watchObservedRunningTime="2026-04-21 00:03:49.523051165 +0000 UTC m=+21.958389388" Apr 21 00:03:49.536511 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:49.536446 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-84h5p" podStartSLOduration=3.208313093 podStartE2EDuration="21.536427201s" podCreationTimestamp="2026-04-21 00:03:28 +0000 UTC" firstStartedPulling="2026-04-21 00:03:29.455142268 +0000 UTC m=+1.890480470" lastFinishedPulling="2026-04-21 00:03:47.783256363 +0000 UTC m=+20.218594578" observedRunningTime="2026-04-21 00:03:49.535776126 +0000 UTC m=+21.971114353" watchObservedRunningTime="2026-04-21 00:03:49.536427201 +0000 UTC m=+21.971765426" Apr 21 00:03:49.569393 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:49.569323 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-fbsp9" podStartSLOduration=3.291938519 podStartE2EDuration="21.569301987s" podCreationTimestamp="2026-04-21 00:03:28 +0000 UTC" firstStartedPulling="2026-04-21 00:03:29.505864357 +0000 UTC m=+1.941202558" lastFinishedPulling="2026-04-21 00:03:47.783227817 +0000 UTC m=+20.218566026" observedRunningTime="2026-04-21 00:03:49.568884421 +0000 UTC m=+22.004222649" watchObservedRunningTime="2026-04-21 00:03:49.569301987 +0000 UTC m=+22.004640211" Apr 21 00:03:49.920333 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:49.920311 2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Apr 21 00:03:50.136304 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:50.136182 2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-04-21T00:03:49.920328475Z","UUID":"fb244ca2-8435-4e69-9eca-6b630c2e31e7","Handler":null,"Name":"","Endpoint":""} Apr 21 00:03:50.138512 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:50.138486 2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Apr 21 00:03:50.138512 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:50.138516 2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Apr 21 00:03:50.205528 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:50.205489 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d5vdn" Apr 21 00:03:50.205710 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:50.205618 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d5vdn" podUID="526918a6-6456-4ee9-b13d-ca26cfea5695" Apr 21 00:03:50.351933 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:50.351897 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-twj7c_30356905-73c1-4fa1-a700-5d499f482647/dns-node-resolver/0.log" Apr 21 00:03:50.495891 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:50.495786 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wn8j" event={"ID":"9bb1c9b4-978f-43ae-ba01-558601306bb0","Type":"ContainerStarted","Data":"a71a0b235c3b99e5d1adee3383685520b0670a0c5e00df0ea9fe49f98d96644d"} Apr 21 00:03:50.497896 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:50.497848 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-1.ec2.internal" event={"ID":"7803e06bf1575842c2662501b98b3432","Type":"ContainerStarted","Data":"635d26899f3eb2d104d1f9c6431176d097e95045d9e6a2e5ceb4dc2d15c7d350"} Apr 21 00:03:51.205888 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:51.205852 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lr9hq" Apr 21 00:03:51.206070 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:51.205968 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lr9hq" podUID="65f5aca2-9fa7-4b19-b02f-0dd809899f41" Apr 21 00:03:51.335228 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:51.335200 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-84h5p_945c8a71-f620-4cdb-89b7-0f17fbd8ab5b/node-ca/0.log" Apr 21 00:03:51.501116 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:51.501020 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wn8j" event={"ID":"9bb1c9b4-978f-43ae-ba01-558601306bb0","Type":"ContainerStarted","Data":"c34d45a5cff1c74443f94a274540d51a87ad6ad35a254be9af6fec447638e6e2"} Apr 21 00:03:51.504424 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:51.504394 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" event={"ID":"1479bc73-6541-435b-a311-d48731be8d51","Type":"ContainerStarted","Data":"972f9b7631c12a246f4f82075811c0a15a2d467ba292ebdbc24651af773d022f"} Apr 21 00:03:51.517592 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:51.517534 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wn8j" podStartSLOduration=1.8093555220000002 podStartE2EDuration="23.517519445s" podCreationTimestamp="2026-04-21 00:03:28 +0000 UTC" firstStartedPulling="2026-04-21 00:03:29.511556362 +0000 UTC m=+1.946894567" lastFinishedPulling="2026-04-21 00:03:51.21972027 +0000 UTC m=+23.655058490" observedRunningTime="2026-04-21 00:03:51.516983823 +0000 UTC m=+23.952322044" watchObservedRunningTime="2026-04-21 00:03:51.517519445 +0000 UTC m=+23.952857669" Apr 21 00:03:51.517755 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:51.517648 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-1.ec2.internal" podStartSLOduration=23.517641832 podStartE2EDuration="23.517641832s" podCreationTimestamp="2026-04-21 00:03:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-21 00:03:50.513988955 +0000 UTC m=+22.949327181" watchObservedRunningTime="2026-04-21 00:03:51.517641832 +0000 UTC m=+23.952980055" Apr 21 00:03:52.205092 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:52.205054 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d5vdn" Apr 21 00:03:52.205277 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:52.205190 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d5vdn" podUID="526918a6-6456-4ee9-b13d-ca26cfea5695" Apr 21 00:03:53.205505 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:53.205464 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lr9hq" Apr 21 00:03:53.205992 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:53.205624 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lr9hq" podUID="65f5aca2-9fa7-4b19-b02f-0dd809899f41" Apr 21 00:03:53.645502 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:53.645466 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-fbsp9" Apr 21 00:03:53.646227 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:53.646200 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-fbsp9" Apr 21 00:03:54.206156 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:54.205988 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d5vdn" Apr 21 00:03:54.206672 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:54.206236 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d5vdn" podUID="526918a6-6456-4ee9-b13d-ca26cfea5695" Apr 21 00:03:54.515226 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:54.515192 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" event={"ID":"1479bc73-6541-435b-a311-d48731be8d51","Type":"ContainerStarted","Data":"6a52d854b27dd85f7c8678a72580907cd2393d370479a7ecdf90b16f0de0d787"} Apr 21 00:03:54.515726 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:54.515521 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-fbsp9" Apr 21 00:03:54.515903 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:54.515886 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-fbsp9" Apr 21 00:03:54.543924 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:54.543879 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" podStartSLOduration=7.862459548 podStartE2EDuration="26.54386332s" podCreationTimestamp="2026-04-21 00:03:28 +0000 UTC" firstStartedPulling="2026-04-21 00:03:29.499543139 +0000 UTC m=+1.934881343" lastFinishedPulling="2026-04-21 00:03:48.180946899 +0000 UTC m=+20.616285115" observedRunningTime="2026-04-21 00:03:54.543589556 +0000 UTC m=+26.978927780" watchObservedRunningTime="2026-04-21 00:03:54.54386332 +0000 UTC m=+26.979201543" Apr 21 00:03:55.205705 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:55.205671 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lr9hq" Apr 21 00:03:55.205857 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:55.205774 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lr9hq" podUID="65f5aca2-9fa7-4b19-b02f-0dd809899f41" Apr 21 00:03:55.518290 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:55.518213 2576 generic.go:358] "Generic (PLEG): container finished" podID="3abd03e7-2e8f-48a2-b63d-5eddab0cb80a" containerID="87cad094354fc8af3e5cc03636a2c436b73be356456f3757c709b522644b88c9" exitCode=0 Apr 21 00:03:55.518902 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:55.518297 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k959w" event={"ID":"3abd03e7-2e8f-48a2-b63d-5eddab0cb80a","Type":"ContainerDied","Data":"87cad094354fc8af3e5cc03636a2c436b73be356456f3757c709b522644b88c9"} Apr 21 00:03:55.518902 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:55.518798 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" Apr 21 00:03:55.518902 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:55.518839 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" Apr 21 00:03:55.518902 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:55.518853 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" Apr 21 00:03:55.534400 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:55.534354 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" Apr 21 00:03:55.534523 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:55.534452 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" Apr 21 00:03:56.205622 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:56.205581 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d5vdn" Apr 21 00:03:56.205798 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:56.205691 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d5vdn" podUID="526918a6-6456-4ee9-b13d-ca26cfea5695" Apr 21 00:03:57.205317 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:57.205154 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lr9hq" Apr 21 00:03:57.205773 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:57.205419 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lr9hq" podUID="65f5aca2-9fa7-4b19-b02f-0dd809899f41" Apr 21 00:03:57.522948 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:57.522854 2576 generic.go:358] "Generic (PLEG): container finished" podID="3abd03e7-2e8f-48a2-b63d-5eddab0cb80a" containerID="328312d4c1fa1884c70df18ae3a3ee6a0c0658a53e8f5470f2b74bcd3e4b6919" exitCode=0 Apr 21 00:03:57.523100 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:57.522947 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k959w" event={"ID":"3abd03e7-2e8f-48a2-b63d-5eddab0cb80a","Type":"ContainerDied","Data":"328312d4c1fa1884c70df18ae3a3ee6a0c0658a53e8f5470f2b74bcd3e4b6919"} Apr 21 00:03:58.206104 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:58.206067 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d5vdn" Apr 21 00:03:58.206508 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:58.206158 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d5vdn" podUID="526918a6-6456-4ee9-b13d-ca26cfea5695" Apr 21 00:03:59.205052 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:59.205016 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lr9hq" Apr 21 00:03:59.205234 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:03:59.205130 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lr9hq" podUID="65f5aca2-9fa7-4b19-b02f-0dd809899f41" Apr 21 00:03:59.528090 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:59.528007 2576 generic.go:358] "Generic (PLEG): container finished" podID="3abd03e7-2e8f-48a2-b63d-5eddab0cb80a" containerID="72480f7f6140ec1d4c00a833e037900e28776351db9bebc95587ada219030506" exitCode=0 Apr 21 00:03:59.528090 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:03:59.528068 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k959w" event={"ID":"3abd03e7-2e8f-48a2-b63d-5eddab0cb80a","Type":"ContainerDied","Data":"72480f7f6140ec1d4c00a833e037900e28776351db9bebc95587ada219030506"} Apr 21 00:04:00.205892 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:00.205860 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d5vdn" Apr 21 00:04:00.206066 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:04:00.205988 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d5vdn" podUID="526918a6-6456-4ee9-b13d-ca26cfea5695" Apr 21 00:04:00.913985 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:00.913945 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65f5aca2-9fa7-4b19-b02f-0dd809899f41-metrics-certs\") pod \"network-metrics-daemon-lr9hq\" (UID: \"65f5aca2-9fa7-4b19-b02f-0dd809899f41\") " pod="openshift-multus/network-metrics-daemon-lr9hq" Apr 21 00:04:00.914500 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:04:00.914105 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Apr 21 00:04:00.914500 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:04:00.914172 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65f5aca2-9fa7-4b19-b02f-0dd809899f41-metrics-certs podName:65f5aca2-9fa7-4b19-b02f-0dd809899f41 nodeName:}" failed. No retries permitted until 2026-04-21 00:04:32.914156466 +0000 UTC m=+65.349494672 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65f5aca2-9fa7-4b19-b02f-0dd809899f41-metrics-certs") pod "network-metrics-daemon-lr9hq" (UID: "65f5aca2-9fa7-4b19-b02f-0dd809899f41") : object "openshift-multus"/"metrics-daemon-secret" not registered Apr 21 00:04:01.015080 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:01.015034 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4qbl8\" (UniqueName: \"kubernetes.io/projected/526918a6-6456-4ee9-b13d-ca26cfea5695-kube-api-access-4qbl8\") pod \"network-check-target-d5vdn\" (UID: \"526918a6-6456-4ee9-b13d-ca26cfea5695\") " pod="openshift-network-diagnostics/network-check-target-d5vdn" Apr 21 00:04:01.015272 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:04:01.015199 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Apr 21 00:04:01.015272 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:04:01.015219 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Apr 21 00:04:01.015272 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:04:01.015231 2576 projected.go:194] Error preparing data for projected volume kube-api-access-4qbl8 for pod openshift-network-diagnostics/network-check-target-d5vdn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 21 00:04:01.015453 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:04:01.015298 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/526918a6-6456-4ee9-b13d-ca26cfea5695-kube-api-access-4qbl8 podName:526918a6-6456-4ee9-b13d-ca26cfea5695 nodeName:}" failed. No retries permitted until 2026-04-21 00:04:33.015277918 +0000 UTC m=+65.450616135 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-4qbl8" (UniqueName: "kubernetes.io/projected/526918a6-6456-4ee9-b13d-ca26cfea5695-kube-api-access-4qbl8") pod "network-check-target-d5vdn" (UID: "526918a6-6456-4ee9-b13d-ca26cfea5695") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 21 00:04:01.205908 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:01.205827 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lr9hq" Apr 21 00:04:01.206067 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:04:01.205948 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lr9hq" podUID="65f5aca2-9fa7-4b19-b02f-0dd809899f41" Apr 21 00:04:02.205120 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:02.205086 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d5vdn" Apr 21 00:04:02.205610 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:04:02.205213 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d5vdn" podUID="526918a6-6456-4ee9-b13d-ca26cfea5695" Apr 21 00:04:03.205243 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:03.205198 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lr9hq" Apr 21 00:04:03.205679 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:04:03.205339 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lr9hq" podUID="65f5aca2-9fa7-4b19-b02f-0dd809899f41" Apr 21 00:04:04.205091 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:04.205057 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d5vdn" Apr 21 00:04:04.205292 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:04:04.205161 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d5vdn" podUID="526918a6-6456-4ee9-b13d-ca26cfea5695" Apr 21 00:04:05.205558 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:05.205516 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lr9hq" Apr 21 00:04:05.205948 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:04:05.205635 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lr9hq" podUID="65f5aca2-9fa7-4b19-b02f-0dd809899f41" Apr 21 00:04:05.541840 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:05.541755 2576 generic.go:358] "Generic (PLEG): container finished" podID="3abd03e7-2e8f-48a2-b63d-5eddab0cb80a" containerID="80332e1d40b3824ca3db03ba82919b8f9ed0aed574bb736103362c2f2ba1e748" exitCode=0 Apr 21 00:04:05.541840 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:05.541820 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k959w" event={"ID":"3abd03e7-2e8f-48a2-b63d-5eddab0cb80a","Type":"ContainerDied","Data":"80332e1d40b3824ca3db03ba82919b8f9ed0aed574bb736103362c2f2ba1e748"} Apr 21 00:04:06.205511 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:06.205464 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d5vdn" Apr 21 00:04:06.205711 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:04:06.205596 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d5vdn" podUID="526918a6-6456-4ee9-b13d-ca26cfea5695" Apr 21 00:04:06.546790 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:06.546696 2576 generic.go:358] "Generic (PLEG): container finished" podID="3abd03e7-2e8f-48a2-b63d-5eddab0cb80a" containerID="fdd6ff0efe1016e1b037dca8344c65c0a360b89d518f1ba5e8676c5391ed4dce" exitCode=0 Apr 21 00:04:06.546938 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:06.546781 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k959w" event={"ID":"3abd03e7-2e8f-48a2-b63d-5eddab0cb80a","Type":"ContainerDied","Data":"fdd6ff0efe1016e1b037dca8344c65c0a360b89d518f1ba5e8676c5391ed4dce"} Apr 21 00:04:07.205155 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:07.205116 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lr9hq" Apr 21 00:04:07.205337 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:04:07.205227 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lr9hq" podUID="65f5aca2-9fa7-4b19-b02f-0dd809899f41" Apr 21 00:04:07.551500 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:07.551414 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k959w" event={"ID":"3abd03e7-2e8f-48a2-b63d-5eddab0cb80a","Type":"ContainerStarted","Data":"ee6f9b91924b7efaa19312e5167450933c0dbe9da6ad38ac53500ed8f1518b41"} Apr 21 00:04:07.575338 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:07.575287 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-k959w" podStartSLOduration=4.02118337 podStartE2EDuration="39.575271225s" podCreationTimestamp="2026-04-21 00:03:28 +0000 UTC" firstStartedPulling="2026-04-21 00:03:29.473064066 +0000 UTC m=+1.908402271" lastFinishedPulling="2026-04-21 00:04:05.027151921 +0000 UTC m=+37.462490126" observedRunningTime="2026-04-21 00:04:07.574845562 +0000 UTC m=+40.010183797" watchObservedRunningTime="2026-04-21 00:04:07.575271225 +0000 UTC m=+40.010609449" Apr 21 00:04:08.206068 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:08.206030 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d5vdn" Apr 21 00:04:08.206232 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:04:08.206114 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d5vdn" podUID="526918a6-6456-4ee9-b13d-ca26cfea5695" Apr 21 00:04:09.205601 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:09.205562 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lr9hq" Apr 21 00:04:09.205991 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:04:09.205677 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lr9hq" podUID="65f5aca2-9fa7-4b19-b02f-0dd809899f41" Apr 21 00:04:10.151519 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:10.151294 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-d5vdn"] Apr 21 00:04:10.152267 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:10.151651 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d5vdn" Apr 21 00:04:10.152267 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:04:10.151775 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d5vdn" podUID="526918a6-6456-4ee9-b13d-ca26cfea5695" Apr 21 00:04:10.154696 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:10.154662 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lr9hq"] Apr 21 00:04:10.154817 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:10.154775 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lr9hq" Apr 21 00:04:10.154911 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:04:10.154892 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lr9hq" podUID="65f5aca2-9fa7-4b19-b02f-0dd809899f41" Apr 21 00:04:12.205803 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:12.205763 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lr9hq" Apr 21 00:04:12.206276 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:12.205763 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d5vdn" Apr 21 00:04:12.206276 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:04:12.205902 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lr9hq" podUID="65f5aca2-9fa7-4b19-b02f-0dd809899f41" Apr 21 00:04:12.206276 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:04:12.205955 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d5vdn" podUID="526918a6-6456-4ee9-b13d-ca26cfea5695" Apr 21 00:04:14.205616 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:14.205573 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d5vdn" Apr 21 00:04:14.205616 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:14.205604 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lr9hq" Apr 21 00:04:14.206154 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:04:14.205682 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d5vdn" podUID="526918a6-6456-4ee9-b13d-ca26cfea5695" Apr 21 00:04:14.206154 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:04:14.205752 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lr9hq" podUID="65f5aca2-9fa7-4b19-b02f-0dd809899f41" Apr 21 00:04:14.900019 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:14.899992 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-1.ec2.internal" event="NodeReady" Apr 21 00:04:14.900194 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:14.900119 2576 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Apr 21 00:04:14.941542 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:14.941511 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7smln"] Apr 21 00:04:14.976122 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:14.976079 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-bpxlz"] Apr 21 00:04:14.976285 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:14.976243 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7smln" Apr 21 00:04:14.978673 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:14.978643 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Apr 21 00:04:14.978835 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:14.978686 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Apr 21 00:04:14.978835 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:14.978696 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-79cql\"" Apr 21 00:04:15.000465 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:15.000424 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7smln"] Apr 21 00:04:15.000465 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:15.000458 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bpxlz"] Apr 21 00:04:15.000465 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:15.000469 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-27rqs"] Apr 21 00:04:15.000676 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:15.000579 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bpxlz" Apr 21 00:04:15.003492 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:15.003458 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2glpj\"" Apr 21 00:04:15.003492 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:15.003481 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Apr 21 00:04:15.003492 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:15.003463 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Apr 21 00:04:15.003822 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:15.003471 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Apr 21 00:04:15.019116 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:15.019081 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-27rqs"] Apr 21 00:04:15.019272 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:15.019209 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-27rqs" Apr 21 00:04:15.021474 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:15.021444 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Apr 21 00:04:15.021637 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:15.021615 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pjwht\"" Apr 21 00:04:15.021741 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:15.021710 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Apr 21 00:04:15.021795 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:15.021783 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Apr 21 00:04:15.021848 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:15.021784 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Apr 21 00:04:15.119095 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:15.119052 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e7c09cc6-2592-4775-b6aa-5565a18dc6d4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-27rqs\" (UID: \"e7c09cc6-2592-4775-b6aa-5565a18dc6d4\") " pod="openshift-insights/insights-runtime-extractor-27rqs" Apr 21 00:04:15.119095 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:15.119097 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnm84\" (UniqueName: \"kubernetes.io/projected/3abcd43c-0a0a-42d7-b1cc-6efb9679b409-kube-api-access-rnm84\") pod \"dns-default-7smln\" (UID: \"3abcd43c-0a0a-42d7-b1cc-6efb9679b409\") " pod="openshift-dns/dns-default-7smln" Apr 21 00:04:15.119319 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:15.119118 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e7c09cc6-2592-4775-b6aa-5565a18dc6d4-crio-socket\") pod \"insights-runtime-extractor-27rqs\" (UID: \"e7c09cc6-2592-4775-b6aa-5565a18dc6d4\") " pod="openshift-insights/insights-runtime-extractor-27rqs" Apr 21 00:04:15.119319 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:15.119141 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3abcd43c-0a0a-42d7-b1cc-6efb9679b409-config-volume\") pod \"dns-default-7smln\" (UID: \"3abcd43c-0a0a-42d7-b1cc-6efb9679b409\") " pod="openshift-dns/dns-default-7smln" Apr 21 00:04:15.119319 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:15.119185 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3abcd43c-0a0a-42d7-b1cc-6efb9679b409-metrics-tls\") pod \"dns-default-7smln\" (UID: \"3abcd43c-0a0a-42d7-b1cc-6efb9679b409\") " pod="openshift-dns/dns-default-7smln" Apr 21 00:04:15.119319 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:15.119236 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8fbc25fb-05e2-4240-8294-bee8b0e94fbf-cert\") pod \"ingress-canary-bpxlz\" (UID: \"8fbc25fb-05e2-4240-8294-bee8b0e94fbf\") " pod="openshift-ingress-canary/ingress-canary-bpxlz" Apr 21 00:04:15.119319 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:15.119263 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6v2v\" (UniqueName: \"kubernetes.io/projected/8fbc25fb-05e2-4240-8294-bee8b0e94fbf-kube-api-access-r6v2v\") pod \"ingress-canary-bpxlz\" (UID: \"8fbc25fb-05e2-4240-8294-bee8b0e94fbf\") " pod="openshift-ingress-canary/ingress-canary-bpxlz" Apr 21 00:04:15.119319 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:15.119286 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e7c09cc6-2592-4775-b6aa-5565a18dc6d4-data-volume\") pod \"insights-runtime-extractor-27rqs\" (UID: \"e7c09cc6-2592-4775-b6aa-5565a18dc6d4\") " pod="openshift-insights/insights-runtime-extractor-27rqs" Apr 21 00:04:15.119617 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:15.119320 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e7c09cc6-2592-4775-b6aa-5565a18dc6d4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-27rqs\" (UID: \"e7c09cc6-2592-4775-b6aa-5565a18dc6d4\") " pod="openshift-insights/insights-runtime-extractor-27rqs" Apr 21 00:04:15.119617 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:15.119341 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3abcd43c-0a0a-42d7-b1cc-6efb9679b409-tmp-dir\") pod \"dns-default-7smln\" (UID: \"3abcd43c-0a0a-42d7-b1cc-6efb9679b409\") " pod="openshift-dns/dns-default-7smln" Apr 21 00:04:15.119617 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:15.119400 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlthl\" (UniqueName: \"kubernetes.io/projected/e7c09cc6-2592-4775-b6aa-5565a18dc6d4-kube-api-access-xlthl\") pod \"insights-runtime-extractor-27rqs\" (UID: \"e7c09cc6-2592-4775-b6aa-5565a18dc6d4\") " pod="openshift-insights/insights-runtime-extractor-27rqs" Apr 21 00:04:15.220482 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:15.220394 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r6v2v\" (UniqueName: \"kubernetes.io/projected/8fbc25fb-05e2-4240-8294-bee8b0e94fbf-kube-api-access-r6v2v\") pod \"ingress-canary-bpxlz\" (UID: \"8fbc25fb-05e2-4240-8294-bee8b0e94fbf\") " pod="openshift-ingress-canary/ingress-canary-bpxlz" Apr 21 00:04:15.220482 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:15.220432 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e7c09cc6-2592-4775-b6aa-5565a18dc6d4-data-volume\") pod \"insights-runtime-extractor-27rqs\" (UID: \"e7c09cc6-2592-4775-b6aa-5565a18dc6d4\") " pod="openshift-insights/insights-runtime-extractor-27rqs" Apr 21 00:04:15.220482 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:15.220453 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e7c09cc6-2592-4775-b6aa-5565a18dc6d4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-27rqs\" (UID: \"e7c09cc6-2592-4775-b6aa-5565a18dc6d4\") " pod="openshift-insights/insights-runtime-extractor-27rqs" Apr 21 00:04:15.220482 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:15.220477 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3abcd43c-0a0a-42d7-b1cc-6efb9679b409-tmp-dir\") pod \"dns-default-7smln\" (UID: \"3abcd43c-0a0a-42d7-b1cc-6efb9679b409\") " pod="openshift-dns/dns-default-7smln" Apr 21 00:04:15.221149 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:15.220510 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xlthl\" (UniqueName: \"kubernetes.io/projected/e7c09cc6-2592-4775-b6aa-5565a18dc6d4-kube-api-access-xlthl\") pod \"insights-runtime-extractor-27rqs\" (UID: \"e7c09cc6-2592-4775-b6aa-5565a18dc6d4\") " pod="openshift-insights/insights-runtime-extractor-27rqs" Apr 21 00:04:15.221149 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:15.220538 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e7c09cc6-2592-4775-b6aa-5565a18dc6d4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-27rqs\" (UID: \"e7c09cc6-2592-4775-b6aa-5565a18dc6d4\") " pod="openshift-insights/insights-runtime-extractor-27rqs" Apr 21 00:04:15.221149 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:15.220554 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rnm84\" (UniqueName: \"kubernetes.io/projected/3abcd43c-0a0a-42d7-b1cc-6efb9679b409-kube-api-access-rnm84\") pod \"dns-default-7smln\" (UID: \"3abcd43c-0a0a-42d7-b1cc-6efb9679b409\") " pod="openshift-dns/dns-default-7smln" Apr 21 00:04:15.221149 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:15.220697 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e7c09cc6-2592-4775-b6aa-5565a18dc6d4-crio-socket\") pod \"insights-runtime-extractor-27rqs\" (UID: \"e7c09cc6-2592-4775-b6aa-5565a18dc6d4\") " pod="openshift-insights/insights-runtime-extractor-27rqs" Apr 21 00:04:15.221149 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:15.220742 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3abcd43c-0a0a-42d7-b1cc-6efb9679b409-config-volume\") pod \"dns-default-7smln\" (UID: \"3abcd43c-0a0a-42d7-b1cc-6efb9679b409\") " pod="openshift-dns/dns-default-7smln" Apr 21 00:04:15.221149 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:15.220780 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3abcd43c-0a0a-42d7-b1cc-6efb9679b409-metrics-tls\") pod \"dns-default-7smln\" (UID: \"3abcd43c-0a0a-42d7-b1cc-6efb9679b409\") " pod="openshift-dns/dns-default-7smln" Apr 21 00:04:15.221149 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:15.220817 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e7c09cc6-2592-4775-b6aa-5565a18dc6d4-data-volume\") pod \"insights-runtime-extractor-27rqs\" (UID: \"e7c09cc6-2592-4775-b6aa-5565a18dc6d4\") " pod="openshift-insights/insights-runtime-extractor-27rqs" Apr 21 00:04:15.221149 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:15.220850 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3abcd43c-0a0a-42d7-b1cc-6efb9679b409-tmp-dir\") pod \"dns-default-7smln\" (UID: \"3abcd43c-0a0a-42d7-b1cc-6efb9679b409\") " pod="openshift-dns/dns-default-7smln" Apr 21 00:04:15.221149 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:15.220826 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8fbc25fb-05e2-4240-8294-bee8b0e94fbf-cert\") pod \"ingress-canary-bpxlz\" (UID: \"8fbc25fb-05e2-4240-8294-bee8b0e94fbf\") " pod="openshift-ingress-canary/ingress-canary-bpxlz" Apr 21 00:04:15.221149 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:15.220897 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e7c09cc6-2592-4775-b6aa-5565a18dc6d4-crio-socket\") pod \"insights-runtime-extractor-27rqs\" (UID: \"e7c09cc6-2592-4775-b6aa-5565a18dc6d4\") " pod="openshift-insights/insights-runtime-extractor-27rqs" Apr 21 00:04:15.221527 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:15.221272 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3abcd43c-0a0a-42d7-b1cc-6efb9679b409-config-volume\") pod \"dns-default-7smln\" (UID: \"3abcd43c-0a0a-42d7-b1cc-6efb9679b409\") " pod="openshift-dns/dns-default-7smln" Apr 21 00:04:15.221527 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:15.221316 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e7c09cc6-2592-4775-b6aa-5565a18dc6d4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-27rqs\" (UID: \"e7c09cc6-2592-4775-b6aa-5565a18dc6d4\") " pod="openshift-insights/insights-runtime-extractor-27rqs" Apr 21 00:04:15.224795 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:15.224772 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e7c09cc6-2592-4775-b6aa-5565a18dc6d4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-27rqs\" (UID: \"e7c09cc6-2592-4775-b6aa-5565a18dc6d4\") " pod="openshift-insights/insights-runtime-extractor-27rqs" Apr 21 00:04:15.224903 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:15.224803 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8fbc25fb-05e2-4240-8294-bee8b0e94fbf-cert\") pod \"ingress-canary-bpxlz\" (UID: \"8fbc25fb-05e2-4240-8294-bee8b0e94fbf\") " pod="openshift-ingress-canary/ingress-canary-bpxlz" Apr 21 00:04:15.228688 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:15.228661 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6v2v\" (UniqueName: \"kubernetes.io/projected/8fbc25fb-05e2-4240-8294-bee8b0e94fbf-kube-api-access-r6v2v\") pod \"ingress-canary-bpxlz\" (UID: \"8fbc25fb-05e2-4240-8294-bee8b0e94fbf\") " pod="openshift-ingress-canary/ingress-canary-bpxlz" Apr 21 00:04:15.229149 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:15.229116 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlthl\" (UniqueName: \"kubernetes.io/projected/e7c09cc6-2592-4775-b6aa-5565a18dc6d4-kube-api-access-xlthl\") pod \"insights-runtime-extractor-27rqs\" (UID: \"e7c09cc6-2592-4775-b6aa-5565a18dc6d4\") " pod="openshift-insights/insights-runtime-extractor-27rqs" Apr 21 00:04:15.235771 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:15.235748 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3abcd43c-0a0a-42d7-b1cc-6efb9679b409-metrics-tls\") pod \"dns-default-7smln\" (UID: \"3abcd43c-0a0a-42d7-b1cc-6efb9679b409\") " pod="openshift-dns/dns-default-7smln" Apr 21 00:04:15.237710 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:15.237681 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnm84\" (UniqueName: \"kubernetes.io/projected/3abcd43c-0a0a-42d7-b1cc-6efb9679b409-kube-api-access-rnm84\") pod \"dns-default-7smln\" (UID: \"3abcd43c-0a0a-42d7-b1cc-6efb9679b409\") " pod="openshift-dns/dns-default-7smln" Apr 21 00:04:15.285714 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:15.285669 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7smln" Apr 21 00:04:15.309480 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:15.309447 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bpxlz" Apr 21 00:04:15.327435 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:15.327406 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-27rqs" Apr 21 00:04:15.463766 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:15.463731 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bpxlz"] Apr 21 00:04:15.466339 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:15.466299 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7smln"] Apr 21 00:04:15.469457 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:04:15.469421 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fbc25fb_05e2_4240_8294_bee8b0e94fbf.slice/crio-a22993330371fe875db6cc2d6942ac1d72e05f4742475b257254ef606ae8454f WatchSource:0}: Error finding container a22993330371fe875db6cc2d6942ac1d72e05f4742475b257254ef606ae8454f: Status 404 returned error can't find the container with id a22993330371fe875db6cc2d6942ac1d72e05f4742475b257254ef606ae8454f Apr 21 00:04:15.469839 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:15.469820 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-27rqs"] Apr 21 00:04:15.471525 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:04:15.471482 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3abcd43c_0a0a_42d7_b1cc_6efb9679b409.slice/crio-cd1a8b7af5bc616f2bae56b72a9df34c237259261f6ddf06e4d7450ca097681c WatchSource:0}: Error finding container cd1a8b7af5bc616f2bae56b72a9df34c237259261f6ddf06e4d7450ca097681c: Status 404 returned error can't find the container with id cd1a8b7af5bc616f2bae56b72a9df34c237259261f6ddf06e4d7450ca097681c Apr 21 00:04:15.473785 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:04:15.473762 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7c09cc6_2592_4775_b6aa_5565a18dc6d4.slice/crio-04e9baffb0cec43c85d5962b0411e5904f544838cfbd86e683c0c0ee44708cf8 WatchSource:0}: Error finding container 04e9baffb0cec43c85d5962b0411e5904f544838cfbd86e683c0c0ee44708cf8: Status 404 returned error can't find the container with id 04e9baffb0cec43c85d5962b0411e5904f544838cfbd86e683c0c0ee44708cf8 Apr 21 00:04:15.566718 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:15.566530 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-27rqs" event={"ID":"e7c09cc6-2592-4775-b6aa-5565a18dc6d4","Type":"ContainerStarted","Data":"04e9baffb0cec43c85d5962b0411e5904f544838cfbd86e683c0c0ee44708cf8"} Apr 21 00:04:15.567408 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:15.567382 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7smln" event={"ID":"3abcd43c-0a0a-42d7-b1cc-6efb9679b409","Type":"ContainerStarted","Data":"cd1a8b7af5bc616f2bae56b72a9df34c237259261f6ddf06e4d7450ca097681c"} Apr 21 00:04:15.568123 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:15.568102 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bpxlz" event={"ID":"8fbc25fb-05e2-4240-8294-bee8b0e94fbf","Type":"ContainerStarted","Data":"a22993330371fe875db6cc2d6942ac1d72e05f4742475b257254ef606ae8454f"} Apr 21 00:04:16.206604 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:16.205438 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lr9hq" Apr 21 00:04:16.206604 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:16.206131 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d5vdn" Apr 21 00:04:16.210374 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:16.210322 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Apr 21 00:04:16.210631 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:16.210607 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-n52qc\"" Apr 21 00:04:16.211032 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:16.211008 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Apr 21 00:04:16.211255 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:16.211232 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-24wfg\"" Apr 21 00:04:16.211556 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:16.211539 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Apr 21 00:04:16.572033 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:16.571951 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-27rqs" event={"ID":"e7c09cc6-2592-4775-b6aa-5565a18dc6d4","Type":"ContainerStarted","Data":"8a53dbb215a8198c6ee4621ff29c0e825b9eba57d67f3a63c86cef0793de0014"} Apr 21 00:04:18.072087 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:18.072008 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5676c8c784-6pwzc"] Apr 21 00:04:18.089205 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:18.089143 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5676c8c784-6pwzc"] Apr 21 00:04:18.089406 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:18.089284 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5676c8c784-6pwzc" Apr 21 00:04:18.092589 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:18.092558 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Apr 21 00:04:18.092739 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:18.092684 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Apr 21 00:04:18.099832 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:18.093680 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Apr 21 00:04:18.099832 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:18.093697 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Apr 21 00:04:18.099832 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:18.093703 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Apr 21 00:04:18.099832 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:18.093769 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-ck7wm\"" Apr 21 00:04:18.246654 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:18.246613 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4d6d5\" (UniqueName: \"kubernetes.io/projected/a7da2692-d1fe-4e3f-8a7a-b34812c9f313-kube-api-access-4d6d5\") pod \"prometheus-operator-5676c8c784-6pwzc\" (UID: \"a7da2692-d1fe-4e3f-8a7a-b34812c9f313\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-6pwzc" Apr 21 00:04:18.246835 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:18.246691 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7da2692-d1fe-4e3f-8a7a-b34812c9f313-metrics-client-ca\") pod \"prometheus-operator-5676c8c784-6pwzc\" (UID: \"a7da2692-d1fe-4e3f-8a7a-b34812c9f313\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-6pwzc" Apr 21 00:04:18.246835 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:18.246737 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a7da2692-d1fe-4e3f-8a7a-b34812c9f313-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5676c8c784-6pwzc\" (UID: \"a7da2692-d1fe-4e3f-8a7a-b34812c9f313\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-6pwzc" Apr 21 00:04:18.246835 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:18.246800 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a7da2692-d1fe-4e3f-8a7a-b34812c9f313-prometheus-operator-tls\") pod \"prometheus-operator-5676c8c784-6pwzc\" (UID: \"a7da2692-d1fe-4e3f-8a7a-b34812c9f313\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-6pwzc" Apr 21 00:04:18.347609 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:18.347444 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a7da2692-d1fe-4e3f-8a7a-b34812c9f313-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5676c8c784-6pwzc\" (UID: \"a7da2692-d1fe-4e3f-8a7a-b34812c9f313\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-6pwzc" Apr 21 00:04:18.347779 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:18.347633 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a7da2692-d1fe-4e3f-8a7a-b34812c9f313-prometheus-operator-tls\") pod \"prometheus-operator-5676c8c784-6pwzc\" (UID: \"a7da2692-d1fe-4e3f-8a7a-b34812c9f313\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-6pwzc" Apr 21 00:04:18.347779 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:18.347660 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4d6d5\" (UniqueName: \"kubernetes.io/projected/a7da2692-d1fe-4e3f-8a7a-b34812c9f313-kube-api-access-4d6d5\") pod \"prometheus-operator-5676c8c784-6pwzc\" (UID: \"a7da2692-d1fe-4e3f-8a7a-b34812c9f313\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-6pwzc" Apr 21 00:04:18.347779 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:18.347691 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7da2692-d1fe-4e3f-8a7a-b34812c9f313-metrics-client-ca\") pod \"prometheus-operator-5676c8c784-6pwzc\" (UID: \"a7da2692-d1fe-4e3f-8a7a-b34812c9f313\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-6pwzc" Apr 21 00:04:18.347945 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:04:18.347819 2576 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Apr 21 00:04:18.347945 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:04:18.347902 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7da2692-d1fe-4e3f-8a7a-b34812c9f313-prometheus-operator-tls podName:a7da2692-d1fe-4e3f-8a7a-b34812c9f313 nodeName:}" failed. No retries permitted until 2026-04-21 00:04:18.847881036 +0000 UTC m=+51.283219252 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/a7da2692-d1fe-4e3f-8a7a-b34812c9f313-prometheus-operator-tls") pod "prometheus-operator-5676c8c784-6pwzc" (UID: "a7da2692-d1fe-4e3f-8a7a-b34812c9f313") : secret "prometheus-operator-tls" not found Apr 21 00:04:18.348326 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:18.348308 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7da2692-d1fe-4e3f-8a7a-b34812c9f313-metrics-client-ca\") pod \"prometheus-operator-5676c8c784-6pwzc\" (UID: \"a7da2692-d1fe-4e3f-8a7a-b34812c9f313\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-6pwzc" Apr 21 00:04:18.351524 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:18.351503 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a7da2692-d1fe-4e3f-8a7a-b34812c9f313-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5676c8c784-6pwzc\" (UID: \"a7da2692-d1fe-4e3f-8a7a-b34812c9f313\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-6pwzc" Apr 21 00:04:18.355999 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:18.355974 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4d6d5\" (UniqueName: \"kubernetes.io/projected/a7da2692-d1fe-4e3f-8a7a-b34812c9f313-kube-api-access-4d6d5\") pod \"prometheus-operator-5676c8c784-6pwzc\" (UID: \"a7da2692-d1fe-4e3f-8a7a-b34812c9f313\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-6pwzc" Apr 21 00:04:18.577085 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:18.577042 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bpxlz" event={"ID":"8fbc25fb-05e2-4240-8294-bee8b0e94fbf","Type":"ContainerStarted","Data":"253807076f1cf2dc06b4615a262c9790680410005722cc3d2f3ddfddb6efe893"} Apr 21 00:04:18.578792 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:18.578716 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-27rqs" event={"ID":"e7c09cc6-2592-4775-b6aa-5565a18dc6d4","Type":"ContainerStarted","Data":"b0fe65fc16e6175e447024ea5c296de5140bd3ce0f13b83cb9e91fc8c31915a9"} Apr 21 00:04:18.580323 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:18.580298 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7smln" event={"ID":"3abcd43c-0a0a-42d7-b1cc-6efb9679b409","Type":"ContainerStarted","Data":"87fe3be40348451b44a057bc40aa614c5106bf274957d3a8d9ab60afd7255968"} Apr 21 00:04:18.580473 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:18.580328 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7smln" event={"ID":"3abcd43c-0a0a-42d7-b1cc-6efb9679b409","Type":"ContainerStarted","Data":"b0fec9483b3208ac39655a6283ac79035e741bd8bc4598910cd5979beec3f122"} Apr 21 00:04:18.580473 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:18.580454 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7smln" Apr 21 00:04:18.594473 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:18.594424 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-bpxlz" podStartSLOduration=2.033055663 podStartE2EDuration="4.594411931s" podCreationTimestamp="2026-04-21 00:04:14 +0000 UTC" firstStartedPulling="2026-04-21 00:04:15.472502086 +0000 UTC m=+47.907840302" lastFinishedPulling="2026-04-21 00:04:18.033858351 +0000 UTC m=+50.469196570" observedRunningTime="2026-04-21 00:04:18.593872009 +0000 UTC m=+51.029210233" watchObservedRunningTime="2026-04-21 00:04:18.594411931 +0000 UTC m=+51.029750154" Apr 21 00:04:18.608873 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:18.608823 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-7smln" podStartSLOduration=2.053524522 podStartE2EDuration="4.608809283s" podCreationTimestamp="2026-04-21 00:04:14 +0000 UTC" firstStartedPulling="2026-04-21 00:04:15.473552267 +0000 UTC m=+47.908890469" lastFinishedPulling="2026-04-21 00:04:18.028837025 +0000 UTC m=+50.464175230" observedRunningTime="2026-04-21 00:04:18.608078895 +0000 UTC m=+51.043417120" watchObservedRunningTime="2026-04-21 00:04:18.608809283 +0000 UTC m=+51.044147508" Apr 21 00:04:18.852348 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:18.852262 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a7da2692-d1fe-4e3f-8a7a-b34812c9f313-prometheus-operator-tls\") pod \"prometheus-operator-5676c8c784-6pwzc\" (UID: \"a7da2692-d1fe-4e3f-8a7a-b34812c9f313\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-6pwzc" Apr 21 00:04:18.855180 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:18.855151 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a7da2692-d1fe-4e3f-8a7a-b34812c9f313-prometheus-operator-tls\") pod \"prometheus-operator-5676c8c784-6pwzc\" (UID: \"a7da2692-d1fe-4e3f-8a7a-b34812c9f313\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-6pwzc" Apr 21 00:04:19.026672 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:19.026627 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5676c8c784-6pwzc" Apr 21 00:04:19.189129 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:19.189096 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5676c8c784-6pwzc"] Apr 21 00:04:19.195029 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:04:19.194860 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7da2692_d1fe_4e3f_8a7a_b34812c9f313.slice/crio-34d2ecfd81b085b02bfb015c60bc41fab74d746a7de782c361891c70965c2867 WatchSource:0}: Error finding container 34d2ecfd81b085b02bfb015c60bc41fab74d746a7de782c361891c70965c2867: Status 404 returned error can't find the container with id 34d2ecfd81b085b02bfb015c60bc41fab74d746a7de782c361891c70965c2867 Apr 21 00:04:19.277383 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:19.277332 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-684bdd6bf-lrfm4"] Apr 21 00:04:19.288414 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:19.288384 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-684bdd6bf-lrfm4" Apr 21 00:04:19.290119 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:19.290093 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-684bdd6bf-lrfm4"] Apr 21 00:04:19.290993 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:19.290944 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Apr 21 00:04:19.290993 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:19.290963 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Apr 21 00:04:19.291187 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:19.291005 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Apr 21 00:04:19.291187 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:19.291033 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-jxljl\"" Apr 21 00:04:19.291332 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:19.291316 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Apr 21 00:04:19.291445 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:19.291335 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Apr 21 00:04:19.291445 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:19.291380 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Apr 21 00:04:19.291445 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:19.291397 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Apr 21 00:04:19.458593 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:19.458480 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c9a689e8-8774-4fff-9a9f-a774f4fa3564-console-serving-cert\") pod \"console-684bdd6bf-lrfm4\" (UID: \"c9a689e8-8774-4fff-9a9f-a774f4fa3564\") " pod="openshift-console/console-684bdd6bf-lrfm4" Apr 21 00:04:19.458593 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:19.458528 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krwbw\" (UniqueName: \"kubernetes.io/projected/c9a689e8-8774-4fff-9a9f-a774f4fa3564-kube-api-access-krwbw\") pod \"console-684bdd6bf-lrfm4\" (UID: \"c9a689e8-8774-4fff-9a9f-a774f4fa3564\") " pod="openshift-console/console-684bdd6bf-lrfm4" Apr 21 00:04:19.458593 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:19.458573 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c9a689e8-8774-4fff-9a9f-a774f4fa3564-console-config\") pod \"console-684bdd6bf-lrfm4\" (UID: \"c9a689e8-8774-4fff-9a9f-a774f4fa3564\") " pod="openshift-console/console-684bdd6bf-lrfm4" Apr 21 00:04:19.458854 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:19.458621 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c9a689e8-8774-4fff-9a9f-a774f4fa3564-oauth-serving-cert\") pod \"console-684bdd6bf-lrfm4\" (UID: \"c9a689e8-8774-4fff-9a9f-a774f4fa3564\") " pod="openshift-console/console-684bdd6bf-lrfm4" Apr 21 00:04:19.458854 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:19.458688 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c9a689e8-8774-4fff-9a9f-a774f4fa3564-console-oauth-config\") pod \"console-684bdd6bf-lrfm4\" (UID: \"c9a689e8-8774-4fff-9a9f-a774f4fa3564\") " pod="openshift-console/console-684bdd6bf-lrfm4" Apr 21 00:04:19.458854 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:19.458724 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c9a689e8-8774-4fff-9a9f-a774f4fa3564-service-ca\") pod \"console-684bdd6bf-lrfm4\" (UID: \"c9a689e8-8774-4fff-9a9f-a774f4fa3564\") " pod="openshift-console/console-684bdd6bf-lrfm4" Apr 21 00:04:19.559347 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:19.559312 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c9a689e8-8774-4fff-9a9f-a774f4fa3564-console-config\") pod \"console-684bdd6bf-lrfm4\" (UID: \"c9a689e8-8774-4fff-9a9f-a774f4fa3564\") " pod="openshift-console/console-684bdd6bf-lrfm4" Apr 21 00:04:19.559347 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:19.559352 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c9a689e8-8774-4fff-9a9f-a774f4fa3564-oauth-serving-cert\") pod \"console-684bdd6bf-lrfm4\" (UID: \"c9a689e8-8774-4fff-9a9f-a774f4fa3564\") " pod="openshift-console/console-684bdd6bf-lrfm4" Apr 21 00:04:19.559622 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:19.559408 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c9a689e8-8774-4fff-9a9f-a774f4fa3564-console-oauth-config\") pod \"console-684bdd6bf-lrfm4\" (UID: \"c9a689e8-8774-4fff-9a9f-a774f4fa3564\") " pod="openshift-console/console-684bdd6bf-lrfm4" Apr 21 00:04:19.559622 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:19.559441 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c9a689e8-8774-4fff-9a9f-a774f4fa3564-service-ca\") pod \"console-684bdd6bf-lrfm4\" (UID: \"c9a689e8-8774-4fff-9a9f-a774f4fa3564\") " pod="openshift-console/console-684bdd6bf-lrfm4" Apr 21 00:04:19.559622 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:19.559486 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c9a689e8-8774-4fff-9a9f-a774f4fa3564-console-serving-cert\") pod \"console-684bdd6bf-lrfm4\" (UID: \"c9a689e8-8774-4fff-9a9f-a774f4fa3564\") " pod="openshift-console/console-684bdd6bf-lrfm4" Apr 21 00:04:19.559622 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:19.559519 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-krwbw\" (UniqueName: \"kubernetes.io/projected/c9a689e8-8774-4fff-9a9f-a774f4fa3564-kube-api-access-krwbw\") pod \"console-684bdd6bf-lrfm4\" (UID: \"c9a689e8-8774-4fff-9a9f-a774f4fa3564\") " pod="openshift-console/console-684bdd6bf-lrfm4" Apr 21 00:04:19.560199 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:19.560175 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c9a689e8-8774-4fff-9a9f-a774f4fa3564-console-config\") pod \"console-684bdd6bf-lrfm4\" (UID: \"c9a689e8-8774-4fff-9a9f-a774f4fa3564\") " pod="openshift-console/console-684bdd6bf-lrfm4" Apr 21 00:04:19.560286 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:19.560204 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c9a689e8-8774-4fff-9a9f-a774f4fa3564-service-ca\") pod \"console-684bdd6bf-lrfm4\" (UID: \"c9a689e8-8774-4fff-9a9f-a774f4fa3564\") " pod="openshift-console/console-684bdd6bf-lrfm4" Apr 21 00:04:19.560286 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:19.560175 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c9a689e8-8774-4fff-9a9f-a774f4fa3564-oauth-serving-cert\") pod \"console-684bdd6bf-lrfm4\" (UID: \"c9a689e8-8774-4fff-9a9f-a774f4fa3564\") " pod="openshift-console/console-684bdd6bf-lrfm4" Apr 21 00:04:19.563325 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:19.563299 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c9a689e8-8774-4fff-9a9f-a774f4fa3564-console-oauth-config\") pod \"console-684bdd6bf-lrfm4\" (UID: \"c9a689e8-8774-4fff-9a9f-a774f4fa3564\") " pod="openshift-console/console-684bdd6bf-lrfm4" Apr 21 00:04:19.563471 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:19.563409 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c9a689e8-8774-4fff-9a9f-a774f4fa3564-console-serving-cert\") pod \"console-684bdd6bf-lrfm4\" (UID: \"c9a689e8-8774-4fff-9a9f-a774f4fa3564\") " pod="openshift-console/console-684bdd6bf-lrfm4" Apr 21 00:04:19.568009 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:19.567958 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krwbw\" (UniqueName: \"kubernetes.io/projected/c9a689e8-8774-4fff-9a9f-a774f4fa3564-kube-api-access-krwbw\") pod \"console-684bdd6bf-lrfm4\" (UID: \"c9a689e8-8774-4fff-9a9f-a774f4fa3564\") " pod="openshift-console/console-684bdd6bf-lrfm4" Apr 21 00:04:19.583568 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:19.583531 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5676c8c784-6pwzc" event={"ID":"a7da2692-d1fe-4e3f-8a7a-b34812c9f313","Type":"ContainerStarted","Data":"34d2ecfd81b085b02bfb015c60bc41fab74d746a7de782c361891c70965c2867"} Apr 21 00:04:19.599269 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:19.599234 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-684bdd6bf-lrfm4" Apr 21 00:04:19.907169 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:19.907137 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-684bdd6bf-lrfm4"] Apr 21 00:04:19.911284 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:04:19.911257 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9a689e8_8774_4fff_9a9f_a774f4fa3564.slice/crio-00cc4fec52b5a9f5a9ef9279b03975c5e28f07d5cb434954180318859a1663f4 WatchSource:0}: Error finding container 00cc4fec52b5a9f5a9ef9279b03975c5e28f07d5cb434954180318859a1663f4: Status 404 returned error can't find the container with id 00cc4fec52b5a9f5a9ef9279b03975c5e28f07d5cb434954180318859a1663f4 Apr 21 00:04:20.590088 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:20.590053 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-27rqs" event={"ID":"e7c09cc6-2592-4775-b6aa-5565a18dc6d4","Type":"ContainerStarted","Data":"bcf560b6b0acab3412ddaf8456fb62a427827e358bf8f9a968ff50813b823f98"} Apr 21 00:04:20.591311 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:20.591280 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-684bdd6bf-lrfm4" event={"ID":"c9a689e8-8774-4fff-9a9f-a774f4fa3564","Type":"ContainerStarted","Data":"00cc4fec52b5a9f5a9ef9279b03975c5e28f07d5cb434954180318859a1663f4"} Apr 21 00:04:20.607821 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:20.607764 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-27rqs" podStartSLOduration=2.129811911 podStartE2EDuration="6.607749593s" podCreationTimestamp="2026-04-21 00:04:14 +0000 UTC" firstStartedPulling="2026-04-21 00:04:15.610832887 +0000 UTC m=+48.046171089" lastFinishedPulling="2026-04-21 00:04:20.088770569 +0000 UTC m=+52.524108771" observedRunningTime="2026-04-21 00:04:20.606591528 +0000 UTC m=+53.041929753" watchObservedRunningTime="2026-04-21 00:04:20.607749593 +0000 UTC m=+53.043087816" Apr 21 00:04:21.595886 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:21.595688 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5676c8c784-6pwzc" event={"ID":"a7da2692-d1fe-4e3f-8a7a-b34812c9f313","Type":"ContainerStarted","Data":"9adb62dbf34c005017243c5fc3fdb69b90979f4031f5783262073aabadb930d4"} Apr 21 00:04:21.595886 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:21.595895 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5676c8c784-6pwzc" event={"ID":"a7da2692-d1fe-4e3f-8a7a-b34812c9f313","Type":"ContainerStarted","Data":"6f03e05ad73751467b7ec1b9e047162deb41d43f2fd20aa3fc1b8ab97760f371"} Apr 21 00:04:21.611395 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:21.611312 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5676c8c784-6pwzc" podStartSLOduration=1.93293107 podStartE2EDuration="3.611294371s" podCreationTimestamp="2026-04-21 00:04:18 +0000 UTC" firstStartedPulling="2026-04-21 00:04:19.204489647 +0000 UTC m=+51.639827851" lastFinishedPulling="2026-04-21 00:04:20.882852934 +0000 UTC m=+53.318191152" observedRunningTime="2026-04-21 00:04:21.61085035 +0000 UTC m=+54.046188575" watchObservedRunningTime="2026-04-21 00:04:21.611294371 +0000 UTC m=+54.046632627" Apr 21 00:04:23.395344 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.395308 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9d44df66c-hjf9j"] Apr 21 00:04:23.398249 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.398232 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9d44df66c-hjf9j" Apr 21 00:04:23.400786 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.400760 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Apr 21 00:04:23.400908 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.400790 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-gv8bb\"" Apr 21 00:04:23.400908 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.400760 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Apr 21 00:04:23.410791 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.410765 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9d44df66c-hjf9j"] Apr 21 00:04:23.416707 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.416679 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-69db897b98-bp68h"] Apr 21 00:04:23.419834 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.419815 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-69db897b98-bp68h" Apr 21 00:04:23.422209 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.422188 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Apr 21 00:04:23.422311 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.422188 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-zqtwj\"" Apr 21 00:04:23.422428 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.422348 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Apr 21 00:04:23.422428 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.422387 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Apr 21 00:04:23.425312 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.425290 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-g7qpx"] Apr 21 00:04:23.428330 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.428313 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-g7qpx" Apr 21 00:04:23.430895 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.430870 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Apr 21 00:04:23.430895 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.430891 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9p48h\"" Apr 21 00:04:23.431028 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.430967 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Apr 21 00:04:23.431028 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.430876 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Apr 21 00:04:23.431569 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.431544 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-69db897b98-bp68h"] Apr 21 00:04:23.487003 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.486966 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ec391d4-00db-40aa-8cc2-92ea1e6e782f-sys\") pod \"node-exporter-g7qpx\" (UID: \"0ec391d4-00db-40aa-8cc2-92ea1e6e782f\") " pod="openshift-monitoring/node-exporter-g7qpx" Apr 21 00:04:23.487003 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.487008 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/64bfd4c5-2ae7-487a-bd3a-56ed5d10fed3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-69db897b98-bp68h\" (UID: \"64bfd4c5-2ae7-487a-bd3a-56ed5d10fed3\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-bp68h" Apr 21 00:04:23.487244 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.487030 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0ec391d4-00db-40aa-8cc2-92ea1e6e782f-node-exporter-textfile\") pod \"node-exporter-g7qpx\" (UID: \"0ec391d4-00db-40aa-8cc2-92ea1e6e782f\") " pod="openshift-monitoring/node-exporter-g7qpx" Apr 21 00:04:23.487244 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.487079 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e90298e-8e0c-4366-8069-2a091a230c45-metrics-client-ca\") pod \"openshift-state-metrics-9d44df66c-hjf9j\" (UID: \"5e90298e-8e0c-4366-8069-2a091a230c45\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-hjf9j" Apr 21 00:04:23.487244 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.487109 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0ec391d4-00db-40aa-8cc2-92ea1e6e782f-root\") pod \"node-exporter-g7qpx\" (UID: \"0ec391d4-00db-40aa-8cc2-92ea1e6e782f\") " pod="openshift-monitoring/node-exporter-g7qpx" Apr 21 00:04:23.487244 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.487143 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64bfd4c5-2ae7-487a-bd3a-56ed5d10fed3-metrics-client-ca\") pod \"kube-state-metrics-69db897b98-bp68h\" (UID: \"64bfd4c5-2ae7-487a-bd3a-56ed5d10fed3\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-bp68h" Apr 21 00:04:23.487244 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.487168 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ec391d4-00db-40aa-8cc2-92ea1e6e782f-metrics-client-ca\") pod \"node-exporter-g7qpx\" (UID: \"0ec391d4-00db-40aa-8cc2-92ea1e6e782f\") " pod="openshift-monitoring/node-exporter-g7qpx" Apr 21 00:04:23.487244 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.487198 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqn86\" (UniqueName: \"kubernetes.io/projected/5e90298e-8e0c-4366-8069-2a091a230c45-kube-api-access-gqn86\") pod \"openshift-state-metrics-9d44df66c-hjf9j\" (UID: \"5e90298e-8e0c-4366-8069-2a091a230c45\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-hjf9j" Apr 21 00:04:23.487244 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.487224 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxbnl\" (UniqueName: \"kubernetes.io/projected/0ec391d4-00db-40aa-8cc2-92ea1e6e782f-kube-api-access-rxbnl\") pod \"node-exporter-g7qpx\" (UID: \"0ec391d4-00db-40aa-8cc2-92ea1e6e782f\") " pod="openshift-monitoring/node-exporter-g7qpx" Apr 21 00:04:23.487244 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.487242 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5e90298e-8e0c-4366-8069-2a091a230c45-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9d44df66c-hjf9j\" (UID: \"5e90298e-8e0c-4366-8069-2a091a230c45\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-hjf9j" Apr 21 00:04:23.487555 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.487265 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0ec391d4-00db-40aa-8cc2-92ea1e6e782f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-g7qpx\" (UID: \"0ec391d4-00db-40aa-8cc2-92ea1e6e782f\") " pod="openshift-monitoring/node-exporter-g7qpx" Apr 21 00:04:23.487555 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.487294 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5e90298e-8e0c-4366-8069-2a091a230c45-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9d44df66c-hjf9j\" (UID: \"5e90298e-8e0c-4366-8069-2a091a230c45\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-hjf9j" Apr 21 00:04:23.487555 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.487319 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/64bfd4c5-2ae7-487a-bd3a-56ed5d10fed3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-69db897b98-bp68h\" (UID: \"64bfd4c5-2ae7-487a-bd3a-56ed5d10fed3\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-bp68h" Apr 21 00:04:23.487555 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.487345 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0ec391d4-00db-40aa-8cc2-92ea1e6e782f-node-exporter-wtmp\") pod \"node-exporter-g7qpx\" (UID: \"0ec391d4-00db-40aa-8cc2-92ea1e6e782f\") " pod="openshift-monitoring/node-exporter-g7qpx" Apr 21 00:04:23.487555 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.487380 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0ec391d4-00db-40aa-8cc2-92ea1e6e782f-node-exporter-tls\") pod \"node-exporter-g7qpx\" (UID: \"0ec391d4-00db-40aa-8cc2-92ea1e6e782f\") " pod="openshift-monitoring/node-exporter-g7qpx" Apr 21 00:04:23.487555 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.487398 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0ec391d4-00db-40aa-8cc2-92ea1e6e782f-node-exporter-accelerators-collector-config\") pod \"node-exporter-g7qpx\" (UID: \"0ec391d4-00db-40aa-8cc2-92ea1e6e782f\") " pod="openshift-monitoring/node-exporter-g7qpx" Apr 21 00:04:23.487555 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.487415 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wllwq\" (UniqueName: \"kubernetes.io/projected/64bfd4c5-2ae7-487a-bd3a-56ed5d10fed3-kube-api-access-wllwq\") pod \"kube-state-metrics-69db897b98-bp68h\" (UID: \"64bfd4c5-2ae7-487a-bd3a-56ed5d10fed3\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-bp68h" Apr 21 00:04:23.487555 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.487441 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/64bfd4c5-2ae7-487a-bd3a-56ed5d10fed3-kube-state-metrics-tls\") pod \"kube-state-metrics-69db897b98-bp68h\" (UID: \"64bfd4c5-2ae7-487a-bd3a-56ed5d10fed3\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-bp68h" Apr 21 00:04:23.487555 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.487460 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/64bfd4c5-2ae7-487a-bd3a-56ed5d10fed3-volume-directive-shadow\") pod \"kube-state-metrics-69db897b98-bp68h\" (UID: \"64bfd4c5-2ae7-487a-bd3a-56ed5d10fed3\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-bp68h" Apr 21 00:04:23.588504 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.588418 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5e90298e-8e0c-4366-8069-2a091a230c45-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9d44df66c-hjf9j\" (UID: \"5e90298e-8e0c-4366-8069-2a091a230c45\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-hjf9j" Apr 21 00:04:23.588504 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.588461 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/64bfd4c5-2ae7-487a-bd3a-56ed5d10fed3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-69db897b98-bp68h\" (UID: \"64bfd4c5-2ae7-487a-bd3a-56ed5d10fed3\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-bp68h" Apr 21 00:04:23.588504 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.588483 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0ec391d4-00db-40aa-8cc2-92ea1e6e782f-node-exporter-wtmp\") pod \"node-exporter-g7qpx\" (UID: \"0ec391d4-00db-40aa-8cc2-92ea1e6e782f\") " pod="openshift-monitoring/node-exporter-g7qpx" Apr 21 00:04:23.588504 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.588499 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0ec391d4-00db-40aa-8cc2-92ea1e6e782f-node-exporter-tls\") pod \"node-exporter-g7qpx\" (UID: \"0ec391d4-00db-40aa-8cc2-92ea1e6e782f\") " pod="openshift-monitoring/node-exporter-g7qpx" Apr 21 00:04:23.588788 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.588521 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0ec391d4-00db-40aa-8cc2-92ea1e6e782f-node-exporter-accelerators-collector-config\") pod \"node-exporter-g7qpx\" (UID: \"0ec391d4-00db-40aa-8cc2-92ea1e6e782f\") " pod="openshift-monitoring/node-exporter-g7qpx" Apr 21 00:04:23.588788 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.588547 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wllwq\" (UniqueName: \"kubernetes.io/projected/64bfd4c5-2ae7-487a-bd3a-56ed5d10fed3-kube-api-access-wllwq\") pod \"kube-state-metrics-69db897b98-bp68h\" (UID: \"64bfd4c5-2ae7-487a-bd3a-56ed5d10fed3\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-bp68h" Apr 21 00:04:23.588788 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.588588 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/64bfd4c5-2ae7-487a-bd3a-56ed5d10fed3-kube-state-metrics-tls\") pod \"kube-state-metrics-69db897b98-bp68h\" (UID: \"64bfd4c5-2ae7-487a-bd3a-56ed5d10fed3\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-bp68h" Apr 21 00:04:23.588788 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:04:23.588615 2576 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Apr 21 00:04:23.588788 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.588623 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/64bfd4c5-2ae7-487a-bd3a-56ed5d10fed3-volume-directive-shadow\") pod \"kube-state-metrics-69db897b98-bp68h\" (UID: \"64bfd4c5-2ae7-487a-bd3a-56ed5d10fed3\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-bp68h" Apr 21 00:04:23.588788 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.588657 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0ec391d4-00db-40aa-8cc2-92ea1e6e782f-node-exporter-wtmp\") pod \"node-exporter-g7qpx\" (UID: \"0ec391d4-00db-40aa-8cc2-92ea1e6e782f\") " pod="openshift-monitoring/node-exporter-g7qpx" Apr 21 00:04:23.588788 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.588678 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ec391d4-00db-40aa-8cc2-92ea1e6e782f-sys\") pod \"node-exporter-g7qpx\" (UID: \"0ec391d4-00db-40aa-8cc2-92ea1e6e782f\") " pod="openshift-monitoring/node-exporter-g7qpx" Apr 21 00:04:23.588788 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:04:23.588684 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ec391d4-00db-40aa-8cc2-92ea1e6e782f-node-exporter-tls podName:0ec391d4-00db-40aa-8cc2-92ea1e6e782f nodeName:}" failed. No retries permitted until 2026-04-21 00:04:24.088664289 +0000 UTC m=+56.524002490 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/0ec391d4-00db-40aa-8cc2-92ea1e6e782f-node-exporter-tls") pod "node-exporter-g7qpx" (UID: "0ec391d4-00db-40aa-8cc2-92ea1e6e782f") : secret "node-exporter-tls" not found Apr 21 00:04:23.588788 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.588739 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/64bfd4c5-2ae7-487a-bd3a-56ed5d10fed3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-69db897b98-bp68h\" (UID: \"64bfd4c5-2ae7-487a-bd3a-56ed5d10fed3\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-bp68h" Apr 21 00:04:23.588788 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:04:23.588751 2576 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Apr 21 00:04:23.588788 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.588780 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0ec391d4-00db-40aa-8cc2-92ea1e6e782f-node-exporter-textfile\") pod \"node-exporter-g7qpx\" (UID: \"0ec391d4-00db-40aa-8cc2-92ea1e6e782f\") " pod="openshift-monitoring/node-exporter-g7qpx" Apr 21 00:04:23.588788 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:04:23.588787 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64bfd4c5-2ae7-487a-bd3a-56ed5d10fed3-kube-state-metrics-tls podName:64bfd4c5-2ae7-487a-bd3a-56ed5d10fed3 nodeName:}" failed. No retries permitted until 2026-04-21 00:04:24.088775759 +0000 UTC m=+56.524113961 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/64bfd4c5-2ae7-487a-bd3a-56ed5d10fed3-kube-state-metrics-tls") pod "kube-state-metrics-69db897b98-bp68h" (UID: "64bfd4c5-2ae7-487a-bd3a-56ed5d10fed3") : secret "kube-state-metrics-tls" not found Apr 21 00:04:23.589619 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.588820 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e90298e-8e0c-4366-8069-2a091a230c45-metrics-client-ca\") pod \"openshift-state-metrics-9d44df66c-hjf9j\" (UID: \"5e90298e-8e0c-4366-8069-2a091a230c45\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-hjf9j" Apr 21 00:04:23.589619 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.588847 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0ec391d4-00db-40aa-8cc2-92ea1e6e782f-root\") pod \"node-exporter-g7qpx\" (UID: \"0ec391d4-00db-40aa-8cc2-92ea1e6e782f\") " pod="openshift-monitoring/node-exporter-g7qpx" Apr 21 00:04:23.589619 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.588885 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64bfd4c5-2ae7-487a-bd3a-56ed5d10fed3-metrics-client-ca\") pod \"kube-state-metrics-69db897b98-bp68h\" (UID: \"64bfd4c5-2ae7-487a-bd3a-56ed5d10fed3\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-bp68h" Apr 21 00:04:23.589619 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.588916 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ec391d4-00db-40aa-8cc2-92ea1e6e782f-metrics-client-ca\") pod \"node-exporter-g7qpx\" (UID: \"0ec391d4-00db-40aa-8cc2-92ea1e6e782f\") " pod="openshift-monitoring/node-exporter-g7qpx" Apr 21 00:04:23.589619 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.588960 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gqn86\" (UniqueName: \"kubernetes.io/projected/5e90298e-8e0c-4366-8069-2a091a230c45-kube-api-access-gqn86\") pod \"openshift-state-metrics-9d44df66c-hjf9j\" (UID: \"5e90298e-8e0c-4366-8069-2a091a230c45\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-hjf9j" Apr 21 00:04:23.589619 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.588990 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rxbnl\" (UniqueName: \"kubernetes.io/projected/0ec391d4-00db-40aa-8cc2-92ea1e6e782f-kube-api-access-rxbnl\") pod \"node-exporter-g7qpx\" (UID: \"0ec391d4-00db-40aa-8cc2-92ea1e6e782f\") " pod="openshift-monitoring/node-exporter-g7qpx" Apr 21 00:04:23.589619 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.589023 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5e90298e-8e0c-4366-8069-2a091a230c45-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9d44df66c-hjf9j\" (UID: \"5e90298e-8e0c-4366-8069-2a091a230c45\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-hjf9j" Apr 21 00:04:23.589619 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.589051 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0ec391d4-00db-40aa-8cc2-92ea1e6e782f-node-exporter-textfile\") pod \"node-exporter-g7qpx\" (UID: \"0ec391d4-00db-40aa-8cc2-92ea1e6e782f\") " pod="openshift-monitoring/node-exporter-g7qpx" Apr 21 00:04:23.589619 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.589073 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0ec391d4-00db-40aa-8cc2-92ea1e6e782f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-g7qpx\" (UID: \"0ec391d4-00db-40aa-8cc2-92ea1e6e782f\") " pod="openshift-monitoring/node-exporter-g7qpx" Apr 21 00:04:23.589619 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.589079 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0ec391d4-00db-40aa-8cc2-92ea1e6e782f-root\") pod \"node-exporter-g7qpx\" (UID: \"0ec391d4-00db-40aa-8cc2-92ea1e6e782f\") " pod="openshift-monitoring/node-exporter-g7qpx" Apr 21 00:04:23.589619 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.589115 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ec391d4-00db-40aa-8cc2-92ea1e6e782f-sys\") pod \"node-exporter-g7qpx\" (UID: \"0ec391d4-00db-40aa-8cc2-92ea1e6e782f\") " pod="openshift-monitoring/node-exporter-g7qpx" Apr 21 00:04:23.589619 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.589466 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/64bfd4c5-2ae7-487a-bd3a-56ed5d10fed3-volume-directive-shadow\") pod \"kube-state-metrics-69db897b98-bp68h\" (UID: \"64bfd4c5-2ae7-487a-bd3a-56ed5d10fed3\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-bp68h" Apr 21 00:04:23.589619 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.589522 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/64bfd4c5-2ae7-487a-bd3a-56ed5d10fed3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-69db897b98-bp68h\" (UID: \"64bfd4c5-2ae7-487a-bd3a-56ed5d10fed3\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-bp68h" Apr 21 00:04:23.590185 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.589696 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0ec391d4-00db-40aa-8cc2-92ea1e6e782f-node-exporter-accelerators-collector-config\") pod \"node-exporter-g7qpx\" (UID: \"0ec391d4-00db-40aa-8cc2-92ea1e6e782f\") " pod="openshift-monitoring/node-exporter-g7qpx" Apr 21 00:04:23.590185 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.589819 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e90298e-8e0c-4366-8069-2a091a230c45-metrics-client-ca\") pod \"openshift-state-metrics-9d44df66c-hjf9j\" (UID: \"5e90298e-8e0c-4366-8069-2a091a230c45\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-hjf9j" Apr 21 00:04:23.590185 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.589890 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64bfd4c5-2ae7-487a-bd3a-56ed5d10fed3-metrics-client-ca\") pod \"kube-state-metrics-69db897b98-bp68h\" (UID: \"64bfd4c5-2ae7-487a-bd3a-56ed5d10fed3\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-bp68h" Apr 21 00:04:23.590185 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.589987 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ec391d4-00db-40aa-8cc2-92ea1e6e782f-metrics-client-ca\") pod \"node-exporter-g7qpx\" (UID: \"0ec391d4-00db-40aa-8cc2-92ea1e6e782f\") " pod="openshift-monitoring/node-exporter-g7qpx" Apr 21 00:04:23.592460 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.592435 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5e90298e-8e0c-4366-8069-2a091a230c45-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9d44df66c-hjf9j\" (UID: \"5e90298e-8e0c-4366-8069-2a091a230c45\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-hjf9j" Apr 21 00:04:23.592460 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.592443 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0ec391d4-00db-40aa-8cc2-92ea1e6e782f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-g7qpx\" (UID: \"0ec391d4-00db-40aa-8cc2-92ea1e6e782f\") " pod="openshift-monitoring/node-exporter-g7qpx" Apr 21 00:04:23.592597 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.592457 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5e90298e-8e0c-4366-8069-2a091a230c45-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9d44df66c-hjf9j\" (UID: \"5e90298e-8e0c-4366-8069-2a091a230c45\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-hjf9j" Apr 21 00:04:23.592597 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.592444 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/64bfd4c5-2ae7-487a-bd3a-56ed5d10fed3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-69db897b98-bp68h\" (UID: \"64bfd4c5-2ae7-487a-bd3a-56ed5d10fed3\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-bp68h" Apr 21 00:04:23.600263 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.600233 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxbnl\" (UniqueName: \"kubernetes.io/projected/0ec391d4-00db-40aa-8cc2-92ea1e6e782f-kube-api-access-rxbnl\") pod \"node-exporter-g7qpx\" (UID: \"0ec391d4-00db-40aa-8cc2-92ea1e6e782f\") " pod="openshift-monitoring/node-exporter-g7qpx" Apr 21 00:04:23.600459 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.600394 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wllwq\" (UniqueName: \"kubernetes.io/projected/64bfd4c5-2ae7-487a-bd3a-56ed5d10fed3-kube-api-access-wllwq\") pod \"kube-state-metrics-69db897b98-bp68h\" (UID: \"64bfd4c5-2ae7-487a-bd3a-56ed5d10fed3\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-bp68h" Apr 21 00:04:23.600931 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.600909 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqn86\" (UniqueName: \"kubernetes.io/projected/5e90298e-8e0c-4366-8069-2a091a230c45-kube-api-access-gqn86\") pod \"openshift-state-metrics-9d44df66c-hjf9j\" (UID: \"5e90298e-8e0c-4366-8069-2a091a230c45\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-hjf9j" Apr 21 00:04:23.602703 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.602679 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-684bdd6bf-lrfm4" event={"ID":"c9a689e8-8774-4fff-9a9f-a774f4fa3564","Type":"ContainerStarted","Data":"6dd0e76d419384ef2bda34c678930426963790a6be255b82b985f59ea62ac9d0"} Apr 21 00:04:23.617957 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.617906 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-684bdd6bf-lrfm4" podStartSLOduration=1.2864741020000001 podStartE2EDuration="4.617875438s" podCreationTimestamp="2026-04-21 00:04:19 +0000 UTC" firstStartedPulling="2026-04-21 00:04:19.913127616 +0000 UTC m=+52.348465819" lastFinishedPulling="2026-04-21 00:04:23.24452894 +0000 UTC m=+55.679867155" observedRunningTime="2026-04-21 00:04:23.617305021 +0000 UTC m=+56.052643249" watchObservedRunningTime="2026-04-21 00:04:23.617875438 +0000 UTC m=+56.053213662" Apr 21 00:04:23.711930 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.711893 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9d44df66c-hjf9j" Apr 21 00:04:23.835680 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:23.835643 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9d44df66c-hjf9j"] Apr 21 00:04:23.839287 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:04:23.839230 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e90298e_8e0c_4366_8069_2a091a230c45.slice/crio-d8f34f60b1a9922de54cca4d94fbe1fab9ff720305bbf3de638be05105b7f7e5 WatchSource:0}: Error finding container d8f34f60b1a9922de54cca4d94fbe1fab9ff720305bbf3de638be05105b7f7e5: Status 404 returned error can't find the container with id d8f34f60b1a9922de54cca4d94fbe1fab9ff720305bbf3de638be05105b7f7e5 Apr 21 00:04:24.094045 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:24.093954 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0ec391d4-00db-40aa-8cc2-92ea1e6e782f-node-exporter-tls\") pod \"node-exporter-g7qpx\" (UID: \"0ec391d4-00db-40aa-8cc2-92ea1e6e782f\") " pod="openshift-monitoring/node-exporter-g7qpx" Apr 21 00:04:24.094045 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:24.093996 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/64bfd4c5-2ae7-487a-bd3a-56ed5d10fed3-kube-state-metrics-tls\") pod \"kube-state-metrics-69db897b98-bp68h\" (UID: \"64bfd4c5-2ae7-487a-bd3a-56ed5d10fed3\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-bp68h" Apr 21 00:04:24.096901 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:24.096875 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/64bfd4c5-2ae7-487a-bd3a-56ed5d10fed3-kube-state-metrics-tls\") pod \"kube-state-metrics-69db897b98-bp68h\" (UID: \"64bfd4c5-2ae7-487a-bd3a-56ed5d10fed3\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-bp68h" Apr 21 00:04:24.097500 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:24.097478 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0ec391d4-00db-40aa-8cc2-92ea1e6e782f-node-exporter-tls\") pod \"node-exporter-g7qpx\" (UID: \"0ec391d4-00db-40aa-8cc2-92ea1e6e782f\") " pod="openshift-monitoring/node-exporter-g7qpx" Apr 21 00:04:24.329180 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:24.329146 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-69db897b98-bp68h" Apr 21 00:04:24.338004 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:24.337967 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-g7qpx" Apr 21 00:04:24.348079 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:04:24.348048 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ec391d4_00db_40aa_8cc2_92ea1e6e782f.slice/crio-6eff1ee40057c7b588dd7c915ee7ecc52315587e0a0c847a8ae0f1f0fee913bd WatchSource:0}: Error finding container 6eff1ee40057c7b588dd7c915ee7ecc52315587e0a0c847a8ae0f1f0fee913bd: Status 404 returned error can't find the container with id 6eff1ee40057c7b588dd7c915ee7ecc52315587e0a0c847a8ae0f1f0fee913bd Apr 21 00:04:24.460477 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:24.460445 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-69db897b98-bp68h"] Apr 21 00:04:24.464176 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:04:24.464116 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64bfd4c5_2ae7_487a_bd3a_56ed5d10fed3.slice/crio-780717ef861264549d0eeef859c599d72c61d2de9006065acf2b4626c43d0caa WatchSource:0}: Error finding container 780717ef861264549d0eeef859c599d72c61d2de9006065acf2b4626c43d0caa: Status 404 returned error can't find the container with id 780717ef861264549d0eeef859c599d72c61d2de9006065acf2b4626c43d0caa Apr 21 00:04:24.487666 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:24.487636 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Apr 21 00:04:24.492230 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:24.492210 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:04:24.495202 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:24.495116 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Apr 21 00:04:24.495202 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:24.495163 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Apr 21 00:04:24.495472 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:24.495448 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Apr 21 00:04:24.495670 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:24.495520 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Apr 21 00:04:24.495670 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:24.495529 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Apr 21 00:04:24.495670 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:24.495561 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-npkj9\"" Apr 21 00:04:24.495670 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:24.495682 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Apr 21 00:04:24.495670 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:24.495817 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Apr 21 00:04:24.495670 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:24.495873 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Apr 21 00:04:24.495670 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:24.495898 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Apr 21 00:04:24.497230 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:24.497212 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:04:24.497338 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:24.497247 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:04:24.497338 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:24.497311 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-config-out\") pod \"alertmanager-main-0\" (UID: \"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:04:24.497441 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:24.497395 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:04:24.497441 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:24.497419 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:04:24.497441 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:24.497436 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:04:24.497589 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:24.497459 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-config-volume\") pod \"alertmanager-main-0\" (UID: \"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:04:24.497589 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:24.497532 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:04:24.497589 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:24.497563 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-web-config\") pod \"alertmanager-main-0\" (UID: \"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:04:24.497729 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:24.497589 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wjf9\" (UniqueName: \"kubernetes.io/projected/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-kube-api-access-6wjf9\") pod \"alertmanager-main-0\" (UID: \"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:04:24.497729 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:24.497615 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:04:24.497729 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:24.497650 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:04:24.497729 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:24.497680 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:04:24.518499 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:24.518469 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Apr 21 00:04:24.598786 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:24.598698 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-config-out\") pod \"alertmanager-main-0\" (UID: \"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:04:24.598786 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:24.598749 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:04:24.598786 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:24.598774 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:04:24.598995 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:24.598894 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:04:24.598995 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:24.598936 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-config-volume\") pod \"alertmanager-main-0\" (UID: \"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:04:24.599123 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:24.599093 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:04:24.599204 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:24.599141 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-web-config\") pod \"alertmanager-main-0\" (UID: \"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:04:24.599204 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:24.599170 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6wjf9\" (UniqueName: \"kubernetes.io/projected/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-kube-api-access-6wjf9\") pod \"alertmanager-main-0\" (UID: \"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:04:24.599302 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:24.599201 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:04:24.599302 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:04:24.599217 2576 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Apr 21 00:04:24.599302 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:24.599242 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:04:24.599302 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:24.599272 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:04:24.599521 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:04:24.599319 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-secret-alertmanager-main-tls podName:85d0b04b-1bef-4c5b-98a5-be1b04f5a27c nodeName:}" failed. No retries permitted until 2026-04-21 00:04:25.099293962 +0000 UTC m=+57.534632176 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "85d0b04b-1bef-4c5b-98a5-be1b04f5a27c") : secret "alertmanager-main-tls" not found Apr 21 00:04:24.599521 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:24.599401 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:04:24.599521 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:24.599432 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:04:24.599678 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:04:24.599603 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-alertmanager-trusted-ca-bundle podName:85d0b04b-1bef-4c5b-98a5-be1b04f5a27c nodeName:}" failed. No retries permitted until 2026-04-21 00:04:25.099589053 +0000 UTC m=+57.534927277 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "85d0b04b-1bef-4c5b-98a5-be1b04f5a27c") : configmap references non-existent config key: ca-bundle.crt Apr 21 00:04:24.600042 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:24.599907 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:04:24.600919 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:24.600892 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:04:24.602039 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:24.601927 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-config-out\") pod \"alertmanager-main-0\" (UID: \"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:04:24.602141 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:24.601992 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:04:24.602286 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:24.602236 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-config-volume\") pod \"alertmanager-main-0\" (UID: \"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:04:24.602286 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:24.602236 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:04:24.602549 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:24.602534 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-web-config\") pod \"alertmanager-main-0\" (UID: \"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:04:24.602649 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:24.602628 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:04:24.603347 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:24.603327 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:04:24.603655 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:24.603633 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:04:24.605932 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:24.605903 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-69db897b98-bp68h" event={"ID":"64bfd4c5-2ae7-487a-bd3a-56ed5d10fed3","Type":"ContainerStarted","Data":"780717ef861264549d0eeef859c599d72c61d2de9006065acf2b4626c43d0caa"} Apr 21 00:04:24.607056 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:24.607030 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g7qpx" event={"ID":"0ec391d4-00db-40aa-8cc2-92ea1e6e782f","Type":"ContainerStarted","Data":"6eff1ee40057c7b588dd7c915ee7ecc52315587e0a0c847a8ae0f1f0fee913bd"} Apr 21 00:04:24.608786 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:24.608767 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9d44df66c-hjf9j" event={"ID":"5e90298e-8e0c-4366-8069-2a091a230c45","Type":"ContainerStarted","Data":"071ccd512279efd4eec224eb8288f56a58c40e7547fcb339fea2365c7d6bc649"} Apr 21 00:04:24.608864 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:24.608792 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9d44df66c-hjf9j" event={"ID":"5e90298e-8e0c-4366-8069-2a091a230c45","Type":"ContainerStarted","Data":"14892190866dab93b991586409e63339b731264b3222da681b340eba0d6f201e"} Apr 21 00:04:24.608864 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:24.608801 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9d44df66c-hjf9j" event={"ID":"5e90298e-8e0c-4366-8069-2a091a230c45","Type":"ContainerStarted","Data":"d8f34f60b1a9922de54cca4d94fbe1fab9ff720305bbf3de638be05105b7f7e5"} Apr 21 00:04:24.610319 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:24.610299 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wjf9\" (UniqueName: \"kubernetes.io/projected/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-kube-api-access-6wjf9\") pod \"alertmanager-main-0\" (UID: \"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:04:25.105268 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:25.105220 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:04:25.105471 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:25.105312 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:04:25.106186 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:25.106163 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:04:25.108737 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:25.108713 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:04:25.401710 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:25.401677 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:04:25.881641 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:25.881411 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Apr 21 00:04:25.974275 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:04:25.974237 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85d0b04b_1bef_4c5b_98a5_be1b04f5a27c.slice/crio-e2535636eb902af491901549fdff55b8f23bb3c16d1748ddfbaa1716c5d3dae6 WatchSource:0}: Error finding container e2535636eb902af491901549fdff55b8f23bb3c16d1748ddfbaa1716c5d3dae6: Status 404 returned error can't find the container with id e2535636eb902af491901549fdff55b8f23bb3c16d1748ddfbaa1716c5d3dae6 Apr 21 00:04:26.617448 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:26.617412 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-69db897b98-bp68h" event={"ID":"64bfd4c5-2ae7-487a-bd3a-56ed5d10fed3","Type":"ContainerStarted","Data":"f345f7e3db97959cd2922dc3eee6e3fa1fa8d7add9433ffeff86cfc49260b321"} Apr 21 00:04:26.617448 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:26.617454 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-69db897b98-bp68h" event={"ID":"64bfd4c5-2ae7-487a-bd3a-56ed5d10fed3","Type":"ContainerStarted","Data":"58cdea5970face1a369d1fdd4fcdeb5afdea9821bfce95fef39627b845dbd2e7"} Apr 21 00:04:26.617448 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:26.617471 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-69db897b98-bp68h" event={"ID":"64bfd4c5-2ae7-487a-bd3a-56ed5d10fed3","Type":"ContainerStarted","Data":"6190e9de38c1c9c8eb61b3847fdd5a0201613be66e55846a372ce99734c71f09"} Apr 21 00:04:26.618967 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:26.618933 2576 generic.go:358] "Generic (PLEG): container finished" podID="0ec391d4-00db-40aa-8cc2-92ea1e6e782f" containerID="20193df50eb150416f6a0c2e388699e0ade60070ca268a09069642dfddbe2696" exitCode=0 Apr 21 00:04:26.619090 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:26.619019 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g7qpx" event={"ID":"0ec391d4-00db-40aa-8cc2-92ea1e6e782f","Type":"ContainerDied","Data":"20193df50eb150416f6a0c2e388699e0ade60070ca268a09069642dfddbe2696"} Apr 21 00:04:26.621187 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:26.621160 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9d44df66c-hjf9j" event={"ID":"5e90298e-8e0c-4366-8069-2a091a230c45","Type":"ContainerStarted","Data":"9772fcce883de4ba927ec081b6b9c68f5d2251b39ba727bd260e918e929be1b8"} Apr 21 00:04:26.622481 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:26.622453 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c","Type":"ContainerStarted","Data":"e2535636eb902af491901549fdff55b8f23bb3c16d1748ddfbaa1716c5d3dae6"} Apr 21 00:04:26.638756 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:26.638702 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-69db897b98-bp68h" podStartSLOduration=2.144095755 podStartE2EDuration="3.63868159s" podCreationTimestamp="2026-04-21 00:04:23 +0000 UTC" firstStartedPulling="2026-04-21 00:04:24.466376239 +0000 UTC m=+56.901714455" lastFinishedPulling="2026-04-21 00:04:25.960962086 +0000 UTC m=+58.396300290" observedRunningTime="2026-04-21 00:04:26.637413995 +0000 UTC m=+59.072752214" watchObservedRunningTime="2026-04-21 00:04:26.63868159 +0000 UTC m=+59.074019815" Apr 21 00:04:26.660325 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:26.660266 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9d44df66c-hjf9j" podStartSLOduration=1.884807845 podStartE2EDuration="3.66024581s" podCreationTimestamp="2026-04-21 00:04:23 +0000 UTC" firstStartedPulling="2026-04-21 00:04:23.973678431 +0000 UTC m=+56.409016634" lastFinishedPulling="2026-04-21 00:04:25.749116383 +0000 UTC m=+58.184454599" observedRunningTime="2026-04-21 00:04:26.660200339 +0000 UTC m=+59.095538565" watchObservedRunningTime="2026-04-21 00:04:26.66024581 +0000 UTC m=+59.095584034" Apr 21 00:04:27.536144 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:27.536113 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wmfb9" Apr 21 00:04:27.627640 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:27.627604 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g7qpx" event={"ID":"0ec391d4-00db-40aa-8cc2-92ea1e6e782f","Type":"ContainerStarted","Data":"9bd3eb5e05da0797baeec28fbbdabe1a721567238cdbdba9ec1d2f4a63fe3c45"} Apr 21 00:04:27.627640 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:27.627647 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g7qpx" event={"ID":"0ec391d4-00db-40aa-8cc2-92ea1e6e782f","Type":"ContainerStarted","Data":"2681b0f0801089b9d7412160b99f0925a04df757866fb5254b25cc703c7dad87"} Apr 21 00:04:27.629054 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:27.629018 2576 generic.go:358] "Generic (PLEG): container finished" podID="85d0b04b-1bef-4c5b-98a5-be1b04f5a27c" containerID="13b8a0f630a51cd66bc7fcc2526a8b09b7bd19a1486a9056d9cb7fcfbdbc1cba" exitCode=0 Apr 21 00:04:27.629171 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:27.629095 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c","Type":"ContainerDied","Data":"13b8a0f630a51cd66bc7fcc2526a8b09b7bd19a1486a9056d9cb7fcfbdbc1cba"} Apr 21 00:04:27.645951 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:27.645897 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-g7qpx" podStartSLOduration=3.246941782 podStartE2EDuration="4.645877224s" podCreationTimestamp="2026-04-21 00:04:23 +0000 UTC" firstStartedPulling="2026-04-21 00:04:24.350179115 +0000 UTC m=+56.785517321" lastFinishedPulling="2026-04-21 00:04:25.749114546 +0000 UTC m=+58.184452763" observedRunningTime="2026-04-21 00:04:27.644894752 +0000 UTC m=+60.080232987" watchObservedRunningTime="2026-04-21 00:04:27.645877224 +0000 UTC m=+60.081215448" Apr 21 00:04:27.814654 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:27.814574 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-797f884dc7-jn6zz"] Apr 21 00:04:27.816896 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:27.816874 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-797f884dc7-jn6zz" Apr 21 00:04:27.819350 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:27.819319 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Apr 21 00:04:27.819521 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:27.819329 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Apr 21 00:04:27.819521 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:27.819397 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-498l6\"" Apr 21 00:04:27.819521 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:27.819333 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-ec1rmsjufo19t\"" Apr 21 00:04:27.819521 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:27.819449 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Apr 21 00:04:27.819521 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:27.819331 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Apr 21 00:04:27.826195 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:27.826164 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-797f884dc7-jn6zz"] Apr 21 00:04:27.828745 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:27.828720 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5956373d-aa90-4f53-b88b-8c6cddeae5ac-metrics-server-audit-profiles\") pod \"metrics-server-797f884dc7-jn6zz\" (UID: \"5956373d-aa90-4f53-b88b-8c6cddeae5ac\") " pod="openshift-monitoring/metrics-server-797f884dc7-jn6zz" Apr 21 00:04:27.828875 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:27.828787 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5956373d-aa90-4f53-b88b-8c6cddeae5ac-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-797f884dc7-jn6zz\" (UID: \"5956373d-aa90-4f53-b88b-8c6cddeae5ac\") " pod="openshift-monitoring/metrics-server-797f884dc7-jn6zz" Apr 21 00:04:27.828875 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:27.828849 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5956373d-aa90-4f53-b88b-8c6cddeae5ac-secret-metrics-server-tls\") pod \"metrics-server-797f884dc7-jn6zz\" (UID: \"5956373d-aa90-4f53-b88b-8c6cddeae5ac\") " pod="openshift-monitoring/metrics-server-797f884dc7-jn6zz" Apr 21 00:04:27.828966 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:27.828895 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2bbv\" (UniqueName: \"kubernetes.io/projected/5956373d-aa90-4f53-b88b-8c6cddeae5ac-kube-api-access-x2bbv\") pod \"metrics-server-797f884dc7-jn6zz\" (UID: \"5956373d-aa90-4f53-b88b-8c6cddeae5ac\") " pod="openshift-monitoring/metrics-server-797f884dc7-jn6zz" Apr 21 00:04:27.828966 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:27.828959 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5956373d-aa90-4f53-b88b-8c6cddeae5ac-audit-log\") pod \"metrics-server-797f884dc7-jn6zz\" (UID: \"5956373d-aa90-4f53-b88b-8c6cddeae5ac\") " pod="openshift-monitoring/metrics-server-797f884dc7-jn6zz" Apr 21 00:04:27.829044 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:27.828981 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5956373d-aa90-4f53-b88b-8c6cddeae5ac-client-ca-bundle\") pod \"metrics-server-797f884dc7-jn6zz\" (UID: \"5956373d-aa90-4f53-b88b-8c6cddeae5ac\") " pod="openshift-monitoring/metrics-server-797f884dc7-jn6zz" Apr 21 00:04:27.829087 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:27.829039 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5956373d-aa90-4f53-b88b-8c6cddeae5ac-secret-metrics-server-client-certs\") pod \"metrics-server-797f884dc7-jn6zz\" (UID: \"5956373d-aa90-4f53-b88b-8c6cddeae5ac\") " pod="openshift-monitoring/metrics-server-797f884dc7-jn6zz" Apr 21 00:04:27.929910 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:27.929876 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5956373d-aa90-4f53-b88b-8c6cddeae5ac-metrics-server-audit-profiles\") pod \"metrics-server-797f884dc7-jn6zz\" (UID: \"5956373d-aa90-4f53-b88b-8c6cddeae5ac\") " pod="openshift-monitoring/metrics-server-797f884dc7-jn6zz" Apr 21 00:04:27.930087 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:27.929942 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5956373d-aa90-4f53-b88b-8c6cddeae5ac-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-797f884dc7-jn6zz\" (UID: \"5956373d-aa90-4f53-b88b-8c6cddeae5ac\") " pod="openshift-monitoring/metrics-server-797f884dc7-jn6zz" Apr 21 00:04:27.930087 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:27.929976 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5956373d-aa90-4f53-b88b-8c6cddeae5ac-secret-metrics-server-tls\") pod \"metrics-server-797f884dc7-jn6zz\" (UID: \"5956373d-aa90-4f53-b88b-8c6cddeae5ac\") " pod="openshift-monitoring/metrics-server-797f884dc7-jn6zz" Apr 21 00:04:27.930087 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:27.930001 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x2bbv\" (UniqueName: \"kubernetes.io/projected/5956373d-aa90-4f53-b88b-8c6cddeae5ac-kube-api-access-x2bbv\") pod \"metrics-server-797f884dc7-jn6zz\" (UID: \"5956373d-aa90-4f53-b88b-8c6cddeae5ac\") " pod="openshift-monitoring/metrics-server-797f884dc7-jn6zz" Apr 21 00:04:27.930087 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:27.930049 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5956373d-aa90-4f53-b88b-8c6cddeae5ac-audit-log\") pod \"metrics-server-797f884dc7-jn6zz\" (UID: \"5956373d-aa90-4f53-b88b-8c6cddeae5ac\") " pod="openshift-monitoring/metrics-server-797f884dc7-jn6zz" Apr 21 00:04:27.930087 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:27.930074 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5956373d-aa90-4f53-b88b-8c6cddeae5ac-client-ca-bundle\") pod \"metrics-server-797f884dc7-jn6zz\" (UID: \"5956373d-aa90-4f53-b88b-8c6cddeae5ac\") " pod="openshift-monitoring/metrics-server-797f884dc7-jn6zz" Apr 21 00:04:27.930338 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:27.930245 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5956373d-aa90-4f53-b88b-8c6cddeae5ac-secret-metrics-server-client-certs\") pod \"metrics-server-797f884dc7-jn6zz\" (UID: \"5956373d-aa90-4f53-b88b-8c6cddeae5ac\") " pod="openshift-monitoring/metrics-server-797f884dc7-jn6zz" Apr 21 00:04:27.930526 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:27.930507 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5956373d-aa90-4f53-b88b-8c6cddeae5ac-audit-log\") pod \"metrics-server-797f884dc7-jn6zz\" (UID: \"5956373d-aa90-4f53-b88b-8c6cddeae5ac\") " pod="openshift-monitoring/metrics-server-797f884dc7-jn6zz" Apr 21 00:04:27.931207 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:27.931183 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5956373d-aa90-4f53-b88b-8c6cddeae5ac-metrics-server-audit-profiles\") pod \"metrics-server-797f884dc7-jn6zz\" (UID: \"5956373d-aa90-4f53-b88b-8c6cddeae5ac\") " pod="openshift-monitoring/metrics-server-797f884dc7-jn6zz" Apr 21 00:04:27.931379 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:27.931343 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5956373d-aa90-4f53-b88b-8c6cddeae5ac-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-797f884dc7-jn6zz\" (UID: \"5956373d-aa90-4f53-b88b-8c6cddeae5ac\") " pod="openshift-monitoring/metrics-server-797f884dc7-jn6zz" Apr 21 00:04:27.932785 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:27.932760 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5956373d-aa90-4f53-b88b-8c6cddeae5ac-client-ca-bundle\") pod \"metrics-server-797f884dc7-jn6zz\" (UID: \"5956373d-aa90-4f53-b88b-8c6cddeae5ac\") " pod="openshift-monitoring/metrics-server-797f884dc7-jn6zz" Apr 21 00:04:27.932866 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:27.932799 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5956373d-aa90-4f53-b88b-8c6cddeae5ac-secret-metrics-server-client-certs\") pod \"metrics-server-797f884dc7-jn6zz\" (UID: \"5956373d-aa90-4f53-b88b-8c6cddeae5ac\") " pod="openshift-monitoring/metrics-server-797f884dc7-jn6zz" Apr 21 00:04:27.932920 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:27.932883 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5956373d-aa90-4f53-b88b-8c6cddeae5ac-secret-metrics-server-tls\") pod \"metrics-server-797f884dc7-jn6zz\" (UID: \"5956373d-aa90-4f53-b88b-8c6cddeae5ac\") " pod="openshift-monitoring/metrics-server-797f884dc7-jn6zz" Apr 21 00:04:27.937593 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:27.937568 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2bbv\" (UniqueName: \"kubernetes.io/projected/5956373d-aa90-4f53-b88b-8c6cddeae5ac-kube-api-access-x2bbv\") pod \"metrics-server-797f884dc7-jn6zz\" (UID: \"5956373d-aa90-4f53-b88b-8c6cddeae5ac\") " pod="openshift-monitoring/metrics-server-797f884dc7-jn6zz" Apr 21 00:04:28.129114 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:28.129085 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-498l6\"" Apr 21 00:04:28.136984 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:28.136957 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-797f884dc7-jn6zz" Apr 21 00:04:28.219340 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:28.219304 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7dccd58f55-ttbcz"] Apr 21 00:04:28.224287 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:28.223031 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7dccd58f55-ttbcz" Apr 21 00:04:28.225791 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:28.225751 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Apr 21 00:04:28.226088 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:28.226032 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-c9x88\"" Apr 21 00:04:28.229551 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:28.228269 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7dccd58f55-ttbcz"] Apr 21 00:04:28.286615 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:28.286562 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-797f884dc7-jn6zz"] Apr 21 00:04:28.294641 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:04:28.294610 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5956373d_aa90_4f53_b88b_8c6cddeae5ac.slice/crio-edce9332e4f9547fe97e60e8468d8e7343c8d63cf1d6538ce04ab8c6492183b4 WatchSource:0}: Error finding container edce9332e4f9547fe97e60e8468d8e7343c8d63cf1d6538ce04ab8c6492183b4: Status 404 returned error can't find the container with id edce9332e4f9547fe97e60e8468d8e7343c8d63cf1d6538ce04ab8c6492183b4 Apr 21 00:04:28.333540 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:28.333507 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/890ff55d-1265-4f2d-9996-2aacce7d531f-monitoring-plugin-cert\") pod \"monitoring-plugin-7dccd58f55-ttbcz\" (UID: \"890ff55d-1265-4f2d-9996-2aacce7d531f\") " pod="openshift-monitoring/monitoring-plugin-7dccd58f55-ttbcz" Apr 21 00:04:28.434901 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:28.434815 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/890ff55d-1265-4f2d-9996-2aacce7d531f-monitoring-plugin-cert\") pod \"monitoring-plugin-7dccd58f55-ttbcz\" (UID: \"890ff55d-1265-4f2d-9996-2aacce7d531f\") " pod="openshift-monitoring/monitoring-plugin-7dccd58f55-ttbcz" Apr 21 00:04:28.437621 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:28.437589 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/890ff55d-1265-4f2d-9996-2aacce7d531f-monitoring-plugin-cert\") pod \"monitoring-plugin-7dccd58f55-ttbcz\" (UID: \"890ff55d-1265-4f2d-9996-2aacce7d531f\") " pod="openshift-monitoring/monitoring-plugin-7dccd58f55-ttbcz" Apr 21 00:04:28.546324 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:28.546288 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7dccd58f55-ttbcz" Apr 21 00:04:28.586506 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:28.586475 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7smln" Apr 21 00:04:28.633964 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:28.633909 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-797f884dc7-jn6zz" event={"ID":"5956373d-aa90-4f53-b88b-8c6cddeae5ac","Type":"ContainerStarted","Data":"edce9332e4f9547fe97e60e8468d8e7343c8d63cf1d6538ce04ab8c6492183b4"} Apr 21 00:04:28.684778 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:28.684744 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7dccd58f55-ttbcz"] Apr 21 00:04:28.687685 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:04:28.687656 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod890ff55d_1265_4f2d_9996_2aacce7d531f.slice/crio-79eda2c1dd9957d46470878aba7942742180303c11ad8457134a941d85439ef8 WatchSource:0}: Error finding container 79eda2c1dd9957d46470878aba7942742180303c11ad8457134a941d85439ef8: Status 404 returned error can't find the container with id 79eda2c1dd9957d46470878aba7942742180303c11ad8457134a941d85439ef8 Apr 21 00:04:29.600666 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.599945 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-684bdd6bf-lrfm4" Apr 21 00:04:29.600666 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.600007 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-684bdd6bf-lrfm4" Apr 21 00:04:29.609492 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.609457 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-684bdd6bf-lrfm4" Apr 21 00:04:29.613920 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.611889 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Apr 21 00:04:29.615588 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.615562 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:04:29.618051 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.618025 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Apr 21 00:04:29.623540 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.621418 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Apr 21 00:04:29.623540 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.621691 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8kmi8rj1b5ti8\"" Apr 21 00:04:29.625103 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.623858 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Apr 21 00:04:29.625103 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.624078 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Apr 21 00:04:29.625103 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.624288 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-tv545\"" Apr 21 00:04:29.625103 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.624633 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Apr 21 00:04:29.625103 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.624836 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Apr 21 00:04:29.625103 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.625022 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Apr 21 00:04:29.625519 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.625201 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Apr 21 00:04:29.625519 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.625403 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Apr 21 00:04:29.625605 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.625564 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Apr 21 00:04:29.625875 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.625754 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Apr 21 00:04:29.627038 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.625993 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Apr 21 00:04:29.630299 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.630281 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Apr 21 00:04:29.641680 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.641590 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7dccd58f55-ttbcz" event={"ID":"890ff55d-1265-4f2d-9996-2aacce7d531f","Type":"ContainerStarted","Data":"79eda2c1dd9957d46470878aba7942742180303c11ad8457134a941d85439ef8"} Apr 21 00:04:29.649398 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.647168 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-684bdd6bf-lrfm4" Apr 21 00:04:29.650284 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.650244 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/840f2b50-b403-421e-a3c3-b29727f4fd46-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:04:29.650442 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.650297 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/840f2b50-b403-421e-a3c3-b29727f4fd46-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:04:29.650442 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.650327 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/840f2b50-b403-421e-a3c3-b29727f4fd46-config\") pod \"prometheus-k8s-0\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:04:29.650560 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.650440 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/840f2b50-b403-421e-a3c3-b29727f4fd46-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:04:29.650560 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.650465 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/840f2b50-b403-421e-a3c3-b29727f4fd46-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:04:29.650560 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.650500 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/840f2b50-b403-421e-a3c3-b29727f4fd46-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:04:29.650560 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.650528 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/840f2b50-b403-421e-a3c3-b29727f4fd46-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:04:29.650560 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.650551 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvzz8\" (UniqueName: \"kubernetes.io/projected/840f2b50-b403-421e-a3c3-b29727f4fd46-kube-api-access-cvzz8\") pod \"prometheus-k8s-0\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:04:29.650792 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.650607 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/840f2b50-b403-421e-a3c3-b29727f4fd46-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:04:29.650792 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.650649 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/840f2b50-b403-421e-a3c3-b29727f4fd46-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:04:29.650792 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.650671 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/840f2b50-b403-421e-a3c3-b29727f4fd46-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:04:29.650792 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.650700 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/840f2b50-b403-421e-a3c3-b29727f4fd46-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:04:29.650792 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.650732 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/840f2b50-b403-421e-a3c3-b29727f4fd46-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:04:29.650792 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.650758 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/840f2b50-b403-421e-a3c3-b29727f4fd46-config-out\") pod \"prometheus-k8s-0\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:04:29.650792 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.650783 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/840f2b50-b403-421e-a3c3-b29727f4fd46-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:04:29.651103 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.650812 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/840f2b50-b403-421e-a3c3-b29727f4fd46-web-config\") pod \"prometheus-k8s-0\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:04:29.651103 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.650860 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/840f2b50-b403-421e-a3c3-b29727f4fd46-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:04:29.651103 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.650946 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/840f2b50-b403-421e-a3c3-b29727f4fd46-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:04:29.752161 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.752122 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/840f2b50-b403-421e-a3c3-b29727f4fd46-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:04:29.752348 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.752190 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/840f2b50-b403-421e-a3c3-b29727f4fd46-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:04:29.752348 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.752231 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/840f2b50-b403-421e-a3c3-b29727f4fd46-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:04:29.752348 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.752254 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/840f2b50-b403-421e-a3c3-b29727f4fd46-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:04:29.752348 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.752279 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cvzz8\" (UniqueName: \"kubernetes.io/projected/840f2b50-b403-421e-a3c3-b29727f4fd46-kube-api-access-cvzz8\") pod \"prometheus-k8s-0\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:04:29.752742 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.752720 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/840f2b50-b403-421e-a3c3-b29727f4fd46-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:04:29.752801 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.752768 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/840f2b50-b403-421e-a3c3-b29727f4fd46-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:04:29.752801 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.752796 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/840f2b50-b403-421e-a3c3-b29727f4fd46-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:04:29.752910 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.752819 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/840f2b50-b403-421e-a3c3-b29727f4fd46-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:04:29.752910 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.752840 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/840f2b50-b403-421e-a3c3-b29727f4fd46-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:04:29.752910 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.752859 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/840f2b50-b403-421e-a3c3-b29727f4fd46-config-out\") pod \"prometheus-k8s-0\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:04:29.752910 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.752874 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/840f2b50-b403-421e-a3c3-b29727f4fd46-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:04:29.752910 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.752897 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/840f2b50-b403-421e-a3c3-b29727f4fd46-web-config\") pod \"prometheus-k8s-0\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:04:29.753148 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.752929 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/840f2b50-b403-421e-a3c3-b29727f4fd46-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:04:29.753148 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.752984 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/840f2b50-b403-421e-a3c3-b29727f4fd46-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:04:29.753148 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.752991 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/840f2b50-b403-421e-a3c3-b29727f4fd46-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:04:29.753148 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.753021 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/840f2b50-b403-421e-a3c3-b29727f4fd46-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:04:29.757901 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.753669 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/840f2b50-b403-421e-a3c3-b29727f4fd46-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:04:29.757901 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.753716 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/840f2b50-b403-421e-a3c3-b29727f4fd46-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:04:29.757901 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.753749 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/840f2b50-b403-421e-a3c3-b29727f4fd46-config\") pod \"prometheus-k8s-0\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:04:29.757901 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.753824 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/840f2b50-b403-421e-a3c3-b29727f4fd46-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:04:29.758315 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.758288 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/840f2b50-b403-421e-a3c3-b29727f4fd46-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:04:29.762265 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.761137 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/840f2b50-b403-421e-a3c3-b29727f4fd46-config-out\") pod \"prometheus-k8s-0\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:04:29.762265 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.761536 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/840f2b50-b403-421e-a3c3-b29727f4fd46-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:04:29.762265 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.761553 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/840f2b50-b403-421e-a3c3-b29727f4fd46-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:04:29.762265 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.761976 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/840f2b50-b403-421e-a3c3-b29727f4fd46-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:04:29.762623 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.762449 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/840f2b50-b403-421e-a3c3-b29727f4fd46-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:04:29.763529 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.763469 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/840f2b50-b403-421e-a3c3-b29727f4fd46-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:04:29.763789 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.763765 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvzz8\" (UniqueName: \"kubernetes.io/projected/840f2b50-b403-421e-a3c3-b29727f4fd46-kube-api-access-cvzz8\") pod \"prometheus-k8s-0\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:04:29.764245 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.764222 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/840f2b50-b403-421e-a3c3-b29727f4fd46-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:04:29.765191 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.765168 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/840f2b50-b403-421e-a3c3-b29727f4fd46-config\") pod \"prometheus-k8s-0\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:04:29.765713 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.765691 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/840f2b50-b403-421e-a3c3-b29727f4fd46-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:04:29.767656 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.767635 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/840f2b50-b403-421e-a3c3-b29727f4fd46-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:04:29.769870 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.769241 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/840f2b50-b403-421e-a3c3-b29727f4fd46-web-config\") pod \"prometheus-k8s-0\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:04:29.769870 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.769833 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/840f2b50-b403-421e-a3c3-b29727f4fd46-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:04:29.770919 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.770877 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/840f2b50-b403-421e-a3c3-b29727f4fd46-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:04:29.935871 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:29.935844 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:04:30.120542 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:30.120484 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Apr 21 00:04:30.126029 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:04:30.125906 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod840f2b50_b403_421e_a3c3_b29727f4fd46.slice/crio-963b4d5871e63bffc917cfbf8a104760c4c5f79d8f22e8331d50b72a6497e571 WatchSource:0}: Error finding container 963b4d5871e63bffc917cfbf8a104760c4c5f79d8f22e8331d50b72a6497e571: Status 404 returned error can't find the container with id 963b4d5871e63bffc917cfbf8a104760c4c5f79d8f22e8331d50b72a6497e571 Apr 21 00:04:30.647406 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:30.647342 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c","Type":"ContainerStarted","Data":"5dd8c6b14e100156dd197e3864305b4ab6e816ef4bfea9342dc3b077b8809f88"} Apr 21 00:04:30.647791 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:30.647417 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c","Type":"ContainerStarted","Data":"4c00fc0167058a8322abcadb02f47436a151906a7fbe506749fc937a87671532"} Apr 21 00:04:30.647791 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:30.647430 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c","Type":"ContainerStarted","Data":"1873d4ed9d45061c62f1a54e9e90cce8af28ba2a1e059ec748edacc01cf65eb1"} Apr 21 00:04:30.647791 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:30.647443 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c","Type":"ContainerStarted","Data":"7dbf6d97adb0163b8ee43f64a27c902b9942960839a9379e97e16b9158b243d2"} Apr 21 00:04:30.649156 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:30.649015 2576 generic.go:358] "Generic (PLEG): container finished" podID="840f2b50-b403-421e-a3c3-b29727f4fd46" containerID="3efbfafeee2de1a40fab8f87e698669f225673cc0300e26bd583f4aae2810c54" exitCode=0 Apr 21 00:04:30.649156 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:30.649105 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"840f2b50-b403-421e-a3c3-b29727f4fd46","Type":"ContainerDied","Data":"3efbfafeee2de1a40fab8f87e698669f225673cc0300e26bd583f4aae2810c54"} Apr 21 00:04:30.649156 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:30.649130 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"840f2b50-b403-421e-a3c3-b29727f4fd46","Type":"ContainerStarted","Data":"963b4d5871e63bffc917cfbf8a104760c4c5f79d8f22e8331d50b72a6497e571"} Apr 21 00:04:30.650852 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:30.650680 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-797f884dc7-jn6zz" event={"ID":"5956373d-aa90-4f53-b88b-8c6cddeae5ac","Type":"ContainerStarted","Data":"5f78718e9903c8438ccd9c68e3027736bb2d3f547c959babae4801f60f836221"} Apr 21 00:04:30.687063 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:30.687004 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-797f884dc7-jn6zz" podStartSLOduration=2.048573227 podStartE2EDuration="3.686984554s" podCreationTimestamp="2026-04-21 00:04:27 +0000 UTC" firstStartedPulling="2026-04-21 00:04:28.29746281 +0000 UTC m=+60.732801016" lastFinishedPulling="2026-04-21 00:04:29.935874128 +0000 UTC m=+62.371212343" observedRunningTime="2026-04-21 00:04:30.686474901 +0000 UTC m=+63.121813126" watchObservedRunningTime="2026-04-21 00:04:30.686984554 +0000 UTC m=+63.122322778" Apr 21 00:04:31.659889 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:31.659848 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c","Type":"ContainerStarted","Data":"9bf05342a4ccf20d540da69e378abfad0940ee22bf2826855731b672fd499e8d"} Apr 21 00:04:31.661573 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:31.661533 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7dccd58f55-ttbcz" event={"ID":"890ff55d-1265-4f2d-9996-2aacce7d531f","Type":"ContainerStarted","Data":"c80a7d0bc6af07f3d61e3d2cbc094ab7cb7bf3a7b36a8c4481b9dddd70d6dffb"} Apr 21 00:04:31.661944 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:31.661922 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7dccd58f55-ttbcz" Apr 21 00:04:31.667630 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:31.667594 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7dccd58f55-ttbcz" Apr 21 00:04:31.676259 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:31.676202 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7dccd58f55-ttbcz" podStartSLOduration=1.7670976170000001 podStartE2EDuration="3.676180931s" podCreationTimestamp="2026-04-21 00:04:28 +0000 UTC" firstStartedPulling="2026-04-21 00:04:28.689782901 +0000 UTC m=+61.125121106" lastFinishedPulling="2026-04-21 00:04:30.598866215 +0000 UTC m=+63.034204420" observedRunningTime="2026-04-21 00:04:31.674750519 +0000 UTC m=+64.110088743" watchObservedRunningTime="2026-04-21 00:04:31.676180931 +0000 UTC m=+64.111519160" Apr 21 00:04:32.669212 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:32.669173 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c","Type":"ContainerStarted","Data":"185f882925151ae133d058e1ac2ff17232a8fc7d20109504666b370cdd5a183b"} Apr 21 00:04:32.695820 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:32.695765 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.7158774660000002 podStartE2EDuration="8.695746137s" podCreationTimestamp="2026-04-21 00:04:24 +0000 UTC" firstStartedPulling="2026-04-21 00:04:25.976466639 +0000 UTC m=+58.411804844" lastFinishedPulling="2026-04-21 00:04:31.956335299 +0000 UTC m=+64.391673515" observedRunningTime="2026-04-21 00:04:32.693197765 +0000 UTC m=+65.128535988" watchObservedRunningTime="2026-04-21 00:04:32.695746137 +0000 UTC m=+65.131084361" Apr 21 00:04:32.986394 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:32.986269 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65f5aca2-9fa7-4b19-b02f-0dd809899f41-metrics-certs\") pod \"network-metrics-daemon-lr9hq\" (UID: \"65f5aca2-9fa7-4b19-b02f-0dd809899f41\") " pod="openshift-multus/network-metrics-daemon-lr9hq" Apr 21 00:04:32.988791 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:32.988765 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Apr 21 00:04:32.999468 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:32.999423 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65f5aca2-9fa7-4b19-b02f-0dd809899f41-metrics-certs\") pod \"network-metrics-daemon-lr9hq\" (UID: \"65f5aca2-9fa7-4b19-b02f-0dd809899f41\") " pod="openshift-multus/network-metrics-daemon-lr9hq" Apr 21 00:04:33.025526 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:33.025493 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-n52qc\"" Apr 21 00:04:33.033485 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:33.033443 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lr9hq" Apr 21 00:04:33.087091 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:33.087041 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4qbl8\" (UniqueName: \"kubernetes.io/projected/526918a6-6456-4ee9-b13d-ca26cfea5695-kube-api-access-4qbl8\") pod \"network-check-target-d5vdn\" (UID: \"526918a6-6456-4ee9-b13d-ca26cfea5695\") " pod="openshift-network-diagnostics/network-check-target-d5vdn" Apr 21 00:04:33.089692 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:33.089665 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Apr 21 00:04:33.099913 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:33.099885 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Apr 21 00:04:33.110937 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:33.110909 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qbl8\" (UniqueName: \"kubernetes.io/projected/526918a6-6456-4ee9-b13d-ca26cfea5695-kube-api-access-4qbl8\") pod \"network-check-target-d5vdn\" (UID: \"526918a6-6456-4ee9-b13d-ca26cfea5695\") " pod="openshift-network-diagnostics/network-check-target-d5vdn" Apr 21 00:04:33.347308 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:33.347160 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-24wfg\"" Apr 21 00:04:33.355014 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:33.354984 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d5vdn" Apr 21 00:04:33.409573 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:33.409538 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lr9hq"] Apr 21 00:04:33.499544 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:33.499482 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-d5vdn"] Apr 21 00:04:33.502963 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:04:33.502930 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod526918a6_6456_4ee9_b13d_ca26cfea5695.slice/crio-693f36acd9dc4cea1190e41ddb57297315f8227f15cee8db6b7901452cdc2ae3 WatchSource:0}: Error finding container 693f36acd9dc4cea1190e41ddb57297315f8227f15cee8db6b7901452cdc2ae3: Status 404 returned error can't find the container with id 693f36acd9dc4cea1190e41ddb57297315f8227f15cee8db6b7901452cdc2ae3 Apr 21 00:04:33.673602 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:33.673561 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-d5vdn" event={"ID":"526918a6-6456-4ee9-b13d-ca26cfea5695","Type":"ContainerStarted","Data":"693f36acd9dc4cea1190e41ddb57297315f8227f15cee8db6b7901452cdc2ae3"} Apr 21 00:04:33.675804 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:33.675769 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"840f2b50-b403-421e-a3c3-b29727f4fd46","Type":"ContainerStarted","Data":"262c6c5743ead33e41210b4c42d7b68a659cd5951873b3b6d4941dd916f324c5"} Apr 21 00:04:33.675924 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:33.675812 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"840f2b50-b403-421e-a3c3-b29727f4fd46","Type":"ContainerStarted","Data":"7316214a82653f68f94bfe1b6bbf36031899e47abe0f5857ae4ebdb09d6c3cde"} Apr 21 00:04:33.676852 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:33.676810 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lr9hq" event={"ID":"65f5aca2-9fa7-4b19-b02f-0dd809899f41","Type":"ContainerStarted","Data":"2f1f7e025963da89d38eaf7b81171b82666538efaf664b18fd969975a2ee9442"} Apr 21 00:04:33.710459 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:33.710422 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-54859dff79-d49nb"] Apr 21 00:04:33.713477 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:33.713450 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54859dff79-d49nb" Apr 21 00:04:33.720817 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:33.720752 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Apr 21 00:04:33.724018 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:33.723988 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54859dff79-d49nb"] Apr 21 00:04:33.792819 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:33.792776 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed-console-oauth-config\") pod \"console-54859dff79-d49nb\" (UID: \"ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed\") " pod="openshift-console/console-54859dff79-d49nb" Apr 21 00:04:33.793014 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:33.792877 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed-trusted-ca-bundle\") pod \"console-54859dff79-d49nb\" (UID: \"ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed\") " pod="openshift-console/console-54859dff79-d49nb" Apr 21 00:04:33.793210 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:33.793185 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s74xw\" (UniqueName: \"kubernetes.io/projected/ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed-kube-api-access-s74xw\") pod \"console-54859dff79-d49nb\" (UID: \"ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed\") " pod="openshift-console/console-54859dff79-d49nb" Apr 21 00:04:33.793329 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:33.793311 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed-console-serving-cert\") pod \"console-54859dff79-d49nb\" (UID: \"ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed\") " pod="openshift-console/console-54859dff79-d49nb" Apr 21 00:04:33.793415 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:33.793401 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed-service-ca\") pod \"console-54859dff79-d49nb\" (UID: \"ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed\") " pod="openshift-console/console-54859dff79-d49nb" Apr 21 00:04:33.793473 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:33.793432 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed-oauth-serving-cert\") pod \"console-54859dff79-d49nb\" (UID: \"ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed\") " pod="openshift-console/console-54859dff79-d49nb" Apr 21 00:04:33.793473 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:33.793464 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed-console-config\") pod \"console-54859dff79-d49nb\" (UID: \"ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed\") " pod="openshift-console/console-54859dff79-d49nb" Apr 21 00:04:33.894564 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:33.894513 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed-console-oauth-config\") pod \"console-54859dff79-d49nb\" (UID: \"ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed\") " pod="openshift-console/console-54859dff79-d49nb" Apr 21 00:04:33.894564 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:33.894568 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed-trusted-ca-bundle\") pod \"console-54859dff79-d49nb\" (UID: \"ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed\") " pod="openshift-console/console-54859dff79-d49nb" Apr 21 00:04:33.894806 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:33.894607 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s74xw\" (UniqueName: \"kubernetes.io/projected/ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed-kube-api-access-s74xw\") pod \"console-54859dff79-d49nb\" (UID: \"ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed\") " pod="openshift-console/console-54859dff79-d49nb" Apr 21 00:04:33.894806 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:33.894664 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed-console-serving-cert\") pod \"console-54859dff79-d49nb\" (UID: \"ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed\") " pod="openshift-console/console-54859dff79-d49nb" Apr 21 00:04:33.894806 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:33.894708 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed-service-ca\") pod \"console-54859dff79-d49nb\" (UID: \"ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed\") " pod="openshift-console/console-54859dff79-d49nb" Apr 21 00:04:33.894806 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:33.894740 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed-oauth-serving-cert\") pod \"console-54859dff79-d49nb\" (UID: \"ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed\") " pod="openshift-console/console-54859dff79-d49nb" Apr 21 00:04:33.894806 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:33.894801 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed-console-config\") pod \"console-54859dff79-d49nb\" (UID: \"ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed\") " pod="openshift-console/console-54859dff79-d49nb" Apr 21 00:04:33.895850 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:33.895814 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed-console-config\") pod \"console-54859dff79-d49nb\" (UID: \"ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed\") " pod="openshift-console/console-54859dff79-d49nb" Apr 21 00:04:33.896067 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:33.896043 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed-trusted-ca-bundle\") pod \"console-54859dff79-d49nb\" (UID: \"ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed\") " pod="openshift-console/console-54859dff79-d49nb" Apr 21 00:04:33.896417 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:33.896389 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed-service-ca\") pod \"console-54859dff79-d49nb\" (UID: \"ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed\") " pod="openshift-console/console-54859dff79-d49nb" Apr 21 00:04:33.896933 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:33.896910 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed-oauth-serving-cert\") pod \"console-54859dff79-d49nb\" (UID: \"ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed\") " pod="openshift-console/console-54859dff79-d49nb" Apr 21 00:04:33.898708 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:33.898663 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed-console-oauth-config\") pod \"console-54859dff79-d49nb\" (UID: \"ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed\") " pod="openshift-console/console-54859dff79-d49nb" Apr 21 00:04:33.900312 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:33.900264 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed-console-serving-cert\") pod \"console-54859dff79-d49nb\" (UID: \"ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed\") " pod="openshift-console/console-54859dff79-d49nb" Apr 21 00:04:33.903759 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:33.903733 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s74xw\" (UniqueName: \"kubernetes.io/projected/ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed-kube-api-access-s74xw\") pod \"console-54859dff79-d49nb\" (UID: \"ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed\") " pod="openshift-console/console-54859dff79-d49nb" Apr 21 00:04:34.026925 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:34.026833 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54859dff79-d49nb" Apr 21 00:04:34.200168 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:34.200142 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54859dff79-d49nb"] Apr 21 00:04:34.464299 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:04:34.464228 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba34dd1e_a1d1_4d32_bc94_14af01f7e9ed.slice/crio-f4056a3c4e7426d9c2bcc1aeb0aec763443f1ba013b6fd74cb6a5a3fd028555b WatchSource:0}: Error finding container f4056a3c4e7426d9c2bcc1aeb0aec763443f1ba013b6fd74cb6a5a3fd028555b: Status 404 returned error can't find the container with id f4056a3c4e7426d9c2bcc1aeb0aec763443f1ba013b6fd74cb6a5a3fd028555b Apr 21 00:04:34.683448 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:34.683320 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54859dff79-d49nb" event={"ID":"ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed","Type":"ContainerStarted","Data":"bca3b0e0381e890089e1d706095c6fa8d0696fed1ff7af4ae28f8c554b09042b"} Apr 21 00:04:34.683448 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:34.683394 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54859dff79-d49nb" event={"ID":"ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed","Type":"ContainerStarted","Data":"f4056a3c4e7426d9c2bcc1aeb0aec763443f1ba013b6fd74cb6a5a3fd028555b"} Apr 21 00:04:34.704372 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:34.703046 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-54859dff79-d49nb" podStartSLOduration=1.703026725 podStartE2EDuration="1.703026725s" podCreationTimestamp="2026-04-21 00:04:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-21 00:04:34.702478872 +0000 UTC m=+67.137817096" watchObservedRunningTime="2026-04-21 00:04:34.703026725 +0000 UTC m=+67.138364950" Apr 21 00:04:35.689097 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:35.689055 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lr9hq" event={"ID":"65f5aca2-9fa7-4b19-b02f-0dd809899f41","Type":"ContainerStarted","Data":"d1c3ac26ce1ae78eebe4078d113d4f10986a1979fd5f42d1d7768780ac7eb1ce"} Apr 21 00:04:35.689097 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:35.689104 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lr9hq" event={"ID":"65f5aca2-9fa7-4b19-b02f-0dd809899f41","Type":"ContainerStarted","Data":"0236142bad2e210227f464429be6453fff0d900622b48b31021ca6b1ac8d7f09"} Apr 21 00:04:35.705101 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:35.704788 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-lr9hq" podStartSLOduration=66.589244222 podStartE2EDuration="1m7.704764735s" podCreationTimestamp="2026-04-21 00:03:28 +0000 UTC" firstStartedPulling="2026-04-21 00:04:33.417424774 +0000 UTC m=+65.852762978" lastFinishedPulling="2026-04-21 00:04:34.532945271 +0000 UTC m=+66.968283491" observedRunningTime="2026-04-21 00:04:35.703333078 +0000 UTC m=+68.138671302" watchObservedRunningTime="2026-04-21 00:04:35.704764735 +0000 UTC m=+68.140102959" Apr 21 00:04:36.695675 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:36.695629 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"840f2b50-b403-421e-a3c3-b29727f4fd46","Type":"ContainerStarted","Data":"329c10713eb302c078cd4cf6b83e3d2568e136ce0f562cbfe176e931d2ee67e3"} Apr 21 00:04:37.700666 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:37.700623 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-d5vdn" event={"ID":"526918a6-6456-4ee9-b13d-ca26cfea5695","Type":"ContainerStarted","Data":"0924f01ea99c92fc59471901e7e7c0358007a849f71b78151eff63bca0c4feb7"} Apr 21 00:04:37.701132 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:37.700721 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-d5vdn" Apr 21 00:04:37.703569 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:37.703500 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"840f2b50-b403-421e-a3c3-b29727f4fd46","Type":"ContainerStarted","Data":"8cffcd90b0b8a6744f13e8293925dcbfb4fce05b99afbdacf2811325610e9688"} Apr 21 00:04:37.703569 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:37.703534 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"840f2b50-b403-421e-a3c3-b29727f4fd46","Type":"ContainerStarted","Data":"c2d169fd06377ac6ee1b1b1d9667f95eb8e4597282bfdf3de8c71d5505835917"} Apr 21 00:04:37.703569 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:37.703548 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"840f2b50-b403-421e-a3c3-b29727f4fd46","Type":"ContainerStarted","Data":"92ce364c1e324be8e108cd19e64a383734c9e4641c17ac2557f0f14f764aa25c"} Apr 21 00:04:37.721743 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:37.721686 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-d5vdn" podStartSLOduration=66.429697955 podStartE2EDuration="1m9.72167135s" podCreationTimestamp="2026-04-21 00:03:28 +0000 UTC" firstStartedPulling="2026-04-21 00:04:33.504905999 +0000 UTC m=+65.940244202" lastFinishedPulling="2026-04-21 00:04:36.796879389 +0000 UTC m=+69.232217597" observedRunningTime="2026-04-21 00:04:37.719709724 +0000 UTC m=+70.155047948" watchObservedRunningTime="2026-04-21 00:04:37.72167135 +0000 UTC m=+70.157009574" Apr 21 00:04:37.748394 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:37.747221 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.6926646720000003 podStartE2EDuration="8.747200348s" podCreationTimestamp="2026-04-21 00:04:29 +0000 UTC" firstStartedPulling="2026-04-21 00:04:30.650435163 +0000 UTC m=+63.085773365" lastFinishedPulling="2026-04-21 00:04:35.704970839 +0000 UTC m=+68.140309041" observedRunningTime="2026-04-21 00:04:37.744038516 +0000 UTC m=+70.179376824" watchObservedRunningTime="2026-04-21 00:04:37.747200348 +0000 UTC m=+70.182538573" Apr 21 00:04:39.936798 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:39.936759 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:04:44.027229 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:44.027184 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-54859dff79-d49nb" Apr 21 00:04:44.027229 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:44.027234 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54859dff79-d49nb" Apr 21 00:04:44.032289 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:44.032264 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-54859dff79-d49nb" Apr 21 00:04:44.728916 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:44.728804 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-54859dff79-d49nb" Apr 21 00:04:44.774568 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:44.774536 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-684bdd6bf-lrfm4"] Apr 21 00:04:48.137104 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:48.137063 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-797f884dc7-jn6zz" Apr 21 00:04:48.137104 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:48.137108 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-797f884dc7-jn6zz" Apr 21 00:04:53.224019 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:04:53.223990 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bpxlz_8fbc25fb-05e2-4240-8294-bee8b0e94fbf/serve-healthcheck-canary/0.log" Apr 21 00:05:08.143094 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:08.143061 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-797f884dc7-jn6zz" Apr 21 00:05:08.147567 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:08.147533 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-797f884dc7-jn6zz" Apr 21 00:05:08.708939 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:08.708909 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-d5vdn" Apr 21 00:05:09.795338 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:09.795294 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-684bdd6bf-lrfm4" podUID="c9a689e8-8774-4fff-9a9f-a774f4fa3564" containerName="console" containerID="cri-o://6dd0e76d419384ef2bda34c678930426963790a6be255b82b985f59ea62ac9d0" gracePeriod=15 Apr 21 00:05:10.054062 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:10.053995 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-684bdd6bf-lrfm4_c9a689e8-8774-4fff-9a9f-a774f4fa3564/console/0.log" Apr 21 00:05:10.054189 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:10.054069 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-684bdd6bf-lrfm4" Apr 21 00:05:10.125468 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:10.125434 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c9a689e8-8774-4fff-9a9f-a774f4fa3564-service-ca\") pod \"c9a689e8-8774-4fff-9a9f-a774f4fa3564\" (UID: \"c9a689e8-8774-4fff-9a9f-a774f4fa3564\") " Apr 21 00:05:10.125468 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:10.125476 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c9a689e8-8774-4fff-9a9f-a774f4fa3564-console-oauth-config\") pod \"c9a689e8-8774-4fff-9a9f-a774f4fa3564\" (UID: \"c9a689e8-8774-4fff-9a9f-a774f4fa3564\") " Apr 21 00:05:10.125719 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:10.125521 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c9a689e8-8774-4fff-9a9f-a774f4fa3564-console-serving-cert\") pod \"c9a689e8-8774-4fff-9a9f-a774f4fa3564\" (UID: \"c9a689e8-8774-4fff-9a9f-a774f4fa3564\") " Apr 21 00:05:10.125719 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:10.125544 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c9a689e8-8774-4fff-9a9f-a774f4fa3564-oauth-serving-cert\") pod \"c9a689e8-8774-4fff-9a9f-a774f4fa3564\" (UID: \"c9a689e8-8774-4fff-9a9f-a774f4fa3564\") " Apr 21 00:05:10.125719 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:10.125580 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c9a689e8-8774-4fff-9a9f-a774f4fa3564-console-config\") pod \"c9a689e8-8774-4fff-9a9f-a774f4fa3564\" (UID: \"c9a689e8-8774-4fff-9a9f-a774f4fa3564\") " Apr 21 00:05:10.125719 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:10.125612 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-krwbw\" (UniqueName: \"kubernetes.io/projected/c9a689e8-8774-4fff-9a9f-a774f4fa3564-kube-api-access-krwbw\") pod \"c9a689e8-8774-4fff-9a9f-a774f4fa3564\" (UID: \"c9a689e8-8774-4fff-9a9f-a774f4fa3564\") " Apr 21 00:05:10.126024 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:10.125992 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9a689e8-8774-4fff-9a9f-a774f4fa3564-service-ca" (OuterVolumeSpecName: "service-ca") pod "c9a689e8-8774-4fff-9a9f-a774f4fa3564" (UID: "c9a689e8-8774-4fff-9a9f-a774f4fa3564"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 21 00:05:10.126024 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:10.126007 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9a689e8-8774-4fff-9a9f-a774f4fa3564-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c9a689e8-8774-4fff-9a9f-a774f4fa3564" (UID: "c9a689e8-8774-4fff-9a9f-a774f4fa3564"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 21 00:05:10.126175 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:10.126103 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9a689e8-8774-4fff-9a9f-a774f4fa3564-console-config" (OuterVolumeSpecName: "console-config") pod "c9a689e8-8774-4fff-9a9f-a774f4fa3564" (UID: "c9a689e8-8774-4fff-9a9f-a774f4fa3564"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 21 00:05:10.128083 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:10.128057 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9a689e8-8774-4fff-9a9f-a774f4fa3564-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c9a689e8-8774-4fff-9a9f-a774f4fa3564" (UID: "c9a689e8-8774-4fff-9a9f-a774f4fa3564"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 21 00:05:10.128178 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:10.128091 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9a689e8-8774-4fff-9a9f-a774f4fa3564-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c9a689e8-8774-4fff-9a9f-a774f4fa3564" (UID: "c9a689e8-8774-4fff-9a9f-a774f4fa3564"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 21 00:05:10.128178 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:10.128116 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9a689e8-8774-4fff-9a9f-a774f4fa3564-kube-api-access-krwbw" (OuterVolumeSpecName: "kube-api-access-krwbw") pod "c9a689e8-8774-4fff-9a9f-a774f4fa3564" (UID: "c9a689e8-8774-4fff-9a9f-a774f4fa3564"). InnerVolumeSpecName "kube-api-access-krwbw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 21 00:05:10.226830 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:10.226794 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c9a689e8-8774-4fff-9a9f-a774f4fa3564-service-ca\") on node \"ip-10-0-136-1.ec2.internal\" DevicePath \"\"" Apr 21 00:05:10.226830 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:10.226827 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c9a689e8-8774-4fff-9a9f-a774f4fa3564-console-oauth-config\") on node \"ip-10-0-136-1.ec2.internal\" DevicePath \"\"" Apr 21 00:05:10.226830 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:10.226838 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c9a689e8-8774-4fff-9a9f-a774f4fa3564-console-serving-cert\") on node \"ip-10-0-136-1.ec2.internal\" DevicePath \"\"" Apr 21 00:05:10.227068 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:10.226847 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c9a689e8-8774-4fff-9a9f-a774f4fa3564-oauth-serving-cert\") on node \"ip-10-0-136-1.ec2.internal\" DevicePath \"\"" Apr 21 00:05:10.227068 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:10.226856 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c9a689e8-8774-4fff-9a9f-a774f4fa3564-console-config\") on node \"ip-10-0-136-1.ec2.internal\" DevicePath \"\"" Apr 21 00:05:10.227068 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:10.226864 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-krwbw\" (UniqueName: \"kubernetes.io/projected/c9a689e8-8774-4fff-9a9f-a774f4fa3564-kube-api-access-krwbw\") on node \"ip-10-0-136-1.ec2.internal\" DevicePath \"\"" Apr 21 00:05:10.806705 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:10.806662 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-684bdd6bf-lrfm4_c9a689e8-8774-4fff-9a9f-a774f4fa3564/console/0.log" Apr 21 00:05:10.807121 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:10.806720 2576 generic.go:358] "Generic (PLEG): container finished" podID="c9a689e8-8774-4fff-9a9f-a774f4fa3564" containerID="6dd0e76d419384ef2bda34c678930426963790a6be255b82b985f59ea62ac9d0" exitCode=2 Apr 21 00:05:10.807121 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:10.806753 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-684bdd6bf-lrfm4" event={"ID":"c9a689e8-8774-4fff-9a9f-a774f4fa3564","Type":"ContainerDied","Data":"6dd0e76d419384ef2bda34c678930426963790a6be255b82b985f59ea62ac9d0"} Apr 21 00:05:10.807121 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:10.806792 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-684bdd6bf-lrfm4" event={"ID":"c9a689e8-8774-4fff-9a9f-a774f4fa3564","Type":"ContainerDied","Data":"00cc4fec52b5a9f5a9ef9279b03975c5e28f07d5cb434954180318859a1663f4"} Apr 21 00:05:10.807121 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:10.806793 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-684bdd6bf-lrfm4" Apr 21 00:05:10.807121 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:10.806807 2576 scope.go:117] "RemoveContainer" containerID="6dd0e76d419384ef2bda34c678930426963790a6be255b82b985f59ea62ac9d0" Apr 21 00:05:10.817887 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:10.815875 2576 scope.go:117] "RemoveContainer" containerID="6dd0e76d419384ef2bda34c678930426963790a6be255b82b985f59ea62ac9d0" Apr 21 00:05:10.817887 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:05:10.816275 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6dd0e76d419384ef2bda34c678930426963790a6be255b82b985f59ea62ac9d0\": container with ID starting with 6dd0e76d419384ef2bda34c678930426963790a6be255b82b985f59ea62ac9d0 not found: ID does not exist" containerID="6dd0e76d419384ef2bda34c678930426963790a6be255b82b985f59ea62ac9d0" Apr 21 00:05:10.817887 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:10.816330 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6dd0e76d419384ef2bda34c678930426963790a6be255b82b985f59ea62ac9d0"} err="failed to get container status \"6dd0e76d419384ef2bda34c678930426963790a6be255b82b985f59ea62ac9d0\": rpc error: code = NotFound desc = could not find container \"6dd0e76d419384ef2bda34c678930426963790a6be255b82b985f59ea62ac9d0\": container with ID starting with 6dd0e76d419384ef2bda34c678930426963790a6be255b82b985f59ea62ac9d0 not found: ID does not exist" Apr 21 00:05:10.822703 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:10.822671 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-684bdd6bf-lrfm4"] Apr 21 00:05:10.826192 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:10.826163 2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-684bdd6bf-lrfm4"] Apr 21 00:05:12.209320 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:12.209280 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9a689e8-8774-4fff-9a9f-a774f4fa3564" path="/var/lib/kubelet/pods/c9a689e8-8774-4fff-9a9f-a774f4fa3564/volumes" Apr 21 00:05:29.937046 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:29.937010 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:05:29.957862 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:29.957832 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:05:30.881917 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:30.881878 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:05:43.619438 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:43.619398 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Apr 21 00:05:43.620141 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:43.620071 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="85d0b04b-1bef-4c5b-98a5-be1b04f5a27c" containerName="alertmanager" containerID="cri-o://7dbf6d97adb0163b8ee43f64a27c902b9942960839a9379e97e16b9158b243d2" gracePeriod=120 Apr 21 00:05:43.620223 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:43.620130 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="85d0b04b-1bef-4c5b-98a5-be1b04f5a27c" containerName="kube-rbac-proxy-metric" containerID="cri-o://9bf05342a4ccf20d540da69e378abfad0940ee22bf2826855731b672fd499e8d" gracePeriod=120 Apr 21 00:05:43.620223 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:43.620181 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="85d0b04b-1bef-4c5b-98a5-be1b04f5a27c" containerName="config-reloader" containerID="cri-o://1873d4ed9d45061c62f1a54e9e90cce8af28ba2a1e059ec748edacc01cf65eb1" gracePeriod=120 Apr 21 00:05:43.620329 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:43.620205 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="85d0b04b-1bef-4c5b-98a5-be1b04f5a27c" containerName="kube-rbac-proxy" containerID="cri-o://5dd8c6b14e100156dd197e3864305b4ab6e816ef4bfea9342dc3b077b8809f88" gracePeriod=120 Apr 21 00:05:43.620329 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:43.620180 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="85d0b04b-1bef-4c5b-98a5-be1b04f5a27c" containerName="kube-rbac-proxy-web" containerID="cri-o://4c00fc0167058a8322abcadb02f47436a151906a7fbe506749fc937a87671532" gracePeriod=120 Apr 21 00:05:43.620461 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:43.620327 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="85d0b04b-1bef-4c5b-98a5-be1b04f5a27c" containerName="prom-label-proxy" containerID="cri-o://185f882925151ae133d058e1ac2ff17232a8fc7d20109504666b370cdd5a183b" gracePeriod=120 Apr 21 00:05:43.915575 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:43.915546 2576 generic.go:358] "Generic (PLEG): container finished" podID="85d0b04b-1bef-4c5b-98a5-be1b04f5a27c" containerID="185f882925151ae133d058e1ac2ff17232a8fc7d20109504666b370cdd5a183b" exitCode=0 Apr 21 00:05:43.915575 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:43.915571 2576 generic.go:358] "Generic (PLEG): container finished" podID="85d0b04b-1bef-4c5b-98a5-be1b04f5a27c" containerID="5dd8c6b14e100156dd197e3864305b4ab6e816ef4bfea9342dc3b077b8809f88" exitCode=0 Apr 21 00:05:43.915575 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:43.915578 2576 generic.go:358] "Generic (PLEG): container finished" podID="85d0b04b-1bef-4c5b-98a5-be1b04f5a27c" containerID="1873d4ed9d45061c62f1a54e9e90cce8af28ba2a1e059ec748edacc01cf65eb1" exitCode=0 Apr 21 00:05:43.915575 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:43.915583 2576 generic.go:358] "Generic (PLEG): container finished" podID="85d0b04b-1bef-4c5b-98a5-be1b04f5a27c" containerID="7dbf6d97adb0163b8ee43f64a27c902b9942960839a9379e97e16b9158b243d2" exitCode=0 Apr 21 00:05:43.915833 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:43.915619 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c","Type":"ContainerDied","Data":"185f882925151ae133d058e1ac2ff17232a8fc7d20109504666b370cdd5a183b"} Apr 21 00:05:43.915833 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:43.915655 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c","Type":"ContainerDied","Data":"5dd8c6b14e100156dd197e3864305b4ab6e816ef4bfea9342dc3b077b8809f88"} Apr 21 00:05:43.915833 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:43.915665 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c","Type":"ContainerDied","Data":"1873d4ed9d45061c62f1a54e9e90cce8af28ba2a1e059ec748edacc01cf65eb1"} Apr 21 00:05:43.915833 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:43.915675 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c","Type":"ContainerDied","Data":"7dbf6d97adb0163b8ee43f64a27c902b9942960839a9379e97e16b9158b243d2"} Apr 21 00:05:44.873030 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:44.872997 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:05:44.921780 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:44.921748 2576 generic.go:358] "Generic (PLEG): container finished" podID="85d0b04b-1bef-4c5b-98a5-be1b04f5a27c" containerID="9bf05342a4ccf20d540da69e378abfad0940ee22bf2826855731b672fd499e8d" exitCode=0 Apr 21 00:05:44.921780 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:44.921775 2576 generic.go:358] "Generic (PLEG): container finished" podID="85d0b04b-1bef-4c5b-98a5-be1b04f5a27c" containerID="4c00fc0167058a8322abcadb02f47436a151906a7fbe506749fc937a87671532" exitCode=0 Apr 21 00:05:44.922028 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:44.921826 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c","Type":"ContainerDied","Data":"9bf05342a4ccf20d540da69e378abfad0940ee22bf2826855731b672fd499e8d"} Apr 21 00:05:44.922028 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:44.921863 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:05:44.922028 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:44.921878 2576 scope.go:117] "RemoveContainer" containerID="185f882925151ae133d058e1ac2ff17232a8fc7d20109504666b370cdd5a183b" Apr 21 00:05:44.922028 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:44.921868 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c","Type":"ContainerDied","Data":"4c00fc0167058a8322abcadb02f47436a151906a7fbe506749fc937a87671532"} Apr 21 00:05:44.922028 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:44.922010 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c","Type":"ContainerDied","Data":"e2535636eb902af491901549fdff55b8f23bb3c16d1748ddfbaa1716c5d3dae6"} Apr 21 00:05:44.929850 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:44.929825 2576 scope.go:117] "RemoveContainer" containerID="9bf05342a4ccf20d540da69e378abfad0940ee22bf2826855731b672fd499e8d" Apr 21 00:05:44.938077 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:44.938053 2576 scope.go:117] "RemoveContainer" containerID="5dd8c6b14e100156dd197e3864305b4ab6e816ef4bfea9342dc3b077b8809f88" Apr 21 00:05:44.942629 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:44.942393 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-tls-assets\") pod \"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c\" (UID: \"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c\") " Apr 21 00:05:44.942629 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:44.942455 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-secret-alertmanager-kube-rbac-proxy\") pod \"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c\" (UID: \"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c\") " Apr 21 00:05:44.942629 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:44.942514 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-alertmanager-main-db\") pod \"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c\" (UID: \"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c\") " Apr 21 00:05:44.942629 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:44.942549 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-secret-alertmanager-kube-rbac-proxy-web\") pod \"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c\" (UID: \"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c\") " Apr 21 00:05:44.942629 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:44.942574 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c\" (UID: \"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c\") " Apr 21 00:05:44.942629 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:44.942608 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-web-config\") pod \"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c\" (UID: \"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c\") " Apr 21 00:05:44.942629 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:44.942632 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6wjf9\" (UniqueName: \"kubernetes.io/projected/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-kube-api-access-6wjf9\") pod \"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c\" (UID: \"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c\") " Apr 21 00:05:44.943040 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:44.942701 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-metrics-client-ca\") pod \"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c\" (UID: \"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c\") " Apr 21 00:05:44.943040 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:44.942744 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-config-out\") pod \"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c\" (UID: \"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c\") " Apr 21 00:05:44.943040 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:44.942797 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-alertmanager-trusted-ca-bundle\") pod \"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c\" (UID: \"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c\") " Apr 21 00:05:44.943040 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:44.942822 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-secret-alertmanager-main-tls\") pod \"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c\" (UID: \"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c\") " Apr 21 00:05:44.943040 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:44.942852 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-cluster-tls-config\") pod \"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c\" (UID: \"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c\") " Apr 21 00:05:44.943040 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:44.942880 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-config-volume\") pod \"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c\" (UID: \"85d0b04b-1bef-4c5b-98a5-be1b04f5a27c\") " Apr 21 00:05:44.943792 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:44.943526 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "85d0b04b-1bef-4c5b-98a5-be1b04f5a27c" (UID: "85d0b04b-1bef-4c5b-98a5-be1b04f5a27c"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Apr 21 00:05:44.944004 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:44.943865 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "85d0b04b-1bef-4c5b-98a5-be1b04f5a27c" (UID: "85d0b04b-1bef-4c5b-98a5-be1b04f5a27c"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 21 00:05:44.944338 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:44.944203 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "85d0b04b-1bef-4c5b-98a5-be1b04f5a27c" (UID: "85d0b04b-1bef-4c5b-98a5-be1b04f5a27c"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 21 00:05:44.948180 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:44.948123 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-config-volume" (OuterVolumeSpecName: "config-volume") pod "85d0b04b-1bef-4c5b-98a5-be1b04f5a27c" (UID: "85d0b04b-1bef-4c5b-98a5-be1b04f5a27c"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 21 00:05:44.948752 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:44.948617 2576 scope.go:117] "RemoveContainer" containerID="4c00fc0167058a8322abcadb02f47436a151906a7fbe506749fc937a87671532" Apr 21 00:05:44.948752 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:44.948698 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "85d0b04b-1bef-4c5b-98a5-be1b04f5a27c" (UID: "85d0b04b-1bef-4c5b-98a5-be1b04f5a27c"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 21 00:05:44.948950 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:44.948815 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "85d0b04b-1bef-4c5b-98a5-be1b04f5a27c" (UID: "85d0b04b-1bef-4c5b-98a5-be1b04f5a27c"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 21 00:05:44.949015 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:44.948952 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "85d0b04b-1bef-4c5b-98a5-be1b04f5a27c" (UID: "85d0b04b-1bef-4c5b-98a5-be1b04f5a27c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 21 00:05:44.949094 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:44.949069 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "85d0b04b-1bef-4c5b-98a5-be1b04f5a27c" (UID: "85d0b04b-1bef-4c5b-98a5-be1b04f5a27c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 21 00:05:44.949234 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:44.949111 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-kube-api-access-6wjf9" (OuterVolumeSpecName: "kube-api-access-6wjf9") pod "85d0b04b-1bef-4c5b-98a5-be1b04f5a27c" (UID: "85d0b04b-1bef-4c5b-98a5-be1b04f5a27c"). InnerVolumeSpecName "kube-api-access-6wjf9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 21 00:05:44.949234 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:44.949212 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "85d0b04b-1bef-4c5b-98a5-be1b04f5a27c" (UID: "85d0b04b-1bef-4c5b-98a5-be1b04f5a27c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 21 00:05:44.949620 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:44.949597 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-config-out" (OuterVolumeSpecName: "config-out") pod "85d0b04b-1bef-4c5b-98a5-be1b04f5a27c" (UID: "85d0b04b-1bef-4c5b-98a5-be1b04f5a27c"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Apr 21 00:05:44.956548 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:44.956516 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "85d0b04b-1bef-4c5b-98a5-be1b04f5a27c" (UID: "85d0b04b-1bef-4c5b-98a5-be1b04f5a27c"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 21 00:05:44.960430 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:44.960348 2576 scope.go:117] "RemoveContainer" containerID="1873d4ed9d45061c62f1a54e9e90cce8af28ba2a1e059ec748edacc01cf65eb1" Apr 21 00:05:44.962506 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:44.962475 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-web-config" (OuterVolumeSpecName: "web-config") pod "85d0b04b-1bef-4c5b-98a5-be1b04f5a27c" (UID: "85d0b04b-1bef-4c5b-98a5-be1b04f5a27c"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 21 00:05:44.967686 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:44.967668 2576 scope.go:117] "RemoveContainer" containerID="7dbf6d97adb0163b8ee43f64a27c902b9942960839a9379e97e16b9158b243d2" Apr 21 00:05:44.974504 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:44.974487 2576 scope.go:117] "RemoveContainer" containerID="13b8a0f630a51cd66bc7fcc2526a8b09b7bd19a1486a9056d9cb7fcfbdbc1cba" Apr 21 00:05:44.981304 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:44.981282 2576 scope.go:117] "RemoveContainer" containerID="185f882925151ae133d058e1ac2ff17232a8fc7d20109504666b370cdd5a183b" Apr 21 00:05:44.981641 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:05:44.981622 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"185f882925151ae133d058e1ac2ff17232a8fc7d20109504666b370cdd5a183b\": container with ID starting with 185f882925151ae133d058e1ac2ff17232a8fc7d20109504666b370cdd5a183b not found: ID does not exist" containerID="185f882925151ae133d058e1ac2ff17232a8fc7d20109504666b370cdd5a183b" Apr 21 00:05:44.981699 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:44.981653 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"185f882925151ae133d058e1ac2ff17232a8fc7d20109504666b370cdd5a183b"} err="failed to get container status \"185f882925151ae133d058e1ac2ff17232a8fc7d20109504666b370cdd5a183b\": rpc error: code = NotFound desc = could not find container \"185f882925151ae133d058e1ac2ff17232a8fc7d20109504666b370cdd5a183b\": container with ID starting with 185f882925151ae133d058e1ac2ff17232a8fc7d20109504666b370cdd5a183b not found: ID does not exist" Apr 21 00:05:44.981699 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:44.981673 2576 scope.go:117] "RemoveContainer" containerID="9bf05342a4ccf20d540da69e378abfad0940ee22bf2826855731b672fd499e8d" Apr 21 00:05:44.981923 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:05:44.981906 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9bf05342a4ccf20d540da69e378abfad0940ee22bf2826855731b672fd499e8d\": container with ID starting with 9bf05342a4ccf20d540da69e378abfad0940ee22bf2826855731b672fd499e8d not found: ID does not exist" containerID="9bf05342a4ccf20d540da69e378abfad0940ee22bf2826855731b672fd499e8d" Apr 21 00:05:44.981977 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:44.981930 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bf05342a4ccf20d540da69e378abfad0940ee22bf2826855731b672fd499e8d"} err="failed to get container status \"9bf05342a4ccf20d540da69e378abfad0940ee22bf2826855731b672fd499e8d\": rpc error: code = NotFound desc = could not find container \"9bf05342a4ccf20d540da69e378abfad0940ee22bf2826855731b672fd499e8d\": container with ID starting with 9bf05342a4ccf20d540da69e378abfad0940ee22bf2826855731b672fd499e8d not found: ID does not exist" Apr 21 00:05:44.981977 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:44.981946 2576 scope.go:117] "RemoveContainer" containerID="5dd8c6b14e100156dd197e3864305b4ab6e816ef4bfea9342dc3b077b8809f88" Apr 21 00:05:44.982171 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:05:44.982156 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5dd8c6b14e100156dd197e3864305b4ab6e816ef4bfea9342dc3b077b8809f88\": container with ID starting with 5dd8c6b14e100156dd197e3864305b4ab6e816ef4bfea9342dc3b077b8809f88 not found: ID does not exist" containerID="5dd8c6b14e100156dd197e3864305b4ab6e816ef4bfea9342dc3b077b8809f88" Apr 21 00:05:44.982207 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:44.982178 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5dd8c6b14e100156dd197e3864305b4ab6e816ef4bfea9342dc3b077b8809f88"} err="failed to get container status \"5dd8c6b14e100156dd197e3864305b4ab6e816ef4bfea9342dc3b077b8809f88\": rpc error: code = NotFound desc = could not find container \"5dd8c6b14e100156dd197e3864305b4ab6e816ef4bfea9342dc3b077b8809f88\": container with ID starting with 5dd8c6b14e100156dd197e3864305b4ab6e816ef4bfea9342dc3b077b8809f88 not found: ID does not exist" Apr 21 00:05:44.982207 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:44.982192 2576 scope.go:117] "RemoveContainer" containerID="4c00fc0167058a8322abcadb02f47436a151906a7fbe506749fc937a87671532" Apr 21 00:05:44.982387 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:05:44.982372 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c00fc0167058a8322abcadb02f47436a151906a7fbe506749fc937a87671532\": container with ID starting with 4c00fc0167058a8322abcadb02f47436a151906a7fbe506749fc937a87671532 not found: ID does not exist" containerID="4c00fc0167058a8322abcadb02f47436a151906a7fbe506749fc937a87671532" Apr 21 00:05:44.982433 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:44.982390 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c00fc0167058a8322abcadb02f47436a151906a7fbe506749fc937a87671532"} err="failed to get container status \"4c00fc0167058a8322abcadb02f47436a151906a7fbe506749fc937a87671532\": rpc error: code = NotFound desc = could not find container \"4c00fc0167058a8322abcadb02f47436a151906a7fbe506749fc937a87671532\": container with ID starting with 4c00fc0167058a8322abcadb02f47436a151906a7fbe506749fc937a87671532 not found: ID does not exist" Apr 21 00:05:44.982433 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:44.982402 2576 scope.go:117] "RemoveContainer" containerID="1873d4ed9d45061c62f1a54e9e90cce8af28ba2a1e059ec748edacc01cf65eb1" Apr 21 00:05:44.982633 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:05:44.982618 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1873d4ed9d45061c62f1a54e9e90cce8af28ba2a1e059ec748edacc01cf65eb1\": container with ID starting with 1873d4ed9d45061c62f1a54e9e90cce8af28ba2a1e059ec748edacc01cf65eb1 not found: ID does not exist" containerID="1873d4ed9d45061c62f1a54e9e90cce8af28ba2a1e059ec748edacc01cf65eb1" Apr 21 00:05:44.982669 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:44.982637 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1873d4ed9d45061c62f1a54e9e90cce8af28ba2a1e059ec748edacc01cf65eb1"} err="failed to get container status \"1873d4ed9d45061c62f1a54e9e90cce8af28ba2a1e059ec748edacc01cf65eb1\": rpc error: code = NotFound desc = could not find container \"1873d4ed9d45061c62f1a54e9e90cce8af28ba2a1e059ec748edacc01cf65eb1\": container with ID starting with 1873d4ed9d45061c62f1a54e9e90cce8af28ba2a1e059ec748edacc01cf65eb1 not found: ID does not exist" Apr 21 00:05:44.982669 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:44.982652 2576 scope.go:117] "RemoveContainer" containerID="7dbf6d97adb0163b8ee43f64a27c902b9942960839a9379e97e16b9158b243d2" Apr 21 00:05:44.982889 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:05:44.982868 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7dbf6d97adb0163b8ee43f64a27c902b9942960839a9379e97e16b9158b243d2\": container with ID starting with 7dbf6d97adb0163b8ee43f64a27c902b9942960839a9379e97e16b9158b243d2 not found: ID does not exist" containerID="7dbf6d97adb0163b8ee43f64a27c902b9942960839a9379e97e16b9158b243d2" Apr 21 00:05:44.982942 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:44.982896 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7dbf6d97adb0163b8ee43f64a27c902b9942960839a9379e97e16b9158b243d2"} err="failed to get container status \"7dbf6d97adb0163b8ee43f64a27c902b9942960839a9379e97e16b9158b243d2\": rpc error: code = NotFound desc = could not find container \"7dbf6d97adb0163b8ee43f64a27c902b9942960839a9379e97e16b9158b243d2\": container with ID starting with 7dbf6d97adb0163b8ee43f64a27c902b9942960839a9379e97e16b9158b243d2 not found: ID does not exist" Apr 21 00:05:44.982942 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:44.982910 2576 scope.go:117] "RemoveContainer" containerID="13b8a0f630a51cd66bc7fcc2526a8b09b7bd19a1486a9056d9cb7fcfbdbc1cba" Apr 21 00:05:44.983148 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:05:44.983133 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13b8a0f630a51cd66bc7fcc2526a8b09b7bd19a1486a9056d9cb7fcfbdbc1cba\": container with ID starting with 13b8a0f630a51cd66bc7fcc2526a8b09b7bd19a1486a9056d9cb7fcfbdbc1cba not found: ID does not exist" containerID="13b8a0f630a51cd66bc7fcc2526a8b09b7bd19a1486a9056d9cb7fcfbdbc1cba" Apr 21 00:05:44.983196 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:44.983149 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13b8a0f630a51cd66bc7fcc2526a8b09b7bd19a1486a9056d9cb7fcfbdbc1cba"} err="failed to get container status \"13b8a0f630a51cd66bc7fcc2526a8b09b7bd19a1486a9056d9cb7fcfbdbc1cba\": rpc error: code = NotFound desc = could not find container \"13b8a0f630a51cd66bc7fcc2526a8b09b7bd19a1486a9056d9cb7fcfbdbc1cba\": container with ID starting with 13b8a0f630a51cd66bc7fcc2526a8b09b7bd19a1486a9056d9cb7fcfbdbc1cba not found: ID does not exist" Apr 21 00:05:44.983196 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:44.983160 2576 scope.go:117] "RemoveContainer" containerID="185f882925151ae133d058e1ac2ff17232a8fc7d20109504666b370cdd5a183b" Apr 21 00:05:44.983374 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:44.983341 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"185f882925151ae133d058e1ac2ff17232a8fc7d20109504666b370cdd5a183b"} err="failed to get container status \"185f882925151ae133d058e1ac2ff17232a8fc7d20109504666b370cdd5a183b\": rpc error: code = NotFound desc = could not find container \"185f882925151ae133d058e1ac2ff17232a8fc7d20109504666b370cdd5a183b\": container with ID starting with 185f882925151ae133d058e1ac2ff17232a8fc7d20109504666b370cdd5a183b not found: ID does not exist" Apr 21 00:05:44.983418 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:44.983378 2576 scope.go:117] "RemoveContainer" containerID="9bf05342a4ccf20d540da69e378abfad0940ee22bf2826855731b672fd499e8d" Apr 21 00:05:44.983596 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:44.983581 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bf05342a4ccf20d540da69e378abfad0940ee22bf2826855731b672fd499e8d"} err="failed to get container status \"9bf05342a4ccf20d540da69e378abfad0940ee22bf2826855731b672fd499e8d\": rpc error: code = NotFound desc = could not find container \"9bf05342a4ccf20d540da69e378abfad0940ee22bf2826855731b672fd499e8d\": container with ID starting with 9bf05342a4ccf20d540da69e378abfad0940ee22bf2826855731b672fd499e8d not found: ID does not exist" Apr 21 00:05:44.983632 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:44.983595 2576 scope.go:117] "RemoveContainer" containerID="5dd8c6b14e100156dd197e3864305b4ab6e816ef4bfea9342dc3b077b8809f88" Apr 21 00:05:44.983779 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:44.983764 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5dd8c6b14e100156dd197e3864305b4ab6e816ef4bfea9342dc3b077b8809f88"} err="failed to get container status \"5dd8c6b14e100156dd197e3864305b4ab6e816ef4bfea9342dc3b077b8809f88\": rpc error: code = NotFound desc = could not find container \"5dd8c6b14e100156dd197e3864305b4ab6e816ef4bfea9342dc3b077b8809f88\": container with ID starting with 5dd8c6b14e100156dd197e3864305b4ab6e816ef4bfea9342dc3b077b8809f88 not found: ID does not exist" Apr 21 00:05:44.983779 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:44.983778 2576 scope.go:117] "RemoveContainer" containerID="4c00fc0167058a8322abcadb02f47436a151906a7fbe506749fc937a87671532" Apr 21 00:05:44.983999 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:44.983983 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c00fc0167058a8322abcadb02f47436a151906a7fbe506749fc937a87671532"} err="failed to get container status \"4c00fc0167058a8322abcadb02f47436a151906a7fbe506749fc937a87671532\": rpc error: code = NotFound desc = could not find container \"4c00fc0167058a8322abcadb02f47436a151906a7fbe506749fc937a87671532\": container with ID starting with 4c00fc0167058a8322abcadb02f47436a151906a7fbe506749fc937a87671532 not found: ID does not exist" Apr 21 00:05:44.983999 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:44.983998 2576 scope.go:117] "RemoveContainer" containerID="1873d4ed9d45061c62f1a54e9e90cce8af28ba2a1e059ec748edacc01cf65eb1" Apr 21 00:05:44.984173 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:44.984154 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1873d4ed9d45061c62f1a54e9e90cce8af28ba2a1e059ec748edacc01cf65eb1"} err="failed to get container status \"1873d4ed9d45061c62f1a54e9e90cce8af28ba2a1e059ec748edacc01cf65eb1\": rpc error: code = NotFound desc = could not find container \"1873d4ed9d45061c62f1a54e9e90cce8af28ba2a1e059ec748edacc01cf65eb1\": container with ID starting with 1873d4ed9d45061c62f1a54e9e90cce8af28ba2a1e059ec748edacc01cf65eb1 not found: ID does not exist" Apr 21 00:05:44.984214 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:44.984174 2576 scope.go:117] "RemoveContainer" containerID="7dbf6d97adb0163b8ee43f64a27c902b9942960839a9379e97e16b9158b243d2" Apr 21 00:05:44.984339 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:44.984325 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7dbf6d97adb0163b8ee43f64a27c902b9942960839a9379e97e16b9158b243d2"} err="failed to get container status \"7dbf6d97adb0163b8ee43f64a27c902b9942960839a9379e97e16b9158b243d2\": rpc error: code = NotFound desc = could not find container \"7dbf6d97adb0163b8ee43f64a27c902b9942960839a9379e97e16b9158b243d2\": container with ID starting with 7dbf6d97adb0163b8ee43f64a27c902b9942960839a9379e97e16b9158b243d2 not found: ID does not exist" Apr 21 00:05:44.984339 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:44.984338 2576 scope.go:117] "RemoveContainer" containerID="13b8a0f630a51cd66bc7fcc2526a8b09b7bd19a1486a9056d9cb7fcfbdbc1cba" Apr 21 00:05:44.984569 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:44.984550 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13b8a0f630a51cd66bc7fcc2526a8b09b7bd19a1486a9056d9cb7fcfbdbc1cba"} err="failed to get container status \"13b8a0f630a51cd66bc7fcc2526a8b09b7bd19a1486a9056d9cb7fcfbdbc1cba\": rpc error: code = NotFound desc = could not find container \"13b8a0f630a51cd66bc7fcc2526a8b09b7bd19a1486a9056d9cb7fcfbdbc1cba\": container with ID starting with 13b8a0f630a51cd66bc7fcc2526a8b09b7bd19a1486a9056d9cb7fcfbdbc1cba not found: ID does not exist" Apr 21 00:05:45.044245 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.044204 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-136-1.ec2.internal\" DevicePath \"\"" Apr 21 00:05:45.044245 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.044239 2576 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-alertmanager-main-db\") on node \"ip-10-0-136-1.ec2.internal\" DevicePath \"\"" Apr 21 00:05:45.044245 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.044252 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-136-1.ec2.internal\" DevicePath \"\"" Apr 21 00:05:45.044521 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.044261 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-136-1.ec2.internal\" DevicePath \"\"" Apr 21 00:05:45.044521 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.044273 2576 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-web-config\") on node \"ip-10-0-136-1.ec2.internal\" DevicePath \"\"" Apr 21 00:05:45.044521 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.044281 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6wjf9\" (UniqueName: \"kubernetes.io/projected/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-kube-api-access-6wjf9\") on node \"ip-10-0-136-1.ec2.internal\" DevicePath \"\"" Apr 21 00:05:45.044521 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.044290 2576 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-metrics-client-ca\") on node \"ip-10-0-136-1.ec2.internal\" DevicePath \"\"" Apr 21 00:05:45.044521 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.044299 2576 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-config-out\") on node \"ip-10-0-136-1.ec2.internal\" DevicePath \"\"" Apr 21 00:05:45.044521 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.044307 2576 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-136-1.ec2.internal\" DevicePath \"\"" Apr 21 00:05:45.044521 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.044316 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-secret-alertmanager-main-tls\") on node \"ip-10-0-136-1.ec2.internal\" DevicePath \"\"" Apr 21 00:05:45.044521 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.044325 2576 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-cluster-tls-config\") on node \"ip-10-0-136-1.ec2.internal\" DevicePath \"\"" Apr 21 00:05:45.044521 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.044334 2576 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-config-volume\") on node \"ip-10-0-136-1.ec2.internal\" DevicePath \"\"" Apr 21 00:05:45.044521 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.044343 2576 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c-tls-assets\") on node \"ip-10-0-136-1.ec2.internal\" DevicePath \"\"" Apr 21 00:05:45.244071 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.244034 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Apr 21 00:05:45.249533 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.249499 2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Apr 21 00:05:45.271932 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.271898 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Apr 21 00:05:45.272199 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.272177 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85d0b04b-1bef-4c5b-98a5-be1b04f5a27c" containerName="alertmanager" Apr 21 00:05:45.272199 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.272199 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="85d0b04b-1bef-4c5b-98a5-be1b04f5a27c" containerName="alertmanager" Apr 21 00:05:45.272417 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.272213 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85d0b04b-1bef-4c5b-98a5-be1b04f5a27c" containerName="config-reloader" Apr 21 00:05:45.272417 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.272222 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="85d0b04b-1bef-4c5b-98a5-be1b04f5a27c" containerName="config-reloader" Apr 21 00:05:45.272417 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.272241 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85d0b04b-1bef-4c5b-98a5-be1b04f5a27c" containerName="prom-label-proxy" Apr 21 00:05:45.272417 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.272249 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="85d0b04b-1bef-4c5b-98a5-be1b04f5a27c" containerName="prom-label-proxy" Apr 21 00:05:45.272417 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.272264 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85d0b04b-1bef-4c5b-98a5-be1b04f5a27c" containerName="init-config-reloader" Apr 21 00:05:45.272417 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.272272 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="85d0b04b-1bef-4c5b-98a5-be1b04f5a27c" containerName="init-config-reloader" Apr 21 00:05:45.272417 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.272285 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85d0b04b-1bef-4c5b-98a5-be1b04f5a27c" containerName="kube-rbac-proxy" Apr 21 00:05:45.272417 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.272293 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="85d0b04b-1bef-4c5b-98a5-be1b04f5a27c" containerName="kube-rbac-proxy" Apr 21 00:05:45.272417 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.272306 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9a689e8-8774-4fff-9a9f-a774f4fa3564" containerName="console" Apr 21 00:05:45.272417 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.272313 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9a689e8-8774-4fff-9a9f-a774f4fa3564" containerName="console" Apr 21 00:05:45.272417 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.272322 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85d0b04b-1bef-4c5b-98a5-be1b04f5a27c" containerName="kube-rbac-proxy-web" Apr 21 00:05:45.272417 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.272329 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="85d0b04b-1bef-4c5b-98a5-be1b04f5a27c" containerName="kube-rbac-proxy-web" Apr 21 00:05:45.272417 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.272340 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85d0b04b-1bef-4c5b-98a5-be1b04f5a27c" containerName="kube-rbac-proxy-metric" Apr 21 00:05:45.272417 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.272348 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="85d0b04b-1bef-4c5b-98a5-be1b04f5a27c" containerName="kube-rbac-proxy-metric" Apr 21 00:05:45.273112 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.272449 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="85d0b04b-1bef-4c5b-98a5-be1b04f5a27c" containerName="alertmanager" Apr 21 00:05:45.273112 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.272465 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="85d0b04b-1bef-4c5b-98a5-be1b04f5a27c" containerName="kube-rbac-proxy" Apr 21 00:05:45.273112 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.272476 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="85d0b04b-1bef-4c5b-98a5-be1b04f5a27c" containerName="kube-rbac-proxy-web" Apr 21 00:05:45.273112 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.272485 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="85d0b04b-1bef-4c5b-98a5-be1b04f5a27c" containerName="prom-label-proxy" Apr 21 00:05:45.273112 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.272496 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="c9a689e8-8774-4fff-9a9f-a774f4fa3564" containerName="console" Apr 21 00:05:45.273112 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.272504 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="85d0b04b-1bef-4c5b-98a5-be1b04f5a27c" containerName="config-reloader" Apr 21 00:05:45.273112 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.272513 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="85d0b04b-1bef-4c5b-98a5-be1b04f5a27c" containerName="kube-rbac-proxy-metric" Apr 21 00:05:45.276945 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.276919 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:05:45.279650 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.279619 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Apr 21 00:05:45.279795 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.279660 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Apr 21 00:05:45.280151 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.279926 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Apr 21 00:05:45.280151 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.279943 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Apr 21 00:05:45.280151 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.279948 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-npkj9\"" Apr 21 00:05:45.280151 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.279958 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Apr 21 00:05:45.280151 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.279969 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Apr 21 00:05:45.280151 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.279978 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Apr 21 00:05:45.280457 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.280213 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Apr 21 00:05:45.284624 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.284603 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Apr 21 00:05:45.287177 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.287156 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Apr 21 00:05:45.347067 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.347004 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59ee9e7b-537c-4384-ba03-e3f2cdb56bf0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"59ee9e7b-537c-4384-ba03-e3f2cdb56bf0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:05:45.347252 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.347113 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/59ee9e7b-537c-4384-ba03-e3f2cdb56bf0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"59ee9e7b-537c-4384-ba03-e3f2cdb56bf0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:05:45.347252 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.347142 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkqhs\" (UniqueName: \"kubernetes.io/projected/59ee9e7b-537c-4384-ba03-e3f2cdb56bf0-kube-api-access-dkqhs\") pod \"alertmanager-main-0\" (UID: \"59ee9e7b-537c-4384-ba03-e3f2cdb56bf0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:05:45.347252 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.347188 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/59ee9e7b-537c-4384-ba03-e3f2cdb56bf0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"59ee9e7b-537c-4384-ba03-e3f2cdb56bf0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:05:45.347252 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.347212 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/59ee9e7b-537c-4384-ba03-e3f2cdb56bf0-config-out\") pod \"alertmanager-main-0\" (UID: \"59ee9e7b-537c-4384-ba03-e3f2cdb56bf0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:05:45.347252 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.347249 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/59ee9e7b-537c-4384-ba03-e3f2cdb56bf0-config-volume\") pod \"alertmanager-main-0\" (UID: \"59ee9e7b-537c-4384-ba03-e3f2cdb56bf0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:05:45.347479 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.347276 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/59ee9e7b-537c-4384-ba03-e3f2cdb56bf0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"59ee9e7b-537c-4384-ba03-e3f2cdb56bf0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:05:45.347479 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.347311 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/59ee9e7b-537c-4384-ba03-e3f2cdb56bf0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"59ee9e7b-537c-4384-ba03-e3f2cdb56bf0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:05:45.347479 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.347332 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59ee9e7b-537c-4384-ba03-e3f2cdb56bf0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"59ee9e7b-537c-4384-ba03-e3f2cdb56bf0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:05:45.347479 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.347384 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/59ee9e7b-537c-4384-ba03-e3f2cdb56bf0-web-config\") pod \"alertmanager-main-0\" (UID: \"59ee9e7b-537c-4384-ba03-e3f2cdb56bf0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:05:45.347479 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.347429 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/59ee9e7b-537c-4384-ba03-e3f2cdb56bf0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"59ee9e7b-537c-4384-ba03-e3f2cdb56bf0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:05:45.347681 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.347490 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/59ee9e7b-537c-4384-ba03-e3f2cdb56bf0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"59ee9e7b-537c-4384-ba03-e3f2cdb56bf0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:05:45.347681 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.347538 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/59ee9e7b-537c-4384-ba03-e3f2cdb56bf0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"59ee9e7b-537c-4384-ba03-e3f2cdb56bf0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:05:45.448950 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.448908 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/59ee9e7b-537c-4384-ba03-e3f2cdb56bf0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"59ee9e7b-537c-4384-ba03-e3f2cdb56bf0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:05:45.448950 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.448952 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/59ee9e7b-537c-4384-ba03-e3f2cdb56bf0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"59ee9e7b-537c-4384-ba03-e3f2cdb56bf0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:05:45.449207 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.448999 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59ee9e7b-537c-4384-ba03-e3f2cdb56bf0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"59ee9e7b-537c-4384-ba03-e3f2cdb56bf0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:05:45.449207 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.449041 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/59ee9e7b-537c-4384-ba03-e3f2cdb56bf0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"59ee9e7b-537c-4384-ba03-e3f2cdb56bf0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:05:45.449207 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.449062 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dkqhs\" (UniqueName: \"kubernetes.io/projected/59ee9e7b-537c-4384-ba03-e3f2cdb56bf0-kube-api-access-dkqhs\") pod \"alertmanager-main-0\" (UID: \"59ee9e7b-537c-4384-ba03-e3f2cdb56bf0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:05:45.449207 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.449103 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/59ee9e7b-537c-4384-ba03-e3f2cdb56bf0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"59ee9e7b-537c-4384-ba03-e3f2cdb56bf0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:05:45.449207 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.449129 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/59ee9e7b-537c-4384-ba03-e3f2cdb56bf0-config-out\") pod \"alertmanager-main-0\" (UID: \"59ee9e7b-537c-4384-ba03-e3f2cdb56bf0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:05:45.449207 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.449157 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/59ee9e7b-537c-4384-ba03-e3f2cdb56bf0-config-volume\") pod \"alertmanager-main-0\" (UID: \"59ee9e7b-537c-4384-ba03-e3f2cdb56bf0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:05:45.449207 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.449190 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/59ee9e7b-537c-4384-ba03-e3f2cdb56bf0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"59ee9e7b-537c-4384-ba03-e3f2cdb56bf0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:05:45.449526 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.449427 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/59ee9e7b-537c-4384-ba03-e3f2cdb56bf0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"59ee9e7b-537c-4384-ba03-e3f2cdb56bf0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:05:45.449526 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.449470 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59ee9e7b-537c-4384-ba03-e3f2cdb56bf0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"59ee9e7b-537c-4384-ba03-e3f2cdb56bf0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:05:45.449526 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.449502 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/59ee9e7b-537c-4384-ba03-e3f2cdb56bf0-web-config\") pod \"alertmanager-main-0\" (UID: \"59ee9e7b-537c-4384-ba03-e3f2cdb56bf0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:05:45.449634 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.449563 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/59ee9e7b-537c-4384-ba03-e3f2cdb56bf0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"59ee9e7b-537c-4384-ba03-e3f2cdb56bf0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:05:45.450853 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.450787 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59ee9e7b-537c-4384-ba03-e3f2cdb56bf0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"59ee9e7b-537c-4384-ba03-e3f2cdb56bf0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:05:45.450853 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.450819 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59ee9e7b-537c-4384-ba03-e3f2cdb56bf0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"59ee9e7b-537c-4384-ba03-e3f2cdb56bf0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:05:45.451056 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.450900 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/59ee9e7b-537c-4384-ba03-e3f2cdb56bf0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"59ee9e7b-537c-4384-ba03-e3f2cdb56bf0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:05:45.452377 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.452325 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/59ee9e7b-537c-4384-ba03-e3f2cdb56bf0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"59ee9e7b-537c-4384-ba03-e3f2cdb56bf0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:05:45.452588 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.452439 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/59ee9e7b-537c-4384-ba03-e3f2cdb56bf0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"59ee9e7b-537c-4384-ba03-e3f2cdb56bf0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:05:45.452666 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.452651 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/59ee9e7b-537c-4384-ba03-e3f2cdb56bf0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"59ee9e7b-537c-4384-ba03-e3f2cdb56bf0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:05:45.452884 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.452856 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/59ee9e7b-537c-4384-ba03-e3f2cdb56bf0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"59ee9e7b-537c-4384-ba03-e3f2cdb56bf0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:05:45.453000 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.452984 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/59ee9e7b-537c-4384-ba03-e3f2cdb56bf0-web-config\") pod \"alertmanager-main-0\" (UID: \"59ee9e7b-537c-4384-ba03-e3f2cdb56bf0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:05:45.453489 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.453471 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/59ee9e7b-537c-4384-ba03-e3f2cdb56bf0-config-out\") pod \"alertmanager-main-0\" (UID: \"59ee9e7b-537c-4384-ba03-e3f2cdb56bf0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:05:45.453682 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.453659 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/59ee9e7b-537c-4384-ba03-e3f2cdb56bf0-config-volume\") pod \"alertmanager-main-0\" (UID: \"59ee9e7b-537c-4384-ba03-e3f2cdb56bf0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:05:45.453768 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.453743 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/59ee9e7b-537c-4384-ba03-e3f2cdb56bf0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"59ee9e7b-537c-4384-ba03-e3f2cdb56bf0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:05:45.453939 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.453920 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/59ee9e7b-537c-4384-ba03-e3f2cdb56bf0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"59ee9e7b-537c-4384-ba03-e3f2cdb56bf0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:05:45.456911 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.456882 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkqhs\" (UniqueName: \"kubernetes.io/projected/59ee9e7b-537c-4384-ba03-e3f2cdb56bf0-kube-api-access-dkqhs\") pod \"alertmanager-main-0\" (UID: \"59ee9e7b-537c-4384-ba03-e3f2cdb56bf0\") " pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:05:45.587548 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.587460 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Apr 21 00:05:45.721008 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.720979 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Apr 21 00:05:45.722728 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:05:45.722697 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59ee9e7b_537c_4384_ba03_e3f2cdb56bf0.slice/crio-2add762392a6fe7115f3dbff0ccfd318756f7531ac03175bff3d8e63faeaed77 WatchSource:0}: Error finding container 2add762392a6fe7115f3dbff0ccfd318756f7531ac03175bff3d8e63faeaed77: Status 404 returned error can't find the container with id 2add762392a6fe7115f3dbff0ccfd318756f7531ac03175bff3d8e63faeaed77 Apr 21 00:05:45.925718 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.925685 2576 generic.go:358] "Generic (PLEG): container finished" podID="59ee9e7b-537c-4384-ba03-e3f2cdb56bf0" containerID="19aed4a7227ab26d3f642df27a6573f5b28c5880d3e3c59536dde3dd78e329e9" exitCode=0 Apr 21 00:05:45.926178 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.925776 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"59ee9e7b-537c-4384-ba03-e3f2cdb56bf0","Type":"ContainerDied","Data":"19aed4a7227ab26d3f642df27a6573f5b28c5880d3e3c59536dde3dd78e329e9"} Apr 21 00:05:45.926178 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:45.925817 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"59ee9e7b-537c-4384-ba03-e3f2cdb56bf0","Type":"ContainerStarted","Data":"2add762392a6fe7115f3dbff0ccfd318756f7531ac03175bff3d8e63faeaed77"} Apr 21 00:05:46.214215 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:46.214180 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85d0b04b-1bef-4c5b-98a5-be1b04f5a27c" path="/var/lib/kubelet/pods/85d0b04b-1bef-4c5b-98a5-be1b04f5a27c/volumes" Apr 21 00:05:46.932449 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:46.932402 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"59ee9e7b-537c-4384-ba03-e3f2cdb56bf0","Type":"ContainerStarted","Data":"a254aa9d3c7fa655ecf22b3a3617df4f47023a798bca3efadfcec25c7ee9507d"} Apr 21 00:05:46.932449 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:46.932449 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"59ee9e7b-537c-4384-ba03-e3f2cdb56bf0","Type":"ContainerStarted","Data":"0e03a6021b72fbd130b16e1d3a1eb8674c3f5bdd34a51494114b9fdf703a09fb"} Apr 21 00:05:46.932887 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:46.932460 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"59ee9e7b-537c-4384-ba03-e3f2cdb56bf0","Type":"ContainerStarted","Data":"47b2197e713652c30b00831af01f50884c32336ec7f411a200cd6637e7e2f3ca"} Apr 21 00:05:46.932887 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:46.932472 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"59ee9e7b-537c-4384-ba03-e3f2cdb56bf0","Type":"ContainerStarted","Data":"451d871666ccc0aaa13cfb9d84eb1bfd61624335ec7ee05ea3224fc5933727e9"} Apr 21 00:05:46.932887 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:46.932480 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"59ee9e7b-537c-4384-ba03-e3f2cdb56bf0","Type":"ContainerStarted","Data":"e74a449cbf947977a42cd71019dbf52b17af526beef709959304809f5cc91659"} Apr 21 00:05:46.932887 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:46.932487 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"59ee9e7b-537c-4384-ba03-e3f2cdb56bf0","Type":"ContainerStarted","Data":"336831abdf13cf981bbb17a9c33d3cad66919f883f89021a6b3a8bdf44d7158f"} Apr 21 00:05:46.958058 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:46.957943 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.957922926 podStartE2EDuration="1.957922926s" podCreationTimestamp="2026-04-21 00:05:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-21 00:05:46.956391032 +0000 UTC m=+139.391729257" watchObservedRunningTime="2026-04-21 00:05:46.957922926 +0000 UTC m=+139.393261151" Apr 21 00:05:47.630192 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:47.630131 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5cc5c5cd5c-kb7ng"] Apr 21 00:05:47.633682 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:47.633650 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5cc5c5cd5c-kb7ng" Apr 21 00:05:47.636110 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:47.636073 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Apr 21 00:05:47.636531 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:47.636508 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Apr 21 00:05:47.636813 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:47.636793 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Apr 21 00:05:47.636999 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:47.636982 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-9wln8\"" Apr 21 00:05:47.637177 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:47.637161 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Apr 21 00:05:47.637377 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:47.637341 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Apr 21 00:05:47.644159 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:47.644127 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Apr 21 00:05:47.653703 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:47.653671 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5cc5c5cd5c-kb7ng"] Apr 21 00:05:47.670517 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:47.670483 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/408756dd-2811-4fa9-81a3-27796b0d86eb-secret-telemeter-client\") pod \"telemeter-client-5cc5c5cd5c-kb7ng\" (UID: \"408756dd-2811-4fa9-81a3-27796b0d86eb\") " pod="openshift-monitoring/telemeter-client-5cc5c5cd5c-kb7ng" Apr 21 00:05:47.670517 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:47.670523 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d56s2\" (UniqueName: \"kubernetes.io/projected/408756dd-2811-4fa9-81a3-27796b0d86eb-kube-api-access-d56s2\") pod \"telemeter-client-5cc5c5cd5c-kb7ng\" (UID: \"408756dd-2811-4fa9-81a3-27796b0d86eb\") " pod="openshift-monitoring/telemeter-client-5cc5c5cd5c-kb7ng" Apr 21 00:05:47.670737 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:47.670563 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/408756dd-2811-4fa9-81a3-27796b0d86eb-telemeter-client-tls\") pod \"telemeter-client-5cc5c5cd5c-kb7ng\" (UID: \"408756dd-2811-4fa9-81a3-27796b0d86eb\") " pod="openshift-monitoring/telemeter-client-5cc5c5cd5c-kb7ng" Apr 21 00:05:47.670737 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:47.670617 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/408756dd-2811-4fa9-81a3-27796b0d86eb-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5cc5c5cd5c-kb7ng\" (UID: \"408756dd-2811-4fa9-81a3-27796b0d86eb\") " pod="openshift-monitoring/telemeter-client-5cc5c5cd5c-kb7ng" Apr 21 00:05:47.670737 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:47.670654 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/408756dd-2811-4fa9-81a3-27796b0d86eb-serving-certs-ca-bundle\") pod \"telemeter-client-5cc5c5cd5c-kb7ng\" (UID: \"408756dd-2811-4fa9-81a3-27796b0d86eb\") " pod="openshift-monitoring/telemeter-client-5cc5c5cd5c-kb7ng" Apr 21 00:05:47.670737 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:47.670674 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/408756dd-2811-4fa9-81a3-27796b0d86eb-federate-client-tls\") pod \"telemeter-client-5cc5c5cd5c-kb7ng\" (UID: \"408756dd-2811-4fa9-81a3-27796b0d86eb\") " pod="openshift-monitoring/telemeter-client-5cc5c5cd5c-kb7ng" Apr 21 00:05:47.670737 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:47.670708 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/408756dd-2811-4fa9-81a3-27796b0d86eb-metrics-client-ca\") pod \"telemeter-client-5cc5c5cd5c-kb7ng\" (UID: \"408756dd-2811-4fa9-81a3-27796b0d86eb\") " pod="openshift-monitoring/telemeter-client-5cc5c5cd5c-kb7ng" Apr 21 00:05:47.670941 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:47.670799 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/408756dd-2811-4fa9-81a3-27796b0d86eb-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5cc5c5cd5c-kb7ng\" (UID: \"408756dd-2811-4fa9-81a3-27796b0d86eb\") " pod="openshift-monitoring/telemeter-client-5cc5c5cd5c-kb7ng" Apr 21 00:05:47.771837 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:47.771782 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/408756dd-2811-4fa9-81a3-27796b0d86eb-metrics-client-ca\") pod \"telemeter-client-5cc5c5cd5c-kb7ng\" (UID: \"408756dd-2811-4fa9-81a3-27796b0d86eb\") " pod="openshift-monitoring/telemeter-client-5cc5c5cd5c-kb7ng" Apr 21 00:05:47.772037 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:47.771852 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/408756dd-2811-4fa9-81a3-27796b0d86eb-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5cc5c5cd5c-kb7ng\" (UID: \"408756dd-2811-4fa9-81a3-27796b0d86eb\") " pod="openshift-monitoring/telemeter-client-5cc5c5cd5c-kb7ng" Apr 21 00:05:47.772037 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:47.771904 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/408756dd-2811-4fa9-81a3-27796b0d86eb-secret-telemeter-client\") pod \"telemeter-client-5cc5c5cd5c-kb7ng\" (UID: \"408756dd-2811-4fa9-81a3-27796b0d86eb\") " pod="openshift-monitoring/telemeter-client-5cc5c5cd5c-kb7ng" Apr 21 00:05:47.772037 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:47.771932 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d56s2\" (UniqueName: \"kubernetes.io/projected/408756dd-2811-4fa9-81a3-27796b0d86eb-kube-api-access-d56s2\") pod \"telemeter-client-5cc5c5cd5c-kb7ng\" (UID: \"408756dd-2811-4fa9-81a3-27796b0d86eb\") " pod="openshift-monitoring/telemeter-client-5cc5c5cd5c-kb7ng" Apr 21 00:05:47.772037 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:47.771970 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/408756dd-2811-4fa9-81a3-27796b0d86eb-telemeter-client-tls\") pod \"telemeter-client-5cc5c5cd5c-kb7ng\" (UID: \"408756dd-2811-4fa9-81a3-27796b0d86eb\") " pod="openshift-monitoring/telemeter-client-5cc5c5cd5c-kb7ng" Apr 21 00:05:47.772037 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:47.772020 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/408756dd-2811-4fa9-81a3-27796b0d86eb-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5cc5c5cd5c-kb7ng\" (UID: \"408756dd-2811-4fa9-81a3-27796b0d86eb\") " pod="openshift-monitoring/telemeter-client-5cc5c5cd5c-kb7ng" Apr 21 00:05:47.772305 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:47.772065 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/408756dd-2811-4fa9-81a3-27796b0d86eb-serving-certs-ca-bundle\") pod \"telemeter-client-5cc5c5cd5c-kb7ng\" (UID: \"408756dd-2811-4fa9-81a3-27796b0d86eb\") " pod="openshift-monitoring/telemeter-client-5cc5c5cd5c-kb7ng" Apr 21 00:05:47.772305 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:47.772093 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/408756dd-2811-4fa9-81a3-27796b0d86eb-federate-client-tls\") pod \"telemeter-client-5cc5c5cd5c-kb7ng\" (UID: \"408756dd-2811-4fa9-81a3-27796b0d86eb\") " pod="openshift-monitoring/telemeter-client-5cc5c5cd5c-kb7ng" Apr 21 00:05:47.772676 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:47.772637 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/408756dd-2811-4fa9-81a3-27796b0d86eb-metrics-client-ca\") pod \"telemeter-client-5cc5c5cd5c-kb7ng\" (UID: \"408756dd-2811-4fa9-81a3-27796b0d86eb\") " pod="openshift-monitoring/telemeter-client-5cc5c5cd5c-kb7ng" Apr 21 00:05:47.772941 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:47.772912 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/408756dd-2811-4fa9-81a3-27796b0d86eb-serving-certs-ca-bundle\") pod \"telemeter-client-5cc5c5cd5c-kb7ng\" (UID: \"408756dd-2811-4fa9-81a3-27796b0d86eb\") " pod="openshift-monitoring/telemeter-client-5cc5c5cd5c-kb7ng" Apr 21 00:05:47.773183 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:47.773075 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/408756dd-2811-4fa9-81a3-27796b0d86eb-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5cc5c5cd5c-kb7ng\" (UID: \"408756dd-2811-4fa9-81a3-27796b0d86eb\") " pod="openshift-monitoring/telemeter-client-5cc5c5cd5c-kb7ng" Apr 21 00:05:47.774906 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:47.774883 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/408756dd-2811-4fa9-81a3-27796b0d86eb-federate-client-tls\") pod \"telemeter-client-5cc5c5cd5c-kb7ng\" (UID: \"408756dd-2811-4fa9-81a3-27796b0d86eb\") " pod="openshift-monitoring/telemeter-client-5cc5c5cd5c-kb7ng" Apr 21 00:05:47.777484 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:47.775139 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/408756dd-2811-4fa9-81a3-27796b0d86eb-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5cc5c5cd5c-kb7ng\" (UID: \"408756dd-2811-4fa9-81a3-27796b0d86eb\") " pod="openshift-monitoring/telemeter-client-5cc5c5cd5c-kb7ng" Apr 21 00:05:47.777484 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:47.775305 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/408756dd-2811-4fa9-81a3-27796b0d86eb-telemeter-client-tls\") pod \"telemeter-client-5cc5c5cd5c-kb7ng\" (UID: \"408756dd-2811-4fa9-81a3-27796b0d86eb\") " pod="openshift-monitoring/telemeter-client-5cc5c5cd5c-kb7ng" Apr 21 00:05:47.777484 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:47.775309 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/408756dd-2811-4fa9-81a3-27796b0d86eb-secret-telemeter-client\") pod \"telemeter-client-5cc5c5cd5c-kb7ng\" (UID: \"408756dd-2811-4fa9-81a3-27796b0d86eb\") " pod="openshift-monitoring/telemeter-client-5cc5c5cd5c-kb7ng" Apr 21 00:05:47.783923 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:47.783893 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d56s2\" (UniqueName: \"kubernetes.io/projected/408756dd-2811-4fa9-81a3-27796b0d86eb-kube-api-access-d56s2\") pod \"telemeter-client-5cc5c5cd5c-kb7ng\" (UID: \"408756dd-2811-4fa9-81a3-27796b0d86eb\") " pod="openshift-monitoring/telemeter-client-5cc5c5cd5c-kb7ng" Apr 21 00:05:47.955056 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:47.954974 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5cc5c5cd5c-kb7ng" Apr 21 00:05:47.960166 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:47.960135 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Apr 21 00:05:47.960778 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:47.960747 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="840f2b50-b403-421e-a3c3-b29727f4fd46" containerName="prometheus" containerID="cri-o://7316214a82653f68f94bfe1b6bbf36031899e47abe0f5857ae4ebdb09d6c3cde" gracePeriod=600 Apr 21 00:05:47.961250 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:47.960942 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="840f2b50-b403-421e-a3c3-b29727f4fd46" containerName="kube-rbac-proxy" containerID="cri-o://c2d169fd06377ac6ee1b1b1d9667f95eb8e4597282bfdf3de8c71d5505835917" gracePeriod=600 Apr 21 00:05:47.961250 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:47.961077 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="840f2b50-b403-421e-a3c3-b29727f4fd46" containerName="kube-rbac-proxy-thanos" containerID="cri-o://8cffcd90b0b8a6744f13e8293925dcbfb4fce05b99afbdacf2811325610e9688" gracePeriod=600 Apr 21 00:05:47.961250 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:47.961082 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="840f2b50-b403-421e-a3c3-b29727f4fd46" containerName="kube-rbac-proxy-web" containerID="cri-o://92ce364c1e324be8e108cd19e64a383734c9e4641c17ac2557f0f14f764aa25c" gracePeriod=600 Apr 21 00:05:47.961250 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:47.961139 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="840f2b50-b403-421e-a3c3-b29727f4fd46" containerName="thanos-sidecar" containerID="cri-o://329c10713eb302c078cd4cf6b83e3d2568e136ce0f562cbfe176e931d2ee67e3" gracePeriod=600 Apr 21 00:05:47.961250 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:47.961153 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="840f2b50-b403-421e-a3c3-b29727f4fd46" containerName="config-reloader" containerID="cri-o://262c6c5743ead33e41210b4c42d7b68a659cd5951873b3b6d4941dd916f324c5" gracePeriod=600 Apr 21 00:05:48.118864 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.118799 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5cc5c5cd5c-kb7ng"] Apr 21 00:05:48.121620 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:05:48.121588 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod408756dd_2811_4fa9_81a3_27796b0d86eb.slice/crio-75f404c939b47b891c913da8cdda5fee66ac7e2f98b39b36717790c2ef77230c WatchSource:0}: Error finding container 75f404c939b47b891c913da8cdda5fee66ac7e2f98b39b36717790c2ef77230c: Status 404 returned error can't find the container with id 75f404c939b47b891c913da8cdda5fee66ac7e2f98b39b36717790c2ef77230c Apr 21 00:05:48.239926 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.239900 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:05:48.279206 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.279166 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/840f2b50-b403-421e-a3c3-b29727f4fd46-configmap-metrics-client-ca\") pod \"840f2b50-b403-421e-a3c3-b29727f4fd46\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " Apr 21 00:05:48.279411 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.279237 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/840f2b50-b403-421e-a3c3-b29727f4fd46-secret-metrics-client-certs\") pod \"840f2b50-b403-421e-a3c3-b29727f4fd46\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " Apr 21 00:05:48.279411 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.279271 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/840f2b50-b403-421e-a3c3-b29727f4fd46-config\") pod \"840f2b50-b403-421e-a3c3-b29727f4fd46\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " Apr 21 00:05:48.279411 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.279305 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/840f2b50-b403-421e-a3c3-b29727f4fd46-web-config\") pod \"840f2b50-b403-421e-a3c3-b29727f4fd46\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " Apr 21 00:05:48.279411 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.279354 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/840f2b50-b403-421e-a3c3-b29727f4fd46-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"840f2b50-b403-421e-a3c3-b29727f4fd46\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " Apr 21 00:05:48.282720 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.279748 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/840f2b50-b403-421e-a3c3-b29727f4fd46-prometheus-k8s-db\") pod \"840f2b50-b403-421e-a3c3-b29727f4fd46\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " Apr 21 00:05:48.282720 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.279796 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/840f2b50-b403-421e-a3c3-b29727f4fd46-prometheus-trusted-ca-bundle\") pod \"840f2b50-b403-421e-a3c3-b29727f4fd46\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " Apr 21 00:05:48.282720 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.279825 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/840f2b50-b403-421e-a3c3-b29727f4fd46-configmap-serving-certs-ca-bundle\") pod \"840f2b50-b403-421e-a3c3-b29727f4fd46\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " Apr 21 00:05:48.282720 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.279862 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/840f2b50-b403-421e-a3c3-b29727f4fd46-secret-kube-rbac-proxy\") pod \"840f2b50-b403-421e-a3c3-b29727f4fd46\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " Apr 21 00:05:48.282720 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.279905 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/840f2b50-b403-421e-a3c3-b29727f4fd46-configmap-kubelet-serving-ca-bundle\") pod \"840f2b50-b403-421e-a3c3-b29727f4fd46\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " Apr 21 00:05:48.282720 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.279946 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/840f2b50-b403-421e-a3c3-b29727f4fd46-config-out\") pod \"840f2b50-b403-421e-a3c3-b29727f4fd46\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " Apr 21 00:05:48.282720 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.279971 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cvzz8\" (UniqueName: \"kubernetes.io/projected/840f2b50-b403-421e-a3c3-b29727f4fd46-kube-api-access-cvzz8\") pod \"840f2b50-b403-421e-a3c3-b29727f4fd46\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " Apr 21 00:05:48.282720 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.280009 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/840f2b50-b403-421e-a3c3-b29727f4fd46-thanos-prometheus-http-client-file\") pod \"840f2b50-b403-421e-a3c3-b29727f4fd46\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " Apr 21 00:05:48.282720 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.280045 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/840f2b50-b403-421e-a3c3-b29727f4fd46-tls-assets\") pod \"840f2b50-b403-421e-a3c3-b29727f4fd46\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " Apr 21 00:05:48.282720 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.280097 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/840f2b50-b403-421e-a3c3-b29727f4fd46-secret-grpc-tls\") pod \"840f2b50-b403-421e-a3c3-b29727f4fd46\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " Apr 21 00:05:48.282720 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.280127 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/840f2b50-b403-421e-a3c3-b29727f4fd46-secret-prometheus-k8s-tls\") pod \"840f2b50-b403-421e-a3c3-b29727f4fd46\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " Apr 21 00:05:48.282720 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.280151 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/840f2b50-b403-421e-a3c3-b29727f4fd46-prometheus-k8s-rulefiles-0\") pod \"840f2b50-b403-421e-a3c3-b29727f4fd46\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " Apr 21 00:05:48.282720 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.280181 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/840f2b50-b403-421e-a3c3-b29727f4fd46-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"840f2b50-b403-421e-a3c3-b29727f4fd46\" (UID: \"840f2b50-b403-421e-a3c3-b29727f4fd46\") " Apr 21 00:05:48.282720 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.280204 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/840f2b50-b403-421e-a3c3-b29727f4fd46-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "840f2b50-b403-421e-a3c3-b29727f4fd46" (UID: "840f2b50-b403-421e-a3c3-b29727f4fd46"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 21 00:05:48.282720 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.280848 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/840f2b50-b403-421e-a3c3-b29727f4fd46-prometheus-trusted-ca-bundle\") on node \"ip-10-0-136-1.ec2.internal\" DevicePath \"\"" Apr 21 00:05:48.282720 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.280905 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/840f2b50-b403-421e-a3c3-b29727f4fd46-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "840f2b50-b403-421e-a3c3-b29727f4fd46" (UID: "840f2b50-b403-421e-a3c3-b29727f4fd46"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Apr 21 00:05:48.284203 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.284171 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/840f2b50-b403-421e-a3c3-b29727f4fd46-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "840f2b50-b403-421e-a3c3-b29727f4fd46" (UID: "840f2b50-b403-421e-a3c3-b29727f4fd46"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 21 00:05:48.286065 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.286030 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/840f2b50-b403-421e-a3c3-b29727f4fd46-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "840f2b50-b403-421e-a3c3-b29727f4fd46" (UID: "840f2b50-b403-421e-a3c3-b29727f4fd46"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 21 00:05:48.286248 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.286186 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/840f2b50-b403-421e-a3c3-b29727f4fd46-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "840f2b50-b403-421e-a3c3-b29727f4fd46" (UID: "840f2b50-b403-421e-a3c3-b29727f4fd46"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 21 00:05:48.286535 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.286504 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/840f2b50-b403-421e-a3c3-b29727f4fd46-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "840f2b50-b403-421e-a3c3-b29727f4fd46" (UID: "840f2b50-b403-421e-a3c3-b29727f4fd46"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 21 00:05:48.286609 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.286546 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/840f2b50-b403-421e-a3c3-b29727f4fd46-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "840f2b50-b403-421e-a3c3-b29727f4fd46" (UID: "840f2b50-b403-421e-a3c3-b29727f4fd46"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 21 00:05:48.286609 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.286584 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/840f2b50-b403-421e-a3c3-b29727f4fd46-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "840f2b50-b403-421e-a3c3-b29727f4fd46" (UID: "840f2b50-b403-421e-a3c3-b29727f4fd46"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 21 00:05:48.286609 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.286591 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/840f2b50-b403-421e-a3c3-b29727f4fd46-config" (OuterVolumeSpecName: "config") pod "840f2b50-b403-421e-a3c3-b29727f4fd46" (UID: "840f2b50-b403-421e-a3c3-b29727f4fd46"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 21 00:05:48.286788 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.286645 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/840f2b50-b403-421e-a3c3-b29727f4fd46-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "840f2b50-b403-421e-a3c3-b29727f4fd46" (UID: "840f2b50-b403-421e-a3c3-b29727f4fd46"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 21 00:05:48.287936 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.287909 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/840f2b50-b403-421e-a3c3-b29727f4fd46-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "840f2b50-b403-421e-a3c3-b29727f4fd46" (UID: "840f2b50-b403-421e-a3c3-b29727f4fd46"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 21 00:05:48.288288 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.288266 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/840f2b50-b403-421e-a3c3-b29727f4fd46-kube-api-access-cvzz8" (OuterVolumeSpecName: "kube-api-access-cvzz8") pod "840f2b50-b403-421e-a3c3-b29727f4fd46" (UID: "840f2b50-b403-421e-a3c3-b29727f4fd46"). InnerVolumeSpecName "kube-api-access-cvzz8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 21 00:05:48.288555 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.288514 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/840f2b50-b403-421e-a3c3-b29727f4fd46-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "840f2b50-b403-421e-a3c3-b29727f4fd46" (UID: "840f2b50-b403-421e-a3c3-b29727f4fd46"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 21 00:05:48.288732 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.288705 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/840f2b50-b403-421e-a3c3-b29727f4fd46-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "840f2b50-b403-421e-a3c3-b29727f4fd46" (UID: "840f2b50-b403-421e-a3c3-b29727f4fd46"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 21 00:05:48.288964 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.288944 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/840f2b50-b403-421e-a3c3-b29727f4fd46-config-out" (OuterVolumeSpecName: "config-out") pod "840f2b50-b403-421e-a3c3-b29727f4fd46" (UID: "840f2b50-b403-421e-a3c3-b29727f4fd46"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Apr 21 00:05:48.289727 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.289701 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/840f2b50-b403-421e-a3c3-b29727f4fd46-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "840f2b50-b403-421e-a3c3-b29727f4fd46" (UID: "840f2b50-b403-421e-a3c3-b29727f4fd46"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 21 00:05:48.290104 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.290084 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/840f2b50-b403-421e-a3c3-b29727f4fd46-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "840f2b50-b403-421e-a3c3-b29727f4fd46" (UID: "840f2b50-b403-421e-a3c3-b29727f4fd46"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 21 00:05:48.305612 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.305568 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/840f2b50-b403-421e-a3c3-b29727f4fd46-web-config" (OuterVolumeSpecName: "web-config") pod "840f2b50-b403-421e-a3c3-b29727f4fd46" (UID: "840f2b50-b403-421e-a3c3-b29727f4fd46"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 21 00:05:48.382070 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.382027 2576 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/840f2b50-b403-421e-a3c3-b29727f4fd46-secret-metrics-client-certs\") on node \"ip-10-0-136-1.ec2.internal\" DevicePath \"\"" Apr 21 00:05:48.382070 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.382063 2576 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/840f2b50-b403-421e-a3c3-b29727f4fd46-config\") on node \"ip-10-0-136-1.ec2.internal\" DevicePath \"\"" Apr 21 00:05:48.382070 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.382078 2576 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/840f2b50-b403-421e-a3c3-b29727f4fd46-web-config\") on node \"ip-10-0-136-1.ec2.internal\" DevicePath \"\"" Apr 21 00:05:48.382349 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.382093 2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/840f2b50-b403-421e-a3c3-b29727f4fd46-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-136-1.ec2.internal\" DevicePath \"\"" Apr 21 00:05:48.382349 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.382107 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/840f2b50-b403-421e-a3c3-b29727f4fd46-prometheus-k8s-db\") on node \"ip-10-0-136-1.ec2.internal\" DevicePath \"\"" Apr 21 00:05:48.382349 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.382120 2576 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/840f2b50-b403-421e-a3c3-b29727f4fd46-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-136-1.ec2.internal\" DevicePath \"\"" Apr 21 00:05:48.382349 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.382132 2576 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/840f2b50-b403-421e-a3c3-b29727f4fd46-secret-kube-rbac-proxy\") on node \"ip-10-0-136-1.ec2.internal\" DevicePath \"\"" Apr 21 00:05:48.382349 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.382145 2576 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/840f2b50-b403-421e-a3c3-b29727f4fd46-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-136-1.ec2.internal\" DevicePath \"\"" Apr 21 00:05:48.382349 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.382157 2576 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/840f2b50-b403-421e-a3c3-b29727f4fd46-config-out\") on node \"ip-10-0-136-1.ec2.internal\" DevicePath \"\"" Apr 21 00:05:48.382349 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.382169 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cvzz8\" (UniqueName: \"kubernetes.io/projected/840f2b50-b403-421e-a3c3-b29727f4fd46-kube-api-access-cvzz8\") on node \"ip-10-0-136-1.ec2.internal\" DevicePath \"\"" Apr 21 00:05:48.382349 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.382182 2576 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/840f2b50-b403-421e-a3c3-b29727f4fd46-thanos-prometheus-http-client-file\") on node \"ip-10-0-136-1.ec2.internal\" DevicePath \"\"" Apr 21 00:05:48.382349 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.382207 2576 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/840f2b50-b403-421e-a3c3-b29727f4fd46-tls-assets\") on node \"ip-10-0-136-1.ec2.internal\" DevicePath \"\"" Apr 21 00:05:48.382349 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.382220 2576 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/840f2b50-b403-421e-a3c3-b29727f4fd46-secret-grpc-tls\") on node \"ip-10-0-136-1.ec2.internal\" DevicePath \"\"" Apr 21 00:05:48.382349 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.382232 2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/840f2b50-b403-421e-a3c3-b29727f4fd46-secret-prometheus-k8s-tls\") on node \"ip-10-0-136-1.ec2.internal\" DevicePath \"\"" Apr 21 00:05:48.382349 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.382245 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/840f2b50-b403-421e-a3c3-b29727f4fd46-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-136-1.ec2.internal\" DevicePath \"\"" Apr 21 00:05:48.382349 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.382267 2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/840f2b50-b403-421e-a3c3-b29727f4fd46-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-136-1.ec2.internal\" DevicePath \"\"" Apr 21 00:05:48.382349 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.382282 2576 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/840f2b50-b403-421e-a3c3-b29727f4fd46-configmap-metrics-client-ca\") on node \"ip-10-0-136-1.ec2.internal\" DevicePath \"\"" Apr 21 00:05:48.940557 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.940508 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5cc5c5cd5c-kb7ng" event={"ID":"408756dd-2811-4fa9-81a3-27796b0d86eb","Type":"ContainerStarted","Data":"75f404c939b47b891c913da8cdda5fee66ac7e2f98b39b36717790c2ef77230c"} Apr 21 00:05:48.944496 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.944415 2576 generic.go:358] "Generic (PLEG): container finished" podID="840f2b50-b403-421e-a3c3-b29727f4fd46" containerID="8cffcd90b0b8a6744f13e8293925dcbfb4fce05b99afbdacf2811325610e9688" exitCode=0 Apr 21 00:05:48.944496 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.944439 2576 generic.go:358] "Generic (PLEG): container finished" podID="840f2b50-b403-421e-a3c3-b29727f4fd46" containerID="c2d169fd06377ac6ee1b1b1d9667f95eb8e4597282bfdf3de8c71d5505835917" exitCode=0 Apr 21 00:05:48.944496 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.944450 2576 generic.go:358] "Generic (PLEG): container finished" podID="840f2b50-b403-421e-a3c3-b29727f4fd46" containerID="92ce364c1e324be8e108cd19e64a383734c9e4641c17ac2557f0f14f764aa25c" exitCode=0 Apr 21 00:05:48.944496 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.944458 2576 generic.go:358] "Generic (PLEG): container finished" podID="840f2b50-b403-421e-a3c3-b29727f4fd46" containerID="329c10713eb302c078cd4cf6b83e3d2568e136ce0f562cbfe176e931d2ee67e3" exitCode=0 Apr 21 00:05:48.944496 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.944465 2576 generic.go:358] "Generic (PLEG): container finished" podID="840f2b50-b403-421e-a3c3-b29727f4fd46" containerID="262c6c5743ead33e41210b4c42d7b68a659cd5951873b3b6d4941dd916f324c5" exitCode=0 Apr 21 00:05:48.944496 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.944463 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"840f2b50-b403-421e-a3c3-b29727f4fd46","Type":"ContainerDied","Data":"8cffcd90b0b8a6744f13e8293925dcbfb4fce05b99afbdacf2811325610e9688"} Apr 21 00:05:48.944496 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.944472 2576 generic.go:358] "Generic (PLEG): container finished" podID="840f2b50-b403-421e-a3c3-b29727f4fd46" containerID="7316214a82653f68f94bfe1b6bbf36031899e47abe0f5857ae4ebdb09d6c3cde" exitCode=0 Apr 21 00:05:48.944496 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.944498 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"840f2b50-b403-421e-a3c3-b29727f4fd46","Type":"ContainerDied","Data":"c2d169fd06377ac6ee1b1b1d9667f95eb8e4597282bfdf3de8c71d5505835917"} Apr 21 00:05:48.944983 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.944514 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"840f2b50-b403-421e-a3c3-b29727f4fd46","Type":"ContainerDied","Data":"92ce364c1e324be8e108cd19e64a383734c9e4641c17ac2557f0f14f764aa25c"} Apr 21 00:05:48.944983 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.944527 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"840f2b50-b403-421e-a3c3-b29727f4fd46","Type":"ContainerDied","Data":"329c10713eb302c078cd4cf6b83e3d2568e136ce0f562cbfe176e931d2ee67e3"} Apr 21 00:05:48.944983 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.944542 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"840f2b50-b403-421e-a3c3-b29727f4fd46","Type":"ContainerDied","Data":"262c6c5743ead33e41210b4c42d7b68a659cd5951873b3b6d4941dd916f324c5"} Apr 21 00:05:48.944983 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.944555 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"840f2b50-b403-421e-a3c3-b29727f4fd46","Type":"ContainerDied","Data":"7316214a82653f68f94bfe1b6bbf36031899e47abe0f5857ae4ebdb09d6c3cde"} Apr 21 00:05:48.944983 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.944568 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"840f2b50-b403-421e-a3c3-b29727f4fd46","Type":"ContainerDied","Data":"963b4d5871e63bffc917cfbf8a104760c4c5f79d8f22e8331d50b72a6497e571"} Apr 21 00:05:48.944983 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.944552 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:05:48.944983 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.944589 2576 scope.go:117] "RemoveContainer" containerID="8cffcd90b0b8a6744f13e8293925dcbfb4fce05b99afbdacf2811325610e9688" Apr 21 00:05:48.955174 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.955153 2576 scope.go:117] "RemoveContainer" containerID="c2d169fd06377ac6ee1b1b1d9667f95eb8e4597282bfdf3de8c71d5505835917" Apr 21 00:05:48.964953 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.964926 2576 scope.go:117] "RemoveContainer" containerID="92ce364c1e324be8e108cd19e64a383734c9e4641c17ac2557f0f14f764aa25c" Apr 21 00:05:48.972098 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.972062 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Apr 21 00:05:48.976178 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.975896 2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Apr 21 00:05:48.976178 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.976058 2576 scope.go:117] "RemoveContainer" containerID="329c10713eb302c078cd4cf6b83e3d2568e136ce0f562cbfe176e931d2ee67e3" Apr 21 00:05:48.985964 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.985942 2576 scope.go:117] "RemoveContainer" containerID="262c6c5743ead33e41210b4c42d7b68a659cd5951873b3b6d4941dd916f324c5" Apr 21 00:05:48.995129 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.995105 2576 scope.go:117] "RemoveContainer" containerID="7316214a82653f68f94bfe1b6bbf36031899e47abe0f5857ae4ebdb09d6c3cde" Apr 21 00:05:48.998251 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.998227 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Apr 21 00:05:49.000416 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.998667 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="840f2b50-b403-421e-a3c3-b29727f4fd46" containerName="prometheus" Apr 21 00:05:49.000416 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.998687 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="840f2b50-b403-421e-a3c3-b29727f4fd46" containerName="prometheus" Apr 21 00:05:49.000416 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.998706 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="840f2b50-b403-421e-a3c3-b29727f4fd46" containerName="kube-rbac-proxy-web" Apr 21 00:05:49.000416 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.998717 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="840f2b50-b403-421e-a3c3-b29727f4fd46" containerName="kube-rbac-proxy-web" Apr 21 00:05:49.000416 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.998729 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="840f2b50-b403-421e-a3c3-b29727f4fd46" containerName="config-reloader" Apr 21 00:05:49.000416 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.998738 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="840f2b50-b403-421e-a3c3-b29727f4fd46" containerName="config-reloader" Apr 21 00:05:49.000416 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.998748 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="840f2b50-b403-421e-a3c3-b29727f4fd46" containerName="thanos-sidecar" Apr 21 00:05:49.000416 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.998756 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="840f2b50-b403-421e-a3c3-b29727f4fd46" containerName="thanos-sidecar" Apr 21 00:05:49.000416 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.998767 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="840f2b50-b403-421e-a3c3-b29727f4fd46" containerName="init-config-reloader" Apr 21 00:05:49.000416 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.998775 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="840f2b50-b403-421e-a3c3-b29727f4fd46" containerName="init-config-reloader" Apr 21 00:05:49.000416 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.998786 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="840f2b50-b403-421e-a3c3-b29727f4fd46" containerName="kube-rbac-proxy" Apr 21 00:05:49.000416 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.998794 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="840f2b50-b403-421e-a3c3-b29727f4fd46" containerName="kube-rbac-proxy" Apr 21 00:05:49.000416 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.998810 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="840f2b50-b403-421e-a3c3-b29727f4fd46" containerName="kube-rbac-proxy-thanos" Apr 21 00:05:49.000416 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.998821 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="840f2b50-b403-421e-a3c3-b29727f4fd46" containerName="kube-rbac-proxy-thanos" Apr 21 00:05:49.000416 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.998890 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="840f2b50-b403-421e-a3c3-b29727f4fd46" containerName="kube-rbac-proxy-web" Apr 21 00:05:49.000416 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.998899 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="840f2b50-b403-421e-a3c3-b29727f4fd46" containerName="thanos-sidecar" Apr 21 00:05:49.000416 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.998906 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="840f2b50-b403-421e-a3c3-b29727f4fd46" containerName="kube-rbac-proxy" Apr 21 00:05:49.000416 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.998913 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="840f2b50-b403-421e-a3c3-b29727f4fd46" containerName="kube-rbac-proxy-thanos" Apr 21 00:05:49.000416 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.998919 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="840f2b50-b403-421e-a3c3-b29727f4fd46" containerName="config-reloader" Apr 21 00:05:49.000416 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:48.998925 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="840f2b50-b403-421e-a3c3-b29727f4fd46" containerName="prometheus" Apr 21 00:05:49.003485 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.003464 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:05:49.005793 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.005767 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Apr 21 00:05:49.006407 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.006182 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Apr 21 00:05:49.006407 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.006233 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Apr 21 00:05:49.006407 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.006262 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Apr 21 00:05:49.006407 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.006233 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Apr 21 00:05:49.006661 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.006509 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Apr 21 00:05:49.006661 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.006520 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Apr 21 00:05:49.006764 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.006662 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Apr 21 00:05:49.006817 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.006775 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-tv545\"" Apr 21 00:05:49.006817 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.006794 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8kmi8rj1b5ti8\"" Apr 21 00:05:49.006909 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.006880 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Apr 21 00:05:49.008467 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.007039 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Apr 21 00:05:49.008467 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.007224 2576 scope.go:117] "RemoveContainer" containerID="3efbfafeee2de1a40fab8f87e698669f225673cc0300e26bd583f4aae2810c54" Apr 21 00:05:49.009547 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.009526 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Apr 21 00:05:49.011966 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.011946 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Apr 21 00:05:49.017402 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.017348 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Apr 21 00:05:49.021578 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.019231 2576 scope.go:117] "RemoveContainer" containerID="8cffcd90b0b8a6744f13e8293925dcbfb4fce05b99afbdacf2811325610e9688" Apr 21 00:05:49.021578 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:05:49.020884 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8cffcd90b0b8a6744f13e8293925dcbfb4fce05b99afbdacf2811325610e9688\": container with ID starting with 8cffcd90b0b8a6744f13e8293925dcbfb4fce05b99afbdacf2811325610e9688 not found: ID does not exist" containerID="8cffcd90b0b8a6744f13e8293925dcbfb4fce05b99afbdacf2811325610e9688" Apr 21 00:05:49.021578 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.020919 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cffcd90b0b8a6744f13e8293925dcbfb4fce05b99afbdacf2811325610e9688"} err="failed to get container status \"8cffcd90b0b8a6744f13e8293925dcbfb4fce05b99afbdacf2811325610e9688\": rpc error: code = NotFound desc = could not find container \"8cffcd90b0b8a6744f13e8293925dcbfb4fce05b99afbdacf2811325610e9688\": container with ID starting with 8cffcd90b0b8a6744f13e8293925dcbfb4fce05b99afbdacf2811325610e9688 not found: ID does not exist" Apr 21 00:05:49.021578 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.020951 2576 scope.go:117] "RemoveContainer" containerID="c2d169fd06377ac6ee1b1b1d9667f95eb8e4597282bfdf3de8c71d5505835917" Apr 21 00:05:49.021578 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:05:49.021286 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2d169fd06377ac6ee1b1b1d9667f95eb8e4597282bfdf3de8c71d5505835917\": container with ID starting with c2d169fd06377ac6ee1b1b1d9667f95eb8e4597282bfdf3de8c71d5505835917 not found: ID does not exist" containerID="c2d169fd06377ac6ee1b1b1d9667f95eb8e4597282bfdf3de8c71d5505835917" Apr 21 00:05:49.021578 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.021314 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2d169fd06377ac6ee1b1b1d9667f95eb8e4597282bfdf3de8c71d5505835917"} err="failed to get container status \"c2d169fd06377ac6ee1b1b1d9667f95eb8e4597282bfdf3de8c71d5505835917\": rpc error: code = NotFound desc = could not find container \"c2d169fd06377ac6ee1b1b1d9667f95eb8e4597282bfdf3de8c71d5505835917\": container with ID starting with c2d169fd06377ac6ee1b1b1d9667f95eb8e4597282bfdf3de8c71d5505835917 not found: ID does not exist" Apr 21 00:05:49.021578 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.021346 2576 scope.go:117] "RemoveContainer" containerID="92ce364c1e324be8e108cd19e64a383734c9e4641c17ac2557f0f14f764aa25c" Apr 21 00:05:49.021887 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:05:49.021687 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92ce364c1e324be8e108cd19e64a383734c9e4641c17ac2557f0f14f764aa25c\": container with ID starting with 92ce364c1e324be8e108cd19e64a383734c9e4641c17ac2557f0f14f764aa25c not found: ID does not exist" containerID="92ce364c1e324be8e108cd19e64a383734c9e4641c17ac2557f0f14f764aa25c" Apr 21 00:05:49.021887 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.021736 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92ce364c1e324be8e108cd19e64a383734c9e4641c17ac2557f0f14f764aa25c"} err="failed to get container status \"92ce364c1e324be8e108cd19e64a383734c9e4641c17ac2557f0f14f764aa25c\": rpc error: code = NotFound desc = could not find container \"92ce364c1e324be8e108cd19e64a383734c9e4641c17ac2557f0f14f764aa25c\": container with ID starting with 92ce364c1e324be8e108cd19e64a383734c9e4641c17ac2557f0f14f764aa25c not found: ID does not exist" Apr 21 00:05:49.021887 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.021758 2576 scope.go:117] "RemoveContainer" containerID="329c10713eb302c078cd4cf6b83e3d2568e136ce0f562cbfe176e931d2ee67e3" Apr 21 00:05:49.022072 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:05:49.022041 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"329c10713eb302c078cd4cf6b83e3d2568e136ce0f562cbfe176e931d2ee67e3\": container with ID starting with 329c10713eb302c078cd4cf6b83e3d2568e136ce0f562cbfe176e931d2ee67e3 not found: ID does not exist" containerID="329c10713eb302c078cd4cf6b83e3d2568e136ce0f562cbfe176e931d2ee67e3" Apr 21 00:05:49.022143 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.022072 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"329c10713eb302c078cd4cf6b83e3d2568e136ce0f562cbfe176e931d2ee67e3"} err="failed to get container status \"329c10713eb302c078cd4cf6b83e3d2568e136ce0f562cbfe176e931d2ee67e3\": rpc error: code = NotFound desc = could not find container \"329c10713eb302c078cd4cf6b83e3d2568e136ce0f562cbfe176e931d2ee67e3\": container with ID starting with 329c10713eb302c078cd4cf6b83e3d2568e136ce0f562cbfe176e931d2ee67e3 not found: ID does not exist" Apr 21 00:05:49.022143 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.022095 2576 scope.go:117] "RemoveContainer" containerID="262c6c5743ead33e41210b4c42d7b68a659cd5951873b3b6d4941dd916f324c5" Apr 21 00:05:49.022404 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:05:49.022377 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"262c6c5743ead33e41210b4c42d7b68a659cd5951873b3b6d4941dd916f324c5\": container with ID starting with 262c6c5743ead33e41210b4c42d7b68a659cd5951873b3b6d4941dd916f324c5 not found: ID does not exist" containerID="262c6c5743ead33e41210b4c42d7b68a659cd5951873b3b6d4941dd916f324c5" Apr 21 00:05:49.022502 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.022410 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"262c6c5743ead33e41210b4c42d7b68a659cd5951873b3b6d4941dd916f324c5"} err="failed to get container status \"262c6c5743ead33e41210b4c42d7b68a659cd5951873b3b6d4941dd916f324c5\": rpc error: code = NotFound desc = could not find container \"262c6c5743ead33e41210b4c42d7b68a659cd5951873b3b6d4941dd916f324c5\": container with ID starting with 262c6c5743ead33e41210b4c42d7b68a659cd5951873b3b6d4941dd916f324c5 not found: ID does not exist" Apr 21 00:05:49.022502 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.022433 2576 scope.go:117] "RemoveContainer" containerID="7316214a82653f68f94bfe1b6bbf36031899e47abe0f5857ae4ebdb09d6c3cde" Apr 21 00:05:49.022713 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:05:49.022689 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7316214a82653f68f94bfe1b6bbf36031899e47abe0f5857ae4ebdb09d6c3cde\": container with ID starting with 7316214a82653f68f94bfe1b6bbf36031899e47abe0f5857ae4ebdb09d6c3cde not found: ID does not exist" containerID="7316214a82653f68f94bfe1b6bbf36031899e47abe0f5857ae4ebdb09d6c3cde" Apr 21 00:05:49.022768 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.022720 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7316214a82653f68f94bfe1b6bbf36031899e47abe0f5857ae4ebdb09d6c3cde"} err="failed to get container status \"7316214a82653f68f94bfe1b6bbf36031899e47abe0f5857ae4ebdb09d6c3cde\": rpc error: code = NotFound desc = could not find container \"7316214a82653f68f94bfe1b6bbf36031899e47abe0f5857ae4ebdb09d6c3cde\": container with ID starting with 7316214a82653f68f94bfe1b6bbf36031899e47abe0f5857ae4ebdb09d6c3cde not found: ID does not exist" Apr 21 00:05:49.022768 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.022754 2576 scope.go:117] "RemoveContainer" containerID="3efbfafeee2de1a40fab8f87e698669f225673cc0300e26bd583f4aae2810c54" Apr 21 00:05:49.023027 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:05:49.022997 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3efbfafeee2de1a40fab8f87e698669f225673cc0300e26bd583f4aae2810c54\": container with ID starting with 3efbfafeee2de1a40fab8f87e698669f225673cc0300e26bd583f4aae2810c54 not found: ID does not exist" containerID="3efbfafeee2de1a40fab8f87e698669f225673cc0300e26bd583f4aae2810c54" Apr 21 00:05:49.023107 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.023020 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3efbfafeee2de1a40fab8f87e698669f225673cc0300e26bd583f4aae2810c54"} err="failed to get container status \"3efbfafeee2de1a40fab8f87e698669f225673cc0300e26bd583f4aae2810c54\": rpc error: code = NotFound desc = could not find container \"3efbfafeee2de1a40fab8f87e698669f225673cc0300e26bd583f4aae2810c54\": container with ID starting with 3efbfafeee2de1a40fab8f87e698669f225673cc0300e26bd583f4aae2810c54 not found: ID does not exist" Apr 21 00:05:49.023107 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.023044 2576 scope.go:117] "RemoveContainer" containerID="8cffcd90b0b8a6744f13e8293925dcbfb4fce05b99afbdacf2811325610e9688" Apr 21 00:05:49.023436 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.023317 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cffcd90b0b8a6744f13e8293925dcbfb4fce05b99afbdacf2811325610e9688"} err="failed to get container status \"8cffcd90b0b8a6744f13e8293925dcbfb4fce05b99afbdacf2811325610e9688\": rpc error: code = NotFound desc = could not find container \"8cffcd90b0b8a6744f13e8293925dcbfb4fce05b99afbdacf2811325610e9688\": container with ID starting with 8cffcd90b0b8a6744f13e8293925dcbfb4fce05b99afbdacf2811325610e9688 not found: ID does not exist" Apr 21 00:05:49.023436 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.023345 2576 scope.go:117] "RemoveContainer" containerID="c2d169fd06377ac6ee1b1b1d9667f95eb8e4597282bfdf3de8c71d5505835917" Apr 21 00:05:49.023772 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.023746 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2d169fd06377ac6ee1b1b1d9667f95eb8e4597282bfdf3de8c71d5505835917"} err="failed to get container status \"c2d169fd06377ac6ee1b1b1d9667f95eb8e4597282bfdf3de8c71d5505835917\": rpc error: code = NotFound desc = could not find container \"c2d169fd06377ac6ee1b1b1d9667f95eb8e4597282bfdf3de8c71d5505835917\": container with ID starting with c2d169fd06377ac6ee1b1b1d9667f95eb8e4597282bfdf3de8c71d5505835917 not found: ID does not exist" Apr 21 00:05:49.023872 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.023774 2576 scope.go:117] "RemoveContainer" containerID="92ce364c1e324be8e108cd19e64a383734c9e4641c17ac2557f0f14f764aa25c" Apr 21 00:05:49.024100 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.024048 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92ce364c1e324be8e108cd19e64a383734c9e4641c17ac2557f0f14f764aa25c"} err="failed to get container status \"92ce364c1e324be8e108cd19e64a383734c9e4641c17ac2557f0f14f764aa25c\": rpc error: code = NotFound desc = could not find container \"92ce364c1e324be8e108cd19e64a383734c9e4641c17ac2557f0f14f764aa25c\": container with ID starting with 92ce364c1e324be8e108cd19e64a383734c9e4641c17ac2557f0f14f764aa25c not found: ID does not exist" Apr 21 00:05:49.024100 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.024093 2576 scope.go:117] "RemoveContainer" containerID="329c10713eb302c078cd4cf6b83e3d2568e136ce0f562cbfe176e931d2ee67e3" Apr 21 00:05:49.024343 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.024319 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"329c10713eb302c078cd4cf6b83e3d2568e136ce0f562cbfe176e931d2ee67e3"} err="failed to get container status \"329c10713eb302c078cd4cf6b83e3d2568e136ce0f562cbfe176e931d2ee67e3\": rpc error: code = NotFound desc = could not find container \"329c10713eb302c078cd4cf6b83e3d2568e136ce0f562cbfe176e931d2ee67e3\": container with ID starting with 329c10713eb302c078cd4cf6b83e3d2568e136ce0f562cbfe176e931d2ee67e3 not found: ID does not exist" Apr 21 00:05:49.024343 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.024338 2576 scope.go:117] "RemoveContainer" containerID="262c6c5743ead33e41210b4c42d7b68a659cd5951873b3b6d4941dd916f324c5" Apr 21 00:05:49.024691 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.024592 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"262c6c5743ead33e41210b4c42d7b68a659cd5951873b3b6d4941dd916f324c5"} err="failed to get container status \"262c6c5743ead33e41210b4c42d7b68a659cd5951873b3b6d4941dd916f324c5\": rpc error: code = NotFound desc = could not find container \"262c6c5743ead33e41210b4c42d7b68a659cd5951873b3b6d4941dd916f324c5\": container with ID starting with 262c6c5743ead33e41210b4c42d7b68a659cd5951873b3b6d4941dd916f324c5 not found: ID does not exist" Apr 21 00:05:49.024691 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.024618 2576 scope.go:117] "RemoveContainer" containerID="7316214a82653f68f94bfe1b6bbf36031899e47abe0f5857ae4ebdb09d6c3cde" Apr 21 00:05:49.024896 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.024877 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7316214a82653f68f94bfe1b6bbf36031899e47abe0f5857ae4ebdb09d6c3cde"} err="failed to get container status \"7316214a82653f68f94bfe1b6bbf36031899e47abe0f5857ae4ebdb09d6c3cde\": rpc error: code = NotFound desc = could not find container \"7316214a82653f68f94bfe1b6bbf36031899e47abe0f5857ae4ebdb09d6c3cde\": container with ID starting with 7316214a82653f68f94bfe1b6bbf36031899e47abe0f5857ae4ebdb09d6c3cde not found: ID does not exist" Apr 21 00:05:49.024896 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.024896 2576 scope.go:117] "RemoveContainer" containerID="3efbfafeee2de1a40fab8f87e698669f225673cc0300e26bd583f4aae2810c54" Apr 21 00:05:49.025125 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.025094 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3efbfafeee2de1a40fab8f87e698669f225673cc0300e26bd583f4aae2810c54"} err="failed to get container status \"3efbfafeee2de1a40fab8f87e698669f225673cc0300e26bd583f4aae2810c54\": rpc error: code = NotFound desc = could not find container \"3efbfafeee2de1a40fab8f87e698669f225673cc0300e26bd583f4aae2810c54\": container with ID starting with 3efbfafeee2de1a40fab8f87e698669f225673cc0300e26bd583f4aae2810c54 not found: ID does not exist" Apr 21 00:05:49.025125 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.025118 2576 scope.go:117] "RemoveContainer" containerID="8cffcd90b0b8a6744f13e8293925dcbfb4fce05b99afbdacf2811325610e9688" Apr 21 00:05:49.025418 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.025399 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cffcd90b0b8a6744f13e8293925dcbfb4fce05b99afbdacf2811325610e9688"} err="failed to get container status \"8cffcd90b0b8a6744f13e8293925dcbfb4fce05b99afbdacf2811325610e9688\": rpc error: code = NotFound desc = could not find container \"8cffcd90b0b8a6744f13e8293925dcbfb4fce05b99afbdacf2811325610e9688\": container with ID starting with 8cffcd90b0b8a6744f13e8293925dcbfb4fce05b99afbdacf2811325610e9688 not found: ID does not exist" Apr 21 00:05:49.025418 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.025416 2576 scope.go:117] "RemoveContainer" containerID="c2d169fd06377ac6ee1b1b1d9667f95eb8e4597282bfdf3de8c71d5505835917" Apr 21 00:05:49.025639 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.025611 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2d169fd06377ac6ee1b1b1d9667f95eb8e4597282bfdf3de8c71d5505835917"} err="failed to get container status \"c2d169fd06377ac6ee1b1b1d9667f95eb8e4597282bfdf3de8c71d5505835917\": rpc error: code = NotFound desc = could not find container \"c2d169fd06377ac6ee1b1b1d9667f95eb8e4597282bfdf3de8c71d5505835917\": container with ID starting with c2d169fd06377ac6ee1b1b1d9667f95eb8e4597282bfdf3de8c71d5505835917 not found: ID does not exist" Apr 21 00:05:49.025639 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.025631 2576 scope.go:117] "RemoveContainer" containerID="92ce364c1e324be8e108cd19e64a383734c9e4641c17ac2557f0f14f764aa25c" Apr 21 00:05:49.025912 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.025895 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92ce364c1e324be8e108cd19e64a383734c9e4641c17ac2557f0f14f764aa25c"} err="failed to get container status \"92ce364c1e324be8e108cd19e64a383734c9e4641c17ac2557f0f14f764aa25c\": rpc error: code = NotFound desc = could not find container \"92ce364c1e324be8e108cd19e64a383734c9e4641c17ac2557f0f14f764aa25c\": container with ID starting with 92ce364c1e324be8e108cd19e64a383734c9e4641c17ac2557f0f14f764aa25c not found: ID does not exist" Apr 21 00:05:49.026001 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.025922 2576 scope.go:117] "RemoveContainer" containerID="329c10713eb302c078cd4cf6b83e3d2568e136ce0f562cbfe176e931d2ee67e3" Apr 21 00:05:49.026225 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.026204 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"329c10713eb302c078cd4cf6b83e3d2568e136ce0f562cbfe176e931d2ee67e3"} err="failed to get container status \"329c10713eb302c078cd4cf6b83e3d2568e136ce0f562cbfe176e931d2ee67e3\": rpc error: code = NotFound desc = could not find container \"329c10713eb302c078cd4cf6b83e3d2568e136ce0f562cbfe176e931d2ee67e3\": container with ID starting with 329c10713eb302c078cd4cf6b83e3d2568e136ce0f562cbfe176e931d2ee67e3 not found: ID does not exist" Apr 21 00:05:49.026315 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.026226 2576 scope.go:117] "RemoveContainer" containerID="262c6c5743ead33e41210b4c42d7b68a659cd5951873b3b6d4941dd916f324c5" Apr 21 00:05:49.026631 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.026600 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"262c6c5743ead33e41210b4c42d7b68a659cd5951873b3b6d4941dd916f324c5"} err="failed to get container status \"262c6c5743ead33e41210b4c42d7b68a659cd5951873b3b6d4941dd916f324c5\": rpc error: code = NotFound desc = could not find container \"262c6c5743ead33e41210b4c42d7b68a659cd5951873b3b6d4941dd916f324c5\": container with ID starting with 262c6c5743ead33e41210b4c42d7b68a659cd5951873b3b6d4941dd916f324c5 not found: ID does not exist" Apr 21 00:05:49.026717 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.026634 2576 scope.go:117] "RemoveContainer" containerID="7316214a82653f68f94bfe1b6bbf36031899e47abe0f5857ae4ebdb09d6c3cde" Apr 21 00:05:49.026908 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.026888 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7316214a82653f68f94bfe1b6bbf36031899e47abe0f5857ae4ebdb09d6c3cde"} err="failed to get container status \"7316214a82653f68f94bfe1b6bbf36031899e47abe0f5857ae4ebdb09d6c3cde\": rpc error: code = NotFound desc = could not find container \"7316214a82653f68f94bfe1b6bbf36031899e47abe0f5857ae4ebdb09d6c3cde\": container with ID starting with 7316214a82653f68f94bfe1b6bbf36031899e47abe0f5857ae4ebdb09d6c3cde not found: ID does not exist" Apr 21 00:05:49.026991 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.026909 2576 scope.go:117] "RemoveContainer" containerID="3efbfafeee2de1a40fab8f87e698669f225673cc0300e26bd583f4aae2810c54" Apr 21 00:05:49.027199 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.027172 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3efbfafeee2de1a40fab8f87e698669f225673cc0300e26bd583f4aae2810c54"} err="failed to get container status \"3efbfafeee2de1a40fab8f87e698669f225673cc0300e26bd583f4aae2810c54\": rpc error: code = NotFound desc = could not find container \"3efbfafeee2de1a40fab8f87e698669f225673cc0300e26bd583f4aae2810c54\": container with ID starting with 3efbfafeee2de1a40fab8f87e698669f225673cc0300e26bd583f4aae2810c54 not found: ID does not exist" Apr 21 00:05:49.027276 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.027201 2576 scope.go:117] "RemoveContainer" containerID="8cffcd90b0b8a6744f13e8293925dcbfb4fce05b99afbdacf2811325610e9688" Apr 21 00:05:49.027476 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.027454 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cffcd90b0b8a6744f13e8293925dcbfb4fce05b99afbdacf2811325610e9688"} err="failed to get container status \"8cffcd90b0b8a6744f13e8293925dcbfb4fce05b99afbdacf2811325610e9688\": rpc error: code = NotFound desc = could not find container \"8cffcd90b0b8a6744f13e8293925dcbfb4fce05b99afbdacf2811325610e9688\": container with ID starting with 8cffcd90b0b8a6744f13e8293925dcbfb4fce05b99afbdacf2811325610e9688 not found: ID does not exist" Apr 21 00:05:49.027567 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.027478 2576 scope.go:117] "RemoveContainer" containerID="c2d169fd06377ac6ee1b1b1d9667f95eb8e4597282bfdf3de8c71d5505835917" Apr 21 00:05:49.027830 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.027809 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2d169fd06377ac6ee1b1b1d9667f95eb8e4597282bfdf3de8c71d5505835917"} err="failed to get container status \"c2d169fd06377ac6ee1b1b1d9667f95eb8e4597282bfdf3de8c71d5505835917\": rpc error: code = NotFound desc = could not find container \"c2d169fd06377ac6ee1b1b1d9667f95eb8e4597282bfdf3de8c71d5505835917\": container with ID starting with c2d169fd06377ac6ee1b1b1d9667f95eb8e4597282bfdf3de8c71d5505835917 not found: ID does not exist" Apr 21 00:05:49.027914 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.027845 2576 scope.go:117] "RemoveContainer" containerID="92ce364c1e324be8e108cd19e64a383734c9e4641c17ac2557f0f14f764aa25c" Apr 21 00:05:49.028117 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.028077 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92ce364c1e324be8e108cd19e64a383734c9e4641c17ac2557f0f14f764aa25c"} err="failed to get container status \"92ce364c1e324be8e108cd19e64a383734c9e4641c17ac2557f0f14f764aa25c\": rpc error: code = NotFound desc = could not find container \"92ce364c1e324be8e108cd19e64a383734c9e4641c17ac2557f0f14f764aa25c\": container with ID starting with 92ce364c1e324be8e108cd19e64a383734c9e4641c17ac2557f0f14f764aa25c not found: ID does not exist" Apr 21 00:05:49.028117 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.028107 2576 scope.go:117] "RemoveContainer" containerID="329c10713eb302c078cd4cf6b83e3d2568e136ce0f562cbfe176e931d2ee67e3" Apr 21 00:05:49.028412 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.028386 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"329c10713eb302c078cd4cf6b83e3d2568e136ce0f562cbfe176e931d2ee67e3"} err="failed to get container status \"329c10713eb302c078cd4cf6b83e3d2568e136ce0f562cbfe176e931d2ee67e3\": rpc error: code = NotFound desc = could not find container \"329c10713eb302c078cd4cf6b83e3d2568e136ce0f562cbfe176e931d2ee67e3\": container with ID starting with 329c10713eb302c078cd4cf6b83e3d2568e136ce0f562cbfe176e931d2ee67e3 not found: ID does not exist" Apr 21 00:05:49.028412 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.028412 2576 scope.go:117] "RemoveContainer" containerID="262c6c5743ead33e41210b4c42d7b68a659cd5951873b3b6d4941dd916f324c5" Apr 21 00:05:49.028683 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.028664 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"262c6c5743ead33e41210b4c42d7b68a659cd5951873b3b6d4941dd916f324c5"} err="failed to get container status \"262c6c5743ead33e41210b4c42d7b68a659cd5951873b3b6d4941dd916f324c5\": rpc error: code = NotFound desc = could not find container \"262c6c5743ead33e41210b4c42d7b68a659cd5951873b3b6d4941dd916f324c5\": container with ID starting with 262c6c5743ead33e41210b4c42d7b68a659cd5951873b3b6d4941dd916f324c5 not found: ID does not exist" Apr 21 00:05:49.028818 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.028686 2576 scope.go:117] "RemoveContainer" containerID="7316214a82653f68f94bfe1b6bbf36031899e47abe0f5857ae4ebdb09d6c3cde" Apr 21 00:05:49.028939 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.028915 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7316214a82653f68f94bfe1b6bbf36031899e47abe0f5857ae4ebdb09d6c3cde"} err="failed to get container status \"7316214a82653f68f94bfe1b6bbf36031899e47abe0f5857ae4ebdb09d6c3cde\": rpc error: code = NotFound desc = could not find container \"7316214a82653f68f94bfe1b6bbf36031899e47abe0f5857ae4ebdb09d6c3cde\": container with ID starting with 7316214a82653f68f94bfe1b6bbf36031899e47abe0f5857ae4ebdb09d6c3cde not found: ID does not exist" Apr 21 00:05:49.028994 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.028942 2576 scope.go:117] "RemoveContainer" containerID="3efbfafeee2de1a40fab8f87e698669f225673cc0300e26bd583f4aae2810c54" Apr 21 00:05:49.029406 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.029285 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3efbfafeee2de1a40fab8f87e698669f225673cc0300e26bd583f4aae2810c54"} err="failed to get container status \"3efbfafeee2de1a40fab8f87e698669f225673cc0300e26bd583f4aae2810c54\": rpc error: code = NotFound desc = could not find container \"3efbfafeee2de1a40fab8f87e698669f225673cc0300e26bd583f4aae2810c54\": container with ID starting with 3efbfafeee2de1a40fab8f87e698669f225673cc0300e26bd583f4aae2810c54 not found: ID does not exist" Apr 21 00:05:49.029406 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.029307 2576 scope.go:117] "RemoveContainer" containerID="8cffcd90b0b8a6744f13e8293925dcbfb4fce05b99afbdacf2811325610e9688" Apr 21 00:05:49.029568 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.029525 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cffcd90b0b8a6744f13e8293925dcbfb4fce05b99afbdacf2811325610e9688"} err="failed to get container status \"8cffcd90b0b8a6744f13e8293925dcbfb4fce05b99afbdacf2811325610e9688\": rpc error: code = NotFound desc = could not find container \"8cffcd90b0b8a6744f13e8293925dcbfb4fce05b99afbdacf2811325610e9688\": container with ID starting with 8cffcd90b0b8a6744f13e8293925dcbfb4fce05b99afbdacf2811325610e9688 not found: ID does not exist" Apr 21 00:05:49.029568 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.029546 2576 scope.go:117] "RemoveContainer" containerID="c2d169fd06377ac6ee1b1b1d9667f95eb8e4597282bfdf3de8c71d5505835917" Apr 21 00:05:49.029801 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.029774 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2d169fd06377ac6ee1b1b1d9667f95eb8e4597282bfdf3de8c71d5505835917"} err="failed to get container status \"c2d169fd06377ac6ee1b1b1d9667f95eb8e4597282bfdf3de8c71d5505835917\": rpc error: code = NotFound desc = could not find container \"c2d169fd06377ac6ee1b1b1d9667f95eb8e4597282bfdf3de8c71d5505835917\": container with ID starting with c2d169fd06377ac6ee1b1b1d9667f95eb8e4597282bfdf3de8c71d5505835917 not found: ID does not exist" Apr 21 00:05:49.029855 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.029802 2576 scope.go:117] "RemoveContainer" containerID="92ce364c1e324be8e108cd19e64a383734c9e4641c17ac2557f0f14f764aa25c" Apr 21 00:05:49.030051 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.030028 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92ce364c1e324be8e108cd19e64a383734c9e4641c17ac2557f0f14f764aa25c"} err="failed to get container status \"92ce364c1e324be8e108cd19e64a383734c9e4641c17ac2557f0f14f764aa25c\": rpc error: code = NotFound desc = could not find container \"92ce364c1e324be8e108cd19e64a383734c9e4641c17ac2557f0f14f764aa25c\": container with ID starting with 92ce364c1e324be8e108cd19e64a383734c9e4641c17ac2557f0f14f764aa25c not found: ID does not exist" Apr 21 00:05:49.030154 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.030053 2576 scope.go:117] "RemoveContainer" containerID="329c10713eb302c078cd4cf6b83e3d2568e136ce0f562cbfe176e931d2ee67e3" Apr 21 00:05:49.030305 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.030274 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"329c10713eb302c078cd4cf6b83e3d2568e136ce0f562cbfe176e931d2ee67e3"} err="failed to get container status \"329c10713eb302c078cd4cf6b83e3d2568e136ce0f562cbfe176e931d2ee67e3\": rpc error: code = NotFound desc = could not find container \"329c10713eb302c078cd4cf6b83e3d2568e136ce0f562cbfe176e931d2ee67e3\": container with ID starting with 329c10713eb302c078cd4cf6b83e3d2568e136ce0f562cbfe176e931d2ee67e3 not found: ID does not exist" Apr 21 00:05:49.030347 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.030310 2576 scope.go:117] "RemoveContainer" containerID="262c6c5743ead33e41210b4c42d7b68a659cd5951873b3b6d4941dd916f324c5" Apr 21 00:05:49.030557 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.030532 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"262c6c5743ead33e41210b4c42d7b68a659cd5951873b3b6d4941dd916f324c5"} err="failed to get container status \"262c6c5743ead33e41210b4c42d7b68a659cd5951873b3b6d4941dd916f324c5\": rpc error: code = NotFound desc = could not find container \"262c6c5743ead33e41210b4c42d7b68a659cd5951873b3b6d4941dd916f324c5\": container with ID starting with 262c6c5743ead33e41210b4c42d7b68a659cd5951873b3b6d4941dd916f324c5 not found: ID does not exist" Apr 21 00:05:49.030664 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.030560 2576 scope.go:117] "RemoveContainer" containerID="7316214a82653f68f94bfe1b6bbf36031899e47abe0f5857ae4ebdb09d6c3cde" Apr 21 00:05:49.030802 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.030783 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7316214a82653f68f94bfe1b6bbf36031899e47abe0f5857ae4ebdb09d6c3cde"} err="failed to get container status \"7316214a82653f68f94bfe1b6bbf36031899e47abe0f5857ae4ebdb09d6c3cde\": rpc error: code = NotFound desc = could not find container \"7316214a82653f68f94bfe1b6bbf36031899e47abe0f5857ae4ebdb09d6c3cde\": container with ID starting with 7316214a82653f68f94bfe1b6bbf36031899e47abe0f5857ae4ebdb09d6c3cde not found: ID does not exist" Apr 21 00:05:49.030894 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.030803 2576 scope.go:117] "RemoveContainer" containerID="3efbfafeee2de1a40fab8f87e698669f225673cc0300e26bd583f4aae2810c54" Apr 21 00:05:49.031050 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.031012 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3efbfafeee2de1a40fab8f87e698669f225673cc0300e26bd583f4aae2810c54"} err="failed to get container status \"3efbfafeee2de1a40fab8f87e698669f225673cc0300e26bd583f4aae2810c54\": rpc error: code = NotFound desc = could not find container \"3efbfafeee2de1a40fab8f87e698669f225673cc0300e26bd583f4aae2810c54\": container with ID starting with 3efbfafeee2de1a40fab8f87e698669f225673cc0300e26bd583f4aae2810c54 not found: ID does not exist" Apr 21 00:05:49.031050 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.031033 2576 scope.go:117] "RemoveContainer" containerID="8cffcd90b0b8a6744f13e8293925dcbfb4fce05b99afbdacf2811325610e9688" Apr 21 00:05:49.031833 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.031806 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cffcd90b0b8a6744f13e8293925dcbfb4fce05b99afbdacf2811325610e9688"} err="failed to get container status \"8cffcd90b0b8a6744f13e8293925dcbfb4fce05b99afbdacf2811325610e9688\": rpc error: code = NotFound desc = could not find container \"8cffcd90b0b8a6744f13e8293925dcbfb4fce05b99afbdacf2811325610e9688\": container with ID starting with 8cffcd90b0b8a6744f13e8293925dcbfb4fce05b99afbdacf2811325610e9688 not found: ID does not exist" Apr 21 00:05:49.032064 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.032027 2576 scope.go:117] "RemoveContainer" containerID="c2d169fd06377ac6ee1b1b1d9667f95eb8e4597282bfdf3de8c71d5505835917" Apr 21 00:05:49.032804 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.032777 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2d169fd06377ac6ee1b1b1d9667f95eb8e4597282bfdf3de8c71d5505835917"} err="failed to get container status \"c2d169fd06377ac6ee1b1b1d9667f95eb8e4597282bfdf3de8c71d5505835917\": rpc error: code = NotFound desc = could not find container \"c2d169fd06377ac6ee1b1b1d9667f95eb8e4597282bfdf3de8c71d5505835917\": container with ID starting with c2d169fd06377ac6ee1b1b1d9667f95eb8e4597282bfdf3de8c71d5505835917 not found: ID does not exist" Apr 21 00:05:49.032804 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.032803 2576 scope.go:117] "RemoveContainer" containerID="92ce364c1e324be8e108cd19e64a383734c9e4641c17ac2557f0f14f764aa25c" Apr 21 00:05:49.033166 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.033128 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92ce364c1e324be8e108cd19e64a383734c9e4641c17ac2557f0f14f764aa25c"} err="failed to get container status \"92ce364c1e324be8e108cd19e64a383734c9e4641c17ac2557f0f14f764aa25c\": rpc error: code = NotFound desc = could not find container \"92ce364c1e324be8e108cd19e64a383734c9e4641c17ac2557f0f14f764aa25c\": container with ID starting with 92ce364c1e324be8e108cd19e64a383734c9e4641c17ac2557f0f14f764aa25c not found: ID does not exist" Apr 21 00:05:49.033166 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.033152 2576 scope.go:117] "RemoveContainer" containerID="329c10713eb302c078cd4cf6b83e3d2568e136ce0f562cbfe176e931d2ee67e3" Apr 21 00:05:49.033419 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.033391 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"329c10713eb302c078cd4cf6b83e3d2568e136ce0f562cbfe176e931d2ee67e3"} err="failed to get container status \"329c10713eb302c078cd4cf6b83e3d2568e136ce0f562cbfe176e931d2ee67e3\": rpc error: code = NotFound desc = could not find container \"329c10713eb302c078cd4cf6b83e3d2568e136ce0f562cbfe176e931d2ee67e3\": container with ID starting with 329c10713eb302c078cd4cf6b83e3d2568e136ce0f562cbfe176e931d2ee67e3 not found: ID does not exist" Apr 21 00:05:49.033419 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.033417 2576 scope.go:117] "RemoveContainer" containerID="262c6c5743ead33e41210b4c42d7b68a659cd5951873b3b6d4941dd916f324c5" Apr 21 00:05:49.033699 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.033675 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"262c6c5743ead33e41210b4c42d7b68a659cd5951873b3b6d4941dd916f324c5"} err="failed to get container status \"262c6c5743ead33e41210b4c42d7b68a659cd5951873b3b6d4941dd916f324c5\": rpc error: code = NotFound desc = could not find container \"262c6c5743ead33e41210b4c42d7b68a659cd5951873b3b6d4941dd916f324c5\": container with ID starting with 262c6c5743ead33e41210b4c42d7b68a659cd5951873b3b6d4941dd916f324c5 not found: ID does not exist" Apr 21 00:05:49.033788 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.033702 2576 scope.go:117] "RemoveContainer" containerID="7316214a82653f68f94bfe1b6bbf36031899e47abe0f5857ae4ebdb09d6c3cde" Apr 21 00:05:49.033955 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.033931 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7316214a82653f68f94bfe1b6bbf36031899e47abe0f5857ae4ebdb09d6c3cde"} err="failed to get container status \"7316214a82653f68f94bfe1b6bbf36031899e47abe0f5857ae4ebdb09d6c3cde\": rpc error: code = NotFound desc = could not find container \"7316214a82653f68f94bfe1b6bbf36031899e47abe0f5857ae4ebdb09d6c3cde\": container with ID starting with 7316214a82653f68f94bfe1b6bbf36031899e47abe0f5857ae4ebdb09d6c3cde not found: ID does not exist" Apr 21 00:05:49.034045 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.033957 2576 scope.go:117] "RemoveContainer" containerID="3efbfafeee2de1a40fab8f87e698669f225673cc0300e26bd583f4aae2810c54" Apr 21 00:05:49.034210 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.034190 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3efbfafeee2de1a40fab8f87e698669f225673cc0300e26bd583f4aae2810c54"} err="failed to get container status \"3efbfafeee2de1a40fab8f87e698669f225673cc0300e26bd583f4aae2810c54\": rpc error: code = NotFound desc = could not find container \"3efbfafeee2de1a40fab8f87e698669f225673cc0300e26bd583f4aae2810c54\": container with ID starting with 3efbfafeee2de1a40fab8f87e698669f225673cc0300e26bd583f4aae2810c54 not found: ID does not exist" Apr 21 00:05:49.087022 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.086985 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bd82b75b-82f3-46b0-b6aa-dc0a5407511b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bd82b75b-82f3-46b0-b6aa-dc0a5407511b\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:05:49.087219 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.087082 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd82b75b-82f3-46b0-b6aa-dc0a5407511b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bd82b75b-82f3-46b0-b6aa-dc0a5407511b\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:05:49.087219 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.087149 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd82b75b-82f3-46b0-b6aa-dc0a5407511b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bd82b75b-82f3-46b0-b6aa-dc0a5407511b\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:05:49.087219 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.087180 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bd82b75b-82f3-46b0-b6aa-dc0a5407511b-web-config\") pod \"prometheus-k8s-0\" (UID: \"bd82b75b-82f3-46b0-b6aa-dc0a5407511b\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:05:49.087219 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.087205 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bd82b75b-82f3-46b0-b6aa-dc0a5407511b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bd82b75b-82f3-46b0-b6aa-dc0a5407511b\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:05:49.087402 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.087221 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bd82b75b-82f3-46b0-b6aa-dc0a5407511b-config-out\") pod \"prometheus-k8s-0\" (UID: \"bd82b75b-82f3-46b0-b6aa-dc0a5407511b\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:05:49.087402 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.087254 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bd82b75b-82f3-46b0-b6aa-dc0a5407511b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bd82b75b-82f3-46b0-b6aa-dc0a5407511b\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:05:49.087402 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.087274 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bd82b75b-82f3-46b0-b6aa-dc0a5407511b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bd82b75b-82f3-46b0-b6aa-dc0a5407511b\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:05:49.087402 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.087292 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpn6d\" (UniqueName: \"kubernetes.io/projected/bd82b75b-82f3-46b0-b6aa-dc0a5407511b-kube-api-access-hpn6d\") pod \"prometheus-k8s-0\" (UID: \"bd82b75b-82f3-46b0-b6aa-dc0a5407511b\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:05:49.087402 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.087310 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bd82b75b-82f3-46b0-b6aa-dc0a5407511b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bd82b75b-82f3-46b0-b6aa-dc0a5407511b\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:05:49.087576 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.087421 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bd82b75b-82f3-46b0-b6aa-dc0a5407511b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bd82b75b-82f3-46b0-b6aa-dc0a5407511b\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:05:49.087576 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.087538 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bd82b75b-82f3-46b0-b6aa-dc0a5407511b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bd82b75b-82f3-46b0-b6aa-dc0a5407511b\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:05:49.087662 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.087584 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd82b75b-82f3-46b0-b6aa-dc0a5407511b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bd82b75b-82f3-46b0-b6aa-dc0a5407511b\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:05:49.087662 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.087648 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bd82b75b-82f3-46b0-b6aa-dc0a5407511b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bd82b75b-82f3-46b0-b6aa-dc0a5407511b\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:05:49.087732 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.087688 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bd82b75b-82f3-46b0-b6aa-dc0a5407511b-config\") pod \"prometheus-k8s-0\" (UID: \"bd82b75b-82f3-46b0-b6aa-dc0a5407511b\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:05:49.087784 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.087743 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd82b75b-82f3-46b0-b6aa-dc0a5407511b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bd82b75b-82f3-46b0-b6aa-dc0a5407511b\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:05:49.087837 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.087824 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bd82b75b-82f3-46b0-b6aa-dc0a5407511b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bd82b75b-82f3-46b0-b6aa-dc0a5407511b\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:05:49.087880 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.087860 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bd82b75b-82f3-46b0-b6aa-dc0a5407511b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bd82b75b-82f3-46b0-b6aa-dc0a5407511b\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:05:49.188902 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.188858 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bd82b75b-82f3-46b0-b6aa-dc0a5407511b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bd82b75b-82f3-46b0-b6aa-dc0a5407511b\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:05:49.189097 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.188917 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bd82b75b-82f3-46b0-b6aa-dc0a5407511b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bd82b75b-82f3-46b0-b6aa-dc0a5407511b\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:05:49.189097 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.188948 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd82b75b-82f3-46b0-b6aa-dc0a5407511b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bd82b75b-82f3-46b0-b6aa-dc0a5407511b\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:05:49.189097 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.188979 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bd82b75b-82f3-46b0-b6aa-dc0a5407511b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bd82b75b-82f3-46b0-b6aa-dc0a5407511b\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:05:49.189097 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.189007 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bd82b75b-82f3-46b0-b6aa-dc0a5407511b-config\") pod \"prometheus-k8s-0\" (UID: \"bd82b75b-82f3-46b0-b6aa-dc0a5407511b\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:05:49.189097 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.189037 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd82b75b-82f3-46b0-b6aa-dc0a5407511b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bd82b75b-82f3-46b0-b6aa-dc0a5407511b\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:05:49.189097 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.189064 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bd82b75b-82f3-46b0-b6aa-dc0a5407511b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bd82b75b-82f3-46b0-b6aa-dc0a5407511b\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:05:49.189097 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.189092 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bd82b75b-82f3-46b0-b6aa-dc0a5407511b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bd82b75b-82f3-46b0-b6aa-dc0a5407511b\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:05:49.189468 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.189124 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bd82b75b-82f3-46b0-b6aa-dc0a5407511b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bd82b75b-82f3-46b0-b6aa-dc0a5407511b\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:05:49.189468 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.189149 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd82b75b-82f3-46b0-b6aa-dc0a5407511b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bd82b75b-82f3-46b0-b6aa-dc0a5407511b\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:05:49.189468 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.189175 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd82b75b-82f3-46b0-b6aa-dc0a5407511b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bd82b75b-82f3-46b0-b6aa-dc0a5407511b\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:05:49.189468 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.189199 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bd82b75b-82f3-46b0-b6aa-dc0a5407511b-web-config\") pod \"prometheus-k8s-0\" (UID: \"bd82b75b-82f3-46b0-b6aa-dc0a5407511b\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:05:49.189468 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.189224 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bd82b75b-82f3-46b0-b6aa-dc0a5407511b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bd82b75b-82f3-46b0-b6aa-dc0a5407511b\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:05:49.189468 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.189244 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bd82b75b-82f3-46b0-b6aa-dc0a5407511b-config-out\") pod \"prometheus-k8s-0\" (UID: \"bd82b75b-82f3-46b0-b6aa-dc0a5407511b\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:05:49.189468 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.189285 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bd82b75b-82f3-46b0-b6aa-dc0a5407511b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bd82b75b-82f3-46b0-b6aa-dc0a5407511b\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:05:49.189468 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.189310 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bd82b75b-82f3-46b0-b6aa-dc0a5407511b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bd82b75b-82f3-46b0-b6aa-dc0a5407511b\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:05:49.189468 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.189343 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hpn6d\" (UniqueName: \"kubernetes.io/projected/bd82b75b-82f3-46b0-b6aa-dc0a5407511b-kube-api-access-hpn6d\") pod \"prometheus-k8s-0\" (UID: \"bd82b75b-82f3-46b0-b6aa-dc0a5407511b\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:05:49.190083 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.189595 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bd82b75b-82f3-46b0-b6aa-dc0a5407511b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bd82b75b-82f3-46b0-b6aa-dc0a5407511b\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:05:49.190083 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.190071 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd82b75b-82f3-46b0-b6aa-dc0a5407511b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bd82b75b-82f3-46b0-b6aa-dc0a5407511b\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:05:49.191031 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.190661 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd82b75b-82f3-46b0-b6aa-dc0a5407511b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bd82b75b-82f3-46b0-b6aa-dc0a5407511b\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:05:49.191031 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.190715 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bd82b75b-82f3-46b0-b6aa-dc0a5407511b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bd82b75b-82f3-46b0-b6aa-dc0a5407511b\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:05:49.192620 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.192262 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bd82b75b-82f3-46b0-b6aa-dc0a5407511b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bd82b75b-82f3-46b0-b6aa-dc0a5407511b\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:05:49.192620 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.192600 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bd82b75b-82f3-46b0-b6aa-dc0a5407511b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bd82b75b-82f3-46b0-b6aa-dc0a5407511b\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:05:49.196725 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.192655 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bd82b75b-82f3-46b0-b6aa-dc0a5407511b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bd82b75b-82f3-46b0-b6aa-dc0a5407511b\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:05:49.196725 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.193479 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bd82b75b-82f3-46b0-b6aa-dc0a5407511b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bd82b75b-82f3-46b0-b6aa-dc0a5407511b\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:05:49.196725 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.193914 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bd82b75b-82f3-46b0-b6aa-dc0a5407511b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bd82b75b-82f3-46b0-b6aa-dc0a5407511b\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:05:49.196725 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.194072 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd82b75b-82f3-46b0-b6aa-dc0a5407511b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bd82b75b-82f3-46b0-b6aa-dc0a5407511b\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:05:49.196725 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.194577 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd82b75b-82f3-46b0-b6aa-dc0a5407511b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bd82b75b-82f3-46b0-b6aa-dc0a5407511b\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:05:49.196725 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.195094 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bd82b75b-82f3-46b0-b6aa-dc0a5407511b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bd82b75b-82f3-46b0-b6aa-dc0a5407511b\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:05:49.196725 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.195226 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bd82b75b-82f3-46b0-b6aa-dc0a5407511b-config-out\") pod \"prometheus-k8s-0\" (UID: \"bd82b75b-82f3-46b0-b6aa-dc0a5407511b\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:05:49.196725 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.196200 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bd82b75b-82f3-46b0-b6aa-dc0a5407511b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bd82b75b-82f3-46b0-b6aa-dc0a5407511b\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:05:49.196725 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.196541 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bd82b75b-82f3-46b0-b6aa-dc0a5407511b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bd82b75b-82f3-46b0-b6aa-dc0a5407511b\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:05:49.197199 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.196770 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bd82b75b-82f3-46b0-b6aa-dc0a5407511b-web-config\") pod \"prometheus-k8s-0\" (UID: \"bd82b75b-82f3-46b0-b6aa-dc0a5407511b\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:05:49.197298 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.197276 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/bd82b75b-82f3-46b0-b6aa-dc0a5407511b-config\") pod \"prometheus-k8s-0\" (UID: \"bd82b75b-82f3-46b0-b6aa-dc0a5407511b\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:05:49.197734 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.197714 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpn6d\" (UniqueName: \"kubernetes.io/projected/bd82b75b-82f3-46b0-b6aa-dc0a5407511b-kube-api-access-hpn6d\") pod \"prometheus-k8s-0\" (UID: \"bd82b75b-82f3-46b0-b6aa-dc0a5407511b\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:05:49.198815 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.198798 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bd82b75b-82f3-46b0-b6aa-dc0a5407511b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bd82b75b-82f3-46b0-b6aa-dc0a5407511b\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:05:49.317279 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.317186 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:05:49.467466 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.467387 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Apr 21 00:05:49.472547 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:05:49.472510 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd82b75b_82f3_46b0_b6aa_dc0a5407511b.slice/crio-536de98928453aa9417ce07c0b602824e3db8c95744255ea06970c1bfecdeb25 WatchSource:0}: Error finding container 536de98928453aa9417ce07c0b602824e3db8c95744255ea06970c1bfecdeb25: Status 404 returned error can't find the container with id 536de98928453aa9417ce07c0b602824e3db8c95744255ea06970c1bfecdeb25 Apr 21 00:05:49.949894 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:49.949859 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd82b75b-82f3-46b0-b6aa-dc0a5407511b","Type":"ContainerStarted","Data":"536de98928453aa9417ce07c0b602824e3db8c95744255ea06970c1bfecdeb25"} Apr 21 00:05:50.210444 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:50.210345 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="840f2b50-b403-421e-a3c3-b29727f4fd46" path="/var/lib/kubelet/pods/840f2b50-b403-421e-a3c3-b29727f4fd46/volumes" Apr 21 00:05:50.954969 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:50.954928 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5cc5c5cd5c-kb7ng" event={"ID":"408756dd-2811-4fa9-81a3-27796b0d86eb","Type":"ContainerStarted","Data":"06cf4db682a17bcfef07b7a14d503a4d8ea753df5661652ab9afd9dfa5d3a47c"} Apr 21 00:05:50.954969 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:50.954976 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5cc5c5cd5c-kb7ng" event={"ID":"408756dd-2811-4fa9-81a3-27796b0d86eb","Type":"ContainerStarted","Data":"c26b3e70da4bbce3034002882edb911373e4b28d513a3df745e9d17986b52067"} Apr 21 00:05:50.955409 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:50.954991 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5cc5c5cd5c-kb7ng" event={"ID":"408756dd-2811-4fa9-81a3-27796b0d86eb","Type":"ContainerStarted","Data":"5a28ee21fc8b990c4964289376f88e9a4cfb05cdf574b34bd8eefcd6789f3612"} Apr 21 00:05:50.956335 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:50.956307 2576 generic.go:358] "Generic (PLEG): container finished" podID="bd82b75b-82f3-46b0-b6aa-dc0a5407511b" containerID="dd9f6cc43eaefd6afb7422816e5f5cc621c32a5d11cb7c60054a9c7d5370661f" exitCode=0 Apr 21 00:05:50.956458 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:50.956396 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd82b75b-82f3-46b0-b6aa-dc0a5407511b","Type":"ContainerDied","Data":"dd9f6cc43eaefd6afb7422816e5f5cc621c32a5d11cb7c60054a9c7d5370661f"} Apr 21 00:05:50.974530 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:50.974483 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5cc5c5cd5c-kb7ng" podStartSLOduration=2.160381535 podStartE2EDuration="3.974466252s" podCreationTimestamp="2026-04-21 00:05:47 +0000 UTC" firstStartedPulling="2026-04-21 00:05:48.123841099 +0000 UTC m=+140.559179308" lastFinishedPulling="2026-04-21 00:05:49.937925822 +0000 UTC m=+142.373264025" observedRunningTime="2026-04-21 00:05:50.972148961 +0000 UTC m=+143.407487210" watchObservedRunningTime="2026-04-21 00:05:50.974466252 +0000 UTC m=+143.409804477" Apr 21 00:05:51.966457 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:51.966411 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd82b75b-82f3-46b0-b6aa-dc0a5407511b","Type":"ContainerStarted","Data":"389239167bab54c3c8dbef9006746208608e29a7c488ffb26d51e1919d7e5fee"} Apr 21 00:05:51.966457 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:51.966458 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd82b75b-82f3-46b0-b6aa-dc0a5407511b","Type":"ContainerStarted","Data":"cb24f3adc8556b095112dfc84d24e39187a8ba75878d5143f489be04bfe1155d"} Apr 21 00:05:51.966972 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:51.966471 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd82b75b-82f3-46b0-b6aa-dc0a5407511b","Type":"ContainerStarted","Data":"cf068a58e8b2c1c9dd21a3eaa126f601932ce2f182d39f5e6edb5f84b4678689"} Apr 21 00:05:51.966972 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:51.966483 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd82b75b-82f3-46b0-b6aa-dc0a5407511b","Type":"ContainerStarted","Data":"5829ffea618892f249a3d7c818d21f6974544b0001d2f322cca4b6b2c41908a8"} Apr 21 00:05:51.966972 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:51.966494 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd82b75b-82f3-46b0-b6aa-dc0a5407511b","Type":"ContainerStarted","Data":"2c73293205382247bce181bbf3b6848a5a706e2ae560a15f48b3778fb82ee29f"} Apr 21 00:05:51.966972 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:51.966506 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd82b75b-82f3-46b0-b6aa-dc0a5407511b","Type":"ContainerStarted","Data":"e52ad1d37dd4951e8d85aa61435e75dbd2bdf4d4475ccfe1710299ff427a07bb"} Apr 21 00:05:51.996620 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:51.996547 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.99652876 podStartE2EDuration="3.99652876s" podCreationTimestamp="2026-04-21 00:05:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-21 00:05:51.993717572 +0000 UTC m=+144.429055796" watchObservedRunningTime="2026-04-21 00:05:51.99652876 +0000 UTC m=+144.431866985" Apr 21 00:05:54.318310 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:05:54.318269 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:06:02.464285 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:06:02.464248 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54859dff79-d49nb"] Apr 21 00:06:27.487313 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:06:27.487241 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-54859dff79-d49nb" podUID="ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed" containerName="console" containerID="cri-o://bca3b0e0381e890089e1d706095c6fa8d0696fed1ff7af4ae28f8c554b09042b" gracePeriod=15 Apr 21 00:06:27.729397 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:06:27.729372 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-54859dff79-d49nb_ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed/console/0.log" Apr 21 00:06:27.729558 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:06:27.729447 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54859dff79-d49nb" Apr 21 00:06:27.827419 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:06:27.827293 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed-service-ca\") pod \"ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed\" (UID: \"ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed\") " Apr 21 00:06:27.827419 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:06:27.827350 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed-console-serving-cert\") pod \"ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed\" (UID: \"ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed\") " Apr 21 00:06:27.827419 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:06:27.827402 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed-console-config\") pod \"ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed\" (UID: \"ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed\") " Apr 21 00:06:27.827698 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:06:27.827455 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed-trusted-ca-bundle\") pod \"ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed\" (UID: \"ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed\") " Apr 21 00:06:27.827698 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:06:27.827471 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s74xw\" (UniqueName: \"kubernetes.io/projected/ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed-kube-api-access-s74xw\") pod \"ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed\" (UID: \"ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed\") " Apr 21 00:06:27.827698 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:06:27.827496 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed-oauth-serving-cert\") pod \"ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed\" (UID: \"ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed\") " Apr 21 00:06:27.827698 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:06:27.827537 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed-console-oauth-config\") pod \"ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed\" (UID: \"ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed\") " Apr 21 00:06:27.827901 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:06:27.827745 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed-service-ca" (OuterVolumeSpecName: "service-ca") pod "ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed" (UID: "ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 21 00:06:27.828071 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:06:27.827974 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed" (UID: "ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 21 00:06:27.828203 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:06:27.828146 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed" (UID: "ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 21 00:06:27.828203 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:06:27.828151 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed-console-config" (OuterVolumeSpecName: "console-config") pod "ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed" (UID: "ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 21 00:06:27.829860 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:06:27.829828 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed-kube-api-access-s74xw" (OuterVolumeSpecName: "kube-api-access-s74xw") pod "ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed" (UID: "ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed"). InnerVolumeSpecName "kube-api-access-s74xw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 21 00:06:27.829961 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:06:27.829942 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed" (UID: "ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 21 00:06:27.830032 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:06:27.830010 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed" (UID: "ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 21 00:06:27.928123 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:06:27.928085 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed-trusted-ca-bundle\") on node \"ip-10-0-136-1.ec2.internal\" DevicePath \"\"" Apr 21 00:06:27.928123 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:06:27.928116 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s74xw\" (UniqueName: \"kubernetes.io/projected/ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed-kube-api-access-s74xw\") on node \"ip-10-0-136-1.ec2.internal\" DevicePath \"\"" Apr 21 00:06:27.928123 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:06:27.928127 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed-oauth-serving-cert\") on node \"ip-10-0-136-1.ec2.internal\" DevicePath \"\"" Apr 21 00:06:27.928123 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:06:27.928136 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed-console-oauth-config\") on node \"ip-10-0-136-1.ec2.internal\" DevicePath \"\"" Apr 21 00:06:27.928430 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:06:27.928145 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed-service-ca\") on node \"ip-10-0-136-1.ec2.internal\" DevicePath \"\"" Apr 21 00:06:27.928430 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:06:27.928153 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed-console-serving-cert\") on node \"ip-10-0-136-1.ec2.internal\" DevicePath \"\"" Apr 21 00:06:27.928430 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:06:27.928161 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed-console-config\") on node \"ip-10-0-136-1.ec2.internal\" DevicePath \"\"" Apr 21 00:06:28.072605 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:06:28.072573 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-54859dff79-d49nb_ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed/console/0.log" Apr 21 00:06:28.072803 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:06:28.072623 2576 generic.go:358] "Generic (PLEG): container finished" podID="ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed" containerID="bca3b0e0381e890089e1d706095c6fa8d0696fed1ff7af4ae28f8c554b09042b" exitCode=2 Apr 21 00:06:28.072803 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:06:28.072664 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54859dff79-d49nb" event={"ID":"ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed","Type":"ContainerDied","Data":"bca3b0e0381e890089e1d706095c6fa8d0696fed1ff7af4ae28f8c554b09042b"} Apr 21 00:06:28.072803 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:06:28.072695 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54859dff79-d49nb" event={"ID":"ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed","Type":"ContainerDied","Data":"f4056a3c4e7426d9c2bcc1aeb0aec763443f1ba013b6fd74cb6a5a3fd028555b"} Apr 21 00:06:28.072803 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:06:28.072717 2576 scope.go:117] "RemoveContainer" containerID="bca3b0e0381e890089e1d706095c6fa8d0696fed1ff7af4ae28f8c554b09042b" Apr 21 00:06:28.072803 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:06:28.072743 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54859dff79-d49nb" Apr 21 00:06:28.084188 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:06:28.084170 2576 scope.go:117] "RemoveContainer" containerID="bca3b0e0381e890089e1d706095c6fa8d0696fed1ff7af4ae28f8c554b09042b" Apr 21 00:06:28.084471 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:06:28.084441 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bca3b0e0381e890089e1d706095c6fa8d0696fed1ff7af4ae28f8c554b09042b\": container with ID starting with bca3b0e0381e890089e1d706095c6fa8d0696fed1ff7af4ae28f8c554b09042b not found: ID does not exist" containerID="bca3b0e0381e890089e1d706095c6fa8d0696fed1ff7af4ae28f8c554b09042b" Apr 21 00:06:28.084575 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:06:28.084481 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bca3b0e0381e890089e1d706095c6fa8d0696fed1ff7af4ae28f8c554b09042b"} err="failed to get container status \"bca3b0e0381e890089e1d706095c6fa8d0696fed1ff7af4ae28f8c554b09042b\": rpc error: code = NotFound desc = could not find container \"bca3b0e0381e890089e1d706095c6fa8d0696fed1ff7af4ae28f8c554b09042b\": container with ID starting with bca3b0e0381e890089e1d706095c6fa8d0696fed1ff7af4ae28f8c554b09042b not found: ID does not exist" Apr 21 00:06:28.093934 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:06:28.093909 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54859dff79-d49nb"] Apr 21 00:06:28.097584 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:06:28.097561 2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-54859dff79-d49nb"] Apr 21 00:06:28.209507 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:06:28.209469 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed" path="/var/lib/kubelet/pods/ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed/volumes" Apr 21 00:06:28.504025 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:06:28.503990 2576 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba34dd1e_a1d1_4d32_bc94_14af01f7e9ed.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba34dd1e_a1d1_4d32_bc94_14af01f7e9ed.slice/crio-f4056a3c4e7426d9c2bcc1aeb0aec763443f1ba013b6fd74cb6a5a3fd028555b\": RecentStats: unable to find data in memory cache]" Apr 21 00:06:31.571873 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:06:31.571831 2576 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba34dd1e_a1d1_4d32_bc94_14af01f7e9ed.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba34dd1e_a1d1_4d32_bc94_14af01f7e9ed.slice/crio-f4056a3c4e7426d9c2bcc1aeb0aec763443f1ba013b6fd74cb6a5a3fd028555b\": RecentStats: unable to find data in memory cache]" Apr 21 00:06:38.540440 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:06:38.540402 2576 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba34dd1e_a1d1_4d32_bc94_14af01f7e9ed.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba34dd1e_a1d1_4d32_bc94_14af01f7e9ed.slice/crio-f4056a3c4e7426d9c2bcc1aeb0aec763443f1ba013b6fd74cb6a5a3fd028555b\": RecentStats: unable to find data in memory cache]" Apr 21 00:06:46.561983 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:06:46.561938 2576 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba34dd1e_a1d1_4d32_bc94_14af01f7e9ed.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba34dd1e_a1d1_4d32_bc94_14af01f7e9ed.slice/crio-f4056a3c4e7426d9c2bcc1aeb0aec763443f1ba013b6fd74cb6a5a3fd028555b\": RecentStats: unable to find data in memory cache]" Apr 21 00:06:48.548549 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:06:48.548512 2576 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba34dd1e_a1d1_4d32_bc94_14af01f7e9ed.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba34dd1e_a1d1_4d32_bc94_14af01f7e9ed.slice/crio-f4056a3c4e7426d9c2bcc1aeb0aec763443f1ba013b6fd74cb6a5a3fd028555b\": RecentStats: unable to find data in memory cache]" Apr 21 00:06:49.318196 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:06:49.318156 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:06:49.334403 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:06:49.334351 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:06:50.154734 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:06:50.154704 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Apr 21 00:06:58.585311 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:06:58.585273 2576 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba34dd1e_a1d1_4d32_bc94_14af01f7e9ed.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba34dd1e_a1d1_4d32_bc94_14af01f7e9ed.slice/crio-f4056a3c4e7426d9c2bcc1aeb0aec763443f1ba013b6fd74cb6a5a3fd028555b\": RecentStats: unable to find data in memory cache]" Apr 21 00:07:01.532325 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:07:01.532284 2576 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba34dd1e_a1d1_4d32_bc94_14af01f7e9ed.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba34dd1e_a1d1_4d32_bc94_14af01f7e9ed.slice/crio-f4056a3c4e7426d9c2bcc1aeb0aec763443f1ba013b6fd74cb6a5a3fd028555b\": RecentStats: unable to find data in memory cache]" Apr 21 00:07:08.620847 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:07:08.620803 2576 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba34dd1e_a1d1_4d32_bc94_14af01f7e9ed.slice/crio-f4056a3c4e7426d9c2bcc1aeb0aec763443f1ba013b6fd74cb6a5a3fd028555b\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba34dd1e_a1d1_4d32_bc94_14af01f7e9ed.slice\": RecentStats: unable to find data in memory cache]" Apr 21 00:07:16.188551 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:07:16.188513 2576 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba34dd1e_a1d1_4d32_bc94_14af01f7e9ed.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba34dd1e_a1d1_4d32_bc94_14af01f7e9ed.slice/crio-f4056a3c4e7426d9c2bcc1aeb0aec763443f1ba013b6fd74cb6a5a3fd028555b\": RecentStats: unable to find data in memory cache]" Apr 21 00:07:16.188938 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:07:16.188646 2576 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba34dd1e_a1d1_4d32_bc94_14af01f7e9ed.slice/crio-f4056a3c4e7426d9c2bcc1aeb0aec763443f1ba013b6fd74cb6a5a3fd028555b\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba34dd1e_a1d1_4d32_bc94_14af01f7e9ed.slice\": RecentStats: unable to find data in memory cache]" Apr 21 00:07:16.529319 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:07:16.529210 2576 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba34dd1e_a1d1_4d32_bc94_14af01f7e9ed.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba34dd1e_a1d1_4d32_bc94_14af01f7e9ed.slice/crio-f4056a3c4e7426d9c2bcc1aeb0aec763443f1ba013b6fd74cb6a5a3fd028555b\": RecentStats: unable to find data in memory cache]" Apr 21 00:07:18.628734 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:07:18.628699 2576 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba34dd1e_a1d1_4d32_bc94_14af01f7e9ed.slice/crio-f4056a3c4e7426d9c2bcc1aeb0aec763443f1ba013b6fd74cb6a5a3fd028555b\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba34dd1e_a1d1_4d32_bc94_14af01f7e9ed.slice\": RecentStats: unable to find data in memory cache]" Apr 21 00:07:27.645998 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:07:27.645964 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-lnrfk"] Apr 21 00:07:27.646400 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:07:27.646272 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed" containerName="console" Apr 21 00:07:27.646400 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:07:27.646284 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed" containerName="console" Apr 21 00:07:27.646400 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:07:27.646349 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="ba34dd1e-a1d1-4d32-bc94-14af01f7e9ed" containerName="console" Apr 21 00:07:27.648278 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:07:27.648258 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lnrfk" Apr 21 00:07:27.650587 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:07:27.650565 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Apr 21 00:07:27.658387 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:07:27.658346 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lnrfk"] Apr 21 00:07:27.727930 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:07:27.727892 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9bea10f3-585b-463c-8dc6-e016d6ef92ef-original-pull-secret\") pod \"global-pull-secret-syncer-lnrfk\" (UID: \"9bea10f3-585b-463c-8dc6-e016d6ef92ef\") " pod="kube-system/global-pull-secret-syncer-lnrfk" Apr 21 00:07:27.727930 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:07:27.727944 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9bea10f3-585b-463c-8dc6-e016d6ef92ef-dbus\") pod \"global-pull-secret-syncer-lnrfk\" (UID: \"9bea10f3-585b-463c-8dc6-e016d6ef92ef\") " pod="kube-system/global-pull-secret-syncer-lnrfk" Apr 21 00:07:27.728153 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:07:27.728026 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9bea10f3-585b-463c-8dc6-e016d6ef92ef-kubelet-config\") pod \"global-pull-secret-syncer-lnrfk\" (UID: \"9bea10f3-585b-463c-8dc6-e016d6ef92ef\") " pod="kube-system/global-pull-secret-syncer-lnrfk" Apr 21 00:07:27.829210 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:07:27.829162 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9bea10f3-585b-463c-8dc6-e016d6ef92ef-original-pull-secret\") pod \"global-pull-secret-syncer-lnrfk\" (UID: \"9bea10f3-585b-463c-8dc6-e016d6ef92ef\") " pod="kube-system/global-pull-secret-syncer-lnrfk" Apr 21 00:07:27.829423 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:07:27.829220 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9bea10f3-585b-463c-8dc6-e016d6ef92ef-dbus\") pod \"global-pull-secret-syncer-lnrfk\" (UID: \"9bea10f3-585b-463c-8dc6-e016d6ef92ef\") " pod="kube-system/global-pull-secret-syncer-lnrfk" Apr 21 00:07:27.829423 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:07:27.829258 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9bea10f3-585b-463c-8dc6-e016d6ef92ef-kubelet-config\") pod \"global-pull-secret-syncer-lnrfk\" (UID: \"9bea10f3-585b-463c-8dc6-e016d6ef92ef\") " pod="kube-system/global-pull-secret-syncer-lnrfk" Apr 21 00:07:27.829423 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:07:27.829331 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9bea10f3-585b-463c-8dc6-e016d6ef92ef-kubelet-config\") pod \"global-pull-secret-syncer-lnrfk\" (UID: \"9bea10f3-585b-463c-8dc6-e016d6ef92ef\") " pod="kube-system/global-pull-secret-syncer-lnrfk" Apr 21 00:07:27.829535 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:07:27.829444 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9bea10f3-585b-463c-8dc6-e016d6ef92ef-dbus\") pod \"global-pull-secret-syncer-lnrfk\" (UID: \"9bea10f3-585b-463c-8dc6-e016d6ef92ef\") " pod="kube-system/global-pull-secret-syncer-lnrfk" Apr 21 00:07:27.831763 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:07:27.831729 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9bea10f3-585b-463c-8dc6-e016d6ef92ef-original-pull-secret\") pod \"global-pull-secret-syncer-lnrfk\" (UID: \"9bea10f3-585b-463c-8dc6-e016d6ef92ef\") " pod="kube-system/global-pull-secret-syncer-lnrfk" Apr 21 00:07:27.957881 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:07:27.957794 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lnrfk" Apr 21 00:07:28.095343 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:07:28.095324 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lnrfk"] Apr 21 00:07:28.098048 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:07:28.098024 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bea10f3_585b_463c_8dc6_e016d6ef92ef.slice/crio-377e0223bc8fe2315488765778e7c9ed6495aeaff1e4c04c741cf07851b8f2df WatchSource:0}: Error finding container 377e0223bc8fe2315488765778e7c9ed6495aeaff1e4c04c741cf07851b8f2df: Status 404 returned error can't find the container with id 377e0223bc8fe2315488765778e7c9ed6495aeaff1e4c04c741cf07851b8f2df Apr 21 00:07:28.245451 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:07:28.245341 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lnrfk" event={"ID":"9bea10f3-585b-463c-8dc6-e016d6ef92ef","Type":"ContainerStarted","Data":"377e0223bc8fe2315488765778e7c9ed6495aeaff1e4c04c741cf07851b8f2df"} Apr 21 00:07:33.261063 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:07:33.261022 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lnrfk" event={"ID":"9bea10f3-585b-463c-8dc6-e016d6ef92ef","Type":"ContainerStarted","Data":"95e79e9ee2968df8086eedca0d4b30a87bfb56140ddfc27fc4d0de7ec95c97f6"} Apr 21 00:07:33.278880 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:07:33.278824 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-lnrfk" podStartSLOduration=2.006983511 podStartE2EDuration="6.278808766s" podCreationTimestamp="2026-04-21 00:07:27 +0000 UTC" firstStartedPulling="2026-04-21 00:07:28.100171675 +0000 UTC m=+240.535509877" lastFinishedPulling="2026-04-21 00:07:32.371996923 +0000 UTC m=+244.807335132" observedRunningTime="2026-04-21 00:07:33.27744993 +0000 UTC m=+245.712788155" watchObservedRunningTime="2026-04-21 00:07:33.278808766 +0000 UTC m=+245.714146989" Apr 21 00:08:25.564248 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:25.564213 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-vb7tw"] Apr 21 00:08:25.566695 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:25.566672 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-vb7tw" Apr 21 00:08:25.569229 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:25.569207 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Apr 21 00:08:25.569376 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:25.569284 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Apr 21 00:08:25.569431 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:25.569378 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-vxx4l\"" Apr 21 00:08:25.576200 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:25.576173 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-vb7tw"] Apr 21 00:08:25.632884 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:25.632844 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqdzw\" (UniqueName: \"kubernetes.io/projected/51e5578a-d9a2-4626-97dd-0025cc10af35-kube-api-access-zqdzw\") pod \"openshift-lws-operator-bfc7f696d-vb7tw\" (UID: \"51e5578a-d9a2-4626-97dd-0025cc10af35\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-vb7tw" Apr 21 00:08:25.633055 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:25.632906 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/51e5578a-d9a2-4626-97dd-0025cc10af35-tmp\") pod \"openshift-lws-operator-bfc7f696d-vb7tw\" (UID: \"51e5578a-d9a2-4626-97dd-0025cc10af35\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-vb7tw" Apr 21 00:08:25.734249 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:25.734207 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zqdzw\" (UniqueName: \"kubernetes.io/projected/51e5578a-d9a2-4626-97dd-0025cc10af35-kube-api-access-zqdzw\") pod \"openshift-lws-operator-bfc7f696d-vb7tw\" (UID: \"51e5578a-d9a2-4626-97dd-0025cc10af35\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-vb7tw" Apr 21 00:08:25.734249 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:25.734256 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/51e5578a-d9a2-4626-97dd-0025cc10af35-tmp\") pod \"openshift-lws-operator-bfc7f696d-vb7tw\" (UID: \"51e5578a-d9a2-4626-97dd-0025cc10af35\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-vb7tw" Apr 21 00:08:25.734655 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:25.734638 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/51e5578a-d9a2-4626-97dd-0025cc10af35-tmp\") pod \"openshift-lws-operator-bfc7f696d-vb7tw\" (UID: \"51e5578a-d9a2-4626-97dd-0025cc10af35\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-vb7tw" Apr 21 00:08:25.742553 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:25.742521 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqdzw\" (UniqueName: \"kubernetes.io/projected/51e5578a-d9a2-4626-97dd-0025cc10af35-kube-api-access-zqdzw\") pod \"openshift-lws-operator-bfc7f696d-vb7tw\" (UID: \"51e5578a-d9a2-4626-97dd-0025cc10af35\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-vb7tw" Apr 21 00:08:25.887367 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:25.887333 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-vb7tw" Apr 21 00:08:26.028993 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:26.028958 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-vb7tw"] Apr 21 00:08:26.032156 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:08:26.032123 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod51e5578a_d9a2_4626_97dd_0025cc10af35.slice/crio-68ca23801cb178650a55412fb864dffe9fdbfd32f85a134b3f5443a50dbb38d3 WatchSource:0}: Error finding container 68ca23801cb178650a55412fb864dffe9fdbfd32f85a134b3f5443a50dbb38d3: Status 404 returned error can't find the container with id 68ca23801cb178650a55412fb864dffe9fdbfd32f85a134b3f5443a50dbb38d3 Apr 21 00:08:26.420918 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:26.420882 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-vb7tw" event={"ID":"51e5578a-d9a2-4626-97dd-0025cc10af35","Type":"ContainerStarted","Data":"68ca23801cb178650a55412fb864dffe9fdbfd32f85a134b3f5443a50dbb38d3"} Apr 21 00:08:28.982587 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:28.982563 2576 kubelet.go:1628] "Image garbage collection succeeded" Apr 21 00:08:29.432211 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:29.432171 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-vb7tw" event={"ID":"51e5578a-d9a2-4626-97dd-0025cc10af35","Type":"ContainerStarted","Data":"8f406d9c359525a1a960a9faa2b01e2762df97fce0fd4c86588d0baee33c44d2"} Apr 21 00:08:29.447394 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:29.447328 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-vb7tw" podStartSLOduration=1.475837585 podStartE2EDuration="4.447312982s" podCreationTimestamp="2026-04-21 00:08:25 +0000 UTC" firstStartedPulling="2026-04-21 00:08:26.0337836 +0000 UTC m=+298.469121806" lastFinishedPulling="2026-04-21 00:08:29.005258997 +0000 UTC m=+301.440597203" observedRunningTime="2026-04-21 00:08:29.445895774 +0000 UTC m=+301.881233997" watchObservedRunningTime="2026-04-21 00:08:29.447312982 +0000 UTC m=+301.882651206" Apr 21 00:08:32.140773 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:32.140739 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-5lrxs"] Apr 21 00:08:32.143315 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:32.143298 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-5lrxs" Apr 21 00:08:32.145497 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:32.145475 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-4gzwp\"" Apr 21 00:08:32.145636 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:32.145475 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Apr 21 00:08:32.146392 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:32.146373 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Apr 21 00:08:32.150932 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:32.150908 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-5lrxs"] Apr 21 00:08:32.191961 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:32.191921 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0c70a39d-6e5c-4d79-ab89-3071264b65cc-bound-sa-token\") pod \"cert-manager-79c8d999ff-5lrxs\" (UID: \"0c70a39d-6e5c-4d79-ab89-3071264b65cc\") " pod="cert-manager/cert-manager-79c8d999ff-5lrxs" Apr 21 00:08:32.192156 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:32.191985 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkpg7\" (UniqueName: \"kubernetes.io/projected/0c70a39d-6e5c-4d79-ab89-3071264b65cc-kube-api-access-lkpg7\") pod \"cert-manager-79c8d999ff-5lrxs\" (UID: \"0c70a39d-6e5c-4d79-ab89-3071264b65cc\") " pod="cert-manager/cert-manager-79c8d999ff-5lrxs" Apr 21 00:08:32.293251 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:32.293211 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0c70a39d-6e5c-4d79-ab89-3071264b65cc-bound-sa-token\") pod \"cert-manager-79c8d999ff-5lrxs\" (UID: \"0c70a39d-6e5c-4d79-ab89-3071264b65cc\") " pod="cert-manager/cert-manager-79c8d999ff-5lrxs" Apr 21 00:08:32.293460 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:32.293299 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lkpg7\" (UniqueName: \"kubernetes.io/projected/0c70a39d-6e5c-4d79-ab89-3071264b65cc-kube-api-access-lkpg7\") pod \"cert-manager-79c8d999ff-5lrxs\" (UID: \"0c70a39d-6e5c-4d79-ab89-3071264b65cc\") " pod="cert-manager/cert-manager-79c8d999ff-5lrxs" Apr 21 00:08:32.300928 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:32.300889 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0c70a39d-6e5c-4d79-ab89-3071264b65cc-bound-sa-token\") pod \"cert-manager-79c8d999ff-5lrxs\" (UID: \"0c70a39d-6e5c-4d79-ab89-3071264b65cc\") " pod="cert-manager/cert-manager-79c8d999ff-5lrxs" Apr 21 00:08:32.301064 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:32.300938 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkpg7\" (UniqueName: \"kubernetes.io/projected/0c70a39d-6e5c-4d79-ab89-3071264b65cc-kube-api-access-lkpg7\") pod \"cert-manager-79c8d999ff-5lrxs\" (UID: \"0c70a39d-6e5c-4d79-ab89-3071264b65cc\") " pod="cert-manager/cert-manager-79c8d999ff-5lrxs" Apr 21 00:08:32.453531 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:32.453424 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-5lrxs" Apr 21 00:08:32.578130 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:32.578097 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-5lrxs"] Apr 21 00:08:32.581797 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:08:32.581761 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0c70a39d_6e5c_4d79_ab89_3071264b65cc.slice/crio-597d40f3ac65e130cdb07660c3cdeb94d711f68659f521839fbf1b36c456b5e1 WatchSource:0}: Error finding container 597d40f3ac65e130cdb07660c3cdeb94d711f68659f521839fbf1b36c456b5e1: Status 404 returned error can't find the container with id 597d40f3ac65e130cdb07660c3cdeb94d711f68659f521839fbf1b36c456b5e1 Apr 21 00:08:32.583584 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:32.583568 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Apr 21 00:08:33.447775 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:33.447731 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-5lrxs" event={"ID":"0c70a39d-6e5c-4d79-ab89-3071264b65cc","Type":"ContainerStarted","Data":"597d40f3ac65e130cdb07660c3cdeb94d711f68659f521839fbf1b36c456b5e1"} Apr 21 00:08:35.457353 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:35.457310 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-5lrxs" event={"ID":"0c70a39d-6e5c-4d79-ab89-3071264b65cc","Type":"ContainerStarted","Data":"615e386c999aed0db6400cd3bca117ffff8b97c84143f4a78a49b8178d7e51db"} Apr 21 00:08:35.473194 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:35.473141 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-5lrxs" podStartSLOduration=0.686894495 podStartE2EDuration="3.473123918s" podCreationTimestamp="2026-04-21 00:08:32 +0000 UTC" firstStartedPulling="2026-04-21 00:08:32.583696898 +0000 UTC m=+305.019035100" lastFinishedPulling="2026-04-21 00:08:35.369926318 +0000 UTC m=+307.805264523" observedRunningTime="2026-04-21 00:08:35.471784914 +0000 UTC m=+307.907123138" watchObservedRunningTime="2026-04-21 00:08:35.473123918 +0000 UTC m=+307.908462143" Apr 21 00:08:38.376231 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:38.376193 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5956879555-qddpw"] Apr 21 00:08:38.378882 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:38.378861 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5956879555-qddpw" Apr 21 00:08:38.381034 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:38.381010 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Apr 21 00:08:38.382230 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:38.382211 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Apr 21 00:08:38.382311 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:38.382211 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-b9t7h\"" Apr 21 00:08:38.382311 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:38.382276 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Apr 21 00:08:38.391994 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:38.391966 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5956879555-qddpw"] Apr 21 00:08:38.453457 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:38.453404 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnwgf\" (UniqueName: \"kubernetes.io/projected/17680b37-e969-4275-8e84-557fb8d45d6f-kube-api-access-qnwgf\") pod \"lws-controller-manager-5956879555-qddpw\" (UID: \"17680b37-e969-4275-8e84-557fb8d45d6f\") " pod="openshift-lws-operator/lws-controller-manager-5956879555-qddpw" Apr 21 00:08:38.453457 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:38.453463 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/17680b37-e969-4275-8e84-557fb8d45d6f-cert\") pod \"lws-controller-manager-5956879555-qddpw\" (UID: \"17680b37-e969-4275-8e84-557fb8d45d6f\") " pod="openshift-lws-operator/lws-controller-manager-5956879555-qddpw" Apr 21 00:08:38.453723 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:38.453497 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/17680b37-e969-4275-8e84-557fb8d45d6f-manager-config\") pod \"lws-controller-manager-5956879555-qddpw\" (UID: \"17680b37-e969-4275-8e84-557fb8d45d6f\") " pod="openshift-lws-operator/lws-controller-manager-5956879555-qddpw" Apr 21 00:08:38.453723 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:38.453566 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/17680b37-e969-4275-8e84-557fb8d45d6f-metrics-cert\") pod \"lws-controller-manager-5956879555-qddpw\" (UID: \"17680b37-e969-4275-8e84-557fb8d45d6f\") " pod="openshift-lws-operator/lws-controller-manager-5956879555-qddpw" Apr 21 00:08:38.554617 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:38.554577 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qnwgf\" (UniqueName: \"kubernetes.io/projected/17680b37-e969-4275-8e84-557fb8d45d6f-kube-api-access-qnwgf\") pod \"lws-controller-manager-5956879555-qddpw\" (UID: \"17680b37-e969-4275-8e84-557fb8d45d6f\") " pod="openshift-lws-operator/lws-controller-manager-5956879555-qddpw" Apr 21 00:08:38.554617 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:38.554622 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/17680b37-e969-4275-8e84-557fb8d45d6f-cert\") pod \"lws-controller-manager-5956879555-qddpw\" (UID: \"17680b37-e969-4275-8e84-557fb8d45d6f\") " pod="openshift-lws-operator/lws-controller-manager-5956879555-qddpw" Apr 21 00:08:38.554873 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:38.554641 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/17680b37-e969-4275-8e84-557fb8d45d6f-manager-config\") pod \"lws-controller-manager-5956879555-qddpw\" (UID: \"17680b37-e969-4275-8e84-557fb8d45d6f\") " pod="openshift-lws-operator/lws-controller-manager-5956879555-qddpw" Apr 21 00:08:38.554873 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:38.554774 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/17680b37-e969-4275-8e84-557fb8d45d6f-metrics-cert\") pod \"lws-controller-manager-5956879555-qddpw\" (UID: \"17680b37-e969-4275-8e84-557fb8d45d6f\") " pod="openshift-lws-operator/lws-controller-manager-5956879555-qddpw" Apr 21 00:08:38.555209 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:38.555188 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/17680b37-e969-4275-8e84-557fb8d45d6f-manager-config\") pod \"lws-controller-manager-5956879555-qddpw\" (UID: \"17680b37-e969-4275-8e84-557fb8d45d6f\") " pod="openshift-lws-operator/lws-controller-manager-5956879555-qddpw" Apr 21 00:08:38.557322 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:38.557292 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/17680b37-e969-4275-8e84-557fb8d45d6f-metrics-cert\") pod \"lws-controller-manager-5956879555-qddpw\" (UID: \"17680b37-e969-4275-8e84-557fb8d45d6f\") " pod="openshift-lws-operator/lws-controller-manager-5956879555-qddpw" Apr 21 00:08:38.557433 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:38.557298 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/17680b37-e969-4275-8e84-557fb8d45d6f-cert\") pod \"lws-controller-manager-5956879555-qddpw\" (UID: \"17680b37-e969-4275-8e84-557fb8d45d6f\") " pod="openshift-lws-operator/lws-controller-manager-5956879555-qddpw" Apr 21 00:08:38.561832 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:38.561805 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnwgf\" (UniqueName: \"kubernetes.io/projected/17680b37-e969-4275-8e84-557fb8d45d6f-kube-api-access-qnwgf\") pod \"lws-controller-manager-5956879555-qddpw\" (UID: \"17680b37-e969-4275-8e84-557fb8d45d6f\") " pod="openshift-lws-operator/lws-controller-manager-5956879555-qddpw" Apr 21 00:08:38.688905 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:38.688810 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5956879555-qddpw" Apr 21 00:08:38.813958 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:38.813792 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5956879555-qddpw"] Apr 21 00:08:38.816999 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:08:38.816969 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17680b37_e969_4275_8e84_557fb8d45d6f.slice/crio-d9684b4219f28b18c7d5911d45ea096c1ee113bd50b4537ef2c901073c6320af WatchSource:0}: Error finding container d9684b4219f28b18c7d5911d45ea096c1ee113bd50b4537ef2c901073c6320af: Status 404 returned error can't find the container with id d9684b4219f28b18c7d5911d45ea096c1ee113bd50b4537ef2c901073c6320af Apr 21 00:08:39.470141 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:39.470104 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5956879555-qddpw" event={"ID":"17680b37-e969-4275-8e84-557fb8d45d6f","Type":"ContainerStarted","Data":"d9684b4219f28b18c7d5911d45ea096c1ee113bd50b4537ef2c901073c6320af"} Apr 21 00:08:40.475906 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:40.475868 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5956879555-qddpw" event={"ID":"17680b37-e969-4275-8e84-557fb8d45d6f","Type":"ContainerStarted","Data":"884e463eb9503d3b91b49f8634803c4763a2b5767dd77d83569424f62f1b2f72"} Apr 21 00:08:40.476342 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:40.476006 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5956879555-qddpw" Apr 21 00:08:40.491689 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:40.491638 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5956879555-qddpw" podStartSLOduration=0.910610655 podStartE2EDuration="2.491617304s" podCreationTimestamp="2026-04-21 00:08:38 +0000 UTC" firstStartedPulling="2026-04-21 00:08:38.819404209 +0000 UTC m=+311.254742411" lastFinishedPulling="2026-04-21 00:08:40.400410856 +0000 UTC m=+312.835749060" observedRunningTime="2026-04-21 00:08:40.490659791 +0000 UTC m=+312.925998017" watchObservedRunningTime="2026-04-21 00:08:40.491617304 +0000 UTC m=+312.926955529" Apr 21 00:08:48.660829 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:48.660796 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-587f5698df-69rjl"] Apr 21 00:08:48.663557 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:48.663532 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-587f5698df-69rjl" Apr 21 00:08:48.667103 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:48.667070 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Apr 21 00:08:48.667276 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:48.667193 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-fjxgs\"" Apr 21 00:08:48.667401 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:48.667383 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Apr 21 00:08:48.667462 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:48.667400 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Apr 21 00:08:48.669275 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:48.669259 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Apr 21 00:08:48.682292 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:48.682262 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-587f5698df-69rjl"] Apr 21 00:08:48.747037 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:48.747001 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgbzn\" (UniqueName: \"kubernetes.io/projected/17276bb2-cd74-40d8-a4f8-60d35d923799-kube-api-access-sgbzn\") pod \"opendatahub-operator-controller-manager-587f5698df-69rjl\" (UID: \"17276bb2-cd74-40d8-a4f8-60d35d923799\") " pod="opendatahub/opendatahub-operator-controller-manager-587f5698df-69rjl" Apr 21 00:08:48.747037 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:48.747041 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/17276bb2-cd74-40d8-a4f8-60d35d923799-webhook-cert\") pod \"opendatahub-operator-controller-manager-587f5698df-69rjl\" (UID: \"17276bb2-cd74-40d8-a4f8-60d35d923799\") " pod="opendatahub/opendatahub-operator-controller-manager-587f5698df-69rjl" Apr 21 00:08:48.747295 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:48.747182 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/17276bb2-cd74-40d8-a4f8-60d35d923799-apiservice-cert\") pod \"opendatahub-operator-controller-manager-587f5698df-69rjl\" (UID: \"17276bb2-cd74-40d8-a4f8-60d35d923799\") " pod="opendatahub/opendatahub-operator-controller-manager-587f5698df-69rjl" Apr 21 00:08:48.848262 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:48.848220 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/17276bb2-cd74-40d8-a4f8-60d35d923799-apiservice-cert\") pod \"opendatahub-operator-controller-manager-587f5698df-69rjl\" (UID: \"17276bb2-cd74-40d8-a4f8-60d35d923799\") " pod="opendatahub/opendatahub-operator-controller-manager-587f5698df-69rjl" Apr 21 00:08:48.848483 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:48.848295 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sgbzn\" (UniqueName: \"kubernetes.io/projected/17276bb2-cd74-40d8-a4f8-60d35d923799-kube-api-access-sgbzn\") pod \"opendatahub-operator-controller-manager-587f5698df-69rjl\" (UID: \"17276bb2-cd74-40d8-a4f8-60d35d923799\") " pod="opendatahub/opendatahub-operator-controller-manager-587f5698df-69rjl" Apr 21 00:08:48.848483 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:48.848318 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/17276bb2-cd74-40d8-a4f8-60d35d923799-webhook-cert\") pod \"opendatahub-operator-controller-manager-587f5698df-69rjl\" (UID: \"17276bb2-cd74-40d8-a4f8-60d35d923799\") " pod="opendatahub/opendatahub-operator-controller-manager-587f5698df-69rjl" Apr 21 00:08:48.851018 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:48.850983 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/17276bb2-cd74-40d8-a4f8-60d35d923799-apiservice-cert\") pod \"opendatahub-operator-controller-manager-587f5698df-69rjl\" (UID: \"17276bb2-cd74-40d8-a4f8-60d35d923799\") " pod="opendatahub/opendatahub-operator-controller-manager-587f5698df-69rjl" Apr 21 00:08:48.851309 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:48.851288 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/17276bb2-cd74-40d8-a4f8-60d35d923799-webhook-cert\") pod \"opendatahub-operator-controller-manager-587f5698df-69rjl\" (UID: \"17276bb2-cd74-40d8-a4f8-60d35d923799\") " pod="opendatahub/opendatahub-operator-controller-manager-587f5698df-69rjl" Apr 21 00:08:48.856167 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:48.856142 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgbzn\" (UniqueName: \"kubernetes.io/projected/17276bb2-cd74-40d8-a4f8-60d35d923799-kube-api-access-sgbzn\") pod \"opendatahub-operator-controller-manager-587f5698df-69rjl\" (UID: \"17276bb2-cd74-40d8-a4f8-60d35d923799\") " pod="opendatahub/opendatahub-operator-controller-manager-587f5698df-69rjl" Apr 21 00:08:48.974574 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:48.974484 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-587f5698df-69rjl" Apr 21 00:08:49.105170 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:49.105141 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-587f5698df-69rjl"] Apr 21 00:08:49.107679 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:08:49.107649 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17276bb2_cd74_40d8_a4f8_60d35d923799.slice/crio-7dafb10a6593462baaee1e9cfdc1cdf04ded9254c9cdbf008041de20b8980f4f WatchSource:0}: Error finding container 7dafb10a6593462baaee1e9cfdc1cdf04ded9254c9cdbf008041de20b8980f4f: Status 404 returned error can't find the container with id 7dafb10a6593462baaee1e9cfdc1cdf04ded9254c9cdbf008041de20b8980f4f Apr 21 00:08:49.505677 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:49.505639 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-587f5698df-69rjl" event={"ID":"17276bb2-cd74-40d8-a4f8-60d35d923799","Type":"ContainerStarted","Data":"7dafb10a6593462baaee1e9cfdc1cdf04ded9254c9cdbf008041de20b8980f4f"} Apr 21 00:08:51.481796 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:51.481767 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5956879555-qddpw" Apr 21 00:08:52.518905 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:52.518873 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-587f5698df-69rjl" event={"ID":"17276bb2-cd74-40d8-a4f8-60d35d923799","Type":"ContainerStarted","Data":"d47aacbbfc5d323a58a71da8ee3710401e952838dd23d9be13d6a210819666d7"} Apr 21 00:08:52.519270 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:52.518927 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-587f5698df-69rjl" Apr 21 00:08:52.538972 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:08:52.538916 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-587f5698df-69rjl" podStartSLOduration=2.110399467 podStartE2EDuration="4.538901427s" podCreationTimestamp="2026-04-21 00:08:48 +0000 UTC" firstStartedPulling="2026-04-21 00:08:49.109552935 +0000 UTC m=+321.544891142" lastFinishedPulling="2026-04-21 00:08:51.538054887 +0000 UTC m=+323.973393102" observedRunningTime="2026-04-21 00:08:52.536919016 +0000 UTC m=+324.972257242" watchObservedRunningTime="2026-04-21 00:08:52.538901427 +0000 UTC m=+324.974239650" Apr 21 00:09:03.525064 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:09:03.525027 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-587f5698df-69rjl" Apr 21 00:09:16.606746 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:09:16.606659 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-f6b6bc78b-m4x85"] Apr 21 00:09:16.609601 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:09:16.609577 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-f6b6bc78b-m4x85" Apr 21 00:09:16.611922 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:09:16.611890 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Apr 21 00:09:16.612054 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:09:16.611897 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Apr 21 00:09:16.612054 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:09:16.611975 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Apr 21 00:09:16.612054 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:09:16.611989 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-cd5qg\"" Apr 21 00:09:16.612842 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:09:16.612825 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Apr 21 00:09:16.617785 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:09:16.617617 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-f6b6bc78b-m4x85"] Apr 21 00:09:16.694038 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:09:16.694006 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/05fee8f0-6e32-46d1-8c2b-4b87af7dd59d-tls-certs\") pod \"kube-auth-proxy-f6b6bc78b-m4x85\" (UID: \"05fee8f0-6e32-46d1-8c2b-4b87af7dd59d\") " pod="openshift-ingress/kube-auth-proxy-f6b6bc78b-m4x85" Apr 21 00:09:16.694038 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:09:16.694042 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/05fee8f0-6e32-46d1-8c2b-4b87af7dd59d-tmp\") pod \"kube-auth-proxy-f6b6bc78b-m4x85\" (UID: \"05fee8f0-6e32-46d1-8c2b-4b87af7dd59d\") " pod="openshift-ingress/kube-auth-proxy-f6b6bc78b-m4x85" Apr 21 00:09:16.694251 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:09:16.694116 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2sbq\" (UniqueName: \"kubernetes.io/projected/05fee8f0-6e32-46d1-8c2b-4b87af7dd59d-kube-api-access-f2sbq\") pod \"kube-auth-proxy-f6b6bc78b-m4x85\" (UID: \"05fee8f0-6e32-46d1-8c2b-4b87af7dd59d\") " pod="openshift-ingress/kube-auth-proxy-f6b6bc78b-m4x85" Apr 21 00:09:16.795341 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:09:16.795299 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/05fee8f0-6e32-46d1-8c2b-4b87af7dd59d-tls-certs\") pod \"kube-auth-proxy-f6b6bc78b-m4x85\" (UID: \"05fee8f0-6e32-46d1-8c2b-4b87af7dd59d\") " pod="openshift-ingress/kube-auth-proxy-f6b6bc78b-m4x85" Apr 21 00:09:16.795341 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:09:16.795339 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/05fee8f0-6e32-46d1-8c2b-4b87af7dd59d-tmp\") pod \"kube-auth-proxy-f6b6bc78b-m4x85\" (UID: \"05fee8f0-6e32-46d1-8c2b-4b87af7dd59d\") " pod="openshift-ingress/kube-auth-proxy-f6b6bc78b-m4x85" Apr 21 00:09:16.795591 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:09:16.795417 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f2sbq\" (UniqueName: \"kubernetes.io/projected/05fee8f0-6e32-46d1-8c2b-4b87af7dd59d-kube-api-access-f2sbq\") pod \"kube-auth-proxy-f6b6bc78b-m4x85\" (UID: \"05fee8f0-6e32-46d1-8c2b-4b87af7dd59d\") " pod="openshift-ingress/kube-auth-proxy-f6b6bc78b-m4x85" Apr 21 00:09:16.797930 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:09:16.797889 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/05fee8f0-6e32-46d1-8c2b-4b87af7dd59d-tmp\") pod \"kube-auth-proxy-f6b6bc78b-m4x85\" (UID: \"05fee8f0-6e32-46d1-8c2b-4b87af7dd59d\") " pod="openshift-ingress/kube-auth-proxy-f6b6bc78b-m4x85" Apr 21 00:09:16.798181 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:09:16.798159 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/05fee8f0-6e32-46d1-8c2b-4b87af7dd59d-tls-certs\") pod \"kube-auth-proxy-f6b6bc78b-m4x85\" (UID: \"05fee8f0-6e32-46d1-8c2b-4b87af7dd59d\") " pod="openshift-ingress/kube-auth-proxy-f6b6bc78b-m4x85" Apr 21 00:09:16.807427 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:09:16.807397 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2sbq\" (UniqueName: \"kubernetes.io/projected/05fee8f0-6e32-46d1-8c2b-4b87af7dd59d-kube-api-access-f2sbq\") pod \"kube-auth-proxy-f6b6bc78b-m4x85\" (UID: \"05fee8f0-6e32-46d1-8c2b-4b87af7dd59d\") " pod="openshift-ingress/kube-auth-proxy-f6b6bc78b-m4x85" Apr 21 00:09:16.921545 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:09:16.921503 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-f6b6bc78b-m4x85" Apr 21 00:09:17.051144 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:09:17.051105 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-f6b6bc78b-m4x85"] Apr 21 00:09:17.054344 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:09:17.054311 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05fee8f0_6e32_46d1_8c2b_4b87af7dd59d.slice/crio-ad2cc4673d60141067800e0e121746c7bc41136b77079e4cab0df7f5241c97cd WatchSource:0}: Error finding container ad2cc4673d60141067800e0e121746c7bc41136b77079e4cab0df7f5241c97cd: Status 404 returned error can't find the container with id ad2cc4673d60141067800e0e121746c7bc41136b77079e4cab0df7f5241c97cd Apr 21 00:09:17.602242 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:09:17.602207 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-f6b6bc78b-m4x85" event={"ID":"05fee8f0-6e32-46d1-8c2b-4b87af7dd59d","Type":"ContainerStarted","Data":"ad2cc4673d60141067800e0e121746c7bc41136b77079e4cab0df7f5241c97cd"} Apr 21 00:09:20.612176 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:09:20.612082 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-f6b6bc78b-m4x85" event={"ID":"05fee8f0-6e32-46d1-8c2b-4b87af7dd59d","Type":"ContainerStarted","Data":"1d4494370013ca0ac1a5ec1f827db7bc8df6f604809f8365befebdb1e3fcae91"} Apr 21 00:09:20.628290 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:09:20.628235 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-f6b6bc78b-m4x85" podStartSLOduration=1.345385948 podStartE2EDuration="4.6282178s" podCreationTimestamp="2026-04-21 00:09:16 +0000 UTC" firstStartedPulling="2026-04-21 00:09:17.056749297 +0000 UTC m=+349.492087512" lastFinishedPulling="2026-04-21 00:09:20.339581148 +0000 UTC m=+352.774919364" observedRunningTime="2026-04-21 00:09:20.626385865 +0000 UTC m=+353.061724081" watchObservedRunningTime="2026-04-21 00:09:20.6282178 +0000 UTC m=+353.063556045" Apr 21 00:10:58.681340 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:10:58.681305 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-nt56h"] Apr 21 00:10:58.684880 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:10:58.684861 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-nt56h" Apr 21 00:10:58.687312 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:10:58.687286 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Apr 21 00:10:58.687312 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:10:58.687303 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Apr 21 00:10:58.687528 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:10:58.687300 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Apr 21 00:10:58.688349 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:10:58.688328 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Apr 21 00:10:58.688468 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:10:58.688354 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-pdvtf\"" Apr 21 00:10:58.691844 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:10:58.691808 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-nt56h"] Apr 21 00:10:58.812753 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:10:58.812713 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/28410474-f2d5-4615-ab51-011677afbd87-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-nt56h\" (UID: \"28410474-f2d5-4615-ab51-011677afbd87\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-nt56h" Apr 21 00:10:58.812753 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:10:58.812757 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/28410474-f2d5-4615-ab51-011677afbd87-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-nt56h\" (UID: \"28410474-f2d5-4615-ab51-011677afbd87\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-nt56h" Apr 21 00:10:58.812964 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:10:58.812856 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpdsv\" (UniqueName: \"kubernetes.io/projected/28410474-f2d5-4615-ab51-011677afbd87-kube-api-access-mpdsv\") pod \"kuadrant-console-plugin-6cb54b5c86-nt56h\" (UID: \"28410474-f2d5-4615-ab51-011677afbd87\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-nt56h" Apr 21 00:10:58.913672 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:10:58.913635 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mpdsv\" (UniqueName: \"kubernetes.io/projected/28410474-f2d5-4615-ab51-011677afbd87-kube-api-access-mpdsv\") pod \"kuadrant-console-plugin-6cb54b5c86-nt56h\" (UID: \"28410474-f2d5-4615-ab51-011677afbd87\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-nt56h" Apr 21 00:10:58.913811 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:10:58.913696 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/28410474-f2d5-4615-ab51-011677afbd87-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-nt56h\" (UID: \"28410474-f2d5-4615-ab51-011677afbd87\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-nt56h" Apr 21 00:10:58.913811 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:10:58.913727 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/28410474-f2d5-4615-ab51-011677afbd87-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-nt56h\" (UID: \"28410474-f2d5-4615-ab51-011677afbd87\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-nt56h" Apr 21 00:10:58.914510 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:10:58.914483 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/28410474-f2d5-4615-ab51-011677afbd87-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-nt56h\" (UID: \"28410474-f2d5-4615-ab51-011677afbd87\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-nt56h" Apr 21 00:10:58.916411 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:10:58.916390 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/28410474-f2d5-4615-ab51-011677afbd87-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-nt56h\" (UID: \"28410474-f2d5-4615-ab51-011677afbd87\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-nt56h" Apr 21 00:10:58.921979 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:10:58.921950 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpdsv\" (UniqueName: \"kubernetes.io/projected/28410474-f2d5-4615-ab51-011677afbd87-kube-api-access-mpdsv\") pod \"kuadrant-console-plugin-6cb54b5c86-nt56h\" (UID: \"28410474-f2d5-4615-ab51-011677afbd87\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-nt56h" Apr 21 00:10:58.996684 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:10:58.996594 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-nt56h" Apr 21 00:10:59.128628 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:10:59.128592 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-nt56h"] Apr 21 00:10:59.131889 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:10:59.131860 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod28410474_f2d5_4615_ab51_011677afbd87.slice/crio-f51a3dd7482eae85fedcb7aa077de0e3162be2a300a199693027d577e6b9d523 WatchSource:0}: Error finding container f51a3dd7482eae85fedcb7aa077de0e3162be2a300a199693027d577e6b9d523: Status 404 returned error can't find the container with id f51a3dd7482eae85fedcb7aa077de0e3162be2a300a199693027d577e6b9d523 Apr 21 00:10:59.956974 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:10:59.956931 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-nt56h" event={"ID":"28410474-f2d5-4615-ab51-011677afbd87","Type":"ContainerStarted","Data":"f51a3dd7482eae85fedcb7aa077de0e3162be2a300a199693027d577e6b9d523"} Apr 21 00:11:08.601636 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:11:08.601595 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-brgbt"] Apr 21 00:11:08.605289 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:11:08.605258 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-brgbt" Apr 21 00:11:08.607780 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:11:08.607754 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-7v22d\"" Apr 21 00:11:08.620377 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:11:08.620309 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-brgbt"] Apr 21 00:11:08.703007 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:11:08.702968 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d72334d9-584c-47a4-a317-d41f86ad4e39-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-brgbt\" (UID: \"d72334d9-584c-47a4-a317-d41f86ad4e39\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-brgbt" Apr 21 00:11:08.703188 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:11:08.703038 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wzqn\" (UniqueName: \"kubernetes.io/projected/d72334d9-584c-47a4-a317-d41f86ad4e39-kube-api-access-9wzqn\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-brgbt\" (UID: \"d72334d9-584c-47a4-a317-d41f86ad4e39\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-brgbt" Apr 21 00:11:08.803940 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:11:08.803896 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9wzqn\" (UniqueName: \"kubernetes.io/projected/d72334d9-584c-47a4-a317-d41f86ad4e39-kube-api-access-9wzqn\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-brgbt\" (UID: \"d72334d9-584c-47a4-a317-d41f86ad4e39\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-brgbt" Apr 21 00:11:08.804128 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:11:08.804004 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d72334d9-584c-47a4-a317-d41f86ad4e39-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-brgbt\" (UID: \"d72334d9-584c-47a4-a317-d41f86ad4e39\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-brgbt" Apr 21 00:11:08.804476 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:11:08.804443 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d72334d9-584c-47a4-a317-d41f86ad4e39-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-brgbt\" (UID: \"d72334d9-584c-47a4-a317-d41f86ad4e39\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-brgbt" Apr 21 00:11:08.815634 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:11:08.815602 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wzqn\" (UniqueName: \"kubernetes.io/projected/d72334d9-584c-47a4-a317-d41f86ad4e39-kube-api-access-9wzqn\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-brgbt\" (UID: \"d72334d9-584c-47a4-a317-d41f86ad4e39\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-brgbt" Apr 21 00:11:08.918523 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:11:08.918393 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-brgbt" Apr 21 00:11:09.052737 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:11:09.052652 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-brgbt"] Apr 21 00:11:09.330833 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:11:09.330736 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-brgbt"] Apr 21 00:11:09.336759 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:11:09.336697 2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-brgbt"] Apr 21 00:11:24.110238 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:11:24.110201 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd72334d9_584c_47a4_a317_d41f86ad4e39.slice/crio-d4ec1389c2dc55a4de4c0417ab22d5c2b85a68839ffea846ec2745b29d7f32c9 WatchSource:0}: Error finding container d4ec1389c2dc55a4de4c0417ab22d5c2b85a68839ffea846ec2745b29d7f32c9: Status 404 returned error can't find the container with id d4ec1389c2dc55a4de4c0417ab22d5c2b85a68839ffea846ec2745b29d7f32c9 Apr 21 00:11:25.052888 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:11:25.052844 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-nt56h" event={"ID":"28410474-f2d5-4615-ab51-011677afbd87","Type":"ContainerStarted","Data":"2c1871a7bdf4b9aea2df9e1e7eb1fbd8094cce64736a4114a1740c8e355ce20e"} Apr 21 00:11:25.068440 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:11:25.068378 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-nt56h" podStartSLOduration=1.745339874 podStartE2EDuration="27.068345699s" podCreationTimestamp="2026-04-21 00:10:58 +0000 UTC" firstStartedPulling="2026-04-21 00:10:59.133240918 +0000 UTC m=+451.568579134" lastFinishedPulling="2026-04-21 00:11:24.456246755 +0000 UTC m=+476.891584959" observedRunningTime="2026-04-21 00:11:25.066425617 +0000 UTC m=+477.501763841" watchObservedRunningTime="2026-04-21 00:11:25.068345699 +0000 UTC m=+477.503683925" Apr 21 00:11:29.071389 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:11:29.071318 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-brgbt" podUID="d72334d9-584c-47a4-a317-d41f86ad4e39" containerName="manager" containerID="cri-o://b509191a1308761fe2931f65f4d12fe8d6fd64a997c691275b283d13bcdf2830" gracePeriod=2 Apr 21 00:11:29.074738 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:11:29.074701 2576 status_manager.go:895] "Failed to get status for pod" podUID="d72334d9-584c-47a4-a317-d41f86ad4e39" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-brgbt" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-brgbt\" is forbidden: User \"system:node:ip-10-0-136-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-1.ec2.internal' and this object" Apr 21 00:11:29.306264 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:11:29.306239 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-brgbt" Apr 21 00:11:29.308509 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:11:29.308479 2576 status_manager.go:895] "Failed to get status for pod" podUID="d72334d9-584c-47a4-a317-d41f86ad4e39" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-brgbt" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-brgbt\" is forbidden: User \"system:node:ip-10-0-136-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-1.ec2.internal' and this object" Apr 21 00:11:29.401439 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:11:29.401403 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d72334d9-584c-47a4-a317-d41f86ad4e39-extensions-socket-volume\") pod \"d72334d9-584c-47a4-a317-d41f86ad4e39\" (UID: \"d72334d9-584c-47a4-a317-d41f86ad4e39\") " Apr 21 00:11:29.401645 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:11:29.401465 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9wzqn\" (UniqueName: \"kubernetes.io/projected/d72334d9-584c-47a4-a317-d41f86ad4e39-kube-api-access-9wzqn\") pod \"d72334d9-584c-47a4-a317-d41f86ad4e39\" (UID: \"d72334d9-584c-47a4-a317-d41f86ad4e39\") " Apr 21 00:11:29.401738 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:11:29.401712 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d72334d9-584c-47a4-a317-d41f86ad4e39-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d72334d9-584c-47a4-a317-d41f86ad4e39" (UID: "d72334d9-584c-47a4-a317-d41f86ad4e39"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Apr 21 00:11:29.403850 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:11:29.403817 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d72334d9-584c-47a4-a317-d41f86ad4e39-kube-api-access-9wzqn" (OuterVolumeSpecName: "kube-api-access-9wzqn") pod "d72334d9-584c-47a4-a317-d41f86ad4e39" (UID: "d72334d9-584c-47a4-a317-d41f86ad4e39"). InnerVolumeSpecName "kube-api-access-9wzqn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 21 00:11:29.502758 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:11:29.502670 2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d72334d9-584c-47a4-a317-d41f86ad4e39-extensions-socket-volume\") on node \"ip-10-0-136-1.ec2.internal\" DevicePath \"\"" Apr 21 00:11:29.502758 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:11:29.502703 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9wzqn\" (UniqueName: \"kubernetes.io/projected/d72334d9-584c-47a4-a317-d41f86ad4e39-kube-api-access-9wzqn\") on node \"ip-10-0-136-1.ec2.internal\" DevicePath \"\"" Apr 21 00:11:30.075739 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:11:30.075703 2576 generic.go:358] "Generic (PLEG): container finished" podID="d72334d9-584c-47a4-a317-d41f86ad4e39" containerID="b509191a1308761fe2931f65f4d12fe8d6fd64a997c691275b283d13bcdf2830" exitCode=2 Apr 21 00:11:30.076152 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:11:30.075759 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-brgbt" Apr 21 00:11:30.076152 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:11:30.075797 2576 scope.go:117] "RemoveContainer" containerID="b509191a1308761fe2931f65f4d12fe8d6fd64a997c691275b283d13bcdf2830" Apr 21 00:11:30.077993 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:11:30.077960 2576 status_manager.go:895] "Failed to get status for pod" podUID="d72334d9-584c-47a4-a317-d41f86ad4e39" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-brgbt" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-brgbt\" is forbidden: User \"system:node:ip-10-0-136-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-1.ec2.internal' and this object" Apr 21 00:11:30.084263 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:11:30.084242 2576 scope.go:117] "RemoveContainer" containerID="b509191a1308761fe2931f65f4d12fe8d6fd64a997c691275b283d13bcdf2830" Apr 21 00:11:30.084579 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:11:30.084558 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b509191a1308761fe2931f65f4d12fe8d6fd64a997c691275b283d13bcdf2830\": container with ID starting with b509191a1308761fe2931f65f4d12fe8d6fd64a997c691275b283d13bcdf2830 not found: ID does not exist" containerID="b509191a1308761fe2931f65f4d12fe8d6fd64a997c691275b283d13bcdf2830" Apr 21 00:11:30.084655 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:11:30.084588 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b509191a1308761fe2931f65f4d12fe8d6fd64a997c691275b283d13bcdf2830"} err="failed to get container status \"b509191a1308761fe2931f65f4d12fe8d6fd64a997c691275b283d13bcdf2830\": rpc error: code = NotFound desc = could not find container \"b509191a1308761fe2931f65f4d12fe8d6fd64a997c691275b283d13bcdf2830\": container with ID starting with b509191a1308761fe2931f65f4d12fe8d6fd64a997c691275b283d13bcdf2830 not found: ID does not exist" Apr 21 00:11:30.085838 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:11:30.085813 2576 status_manager.go:895] "Failed to get status for pod" podUID="d72334d9-584c-47a4-a317-d41f86ad4e39" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-brgbt" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-brgbt\" is forbidden: User \"system:node:ip-10-0-136-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-1.ec2.internal' and this object" Apr 21 00:11:30.209990 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:11:30.209941 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d72334d9-584c-47a4-a317-d41f86ad4e39" path="/var/lib/kubelet/pods/d72334d9-584c-47a4-a317-d41f86ad4e39/volumes" Apr 21 00:11:55.885855 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:11:55.885791 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-b8vjb"] Apr 21 00:11:55.886336 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:11:55.886193 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d72334d9-584c-47a4-a317-d41f86ad4e39" containerName="manager" Apr 21 00:11:55.886336 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:11:55.886205 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d72334d9-584c-47a4-a317-d41f86ad4e39" containerName="manager" Apr 21 00:11:55.886336 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:11:55.886266 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="d72334d9-584c-47a4-a317-d41f86ad4e39" containerName="manager" Apr 21 00:11:55.908801 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:11:55.908772 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-b8vjb"] Apr 21 00:11:55.908953 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:11:55.908887 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-b8vjb" Apr 21 00:11:55.911399 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:11:55.911354 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Apr 21 00:11:55.933930 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:11:55.933890 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/cd67b2d6-254b-4e72-8885-c7dbceb49251-config-file\") pod \"limitador-limitador-7d549b5b-b8vjb\" (UID: \"cd67b2d6-254b-4e72-8885-c7dbceb49251\") " pod="kuadrant-system/limitador-limitador-7d549b5b-b8vjb" Apr 21 00:11:55.934113 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:11:55.933953 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cw54c\" (UniqueName: \"kubernetes.io/projected/cd67b2d6-254b-4e72-8885-c7dbceb49251-kube-api-access-cw54c\") pod \"limitador-limitador-7d549b5b-b8vjb\" (UID: \"cd67b2d6-254b-4e72-8885-c7dbceb49251\") " pod="kuadrant-system/limitador-limitador-7d549b5b-b8vjb" Apr 21 00:11:55.989955 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:11:55.989906 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-b8vjb"] Apr 21 00:11:56.034911 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:11:56.034871 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/cd67b2d6-254b-4e72-8885-c7dbceb49251-config-file\") pod \"limitador-limitador-7d549b5b-b8vjb\" (UID: \"cd67b2d6-254b-4e72-8885-c7dbceb49251\") " pod="kuadrant-system/limitador-limitador-7d549b5b-b8vjb" Apr 21 00:11:56.035099 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:11:56.034963 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cw54c\" (UniqueName: \"kubernetes.io/projected/cd67b2d6-254b-4e72-8885-c7dbceb49251-kube-api-access-cw54c\") pod \"limitador-limitador-7d549b5b-b8vjb\" (UID: \"cd67b2d6-254b-4e72-8885-c7dbceb49251\") " pod="kuadrant-system/limitador-limitador-7d549b5b-b8vjb" Apr 21 00:11:56.035556 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:11:56.035535 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/cd67b2d6-254b-4e72-8885-c7dbceb49251-config-file\") pod \"limitador-limitador-7d549b5b-b8vjb\" (UID: \"cd67b2d6-254b-4e72-8885-c7dbceb49251\") " pod="kuadrant-system/limitador-limitador-7d549b5b-b8vjb" Apr 21 00:11:56.043099 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:11:56.043076 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cw54c\" (UniqueName: \"kubernetes.io/projected/cd67b2d6-254b-4e72-8885-c7dbceb49251-kube-api-access-cw54c\") pod \"limitador-limitador-7d549b5b-b8vjb\" (UID: \"cd67b2d6-254b-4e72-8885-c7dbceb49251\") " pod="kuadrant-system/limitador-limitador-7d549b5b-b8vjb" Apr 21 00:11:56.219568 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:11:56.219493 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-b8vjb" Apr 21 00:11:56.349284 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:11:56.349257 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-b8vjb"] Apr 21 00:11:56.352106 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:11:56.352075 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd67b2d6_254b_4e72_8885_c7dbceb49251.slice/crio-3f2719e271ba0c7a02057ecf3c83bb4a6da04d5755117a739671c032a7620601 WatchSource:0}: Error finding container 3f2719e271ba0c7a02057ecf3c83bb4a6da04d5755117a739671c032a7620601: Status 404 returned error can't find the container with id 3f2719e271ba0c7a02057ecf3c83bb4a6da04d5755117a739671c032a7620601 Apr 21 00:11:57.169411 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:11:57.169332 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-b8vjb" event={"ID":"cd67b2d6-254b-4e72-8885-c7dbceb49251","Type":"ContainerStarted","Data":"3f2719e271ba0c7a02057ecf3c83bb4a6da04d5755117a739671c032a7620601"} Apr 21 00:12:00.181471 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:12:00.181429 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-b8vjb" event={"ID":"cd67b2d6-254b-4e72-8885-c7dbceb49251","Type":"ContainerStarted","Data":"e48ecf8160fc8eb1c9bf6dfe22d0c86454ecf6bee4aa57d4a66d8ec8f0a42f3a"} Apr 21 00:12:00.181873 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:12:00.181687 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-b8vjb" Apr 21 00:12:00.197379 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:12:00.197316 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-b8vjb" podStartSLOduration=1.60073298 podStartE2EDuration="5.197299599s" podCreationTimestamp="2026-04-21 00:11:55 +0000 UTC" firstStartedPulling="2026-04-21 00:11:56.354068634 +0000 UTC m=+508.789406836" lastFinishedPulling="2026-04-21 00:11:59.950635248 +0000 UTC m=+512.385973455" observedRunningTime="2026-04-21 00:12:00.196047467 +0000 UTC m=+512.631385693" watchObservedRunningTime="2026-04-21 00:12:00.197299599 +0000 UTC m=+512.632637823" Apr 21 00:12:10.922438 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:12:10.922400 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-b8vjb"] Apr 21 00:12:10.922893 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:12:10.922631 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-b8vjb" podUID="cd67b2d6-254b-4e72-8885-c7dbceb49251" containerName="limitador" containerID="cri-o://e48ecf8160fc8eb1c9bf6dfe22d0c86454ecf6bee4aa57d4a66d8ec8f0a42f3a" gracePeriod=30 Apr 21 00:12:10.923393 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:12:10.923346 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-b8vjb" Apr 21 00:12:11.464473 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:12:11.464451 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-b8vjb" Apr 21 00:12:11.569905 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:12:11.569806 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cw54c\" (UniqueName: \"kubernetes.io/projected/cd67b2d6-254b-4e72-8885-c7dbceb49251-kube-api-access-cw54c\") pod \"cd67b2d6-254b-4e72-8885-c7dbceb49251\" (UID: \"cd67b2d6-254b-4e72-8885-c7dbceb49251\") " Apr 21 00:12:11.569905 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:12:11.569884 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/cd67b2d6-254b-4e72-8885-c7dbceb49251-config-file\") pod \"cd67b2d6-254b-4e72-8885-c7dbceb49251\" (UID: \"cd67b2d6-254b-4e72-8885-c7dbceb49251\") " Apr 21 00:12:11.570241 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:12:11.570219 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd67b2d6-254b-4e72-8885-c7dbceb49251-config-file" (OuterVolumeSpecName: "config-file") pod "cd67b2d6-254b-4e72-8885-c7dbceb49251" (UID: "cd67b2d6-254b-4e72-8885-c7dbceb49251"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 21 00:12:11.572091 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:12:11.572068 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd67b2d6-254b-4e72-8885-c7dbceb49251-kube-api-access-cw54c" (OuterVolumeSpecName: "kube-api-access-cw54c") pod "cd67b2d6-254b-4e72-8885-c7dbceb49251" (UID: "cd67b2d6-254b-4e72-8885-c7dbceb49251"). InnerVolumeSpecName "kube-api-access-cw54c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 21 00:12:11.670701 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:12:11.670669 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cw54c\" (UniqueName: \"kubernetes.io/projected/cd67b2d6-254b-4e72-8885-c7dbceb49251-kube-api-access-cw54c\") on node \"ip-10-0-136-1.ec2.internal\" DevicePath \"\"" Apr 21 00:12:11.670701 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:12:11.670698 2576 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/cd67b2d6-254b-4e72-8885-c7dbceb49251-config-file\") on node \"ip-10-0-136-1.ec2.internal\" DevicePath \"\"" Apr 21 00:12:12.221884 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:12:12.221851 2576 generic.go:358] "Generic (PLEG): container finished" podID="cd67b2d6-254b-4e72-8885-c7dbceb49251" containerID="e48ecf8160fc8eb1c9bf6dfe22d0c86454ecf6bee4aa57d4a66d8ec8f0a42f3a" exitCode=0 Apr 21 00:12:12.222320 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:12:12.221912 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-b8vjb" Apr 21 00:12:12.222320 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:12:12.221931 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-b8vjb" event={"ID":"cd67b2d6-254b-4e72-8885-c7dbceb49251","Type":"ContainerDied","Data":"e48ecf8160fc8eb1c9bf6dfe22d0c86454ecf6bee4aa57d4a66d8ec8f0a42f3a"} Apr 21 00:12:12.222320 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:12:12.221969 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-b8vjb" event={"ID":"cd67b2d6-254b-4e72-8885-c7dbceb49251","Type":"ContainerDied","Data":"3f2719e271ba0c7a02057ecf3c83bb4a6da04d5755117a739671c032a7620601"} Apr 21 00:12:12.222320 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:12:12.221985 2576 scope.go:117] "RemoveContainer" containerID="e48ecf8160fc8eb1c9bf6dfe22d0c86454ecf6bee4aa57d4a66d8ec8f0a42f3a" Apr 21 00:12:12.230161 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:12:12.230142 2576 scope.go:117] "RemoveContainer" containerID="e48ecf8160fc8eb1c9bf6dfe22d0c86454ecf6bee4aa57d4a66d8ec8f0a42f3a" Apr 21 00:12:12.230460 ip-10-0-136-1 kubenswrapper[2576]: E0421 00:12:12.230440 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e48ecf8160fc8eb1c9bf6dfe22d0c86454ecf6bee4aa57d4a66d8ec8f0a42f3a\": container with ID starting with e48ecf8160fc8eb1c9bf6dfe22d0c86454ecf6bee4aa57d4a66d8ec8f0a42f3a not found: ID does not exist" containerID="e48ecf8160fc8eb1c9bf6dfe22d0c86454ecf6bee4aa57d4a66d8ec8f0a42f3a" Apr 21 00:12:12.230524 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:12:12.230469 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e48ecf8160fc8eb1c9bf6dfe22d0c86454ecf6bee4aa57d4a66d8ec8f0a42f3a"} err="failed to get container status \"e48ecf8160fc8eb1c9bf6dfe22d0c86454ecf6bee4aa57d4a66d8ec8f0a42f3a\": rpc error: code = NotFound desc = could not find container \"e48ecf8160fc8eb1c9bf6dfe22d0c86454ecf6bee4aa57d4a66d8ec8f0a42f3a\": container with ID starting with e48ecf8160fc8eb1c9bf6dfe22d0c86454ecf6bee4aa57d4a66d8ec8f0a42f3a not found: ID does not exist" Apr 21 00:12:12.236759 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:12:12.236728 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-b8vjb"] Apr 21 00:12:12.238280 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:12:12.238257 2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-b8vjb"] Apr 21 00:12:13.411071 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:12:13.411034 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-868db5846d-ncfdw"] Apr 21 00:12:13.411532 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:12:13.411462 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd67b2d6-254b-4e72-8885-c7dbceb49251" containerName="limitador" Apr 21 00:12:13.411532 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:12:13.411476 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd67b2d6-254b-4e72-8885-c7dbceb49251" containerName="limitador" Apr 21 00:12:13.411532 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:12:13.411525 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="cd67b2d6-254b-4e72-8885-c7dbceb49251" containerName="limitador" Apr 21 00:12:13.414720 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:12:13.414697 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-868db5846d-ncfdw" Apr 21 00:12:13.417034 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:12:13.417007 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Apr 21 00:12:13.417034 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:12:13.417028 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-njr87\"" Apr 21 00:12:13.421536 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:12:13.421505 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-868db5846d-ncfdw"] Apr 21 00:12:13.488143 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:12:13.488101 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nspqg\" (UniqueName: \"kubernetes.io/projected/2a2e4534-f288-4ed3-92b2-7fb7fc0bcfba-kube-api-access-nspqg\") pod \"postgres-868db5846d-ncfdw\" (UID: \"2a2e4534-f288-4ed3-92b2-7fb7fc0bcfba\") " pod="opendatahub/postgres-868db5846d-ncfdw" Apr 21 00:12:13.488328 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:12:13.488160 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2a2e4534-f288-4ed3-92b2-7fb7fc0bcfba-data\") pod \"postgres-868db5846d-ncfdw\" (UID: \"2a2e4534-f288-4ed3-92b2-7fb7fc0bcfba\") " pod="opendatahub/postgres-868db5846d-ncfdw" Apr 21 00:12:13.589331 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:12:13.589299 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nspqg\" (UniqueName: \"kubernetes.io/projected/2a2e4534-f288-4ed3-92b2-7fb7fc0bcfba-kube-api-access-nspqg\") pod \"postgres-868db5846d-ncfdw\" (UID: \"2a2e4534-f288-4ed3-92b2-7fb7fc0bcfba\") " pod="opendatahub/postgres-868db5846d-ncfdw" Apr 21 00:12:13.589552 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:12:13.589352 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2a2e4534-f288-4ed3-92b2-7fb7fc0bcfba-data\") pod \"postgres-868db5846d-ncfdw\" (UID: \"2a2e4534-f288-4ed3-92b2-7fb7fc0bcfba\") " pod="opendatahub/postgres-868db5846d-ncfdw" Apr 21 00:12:13.589807 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:12:13.589784 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2a2e4534-f288-4ed3-92b2-7fb7fc0bcfba-data\") pod \"postgres-868db5846d-ncfdw\" (UID: \"2a2e4534-f288-4ed3-92b2-7fb7fc0bcfba\") " pod="opendatahub/postgres-868db5846d-ncfdw" Apr 21 00:12:13.597679 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:12:13.597646 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nspqg\" (UniqueName: \"kubernetes.io/projected/2a2e4534-f288-4ed3-92b2-7fb7fc0bcfba-kube-api-access-nspqg\") pod \"postgres-868db5846d-ncfdw\" (UID: \"2a2e4534-f288-4ed3-92b2-7fb7fc0bcfba\") " pod="opendatahub/postgres-868db5846d-ncfdw" Apr 21 00:12:13.727337 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:12:13.727246 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-868db5846d-ncfdw" Apr 21 00:12:13.855598 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:12:13.855565 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-868db5846d-ncfdw"] Apr 21 00:12:13.858540 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:12:13.858502 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a2e4534_f288_4ed3_92b2_7fb7fc0bcfba.slice/crio-6ee9a7dd06890a13f7d9b31f0e947bf2c432167bed124cf4af11e77591a231fe WatchSource:0}: Error finding container 6ee9a7dd06890a13f7d9b31f0e947bf2c432167bed124cf4af11e77591a231fe: Status 404 returned error can't find the container with id 6ee9a7dd06890a13f7d9b31f0e947bf2c432167bed124cf4af11e77591a231fe Apr 21 00:12:14.210486 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:12:14.210455 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd67b2d6-254b-4e72-8885-c7dbceb49251" path="/var/lib/kubelet/pods/cd67b2d6-254b-4e72-8885-c7dbceb49251/volumes" Apr 21 00:12:14.230239 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:12:14.230203 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-868db5846d-ncfdw" event={"ID":"2a2e4534-f288-4ed3-92b2-7fb7fc0bcfba","Type":"ContainerStarted","Data":"6ee9a7dd06890a13f7d9b31f0e947bf2c432167bed124cf4af11e77591a231fe"} Apr 21 00:12:19.251952 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:12:19.251852 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-868db5846d-ncfdw" event={"ID":"2a2e4534-f288-4ed3-92b2-7fb7fc0bcfba","Type":"ContainerStarted","Data":"421cfebbdd8efe986800648c99458b2ba987d2ef18d7e582c6befa2cffeb42bd"} Apr 21 00:12:19.252460 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:12:19.251967 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-868db5846d-ncfdw" Apr 21 00:12:19.267021 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:12:19.266955 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-868db5846d-ncfdw" podStartSLOduration=1.187763548 podStartE2EDuration="6.266938358s" podCreationTimestamp="2026-04-21 00:12:13 +0000 UTC" firstStartedPulling="2026-04-21 00:12:13.859856336 +0000 UTC m=+526.295194538" lastFinishedPulling="2026-04-21 00:12:18.939031143 +0000 UTC m=+531.374369348" observedRunningTime="2026-04-21 00:12:19.265588319 +0000 UTC m=+531.700926544" watchObservedRunningTime="2026-04-21 00:12:19.266938358 +0000 UTC m=+531.702276582" Apr 21 00:12:25.287727 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:12:25.287696 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-868db5846d-ncfdw" Apr 21 00:12:38.059038 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:12:38.058989 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-5c4df598dd-86wlq"] Apr 21 00:12:38.084082 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:12:38.084049 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-5c4df598dd-86wlq"] Apr 21 00:12:38.084238 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:12:38.084174 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-5c4df598dd-86wlq" Apr 21 00:12:38.087294 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:12:38.087268 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Apr 21 00:12:38.087294 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:12:38.087288 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Apr 21 00:12:38.087508 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:12:38.087288 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-6kwgz\"" Apr 21 00:12:38.215919 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:12:38.215875 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njsck\" (UniqueName: \"kubernetes.io/projected/fe4f5551-4602-46d9-8d75-4bc017612b66-kube-api-access-njsck\") pod \"keycloak-operator-5c4df598dd-86wlq\" (UID: \"fe4f5551-4602-46d9-8d75-4bc017612b66\") " pod="keycloak-system/keycloak-operator-5c4df598dd-86wlq" Apr 21 00:12:38.316934 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:12:38.316832 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-njsck\" (UniqueName: \"kubernetes.io/projected/fe4f5551-4602-46d9-8d75-4bc017612b66-kube-api-access-njsck\") pod \"keycloak-operator-5c4df598dd-86wlq\" (UID: \"fe4f5551-4602-46d9-8d75-4bc017612b66\") " pod="keycloak-system/keycloak-operator-5c4df598dd-86wlq" Apr 21 00:12:38.325675 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:12:38.325641 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njsck\" (UniqueName: \"kubernetes.io/projected/fe4f5551-4602-46d9-8d75-4bc017612b66-kube-api-access-njsck\") pod \"keycloak-operator-5c4df598dd-86wlq\" (UID: \"fe4f5551-4602-46d9-8d75-4bc017612b66\") " pod="keycloak-system/keycloak-operator-5c4df598dd-86wlq" Apr 21 00:12:38.395106 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:12:38.395074 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-5c4df598dd-86wlq" Apr 21 00:12:38.520821 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:12:38.520786 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-5c4df598dd-86wlq"] Apr 21 00:12:38.524278 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:12:38.524246 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe4f5551_4602_46d9_8d75_4bc017612b66.slice/crio-1369ec19cf8ab9bc1de6e7bb1869e0ba45a0b8cc19e38d9a841084f4a386cd9d WatchSource:0}: Error finding container 1369ec19cf8ab9bc1de6e7bb1869e0ba45a0b8cc19e38d9a841084f4a386cd9d: Status 404 returned error can't find the container with id 1369ec19cf8ab9bc1de6e7bb1869e0ba45a0b8cc19e38d9a841084f4a386cd9d Apr 21 00:12:39.332048 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:12:39.331970 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-5c4df598dd-86wlq" event={"ID":"fe4f5551-4602-46d9-8d75-4bc017612b66","Type":"ContainerStarted","Data":"1369ec19cf8ab9bc1de6e7bb1869e0ba45a0b8cc19e38d9a841084f4a386cd9d"} Apr 21 00:12:45.358243 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:12:45.358197 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-5c4df598dd-86wlq" event={"ID":"fe4f5551-4602-46d9-8d75-4bc017612b66","Type":"ContainerStarted","Data":"b31ea4a772c08dbd01e7351a628abfc08592301be8f579f71bce7bb9a87ca90c"} Apr 21 00:12:45.374128 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:12:45.374070 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-5c4df598dd-86wlq" podStartSLOduration=1.5224196129999998 podStartE2EDuration="7.374053012s" podCreationTimestamp="2026-04-21 00:12:38 +0000 UTC" firstStartedPulling="2026-04-21 00:12:38.525885798 +0000 UTC m=+550.961224014" lastFinishedPulling="2026-04-21 00:12:44.377519208 +0000 UTC m=+556.812857413" observedRunningTime="2026-04-21 00:12:45.372938691 +0000 UTC m=+557.808276915" watchObservedRunningTime="2026-04-21 00:12:45.374053012 +0000 UTC m=+557.809391236" Apr 21 00:38:41.472642 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:38:41.472613 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-587f5698df-69rjl_17276bb2-cd74-40d8-a4f8-60d35d923799/manager/0.log" Apr 21 00:38:41.804608 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:38:41.804528 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-868db5846d-ncfdw_2a2e4534-f288-4ed3-92b2-7fb7fc0bcfba/postgres/0.log" Apr 21 00:38:43.450237 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:38:43.450210 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-nt56h_28410474-f2d5-4615-ab51-011677afbd87/kuadrant-console-plugin/0.log" Apr 21 00:38:44.592337 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:38:44.592311 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f6b6bc78b-m4x85_05fee8f0-6e32-46d1-8c2b-4b87af7dd59d/kube-auth-proxy/0.log" Apr 21 00:38:49.314497 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:38:49.314461 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gc8bw/must-gather-nkrmx"] Apr 21 00:38:49.318144 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:38:49.318122 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gc8bw/must-gather-nkrmx" Apr 21 00:38:49.320572 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:38:49.320543 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gc8bw\"/\"openshift-service-ca.crt\"" Apr 21 00:38:49.320715 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:38:49.320551 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gc8bw\"/\"kube-root-ca.crt\"" Apr 21 00:38:49.321511 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:38:49.321491 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gc8bw\"/\"default-dockercfg-45ldp\"" Apr 21 00:38:49.332470 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:38:49.332427 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gc8bw/must-gather-nkrmx"] Apr 21 00:38:49.336695 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:38:49.336667 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8g97g\" (UniqueName: \"kubernetes.io/projected/95bbcd82-ea41-419e-a444-0fb97ed086f2-kube-api-access-8g97g\") pod \"must-gather-nkrmx\" (UID: \"95bbcd82-ea41-419e-a444-0fb97ed086f2\") " pod="openshift-must-gather-gc8bw/must-gather-nkrmx" Apr 21 00:38:49.336815 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:38:49.336707 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/95bbcd82-ea41-419e-a444-0fb97ed086f2-must-gather-output\") pod \"must-gather-nkrmx\" (UID: \"95bbcd82-ea41-419e-a444-0fb97ed086f2\") " pod="openshift-must-gather-gc8bw/must-gather-nkrmx" Apr 21 00:38:49.437705 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:38:49.437667 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8g97g\" (UniqueName: \"kubernetes.io/projected/95bbcd82-ea41-419e-a444-0fb97ed086f2-kube-api-access-8g97g\") pod \"must-gather-nkrmx\" (UID: \"95bbcd82-ea41-419e-a444-0fb97ed086f2\") " pod="openshift-must-gather-gc8bw/must-gather-nkrmx" Apr 21 00:38:49.437875 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:38:49.437713 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/95bbcd82-ea41-419e-a444-0fb97ed086f2-must-gather-output\") pod \"must-gather-nkrmx\" (UID: \"95bbcd82-ea41-419e-a444-0fb97ed086f2\") " pod="openshift-must-gather-gc8bw/must-gather-nkrmx" Apr 21 00:38:49.438024 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:38:49.438009 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/95bbcd82-ea41-419e-a444-0fb97ed086f2-must-gather-output\") pod \"must-gather-nkrmx\" (UID: \"95bbcd82-ea41-419e-a444-0fb97ed086f2\") " pod="openshift-must-gather-gc8bw/must-gather-nkrmx" Apr 21 00:38:49.446227 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:38:49.446202 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8g97g\" (UniqueName: \"kubernetes.io/projected/95bbcd82-ea41-419e-a444-0fb97ed086f2-kube-api-access-8g97g\") pod \"must-gather-nkrmx\" (UID: \"95bbcd82-ea41-419e-a444-0fb97ed086f2\") " pod="openshift-must-gather-gc8bw/must-gather-nkrmx" Apr 21 00:38:49.627882 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:38:49.627848 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gc8bw/must-gather-nkrmx" Apr 21 00:38:49.755645 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:38:49.755612 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gc8bw/must-gather-nkrmx"] Apr 21 00:38:49.758711 ip-10-0-136-1 kubenswrapper[2576]: W0421 00:38:49.758675 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod95bbcd82_ea41_419e_a444_0fb97ed086f2.slice/crio-2d3c6968529048f46a3f9262924eb842ccb496c7f919990b53b36cee4161ee21 WatchSource:0}: Error finding container 2d3c6968529048f46a3f9262924eb842ccb496c7f919990b53b36cee4161ee21: Status 404 returned error can't find the container with id 2d3c6968529048f46a3f9262924eb842ccb496c7f919990b53b36cee4161ee21 Apr 21 00:38:49.760467 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:38:49.760447 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Apr 21 00:38:50.715708 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:38:50.715658 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gc8bw/must-gather-nkrmx" event={"ID":"95bbcd82-ea41-419e-a444-0fb97ed086f2","Type":"ContainerStarted","Data":"7a97a30e0f1fdf48612cacbff6e3b68fb4fde5b6f266f76387555b814cdcc317"} Apr 21 00:38:50.715708 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:38:50.715699 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gc8bw/must-gather-nkrmx" event={"ID":"95bbcd82-ea41-419e-a444-0fb97ed086f2","Type":"ContainerStarted","Data":"2d3c6968529048f46a3f9262924eb842ccb496c7f919990b53b36cee4161ee21"} Apr 21 00:38:51.721760 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:38:51.721723 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gc8bw/must-gather-nkrmx" event={"ID":"95bbcd82-ea41-419e-a444-0fb97ed086f2","Type":"ContainerStarted","Data":"c32686f95b1262793398967c06031c2ad9da2e1631fad3b2a6a9a6a47ac06c2d"} Apr 21 00:38:51.738138 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:38:51.738074 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-gc8bw/must-gather-nkrmx" podStartSLOduration=1.998762057 podStartE2EDuration="2.738052326s" podCreationTimestamp="2026-04-21 00:38:49 +0000 UTC" firstStartedPulling="2026-04-21 00:38:49.760606963 +0000 UTC m=+2122.195945164" lastFinishedPulling="2026-04-21 00:38:50.499897232 +0000 UTC m=+2122.935235433" observedRunningTime="2026-04-21 00:38:51.735666821 +0000 UTC m=+2124.171005046" watchObservedRunningTime="2026-04-21 00:38:51.738052326 +0000 UTC m=+2124.173390551" Apr 21 00:38:52.158610 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:38:52.158573 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-lnrfk_9bea10f3-585b-463c-8dc6-e016d6ef92ef/global-pull-secret-syncer/0.log" Apr 21 00:38:52.211319 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:38:52.211290 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-fbsp9_39e13056-9209-4845-838d-9d46aa0dae95/konnectivity-agent/0.log" Apr 21 00:38:52.331998 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:38:52.331968 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-1.ec2.internal_893ed304dbbaa7472e9062bd86be8331/haproxy/0.log" Apr 21 00:38:56.080948 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:38:56.080903 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-nt56h_28410474-f2d5-4615-ab51-011677afbd87/kuadrant-console-plugin/0.log" Apr 21 00:38:57.774825 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:38:57.774744 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_59ee9e7b-537c-4384-ba03-e3f2cdb56bf0/alertmanager/0.log" Apr 21 00:38:57.798801 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:38:57.798692 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_59ee9e7b-537c-4384-ba03-e3f2cdb56bf0/config-reloader/0.log" Apr 21 00:38:57.823262 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:38:57.823170 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_59ee9e7b-537c-4384-ba03-e3f2cdb56bf0/kube-rbac-proxy-web/0.log" Apr 21 00:38:57.847757 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:38:57.847622 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_59ee9e7b-537c-4384-ba03-e3f2cdb56bf0/kube-rbac-proxy/0.log" Apr 21 00:38:57.875763 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:38:57.875721 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_59ee9e7b-537c-4384-ba03-e3f2cdb56bf0/kube-rbac-proxy-metric/0.log" Apr 21 00:38:57.899108 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:38:57.899080 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_59ee9e7b-537c-4384-ba03-e3f2cdb56bf0/prom-label-proxy/0.log" Apr 21 00:38:57.922134 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:38:57.921990 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_59ee9e7b-537c-4384-ba03-e3f2cdb56bf0/init-config-reloader/0.log" Apr 21 00:38:57.998234 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:38:57.998200 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-69db897b98-bp68h_64bfd4c5-2ae7-487a-bd3a-56ed5d10fed3/kube-state-metrics/0.log" Apr 21 00:38:58.023215 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:38:58.023188 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-69db897b98-bp68h_64bfd4c5-2ae7-487a-bd3a-56ed5d10fed3/kube-rbac-proxy-main/0.log" Apr 21 00:38:58.047535 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:38:58.047469 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-69db897b98-bp68h_64bfd4c5-2ae7-487a-bd3a-56ed5d10fed3/kube-rbac-proxy-self/0.log" Apr 21 00:38:58.074578 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:38:58.074547 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-797f884dc7-jn6zz_5956373d-aa90-4f53-b88b-8c6cddeae5ac/metrics-server/0.log" Apr 21 00:38:58.104428 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:38:58.104401 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7dccd58f55-ttbcz_890ff55d-1265-4f2d-9996-2aacce7d531f/monitoring-plugin/0.log" Apr 21 00:38:58.135302 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:38:58.135275 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-g7qpx_0ec391d4-00db-40aa-8cc2-92ea1e6e782f/node-exporter/0.log" Apr 21 00:38:58.156955 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:38:58.156928 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-g7qpx_0ec391d4-00db-40aa-8cc2-92ea1e6e782f/kube-rbac-proxy/0.log" Apr 21 00:38:58.179091 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:38:58.179016 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-g7qpx_0ec391d4-00db-40aa-8cc2-92ea1e6e782f/init-textfile/0.log" Apr 21 00:38:58.388994 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:38:58.388966 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9d44df66c-hjf9j_5e90298e-8e0c-4366-8069-2a091a230c45/kube-rbac-proxy-main/0.log" Apr 21 00:38:58.412349 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:38:58.412293 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9d44df66c-hjf9j_5e90298e-8e0c-4366-8069-2a091a230c45/kube-rbac-proxy-self/0.log" Apr 21 00:38:58.433066 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:38:58.432985 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9d44df66c-hjf9j_5e90298e-8e0c-4366-8069-2a091a230c45/openshift-state-metrics/0.log" Apr 21 00:38:58.473769 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:38:58.473734 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bd82b75b-82f3-46b0-b6aa-dc0a5407511b/prometheus/0.log" Apr 21 00:38:58.507180 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:38:58.507138 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bd82b75b-82f3-46b0-b6aa-dc0a5407511b/config-reloader/0.log" Apr 21 00:38:58.531551 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:38:58.531520 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bd82b75b-82f3-46b0-b6aa-dc0a5407511b/thanos-sidecar/0.log" Apr 21 00:38:58.553326 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:38:58.553295 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bd82b75b-82f3-46b0-b6aa-dc0a5407511b/kube-rbac-proxy-web/0.log" Apr 21 00:38:58.580044 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:38:58.580012 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bd82b75b-82f3-46b0-b6aa-dc0a5407511b/kube-rbac-proxy/0.log" Apr 21 00:38:58.605546 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:38:58.605510 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bd82b75b-82f3-46b0-b6aa-dc0a5407511b/kube-rbac-proxy-thanos/0.log" Apr 21 00:38:58.628592 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:38:58.628489 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bd82b75b-82f3-46b0-b6aa-dc0a5407511b/init-config-reloader/0.log" Apr 21 00:38:58.661669 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:38:58.661628 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5676c8c784-6pwzc_a7da2692-d1fe-4e3f-8a7a-b34812c9f313/prometheus-operator/0.log" Apr 21 00:38:58.686438 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:38:58.686308 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5676c8c784-6pwzc_a7da2692-d1fe-4e3f-8a7a-b34812c9f313/kube-rbac-proxy/0.log" Apr 21 00:38:58.748152 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:38:58.748107 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5cc5c5cd5c-kb7ng_408756dd-2811-4fa9-81a3-27796b0d86eb/telemeter-client/0.log" Apr 21 00:38:58.770988 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:38:58.770944 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5cc5c5cd5c-kb7ng_408756dd-2811-4fa9-81a3-27796b0d86eb/reload/0.log" Apr 21 00:38:58.821125 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:38:58.821084 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5cc5c5cd5c-kb7ng_408756dd-2811-4fa9-81a3-27796b0d86eb/kube-rbac-proxy/0.log" Apr 21 00:39:01.600621 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:39:01.600583 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gc8bw/perf-node-gather-daemonset-wrcn4"] Apr 21 00:39:01.606411 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:39:01.606379 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gc8bw/perf-node-gather-daemonset-wrcn4" Apr 21 00:39:01.613503 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:39:01.613465 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gc8bw/perf-node-gather-daemonset-wrcn4"] Apr 21 00:39:01.657481 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:39:01.657442 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7mgs\" (UniqueName: \"kubernetes.io/projected/e9cbe65b-e422-4352-b1fb-b31e840affca-kube-api-access-l7mgs\") pod \"perf-node-gather-daemonset-wrcn4\" (UID: \"e9cbe65b-e422-4352-b1fb-b31e840affca\") " pod="openshift-must-gather-gc8bw/perf-node-gather-daemonset-wrcn4" Apr 21 00:39:01.657672 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:39:01.657520 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e9cbe65b-e422-4352-b1fb-b31e840affca-proc\") pod \"perf-node-gather-daemonset-wrcn4\" (UID: \"e9cbe65b-e422-4352-b1fb-b31e840affca\") " pod="openshift-must-gather-gc8bw/perf-node-gather-daemonset-wrcn4" Apr 21 00:39:01.657672 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:39:01.657577 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e9cbe65b-e422-4352-b1fb-b31e840affca-lib-modules\") pod \"perf-node-gather-daemonset-wrcn4\" (UID: \"e9cbe65b-e422-4352-b1fb-b31e840affca\") " pod="openshift-must-gather-gc8bw/perf-node-gather-daemonset-wrcn4" Apr 21 00:39:01.657672 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:39:01.657594 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e9cbe65b-e422-4352-b1fb-b31e840affca-podres\") pod \"perf-node-gather-daemonset-wrcn4\" (UID: \"e9cbe65b-e422-4352-b1fb-b31e840affca\") " pod="openshift-must-gather-gc8bw/perf-node-gather-daemonset-wrcn4" Apr 21 00:39:01.657672 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:39:01.657623 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e9cbe65b-e422-4352-b1fb-b31e840affca-sys\") pod \"perf-node-gather-daemonset-wrcn4\" (UID: \"e9cbe65b-e422-4352-b1fb-b31e840affca\") " pod="openshift-must-gather-gc8bw/perf-node-gather-daemonset-wrcn4" Apr 21 00:39:01.759032 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:39:01.758989 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e9cbe65b-e422-4352-b1fb-b31e840affca-proc\") pod \"perf-node-gather-daemonset-wrcn4\" (UID: \"e9cbe65b-e422-4352-b1fb-b31e840affca\") " pod="openshift-must-gather-gc8bw/perf-node-gather-daemonset-wrcn4" Apr 21 00:39:01.759453 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:39:01.759414 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e9cbe65b-e422-4352-b1fb-b31e840affca-lib-modules\") pod \"perf-node-gather-daemonset-wrcn4\" (UID: \"e9cbe65b-e422-4352-b1fb-b31e840affca\") " pod="openshift-must-gather-gc8bw/perf-node-gather-daemonset-wrcn4" Apr 21 00:39:01.759625 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:39:01.759609 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e9cbe65b-e422-4352-b1fb-b31e840affca-podres\") pod \"perf-node-gather-daemonset-wrcn4\" (UID: \"e9cbe65b-e422-4352-b1fb-b31e840affca\") " pod="openshift-must-gather-gc8bw/perf-node-gather-daemonset-wrcn4" Apr 21 00:39:01.759734 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:39:01.759712 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e9cbe65b-e422-4352-b1fb-b31e840affca-podres\") pod \"perf-node-gather-daemonset-wrcn4\" (UID: \"e9cbe65b-e422-4352-b1fb-b31e840affca\") " pod="openshift-must-gather-gc8bw/perf-node-gather-daemonset-wrcn4" Apr 21 00:39:01.759799 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:39:01.759194 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e9cbe65b-e422-4352-b1fb-b31e840affca-proc\") pod \"perf-node-gather-daemonset-wrcn4\" (UID: \"e9cbe65b-e422-4352-b1fb-b31e840affca\") " pod="openshift-must-gather-gc8bw/perf-node-gather-daemonset-wrcn4" Apr 21 00:39:01.759799 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:39:01.759637 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e9cbe65b-e422-4352-b1fb-b31e840affca-lib-modules\") pod \"perf-node-gather-daemonset-wrcn4\" (UID: \"e9cbe65b-e422-4352-b1fb-b31e840affca\") " pod="openshift-must-gather-gc8bw/perf-node-gather-daemonset-wrcn4" Apr 21 00:39:01.759914 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:39:01.759884 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e9cbe65b-e422-4352-b1fb-b31e840affca-sys\") pod \"perf-node-gather-daemonset-wrcn4\" (UID: \"e9cbe65b-e422-4352-b1fb-b31e840affca\") " pod="openshift-must-gather-gc8bw/perf-node-gather-daemonset-wrcn4" Apr 21 00:39:01.760001 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:39:01.759983 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e9cbe65b-e422-4352-b1fb-b31e840affca-sys\") pod \"perf-node-gather-daemonset-wrcn4\" (UID: \"e9cbe65b-e422-4352-b1fb-b31e840affca\") " pod="openshift-must-gather-gc8bw/perf-node-gather-daemonset-wrcn4" Apr 21 00:39:01.760143 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:39:01.760128 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l7mgs\" (UniqueName: \"kubernetes.io/projected/e9cbe65b-e422-4352-b1fb-b31e840affca-kube-api-access-l7mgs\") pod \"perf-node-gather-daemonset-wrcn4\" (UID: \"e9cbe65b-e422-4352-b1fb-b31e840affca\") " pod="openshift-must-gather-gc8bw/perf-node-gather-daemonset-wrcn4" Apr 21 00:39:01.769010 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:39:01.768969 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7mgs\" (UniqueName: \"kubernetes.io/projected/e9cbe65b-e422-4352-b1fb-b31e840affca-kube-api-access-l7mgs\") pod \"perf-node-gather-daemonset-wrcn4\" (UID: \"e9cbe65b-e422-4352-b1fb-b31e840affca\") " pod="openshift-must-gather-gc8bw/perf-node-gather-daemonset-wrcn4" Apr 21 00:39:01.925013 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:39:01.924973 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gc8bw/perf-node-gather-daemonset-wrcn4" Apr 21 00:39:02.086514 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:39:02.085113 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gc8bw/perf-node-gather-daemonset-wrcn4"] Apr 21 00:39:02.761315 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:39:02.761278 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7smln_3abcd43c-0a0a-42d7-b1cc-6efb9679b409/dns/0.log" Apr 21 00:39:02.775646 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:39:02.775606 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gc8bw/perf-node-gather-daemonset-wrcn4" event={"ID":"e9cbe65b-e422-4352-b1fb-b31e840affca","Type":"ContainerStarted","Data":"b0d0cd7e1ff5864e1cf75082b83a51aa3ee713a412558a1bb12e81df22cda931"} Apr 21 00:39:02.775646 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:39:02.775651 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gc8bw/perf-node-gather-daemonset-wrcn4" event={"ID":"e9cbe65b-e422-4352-b1fb-b31e840affca","Type":"ContainerStarted","Data":"77a30dfe59b7bb63da813704a955ea53ae801b46b72cc300f48e47f40bb2d8eb"} Apr 21 00:39:02.775885 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:39:02.775759 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-gc8bw/perf-node-gather-daemonset-wrcn4" Apr 21 00:39:02.784044 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:39:02.783989 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7smln_3abcd43c-0a0a-42d7-b1cc-6efb9679b409/kube-rbac-proxy/0.log" Apr 21 00:39:02.791337 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:39:02.791285 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-gc8bw/perf-node-gather-daemonset-wrcn4" podStartSLOduration=1.79127071 podStartE2EDuration="1.79127071s" podCreationTimestamp="2026-04-21 00:39:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-21 00:39:02.789510156 +0000 UTC m=+2135.224848379" watchObservedRunningTime="2026-04-21 00:39:02.79127071 +0000 UTC m=+2135.226608934" Apr 21 00:39:02.931174 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:39:02.931145 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-twj7c_30356905-73c1-4fa1-a700-5d499f482647/dns-node-resolver/0.log" Apr 21 00:39:03.461013 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:39:03.460981 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-84h5p_945c8a71-f620-4cdb-89b7-0f17fbd8ab5b/node-ca/0.log" Apr 21 00:39:04.569535 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:39:04.569494 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f6b6bc78b-m4x85_05fee8f0-6e32-46d1-8c2b-4b87af7dd59d/kube-auth-proxy/0.log" Apr 21 00:39:05.170025 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:39:05.169999 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bpxlz_8fbc25fb-05e2-4240-8294-bee8b0e94fbf/serve-healthcheck-canary/0.log" Apr 21 00:39:05.657047 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:39:05.657015 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-27rqs_e7c09cc6-2592-4775-b6aa-5565a18dc6d4/kube-rbac-proxy/0.log" Apr 21 00:39:05.677203 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:39:05.677178 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-27rqs_e7c09cc6-2592-4775-b6aa-5565a18dc6d4/exporter/0.log" Apr 21 00:39:05.701195 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:39:05.701169 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-27rqs_e7c09cc6-2592-4775-b6aa-5565a18dc6d4/extractor/0.log" Apr 21 00:39:07.971526 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:39:07.971502 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-587f5698df-69rjl_17276bb2-cd74-40d8-a4f8-60d35d923799/manager/0.log" Apr 21 00:39:08.057918 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:39:08.057893 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-868db5846d-ncfdw_2a2e4534-f288-4ed3-92b2-7fb7fc0bcfba/postgres/0.log" Apr 21 00:39:08.791007 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:39:08.790980 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-gc8bw/perf-node-gather-daemonset-wrcn4" Apr 21 00:39:09.307934 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:39:09.307901 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5956879555-qddpw_17680b37-e969-4275-8e84-557fb8d45d6f/manager/0.log" Apr 21 00:39:09.331763 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:39:09.331733 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-vb7tw_51e5578a-d9a2-4626-97dd-0025cc10af35/openshift-lws-operator/0.log" Apr 21 00:39:15.189649 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:39:15.189561 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k959w_3abd03e7-2e8f-48a2-b63d-5eddab0cb80a/kube-multus-additional-cni-plugins/0.log" Apr 21 00:39:15.210909 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:39:15.210881 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k959w_3abd03e7-2e8f-48a2-b63d-5eddab0cb80a/egress-router-binary-copy/0.log" Apr 21 00:39:15.232388 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:39:15.232343 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k959w_3abd03e7-2e8f-48a2-b63d-5eddab0cb80a/cni-plugins/0.log" Apr 21 00:39:15.253578 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:39:15.253544 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k959w_3abd03e7-2e8f-48a2-b63d-5eddab0cb80a/bond-cni-plugin/0.log" Apr 21 00:39:15.275332 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:39:15.275306 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k959w_3abd03e7-2e8f-48a2-b63d-5eddab0cb80a/routeoverride-cni/0.log" Apr 21 00:39:15.296339 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:39:15.296313 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k959w_3abd03e7-2e8f-48a2-b63d-5eddab0cb80a/whereabouts-cni-bincopy/0.log" Apr 21 00:39:15.316124 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:39:15.316098 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k959w_3abd03e7-2e8f-48a2-b63d-5eddab0cb80a/whereabouts-cni/0.log" Apr 21 00:39:15.730869 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:39:15.730840 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-lfxrt_3f41362d-51f9-4dde-9796-2752b85d50ee/kube-multus/0.log" Apr 21 00:39:15.792887 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:39:15.792860 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-lr9hq_65f5aca2-9fa7-4b19-b02f-0dd809899f41/network-metrics-daemon/0.log" Apr 21 00:39:15.812821 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:39:15.812786 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-lr9hq_65f5aca2-9fa7-4b19-b02f-0dd809899f41/kube-rbac-proxy/0.log" Apr 21 00:39:17.060557 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:39:17.060527 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wmfb9_1479bc73-6541-435b-a311-d48731be8d51/ovn-controller/0.log" Apr 21 00:39:17.093746 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:39:17.093711 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wmfb9_1479bc73-6541-435b-a311-d48731be8d51/ovn-acl-logging/0.log" Apr 21 00:39:17.112761 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:39:17.112734 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wmfb9_1479bc73-6541-435b-a311-d48731be8d51/kube-rbac-proxy-node/0.log" Apr 21 00:39:17.133318 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:39:17.133280 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wmfb9_1479bc73-6541-435b-a311-d48731be8d51/kube-rbac-proxy-ovn-metrics/0.log" Apr 21 00:39:17.153682 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:39:17.153625 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wmfb9_1479bc73-6541-435b-a311-d48731be8d51/northd/0.log" Apr 21 00:39:17.174457 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:39:17.174424 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wmfb9_1479bc73-6541-435b-a311-d48731be8d51/nbdb/0.log" Apr 21 00:39:17.198412 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:39:17.198354 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wmfb9_1479bc73-6541-435b-a311-d48731be8d51/sbdb/0.log" Apr 21 00:39:17.314392 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:39:17.314277 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wmfb9_1479bc73-6541-435b-a311-d48731be8d51/ovnkube-controller/0.log" Apr 21 00:39:18.756207 ip-10-0-136-1 kubenswrapper[2576]: I0421 00:39:18.756132 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-d5vdn_526918a6-6456-4ee9-b13d-ca26cfea5695/network-check-target-container/0.log"