Apr 24 21:13:59.386184 ip-10-0-142-241 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Apr 24 21:13:59.386197 ip-10-0-142-241 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Apr 24 21:13:59.386206 ip-10-0-142-241 systemd[1]: kubelet.service: Failed with result 'resources'. Apr 24 21:13:59.386478 ip-10-0-142-241 systemd[1]: Failed to start Kubernetes Kubelet. Apr 24 21:14:09.508204 ip-10-0-142-241 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Apr 24 21:14:09.508220 ip-10-0-142-241 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot b89de34ecb424dc4aeea0496318f08da -- Apr 24 21:16:35.006654 ip-10-0-142-241 systemd[1]: Starting Kubernetes Kubelet... Apr 24 21:16:35.501976 ip-10-0-142-241 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Apr 24 21:16:35.501976 ip-10-0-142-241 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Apr 24 21:16:35.501976 ip-10-0-142-241 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Apr 24 21:16:35.501976 ip-10-0-142-241 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Apr 24 21:16:35.501976 ip-10-0-142-241 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Apr 24 21:16:35.503832 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.503743 2579 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Apr 24 21:16:35.513300 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513272 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Apr 24 21:16:35.513300 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513292 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Apr 24 21:16:35.513300 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513297 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Apr 24 21:16:35.513300 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513300 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Apr 24 21:16:35.513300 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513303 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Apr 24 21:16:35.513300 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513306 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Apr 24 21:16:35.513300 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513309 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Apr 24 21:16:35.513300 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513311 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Apr 24 21:16:35.513581 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513314 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Apr 24 21:16:35.513581 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513317 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Apr 24 21:16:35.513581 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513320 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Apr 24 21:16:35.513581 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513324 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Apr 24 21:16:35.513581 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513328 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Apr 24 21:16:35.513581 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513331 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Apr 24 21:16:35.513581 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513334 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Apr 24 21:16:35.513581 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513349 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Apr 24 21:16:35.513581 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513352 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Apr 24 21:16:35.513581 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513355 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Apr 24 21:16:35.513581 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513358 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Apr 24 21:16:35.513581 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513361 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Apr 24 21:16:35.513581 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513364 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Apr 24 21:16:35.513581 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513366 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Apr 24 21:16:35.513581 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513369 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Apr 24 21:16:35.513581 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513372 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Apr 24 21:16:35.513581 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513374 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Apr 24 21:16:35.513581 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513377 2579 feature_gate.go:328] unrecognized feature gate: Example2 Apr 24 21:16:35.513581 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513380 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Apr 24 21:16:35.514017 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513383 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Apr 24 21:16:35.514017 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513385 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Apr 24 21:16:35.514017 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513388 2579 feature_gate.go:328] unrecognized feature gate: Example Apr 24 21:16:35.514017 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513392 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Apr 24 21:16:35.514017 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513394 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Apr 24 21:16:35.514017 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513400 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Apr 24 21:16:35.514017 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513403 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Apr 24 21:16:35.514017 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513405 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Apr 24 21:16:35.514017 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513407 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Apr 24 21:16:35.514017 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513410 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Apr 24 21:16:35.514017 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513412 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Apr 24 21:16:35.514017 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513414 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Apr 24 21:16:35.514017 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513417 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Apr 24 21:16:35.514017 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513419 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Apr 24 21:16:35.514017 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513422 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Apr 24 21:16:35.514017 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513425 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Apr 24 21:16:35.514017 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513427 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Apr 24 21:16:35.514017 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513430 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Apr 24 21:16:35.514017 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513434 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Apr 24 21:16:35.514017 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513436 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Apr 24 21:16:35.514523 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513438 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Apr 24 21:16:35.514523 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513441 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Apr 24 21:16:35.514523 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513444 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Apr 24 21:16:35.514523 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513447 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Apr 24 21:16:35.514523 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513449 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Apr 24 21:16:35.514523 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513452 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Apr 24 21:16:35.514523 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513454 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Apr 24 21:16:35.514523 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513457 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Apr 24 21:16:35.514523 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513460 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Apr 24 21:16:35.514523 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513462 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Apr 24 21:16:35.514523 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513465 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Apr 24 21:16:35.514523 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513467 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Apr 24 21:16:35.514523 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513469 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Apr 24 21:16:35.514523 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513472 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Apr 24 21:16:35.514523 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513474 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Apr 24 21:16:35.514523 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513477 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Apr 24 21:16:35.514523 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513479 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Apr 24 21:16:35.514523 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513483 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Apr 24 21:16:35.514523 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513488 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Apr 24 21:16:35.514975 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513490 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Apr 24 21:16:35.514975 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513493 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Apr 24 21:16:35.514975 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513496 2579 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Apr 24 21:16:35.514975 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513498 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Apr 24 21:16:35.514975 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513501 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Apr 24 21:16:35.514975 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513503 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Apr 24 21:16:35.514975 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513505 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Apr 24 21:16:35.514975 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513508 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Apr 24 21:16:35.514975 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513511 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Apr 24 21:16:35.514975 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513513 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Apr 24 21:16:35.514975 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513516 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Apr 24 21:16:35.514975 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513518 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Apr 24 21:16:35.514975 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513521 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Apr 24 21:16:35.514975 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513523 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Apr 24 21:16:35.514975 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513526 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Apr 24 21:16:35.514975 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513528 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Apr 24 21:16:35.514975 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513531 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Apr 24 21:16:35.514975 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513533 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Apr 24 21:16:35.514975 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513535 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Apr 24 21:16:35.515431 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513538 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Apr 24 21:16:35.515431 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513911 2579 feature_gate.go:328] unrecognized feature gate: Example2 Apr 24 21:16:35.515431 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513916 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Apr 24 21:16:35.515431 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513919 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Apr 24 21:16:35.515431 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513922 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Apr 24 21:16:35.515431 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513925 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Apr 24 21:16:35.515431 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513927 2579 feature_gate.go:328] unrecognized feature gate: Example Apr 24 21:16:35.515431 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513930 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Apr 24 21:16:35.515431 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513933 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Apr 24 21:16:35.515431 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513935 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Apr 24 21:16:35.515431 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513938 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Apr 24 21:16:35.515431 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513940 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Apr 24 21:16:35.515431 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513943 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Apr 24 21:16:35.515431 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513945 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Apr 24 21:16:35.515431 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513948 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Apr 24 21:16:35.515431 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513950 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Apr 24 21:16:35.515431 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513952 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Apr 24 21:16:35.515431 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513955 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Apr 24 21:16:35.515431 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513957 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Apr 24 21:16:35.515431 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513960 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Apr 24 21:16:35.515899 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513962 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Apr 24 21:16:35.515899 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513965 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Apr 24 21:16:35.515899 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513968 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Apr 24 21:16:35.515899 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513970 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Apr 24 21:16:35.515899 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513972 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Apr 24 21:16:35.515899 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513975 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Apr 24 21:16:35.515899 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513978 2579 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Apr 24 21:16:35.515899 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513980 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Apr 24 21:16:35.515899 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513983 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Apr 24 21:16:35.515899 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513986 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Apr 24 21:16:35.515899 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513988 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Apr 24 21:16:35.515899 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513991 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Apr 24 21:16:35.515899 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513993 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Apr 24 21:16:35.515899 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513995 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Apr 24 21:16:35.515899 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.513998 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Apr 24 21:16:35.515899 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.514000 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Apr 24 21:16:35.515899 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.514003 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Apr 24 21:16:35.515899 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.514005 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Apr 24 21:16:35.515899 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.514007 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Apr 24 21:16:35.515899 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.514010 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Apr 24 21:16:35.516390 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.514012 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Apr 24 21:16:35.516390 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.514015 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Apr 24 21:16:35.516390 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.514017 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Apr 24 21:16:35.516390 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.514021 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Apr 24 21:16:35.516390 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.514025 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Apr 24 21:16:35.516390 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.514028 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Apr 24 21:16:35.516390 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.514031 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Apr 24 21:16:35.516390 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.514033 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Apr 24 21:16:35.516390 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.514035 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Apr 24 21:16:35.516390 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.514038 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Apr 24 21:16:35.516390 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.514040 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Apr 24 21:16:35.516390 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.514043 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Apr 24 21:16:35.516390 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.514045 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Apr 24 21:16:35.516390 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.514048 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Apr 24 21:16:35.516390 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.514050 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Apr 24 21:16:35.516390 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.514053 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Apr 24 21:16:35.516390 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.514057 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Apr 24 21:16:35.516390 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.514061 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Apr 24 21:16:35.516390 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.514064 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Apr 24 21:16:35.516839 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.514067 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Apr 24 21:16:35.516839 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.514070 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Apr 24 21:16:35.516839 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.514072 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Apr 24 21:16:35.516839 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.514075 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Apr 24 21:16:35.516839 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.514077 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Apr 24 21:16:35.516839 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.514080 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Apr 24 21:16:35.516839 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.514082 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Apr 24 21:16:35.516839 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.514085 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Apr 24 21:16:35.516839 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.514087 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Apr 24 21:16:35.516839 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.514090 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Apr 24 21:16:35.516839 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.514092 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Apr 24 21:16:35.516839 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.514096 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Apr 24 21:16:35.516839 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.514099 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Apr 24 21:16:35.516839 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.514102 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Apr 24 21:16:35.516839 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.514104 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Apr 24 21:16:35.516839 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.514106 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Apr 24 21:16:35.516839 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.514109 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Apr 24 21:16:35.516839 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.514112 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Apr 24 21:16:35.516839 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.514114 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Apr 24 21:16:35.516839 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.514116 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Apr 24 21:16:35.517306 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.514120 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Apr 24 21:16:35.517306 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.514122 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Apr 24 21:16:35.517306 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.514125 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Apr 24 21:16:35.517306 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.514127 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Apr 24 21:16:35.517306 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.514130 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Apr 24 21:16:35.517306 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.514133 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Apr 24 21:16:35.517306 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.514135 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Apr 24 21:16:35.517306 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.514138 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Apr 24 21:16:35.517306 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515709 2579 flags.go:64] FLAG: --address="0.0.0.0" Apr 24 21:16:35.517306 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515718 2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Apr 24 21:16:35.517306 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515725 2579 flags.go:64] FLAG: --anonymous-auth="true" Apr 24 21:16:35.517306 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515730 2579 flags.go:64] FLAG: --application-metrics-count-limit="100" Apr 24 21:16:35.517306 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515735 2579 flags.go:64] FLAG: --authentication-token-webhook="false" Apr 24 21:16:35.517306 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515738 2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Apr 24 21:16:35.517306 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515743 2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Apr 24 21:16:35.517306 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515747 2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Apr 24 21:16:35.517306 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515750 2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Apr 24 21:16:35.517306 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515753 2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Apr 24 21:16:35.517306 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515756 2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Apr 24 21:16:35.517306 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515760 2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Apr 24 21:16:35.517306 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515762 2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Apr 24 21:16:35.517306 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515765 2579 flags.go:64] FLAG: --cgroup-root="" Apr 24 21:16:35.517839 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515768 2579 flags.go:64] FLAG: --cgroups-per-qos="true" Apr 24 21:16:35.517839 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515771 2579 flags.go:64] FLAG: --client-ca-file="" Apr 24 21:16:35.517839 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515774 2579 flags.go:64] FLAG: --cloud-config="" Apr 24 21:16:35.517839 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515777 2579 flags.go:64] FLAG: --cloud-provider="external" Apr 24 21:16:35.517839 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515779 2579 flags.go:64] FLAG: --cluster-dns="[]" Apr 24 21:16:35.517839 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515783 2579 flags.go:64] FLAG: --cluster-domain="" Apr 24 21:16:35.517839 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515786 2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Apr 24 21:16:35.517839 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515789 2579 flags.go:64] FLAG: --config-dir="" Apr 24 21:16:35.517839 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515792 2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Apr 24 21:16:35.517839 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515795 2579 flags.go:64] FLAG: --container-log-max-files="5" Apr 24 21:16:35.517839 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515804 2579 flags.go:64] FLAG: --container-log-max-size="10Mi" Apr 24 21:16:35.517839 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515807 2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Apr 24 21:16:35.517839 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515811 2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Apr 24 21:16:35.517839 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515814 2579 flags.go:64] FLAG: --containerd-namespace="k8s.io" Apr 24 21:16:35.517839 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515817 2579 flags.go:64] FLAG: --contention-profiling="false" Apr 24 21:16:35.517839 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515819 2579 flags.go:64] FLAG: --cpu-cfs-quota="true" Apr 24 21:16:35.517839 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515822 2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Apr 24 21:16:35.517839 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515825 2579 flags.go:64] FLAG: --cpu-manager-policy="none" Apr 24 21:16:35.517839 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515828 2579 flags.go:64] FLAG: --cpu-manager-policy-options="" Apr 24 21:16:35.517839 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515832 2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Apr 24 21:16:35.517839 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515835 2579 flags.go:64] FLAG: --enable-controller-attach-detach="true" Apr 24 21:16:35.517839 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515837 2579 flags.go:64] FLAG: --enable-debugging-handlers="true" Apr 24 21:16:35.517839 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515840 2579 flags.go:64] FLAG: --enable-load-reader="false" Apr 24 21:16:35.517839 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515844 2579 flags.go:64] FLAG: --enable-server="true" Apr 24 21:16:35.517839 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515847 2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Apr 24 21:16:35.518471 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515851 2579 flags.go:64] FLAG: --event-burst="100" Apr 24 21:16:35.518471 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515855 2579 flags.go:64] FLAG: --event-qps="50" Apr 24 21:16:35.518471 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515858 2579 flags.go:64] FLAG: --event-storage-age-limit="default=0" Apr 24 21:16:35.518471 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515861 2579 flags.go:64] FLAG: --event-storage-event-limit="default=0" Apr 24 21:16:35.518471 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515863 2579 flags.go:64] FLAG: --eviction-hard="" Apr 24 21:16:35.518471 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515867 2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Apr 24 21:16:35.518471 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515870 2579 flags.go:64] FLAG: --eviction-minimum-reclaim="" Apr 24 21:16:35.518471 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515873 2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Apr 24 21:16:35.518471 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515876 2579 flags.go:64] FLAG: --eviction-soft="" Apr 24 21:16:35.518471 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515879 2579 flags.go:64] FLAG: --eviction-soft-grace-period="" Apr 24 21:16:35.518471 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515881 2579 flags.go:64] FLAG: --exit-on-lock-contention="false" Apr 24 21:16:35.518471 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515884 2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Apr 24 21:16:35.518471 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515887 2579 flags.go:64] FLAG: --experimental-mounter-path="" Apr 24 21:16:35.518471 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515889 2579 flags.go:64] FLAG: --fail-cgroupv1="false" Apr 24 21:16:35.518471 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515893 2579 flags.go:64] FLAG: --fail-swap-on="true" Apr 24 21:16:35.518471 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515895 2579 flags.go:64] FLAG: --feature-gates="" Apr 24 21:16:35.518471 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515899 2579 flags.go:64] FLAG: --file-check-frequency="20s" Apr 24 21:16:35.518471 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515902 2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Apr 24 21:16:35.518471 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515905 2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Apr 24 21:16:35.518471 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515908 2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Apr 24 21:16:35.518471 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515911 2579 flags.go:64] FLAG: --healthz-port="10248" Apr 24 21:16:35.518471 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515914 2579 flags.go:64] FLAG: --help="false" Apr 24 21:16:35.518471 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515917 2579 flags.go:64] FLAG: --hostname-override="ip-10-0-142-241.ec2.internal" Apr 24 21:16:35.518471 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515920 2579 flags.go:64] FLAG: --housekeeping-interval="10s" Apr 24 21:16:35.518471 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515923 2579 flags.go:64] FLAG: --http-check-frequency="20s" Apr 24 21:16:35.519058 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515926 2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Apr 24 21:16:35.519058 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515930 2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Apr 24 21:16:35.519058 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515933 2579 flags.go:64] FLAG: --image-gc-high-threshold="85" Apr 24 21:16:35.519058 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515935 2579 flags.go:64] FLAG: --image-gc-low-threshold="80" Apr 24 21:16:35.519058 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515938 2579 flags.go:64] FLAG: --image-service-endpoint="" Apr 24 21:16:35.519058 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515941 2579 flags.go:64] FLAG: --kernel-memcg-notification="false" Apr 24 21:16:35.519058 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515944 2579 flags.go:64] FLAG: --kube-api-burst="100" Apr 24 21:16:35.519058 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515947 2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Apr 24 21:16:35.519058 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515950 2579 flags.go:64] FLAG: --kube-api-qps="50" Apr 24 21:16:35.519058 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515953 2579 flags.go:64] FLAG: --kube-reserved="" Apr 24 21:16:35.519058 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515956 2579 flags.go:64] FLAG: --kube-reserved-cgroup="" Apr 24 21:16:35.519058 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515959 2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Apr 24 21:16:35.519058 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515961 2579 flags.go:64] FLAG: --kubelet-cgroups="" Apr 24 21:16:35.519058 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515964 2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Apr 24 21:16:35.519058 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515967 2579 flags.go:64] FLAG: --lock-file="" Apr 24 21:16:35.519058 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515969 2579 flags.go:64] FLAG: --log-cadvisor-usage="false" Apr 24 21:16:35.519058 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515972 2579 flags.go:64] FLAG: --log-flush-frequency="5s" Apr 24 21:16:35.519058 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515975 2579 flags.go:64] FLAG: --log-json-info-buffer-size="0" Apr 24 21:16:35.519058 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515980 2579 flags.go:64] FLAG: --log-json-split-stream="false" Apr 24 21:16:35.519058 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515982 2579 flags.go:64] FLAG: --log-text-info-buffer-size="0" Apr 24 21:16:35.519058 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515985 2579 flags.go:64] FLAG: --log-text-split-stream="false" Apr 24 21:16:35.519058 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515988 2579 flags.go:64] FLAG: --logging-format="text" Apr 24 21:16:35.519058 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515990 2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Apr 24 21:16:35.519654 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515994 2579 flags.go:64] FLAG: --make-iptables-util-chains="true" Apr 24 21:16:35.519654 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515996 2579 flags.go:64] FLAG: --manifest-url="" Apr 24 21:16:35.519654 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.515999 2579 flags.go:64] FLAG: --manifest-url-header="" Apr 24 21:16:35.519654 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.516003 2579 flags.go:64] FLAG: --max-housekeeping-interval="15s" Apr 24 21:16:35.519654 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.516006 2579 flags.go:64] FLAG: --max-open-files="1000000" Apr 24 21:16:35.519654 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.516010 2579 flags.go:64] FLAG: --max-pods="110" Apr 24 21:16:35.519654 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.516013 2579 flags.go:64] FLAG: --maximum-dead-containers="-1" Apr 24 21:16:35.519654 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.516015 2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Apr 24 21:16:35.519654 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.516018 2579 flags.go:64] FLAG: --memory-manager-policy="None" Apr 24 21:16:35.519654 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.516021 2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Apr 24 21:16:35.519654 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.516024 2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Apr 24 21:16:35.519654 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.516027 2579 flags.go:64] FLAG: --node-ip="0.0.0.0" Apr 24 21:16:35.519654 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.516030 2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Apr 24 21:16:35.519654 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.516037 2579 flags.go:64] FLAG: --node-status-max-images="50" Apr 24 21:16:35.519654 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.516040 2579 flags.go:64] FLAG: --node-status-update-frequency="10s" Apr 24 21:16:35.519654 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.516043 2579 flags.go:64] FLAG: --oom-score-adj="-999" Apr 24 21:16:35.519654 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.516046 2579 flags.go:64] FLAG: --pod-cidr="" Apr 24 21:16:35.519654 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.516050 2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c8cfe89231412ff3ee8cb6207fa0be33cad0f08e88c9c0f1e9f7e8c6f14d6715" Apr 24 21:16:35.519654 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.516055 2579 flags.go:64] FLAG: --pod-manifest-path="" Apr 24 21:16:35.519654 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.516058 2579 flags.go:64] FLAG: --pod-max-pids="-1" Apr 24 21:16:35.519654 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.516061 2579 flags.go:64] FLAG: --pods-per-core="0" Apr 24 21:16:35.519654 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.516064 2579 flags.go:64] FLAG: --port="10250" Apr 24 21:16:35.519654 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.516067 2579 flags.go:64] FLAG: --protect-kernel-defaults="false" Apr 24 21:16:35.519654 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.516069 2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f3356f90a66f7208" Apr 24 21:16:35.520212 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.516072 2579 flags.go:64] FLAG: --qos-reserved="" Apr 24 21:16:35.520212 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.516075 2579 flags.go:64] FLAG: --read-only-port="10255" Apr 24 21:16:35.520212 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.516078 2579 flags.go:64] FLAG: --register-node="true" Apr 24 21:16:35.520212 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.516080 2579 flags.go:64] FLAG: --register-schedulable="true" Apr 24 21:16:35.520212 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.516083 2579 flags.go:64] FLAG: --register-with-taints="" Apr 24 21:16:35.520212 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.516086 2579 flags.go:64] FLAG: --registry-burst="10" Apr 24 21:16:35.520212 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.516089 2579 flags.go:64] FLAG: --registry-qps="5" Apr 24 21:16:35.520212 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.516093 2579 flags.go:64] FLAG: --reserved-cpus="" Apr 24 21:16:35.520212 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.516095 2579 flags.go:64] FLAG: --reserved-memory="" Apr 24 21:16:35.520212 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.516099 2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Apr 24 21:16:35.520212 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.516102 2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Apr 24 21:16:35.520212 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.516105 2579 flags.go:64] FLAG: --rotate-certificates="false" Apr 24 21:16:35.520212 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.516108 2579 flags.go:64] FLAG: --rotate-server-certificates="false" Apr 24 21:16:35.520212 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.516110 2579 flags.go:64] FLAG: --runonce="false" Apr 24 21:16:35.520212 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.516113 2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Apr 24 21:16:35.520212 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.516116 2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Apr 24 21:16:35.520212 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.516119 2579 flags.go:64] FLAG: --seccomp-default="false" Apr 24 21:16:35.520212 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.516121 2579 flags.go:64] FLAG: --serialize-image-pulls="true" Apr 24 21:16:35.520212 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.516124 2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Apr 24 21:16:35.520212 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.516127 2579 flags.go:64] FLAG: --storage-driver-db="cadvisor" Apr 24 21:16:35.520212 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.516130 2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Apr 24 21:16:35.520212 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.516133 2579 flags.go:64] FLAG: --storage-driver-password="root" Apr 24 21:16:35.520212 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.516136 2579 flags.go:64] FLAG: --storage-driver-secure="false" Apr 24 21:16:35.520212 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.516138 2579 flags.go:64] FLAG: --storage-driver-table="stats" Apr 24 21:16:35.520212 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.516141 2579 flags.go:64] FLAG: --storage-driver-user="root" Apr 24 21:16:35.520212 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.516145 2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Apr 24 21:16:35.520847 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.516148 2579 flags.go:64] FLAG: --sync-frequency="1m0s" Apr 24 21:16:35.520847 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.516151 2579 flags.go:64] FLAG: --system-cgroups="" Apr 24 21:16:35.520847 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.516153 2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Apr 24 21:16:35.520847 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.516158 2579 flags.go:64] FLAG: --system-reserved-cgroup="" Apr 24 21:16:35.520847 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.516161 2579 flags.go:64] FLAG: --tls-cert-file="" Apr 24 21:16:35.520847 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.516164 2579 flags.go:64] FLAG: --tls-cipher-suites="[]" Apr 24 21:16:35.520847 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.516167 2579 flags.go:64] FLAG: --tls-min-version="" Apr 24 21:16:35.520847 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.516170 2579 flags.go:64] FLAG: --tls-private-key-file="" Apr 24 21:16:35.520847 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.516173 2579 flags.go:64] FLAG: --topology-manager-policy="none" Apr 24 21:16:35.520847 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.516175 2579 flags.go:64] FLAG: --topology-manager-policy-options="" Apr 24 21:16:35.520847 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.516178 2579 flags.go:64] FLAG: --topology-manager-scope="container" Apr 24 21:16:35.520847 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.516181 2579 flags.go:64] FLAG: --v="2" Apr 24 21:16:35.520847 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.516185 2579 flags.go:64] FLAG: --version="false" Apr 24 21:16:35.520847 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.516189 2579 flags.go:64] FLAG: --vmodule="" Apr 24 21:16:35.520847 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.516194 2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Apr 24 21:16:35.520847 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.516197 2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Apr 24 21:16:35.520847 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516293 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Apr 24 21:16:35.520847 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516297 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Apr 24 21:16:35.520847 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516300 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Apr 24 21:16:35.520847 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516302 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Apr 24 21:16:35.520847 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516305 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Apr 24 21:16:35.520847 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516308 2579 feature_gate.go:328] unrecognized feature gate: Example Apr 24 21:16:35.520847 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516311 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Apr 24 21:16:35.521396 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516313 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Apr 24 21:16:35.521396 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516316 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Apr 24 21:16:35.521396 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516318 2579 feature_gate.go:328] unrecognized feature gate: Example2 Apr 24 21:16:35.521396 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516321 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Apr 24 21:16:35.521396 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516324 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Apr 24 21:16:35.521396 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516326 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Apr 24 21:16:35.521396 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516329 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Apr 24 21:16:35.521396 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516331 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Apr 24 21:16:35.521396 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516334 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Apr 24 21:16:35.521396 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516354 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Apr 24 21:16:35.521396 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516356 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Apr 24 21:16:35.521396 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516359 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Apr 24 21:16:35.521396 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516361 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Apr 24 21:16:35.521396 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516364 2579 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Apr 24 21:16:35.521396 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516366 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Apr 24 21:16:35.521396 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516369 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Apr 24 21:16:35.521396 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516371 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Apr 24 21:16:35.521396 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516374 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Apr 24 21:16:35.521396 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516376 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Apr 24 21:16:35.521870 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516379 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Apr 24 21:16:35.521870 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516382 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Apr 24 21:16:35.521870 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516384 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Apr 24 21:16:35.521870 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516387 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Apr 24 21:16:35.521870 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516389 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Apr 24 21:16:35.521870 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516392 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Apr 24 21:16:35.521870 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516394 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Apr 24 21:16:35.521870 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516397 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Apr 24 21:16:35.521870 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516399 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Apr 24 21:16:35.521870 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516402 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Apr 24 21:16:35.521870 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516404 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Apr 24 21:16:35.521870 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516407 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Apr 24 21:16:35.521870 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516409 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Apr 24 21:16:35.521870 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516411 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Apr 24 21:16:35.521870 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516414 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Apr 24 21:16:35.521870 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516416 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Apr 24 21:16:35.521870 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516418 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Apr 24 21:16:35.521870 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516421 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Apr 24 21:16:35.521870 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516423 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Apr 24 21:16:35.521870 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516425 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Apr 24 21:16:35.522368 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516428 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Apr 24 21:16:35.522368 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516430 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Apr 24 21:16:35.522368 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516433 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Apr 24 21:16:35.522368 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516435 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Apr 24 21:16:35.522368 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516438 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Apr 24 21:16:35.522368 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516441 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Apr 24 21:16:35.522368 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516443 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Apr 24 21:16:35.522368 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516445 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Apr 24 21:16:35.522368 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516448 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Apr 24 21:16:35.522368 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516450 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Apr 24 21:16:35.522368 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516452 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Apr 24 21:16:35.522368 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516455 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Apr 24 21:16:35.522368 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516457 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Apr 24 21:16:35.522368 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516460 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Apr 24 21:16:35.522368 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516463 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Apr 24 21:16:35.522368 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516465 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Apr 24 21:16:35.522368 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516469 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Apr 24 21:16:35.522368 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516473 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Apr 24 21:16:35.522368 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516475 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Apr 24 21:16:35.522838 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516480 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Apr 24 21:16:35.522838 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516483 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Apr 24 21:16:35.522838 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516489 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Apr 24 21:16:35.522838 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516492 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Apr 24 21:16:35.522838 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516495 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Apr 24 21:16:35.522838 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516498 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Apr 24 21:16:35.522838 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516501 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Apr 24 21:16:35.522838 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516503 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Apr 24 21:16:35.522838 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516506 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Apr 24 21:16:35.522838 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516509 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Apr 24 21:16:35.522838 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516511 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Apr 24 21:16:35.522838 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516514 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Apr 24 21:16:35.522838 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516517 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Apr 24 21:16:35.522838 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516520 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Apr 24 21:16:35.522838 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516522 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Apr 24 21:16:35.522838 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516525 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Apr 24 21:16:35.522838 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516527 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Apr 24 21:16:35.522838 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516530 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Apr 24 21:16:35.522838 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516533 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Apr 24 21:16:35.522838 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516535 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Apr 24 21:16:35.523318 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.516538 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Apr 24 21:16:35.523318 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.517406 2579 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Apr 24 21:16:35.523914 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.523895 2579 server.go:530] "Kubelet version" kubeletVersion="v1.33.9" Apr 24 21:16:35.523944 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.523915 2579 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Apr 24 21:16:35.523972 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.523961 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Apr 24 21:16:35.523972 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.523967 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Apr 24 21:16:35.523972 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.523971 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Apr 24 21:16:35.524050 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.523975 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Apr 24 21:16:35.524050 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.523979 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Apr 24 21:16:35.524050 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.523982 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Apr 24 21:16:35.524050 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.523984 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Apr 24 21:16:35.524050 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.523987 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Apr 24 21:16:35.524050 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.523990 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Apr 24 21:16:35.524050 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.523992 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Apr 24 21:16:35.524050 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.523994 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Apr 24 21:16:35.524050 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.523997 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Apr 24 21:16:35.524050 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524000 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Apr 24 21:16:35.524050 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524002 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Apr 24 21:16:35.524050 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524005 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Apr 24 21:16:35.524050 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524007 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Apr 24 21:16:35.524050 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524010 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Apr 24 21:16:35.524050 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524012 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Apr 24 21:16:35.524050 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524015 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Apr 24 21:16:35.524050 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524017 2579 feature_gate.go:328] unrecognized feature gate: Example Apr 24 21:16:35.524050 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524020 2579 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Apr 24 21:16:35.524050 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524022 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Apr 24 21:16:35.524050 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524025 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Apr 24 21:16:35.524050 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524027 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Apr 24 21:16:35.524692 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524030 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Apr 24 21:16:35.524692 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524032 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Apr 24 21:16:35.524692 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524034 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Apr 24 21:16:35.524692 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524037 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Apr 24 21:16:35.524692 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524040 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Apr 24 21:16:35.524692 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524042 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Apr 24 21:16:35.524692 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524044 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Apr 24 21:16:35.524692 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524048 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Apr 24 21:16:35.524692 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524050 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Apr 24 21:16:35.524692 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524053 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Apr 24 21:16:35.524692 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524055 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Apr 24 21:16:35.524692 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524058 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Apr 24 21:16:35.524692 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524061 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Apr 24 21:16:35.524692 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524063 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Apr 24 21:16:35.524692 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524066 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Apr 24 21:16:35.524692 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524068 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Apr 24 21:16:35.524692 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524070 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Apr 24 21:16:35.524692 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524072 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Apr 24 21:16:35.524692 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524075 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Apr 24 21:16:35.525135 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524077 2579 feature_gate.go:328] unrecognized feature gate: Example2 Apr 24 21:16:35.525135 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524079 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Apr 24 21:16:35.525135 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524082 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Apr 24 21:16:35.525135 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524084 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Apr 24 21:16:35.525135 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524086 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Apr 24 21:16:35.525135 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524089 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Apr 24 21:16:35.525135 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524091 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Apr 24 21:16:35.525135 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524094 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Apr 24 21:16:35.525135 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524096 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Apr 24 21:16:35.525135 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524098 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Apr 24 21:16:35.525135 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524101 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Apr 24 21:16:35.525135 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524103 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Apr 24 21:16:35.525135 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524107 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Apr 24 21:16:35.525135 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524110 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Apr 24 21:16:35.525135 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524114 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Apr 24 21:16:35.525135 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524116 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Apr 24 21:16:35.525135 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524119 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Apr 24 21:16:35.525135 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524121 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Apr 24 21:16:35.525135 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524124 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Apr 24 21:16:35.525615 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524126 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Apr 24 21:16:35.525615 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524129 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Apr 24 21:16:35.525615 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524132 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Apr 24 21:16:35.525615 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524134 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Apr 24 21:16:35.525615 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524136 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Apr 24 21:16:35.525615 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524139 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Apr 24 21:16:35.525615 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524141 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Apr 24 21:16:35.525615 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524143 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Apr 24 21:16:35.525615 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524146 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Apr 24 21:16:35.525615 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524148 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Apr 24 21:16:35.525615 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524150 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Apr 24 21:16:35.525615 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524153 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Apr 24 21:16:35.525615 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524155 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Apr 24 21:16:35.525615 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524158 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Apr 24 21:16:35.525615 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524161 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Apr 24 21:16:35.525615 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524163 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Apr 24 21:16:35.525615 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524165 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Apr 24 21:16:35.525615 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524167 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Apr 24 21:16:35.525615 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524170 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Apr 24 21:16:35.525615 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524172 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Apr 24 21:16:35.526094 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524175 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Apr 24 21:16:35.526094 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524177 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Apr 24 21:16:35.526094 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524180 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Apr 24 21:16:35.526094 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524182 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Apr 24 21:16:35.526094 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.524187 2579 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Apr 24 21:16:35.526094 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524283 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Apr 24 21:16:35.526094 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524288 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Apr 24 21:16:35.526094 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524292 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Apr 24 21:16:35.526094 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524295 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Apr 24 21:16:35.526094 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524297 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Apr 24 21:16:35.526094 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524300 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Apr 24 21:16:35.526094 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524302 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Apr 24 21:16:35.526094 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524304 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Apr 24 21:16:35.526094 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524307 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Apr 24 21:16:35.526094 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524309 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Apr 24 21:16:35.526475 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524312 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Apr 24 21:16:35.526475 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524315 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Apr 24 21:16:35.526475 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524317 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Apr 24 21:16:35.526475 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524319 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Apr 24 21:16:35.526475 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524322 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Apr 24 21:16:35.526475 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524325 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Apr 24 21:16:35.526475 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524329 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Apr 24 21:16:35.526475 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524332 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Apr 24 21:16:35.526475 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524334 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Apr 24 21:16:35.526475 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524350 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Apr 24 21:16:35.526475 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524353 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Apr 24 21:16:35.526475 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524356 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Apr 24 21:16:35.526475 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524359 2579 feature_gate.go:328] unrecognized feature gate: Example2 Apr 24 21:16:35.526475 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524361 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Apr 24 21:16:35.526475 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524364 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Apr 24 21:16:35.526475 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524366 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Apr 24 21:16:35.526475 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524369 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Apr 24 21:16:35.526475 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524371 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Apr 24 21:16:35.526475 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524374 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Apr 24 21:16:35.526932 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524376 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Apr 24 21:16:35.526932 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524379 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Apr 24 21:16:35.526932 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524381 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Apr 24 21:16:35.526932 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524384 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Apr 24 21:16:35.526932 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524403 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Apr 24 21:16:35.526932 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524408 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Apr 24 21:16:35.526932 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524410 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Apr 24 21:16:35.526932 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524413 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Apr 24 21:16:35.526932 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524416 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Apr 24 21:16:35.526932 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524419 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Apr 24 21:16:35.526932 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524422 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Apr 24 21:16:35.526932 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524425 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Apr 24 21:16:35.526932 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524429 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Apr 24 21:16:35.526932 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524431 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Apr 24 21:16:35.526932 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524434 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Apr 24 21:16:35.526932 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524437 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Apr 24 21:16:35.526932 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524439 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Apr 24 21:16:35.526932 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524442 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Apr 24 21:16:35.526932 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524444 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Apr 24 21:16:35.527448 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524447 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Apr 24 21:16:35.527448 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524449 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Apr 24 21:16:35.527448 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524451 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Apr 24 21:16:35.527448 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524454 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Apr 24 21:16:35.527448 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524456 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Apr 24 21:16:35.527448 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524458 2579 feature_gate.go:328] unrecognized feature gate: Example Apr 24 21:16:35.527448 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524461 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Apr 24 21:16:35.527448 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524464 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Apr 24 21:16:35.527448 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524466 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Apr 24 21:16:35.527448 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524468 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Apr 24 21:16:35.527448 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524471 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Apr 24 21:16:35.527448 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524473 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Apr 24 21:16:35.527448 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524476 2579 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Apr 24 21:16:35.527448 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524478 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Apr 24 21:16:35.527448 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524481 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Apr 24 21:16:35.527448 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524483 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Apr 24 21:16:35.527448 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524485 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Apr 24 21:16:35.527448 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524488 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Apr 24 21:16:35.527448 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524490 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Apr 24 21:16:35.527448 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524493 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Apr 24 21:16:35.527921 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524495 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Apr 24 21:16:35.527921 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524497 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Apr 24 21:16:35.527921 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524500 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Apr 24 21:16:35.527921 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524502 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Apr 24 21:16:35.527921 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524504 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Apr 24 21:16:35.527921 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524506 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Apr 24 21:16:35.527921 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524508 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Apr 24 21:16:35.527921 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524511 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Apr 24 21:16:35.527921 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524514 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Apr 24 21:16:35.527921 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524516 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Apr 24 21:16:35.527921 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524519 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Apr 24 21:16:35.527921 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524521 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Apr 24 21:16:35.527921 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524523 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Apr 24 21:16:35.527921 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524526 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Apr 24 21:16:35.527921 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524528 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Apr 24 21:16:35.527921 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524530 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Apr 24 21:16:35.527921 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524532 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Apr 24 21:16:35.527921 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:35.524535 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Apr 24 21:16:35.528349 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.524539 2579 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Apr 24 21:16:35.528349 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.525357 2579 server.go:962] "Client rotation is on, will bootstrap in background" Apr 24 21:16:35.528349 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.527615 2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Apr 24 21:16:35.528680 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.528668 2579 server.go:1019] "Starting client certificate rotation" Apr 24 21:16:35.528777 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.528762 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Apr 24 21:16:35.528809 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.528799 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Apr 24 21:16:35.558943 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.558926 2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Apr 24 21:16:35.563925 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.563889 2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Apr 24 21:16:35.578101 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.578077 2579 log.go:25] "Validated CRI v1 runtime API" Apr 24 21:16:35.584947 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.584930 2579 log.go:25] "Validated CRI v1 image API" Apr 24 21:16:35.586195 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.586180 2579 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Apr 24 21:16:35.590142 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.590121 2579 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Apr 24 21:16:35.590534 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.590514 2579 fs.go:135] Filesystem UUIDs: map[615e3d9a-9787-40ae-8067-294be2d92927:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 e28f1aac-839a-4f9a-ad1b-b3b525348c98:/dev/nvme0n1p3] Apr 24 21:16:35.590582 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.590534 2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Apr 24 21:16:35.595571 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.595451 2579 manager.go:217] Machine: {Timestamp:2026-04-24 21:16:35.594141683 +0000 UTC m=+0.456866758 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3210502 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec288fb8786cbe04de7e36e4249011fa SystemUUID:ec288fb8-786c-be04-de7e-36e4249011fa BootID:b89de34e-cb42-4dc4-aeea-0496318f08da Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:7d:ae:55:c6:89 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:7d:ae:55:c6:89 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f2:a9:d7:c9:87:5f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Apr 24 21:16:35.595571 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.595565 2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Apr 24 21:16:35.595672 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.595647 2579 manager.go:233] Version: {KernelVersion:5.14.0-570.107.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260414-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Apr 24 21:16:35.596961 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.596936 2579 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Apr 24 21:16:35.597090 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.596963 2579 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-241.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Apr 24 21:16:35.597140 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.597101 2579 topology_manager.go:138] "Creating topology manager with none policy" Apr 24 21:16:35.597140 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.597110 2579 container_manager_linux.go:306] "Creating device plugin manager" Apr 24 21:16:35.597140 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.597123 2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Apr 24 21:16:35.597140 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.597138 2579 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Apr 24 21:16:35.597881 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.597872 2579 state_mem.go:36] "Initialized new in-memory state store" Apr 24 21:16:35.597982 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.597974 2579 server.go:1267] "Using root directory" path="/var/lib/kubelet" Apr 24 21:16:35.600574 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.600565 2579 kubelet.go:491] "Attempting to sync node with API server" Apr 24 21:16:35.600608 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.600580 2579 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Apr 24 21:16:35.600608 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.600593 2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Apr 24 21:16:35.600608 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.600603 2579 kubelet.go:397] "Adding apiserver pod source" Apr 24 21:16:35.600723 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.600619 2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Apr 24 21:16:35.601965 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.601948 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Apr 24 21:16:35.602055 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.601974 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Apr 24 21:16:35.604802 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.604788 2579 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.10-2.rhaos4.20.gita4d0894.el9" apiVersion="v1" Apr 24 21:16:35.606651 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.606637 2579 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Apr 24 21:16:35.608150 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.608134 2579 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Apr 24 21:16:35.608150 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.608152 2579 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Apr 24 21:16:35.608268 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.608158 2579 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Apr 24 21:16:35.608268 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.608164 2579 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Apr 24 21:16:35.608268 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.608169 2579 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Apr 24 21:16:35.608268 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.608185 2579 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Apr 24 21:16:35.608268 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.608191 2579 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Apr 24 21:16:35.608268 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.608197 2579 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Apr 24 21:16:35.608268 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.608203 2579 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Apr 24 21:16:35.608268 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.608208 2579 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Apr 24 21:16:35.608268 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.608225 2579 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Apr 24 21:16:35.608268 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.608234 2579 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Apr 24 21:16:35.609122 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.609112 2579 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Apr 24 21:16:35.609122 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.609122 2579 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Apr 24 21:16:35.612276 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.612252 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ntszb" Apr 24 21:16:35.613867 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.613837 2579 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-241.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Apr 24 21:16:35.614979 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:35.614952 2579 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Apr 24 21:16:35.615035 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:35.614952 2579 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-241.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Apr 24 21:16:35.615688 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.615674 2579 watchdog_linux.go:99] "Systemd watchdog is not enabled" Apr 24 21:16:35.615721 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.615714 2579 server.go:1295] "Started kubelet" Apr 24 21:16:35.615851 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.615804 2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Apr 24 21:16:35.615933 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.615859 2579 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Apr 24 21:16:35.615933 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.615924 2579 server_v1.go:47] "podresources" method="list" useActivePods=true Apr 24 21:16:35.616491 ip-10-0-142-241 systemd[1]: Started Kubernetes Kubelet. Apr 24 21:16:35.619088 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.619076 2579 server.go:317] "Adding debug handlers to kubelet server" Apr 24 21:16:35.619572 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.619558 2579 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Apr 24 21:16:35.620852 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.620836 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ntszb" Apr 24 21:16:35.623674 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:35.622553 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-241.ec2.internal.18a9678fe04fe7ed default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-241.ec2.internal,UID:ip-10-0-142-241.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-241.ec2.internal,},FirstTimestamp:2026-04-24 21:16:35.615688685 +0000 UTC m=+0.478413760,LastTimestamp:2026-04-24 21:16:35.615688685 +0000 UTC m=+0.478413760,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-241.ec2.internal,}" Apr 24 21:16:35.625692 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.625672 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Apr 24 21:16:35.626219 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:35.626202 2579 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Apr 24 21:16:35.626331 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.626315 2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Apr 24 21:16:35.627055 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.627037 2579 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Apr 24 21:16:35.627131 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.627056 2579 factory.go:55] Registering systemd factory Apr 24 21:16:35.627131 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.627076 2579 factory.go:223] Registration of the systemd container factory successfully Apr 24 21:16:35.627220 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.627084 2579 volume_manager.go:295] "The desired_state_of_world populator starts" Apr 24 21:16:35.627220 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.627185 2579 volume_manager.go:297] "Starting Kubelet Volume Manager" Apr 24 21:16:35.627220 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:35.627215 2579 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-241.ec2.internal\" not found" Apr 24 21:16:35.627311 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.627261 2579 factory.go:153] Registering CRI-O factory Apr 24 21:16:35.627311 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.627264 2579 reconstruct.go:97] "Volume reconstruction finished" Apr 24 21:16:35.627311 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.627277 2579 reconciler.go:26] "Reconciler: start to sync state" Apr 24 21:16:35.627311 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.627268 2579 factory.go:223] Registration of the crio container factory successfully Apr 24 21:16:35.627517 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.627331 2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Apr 24 21:16:35.627517 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.627380 2579 factory.go:103] Registering Raw factory Apr 24 21:16:35.627517 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.627392 2579 manager.go:1196] Started watching for new ooms in manager Apr 24 21:16:35.627875 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.627770 2579 manager.go:319] Starting recovery of all containers Apr 24 21:16:35.632395 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.632376 2579 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Apr 24 21:16:35.638086 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:35.638058 2579 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-142-241.ec2.internal\" not found" node="ip-10-0-142-241.ec2.internal" Apr 24 21:16:35.638213 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.638197 2579 manager.go:324] Recovery completed Apr 24 21:16:35.643523 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.643508 2579 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Apr 24 21:16:35.646690 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.646674 2579 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-241.ec2.internal" event="NodeHasSufficientMemory" Apr 24 21:16:35.646756 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.646703 2579 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-241.ec2.internal" event="NodeHasNoDiskPressure" Apr 24 21:16:35.646756 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.646713 2579 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-241.ec2.internal" event="NodeHasSufficientPID" Apr 24 21:16:35.647198 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.647185 2579 cpu_manager.go:222] "Starting CPU manager" policy="none" Apr 24 21:16:35.647263 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.647197 2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Apr 24 21:16:35.647263 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.647213 2579 state_mem.go:36] "Initialized new in-memory state store" Apr 24 21:16:35.649356 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.649332 2579 policy_none.go:49] "None policy: Start" Apr 24 21:16:35.649410 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.649360 2579 memory_manager.go:186] "Starting memorymanager" policy="None" Apr 24 21:16:35.649410 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.649371 2579 state_mem.go:35] "Initializing new in-memory state store" Apr 24 21:16:35.685945 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.685929 2579 manager.go:341] "Starting Device Plugin manager" Apr 24 21:16:35.718362 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:35.685974 2579 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Apr 24 21:16:35.718362 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.685984 2579 server.go:85] "Starting device plugin registration server" Apr 24 21:16:35.718362 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.686256 2579 eviction_manager.go:189] "Eviction manager: starting control loop" Apr 24 21:16:35.718362 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.686270 2579 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Apr 24 21:16:35.718362 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.686356 2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Apr 24 21:16:35.718362 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.686434 2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Apr 24 21:16:35.718362 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.686444 2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Apr 24 21:16:35.718362 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:35.687028 2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Apr 24 21:16:35.718362 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:35.687071 2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-241.ec2.internal\" not found" Apr 24 21:16:35.761657 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.761591 2579 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Apr 24 21:16:35.762880 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.762867 2579 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Apr 24 21:16:35.763475 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.763456 2579 status_manager.go:230] "Starting to sync pod status with apiserver" Apr 24 21:16:35.763572 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.763496 2579 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Apr 24 21:16:35.763572 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.763507 2579 kubelet.go:2451] "Starting kubelet main sync loop" Apr 24 21:16:35.763572 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:35.763547 2579 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Apr 24 21:16:35.766281 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.766266 2579 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Apr 24 21:16:35.786561 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.786536 2579 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Apr 24 21:16:35.788429 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.788412 2579 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-241.ec2.internal" event="NodeHasSufficientMemory" Apr 24 21:16:35.788522 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.788443 2579 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-241.ec2.internal" event="NodeHasNoDiskPressure" Apr 24 21:16:35.788522 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.788457 2579 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-241.ec2.internal" event="NodeHasSufficientPID" Apr 24 21:16:35.788522 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.788481 2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-241.ec2.internal" Apr 24 21:16:35.797010 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.796995 2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-241.ec2.internal" Apr 24 21:16:35.797066 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:35.797022 2579 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-241.ec2.internal\": node \"ip-10-0-142-241.ec2.internal\" not found" Apr 24 21:16:35.811671 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:35.811651 2579 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-241.ec2.internal\" not found" Apr 24 21:16:35.864389 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.864316 2579 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-241.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-241.ec2.internal"] Apr 24 21:16:35.864508 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.864432 2579 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Apr 24 21:16:35.865382 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.865366 2579 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-241.ec2.internal" event="NodeHasSufficientMemory" Apr 24 21:16:35.865453 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.865395 2579 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-241.ec2.internal" event="NodeHasNoDiskPressure" Apr 24 21:16:35.865453 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.865409 2579 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-241.ec2.internal" event="NodeHasSufficientPID" Apr 24 21:16:35.866651 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.866639 2579 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Apr 24 21:16:35.866804 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.866791 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-241.ec2.internal" Apr 24 21:16:35.866845 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.866819 2579 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Apr 24 21:16:35.867367 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.867334 2579 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-241.ec2.internal" event="NodeHasSufficientMemory" Apr 24 21:16:35.867456 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.867364 2579 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-241.ec2.internal" event="NodeHasSufficientMemory" Apr 24 21:16:35.867456 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.867377 2579 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-241.ec2.internal" event="NodeHasNoDiskPressure" Apr 24 21:16:35.867456 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.867389 2579 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-241.ec2.internal" event="NodeHasNoDiskPressure" Apr 24 21:16:35.867456 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.867403 2579 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-241.ec2.internal" event="NodeHasSufficientPID" Apr 24 21:16:35.867456 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.867391 2579 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-241.ec2.internal" event="NodeHasSufficientPID" Apr 24 21:16:35.868612 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.868596 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-241.ec2.internal" Apr 24 21:16:35.868694 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.868630 2579 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Apr 24 21:16:35.869285 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.869271 2579 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-241.ec2.internal" event="NodeHasSufficientMemory" Apr 24 21:16:35.869411 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.869298 2579 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-241.ec2.internal" event="NodeHasNoDiskPressure" Apr 24 21:16:35.869411 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.869311 2579 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-241.ec2.internal" event="NodeHasSufficientPID" Apr 24 21:16:35.887033 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:35.887008 2579 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-241.ec2.internal\" not found" node="ip-10-0-142-241.ec2.internal" Apr 24 21:16:35.891398 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:35.891382 2579 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-241.ec2.internal\" not found" node="ip-10-0-142-241.ec2.internal" Apr 24 21:16:35.912064 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:35.912049 2579 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-241.ec2.internal\" not found" Apr 24 21:16:35.929419 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.929399 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/be385a9504d9f95a413d90b1b4793a62-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-241.ec2.internal\" (UID: \"be385a9504d9f95a413d90b1b4793a62\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-241.ec2.internal" Apr 24 21:16:35.929494 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.929423 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/be385a9504d9f95a413d90b1b4793a62-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-241.ec2.internal\" (UID: \"be385a9504d9f95a413d90b1b4793a62\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-241.ec2.internal" Apr 24 21:16:35.929494 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:35.929439 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/228671878d0b972ea78e6fdc693250e2-config\") pod \"kube-apiserver-proxy-ip-10-0-142-241.ec2.internal\" (UID: \"228671878d0b972ea78e6fdc693250e2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-241.ec2.internal" Apr 24 21:16:36.012637 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:36.012563 2579 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-241.ec2.internal\" not found" Apr 24 21:16:36.029946 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.029920 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/be385a9504d9f95a413d90b1b4793a62-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-241.ec2.internal\" (UID: \"be385a9504d9f95a413d90b1b4793a62\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-241.ec2.internal" Apr 24 21:16:36.030008 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.029951 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/be385a9504d9f95a413d90b1b4793a62-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-241.ec2.internal\" (UID: \"be385a9504d9f95a413d90b1b4793a62\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-241.ec2.internal" Apr 24 21:16:36.030008 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.029969 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/228671878d0b972ea78e6fdc693250e2-config\") pod \"kube-apiserver-proxy-ip-10-0-142-241.ec2.internal\" (UID: \"228671878d0b972ea78e6fdc693250e2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-241.ec2.internal" Apr 24 21:16:36.030008 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.030006 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/be385a9504d9f95a413d90b1b4793a62-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-241.ec2.internal\" (UID: \"be385a9504d9f95a413d90b1b4793a62\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-241.ec2.internal" Apr 24 21:16:36.030112 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.030029 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/228671878d0b972ea78e6fdc693250e2-config\") pod \"kube-apiserver-proxy-ip-10-0-142-241.ec2.internal\" (UID: \"228671878d0b972ea78e6fdc693250e2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-241.ec2.internal" Apr 24 21:16:36.030112 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.030065 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/be385a9504d9f95a413d90b1b4793a62-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-241.ec2.internal\" (UID: \"be385a9504d9f95a413d90b1b4793a62\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-241.ec2.internal" Apr 24 21:16:36.112809 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:36.112778 2579 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-241.ec2.internal\" not found" Apr 24 21:16:36.190355 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.190317 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-241.ec2.internal" Apr 24 21:16:36.194021 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.194005 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-241.ec2.internal" Apr 24 21:16:36.213622 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:36.213591 2579 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-241.ec2.internal\" not found" Apr 24 21:16:36.314269 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:36.314180 2579 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-241.ec2.internal\" not found" Apr 24 21:16:36.414701 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:36.414674 2579 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-241.ec2.internal\" not found" Apr 24 21:16:36.515370 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:36.515325 2579 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-241.ec2.internal\" not found" Apr 24 21:16:36.528585 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.528566 2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Apr 24 21:16:36.528702 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.528688 2579 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Apr 24 21:16:36.528743 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.528725 2579 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Apr 24 21:16:36.555731 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.555708 2579 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Apr 24 21:16:36.600945 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.600914 2579 apiserver.go:52] "Watching apiserver" Apr 24 21:16:36.612474 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.612445 2579 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Apr 24 21:16:36.612792 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.612773 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-qvphd","openshift-network-operator/iptables-alerter-ks7fr","openshift-ovn-kubernetes/ovnkube-node-bbpmt","kube-system/konnectivity-agent-rrmd6","openshift-dns/node-resolver-jwzsk","openshift-multus/multus-6wpnd","openshift-multus/multus-additional-cni-plugins-7mrlq","openshift-network-diagnostics/network-check-target-s9p7t","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fs6j","openshift-cluster-node-tuning-operator/tuned-sz2jd","openshift-image-registry/node-ca-wglcz"] Apr 24 21:16:36.614148 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.614129 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvphd" Apr 24 21:16:36.614238 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:36.614214 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvphd" podUID="29637be2-89a9-414b-81e0-8c4ebdda7fe0" Apr 24 21:16:36.615204 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.615182 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ks7fr" Apr 24 21:16:36.616253 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.616230 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" Apr 24 21:16:36.618910 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.618279 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Apr 24 21:16:36.618910 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.618324 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hqqq9\"" Apr 24 21:16:36.618910 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.618536 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Apr 24 21:16:36.618910 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.618553 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-vhv4z\"" Apr 24 21:16:36.618910 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.618617 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Apr 24 21:16:36.618910 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.618743 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Apr 24 21:16:36.619257 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.619047 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Apr 24 21:16:36.619257 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.619238 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Apr 24 21:16:36.620433 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.619677 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Apr 24 21:16:36.620433 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.619827 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rrmd6" Apr 24 21:16:36.620433 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.620059 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Apr 24 21:16:36.620433 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.620062 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Apr 24 21:16:36.621464 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.621446 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jwzsk" Apr 24 21:16:36.622327 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.622308 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Apr 24 21:16:36.622423 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.622295 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-04-23 21:11:35 +0000 UTC" deadline="2028-01-08 09:58:02.218491952 +0000 UTC" Apr 24 21:16:36.622423 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.622375 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-d98d6\"" Apr 24 21:16:36.622423 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.622383 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14964h41m25.59611361s" Apr 24 21:16:36.622518 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.622493 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Apr 24 21:16:36.623449 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.623428 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6wpnd" Apr 24 21:16:36.623525 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.623513 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Apr 24 21:16:36.623580 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.623522 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Apr 24 21:16:36.623580 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.623554 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-wxxgs\"" Apr 24 21:16:36.624443 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.624425 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7mrlq" Apr 24 21:16:36.625480 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.625462 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Apr 24 21:16:36.625480 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.625478 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-st5tl\"" Apr 24 21:16:36.625743 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.625725 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Apr 24 21:16:36.625817 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.625738 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Apr 24 21:16:36.625817 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.625746 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Apr 24 21:16:36.625817 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.625811 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Apr 24 21:16:36.625959 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.625728 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s9p7t" Apr 24 21:16:36.626056 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:36.626036 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s9p7t" podUID="b98dea0d-9954-40bd-a46c-865213211e17" Apr 24 21:16:36.626438 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.626424 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Apr 24 21:16:36.626521 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.626436 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Apr 24 21:16:36.626521 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.626480 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vddq6\"" Apr 24 21:16:36.626641 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.626630 2579 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-241.ec2.internal" Apr 24 21:16:36.626982 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.626968 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fs6j" Apr 24 21:16:36.628137 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.628122 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sz2jd" Apr 24 21:16:36.629003 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.628986 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Apr 24 21:16:36.629095 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.629045 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Apr 24 21:16:36.629095 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.629063 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-rcvqf\"" Apr 24 21:16:36.629303 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.629269 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wglcz" Apr 24 21:16:36.629376 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.629319 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Apr 24 21:16:36.630174 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.630159 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8ldq2\"" Apr 24 21:16:36.630254 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.630175 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Apr 24 21:16:36.630254 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.630237 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Apr 24 21:16:36.631452 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.631436 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Apr 24 21:16:36.631552 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.631537 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Apr 24 21:16:36.631637 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.631622 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Apr 24 21:16:36.631768 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.631746 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qxxrn\"" Apr 24 21:16:36.632838 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.632822 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1e4bd81-6e20-4f1b-b9d3-28105e397f45-host-kubelet\") pod \"ovnkube-node-bbpmt\" (UID: \"d1e4bd81-6e20-4f1b-b9d3-28105e397f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" Apr 24 21:16:36.632932 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.632851 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n65bl\" (UniqueName: \"kubernetes.io/projected/6186d834-bc6e-496f-b37d-1bf65365610b-kube-api-access-n65bl\") pod \"multus-6wpnd\" (UID: \"6186d834-bc6e-496f-b37d-1bf65365610b\") " pod="openshift-multus/multus-6wpnd" Apr 24 21:16:36.632932 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.632899 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d1e4bd81-6e20-4f1b-b9d3-28105e397f45-host-run-netns\") pod \"ovnkube-node-bbpmt\" (UID: \"d1e4bd81-6e20-4f1b-b9d3-28105e397f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" Apr 24 21:16:36.633005 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.632954 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czd7s\" (UniqueName: \"kubernetes.io/projected/d1e4bd81-6e20-4f1b-b9d3-28105e397f45-kube-api-access-czd7s\") pod \"ovnkube-node-bbpmt\" (UID: \"d1e4bd81-6e20-4f1b-b9d3-28105e397f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" Apr 24 21:16:36.633005 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.632984 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2f2dk\" (UniqueName: \"kubernetes.io/projected/1d4e12bc-30b8-4123-b939-ae3d8fa15235-kube-api-access-2f2dk\") pod \"node-resolver-jwzsk\" (UID: \"1d4e12bc-30b8-4123-b939-ae3d8fa15235\") " pod="openshift-dns/node-resolver-jwzsk" Apr 24 21:16:36.633062 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.633006 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6186d834-bc6e-496f-b37d-1bf65365610b-multus-socket-dir-parent\") pod \"multus-6wpnd\" (UID: \"6186d834-bc6e-496f-b37d-1bf65365610b\") " pod="openshift-multus/multus-6wpnd" Apr 24 21:16:36.633062 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.633049 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4-cni-binary-copy\") pod \"multus-additional-cni-plugins-7mrlq\" (UID: \"9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4\") " pod="openshift-multus/multus-additional-cni-plugins-7mrlq" Apr 24 21:16:36.633137 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.633078 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9gdc\" (UniqueName: \"kubernetes.io/projected/59d17f67-9ef1-438a-b6aa-86d8f1ce1dd0-kube-api-access-c9gdc\") pod \"aws-ebs-csi-driver-node-2fs6j\" (UID: \"59d17f67-9ef1-438a-b6aa-86d8f1ce1dd0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fs6j" Apr 24 21:16:36.633137 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.633105 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1f929846-6c97-466b-9af3-7a619ca05ce6-etc-modprobe-d\") pod \"tuned-sz2jd\" (UID: \"1f929846-6c97-466b-9af3-7a619ca05ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-sz2jd" Apr 24 21:16:36.633234 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.633136 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1f929846-6c97-466b-9af3-7a619ca05ce6-etc-sysctl-d\") pod \"tuned-sz2jd\" (UID: \"1f929846-6c97-466b-9af3-7a619ca05ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-sz2jd" Apr 24 21:16:36.633234 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.633162 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6186d834-bc6e-496f-b37d-1bf65365610b-host-run-netns\") pod \"multus-6wpnd\" (UID: \"6186d834-bc6e-496f-b37d-1bf65365610b\") " pod="openshift-multus/multus-6wpnd" Apr 24 21:16:36.633234 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.633186 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d1e4bd81-6e20-4f1b-b9d3-28105e397f45-var-lib-openvswitch\") pod \"ovnkube-node-bbpmt\" (UID: \"d1e4bd81-6e20-4f1b-b9d3-28105e397f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" Apr 24 21:16:36.633234 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.633208 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d1e4bd81-6e20-4f1b-b9d3-28105e397f45-node-log\") pod \"ovnkube-node-bbpmt\" (UID: \"d1e4bd81-6e20-4f1b-b9d3-28105e397f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" Apr 24 21:16:36.633234 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.633229 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1f929846-6c97-466b-9af3-7a619ca05ce6-etc-kubernetes\") pod \"tuned-sz2jd\" (UID: \"1f929846-6c97-466b-9af3-7a619ca05ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-sz2jd" Apr 24 21:16:36.633435 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.633253 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1f929846-6c97-466b-9af3-7a619ca05ce6-host\") pod \"tuned-sz2jd\" (UID: \"1f929846-6c97-466b-9af3-7a619ca05ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-sz2jd" Apr 24 21:16:36.633435 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.633274 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f929846-6c97-466b-9af3-7a619ca05ce6-tmp\") pod \"tuned-sz2jd\" (UID: \"1f929846-6c97-466b-9af3-7a619ca05ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-sz2jd" Apr 24 21:16:36.633435 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.633293 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d4e12bc-30b8-4123-b939-ae3d8fa15235-tmp-dir\") pod \"node-resolver-jwzsk\" (UID: \"1d4e12bc-30b8-4123-b939-ae3d8fa15235\") " pod="openshift-dns/node-resolver-jwzsk" Apr 24 21:16:36.633435 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.633315 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6186d834-bc6e-496f-b37d-1bf65365610b-cni-binary-copy\") pod \"multus-6wpnd\" (UID: \"6186d834-bc6e-496f-b37d-1bf65365610b\") " pod="openshift-multus/multus-6wpnd" Apr 24 21:16:36.633435 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.633381 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/29637be2-89a9-414b-81e0-8c4ebdda7fe0-metrics-certs\") pod \"network-metrics-daemon-qvphd\" (UID: \"29637be2-89a9-414b-81e0-8c4ebdda7fe0\") " pod="openshift-multus/network-metrics-daemon-qvphd" Apr 24 21:16:36.633435 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.633421 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d1e4bd81-6e20-4f1b-b9d3-28105e397f45-host-cni-bin\") pod \"ovnkube-node-bbpmt\" (UID: \"d1e4bd81-6e20-4f1b-b9d3-28105e397f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" Apr 24 21:16:36.633691 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.633474 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1f929846-6c97-466b-9af3-7a619ca05ce6-etc-systemd\") pod \"tuned-sz2jd\" (UID: \"1f929846-6c97-466b-9af3-7a619ca05ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-sz2jd" Apr 24 21:16:36.633691 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.633505 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/59d17f67-9ef1-438a-b6aa-86d8f1ce1dd0-registration-dir\") pod \"aws-ebs-csi-driver-node-2fs6j\" (UID: \"59d17f67-9ef1-438a-b6aa-86d8f1ce1dd0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fs6j" Apr 24 21:16:36.633691 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.633530 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d1e4bd81-6e20-4f1b-b9d3-28105e397f45-run-openvswitch\") pod \"ovnkube-node-bbpmt\" (UID: \"d1e4bd81-6e20-4f1b-b9d3-28105e397f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" Apr 24 21:16:36.633691 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.633553 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d1e4bd81-6e20-4f1b-b9d3-28105e397f45-log-socket\") pod \"ovnkube-node-bbpmt\" (UID: \"d1e4bd81-6e20-4f1b-b9d3-28105e397f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" Apr 24 21:16:36.633691 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.633588 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d1e4bd81-6e20-4f1b-b9d3-28105e397f45-host-run-ovn-kubernetes\") pod \"ovnkube-node-bbpmt\" (UID: \"d1e4bd81-6e20-4f1b-b9d3-28105e397f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" Apr 24 21:16:36.633691 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.633621 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1f929846-6c97-466b-9af3-7a619ca05ce6-var-lib-kubelet\") pod \"tuned-sz2jd\" (UID: \"1f929846-6c97-466b-9af3-7a619ca05ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-sz2jd" Apr 24 21:16:36.633691 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.633678 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/452067fc-581a-48e2-876d-0b6afa08e24b-agent-certs\") pod \"konnectivity-agent-rrmd6\" (UID: \"452067fc-581a-48e2-876d-0b6afa08e24b\") " pod="kube-system/konnectivity-agent-rrmd6" Apr 24 21:16:36.634009 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.633704 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6186d834-bc6e-496f-b37d-1bf65365610b-host-var-lib-cni-bin\") pod \"multus-6wpnd\" (UID: \"6186d834-bc6e-496f-b37d-1bf65365610b\") " pod="openshift-multus/multus-6wpnd" Apr 24 21:16:36.634009 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.633731 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4-system-cni-dir\") pod \"multus-additional-cni-plugins-7mrlq\" (UID: \"9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4\") " pod="openshift-multus/multus-additional-cni-plugins-7mrlq" Apr 24 21:16:36.634009 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.633755 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6186d834-bc6e-496f-b37d-1bf65365610b-multus-cni-dir\") pod \"multus-6wpnd\" (UID: \"6186d834-bc6e-496f-b37d-1bf65365610b\") " pod="openshift-multus/multus-6wpnd" Apr 24 21:16:36.634009 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.633781 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/59d17f67-9ef1-438a-b6aa-86d8f1ce1dd0-sys-fs\") pod \"aws-ebs-csi-driver-node-2fs6j\" (UID: \"59d17f67-9ef1-438a-b6aa-86d8f1ce1dd0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fs6j" Apr 24 21:16:36.634009 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.633803 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5g4mv\" (UniqueName: \"kubernetes.io/projected/42cf6af5-0cd5-4da4-876e-4b7ee6eaf49e-kube-api-access-5g4mv\") pod \"iptables-alerter-ks7fr\" (UID: \"42cf6af5-0cd5-4da4-876e-4b7ee6eaf49e\") " pod="openshift-network-operator/iptables-alerter-ks7fr" Apr 24 21:16:36.634009 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.633826 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f929846-6c97-466b-9af3-7a619ca05ce6-sys\") pod \"tuned-sz2jd\" (UID: \"1f929846-6c97-466b-9af3-7a619ca05ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-sz2jd" Apr 24 21:16:36.634009 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.633855 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdn2f\" (UniqueName: \"kubernetes.io/projected/b98dea0d-9954-40bd-a46c-865213211e17-kube-api-access-qdn2f\") pod \"network-check-target-s9p7t\" (UID: \"b98dea0d-9954-40bd-a46c-865213211e17\") " pod="openshift-network-diagnostics/network-check-target-s9p7t" Apr 24 21:16:36.634009 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.633877 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d1e4bd81-6e20-4f1b-b9d3-28105e397f45-run-ovn\") pod \"ovnkube-node-bbpmt\" (UID: \"d1e4bd81-6e20-4f1b-b9d3-28105e397f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" Apr 24 21:16:36.634009 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.633899 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/452067fc-581a-48e2-876d-0b6afa08e24b-konnectivity-ca\") pod \"konnectivity-agent-rrmd6\" (UID: \"452067fc-581a-48e2-876d-0b6afa08e24b\") " pod="kube-system/konnectivity-agent-rrmd6" Apr 24 21:16:36.634009 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.633922 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6186d834-bc6e-496f-b37d-1bf65365610b-cnibin\") pod \"multus-6wpnd\" (UID: \"6186d834-bc6e-496f-b37d-1bf65365610b\") " pod="openshift-multus/multus-6wpnd" Apr 24 21:16:36.634009 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.633945 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6186d834-bc6e-496f-b37d-1bf65365610b-host-var-lib-cni-multus\") pod \"multus-6wpnd\" (UID: \"6186d834-bc6e-496f-b37d-1bf65365610b\") " pod="openshift-multus/multus-6wpnd" Apr 24 21:16:36.634009 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.634000 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6186d834-bc6e-496f-b37d-1bf65365610b-multus-conf-dir\") pod \"multus-6wpnd\" (UID: \"6186d834-bc6e-496f-b37d-1bf65365610b\") " pod="openshift-multus/multus-6wpnd" Apr 24 21:16:36.634511 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.634025 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/59d17f67-9ef1-438a-b6aa-86d8f1ce1dd0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2fs6j\" (UID: \"59d17f67-9ef1-438a-b6aa-86d8f1ce1dd0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fs6j" Apr 24 21:16:36.634511 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.634049 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d1e4bd81-6e20-4f1b-b9d3-28105e397f45-ovnkube-config\") pod \"ovnkube-node-bbpmt\" (UID: \"d1e4bd81-6e20-4f1b-b9d3-28105e397f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" Apr 24 21:16:36.634511 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.634070 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1f929846-6c97-466b-9af3-7a619ca05ce6-etc-tuned\") pod \"tuned-sz2jd\" (UID: \"1f929846-6c97-466b-9af3-7a619ca05ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-sz2jd" Apr 24 21:16:36.634511 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.634094 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfpxs\" (UniqueName: \"kubernetes.io/projected/1f929846-6c97-466b-9af3-7a619ca05ce6-kube-api-access-wfpxs\") pod \"tuned-sz2jd\" (UID: \"1f929846-6c97-466b-9af3-7a619ca05ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-sz2jd" Apr 24 21:16:36.634511 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.634118 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2vnz\" (UniqueName: \"kubernetes.io/projected/29637be2-89a9-414b-81e0-8c4ebdda7fe0-kube-api-access-w2vnz\") pod \"network-metrics-daemon-qvphd\" (UID: \"29637be2-89a9-414b-81e0-8c4ebdda7fe0\") " pod="openshift-multus/network-metrics-daemon-qvphd" Apr 24 21:16:36.634511 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.634150 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/42cf6af5-0cd5-4da4-876e-4b7ee6eaf49e-iptables-alerter-script\") pod \"iptables-alerter-ks7fr\" (UID: \"42cf6af5-0cd5-4da4-876e-4b7ee6eaf49e\") " pod="openshift-network-operator/iptables-alerter-ks7fr" Apr 24 21:16:36.634511 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.634176 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d1e4bd81-6e20-4f1b-b9d3-28105e397f45-ovnkube-script-lib\") pod \"ovnkube-node-bbpmt\" (UID: \"d1e4bd81-6e20-4f1b-b9d3-28105e397f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" Apr 24 21:16:36.634511 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.634210 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1f929846-6c97-466b-9af3-7a619ca05ce6-etc-sysctl-conf\") pod \"tuned-sz2jd\" (UID: \"1f929846-6c97-466b-9af3-7a619ca05ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-sz2jd" Apr 24 21:16:36.634511 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.634233 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4-os-release\") pod \"multus-additional-cni-plugins-7mrlq\" (UID: \"9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4\") " pod="openshift-multus/multus-additional-cni-plugins-7mrlq" Apr 24 21:16:36.634511 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.634256 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d1e4bd81-6e20-4f1b-b9d3-28105e397f45-ovn-node-metrics-cert\") pod \"ovnkube-node-bbpmt\" (UID: \"d1e4bd81-6e20-4f1b-b9d3-28105e397f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" Apr 24 21:16:36.634511 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.634278 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6186d834-bc6e-496f-b37d-1bf65365610b-host-run-k8s-cni-cncf-io\") pod \"multus-6wpnd\" (UID: \"6186d834-bc6e-496f-b37d-1bf65365610b\") " pod="openshift-multus/multus-6wpnd" Apr 24 21:16:36.634511 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.634299 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6186d834-bc6e-496f-b37d-1bf65365610b-hostroot\") pod \"multus-6wpnd\" (UID: \"6186d834-bc6e-496f-b37d-1bf65365610b\") " pod="openshift-multus/multus-6wpnd" Apr 24 21:16:36.634511 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.634350 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl9lf\" (UniqueName: \"kubernetes.io/projected/9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4-kube-api-access-jl9lf\") pod \"multus-additional-cni-plugins-7mrlq\" (UID: \"9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4\") " pod="openshift-multus/multus-additional-cni-plugins-7mrlq" Apr 24 21:16:36.634511 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.634377 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/59d17f67-9ef1-438a-b6aa-86d8f1ce1dd0-etc-selinux\") pod \"aws-ebs-csi-driver-node-2fs6j\" (UID: \"59d17f67-9ef1-438a-b6aa-86d8f1ce1dd0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fs6j" Apr 24 21:16:36.634511 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.634392 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d1e4bd81-6e20-4f1b-b9d3-28105e397f45-run-systemd\") pod \"ovnkube-node-bbpmt\" (UID: \"d1e4bd81-6e20-4f1b-b9d3-28105e397f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" Apr 24 21:16:36.634511 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.634408 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d1e4bd81-6e20-4f1b-b9d3-28105e397f45-etc-openvswitch\") pod \"ovnkube-node-bbpmt\" (UID: \"d1e4bd81-6e20-4f1b-b9d3-28105e397f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" Apr 24 21:16:36.635045 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.634431 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1f929846-6c97-466b-9af3-7a619ca05ce6-etc-sysconfig\") pod \"tuned-sz2jd\" (UID: \"1f929846-6c97-466b-9af3-7a619ca05ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-sz2jd" Apr 24 21:16:36.635045 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.634449 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1f929846-6c97-466b-9af3-7a619ca05ce6-run\") pod \"tuned-sz2jd\" (UID: \"1f929846-6c97-466b-9af3-7a619ca05ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-sz2jd" Apr 24 21:16:36.635045 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.634463 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6186d834-bc6e-496f-b37d-1bf65365610b-system-cni-dir\") pod \"multus-6wpnd\" (UID: \"6186d834-bc6e-496f-b37d-1bf65365610b\") " pod="openshift-multus/multus-6wpnd" Apr 24 21:16:36.635045 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.634483 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6186d834-bc6e-496f-b37d-1bf65365610b-multus-daemon-config\") pod \"multus-6wpnd\" (UID: \"6186d834-bc6e-496f-b37d-1bf65365610b\") " pod="openshift-multus/multus-6wpnd" Apr 24 21:16:36.635045 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.634508 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4-cnibin\") pod \"multus-additional-cni-plugins-7mrlq\" (UID: \"9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4\") " pod="openshift-multus/multus-additional-cni-plugins-7mrlq" Apr 24 21:16:36.635045 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.634538 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1d4e12bc-30b8-4123-b939-ae3d8fa15235-hosts-file\") pod \"node-resolver-jwzsk\" (UID: \"1d4e12bc-30b8-4123-b939-ae3d8fa15235\") " pod="openshift-dns/node-resolver-jwzsk" Apr 24 21:16:36.635045 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.634586 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/59d17f67-9ef1-438a-b6aa-86d8f1ce1dd0-device-dir\") pod \"aws-ebs-csi-driver-node-2fs6j\" (UID: \"59d17f67-9ef1-438a-b6aa-86d8f1ce1dd0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fs6j" Apr 24 21:16:36.635045 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.634611 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d1e4bd81-6e20-4f1b-b9d3-28105e397f45-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bbpmt\" (UID: \"d1e4bd81-6e20-4f1b-b9d3-28105e397f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" Apr 24 21:16:36.635045 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.634646 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d1e4bd81-6e20-4f1b-b9d3-28105e397f45-env-overrides\") pod \"ovnkube-node-bbpmt\" (UID: \"d1e4bd81-6e20-4f1b-b9d3-28105e397f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" Apr 24 21:16:36.635045 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.634678 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7mrlq\" (UID: \"9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4\") " pod="openshift-multus/multus-additional-cni-plugins-7mrlq" Apr 24 21:16:36.635045 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.634699 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d1e4bd81-6e20-4f1b-b9d3-28105e397f45-systemd-units\") pod \"ovnkube-node-bbpmt\" (UID: \"d1e4bd81-6e20-4f1b-b9d3-28105e397f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" Apr 24 21:16:36.635045 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.634721 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1f929846-6c97-466b-9af3-7a619ca05ce6-lib-modules\") pod \"tuned-sz2jd\" (UID: \"1f929846-6c97-466b-9af3-7a619ca05ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-sz2jd" Apr 24 21:16:36.635045 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.634742 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6186d834-bc6e-496f-b37d-1bf65365610b-host-var-lib-kubelet\") pod \"multus-6wpnd\" (UID: \"6186d834-bc6e-496f-b37d-1bf65365610b\") " pod="openshift-multus/multus-6wpnd" Apr 24 21:16:36.635045 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.634765 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6186d834-bc6e-496f-b37d-1bf65365610b-host-run-multus-certs\") pod \"multus-6wpnd\" (UID: \"6186d834-bc6e-496f-b37d-1bf65365610b\") " pod="openshift-multus/multus-6wpnd" Apr 24 21:16:36.635045 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.634790 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7mrlq\" (UID: \"9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4\") " pod="openshift-multus/multus-additional-cni-plugins-7mrlq" Apr 24 21:16:36.635045 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.634811 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d1e4bd81-6e20-4f1b-b9d3-28105e397f45-host-slash\") pod \"ovnkube-node-bbpmt\" (UID: \"d1e4bd81-6e20-4f1b-b9d3-28105e397f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" Apr 24 21:16:36.635594 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.634836 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/59d17f67-9ef1-438a-b6aa-86d8f1ce1dd0-socket-dir\") pod \"aws-ebs-csi-driver-node-2fs6j\" (UID: \"59d17f67-9ef1-438a-b6aa-86d8f1ce1dd0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fs6j" Apr 24 21:16:36.635594 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.634859 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/42cf6af5-0cd5-4da4-876e-4b7ee6eaf49e-host-slash\") pod \"iptables-alerter-ks7fr\" (UID: \"42cf6af5-0cd5-4da4-876e-4b7ee6eaf49e\") " pod="openshift-network-operator/iptables-alerter-ks7fr" Apr 24 21:16:36.635594 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.634885 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d1e4bd81-6e20-4f1b-b9d3-28105e397f45-host-cni-netd\") pod \"ovnkube-node-bbpmt\" (UID: \"d1e4bd81-6e20-4f1b-b9d3-28105e397f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" Apr 24 21:16:36.635594 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.634909 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6186d834-bc6e-496f-b37d-1bf65365610b-os-release\") pod \"multus-6wpnd\" (UID: \"6186d834-bc6e-496f-b37d-1bf65365610b\") " pod="openshift-multus/multus-6wpnd" Apr 24 21:16:36.635594 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.634931 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6186d834-bc6e-496f-b37d-1bf65365610b-etc-kubernetes\") pod \"multus-6wpnd\" (UID: \"6186d834-bc6e-496f-b37d-1bf65365610b\") " pod="openshift-multus/multus-6wpnd" Apr 24 21:16:36.635594 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.634955 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7mrlq\" (UID: \"9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4\") " pod="openshift-multus/multus-additional-cni-plugins-7mrlq" Apr 24 21:16:36.638175 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.638154 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-142-241.ec2.internal"] Apr 24 21:16:36.639481 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.639465 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Apr 24 21:16:36.639547 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.639522 2579 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-241.ec2.internal" Apr 24 21:16:36.640311 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.640297 2579 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Apr 24 21:16:36.651246 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.651228 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Apr 24 21:16:36.651486 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.651467 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-241.ec2.internal"] Apr 24 21:16:36.652705 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.652690 2579 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Apr 24 21:16:36.666791 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.666771 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-rz5cj" Apr 24 21:16:36.675713 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.675694 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-rz5cj" Apr 24 21:16:36.688479 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:36.688453 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe385a9504d9f95a413d90b1b4793a62.slice/crio-a4e5a4e3584c8b8b17930fabaa58d5a155233db8d1ebe0e59ae9fb6e0d5a9408 WatchSource:0}: Error finding container a4e5a4e3584c8b8b17930fabaa58d5a155233db8d1ebe0e59ae9fb6e0d5a9408: Status 404 returned error can't find the container with id a4e5a4e3584c8b8b17930fabaa58d5a155233db8d1ebe0e59ae9fb6e0d5a9408 Apr 24 21:16:36.688654 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:36.688636 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod228671878d0b972ea78e6fdc693250e2.slice/crio-7e74f10e80370cafe274d9ffc8ab8c0ef682d1a4a73cf05108072f25b86eaae0 WatchSource:0}: Error finding container 7e74f10e80370cafe274d9ffc8ab8c0ef682d1a4a73cf05108072f25b86eaae0: Status 404 returned error can't find the container with id 7e74f10e80370cafe274d9ffc8ab8c0ef682d1a4a73cf05108072f25b86eaae0 Apr 24 21:16:36.695173 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.695149 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Apr 24 21:16:36.728624 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.728608 2579 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Apr 24 21:16:36.735559 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.735541 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/59d17f67-9ef1-438a-b6aa-86d8f1ce1dd0-socket-dir\") pod \"aws-ebs-csi-driver-node-2fs6j\" (UID: \"59d17f67-9ef1-438a-b6aa-86d8f1ce1dd0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fs6j" Apr 24 21:16:36.735614 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.735567 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/42cf6af5-0cd5-4da4-876e-4b7ee6eaf49e-host-slash\") pod \"iptables-alerter-ks7fr\" (UID: \"42cf6af5-0cd5-4da4-876e-4b7ee6eaf49e\") " pod="openshift-network-operator/iptables-alerter-ks7fr" Apr 24 21:16:36.735614 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.735583 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d1e4bd81-6e20-4f1b-b9d3-28105e397f45-host-cni-netd\") pod \"ovnkube-node-bbpmt\" (UID: \"d1e4bd81-6e20-4f1b-b9d3-28105e397f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" Apr 24 21:16:36.735614 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.735597 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6186d834-bc6e-496f-b37d-1bf65365610b-os-release\") pod \"multus-6wpnd\" (UID: \"6186d834-bc6e-496f-b37d-1bf65365610b\") " pod="openshift-multus/multus-6wpnd" Apr 24 21:16:36.735749 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.735624 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6186d834-bc6e-496f-b37d-1bf65365610b-etc-kubernetes\") pod \"multus-6wpnd\" (UID: \"6186d834-bc6e-496f-b37d-1bf65365610b\") " pod="openshift-multus/multus-6wpnd" Apr 24 21:16:36.735749 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.735641 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7mrlq\" (UID: \"9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4\") " pod="openshift-multus/multus-additional-cni-plugins-7mrlq" Apr 24 21:16:36.735749 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.735658 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d1e4bd81-6e20-4f1b-b9d3-28105e397f45-host-cni-netd\") pod \"ovnkube-node-bbpmt\" (UID: \"d1e4bd81-6e20-4f1b-b9d3-28105e397f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" Apr 24 21:16:36.735749 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.735668 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/215d3361-bff8-4125-b4d2-ed78b228872a-serviceca\") pod \"node-ca-wglcz\" (UID: \"215d3361-bff8-4125-b4d2-ed78b228872a\") " pod="openshift-image-registry/node-ca-wglcz" Apr 24 21:16:36.735749 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.735685 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6186d834-bc6e-496f-b37d-1bf65365610b-etc-kubernetes\") pod \"multus-6wpnd\" (UID: \"6186d834-bc6e-496f-b37d-1bf65365610b\") " pod="openshift-multus/multus-6wpnd" Apr 24 21:16:36.735749 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.735693 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1e4bd81-6e20-4f1b-b9d3-28105e397f45-host-kubelet\") pod \"ovnkube-node-bbpmt\" (UID: \"d1e4bd81-6e20-4f1b-b9d3-28105e397f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" Apr 24 21:16:36.735749 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.735707 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6186d834-bc6e-496f-b37d-1bf65365610b-os-release\") pod \"multus-6wpnd\" (UID: \"6186d834-bc6e-496f-b37d-1bf65365610b\") " pod="openshift-multus/multus-6wpnd" Apr 24 21:16:36.735749 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.735721 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n65bl\" (UniqueName: \"kubernetes.io/projected/6186d834-bc6e-496f-b37d-1bf65365610b-kube-api-access-n65bl\") pod \"multus-6wpnd\" (UID: \"6186d834-bc6e-496f-b37d-1bf65365610b\") " pod="openshift-multus/multus-6wpnd" Apr 24 21:16:36.735749 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.735735 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1e4bd81-6e20-4f1b-b9d3-28105e397f45-host-kubelet\") pod \"ovnkube-node-bbpmt\" (UID: \"d1e4bd81-6e20-4f1b-b9d3-28105e397f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" Apr 24 21:16:36.735749 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.735658 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/42cf6af5-0cd5-4da4-876e-4b7ee6eaf49e-host-slash\") pod \"iptables-alerter-ks7fr\" (UID: \"42cf6af5-0cd5-4da4-876e-4b7ee6eaf49e\") " pod="openshift-network-operator/iptables-alerter-ks7fr" Apr 24 21:16:36.735749 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.735751 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d1e4bd81-6e20-4f1b-b9d3-28105e397f45-host-run-netns\") pod \"ovnkube-node-bbpmt\" (UID: \"d1e4bd81-6e20-4f1b-b9d3-28105e397f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" Apr 24 21:16:36.736182 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.735771 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7mrlq\" (UID: \"9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4\") " pod="openshift-multus/multus-additional-cni-plugins-7mrlq" Apr 24 21:16:36.736182 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.735770 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/59d17f67-9ef1-438a-b6aa-86d8f1ce1dd0-socket-dir\") pod \"aws-ebs-csi-driver-node-2fs6j\" (UID: \"59d17f67-9ef1-438a-b6aa-86d8f1ce1dd0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fs6j" Apr 24 21:16:36.736182 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.735775 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-czd7s\" (UniqueName: \"kubernetes.io/projected/d1e4bd81-6e20-4f1b-b9d3-28105e397f45-kube-api-access-czd7s\") pod \"ovnkube-node-bbpmt\" (UID: \"d1e4bd81-6e20-4f1b-b9d3-28105e397f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" Apr 24 21:16:36.736182 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.735822 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2f2dk\" (UniqueName: \"kubernetes.io/projected/1d4e12bc-30b8-4123-b939-ae3d8fa15235-kube-api-access-2f2dk\") pod \"node-resolver-jwzsk\" (UID: \"1d4e12bc-30b8-4123-b939-ae3d8fa15235\") " pod="openshift-dns/node-resolver-jwzsk" Apr 24 21:16:36.736182 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.735821 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d1e4bd81-6e20-4f1b-b9d3-28105e397f45-host-run-netns\") pod \"ovnkube-node-bbpmt\" (UID: \"d1e4bd81-6e20-4f1b-b9d3-28105e397f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" Apr 24 21:16:36.736182 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.735911 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6186d834-bc6e-496f-b37d-1bf65365610b-multus-socket-dir-parent\") pod \"multus-6wpnd\" (UID: \"6186d834-bc6e-496f-b37d-1bf65365610b\") " pod="openshift-multus/multus-6wpnd" Apr 24 21:16:36.736182 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.735932 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4-cni-binary-copy\") pod \"multus-additional-cni-plugins-7mrlq\" (UID: \"9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4\") " pod="openshift-multus/multus-additional-cni-plugins-7mrlq" Apr 24 21:16:36.736182 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.735948 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c9gdc\" (UniqueName: \"kubernetes.io/projected/59d17f67-9ef1-438a-b6aa-86d8f1ce1dd0-kube-api-access-c9gdc\") pod \"aws-ebs-csi-driver-node-2fs6j\" (UID: \"59d17f67-9ef1-438a-b6aa-86d8f1ce1dd0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fs6j" Apr 24 21:16:36.736182 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.735964 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1f929846-6c97-466b-9af3-7a619ca05ce6-etc-modprobe-d\") pod \"tuned-sz2jd\" (UID: \"1f929846-6c97-466b-9af3-7a619ca05ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-sz2jd" Apr 24 21:16:36.736182 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.735983 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1f929846-6c97-466b-9af3-7a619ca05ce6-etc-sysctl-d\") pod \"tuned-sz2jd\" (UID: \"1f929846-6c97-466b-9af3-7a619ca05ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-sz2jd" Apr 24 21:16:36.736182 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.736016 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6186d834-bc6e-496f-b37d-1bf65365610b-multus-socket-dir-parent\") pod \"multus-6wpnd\" (UID: \"6186d834-bc6e-496f-b37d-1bf65365610b\") " pod="openshift-multus/multus-6wpnd" Apr 24 21:16:36.736182 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.736053 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6186d834-bc6e-496f-b37d-1bf65365610b-host-run-netns\") pod \"multus-6wpnd\" (UID: \"6186d834-bc6e-496f-b37d-1bf65365610b\") " pod="openshift-multus/multus-6wpnd" Apr 24 21:16:36.736182 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.736079 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d1e4bd81-6e20-4f1b-b9d3-28105e397f45-var-lib-openvswitch\") pod \"ovnkube-node-bbpmt\" (UID: \"d1e4bd81-6e20-4f1b-b9d3-28105e397f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" Apr 24 21:16:36.736182 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.736084 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1f929846-6c97-466b-9af3-7a619ca05ce6-etc-sysctl-d\") pod \"tuned-sz2jd\" (UID: \"1f929846-6c97-466b-9af3-7a619ca05ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-sz2jd" Apr 24 21:16:36.736182 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.736081 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1f929846-6c97-466b-9af3-7a619ca05ce6-etc-modprobe-d\") pod \"tuned-sz2jd\" (UID: \"1f929846-6c97-466b-9af3-7a619ca05ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-sz2jd" Apr 24 21:16:36.736182 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.736102 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6186d834-bc6e-496f-b37d-1bf65365610b-host-run-netns\") pod \"multus-6wpnd\" (UID: \"6186d834-bc6e-496f-b37d-1bf65365610b\") " pod="openshift-multus/multus-6wpnd" Apr 24 21:16:36.736182 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.736137 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d1e4bd81-6e20-4f1b-b9d3-28105e397f45-node-log\") pod \"ovnkube-node-bbpmt\" (UID: \"d1e4bd81-6e20-4f1b-b9d3-28105e397f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" Apr 24 21:16:36.736936 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.736158 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1f929846-6c97-466b-9af3-7a619ca05ce6-etc-kubernetes\") pod \"tuned-sz2jd\" (UID: \"1f929846-6c97-466b-9af3-7a619ca05ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-sz2jd" Apr 24 21:16:36.736936 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.736160 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d1e4bd81-6e20-4f1b-b9d3-28105e397f45-var-lib-openvswitch\") pod \"ovnkube-node-bbpmt\" (UID: \"d1e4bd81-6e20-4f1b-b9d3-28105e397f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" Apr 24 21:16:36.736936 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.736173 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1f929846-6c97-466b-9af3-7a619ca05ce6-host\") pod \"tuned-sz2jd\" (UID: \"1f929846-6c97-466b-9af3-7a619ca05ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-sz2jd" Apr 24 21:16:36.736936 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.736187 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f929846-6c97-466b-9af3-7a619ca05ce6-tmp\") pod \"tuned-sz2jd\" (UID: \"1f929846-6c97-466b-9af3-7a619ca05ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-sz2jd" Apr 24 21:16:36.736936 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.736205 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d1e4bd81-6e20-4f1b-b9d3-28105e397f45-node-log\") pod \"ovnkube-node-bbpmt\" (UID: \"d1e4bd81-6e20-4f1b-b9d3-28105e397f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" Apr 24 21:16:36.736936 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.736210 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1f929846-6c97-466b-9af3-7a619ca05ce6-etc-kubernetes\") pod \"tuned-sz2jd\" (UID: \"1f929846-6c97-466b-9af3-7a619ca05ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-sz2jd" Apr 24 21:16:36.736936 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.736211 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d4e12bc-30b8-4123-b939-ae3d8fa15235-tmp-dir\") pod \"node-resolver-jwzsk\" (UID: \"1d4e12bc-30b8-4123-b939-ae3d8fa15235\") " pod="openshift-dns/node-resolver-jwzsk" Apr 24 21:16:36.736936 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.736235 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6186d834-bc6e-496f-b37d-1bf65365610b-cni-binary-copy\") pod \"multus-6wpnd\" (UID: \"6186d834-bc6e-496f-b37d-1bf65365610b\") " pod="openshift-multus/multus-6wpnd" Apr 24 21:16:36.736936 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.736245 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1f929846-6c97-466b-9af3-7a619ca05ce6-host\") pod \"tuned-sz2jd\" (UID: \"1f929846-6c97-466b-9af3-7a619ca05ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-sz2jd" Apr 24 21:16:36.736936 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.736251 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/29637be2-89a9-414b-81e0-8c4ebdda7fe0-metrics-certs\") pod \"network-metrics-daemon-qvphd\" (UID: \"29637be2-89a9-414b-81e0-8c4ebdda7fe0\") " pod="openshift-multus/network-metrics-daemon-qvphd" Apr 24 21:16:36.736936 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.736304 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d1e4bd81-6e20-4f1b-b9d3-28105e397f45-host-cni-bin\") pod \"ovnkube-node-bbpmt\" (UID: \"d1e4bd81-6e20-4f1b-b9d3-28105e397f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" Apr 24 21:16:36.736936 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.736329 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1f929846-6c97-466b-9af3-7a619ca05ce6-etc-systemd\") pod \"tuned-sz2jd\" (UID: \"1f929846-6c97-466b-9af3-7a619ca05ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-sz2jd" Apr 24 21:16:36.736936 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:36.736361 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Apr 24 21:16:36.736936 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.736369 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/59d17f67-9ef1-438a-b6aa-86d8f1ce1dd0-registration-dir\") pod \"aws-ebs-csi-driver-node-2fs6j\" (UID: \"59d17f67-9ef1-438a-b6aa-86d8f1ce1dd0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fs6j" Apr 24 21:16:36.736936 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.736382 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d1e4bd81-6e20-4f1b-b9d3-28105e397f45-host-cni-bin\") pod \"ovnkube-node-bbpmt\" (UID: \"d1e4bd81-6e20-4f1b-b9d3-28105e397f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" Apr 24 21:16:36.736936 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.736393 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d1e4bd81-6e20-4f1b-b9d3-28105e397f45-run-openvswitch\") pod \"ovnkube-node-bbpmt\" (UID: \"d1e4bd81-6e20-4f1b-b9d3-28105e397f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" Apr 24 21:16:36.736936 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.736415 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d1e4bd81-6e20-4f1b-b9d3-28105e397f45-log-socket\") pod \"ovnkube-node-bbpmt\" (UID: \"d1e4bd81-6e20-4f1b-b9d3-28105e397f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" Apr 24 21:16:36.736936 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.736430 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1f929846-6c97-466b-9af3-7a619ca05ce6-etc-systemd\") pod \"tuned-sz2jd\" (UID: \"1f929846-6c97-466b-9af3-7a619ca05ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-sz2jd" Apr 24 21:16:36.737742 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:36.736445 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29637be2-89a9-414b-81e0-8c4ebdda7fe0-metrics-certs podName:29637be2-89a9-414b-81e0-8c4ebdda7fe0 nodeName:}" failed. No retries permitted until 2026-04-24 21:16:37.236414704 +0000 UTC m=+2.099139784 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/29637be2-89a9-414b-81e0-8c4ebdda7fe0-metrics-certs") pod "network-metrics-daemon-qvphd" (UID: "29637be2-89a9-414b-81e0-8c4ebdda7fe0") : object "openshift-multus"/"metrics-daemon-secret" not registered Apr 24 21:16:36.737742 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.736471 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d1e4bd81-6e20-4f1b-b9d3-28105e397f45-run-openvswitch\") pod \"ovnkube-node-bbpmt\" (UID: \"d1e4bd81-6e20-4f1b-b9d3-28105e397f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" Apr 24 21:16:36.737742 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.736479 2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Apr 24 21:16:36.737742 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.736504 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d1e4bd81-6e20-4f1b-b9d3-28105e397f45-host-run-ovn-kubernetes\") pod \"ovnkube-node-bbpmt\" (UID: \"d1e4bd81-6e20-4f1b-b9d3-28105e397f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" Apr 24 21:16:36.737742 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.736519 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1f929846-6c97-466b-9af3-7a619ca05ce6-var-lib-kubelet\") pod \"tuned-sz2jd\" (UID: \"1f929846-6c97-466b-9af3-7a619ca05ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-sz2jd" Apr 24 21:16:36.737742 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.736535 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/452067fc-581a-48e2-876d-0b6afa08e24b-agent-certs\") pod \"konnectivity-agent-rrmd6\" (UID: \"452067fc-581a-48e2-876d-0b6afa08e24b\") " pod="kube-system/konnectivity-agent-rrmd6" Apr 24 21:16:36.737742 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.736539 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4-cni-binary-copy\") pod \"multus-additional-cni-plugins-7mrlq\" (UID: \"9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4\") " pod="openshift-multus/multus-additional-cni-plugins-7mrlq" Apr 24 21:16:36.737742 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.736549 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6186d834-bc6e-496f-b37d-1bf65365610b-host-var-lib-cni-bin\") pod \"multus-6wpnd\" (UID: \"6186d834-bc6e-496f-b37d-1bf65365610b\") " pod="openshift-multus/multus-6wpnd" Apr 24 21:16:36.737742 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.736445 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d1e4bd81-6e20-4f1b-b9d3-28105e397f45-log-socket\") pod \"ovnkube-node-bbpmt\" (UID: \"d1e4bd81-6e20-4f1b-b9d3-28105e397f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" Apr 24 21:16:36.737742 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.736568 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4-system-cni-dir\") pod \"multus-additional-cni-plugins-7mrlq\" (UID: \"9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4\") " pod="openshift-multus/multus-additional-cni-plugins-7mrlq" Apr 24 21:16:36.737742 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.736584 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6186d834-bc6e-496f-b37d-1bf65365610b-multus-cni-dir\") pod \"multus-6wpnd\" (UID: \"6186d834-bc6e-496f-b37d-1bf65365610b\") " pod="openshift-multus/multus-6wpnd" Apr 24 21:16:36.737742 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.736596 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d1e4bd81-6e20-4f1b-b9d3-28105e397f45-host-run-ovn-kubernetes\") pod \"ovnkube-node-bbpmt\" (UID: \"d1e4bd81-6e20-4f1b-b9d3-28105e397f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" Apr 24 21:16:36.737742 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.736615 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4-system-cni-dir\") pod \"multus-additional-cni-plugins-7mrlq\" (UID: \"9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4\") " pod="openshift-multus/multus-additional-cni-plugins-7mrlq" Apr 24 21:16:36.737742 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.736623 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6186d834-bc6e-496f-b37d-1bf65365610b-host-var-lib-cni-bin\") pod \"multus-6wpnd\" (UID: \"6186d834-bc6e-496f-b37d-1bf65365610b\") " pod="openshift-multus/multus-6wpnd" Apr 24 21:16:36.737742 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.736638 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1f929846-6c97-466b-9af3-7a619ca05ce6-var-lib-kubelet\") pod \"tuned-sz2jd\" (UID: \"1f929846-6c97-466b-9af3-7a619ca05ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-sz2jd" Apr 24 21:16:36.737742 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.736659 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/59d17f67-9ef1-438a-b6aa-86d8f1ce1dd0-sys-fs\") pod \"aws-ebs-csi-driver-node-2fs6j\" (UID: \"59d17f67-9ef1-438a-b6aa-86d8f1ce1dd0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fs6j" Apr 24 21:16:36.737742 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.736688 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5g4mv\" (UniqueName: \"kubernetes.io/projected/42cf6af5-0cd5-4da4-876e-4b7ee6eaf49e-kube-api-access-5g4mv\") pod \"iptables-alerter-ks7fr\" (UID: \"42cf6af5-0cd5-4da4-876e-4b7ee6eaf49e\") " pod="openshift-network-operator/iptables-alerter-ks7fr" Apr 24 21:16:36.738484 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.736712 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/59d17f67-9ef1-438a-b6aa-86d8f1ce1dd0-sys-fs\") pod \"aws-ebs-csi-driver-node-2fs6j\" (UID: \"59d17f67-9ef1-438a-b6aa-86d8f1ce1dd0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fs6j" Apr 24 21:16:36.738484 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.736743 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f929846-6c97-466b-9af3-7a619ca05ce6-sys\") pod \"tuned-sz2jd\" (UID: \"1f929846-6c97-466b-9af3-7a619ca05ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-sz2jd" Apr 24 21:16:36.738484 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.736712 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f929846-6c97-466b-9af3-7a619ca05ce6-sys\") pod \"tuned-sz2jd\" (UID: \"1f929846-6c97-466b-9af3-7a619ca05ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-sz2jd" Apr 24 21:16:36.738484 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.736766 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qdn2f\" (UniqueName: \"kubernetes.io/projected/b98dea0d-9954-40bd-a46c-865213211e17-kube-api-access-qdn2f\") pod \"network-check-target-s9p7t\" (UID: \"b98dea0d-9954-40bd-a46c-865213211e17\") " pod="openshift-network-diagnostics/network-check-target-s9p7t" Apr 24 21:16:36.738484 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.736765 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6186d834-bc6e-496f-b37d-1bf65365610b-cni-binary-copy\") pod \"multus-6wpnd\" (UID: \"6186d834-bc6e-496f-b37d-1bf65365610b\") " pod="openshift-multus/multus-6wpnd" Apr 24 21:16:36.738484 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.736483 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/59d17f67-9ef1-438a-b6aa-86d8f1ce1dd0-registration-dir\") pod \"aws-ebs-csi-driver-node-2fs6j\" (UID: \"59d17f67-9ef1-438a-b6aa-86d8f1ce1dd0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fs6j" Apr 24 21:16:36.738484 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.736791 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5mp9\" (UniqueName: \"kubernetes.io/projected/215d3361-bff8-4125-b4d2-ed78b228872a-kube-api-access-j5mp9\") pod \"node-ca-wglcz\" (UID: \"215d3361-bff8-4125-b4d2-ed78b228872a\") " pod="openshift-image-registry/node-ca-wglcz" Apr 24 21:16:36.738484 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.736816 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d1e4bd81-6e20-4f1b-b9d3-28105e397f45-run-ovn\") pod \"ovnkube-node-bbpmt\" (UID: \"d1e4bd81-6e20-4f1b-b9d3-28105e397f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" Apr 24 21:16:36.738484 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.736836 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/452067fc-581a-48e2-876d-0b6afa08e24b-konnectivity-ca\") pod \"konnectivity-agent-rrmd6\" (UID: \"452067fc-581a-48e2-876d-0b6afa08e24b\") " pod="kube-system/konnectivity-agent-rrmd6" Apr 24 21:16:36.738484 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.736851 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6186d834-bc6e-496f-b37d-1bf65365610b-cnibin\") pod \"multus-6wpnd\" (UID: \"6186d834-bc6e-496f-b37d-1bf65365610b\") " pod="openshift-multus/multus-6wpnd" Apr 24 21:16:36.738484 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.736871 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6186d834-bc6e-496f-b37d-1bf65365610b-host-var-lib-cni-multus\") pod \"multus-6wpnd\" (UID: \"6186d834-bc6e-496f-b37d-1bf65365610b\") " pod="openshift-multus/multus-6wpnd" Apr 24 21:16:36.738484 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.736928 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6186d834-bc6e-496f-b37d-1bf65365610b-host-var-lib-cni-multus\") pod \"multus-6wpnd\" (UID: \"6186d834-bc6e-496f-b37d-1bf65365610b\") " pod="openshift-multus/multus-6wpnd" Apr 24 21:16:36.738484 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.736929 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6186d834-bc6e-496f-b37d-1bf65365610b-cnibin\") pod \"multus-6wpnd\" (UID: \"6186d834-bc6e-496f-b37d-1bf65365610b\") " pod="openshift-multus/multus-6wpnd" Apr 24 21:16:36.738484 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.736957 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6186d834-bc6e-496f-b37d-1bf65365610b-multus-conf-dir\") pod \"multus-6wpnd\" (UID: \"6186d834-bc6e-496f-b37d-1bf65365610b\") " pod="openshift-multus/multus-6wpnd" Apr 24 21:16:36.738484 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.737014 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6186d834-bc6e-496f-b37d-1bf65365610b-multus-conf-dir\") pod \"multus-6wpnd\" (UID: \"6186d834-bc6e-496f-b37d-1bf65365610b\") " pod="openshift-multus/multus-6wpnd" Apr 24 21:16:36.738484 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.736970 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d1e4bd81-6e20-4f1b-b9d3-28105e397f45-run-ovn\") pod \"ovnkube-node-bbpmt\" (UID: \"d1e4bd81-6e20-4f1b-b9d3-28105e397f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" Apr 24 21:16:36.738484 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.737039 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/59d17f67-9ef1-438a-b6aa-86d8f1ce1dd0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2fs6j\" (UID: \"59d17f67-9ef1-438a-b6aa-86d8f1ce1dd0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fs6j" Apr 24 21:16:36.738484 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.737065 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6186d834-bc6e-496f-b37d-1bf65365610b-multus-cni-dir\") pod \"multus-6wpnd\" (UID: \"6186d834-bc6e-496f-b37d-1bf65365610b\") " pod="openshift-multus/multus-6wpnd" Apr 24 21:16:36.741027 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.737069 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d1e4bd81-6e20-4f1b-b9d3-28105e397f45-ovnkube-config\") pod \"ovnkube-node-bbpmt\" (UID: \"d1e4bd81-6e20-4f1b-b9d3-28105e397f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" Apr 24 21:16:36.741027 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.737103 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/59d17f67-9ef1-438a-b6aa-86d8f1ce1dd0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2fs6j\" (UID: \"59d17f67-9ef1-438a-b6aa-86d8f1ce1dd0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fs6j" Apr 24 21:16:36.741027 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.737111 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1f929846-6c97-466b-9af3-7a619ca05ce6-etc-tuned\") pod \"tuned-sz2jd\" (UID: \"1f929846-6c97-466b-9af3-7a619ca05ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-sz2jd" Apr 24 21:16:36.741027 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.737126 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d4e12bc-30b8-4123-b939-ae3d8fa15235-tmp-dir\") pod \"node-resolver-jwzsk\" (UID: \"1d4e12bc-30b8-4123-b939-ae3d8fa15235\") " pod="openshift-dns/node-resolver-jwzsk" Apr 24 21:16:36.741027 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.737136 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wfpxs\" (UniqueName: \"kubernetes.io/projected/1f929846-6c97-466b-9af3-7a619ca05ce6-kube-api-access-wfpxs\") pod \"tuned-sz2jd\" (UID: \"1f929846-6c97-466b-9af3-7a619ca05ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-sz2jd" Apr 24 21:16:36.741027 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.737157 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w2vnz\" (UniqueName: \"kubernetes.io/projected/29637be2-89a9-414b-81e0-8c4ebdda7fe0-kube-api-access-w2vnz\") pod \"network-metrics-daemon-qvphd\" (UID: \"29637be2-89a9-414b-81e0-8c4ebdda7fe0\") " pod="openshift-multus/network-metrics-daemon-qvphd" Apr 24 21:16:36.741027 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.737179 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/42cf6af5-0cd5-4da4-876e-4b7ee6eaf49e-iptables-alerter-script\") pod \"iptables-alerter-ks7fr\" (UID: \"42cf6af5-0cd5-4da4-876e-4b7ee6eaf49e\") " pod="openshift-network-operator/iptables-alerter-ks7fr" Apr 24 21:16:36.741027 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.737411 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/452067fc-581a-48e2-876d-0b6afa08e24b-konnectivity-ca\") pod \"konnectivity-agent-rrmd6\" (UID: \"452067fc-581a-48e2-876d-0b6afa08e24b\") " pod="kube-system/konnectivity-agent-rrmd6" Apr 24 21:16:36.741027 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.737591 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d1e4bd81-6e20-4f1b-b9d3-28105e397f45-ovnkube-script-lib\") pod \"ovnkube-node-bbpmt\" (UID: \"d1e4bd81-6e20-4f1b-b9d3-28105e397f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" Apr 24 21:16:36.741027 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.737618 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1f929846-6c97-466b-9af3-7a619ca05ce6-etc-sysctl-conf\") pod \"tuned-sz2jd\" (UID: \"1f929846-6c97-466b-9af3-7a619ca05ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-sz2jd" Apr 24 21:16:36.741027 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.737640 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4-os-release\") pod \"multus-additional-cni-plugins-7mrlq\" (UID: \"9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4\") " pod="openshift-multus/multus-additional-cni-plugins-7mrlq" Apr 24 21:16:36.741027 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.737665 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d1e4bd81-6e20-4f1b-b9d3-28105e397f45-ovn-node-metrics-cert\") pod \"ovnkube-node-bbpmt\" (UID: \"d1e4bd81-6e20-4f1b-b9d3-28105e397f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" Apr 24 21:16:36.741027 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.737689 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6186d834-bc6e-496f-b37d-1bf65365610b-host-run-k8s-cni-cncf-io\") pod \"multus-6wpnd\" (UID: \"6186d834-bc6e-496f-b37d-1bf65365610b\") " pod="openshift-multus/multus-6wpnd" Apr 24 21:16:36.741027 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.737713 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6186d834-bc6e-496f-b37d-1bf65365610b-hostroot\") pod \"multus-6wpnd\" (UID: \"6186d834-bc6e-496f-b37d-1bf65365610b\") " pod="openshift-multus/multus-6wpnd" Apr 24 21:16:36.741027 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.737738 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jl9lf\" (UniqueName: \"kubernetes.io/projected/9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4-kube-api-access-jl9lf\") pod \"multus-additional-cni-plugins-7mrlq\" (UID: \"9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4\") " pod="openshift-multus/multus-additional-cni-plugins-7mrlq" Apr 24 21:16:36.741027 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.737768 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/215d3361-bff8-4125-b4d2-ed78b228872a-host\") pod \"node-ca-wglcz\" (UID: \"215d3361-bff8-4125-b4d2-ed78b228872a\") " pod="openshift-image-registry/node-ca-wglcz" Apr 24 21:16:36.741027 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.737793 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/59d17f67-9ef1-438a-b6aa-86d8f1ce1dd0-etc-selinux\") pod \"aws-ebs-csi-driver-node-2fs6j\" (UID: \"59d17f67-9ef1-438a-b6aa-86d8f1ce1dd0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fs6j" Apr 24 21:16:36.741735 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.737874 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4-os-release\") pod \"multus-additional-cni-plugins-7mrlq\" (UID: \"9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4\") " pod="openshift-multus/multus-additional-cni-plugins-7mrlq" Apr 24 21:16:36.741735 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.737975 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/59d17f67-9ef1-438a-b6aa-86d8f1ce1dd0-etc-selinux\") pod \"aws-ebs-csi-driver-node-2fs6j\" (UID: \"59d17f67-9ef1-438a-b6aa-86d8f1ce1dd0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fs6j" Apr 24 21:16:36.741735 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.738028 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/42cf6af5-0cd5-4da4-876e-4b7ee6eaf49e-iptables-alerter-script\") pod \"iptables-alerter-ks7fr\" (UID: \"42cf6af5-0cd5-4da4-876e-4b7ee6eaf49e\") " pod="openshift-network-operator/iptables-alerter-ks7fr" Apr 24 21:16:36.741735 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.738100 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1f929846-6c97-466b-9af3-7a619ca05ce6-etc-sysctl-conf\") pod \"tuned-sz2jd\" (UID: \"1f929846-6c97-466b-9af3-7a619ca05ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-sz2jd" Apr 24 21:16:36.741735 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.738129 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d1e4bd81-6e20-4f1b-b9d3-28105e397f45-ovnkube-script-lib\") pod \"ovnkube-node-bbpmt\" (UID: \"d1e4bd81-6e20-4f1b-b9d3-28105e397f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" Apr 24 21:16:36.741735 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.738135 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d1e4bd81-6e20-4f1b-b9d3-28105e397f45-run-systemd\") pod \"ovnkube-node-bbpmt\" (UID: \"d1e4bd81-6e20-4f1b-b9d3-28105e397f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" Apr 24 21:16:36.741735 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.738185 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d1e4bd81-6e20-4f1b-b9d3-28105e397f45-etc-openvswitch\") pod \"ovnkube-node-bbpmt\" (UID: \"d1e4bd81-6e20-4f1b-b9d3-28105e397f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" Apr 24 21:16:36.741735 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.738188 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d1e4bd81-6e20-4f1b-b9d3-28105e397f45-run-systemd\") pod \"ovnkube-node-bbpmt\" (UID: \"d1e4bd81-6e20-4f1b-b9d3-28105e397f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" Apr 24 21:16:36.741735 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.738211 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1f929846-6c97-466b-9af3-7a619ca05ce6-etc-sysconfig\") pod \"tuned-sz2jd\" (UID: \"1f929846-6c97-466b-9af3-7a619ca05ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-sz2jd" Apr 24 21:16:36.741735 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.738248 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1f929846-6c97-466b-9af3-7a619ca05ce6-run\") pod \"tuned-sz2jd\" (UID: \"1f929846-6c97-466b-9af3-7a619ca05ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-sz2jd" Apr 24 21:16:36.741735 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.738273 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6186d834-bc6e-496f-b37d-1bf65365610b-system-cni-dir\") pod \"multus-6wpnd\" (UID: \"6186d834-bc6e-496f-b37d-1bf65365610b\") " pod="openshift-multus/multus-6wpnd" Apr 24 21:16:36.741735 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.738302 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6186d834-bc6e-496f-b37d-1bf65365610b-multus-daemon-config\") pod \"multus-6wpnd\" (UID: \"6186d834-bc6e-496f-b37d-1bf65365610b\") " pod="openshift-multus/multus-6wpnd" Apr 24 21:16:36.741735 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.738325 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4-cnibin\") pod \"multus-additional-cni-plugins-7mrlq\" (UID: \"9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4\") " pod="openshift-multus/multus-additional-cni-plugins-7mrlq" Apr 24 21:16:36.741735 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.738366 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1d4e12bc-30b8-4123-b939-ae3d8fa15235-hosts-file\") pod \"node-resolver-jwzsk\" (UID: \"1d4e12bc-30b8-4123-b939-ae3d8fa15235\") " pod="openshift-dns/node-resolver-jwzsk" Apr 24 21:16:36.741735 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.738390 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/59d17f67-9ef1-438a-b6aa-86d8f1ce1dd0-device-dir\") pod \"aws-ebs-csi-driver-node-2fs6j\" (UID: \"59d17f67-9ef1-438a-b6aa-86d8f1ce1dd0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fs6j" Apr 24 21:16:36.741735 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.738688 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d1e4bd81-6e20-4f1b-b9d3-28105e397f45-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bbpmt\" (UID: \"d1e4bd81-6e20-4f1b-b9d3-28105e397f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" Apr 24 21:16:36.741735 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.738733 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d1e4bd81-6e20-4f1b-b9d3-28105e397f45-env-overrides\") pod \"ovnkube-node-bbpmt\" (UID: \"d1e4bd81-6e20-4f1b-b9d3-28105e397f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" Apr 24 21:16:36.742378 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.738778 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7mrlq\" (UID: \"9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4\") " pod="openshift-multus/multus-additional-cni-plugins-7mrlq" Apr 24 21:16:36.742378 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.738812 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d1e4bd81-6e20-4f1b-b9d3-28105e397f45-systemd-units\") pod \"ovnkube-node-bbpmt\" (UID: \"d1e4bd81-6e20-4f1b-b9d3-28105e397f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" Apr 24 21:16:36.742378 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.738860 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1f929846-6c97-466b-9af3-7a619ca05ce6-lib-modules\") pod \"tuned-sz2jd\" (UID: \"1f929846-6c97-466b-9af3-7a619ca05ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-sz2jd" Apr 24 21:16:36.742378 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.738872 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d1e4bd81-6e20-4f1b-b9d3-28105e397f45-ovnkube-config\") pod \"ovnkube-node-bbpmt\" (UID: \"d1e4bd81-6e20-4f1b-b9d3-28105e397f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" Apr 24 21:16:36.742378 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.738900 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6186d834-bc6e-496f-b37d-1bf65365610b-host-var-lib-kubelet\") pod \"multus-6wpnd\" (UID: \"6186d834-bc6e-496f-b37d-1bf65365610b\") " pod="openshift-multus/multus-6wpnd" Apr 24 21:16:36.742378 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.738937 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6186d834-bc6e-496f-b37d-1bf65365610b-host-run-multus-certs\") pod \"multus-6wpnd\" (UID: \"6186d834-bc6e-496f-b37d-1bf65365610b\") " pod="openshift-multus/multus-6wpnd" Apr 24 21:16:36.742378 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.738956 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6186d834-bc6e-496f-b37d-1bf65365610b-system-cni-dir\") pod \"multus-6wpnd\" (UID: \"6186d834-bc6e-496f-b37d-1bf65365610b\") " pod="openshift-multus/multus-6wpnd" Apr 24 21:16:36.742378 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.738976 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7mrlq\" (UID: \"9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4\") " pod="openshift-multus/multus-additional-cni-plugins-7mrlq" Apr 24 21:16:36.742378 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.739005 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d1e4bd81-6e20-4f1b-b9d3-28105e397f45-etc-openvswitch\") pod \"ovnkube-node-bbpmt\" (UID: \"d1e4bd81-6e20-4f1b-b9d3-28105e397f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" Apr 24 21:16:36.742378 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.739011 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d1e4bd81-6e20-4f1b-b9d3-28105e397f45-host-slash\") pod \"ovnkube-node-bbpmt\" (UID: \"d1e4bd81-6e20-4f1b-b9d3-28105e397f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" Apr 24 21:16:36.742378 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.739116 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6186d834-bc6e-496f-b37d-1bf65365610b-hostroot\") pod \"multus-6wpnd\" (UID: \"6186d834-bc6e-496f-b37d-1bf65365610b\") " pod="openshift-multus/multus-6wpnd" Apr 24 21:16:36.742378 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.739163 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d1e4bd81-6e20-4f1b-b9d3-28105e397f45-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bbpmt\" (UID: \"d1e4bd81-6e20-4f1b-b9d3-28105e397f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" Apr 24 21:16:36.742378 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.739245 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6186d834-bc6e-496f-b37d-1bf65365610b-host-run-k8s-cni-cncf-io\") pod \"multus-6wpnd\" (UID: \"6186d834-bc6e-496f-b37d-1bf65365610b\") " pod="openshift-multus/multus-6wpnd" Apr 24 21:16:36.742378 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.739655 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/59d17f67-9ef1-438a-b6aa-86d8f1ce1dd0-device-dir\") pod \"aws-ebs-csi-driver-node-2fs6j\" (UID: \"59d17f67-9ef1-438a-b6aa-86d8f1ce1dd0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fs6j" Apr 24 21:16:36.742378 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.739744 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d1e4bd81-6e20-4f1b-b9d3-28105e397f45-env-overrides\") pod \"ovnkube-node-bbpmt\" (UID: \"d1e4bd81-6e20-4f1b-b9d3-28105e397f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" Apr 24 21:16:36.742378 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.739787 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1f929846-6c97-466b-9af3-7a619ca05ce6-run\") pod \"tuned-sz2jd\" (UID: \"1f929846-6c97-466b-9af3-7a619ca05ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-sz2jd" Apr 24 21:16:36.742378 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.739798 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4-cnibin\") pod \"multus-additional-cni-plugins-7mrlq\" (UID: \"9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4\") " pod="openshift-multus/multus-additional-cni-plugins-7mrlq" Apr 24 21:16:36.742823 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.740102 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7mrlq\" (UID: \"9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4\") " pod="openshift-multus/multus-additional-cni-plugins-7mrlq" Apr 24 21:16:36.742823 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.740253 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/452067fc-581a-48e2-876d-0b6afa08e24b-agent-certs\") pod \"konnectivity-agent-rrmd6\" (UID: \"452067fc-581a-48e2-876d-0b6afa08e24b\") " pod="kube-system/konnectivity-agent-rrmd6" Apr 24 21:16:36.742823 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.740263 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d1e4bd81-6e20-4f1b-b9d3-28105e397f45-host-slash\") pod \"ovnkube-node-bbpmt\" (UID: \"d1e4bd81-6e20-4f1b-b9d3-28105e397f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" Apr 24 21:16:36.742823 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.740280 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6186d834-bc6e-496f-b37d-1bf65365610b-host-var-lib-kubelet\") pod \"multus-6wpnd\" (UID: \"6186d834-bc6e-496f-b37d-1bf65365610b\") " pod="openshift-multus/multus-6wpnd" Apr 24 21:16:36.742823 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.740309 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1f929846-6c97-466b-9af3-7a619ca05ce6-etc-sysconfig\") pod \"tuned-sz2jd\" (UID: \"1f929846-6c97-466b-9af3-7a619ca05ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-sz2jd" Apr 24 21:16:36.742823 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.740373 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f929846-6c97-466b-9af3-7a619ca05ce6-tmp\") pod \"tuned-sz2jd\" (UID: \"1f929846-6c97-466b-9af3-7a619ca05ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-sz2jd" Apr 24 21:16:36.742823 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.740390 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6186d834-bc6e-496f-b37d-1bf65365610b-host-run-multus-certs\") pod \"multus-6wpnd\" (UID: \"6186d834-bc6e-496f-b37d-1bf65365610b\") " pod="openshift-multus/multus-6wpnd" Apr 24 21:16:36.742823 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.740406 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1f929846-6c97-466b-9af3-7a619ca05ce6-lib-modules\") pod \"tuned-sz2jd\" (UID: \"1f929846-6c97-466b-9af3-7a619ca05ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-sz2jd" Apr 24 21:16:36.742823 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.740463 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1d4e12bc-30b8-4123-b939-ae3d8fa15235-hosts-file\") pod \"node-resolver-jwzsk\" (UID: \"1d4e12bc-30b8-4123-b939-ae3d8fa15235\") " pod="openshift-dns/node-resolver-jwzsk" Apr 24 21:16:36.742823 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.740554 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d1e4bd81-6e20-4f1b-b9d3-28105e397f45-systemd-units\") pod \"ovnkube-node-bbpmt\" (UID: \"d1e4bd81-6e20-4f1b-b9d3-28105e397f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" Apr 24 21:16:36.742823 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.740690 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d1e4bd81-6e20-4f1b-b9d3-28105e397f45-ovn-node-metrics-cert\") pod \"ovnkube-node-bbpmt\" (UID: \"d1e4bd81-6e20-4f1b-b9d3-28105e397f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" Apr 24 21:16:36.742823 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.740732 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6186d834-bc6e-496f-b37d-1bf65365610b-multus-daemon-config\") pod \"multus-6wpnd\" (UID: \"6186d834-bc6e-496f-b37d-1bf65365610b\") " pod="openshift-multus/multus-6wpnd" Apr 24 21:16:36.742823 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.740778 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1f929846-6c97-466b-9af3-7a619ca05ce6-etc-tuned\") pod \"tuned-sz2jd\" (UID: \"1f929846-6c97-466b-9af3-7a619ca05ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-sz2jd" Apr 24 21:16:36.742823 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.740858 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7mrlq\" (UID: \"9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4\") " pod="openshift-multus/multus-additional-cni-plugins-7mrlq" Apr 24 21:16:36.746525 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:36.746179 2579 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Apr 24 21:16:36.746525 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:36.746200 2579 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Apr 24 21:16:36.746525 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:36.746211 2579 projected.go:194] Error preparing data for projected volume kube-api-access-qdn2f for pod openshift-network-diagnostics/network-check-target-s9p7t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 24 21:16:36.746525 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:36.746264 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b98dea0d-9954-40bd-a46c-865213211e17-kube-api-access-qdn2f podName:b98dea0d-9954-40bd-a46c-865213211e17 nodeName:}" failed. No retries permitted until 2026-04-24 21:16:37.246251647 +0000 UTC m=+2.108976746 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qdn2f" (UniqueName: "kubernetes.io/projected/b98dea0d-9954-40bd-a46c-865213211e17-kube-api-access-qdn2f") pod "network-check-target-s9p7t" (UID: "b98dea0d-9954-40bd-a46c-865213211e17") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 24 21:16:36.748895 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.748860 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl9lf\" (UniqueName: \"kubernetes.io/projected/9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4-kube-api-access-jl9lf\") pod \"multus-additional-cni-plugins-7mrlq\" (UID: \"9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4\") " pod="openshift-multus/multus-additional-cni-plugins-7mrlq" Apr 24 21:16:36.748985 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.748915 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9gdc\" (UniqueName: \"kubernetes.io/projected/59d17f67-9ef1-438a-b6aa-86d8f1ce1dd0-kube-api-access-c9gdc\") pod \"aws-ebs-csi-driver-node-2fs6j\" (UID: \"59d17f67-9ef1-438a-b6aa-86d8f1ce1dd0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fs6j" Apr 24 21:16:36.748985 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.748930 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2f2dk\" (UniqueName: \"kubernetes.io/projected/1d4e12bc-30b8-4123-b939-ae3d8fa15235-kube-api-access-2f2dk\") pod \"node-resolver-jwzsk\" (UID: \"1d4e12bc-30b8-4123-b939-ae3d8fa15235\") " pod="openshift-dns/node-resolver-jwzsk" Apr 24 21:16:36.749189 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.749174 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5g4mv\" (UniqueName: \"kubernetes.io/projected/42cf6af5-0cd5-4da4-876e-4b7ee6eaf49e-kube-api-access-5g4mv\") pod \"iptables-alerter-ks7fr\" (UID: \"42cf6af5-0cd5-4da4-876e-4b7ee6eaf49e\") " pod="openshift-network-operator/iptables-alerter-ks7fr" Apr 24 21:16:36.749352 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.749318 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czd7s\" (UniqueName: \"kubernetes.io/projected/d1e4bd81-6e20-4f1b-b9d3-28105e397f45-kube-api-access-czd7s\") pod \"ovnkube-node-bbpmt\" (UID: \"d1e4bd81-6e20-4f1b-b9d3-28105e397f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" Apr 24 21:16:36.749397 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.749325 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfpxs\" (UniqueName: \"kubernetes.io/projected/1f929846-6c97-466b-9af3-7a619ca05ce6-kube-api-access-wfpxs\") pod \"tuned-sz2jd\" (UID: \"1f929846-6c97-466b-9af3-7a619ca05ce6\") " pod="openshift-cluster-node-tuning-operator/tuned-sz2jd" Apr 24 21:16:36.749397 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.749385 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n65bl\" (UniqueName: \"kubernetes.io/projected/6186d834-bc6e-496f-b37d-1bf65365610b-kube-api-access-n65bl\") pod \"multus-6wpnd\" (UID: \"6186d834-bc6e-496f-b37d-1bf65365610b\") " pod="openshift-multus/multus-6wpnd" Apr 24 21:16:36.749520 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.749506 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2vnz\" (UniqueName: \"kubernetes.io/projected/29637be2-89a9-414b-81e0-8c4ebdda7fe0-kube-api-access-w2vnz\") pod \"network-metrics-daemon-qvphd\" (UID: \"29637be2-89a9-414b-81e0-8c4ebdda7fe0\") " pod="openshift-multus/network-metrics-daemon-qvphd" Apr 24 21:16:36.766501 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.766454 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-241.ec2.internal" event={"ID":"228671878d0b972ea78e6fdc693250e2","Type":"ContainerStarted","Data":"7e74f10e80370cafe274d9ffc8ab8c0ef682d1a4a73cf05108072f25b86eaae0"} Apr 24 21:16:36.767253 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.767236 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-241.ec2.internal" event={"ID":"be385a9504d9f95a413d90b1b4793a62","Type":"ContainerStarted","Data":"a4e5a4e3584c8b8b17930fabaa58d5a155233db8d1ebe0e59ae9fb6e0d5a9408"} Apr 24 21:16:36.839594 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.839535 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j5mp9\" (UniqueName: \"kubernetes.io/projected/215d3361-bff8-4125-b4d2-ed78b228872a-kube-api-access-j5mp9\") pod \"node-ca-wglcz\" (UID: \"215d3361-bff8-4125-b4d2-ed78b228872a\") " pod="openshift-image-registry/node-ca-wglcz" Apr 24 21:16:36.839594 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.839567 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/215d3361-bff8-4125-b4d2-ed78b228872a-host\") pod \"node-ca-wglcz\" (UID: \"215d3361-bff8-4125-b4d2-ed78b228872a\") " pod="openshift-image-registry/node-ca-wglcz" Apr 24 21:16:36.839594 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.839589 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/215d3361-bff8-4125-b4d2-ed78b228872a-serviceca\") pod \"node-ca-wglcz\" (UID: \"215d3361-bff8-4125-b4d2-ed78b228872a\") " pod="openshift-image-registry/node-ca-wglcz" Apr 24 21:16:36.839765 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.839649 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/215d3361-bff8-4125-b4d2-ed78b228872a-host\") pod \"node-ca-wglcz\" (UID: \"215d3361-bff8-4125-b4d2-ed78b228872a\") " pod="openshift-image-registry/node-ca-wglcz" Apr 24 21:16:36.839953 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.839939 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/215d3361-bff8-4125-b4d2-ed78b228872a-serviceca\") pod \"node-ca-wglcz\" (UID: \"215d3361-bff8-4125-b4d2-ed78b228872a\") " pod="openshift-image-registry/node-ca-wglcz" Apr 24 21:16:36.852185 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.852161 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5mp9\" (UniqueName: \"kubernetes.io/projected/215d3361-bff8-4125-b4d2-ed78b228872a-kube-api-access-j5mp9\") pod \"node-ca-wglcz\" (UID: \"215d3361-bff8-4125-b4d2-ed78b228872a\") " pod="openshift-image-registry/node-ca-wglcz" Apr 24 21:16:36.957301 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.957262 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ks7fr" Apr 24 21:16:36.963999 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:36.963975 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42cf6af5_0cd5_4da4_876e_4b7ee6eaf49e.slice/crio-b5d540ab099457ba4774cba1de39102f8ea7898ba29962f3fca356ac7958a963 WatchSource:0}: Error finding container b5d540ab099457ba4774cba1de39102f8ea7898ba29962f3fca356ac7958a963: Status 404 returned error can't find the container with id b5d540ab099457ba4774cba1de39102f8ea7898ba29962f3fca356ac7958a963 Apr 24 21:16:36.977287 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.977266 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" Apr 24 21:16:36.983394 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:36.983370 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1e4bd81_6e20_4f1b_b9d3_28105e397f45.slice/crio-8324b781fb78745d8f6b0b9bed5d65de04064305abbb43b73a9349a48f0858d7 WatchSource:0}: Error finding container 8324b781fb78745d8f6b0b9bed5d65de04064305abbb43b73a9349a48f0858d7: Status 404 returned error can't find the container with id 8324b781fb78745d8f6b0b9bed5d65de04064305abbb43b73a9349a48f0858d7 Apr 24 21:16:36.995916 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:36.995894 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rrmd6" Apr 24 21:16:37.000496 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:37.000477 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jwzsk" Apr 24 21:16:37.002513 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:37.002491 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod452067fc_581a_48e2_876d_0b6afa08e24b.slice/crio-ed367284de615c8918396929ef2bde6223377eab4918f800a5f236c07462435a WatchSource:0}: Error finding container ed367284de615c8918396929ef2bde6223377eab4918f800a5f236c07462435a: Status 404 returned error can't find the container with id ed367284de615c8918396929ef2bde6223377eab4918f800a5f236c07462435a Apr 24 21:16:37.006574 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:37.006556 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6wpnd" Apr 24 21:16:37.006906 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:37.006884 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d4e12bc_30b8_4123_b939_ae3d8fa15235.slice/crio-301d702c2789b0d1134d76411e04e596f81f5c58c92546fd0d92ebc7d1052989 WatchSource:0}: Error finding container 301d702c2789b0d1134d76411e04e596f81f5c58c92546fd0d92ebc7d1052989: Status 404 returned error can't find the container with id 301d702c2789b0d1134d76411e04e596f81f5c58c92546fd0d92ebc7d1052989 Apr 24 21:16:37.011019 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:37.010996 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7mrlq" Apr 24 21:16:37.012893 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:37.012859 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6186d834_bc6e_496f_b37d_1bf65365610b.slice/crio-1e2c4bee73a88a679da04efd71c5817412aa5242e9760fad9f33f755078d5d0a WatchSource:0}: Error finding container 1e2c4bee73a88a679da04efd71c5817412aa5242e9760fad9f33f755078d5d0a: Status 404 returned error can't find the container with id 1e2c4bee73a88a679da04efd71c5817412aa5242e9760fad9f33f755078d5d0a Apr 24 21:16:37.016319 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:37.016296 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fs6j" Apr 24 21:16:37.019215 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:37.019192 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9acf9fa8_3c6f_40f6_8b74_f67a8d8df8b4.slice/crio-f1c8d4b30c18b2ea541916ba0bb96d0fb19ea79b25258ac5e11d2891a35a8c4d WatchSource:0}: Error finding container f1c8d4b30c18b2ea541916ba0bb96d0fb19ea79b25258ac5e11d2891a35a8c4d: Status 404 returned error can't find the container with id f1c8d4b30c18b2ea541916ba0bb96d0fb19ea79b25258ac5e11d2891a35a8c4d Apr 24 21:16:37.021114 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:37.021097 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sz2jd" Apr 24 21:16:37.025381 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:37.025355 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59d17f67_9ef1_438a_b6aa_86d8f1ce1dd0.slice/crio-31c90006782db32608291be53002ab8f57ee6960f0c49173275253cf153fcba5 WatchSource:0}: Error finding container 31c90006782db32608291be53002ab8f57ee6960f0c49173275253cf153fcba5: Status 404 returned error can't find the container with id 31c90006782db32608291be53002ab8f57ee6960f0c49173275253cf153fcba5 Apr 24 21:16:37.025918 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:37.025895 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wglcz" Apr 24 21:16:37.028712 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:37.028691 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f929846_6c97_466b_9af3_7a619ca05ce6.slice/crio-62b9a327f6374ab109499f2aabbc337c7be9e9716137e8ecb8936af816607fbd WatchSource:0}: Error finding container 62b9a327f6374ab109499f2aabbc337c7be9e9716137e8ecb8936af816607fbd: Status 404 returned error can't find the container with id 62b9a327f6374ab109499f2aabbc337c7be9e9716137e8ecb8936af816607fbd Apr 24 21:16:37.033451 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:16:37.033427 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod215d3361_bff8_4125_b4d2_ed78b228872a.slice/crio-05b64b66a2280d1da952cb8a7d6168ae32fec9b439ec61b63118a77cd264198b WatchSource:0}: Error finding container 05b64b66a2280d1da952cb8a7d6168ae32fec9b439ec61b63118a77cd264198b: Status 404 returned error can't find the container with id 05b64b66a2280d1da952cb8a7d6168ae32fec9b439ec61b63118a77cd264198b Apr 24 21:16:37.242069 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:37.242034 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/29637be2-89a9-414b-81e0-8c4ebdda7fe0-metrics-certs\") pod \"network-metrics-daemon-qvphd\" (UID: \"29637be2-89a9-414b-81e0-8c4ebdda7fe0\") " pod="openshift-multus/network-metrics-daemon-qvphd" Apr 24 21:16:37.242220 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:37.242165 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Apr 24 21:16:37.242275 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:37.242223 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29637be2-89a9-414b-81e0-8c4ebdda7fe0-metrics-certs podName:29637be2-89a9-414b-81e0-8c4ebdda7fe0 nodeName:}" failed. No retries permitted until 2026-04-24 21:16:38.242205569 +0000 UTC m=+3.104930642 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/29637be2-89a9-414b-81e0-8c4ebdda7fe0-metrics-certs") pod "network-metrics-daemon-qvphd" (UID: "29637be2-89a9-414b-81e0-8c4ebdda7fe0") : object "openshift-multus"/"metrics-daemon-secret" not registered Apr 24 21:16:37.343391 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:37.342807 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qdn2f\" (UniqueName: \"kubernetes.io/projected/b98dea0d-9954-40bd-a46c-865213211e17-kube-api-access-qdn2f\") pod \"network-check-target-s9p7t\" (UID: \"b98dea0d-9954-40bd-a46c-865213211e17\") " pod="openshift-network-diagnostics/network-check-target-s9p7t" Apr 24 21:16:37.343391 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:37.342955 2579 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Apr 24 21:16:37.343391 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:37.342977 2579 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Apr 24 21:16:37.343391 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:37.342989 2579 projected.go:194] Error preparing data for projected volume kube-api-access-qdn2f for pod openshift-network-diagnostics/network-check-target-s9p7t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 24 21:16:37.343391 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:37.343052 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b98dea0d-9954-40bd-a46c-865213211e17-kube-api-access-qdn2f podName:b98dea0d-9954-40bd-a46c-865213211e17 nodeName:}" failed. No retries permitted until 2026-04-24 21:16:38.343032743 +0000 UTC m=+3.205757812 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-qdn2f" (UniqueName: "kubernetes.io/projected/b98dea0d-9954-40bd-a46c-865213211e17-kube-api-access-qdn2f") pod "network-check-target-s9p7t" (UID: "b98dea0d-9954-40bd-a46c-865213211e17") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 24 21:16:37.461894 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:37.461862 2579 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Apr 24 21:16:37.676471 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:37.676373 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-04-23 21:11:36 +0000 UTC" deadline="2027-10-08 23:40:36.009644353 +0000 UTC" Apr 24 21:16:37.676471 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:37.676407 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12770h23m58.333242379s" Apr 24 21:16:37.764299 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:37.763841 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvphd" Apr 24 21:16:37.764299 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:37.763970 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvphd" podUID="29637be2-89a9-414b-81e0-8c4ebdda7fe0" Apr 24 21:16:37.786560 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:37.786364 2579 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Apr 24 21:16:37.787610 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:37.787543 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sz2jd" event={"ID":"1f929846-6c97-466b-9af3-7a619ca05ce6","Type":"ContainerStarted","Data":"62b9a327f6374ab109499f2aabbc337c7be9e9716137e8ecb8936af816607fbd"} Apr 24 21:16:37.798527 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:37.798479 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7mrlq" event={"ID":"9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4","Type":"ContainerStarted","Data":"f1c8d4b30c18b2ea541916ba0bb96d0fb19ea79b25258ac5e11d2891a35a8c4d"} Apr 24 21:16:37.805264 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:37.804977 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jwzsk" event={"ID":"1d4e12bc-30b8-4123-b939-ae3d8fa15235","Type":"ContainerStarted","Data":"301d702c2789b0d1134d76411e04e596f81f5c58c92546fd0d92ebc7d1052989"} Apr 24 21:16:37.810008 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:37.809967 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rrmd6" event={"ID":"452067fc-581a-48e2-876d-0b6afa08e24b","Type":"ContainerStarted","Data":"ed367284de615c8918396929ef2bde6223377eab4918f800a5f236c07462435a"} Apr 24 21:16:37.811836 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:37.811811 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" event={"ID":"d1e4bd81-6e20-4f1b-b9d3-28105e397f45","Type":"ContainerStarted","Data":"8324b781fb78745d8f6b0b9bed5d65de04064305abbb43b73a9349a48f0858d7"} Apr 24 21:16:37.814039 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:37.814013 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ks7fr" event={"ID":"42cf6af5-0cd5-4da4-876e-4b7ee6eaf49e","Type":"ContainerStarted","Data":"b5d540ab099457ba4774cba1de39102f8ea7898ba29962f3fca356ac7958a963"} Apr 24 21:16:37.822139 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:37.822072 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wglcz" event={"ID":"215d3361-bff8-4125-b4d2-ed78b228872a","Type":"ContainerStarted","Data":"05b64b66a2280d1da952cb8a7d6168ae32fec9b439ec61b63118a77cd264198b"} Apr 24 21:16:37.842358 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:37.841288 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fs6j" event={"ID":"59d17f67-9ef1-438a-b6aa-86d8f1ce1dd0","Type":"ContainerStarted","Data":"31c90006782db32608291be53002ab8f57ee6960f0c49173275253cf153fcba5"} Apr 24 21:16:37.852362 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:37.850263 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6wpnd" event={"ID":"6186d834-bc6e-496f-b37d-1bf65365610b","Type":"ContainerStarted","Data":"1e2c4bee73a88a679da04efd71c5817412aa5242e9760fad9f33f755078d5d0a"} Apr 24 21:16:38.254430 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:38.254366 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/29637be2-89a9-414b-81e0-8c4ebdda7fe0-metrics-certs\") pod \"network-metrics-daemon-qvphd\" (UID: \"29637be2-89a9-414b-81e0-8c4ebdda7fe0\") " pod="openshift-multus/network-metrics-daemon-qvphd" Apr 24 21:16:38.254615 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:38.254529 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Apr 24 21:16:38.254615 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:38.254590 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29637be2-89a9-414b-81e0-8c4ebdda7fe0-metrics-certs podName:29637be2-89a9-414b-81e0-8c4ebdda7fe0 nodeName:}" failed. No retries permitted until 2026-04-24 21:16:40.25457146 +0000 UTC m=+5.117296530 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/29637be2-89a9-414b-81e0-8c4ebdda7fe0-metrics-certs") pod "network-metrics-daemon-qvphd" (UID: "29637be2-89a9-414b-81e0-8c4ebdda7fe0") : object "openshift-multus"/"metrics-daemon-secret" not registered Apr 24 21:16:38.355689 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:38.355657 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qdn2f\" (UniqueName: \"kubernetes.io/projected/b98dea0d-9954-40bd-a46c-865213211e17-kube-api-access-qdn2f\") pod \"network-check-target-s9p7t\" (UID: \"b98dea0d-9954-40bd-a46c-865213211e17\") " pod="openshift-network-diagnostics/network-check-target-s9p7t" Apr 24 21:16:38.355892 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:38.355811 2579 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Apr 24 21:16:38.355892 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:38.355837 2579 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Apr 24 21:16:38.355892 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:38.355851 2579 projected.go:194] Error preparing data for projected volume kube-api-access-qdn2f for pod openshift-network-diagnostics/network-check-target-s9p7t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 24 21:16:38.356064 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:38.355910 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b98dea0d-9954-40bd-a46c-865213211e17-kube-api-access-qdn2f podName:b98dea0d-9954-40bd-a46c-865213211e17 nodeName:}" failed. No retries permitted until 2026-04-24 21:16:40.355892394 +0000 UTC m=+5.218617462 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-qdn2f" (UniqueName: "kubernetes.io/projected/b98dea0d-9954-40bd-a46c-865213211e17-kube-api-access-qdn2f") pod "network-check-target-s9p7t" (UID: "b98dea0d-9954-40bd-a46c-865213211e17") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 24 21:16:38.677531 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:38.677461 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-04-23 21:11:36 +0000 UTC" deadline="2028-01-31 11:39:31.663673426 +0000 UTC" Apr 24 21:16:38.677531 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:38.677497 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15518h22m52.986179754s" Apr 24 21:16:38.764704 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:38.764220 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s9p7t" Apr 24 21:16:38.764704 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:38.764358 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s9p7t" podUID="b98dea0d-9954-40bd-a46c-865213211e17" Apr 24 21:16:39.766446 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:39.766415 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvphd" Apr 24 21:16:39.766901 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:39.766555 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvphd" podUID="29637be2-89a9-414b-81e0-8c4ebdda7fe0" Apr 24 21:16:40.272460 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:40.271877 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/29637be2-89a9-414b-81e0-8c4ebdda7fe0-metrics-certs\") pod \"network-metrics-daemon-qvphd\" (UID: \"29637be2-89a9-414b-81e0-8c4ebdda7fe0\") " pod="openshift-multus/network-metrics-daemon-qvphd" Apr 24 21:16:40.272460 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:40.272044 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Apr 24 21:16:40.272460 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:40.272115 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29637be2-89a9-414b-81e0-8c4ebdda7fe0-metrics-certs podName:29637be2-89a9-414b-81e0-8c4ebdda7fe0 nodeName:}" failed. No retries permitted until 2026-04-24 21:16:44.272094948 +0000 UTC m=+9.134820016 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/29637be2-89a9-414b-81e0-8c4ebdda7fe0-metrics-certs") pod "network-metrics-daemon-qvphd" (UID: "29637be2-89a9-414b-81e0-8c4ebdda7fe0") : object "openshift-multus"/"metrics-daemon-secret" not registered Apr 24 21:16:40.373013 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:40.372973 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qdn2f\" (UniqueName: \"kubernetes.io/projected/b98dea0d-9954-40bd-a46c-865213211e17-kube-api-access-qdn2f\") pod \"network-check-target-s9p7t\" (UID: \"b98dea0d-9954-40bd-a46c-865213211e17\") " pod="openshift-network-diagnostics/network-check-target-s9p7t" Apr 24 21:16:40.373222 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:40.373203 2579 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Apr 24 21:16:40.373283 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:40.373230 2579 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Apr 24 21:16:40.373283 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:40.373243 2579 projected.go:194] Error preparing data for projected volume kube-api-access-qdn2f for pod openshift-network-diagnostics/network-check-target-s9p7t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 24 21:16:40.373407 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:40.373300 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b98dea0d-9954-40bd-a46c-865213211e17-kube-api-access-qdn2f podName:b98dea0d-9954-40bd-a46c-865213211e17 nodeName:}" failed. No retries permitted until 2026-04-24 21:16:44.373283053 +0000 UTC m=+9.236008123 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-qdn2f" (UniqueName: "kubernetes.io/projected/b98dea0d-9954-40bd-a46c-865213211e17-kube-api-access-qdn2f") pod "network-check-target-s9p7t" (UID: "b98dea0d-9954-40bd-a46c-865213211e17") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 24 21:16:40.764401 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:40.763902 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s9p7t" Apr 24 21:16:40.764401 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:40.764031 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s9p7t" podUID="b98dea0d-9954-40bd-a46c-865213211e17" Apr 24 21:16:41.765127 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:41.764722 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvphd" Apr 24 21:16:41.765127 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:41.764850 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvphd" podUID="29637be2-89a9-414b-81e0-8c4ebdda7fe0" Apr 24 21:16:42.764038 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:42.764002 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s9p7t" Apr 24 21:16:42.764191 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:42.764102 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s9p7t" podUID="b98dea0d-9954-40bd-a46c-865213211e17" Apr 24 21:16:43.765544 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:43.765506 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvphd" Apr 24 21:16:43.766017 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:43.765642 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvphd" podUID="29637be2-89a9-414b-81e0-8c4ebdda7fe0" Apr 24 21:16:44.307709 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:44.307672 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/29637be2-89a9-414b-81e0-8c4ebdda7fe0-metrics-certs\") pod \"network-metrics-daemon-qvphd\" (UID: \"29637be2-89a9-414b-81e0-8c4ebdda7fe0\") " pod="openshift-multus/network-metrics-daemon-qvphd" Apr 24 21:16:44.307881 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:44.307842 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Apr 24 21:16:44.307927 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:44.307906 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29637be2-89a9-414b-81e0-8c4ebdda7fe0-metrics-certs podName:29637be2-89a9-414b-81e0-8c4ebdda7fe0 nodeName:}" failed. No retries permitted until 2026-04-24 21:16:52.30788544 +0000 UTC m=+17.170610526 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/29637be2-89a9-414b-81e0-8c4ebdda7fe0-metrics-certs") pod "network-metrics-daemon-qvphd" (UID: "29637be2-89a9-414b-81e0-8c4ebdda7fe0") : object "openshift-multus"/"metrics-daemon-secret" not registered Apr 24 21:16:44.408622 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:44.408581 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qdn2f\" (UniqueName: \"kubernetes.io/projected/b98dea0d-9954-40bd-a46c-865213211e17-kube-api-access-qdn2f\") pod \"network-check-target-s9p7t\" (UID: \"b98dea0d-9954-40bd-a46c-865213211e17\") " pod="openshift-network-diagnostics/network-check-target-s9p7t" Apr 24 21:16:44.408783 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:44.408746 2579 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Apr 24 21:16:44.408783 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:44.408761 2579 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Apr 24 21:16:44.408783 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:44.408770 2579 projected.go:194] Error preparing data for projected volume kube-api-access-qdn2f for pod openshift-network-diagnostics/network-check-target-s9p7t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 24 21:16:44.408935 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:44.408812 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b98dea0d-9954-40bd-a46c-865213211e17-kube-api-access-qdn2f podName:b98dea0d-9954-40bd-a46c-865213211e17 nodeName:}" failed. No retries permitted until 2026-04-24 21:16:52.408798616 +0000 UTC m=+17.271523679 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-qdn2f" (UniqueName: "kubernetes.io/projected/b98dea0d-9954-40bd-a46c-865213211e17-kube-api-access-qdn2f") pod "network-check-target-s9p7t" (UID: "b98dea0d-9954-40bd-a46c-865213211e17") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 24 21:16:44.764663 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:44.764624 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s9p7t" Apr 24 21:16:44.764841 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:44.764750 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s9p7t" podUID="b98dea0d-9954-40bd-a46c-865213211e17" Apr 24 21:16:45.765202 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:45.765170 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvphd" Apr 24 21:16:45.765624 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:45.765277 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvphd" podUID="29637be2-89a9-414b-81e0-8c4ebdda7fe0" Apr 24 21:16:46.763768 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:46.763726 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s9p7t" Apr 24 21:16:46.763937 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:46.763867 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s9p7t" podUID="b98dea0d-9954-40bd-a46c-865213211e17" Apr 24 21:16:47.764757 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:47.764721 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvphd" Apr 24 21:16:47.765174 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:47.764844 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvphd" podUID="29637be2-89a9-414b-81e0-8c4ebdda7fe0" Apr 24 21:16:48.764525 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:48.764490 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s9p7t" Apr 24 21:16:48.764687 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:48.764604 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s9p7t" podUID="b98dea0d-9954-40bd-a46c-865213211e17" Apr 24 21:16:49.764447 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:49.764415 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvphd" Apr 24 21:16:49.764892 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:49.764555 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvphd" podUID="29637be2-89a9-414b-81e0-8c4ebdda7fe0" Apr 24 21:16:50.764561 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:50.764524 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s9p7t" Apr 24 21:16:50.764914 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:50.764629 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s9p7t" podUID="b98dea0d-9954-40bd-a46c-865213211e17" Apr 24 21:16:51.764119 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:51.763914 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvphd" Apr 24 21:16:51.764290 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:51.764226 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvphd" podUID="29637be2-89a9-414b-81e0-8c4ebdda7fe0" Apr 24 21:16:52.364001 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:52.363952 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/29637be2-89a9-414b-81e0-8c4ebdda7fe0-metrics-certs\") pod \"network-metrics-daemon-qvphd\" (UID: \"29637be2-89a9-414b-81e0-8c4ebdda7fe0\") " pod="openshift-multus/network-metrics-daemon-qvphd" Apr 24 21:16:52.364513 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:52.364110 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Apr 24 21:16:52.364513 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:52.364180 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29637be2-89a9-414b-81e0-8c4ebdda7fe0-metrics-certs podName:29637be2-89a9-414b-81e0-8c4ebdda7fe0 nodeName:}" failed. No retries permitted until 2026-04-24 21:17:08.364164685 +0000 UTC m=+33.226889748 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/29637be2-89a9-414b-81e0-8c4ebdda7fe0-metrics-certs") pod "network-metrics-daemon-qvphd" (UID: "29637be2-89a9-414b-81e0-8c4ebdda7fe0") : object "openshift-multus"/"metrics-daemon-secret" not registered Apr 24 21:16:52.464540 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:52.464498 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qdn2f\" (UniqueName: \"kubernetes.io/projected/b98dea0d-9954-40bd-a46c-865213211e17-kube-api-access-qdn2f\") pod \"network-check-target-s9p7t\" (UID: \"b98dea0d-9954-40bd-a46c-865213211e17\") " pod="openshift-network-diagnostics/network-check-target-s9p7t" Apr 24 21:16:52.464736 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:52.464650 2579 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Apr 24 21:16:52.464736 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:52.464678 2579 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Apr 24 21:16:52.464736 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:52.464693 2579 projected.go:194] Error preparing data for projected volume kube-api-access-qdn2f for pod openshift-network-diagnostics/network-check-target-s9p7t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 24 21:16:52.464884 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:52.464760 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b98dea0d-9954-40bd-a46c-865213211e17-kube-api-access-qdn2f podName:b98dea0d-9954-40bd-a46c-865213211e17 nodeName:}" failed. No retries permitted until 2026-04-24 21:17:08.46474098 +0000 UTC m=+33.327466046 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-qdn2f" (UniqueName: "kubernetes.io/projected/b98dea0d-9954-40bd-a46c-865213211e17-kube-api-access-qdn2f") pod "network-check-target-s9p7t" (UID: "b98dea0d-9954-40bd-a46c-865213211e17") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 24 21:16:52.763894 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:52.763857 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s9p7t" Apr 24 21:16:52.764075 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:52.763990 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s9p7t" podUID="b98dea0d-9954-40bd-a46c-865213211e17" Apr 24 21:16:53.764330 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:53.764293 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvphd" Apr 24 21:16:53.764861 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:53.764447 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvphd" podUID="29637be2-89a9-414b-81e0-8c4ebdda7fe0" Apr 24 21:16:54.764783 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:54.764661 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s9p7t" Apr 24 21:16:54.765186 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:54.764791 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s9p7t" podUID="b98dea0d-9954-40bd-a46c-865213211e17" Apr 24 21:16:54.887118 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:54.887088 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-241.ec2.internal" event={"ID":"228671878d0b972ea78e6fdc693250e2","Type":"ContainerStarted","Data":"727bbb6fd8955c367faad30bc62a19c36c139c6b63977edefdab334f31eece72"} Apr 24 21:16:54.902175 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:54.902121 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-241.ec2.internal" podStartSLOduration=18.902102339 podStartE2EDuration="18.902102339s" podCreationTimestamp="2026-04-24 21:16:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-24 21:16:54.9016913 +0000 UTC m=+19.764416400" watchObservedRunningTime="2026-04-24 21:16:54.902102339 +0000 UTC m=+19.764827425" Apr 24 21:16:55.764410 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:55.764383 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvphd" Apr 24 21:16:55.764541 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:55.764505 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvphd" podUID="29637be2-89a9-414b-81e0-8c4ebdda7fe0" Apr 24 21:16:55.889611 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:55.889577 2579 generic.go:358] "Generic (PLEG): container finished" podID="be385a9504d9f95a413d90b1b4793a62" containerID="27f6687bfa799ddde80bf4376bf7831c044f45bbf4c9b313665668afaef56111" exitCode=0 Apr 24 21:16:55.890271 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:55.889648 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-241.ec2.internal" event={"ID":"be385a9504d9f95a413d90b1b4793a62","Type":"ContainerDied","Data":"27f6687bfa799ddde80bf4376bf7831c044f45bbf4c9b313665668afaef56111"} Apr 24 21:16:55.891188 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:55.890972 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sz2jd" event={"ID":"1f929846-6c97-466b-9af3-7a619ca05ce6","Type":"ContainerStarted","Data":"ffe25667354763fe9aca6b56e5143743563ac1aa64582d9ebed21580ad5dc556"} Apr 24 21:16:55.892257 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:55.892223 2579 generic.go:358] "Generic (PLEG): container finished" podID="9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4" containerID="b09f16e3884cb38bcb6193b0967a090ed33cb4c651d3b4a6bc6e7010f8d6920b" exitCode=0 Apr 24 21:16:55.892377 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:55.892280 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7mrlq" event={"ID":"9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4","Type":"ContainerDied","Data":"b09f16e3884cb38bcb6193b0967a090ed33cb4c651d3b4a6bc6e7010f8d6920b"} Apr 24 21:16:55.893497 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:55.893456 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jwzsk" event={"ID":"1d4e12bc-30b8-4123-b939-ae3d8fa15235","Type":"ContainerStarted","Data":"eb3704a9a75daf2cdecc2c50acb5924783e8bca6abcef5d021e2a8daf2a9fb72"} Apr 24 21:16:55.894787 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:55.894695 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rrmd6" event={"ID":"452067fc-581a-48e2-876d-0b6afa08e24b","Type":"ContainerStarted","Data":"cafa7170d694f5e927a7a3b9005ae13d7810af8b199fa1af627a2bb7e41da29b"} Apr 24 21:16:55.897199 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:55.897180 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" event={"ID":"d1e4bd81-6e20-4f1b-b9d3-28105e397f45","Type":"ContainerStarted","Data":"65091526aca856592ac00dd6378bf655e1d1f465a48de97f63f80a0d0148f61a"} Apr 24 21:16:55.897302 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:55.897203 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" event={"ID":"d1e4bd81-6e20-4f1b-b9d3-28105e397f45","Type":"ContainerStarted","Data":"c27fa2d39c725fbabac9ffeee98ce729f81e3bbb76b6aadc21be14519490ef84"} Apr 24 21:16:55.897302 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:55.897213 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" event={"ID":"d1e4bd81-6e20-4f1b-b9d3-28105e397f45","Type":"ContainerStarted","Data":"5e5d56b5c4fc674e8264c782be96b85a06df626d019f3d285300ab85297df5d7"} Apr 24 21:16:55.897302 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:55.897222 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" event={"ID":"d1e4bd81-6e20-4f1b-b9d3-28105e397f45","Type":"ContainerStarted","Data":"20d3a35a604b0d9795355a7cf60fc4fcbaf9f8d5c7cfc9c8a3f2ef0a771b35a9"} Apr 24 21:16:55.897302 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:55.897234 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" event={"ID":"d1e4bd81-6e20-4f1b-b9d3-28105e397f45","Type":"ContainerStarted","Data":"c8181746686ed4d8bc613a4c989c3f77c6c0fcc62d50f05af85ad2241d43c26f"} Apr 24 21:16:55.897302 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:55.897243 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" event={"ID":"d1e4bd81-6e20-4f1b-b9d3-28105e397f45","Type":"ContainerStarted","Data":"1dafd3baede2e1fac8ebea71d457bebb4b89527ed2d739a88f03553d822f0504"} Apr 24 21:16:55.898388 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:55.898366 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wglcz" event={"ID":"215d3361-bff8-4125-b4d2-ed78b228872a","Type":"ContainerStarted","Data":"c3384822c32098a2939d721ae74d900137aedbfb238fc58a1e177b45b9076c4f"} Apr 24 21:16:55.899474 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:55.899456 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fs6j" event={"ID":"59d17f67-9ef1-438a-b6aa-86d8f1ce1dd0","Type":"ContainerStarted","Data":"a6cfb4c06aae1ec0e5a8ddd28072e26871043d606842a1e756213d26836f64ab"} Apr 24 21:16:55.900528 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:55.900508 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6wpnd" event={"ID":"6186d834-bc6e-496f-b37d-1bf65365610b","Type":"ContainerStarted","Data":"3f3ba46de4783e4cc2743ec00f44a3fa1f73a1a485d19d160e6005b8f73859d4"} Apr 24 21:16:55.924228 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:55.924176 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-rrmd6" podStartSLOduration=3.464245885 podStartE2EDuration="20.924160801s" podCreationTimestamp="2026-04-24 21:16:35 +0000 UTC" firstStartedPulling="2026-04-24 21:16:37.004136413 +0000 UTC m=+1.866861476" lastFinishedPulling="2026-04-24 21:16:54.464051328 +0000 UTC m=+19.326776392" observedRunningTime="2026-04-24 21:16:55.923653648 +0000 UTC m=+20.786378733" watchObservedRunningTime="2026-04-24 21:16:55.924160801 +0000 UTC m=+20.786885886" Apr 24 21:16:55.941817 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:55.941769 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-jwzsk" podStartSLOduration=3.430709607 podStartE2EDuration="20.941753896s" podCreationTimestamp="2026-04-24 21:16:35 +0000 UTC" firstStartedPulling="2026-04-24 21:16:37.009643745 +0000 UTC m=+1.872368808" lastFinishedPulling="2026-04-24 21:16:54.520688034 +0000 UTC m=+19.383413097" observedRunningTime="2026-04-24 21:16:55.941012126 +0000 UTC m=+20.803737212" watchObservedRunningTime="2026-04-24 21:16:55.941753896 +0000 UTC m=+20.804478982" Apr 24 21:16:55.959999 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:55.959917 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-rrmd6" Apr 24 21:16:56.022911 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:56.022872 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-sz2jd" podStartSLOduration=3.535045996 podStartE2EDuration="21.02285882s" podCreationTimestamp="2026-04-24 21:16:35 +0000 UTC" firstStartedPulling="2026-04-24 21:16:37.030687738 +0000 UTC m=+1.893412806" lastFinishedPulling="2026-04-24 21:16:54.518500554 +0000 UTC m=+19.381225630" observedRunningTime="2026-04-24 21:16:56.021660495 +0000 UTC m=+20.884385579" watchObservedRunningTime="2026-04-24 21:16:56.02285882 +0000 UTC m=+20.885583905" Apr 24 21:16:56.080258 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:56.080212 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-6wpnd" podStartSLOduration=3.579063985 podStartE2EDuration="21.080197475s" podCreationTimestamp="2026-04-24 21:16:35 +0000 UTC" firstStartedPulling="2026-04-24 21:16:37.015838259 +0000 UTC m=+1.878563322" lastFinishedPulling="2026-04-24 21:16:54.516971732 +0000 UTC m=+19.379696812" observedRunningTime="2026-04-24 21:16:56.051204204 +0000 UTC m=+20.913929288" watchObservedRunningTime="2026-04-24 21:16:56.080197475 +0000 UTC m=+20.942922560" Apr 24 21:16:56.689255 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:56.689221 2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-rrmd6" Apr 24 21:16:56.689886 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:56.689859 2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-rrmd6" Apr 24 21:16:56.714402 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:56.714321 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wglcz" podStartSLOduration=4.285767838 podStartE2EDuration="21.71430119s" podCreationTimestamp="2026-04-24 21:16:35 +0000 UTC" firstStartedPulling="2026-04-24 21:16:37.034916287 +0000 UTC m=+1.897641350" lastFinishedPulling="2026-04-24 21:16:54.463449632 +0000 UTC m=+19.326174702" observedRunningTime="2026-04-24 21:16:56.080619512 +0000 UTC m=+20.943344609" watchObservedRunningTime="2026-04-24 21:16:56.71430119 +0000 UTC m=+21.577026277" Apr 24 21:16:56.764362 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:56.764322 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s9p7t" Apr 24 21:16:56.764565 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:56.764429 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s9p7t" podUID="b98dea0d-9954-40bd-a46c-865213211e17" Apr 24 21:16:56.838466 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:56.838423 2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Apr 24 21:16:56.903845 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:56.903811 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-241.ec2.internal" event={"ID":"be385a9504d9f95a413d90b1b4793a62","Type":"ContainerStarted","Data":"2e92ea92625602f011e18b554eade8c00840144dc9c46dd739c22f553aef09cb"} Apr 24 21:16:56.905875 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:56.905833 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ks7fr" event={"ID":"42cf6af5-0cd5-4da4-876e-4b7ee6eaf49e","Type":"ContainerStarted","Data":"eab058f311f81ba5f1d7ecaf332bcf1ea33eccc417556457ce38809bada7300e"} Apr 24 21:16:56.907662 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:56.907640 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fs6j" event={"ID":"59d17f67-9ef1-438a-b6aa-86d8f1ce1dd0","Type":"ContainerStarted","Data":"b78d5a6be337d76e409af1d3c1972baf6fbfdd755ab92f87f29a7fcfec917577"} Apr 24 21:16:56.908361 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:56.908322 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-rrmd6" Apr 24 21:16:56.941107 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:56.941016 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-241.ec2.internal" podStartSLOduration=20.940997456 podStartE2EDuration="20.940997456s" podCreationTimestamp="2026-04-24 21:16:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-24 21:16:56.920788119 +0000 UTC m=+21.783513204" watchObservedRunningTime="2026-04-24 21:16:56.940997456 +0000 UTC m=+21.803722542" Apr 24 21:16:56.941499 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:56.941453 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-ks7fr" podStartSLOduration=4.444486509 podStartE2EDuration="21.941442284s" podCreationTimestamp="2026-04-24 21:16:35 +0000 UTC" firstStartedPulling="2026-04-24 21:16:36.966465657 +0000 UTC m=+1.829190720" lastFinishedPulling="2026-04-24 21:16:54.46342142 +0000 UTC m=+19.326146495" observedRunningTime="2026-04-24 21:16:56.940915633 +0000 UTC m=+21.803640721" watchObservedRunningTime="2026-04-24 21:16:56.941442284 +0000 UTC m=+21.804167369" Apr 24 21:16:57.697564 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:57.697185 2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-04-24T21:16:56.838448974Z","UUID":"1c215b79-fa72-40d2-b0d3-9805daedba72","Handler":null,"Name":"","Endpoint":""} Apr 24 21:16:57.699685 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:57.699654 2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Apr 24 21:16:57.699685 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:57.699691 2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Apr 24 21:16:57.765435 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:57.765397 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvphd" Apr 24 21:16:57.765724 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:57.765700 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvphd" podUID="29637be2-89a9-414b-81e0-8c4ebdda7fe0" Apr 24 21:16:57.911971 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:57.911927 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fs6j" event={"ID":"59d17f67-9ef1-438a-b6aa-86d8f1ce1dd0","Type":"ContainerStarted","Data":"147bf7f7e5de7d61b595b8e4a0f09ff8787d4eab94119e175eb3a01db4d0ed62"} Apr 24 21:16:57.915027 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:57.914997 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" event={"ID":"d1e4bd81-6e20-4f1b-b9d3-28105e397f45","Type":"ContainerStarted","Data":"a5e9842a7e3c0e11c98c9eef8673706fd9547d4b21af2dd86bba1455366db5e0"} Apr 24 21:16:58.764441 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:58.764400 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s9p7t" Apr 24 21:16:58.764667 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:58.764540 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s9p7t" podUID="b98dea0d-9954-40bd-a46c-865213211e17" Apr 24 21:16:59.764737 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:59.764704 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvphd" Apr 24 21:16:59.765093 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:16:59.764808 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvphd" podUID="29637be2-89a9-414b-81e0-8c4ebdda7fe0" Apr 24 21:16:59.923567 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:59.923118 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" event={"ID":"d1e4bd81-6e20-4f1b-b9d3-28105e397f45","Type":"ContainerStarted","Data":"85f093e1ec1e08bb5101f93dba98d976e5dc6d24b3608e0c4303082a34c74a9b"} Apr 24 21:16:59.923567 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:59.923322 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" Apr 24 21:16:59.923567 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:59.923356 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" Apr 24 21:16:59.923567 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:59.923371 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" Apr 24 21:16:59.950989 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:59.950968 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" Apr 24 21:16:59.952206 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:59.952011 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fs6j" podStartSLOduration=4.361816274 podStartE2EDuration="24.951994334s" podCreationTimestamp="2026-04-24 21:16:35 +0000 UTC" firstStartedPulling="2026-04-24 21:16:37.027106169 +0000 UTC m=+1.889831232" lastFinishedPulling="2026-04-24 21:16:57.617284223 +0000 UTC m=+22.480009292" observedRunningTime="2026-04-24 21:16:57.93825131 +0000 UTC m=+22.800976395" watchObservedRunningTime="2026-04-24 21:16:59.951994334 +0000 UTC m=+24.814719421" Apr 24 21:16:59.952519 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:59.952204 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" Apr 24 21:16:59.952519 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:16:59.952370 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" podStartSLOduration=6.797752578 podStartE2EDuration="24.95232505s" podCreationTimestamp="2026-04-24 21:16:35 +0000 UTC" firstStartedPulling="2026-04-24 21:16:36.985053403 +0000 UTC m=+1.847778469" lastFinishedPulling="2026-04-24 21:16:55.139625874 +0000 UTC m=+20.002350941" observedRunningTime="2026-04-24 21:16:59.951896018 +0000 UTC m=+24.814621103" watchObservedRunningTime="2026-04-24 21:16:59.95232505 +0000 UTC m=+24.815050135" Apr 24 21:17:00.764661 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:00.764633 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s9p7t" Apr 24 21:17:00.764823 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:17:00.764750 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s9p7t" podUID="b98dea0d-9954-40bd-a46c-865213211e17" Apr 24 21:17:00.925935 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:00.925903 2579 generic.go:358] "Generic (PLEG): container finished" podID="9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4" containerID="a7eb30c977cc283294ea7f8a3d592b99a17628767eeab00899d44757b38960b2" exitCode=0 Apr 24 21:17:00.926066 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:00.925993 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7mrlq" event={"ID":"9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4","Type":"ContainerDied","Data":"a7eb30c977cc283294ea7f8a3d592b99a17628767eeab00899d44757b38960b2"} Apr 24 21:17:01.764267 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:01.764100 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvphd" Apr 24 21:17:01.764444 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:17:01.764379 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvphd" podUID="29637be2-89a9-414b-81e0-8c4ebdda7fe0" Apr 24 21:17:01.800611 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:01.800512 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qvphd"] Apr 24 21:17:01.803208 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:01.803186 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-s9p7t"] Apr 24 21:17:01.803301 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:01.803290 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s9p7t" Apr 24 21:17:01.803404 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:17:01.803387 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s9p7t" podUID="b98dea0d-9954-40bd-a46c-865213211e17" Apr 24 21:17:01.929404 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:01.929365 2579 generic.go:358] "Generic (PLEG): container finished" podID="9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4" containerID="1e2a1b66371d21abf764008204c457ceb5aa6781613834f57dabe0a9db1a5933" exitCode=0 Apr 24 21:17:01.929570 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:01.929465 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7mrlq" event={"ID":"9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4","Type":"ContainerDied","Data":"1e2a1b66371d21abf764008204c457ceb5aa6781613834f57dabe0a9db1a5933"} Apr 24 21:17:01.929570 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:01.929500 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvphd" Apr 24 21:17:01.929636 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:17:01.929593 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvphd" podUID="29637be2-89a9-414b-81e0-8c4ebdda7fe0" Apr 24 21:17:02.858507 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:02.858435 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jwzsk_1d4e12bc-30b8-4123-b939-ae3d8fa15235/dns-node-resolver/0.log" Apr 24 21:17:02.932973 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:02.932938 2579 generic.go:358] "Generic (PLEG): container finished" podID="9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4" containerID="812752a5dade63ad1899b14fc9a10df75320ab8efef7cd16375f08eae05eb0e3" exitCode=0 Apr 24 21:17:02.933130 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:02.933005 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7mrlq" event={"ID":"9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4","Type":"ContainerDied","Data":"812752a5dade63ad1899b14fc9a10df75320ab8efef7cd16375f08eae05eb0e3"} Apr 24 21:17:03.764789 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:03.764755 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s9p7t" Apr 24 21:17:03.764976 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:17:03.764892 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s9p7t" podUID="b98dea0d-9954-40bd-a46c-865213211e17" Apr 24 21:17:03.765245 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:03.765223 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvphd" Apr 24 21:17:03.765371 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:17:03.765316 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvphd" podUID="29637be2-89a9-414b-81e0-8c4ebdda7fe0" Apr 24 21:17:03.846066 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:03.846043 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wglcz_215d3361-bff8-4125-b4d2-ed78b228872a/node-ca/0.log" Apr 24 21:17:05.765777 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:05.765746 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s9p7t" Apr 24 21:17:05.766312 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:17:05.765857 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s9p7t" podUID="b98dea0d-9954-40bd-a46c-865213211e17" Apr 24 21:17:05.766312 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:05.765913 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvphd" Apr 24 21:17:05.766312 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:17:05.766017 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvphd" podUID="29637be2-89a9-414b-81e0-8c4ebdda7fe0" Apr 24 21:17:07.763861 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:07.763832 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvphd" Apr 24 21:17:07.764231 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:07.763872 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s9p7t" Apr 24 21:17:07.764231 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:17:07.763938 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvphd" podUID="29637be2-89a9-414b-81e0-8c4ebdda7fe0" Apr 24 21:17:07.764231 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:17:07.764042 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s9p7t" podUID="b98dea0d-9954-40bd-a46c-865213211e17" Apr 24 21:17:08.372155 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:08.372123 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/29637be2-89a9-414b-81e0-8c4ebdda7fe0-metrics-certs\") pod \"network-metrics-daemon-qvphd\" (UID: \"29637be2-89a9-414b-81e0-8c4ebdda7fe0\") " pod="openshift-multus/network-metrics-daemon-qvphd" Apr 24 21:17:08.372327 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:17:08.372259 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Apr 24 21:17:08.372327 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:17:08.372321 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29637be2-89a9-414b-81e0-8c4ebdda7fe0-metrics-certs podName:29637be2-89a9-414b-81e0-8c4ebdda7fe0 nodeName:}" failed. No retries permitted until 2026-04-24 21:17:40.372302217 +0000 UTC m=+65.235027293 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/29637be2-89a9-414b-81e0-8c4ebdda7fe0-metrics-certs") pod "network-metrics-daemon-qvphd" (UID: "29637be2-89a9-414b-81e0-8c4ebdda7fe0") : object "openshift-multus"/"metrics-daemon-secret" not registered Apr 24 21:17:08.472845 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:08.472817 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qdn2f\" (UniqueName: \"kubernetes.io/projected/b98dea0d-9954-40bd-a46c-865213211e17-kube-api-access-qdn2f\") pod \"network-check-target-s9p7t\" (UID: \"b98dea0d-9954-40bd-a46c-865213211e17\") " pod="openshift-network-diagnostics/network-check-target-s9p7t" Apr 24 21:17:08.472997 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:17:08.472939 2579 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Apr 24 21:17:08.472997 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:17:08.472956 2579 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Apr 24 21:17:08.472997 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:17:08.472968 2579 projected.go:194] Error preparing data for projected volume kube-api-access-qdn2f for pod openshift-network-diagnostics/network-check-target-s9p7t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 24 21:17:08.473101 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:17:08.473014 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b98dea0d-9954-40bd-a46c-865213211e17-kube-api-access-qdn2f podName:b98dea0d-9954-40bd-a46c-865213211e17 nodeName:}" failed. No retries permitted until 2026-04-24 21:17:40.47300152 +0000 UTC m=+65.335726584 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-qdn2f" (UniqueName: "kubernetes.io/projected/b98dea0d-9954-40bd-a46c-865213211e17-kube-api-access-qdn2f") pod "network-check-target-s9p7t" (UID: "b98dea0d-9954-40bd-a46c-865213211e17") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 24 21:17:08.946934 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:08.946904 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7mrlq" event={"ID":"9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4","Type":"ContainerStarted","Data":"537bf78c3ed1f8da8892fee4b3ec32e80222706691de8529c75171ac2e27891e"} Apr 24 21:17:09.764104 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:09.764058 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvphd" Apr 24 21:17:09.764104 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:09.764093 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s9p7t" Apr 24 21:17:09.764430 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:17:09.764199 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s9p7t" podUID="b98dea0d-9954-40bd-a46c-865213211e17" Apr 24 21:17:09.764430 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:17:09.764215 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvphd" podUID="29637be2-89a9-414b-81e0-8c4ebdda7fe0" Apr 24 21:17:09.950718 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:09.950683 2579 generic.go:358] "Generic (PLEG): container finished" podID="9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4" containerID="537bf78c3ed1f8da8892fee4b3ec32e80222706691de8529c75171ac2e27891e" exitCode=0 Apr 24 21:17:09.951076 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:09.950756 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7mrlq" event={"ID":"9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4","Type":"ContainerDied","Data":"537bf78c3ed1f8da8892fee4b3ec32e80222706691de8529c75171ac2e27891e"} Apr 24 21:17:10.955665 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:10.955627 2579 generic.go:358] "Generic (PLEG): container finished" podID="9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4" containerID="b04eacc359641b03d4d55d25c26101e6ad61c4c17b62df3dd47717a76b0337bc" exitCode=0 Apr 24 21:17:10.956034 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:10.955692 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7mrlq" event={"ID":"9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4","Type":"ContainerDied","Data":"b04eacc359641b03d4d55d25c26101e6ad61c4c17b62df3dd47717a76b0337bc"} Apr 24 21:17:11.764516 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:11.764481 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s9p7t" Apr 24 21:17:11.764675 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:11.764481 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvphd" Apr 24 21:17:11.764713 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:17:11.764581 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s9p7t" podUID="b98dea0d-9954-40bd-a46c-865213211e17" Apr 24 21:17:11.764713 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:17:11.764693 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvphd" podUID="29637be2-89a9-414b-81e0-8c4ebdda7fe0" Apr 24 21:17:11.959895 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:11.959854 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7mrlq" event={"ID":"9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4","Type":"ContainerStarted","Data":"620cc3b05a5f25460fa007371c6a4765df3d1e6881da9408fc38331636906f72"} Apr 24 21:17:13.764475 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:13.764438 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s9p7t" Apr 24 21:17:13.764981 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:17:13.764558 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s9p7t" podUID="b98dea0d-9954-40bd-a46c-865213211e17" Apr 24 21:17:13.764981 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:13.764618 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvphd" Apr 24 21:17:13.764981 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:17:13.764745 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvphd" podUID="29637be2-89a9-414b-81e0-8c4ebdda7fe0" Apr 24 21:17:15.765092 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:15.765052 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s9p7t" Apr 24 21:17:15.765556 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:15.765138 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvphd" Apr 24 21:17:15.765556 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:17:15.765147 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s9p7t" podUID="b98dea0d-9954-40bd-a46c-865213211e17" Apr 24 21:17:15.765556 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:17:15.765231 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvphd" podUID="29637be2-89a9-414b-81e0-8c4ebdda7fe0" Apr 24 21:17:17.764155 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:17.764113 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s9p7t" Apr 24 21:17:17.764617 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:17.764113 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvphd" Apr 24 21:17:17.764617 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:17:17.764242 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s9p7t" podUID="b98dea0d-9954-40bd-a46c-865213211e17" Apr 24 21:17:17.764617 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:17:17.764383 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvphd" podUID="29637be2-89a9-414b-81e0-8c4ebdda7fe0" Apr 24 21:17:19.764451 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:19.764415 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s9p7t" Apr 24 21:17:19.764901 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:19.764418 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvphd" Apr 24 21:17:19.764901 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:17:19.764522 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s9p7t" podUID="b98dea0d-9954-40bd-a46c-865213211e17" Apr 24 21:17:19.764901 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:17:19.764637 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvphd" podUID="29637be2-89a9-414b-81e0-8c4ebdda7fe0" Apr 24 21:17:21.763721 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:21.763686 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s9p7t" Apr 24 21:17:21.763721 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:21.763721 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvphd" Apr 24 21:17:21.764135 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:17:21.763821 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s9p7t" podUID="b98dea0d-9954-40bd-a46c-865213211e17" Apr 24 21:17:21.764135 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:17:21.763937 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvphd" podUID="29637be2-89a9-414b-81e0-8c4ebdda7fe0" Apr 24 21:17:23.764483 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:23.764444 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s9p7t" Apr 24 21:17:23.764936 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:17:23.764561 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s9p7t" podUID="b98dea0d-9954-40bd-a46c-865213211e17" Apr 24 21:17:23.764936 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:23.764608 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvphd" Apr 24 21:17:23.764936 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:17:23.764693 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvphd" podUID="29637be2-89a9-414b-81e0-8c4ebdda7fe0" Apr 24 21:17:25.764402 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:25.764362 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvphd" Apr 24 21:17:25.764822 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:25.764407 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s9p7t" Apr 24 21:17:25.764822 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:17:25.764475 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvphd" podUID="29637be2-89a9-414b-81e0-8c4ebdda7fe0" Apr 24 21:17:25.764822 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:17:25.764617 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s9p7t" podUID="b98dea0d-9954-40bd-a46c-865213211e17" Apr 24 21:17:27.763947 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:27.763917 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s9p7t" Apr 24 21:17:27.763947 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:27.763931 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvphd" Apr 24 21:17:27.764425 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:17:27.764003 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s9p7t" podUID="b98dea0d-9954-40bd-a46c-865213211e17" Apr 24 21:17:27.764425 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:17:27.764151 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvphd" podUID="29637be2-89a9-414b-81e0-8c4ebdda7fe0" Apr 24 21:17:27.965529 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:27.965496 2579 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-241.ec2.internal" event="NodeReady" Apr 24 21:17:27.965714 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:27.965638 2579 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Apr 24 21:17:28.019736 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.019690 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7mrlq" podStartSLOduration=21.377759481 podStartE2EDuration="53.019673919s" podCreationTimestamp="2026-04-24 21:16:35 +0000 UTC" firstStartedPulling="2026-04-24 21:16:37.021283725 +0000 UTC m=+1.884008788" lastFinishedPulling="2026-04-24 21:17:08.663198149 +0000 UTC m=+33.525923226" observedRunningTime="2026-04-24 21:17:11.983137362 +0000 UTC m=+36.845862459" watchObservedRunningTime="2026-04-24 21:17:28.019673919 +0000 UTC m=+52.882399002" Apr 24 21:17:28.019963 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.019944 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hxhnc"] Apr 24 21:17:28.023377 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.023333 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-nj869"] Apr 24 21:17:28.023524 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.023504 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hxhnc" Apr 24 21:17:28.026421 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.026402 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nj869" Apr 24 21:17:28.026836 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.026817 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-86llq\"" Apr 24 21:17:28.026929 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.026909 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Apr 24 21:17:28.026929 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.026921 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Apr 24 21:17:28.029516 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.029490 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Apr 24 21:17:28.029602 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.029574 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-znhx4\"" Apr 24 21:17:28.030418 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.030109 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Apr 24 21:17:28.030418 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.030240 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Apr 24 21:17:28.039952 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.039934 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hxhnc"] Apr 24 21:17:28.044931 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.044910 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nj869"] Apr 24 21:17:28.091252 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.091223 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-qs276"] Apr 24 21:17:28.094537 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.094523 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qs276" Apr 24 21:17:28.098453 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.098432 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2bmll\"" Apr 24 21:17:28.098565 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.098548 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Apr 24 21:17:28.098809 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.098796 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Apr 24 21:17:28.098908 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.098893 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Apr 24 21:17:28.099238 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.099222 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Apr 24 21:17:28.120415 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.120389 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1603a03-2d10-41d3-bf9b-34d45b271773-tmp-dir\") pod \"dns-default-hxhnc\" (UID: \"f1603a03-2d10-41d3-bf9b-34d45b271773\") " pod="openshift-dns/dns-default-hxhnc" Apr 24 21:17:28.120575 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.120431 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f1603a03-2d10-41d3-bf9b-34d45b271773-metrics-tls\") pod \"dns-default-hxhnc\" (UID: \"f1603a03-2d10-41d3-bf9b-34d45b271773\") " pod="openshift-dns/dns-default-hxhnc" Apr 24 21:17:28.120575 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.120456 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9x8w\" (UniqueName: \"kubernetes.io/projected/403124c9-db4a-4d6b-a7b2-d59c7568de7e-kube-api-access-s9x8w\") pod \"ingress-canary-nj869\" (UID: \"403124c9-db4a-4d6b-a7b2-d59c7568de7e\") " pod="openshift-ingress-canary/ingress-canary-nj869" Apr 24 21:17:28.120575 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.120534 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f1603a03-2d10-41d3-bf9b-34d45b271773-config-volume\") pod \"dns-default-hxhnc\" (UID: \"f1603a03-2d10-41d3-bf9b-34d45b271773\") " pod="openshift-dns/dns-default-hxhnc" Apr 24 21:17:28.120701 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.120646 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/403124c9-db4a-4d6b-a7b2-d59c7568de7e-cert\") pod \"ingress-canary-nj869\" (UID: \"403124c9-db4a-4d6b-a7b2-d59c7568de7e\") " pod="openshift-ingress-canary/ingress-canary-nj869" Apr 24 21:17:28.120745 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.120718 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkrdb\" (UniqueName: \"kubernetes.io/projected/f1603a03-2d10-41d3-bf9b-34d45b271773-kube-api-access-rkrdb\") pod \"dns-default-hxhnc\" (UID: \"f1603a03-2d10-41d3-bf9b-34d45b271773\") " pod="openshift-dns/dns-default-hxhnc" Apr 24 21:17:28.123288 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.123265 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qs276"] Apr 24 21:17:28.221609 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.221519 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s9x8w\" (UniqueName: \"kubernetes.io/projected/403124c9-db4a-4d6b-a7b2-d59c7568de7e-kube-api-access-s9x8w\") pod \"ingress-canary-nj869\" (UID: \"403124c9-db4a-4d6b-a7b2-d59c7568de7e\") " pod="openshift-ingress-canary/ingress-canary-nj869" Apr 24 21:17:28.221609 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.221560 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/285b2b48-f737-45d2-80ef-45b4bc73abd2-crio-socket\") pod \"insights-runtime-extractor-qs276\" (UID: \"285b2b48-f737-45d2-80ef-45b4bc73abd2\") " pod="openshift-insights/insights-runtime-extractor-qs276" Apr 24 21:17:28.221609 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.221580 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f1603a03-2d10-41d3-bf9b-34d45b271773-config-volume\") pod \"dns-default-hxhnc\" (UID: \"f1603a03-2d10-41d3-bf9b-34d45b271773\") " pod="openshift-dns/dns-default-hxhnc" Apr 24 21:17:28.221609 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.221607 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d98c5\" (UniqueName: \"kubernetes.io/projected/285b2b48-f737-45d2-80ef-45b4bc73abd2-kube-api-access-d98c5\") pod \"insights-runtime-extractor-qs276\" (UID: \"285b2b48-f737-45d2-80ef-45b4bc73abd2\") " pod="openshift-insights/insights-runtime-extractor-qs276" Apr 24 21:17:28.221933 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.221672 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/285b2b48-f737-45d2-80ef-45b4bc73abd2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qs276\" (UID: \"285b2b48-f737-45d2-80ef-45b4bc73abd2\") " pod="openshift-insights/insights-runtime-extractor-qs276" Apr 24 21:17:28.221933 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.221704 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/285b2b48-f737-45d2-80ef-45b4bc73abd2-data-volume\") pod \"insights-runtime-extractor-qs276\" (UID: \"285b2b48-f737-45d2-80ef-45b4bc73abd2\") " pod="openshift-insights/insights-runtime-extractor-qs276" Apr 24 21:17:28.221933 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.221777 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/403124c9-db4a-4d6b-a7b2-d59c7568de7e-cert\") pod \"ingress-canary-nj869\" (UID: \"403124c9-db4a-4d6b-a7b2-d59c7568de7e\") " pod="openshift-ingress-canary/ingress-canary-nj869" Apr 24 21:17:28.221933 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.221821 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rkrdb\" (UniqueName: \"kubernetes.io/projected/f1603a03-2d10-41d3-bf9b-34d45b271773-kube-api-access-rkrdb\") pod \"dns-default-hxhnc\" (UID: \"f1603a03-2d10-41d3-bf9b-34d45b271773\") " pod="openshift-dns/dns-default-hxhnc" Apr 24 21:17:28.221933 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.221875 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1603a03-2d10-41d3-bf9b-34d45b271773-tmp-dir\") pod \"dns-default-hxhnc\" (UID: \"f1603a03-2d10-41d3-bf9b-34d45b271773\") " pod="openshift-dns/dns-default-hxhnc" Apr 24 21:17:28.222161 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.221998 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/285b2b48-f737-45d2-80ef-45b4bc73abd2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qs276\" (UID: \"285b2b48-f737-45d2-80ef-45b4bc73abd2\") " pod="openshift-insights/insights-runtime-extractor-qs276" Apr 24 21:17:28.222161 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.222040 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f1603a03-2d10-41d3-bf9b-34d45b271773-metrics-tls\") pod \"dns-default-hxhnc\" (UID: \"f1603a03-2d10-41d3-bf9b-34d45b271773\") " pod="openshift-dns/dns-default-hxhnc" Apr 24 21:17:28.222249 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.222172 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f1603a03-2d10-41d3-bf9b-34d45b271773-config-volume\") pod \"dns-default-hxhnc\" (UID: \"f1603a03-2d10-41d3-bf9b-34d45b271773\") " pod="openshift-dns/dns-default-hxhnc" Apr 24 21:17:28.222249 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.222186 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1603a03-2d10-41d3-bf9b-34d45b271773-tmp-dir\") pod \"dns-default-hxhnc\" (UID: \"f1603a03-2d10-41d3-bf9b-34d45b271773\") " pod="openshift-dns/dns-default-hxhnc" Apr 24 21:17:28.225693 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.225669 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f1603a03-2d10-41d3-bf9b-34d45b271773-metrics-tls\") pod \"dns-default-hxhnc\" (UID: \"f1603a03-2d10-41d3-bf9b-34d45b271773\") " pod="openshift-dns/dns-default-hxhnc" Apr 24 21:17:28.225985 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.225965 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/403124c9-db4a-4d6b-a7b2-d59c7568de7e-cert\") pod \"ingress-canary-nj869\" (UID: \"403124c9-db4a-4d6b-a7b2-d59c7568de7e\") " pod="openshift-ingress-canary/ingress-canary-nj869" Apr 24 21:17:28.233668 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.233644 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkrdb\" (UniqueName: \"kubernetes.io/projected/f1603a03-2d10-41d3-bf9b-34d45b271773-kube-api-access-rkrdb\") pod \"dns-default-hxhnc\" (UID: \"f1603a03-2d10-41d3-bf9b-34d45b271773\") " pod="openshift-dns/dns-default-hxhnc" Apr 24 21:17:28.234496 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.234478 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9x8w\" (UniqueName: \"kubernetes.io/projected/403124c9-db4a-4d6b-a7b2-d59c7568de7e-kube-api-access-s9x8w\") pod \"ingress-canary-nj869\" (UID: \"403124c9-db4a-4d6b-a7b2-d59c7568de7e\") " pod="openshift-ingress-canary/ingress-canary-nj869" Apr 24 21:17:28.322630 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.322589 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/285b2b48-f737-45d2-80ef-45b4bc73abd2-crio-socket\") pod \"insights-runtime-extractor-qs276\" (UID: \"285b2b48-f737-45d2-80ef-45b4bc73abd2\") " pod="openshift-insights/insights-runtime-extractor-qs276" Apr 24 21:17:28.322630 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.322637 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d98c5\" (UniqueName: \"kubernetes.io/projected/285b2b48-f737-45d2-80ef-45b4bc73abd2-kube-api-access-d98c5\") pod \"insights-runtime-extractor-qs276\" (UID: \"285b2b48-f737-45d2-80ef-45b4bc73abd2\") " pod="openshift-insights/insights-runtime-extractor-qs276" Apr 24 21:17:28.322832 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.322757 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/285b2b48-f737-45d2-80ef-45b4bc73abd2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qs276\" (UID: \"285b2b48-f737-45d2-80ef-45b4bc73abd2\") " pod="openshift-insights/insights-runtime-extractor-qs276" Apr 24 21:17:28.322832 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.322796 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/285b2b48-f737-45d2-80ef-45b4bc73abd2-data-volume\") pod \"insights-runtime-extractor-qs276\" (UID: \"285b2b48-f737-45d2-80ef-45b4bc73abd2\") " pod="openshift-insights/insights-runtime-extractor-qs276" Apr 24 21:17:28.322832 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.322800 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/285b2b48-f737-45d2-80ef-45b4bc73abd2-crio-socket\") pod \"insights-runtime-extractor-qs276\" (UID: \"285b2b48-f737-45d2-80ef-45b4bc73abd2\") " pod="openshift-insights/insights-runtime-extractor-qs276" Apr 24 21:17:28.322927 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.322885 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/285b2b48-f737-45d2-80ef-45b4bc73abd2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qs276\" (UID: \"285b2b48-f737-45d2-80ef-45b4bc73abd2\") " pod="openshift-insights/insights-runtime-extractor-qs276" Apr 24 21:17:28.323108 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.323093 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/285b2b48-f737-45d2-80ef-45b4bc73abd2-data-volume\") pod \"insights-runtime-extractor-qs276\" (UID: \"285b2b48-f737-45d2-80ef-45b4bc73abd2\") " pod="openshift-insights/insights-runtime-extractor-qs276" Apr 24 21:17:28.323361 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.323316 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/285b2b48-f737-45d2-80ef-45b4bc73abd2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qs276\" (UID: \"285b2b48-f737-45d2-80ef-45b4bc73abd2\") " pod="openshift-insights/insights-runtime-extractor-qs276" Apr 24 21:17:28.325124 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.325098 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/285b2b48-f737-45d2-80ef-45b4bc73abd2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qs276\" (UID: \"285b2b48-f737-45d2-80ef-45b4bc73abd2\") " pod="openshift-insights/insights-runtime-extractor-qs276" Apr 24 21:17:28.333390 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.333367 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hxhnc" Apr 24 21:17:28.333618 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.333597 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d98c5\" (UniqueName: \"kubernetes.io/projected/285b2b48-f737-45d2-80ef-45b4bc73abd2-kube-api-access-d98c5\") pod \"insights-runtime-extractor-qs276\" (UID: \"285b2b48-f737-45d2-80ef-45b4bc73abd2\") " pod="openshift-insights/insights-runtime-extractor-qs276" Apr 24 21:17:28.338119 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.338101 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nj869" Apr 24 21:17:28.402826 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.402791 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qs276" Apr 24 21:17:28.503333 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.503260 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nj869"] Apr 24 21:17:28.507931 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:17:28.507902 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod403124c9_db4a_4d6b_a7b2_d59c7568de7e.slice/crio-25db4884e9fd6c3c9045e639f2e35316237de9c7e12976741eb64eb5e7c7ff24 WatchSource:0}: Error finding container 25db4884e9fd6c3c9045e639f2e35316237de9c7e12976741eb64eb5e7c7ff24: Status 404 returned error can't find the container with id 25db4884e9fd6c3c9045e639f2e35316237de9c7e12976741eb64eb5e7c7ff24 Apr 24 21:17:28.521377 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.521311 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hxhnc"] Apr 24 21:17:28.525470 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:17:28.525437 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1603a03_2d10_41d3_bf9b_34d45b271773.slice/crio-8ba999fc3c16e6470d745120fdd5728a08bb03440d322501857dc9bbae7a904f WatchSource:0}: Error finding container 8ba999fc3c16e6470d745120fdd5728a08bb03440d322501857dc9bbae7a904f: Status 404 returned error can't find the container with id 8ba999fc3c16e6470d745120fdd5728a08bb03440d322501857dc9bbae7a904f Apr 24 21:17:28.553310 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.553282 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qs276"] Apr 24 21:17:28.556256 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:17:28.556233 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod285b2b48_f737_45d2_80ef_45b4bc73abd2.slice/crio-21dc8cd023ea12d3f7871209b8c4aac8b96685553a00d999fc0ca1f87d83364b WatchSource:0}: Error finding container 21dc8cd023ea12d3f7871209b8c4aac8b96685553a00d999fc0ca1f87d83364b: Status 404 returned error can't find the container with id 21dc8cd023ea12d3f7871209b8c4aac8b96685553a00d999fc0ca1f87d83364b Apr 24 21:17:28.880186 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.880103 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-54c7ffcd54-p7j5r"] Apr 24 21:17:28.883255 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.883229 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54c7ffcd54-p7j5r" Apr 24 21:17:28.886121 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.886096 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Apr 24 21:17:28.886558 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.886538 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Apr 24 21:17:28.886683 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.886563 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Apr 24 21:17:28.886683 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.886592 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Apr 24 21:17:28.886683 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.886543 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Apr 24 21:17:28.887099 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.887079 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Apr 24 21:17:28.888289 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.888262 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-wpj8v\"" Apr 24 21:17:28.888553 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.888529 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Apr 24 21:17:28.896764 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.896737 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54c7ffcd54-p7j5r"] Apr 24 21:17:28.899009 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.898978 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Apr 24 21:17:28.992948 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.991921 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qs276" event={"ID":"285b2b48-f737-45d2-80ef-45b4bc73abd2","Type":"ContainerStarted","Data":"36dc5a3496355caf41985079b350610b145aaae939b378c701bc6e5bae822f82"} Apr 24 21:17:28.992948 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.991963 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qs276" event={"ID":"285b2b48-f737-45d2-80ef-45b4bc73abd2","Type":"ContainerStarted","Data":"21dc8cd023ea12d3f7871209b8c4aac8b96685553a00d999fc0ca1f87d83364b"} Apr 24 21:17:28.993218 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.993194 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nj869" event={"ID":"403124c9-db4a-4d6b-a7b2-d59c7568de7e","Type":"ContainerStarted","Data":"25db4884e9fd6c3c9045e639f2e35316237de9c7e12976741eb64eb5e7c7ff24"} Apr 24 21:17:28.996893 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:28.996855 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hxhnc" event={"ID":"f1603a03-2d10-41d3-bf9b-34d45b271773","Type":"ContainerStarted","Data":"8ba999fc3c16e6470d745120fdd5728a08bb03440d322501857dc9bbae7a904f"} Apr 24 21:17:29.029694 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:29.029320 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b8a272a5-98e2-4c95-b1ea-b7831db12313-oauth-serving-cert\") pod \"console-54c7ffcd54-p7j5r\" (UID: \"b8a272a5-98e2-4c95-b1ea-b7831db12313\") " pod="openshift-console/console-54c7ffcd54-p7j5r" Apr 24 21:17:29.029694 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:29.029381 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b8a272a5-98e2-4c95-b1ea-b7831db12313-console-config\") pod \"console-54c7ffcd54-p7j5r\" (UID: \"b8a272a5-98e2-4c95-b1ea-b7831db12313\") " pod="openshift-console/console-54c7ffcd54-p7j5r" Apr 24 21:17:29.029694 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:29.029422 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8a272a5-98e2-4c95-b1ea-b7831db12313-trusted-ca-bundle\") pod \"console-54c7ffcd54-p7j5r\" (UID: \"b8a272a5-98e2-4c95-b1ea-b7831db12313\") " pod="openshift-console/console-54c7ffcd54-p7j5r" Apr 24 21:17:29.029694 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:29.029461 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b8a272a5-98e2-4c95-b1ea-b7831db12313-service-ca\") pod \"console-54c7ffcd54-p7j5r\" (UID: \"b8a272a5-98e2-4c95-b1ea-b7831db12313\") " pod="openshift-console/console-54c7ffcd54-p7j5r" Apr 24 21:17:29.029694 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:29.029488 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b8a272a5-98e2-4c95-b1ea-b7831db12313-console-serving-cert\") pod \"console-54c7ffcd54-p7j5r\" (UID: \"b8a272a5-98e2-4c95-b1ea-b7831db12313\") " pod="openshift-console/console-54c7ffcd54-p7j5r" Apr 24 21:17:29.029694 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:29.029516 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7dv4\" (UniqueName: \"kubernetes.io/projected/b8a272a5-98e2-4c95-b1ea-b7831db12313-kube-api-access-w7dv4\") pod \"console-54c7ffcd54-p7j5r\" (UID: \"b8a272a5-98e2-4c95-b1ea-b7831db12313\") " pod="openshift-console/console-54c7ffcd54-p7j5r" Apr 24 21:17:29.029694 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:29.029553 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b8a272a5-98e2-4c95-b1ea-b7831db12313-console-oauth-config\") pod \"console-54c7ffcd54-p7j5r\" (UID: \"b8a272a5-98e2-4c95-b1ea-b7831db12313\") " pod="openshift-console/console-54c7ffcd54-p7j5r" Apr 24 21:17:29.035944 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:29.035916 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-fpb4d"] Apr 24 21:17:29.038967 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:29.038948 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-fpb4d" Apr 24 21:17:29.041521 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:29.041493 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Apr 24 21:17:29.041622 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:29.041598 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-hknfm\"" Apr 24 21:17:29.051189 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:29.051162 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-fpb4d"] Apr 24 21:17:29.131751 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:29.130698 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b8a272a5-98e2-4c95-b1ea-b7831db12313-service-ca\") pod \"console-54c7ffcd54-p7j5r\" (UID: \"b8a272a5-98e2-4c95-b1ea-b7831db12313\") " pod="openshift-console/console-54c7ffcd54-p7j5r" Apr 24 21:17:29.131751 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:29.130772 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b8a272a5-98e2-4c95-b1ea-b7831db12313-console-serving-cert\") pod \"console-54c7ffcd54-p7j5r\" (UID: \"b8a272a5-98e2-4c95-b1ea-b7831db12313\") " pod="openshift-console/console-54c7ffcd54-p7j5r" Apr 24 21:17:29.131751 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:29.130807 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w7dv4\" (UniqueName: \"kubernetes.io/projected/b8a272a5-98e2-4c95-b1ea-b7831db12313-kube-api-access-w7dv4\") pod \"console-54c7ffcd54-p7j5r\" (UID: \"b8a272a5-98e2-4c95-b1ea-b7831db12313\") " pod="openshift-console/console-54c7ffcd54-p7j5r" Apr 24 21:17:29.131751 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:29.130838 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b8a272a5-98e2-4c95-b1ea-b7831db12313-console-oauth-config\") pod \"console-54c7ffcd54-p7j5r\" (UID: \"b8a272a5-98e2-4c95-b1ea-b7831db12313\") " pod="openshift-console/console-54c7ffcd54-p7j5r" Apr 24 21:17:29.131751 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:29.131079 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b8a272a5-98e2-4c95-b1ea-b7831db12313-oauth-serving-cert\") pod \"console-54c7ffcd54-p7j5r\" (UID: \"b8a272a5-98e2-4c95-b1ea-b7831db12313\") " pod="openshift-console/console-54c7ffcd54-p7j5r" Apr 24 21:17:29.131751 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:29.131119 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b8a272a5-98e2-4c95-b1ea-b7831db12313-console-config\") pod \"console-54c7ffcd54-p7j5r\" (UID: \"b8a272a5-98e2-4c95-b1ea-b7831db12313\") " pod="openshift-console/console-54c7ffcd54-p7j5r" Apr 24 21:17:29.131751 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:29.131148 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/24b77528-b555-42c1-b5f2-c77c5a41fe8e-tls-certificates\") pod \"prometheus-operator-admission-webhook-57cf98b594-fpb4d\" (UID: \"24b77528-b555-42c1-b5f2-c77c5a41fe8e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-fpb4d" Apr 24 21:17:29.131751 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:29.131191 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8a272a5-98e2-4c95-b1ea-b7831db12313-trusted-ca-bundle\") pod \"console-54c7ffcd54-p7j5r\" (UID: \"b8a272a5-98e2-4c95-b1ea-b7831db12313\") " pod="openshift-console/console-54c7ffcd54-p7j5r" Apr 24 21:17:29.131751 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:29.131554 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b8a272a5-98e2-4c95-b1ea-b7831db12313-service-ca\") pod \"console-54c7ffcd54-p7j5r\" (UID: \"b8a272a5-98e2-4c95-b1ea-b7831db12313\") " pod="openshift-console/console-54c7ffcd54-p7j5r" Apr 24 21:17:29.132271 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:29.131774 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b8a272a5-98e2-4c95-b1ea-b7831db12313-console-config\") pod \"console-54c7ffcd54-p7j5r\" (UID: \"b8a272a5-98e2-4c95-b1ea-b7831db12313\") " pod="openshift-console/console-54c7ffcd54-p7j5r" Apr 24 21:17:29.132271 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:29.132026 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8a272a5-98e2-4c95-b1ea-b7831db12313-trusted-ca-bundle\") pod \"console-54c7ffcd54-p7j5r\" (UID: \"b8a272a5-98e2-4c95-b1ea-b7831db12313\") " pod="openshift-console/console-54c7ffcd54-p7j5r" Apr 24 21:17:29.132639 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:29.132598 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b8a272a5-98e2-4c95-b1ea-b7831db12313-oauth-serving-cert\") pod \"console-54c7ffcd54-p7j5r\" (UID: \"b8a272a5-98e2-4c95-b1ea-b7831db12313\") " pod="openshift-console/console-54c7ffcd54-p7j5r" Apr 24 21:17:29.135854 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:29.135836 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b8a272a5-98e2-4c95-b1ea-b7831db12313-console-serving-cert\") pod \"console-54c7ffcd54-p7j5r\" (UID: \"b8a272a5-98e2-4c95-b1ea-b7831db12313\") " pod="openshift-console/console-54c7ffcd54-p7j5r" Apr 24 21:17:29.137536 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:29.137515 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b8a272a5-98e2-4c95-b1ea-b7831db12313-console-oauth-config\") pod \"console-54c7ffcd54-p7j5r\" (UID: \"b8a272a5-98e2-4c95-b1ea-b7831db12313\") " pod="openshift-console/console-54c7ffcd54-p7j5r" Apr 24 21:17:29.143939 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:29.143914 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7dv4\" (UniqueName: \"kubernetes.io/projected/b8a272a5-98e2-4c95-b1ea-b7831db12313-kube-api-access-w7dv4\") pod \"console-54c7ffcd54-p7j5r\" (UID: \"b8a272a5-98e2-4c95-b1ea-b7831db12313\") " pod="openshift-console/console-54c7ffcd54-p7j5r" Apr 24 21:17:29.194845 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:29.194384 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54c7ffcd54-p7j5r" Apr 24 21:17:29.232967 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:29.232420 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/24b77528-b555-42c1-b5f2-c77c5a41fe8e-tls-certificates\") pod \"prometheus-operator-admission-webhook-57cf98b594-fpb4d\" (UID: \"24b77528-b555-42c1-b5f2-c77c5a41fe8e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-fpb4d" Apr 24 21:17:29.236015 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:29.235984 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/24b77528-b555-42c1-b5f2-c77c5a41fe8e-tls-certificates\") pod \"prometheus-operator-admission-webhook-57cf98b594-fpb4d\" (UID: \"24b77528-b555-42c1-b5f2-c77c5a41fe8e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-fpb4d" Apr 24 21:17:29.350061 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:29.350026 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-fpb4d" Apr 24 21:17:29.408028 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:29.407975 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54c7ffcd54-p7j5r"] Apr 24 21:17:29.413747 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:17:29.413677 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8a272a5_98e2_4c95_b1ea_b7831db12313.slice/crio-a7acae9ceb8116e5e2074c917862d69fcb498e2ddab86e9e8869f0cde6fd040b WatchSource:0}: Error finding container a7acae9ceb8116e5e2074c917862d69fcb498e2ddab86e9e8869f0cde6fd040b: Status 404 returned error can't find the container with id a7acae9ceb8116e5e2074c917862d69fcb498e2ddab86e9e8869f0cde6fd040b Apr 24 21:17:29.494255 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:29.494217 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-fpb4d"] Apr 24 21:17:29.767000 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:29.766970 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s9p7t" Apr 24 21:17:29.767170 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:29.766970 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvphd" Apr 24 21:17:29.769582 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:29.769558 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Apr 24 21:17:29.769582 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:29.769578 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Apr 24 21:17:29.769783 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:29.769607 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-w24qg\"" Apr 24 21:17:29.769783 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:29.769559 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Apr 24 21:17:29.769980 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:29.769952 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jphgp\"" Apr 24 21:17:29.874635 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:17:29.874595 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24b77528_b555_42c1_b5f2_c77c5a41fe8e.slice/crio-3211893a3f27c97944e7a748db02182d342b06b5c527fdfd76374f62ac6318fa WatchSource:0}: Error finding container 3211893a3f27c97944e7a748db02182d342b06b5c527fdfd76374f62ac6318fa: Status 404 returned error can't find the container with id 3211893a3f27c97944e7a748db02182d342b06b5c527fdfd76374f62ac6318fa Apr 24 21:17:30.001294 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:30.001257 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-fpb4d" event={"ID":"24b77528-b555-42c1-b5f2-c77c5a41fe8e","Type":"ContainerStarted","Data":"3211893a3f27c97944e7a748db02182d342b06b5c527fdfd76374f62ac6318fa"} Apr 24 21:17:30.002476 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:30.002448 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54c7ffcd54-p7j5r" event={"ID":"b8a272a5-98e2-4c95-b1ea-b7831db12313","Type":"ContainerStarted","Data":"a7acae9ceb8116e5e2074c917862d69fcb498e2ddab86e9e8869f0cde6fd040b"} Apr 24 21:17:30.004649 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:30.004615 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qs276" event={"ID":"285b2b48-f737-45d2-80ef-45b4bc73abd2","Type":"ContainerStarted","Data":"1debc8799a245b402981443cc270c10eac8383aa651c49e42ac0294074f98c46"} Apr 24 21:17:31.945186 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:31.945156 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bbpmt" Apr 24 21:17:33.013148 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:33.013109 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nj869" event={"ID":"403124c9-db4a-4d6b-a7b2-d59c7568de7e","Type":"ContainerStarted","Data":"0102dc93a2251cee64937b8d5968d5ccb332a2366830dd7e140ac7f6a0cceb61"} Apr 24 21:17:33.015553 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:33.015523 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hxhnc" event={"ID":"f1603a03-2d10-41d3-bf9b-34d45b271773","Type":"ContainerStarted","Data":"f3fc0d0191c71f34f199e9f84b3601d1eb4169842e2e33a1b83dde9a153fcd07"} Apr 24 21:17:33.018328 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:33.018299 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-fpb4d" event={"ID":"24b77528-b555-42c1-b5f2-c77c5a41fe8e","Type":"ContainerStarted","Data":"906a7b79f9c0d64344fd3e4a6a5cad547945fdfd5b3aa75384d20c8dfa26e863"} Apr 24 21:17:33.018487 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:33.018458 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-fpb4d" Apr 24 21:17:33.020036 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:33.020017 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54c7ffcd54-p7j5r" event={"ID":"b8a272a5-98e2-4c95-b1ea-b7831db12313","Type":"ContainerStarted","Data":"3eb2869900781f778ade0d08aaf8707e0a984d01017072c40354422cf30bba88"} Apr 24 21:17:33.022312 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:33.022294 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qs276" event={"ID":"285b2b48-f737-45d2-80ef-45b4bc73abd2","Type":"ContainerStarted","Data":"8bdf9de5bdebe18491ba5a4c19dd567d0f6ea9a4a0bb1db5578ebc2bdea8cf51"} Apr 24 21:17:33.025658 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:33.025638 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-fpb4d" Apr 24 21:17:33.030801 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:33.030753 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-nj869" podStartSLOduration=2.405871709 podStartE2EDuration="5.030740783s" podCreationTimestamp="2026-04-24 21:17:28 +0000 UTC" firstStartedPulling="2026-04-24 21:17:28.509770182 +0000 UTC m=+53.372495245" lastFinishedPulling="2026-04-24 21:17:31.134639253 +0000 UTC m=+55.997364319" observedRunningTime="2026-04-24 21:17:33.030235429 +0000 UTC m=+57.892960515" watchObservedRunningTime="2026-04-24 21:17:33.030740783 +0000 UTC m=+57.893465865" Apr 24 21:17:33.047871 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:33.047822 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-54c7ffcd54-p7j5r" podStartSLOduration=1.654204188 podStartE2EDuration="5.047807867s" podCreationTimestamp="2026-04-24 21:17:28 +0000 UTC" firstStartedPulling="2026-04-24 21:17:29.419361655 +0000 UTC m=+54.282086731" lastFinishedPulling="2026-04-24 21:17:32.812965346 +0000 UTC m=+57.675690410" observedRunningTime="2026-04-24 21:17:33.047535755 +0000 UTC m=+57.910260842" watchObservedRunningTime="2026-04-24 21:17:33.047807867 +0000 UTC m=+57.910532955" Apr 24 21:17:33.091823 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:33.091770 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-qs276" podStartSLOduration=0.917194735 podStartE2EDuration="5.091755605s" podCreationTimestamp="2026-04-24 21:17:28 +0000 UTC" firstStartedPulling="2026-04-24 21:17:28.631143848 +0000 UTC m=+53.493868911" lastFinishedPulling="2026-04-24 21:17:32.805704702 +0000 UTC m=+57.668429781" observedRunningTime="2026-04-24 21:17:33.090218625 +0000 UTC m=+57.952943721" watchObservedRunningTime="2026-04-24 21:17:33.091755605 +0000 UTC m=+57.954480689" Apr 24 21:17:33.120923 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:33.120872 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-fpb4d" podStartSLOduration=1.191432521 podStartE2EDuration="4.120855559s" podCreationTimestamp="2026-04-24 21:17:29 +0000 UTC" firstStartedPulling="2026-04-24 21:17:29.876452692 +0000 UTC m=+54.739177755" lastFinishedPulling="2026-04-24 21:17:32.805875713 +0000 UTC m=+57.668600793" observedRunningTime="2026-04-24 21:17:33.120544702 +0000 UTC m=+57.983269788" watchObservedRunningTime="2026-04-24 21:17:33.120855559 +0000 UTC m=+57.983580643" Apr 24 21:17:34.025778 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:34.025739 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hxhnc" event={"ID":"f1603a03-2d10-41d3-bf9b-34d45b271773","Type":"ContainerStarted","Data":"18464c39902031e08d71b67ea1e375712c317c97addb54b59de2511010fbd571"} Apr 24 21:17:34.118209 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:34.118155 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-hxhnc" podStartSLOduration=4.094340601 podStartE2EDuration="6.118138123s" podCreationTimestamp="2026-04-24 21:17:28 +0000 UTC" firstStartedPulling="2026-04-24 21:17:28.52690585 +0000 UTC m=+53.389630913" lastFinishedPulling="2026-04-24 21:17:30.550703368 +0000 UTC m=+55.413428435" observedRunningTime="2026-04-24 21:17:34.044499582 +0000 UTC m=+58.907224669" watchObservedRunningTime="2026-04-24 21:17:34.118138123 +0000 UTC m=+58.980863206" Apr 24 21:17:34.118467 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:34.118453 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5676c8c784-nbb94"] Apr 24 21:17:34.121480 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:34.121463 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5676c8c784-nbb94" Apr 24 21:17:34.123889 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:34.123854 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Apr 24 21:17:34.124061 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:34.123860 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Apr 24 21:17:34.124061 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:34.124016 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Apr 24 21:17:34.124156 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:34.124087 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Apr 24 21:17:34.124406 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:34.124391 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-cnbp6\"" Apr 24 21:17:34.124406 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:34.124399 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Apr 24 21:17:34.131791 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:34.131767 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5676c8c784-nbb94"] Apr 24 21:17:34.173432 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:34.173398 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d8cef8a-4146-403b-a247-b362d2a7cda5-metrics-client-ca\") pod \"prometheus-operator-5676c8c784-nbb94\" (UID: \"5d8cef8a-4146-403b-a247-b362d2a7cda5\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-nbb94" Apr 24 21:17:34.173633 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:34.173550 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5d8cef8a-4146-403b-a247-b362d2a7cda5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5676c8c784-nbb94\" (UID: \"5d8cef8a-4146-403b-a247-b362d2a7cda5\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-nbb94" Apr 24 21:17:34.173633 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:34.173594 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d8cef8a-4146-403b-a247-b362d2a7cda5-prometheus-operator-tls\") pod \"prometheus-operator-5676c8c784-nbb94\" (UID: \"5d8cef8a-4146-403b-a247-b362d2a7cda5\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-nbb94" Apr 24 21:17:34.173633 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:34.173632 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkwms\" (UniqueName: \"kubernetes.io/projected/5d8cef8a-4146-403b-a247-b362d2a7cda5-kube-api-access-rkwms\") pod \"prometheus-operator-5676c8c784-nbb94\" (UID: \"5d8cef8a-4146-403b-a247-b362d2a7cda5\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-nbb94" Apr 24 21:17:34.274809 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:34.274760 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d8cef8a-4146-403b-a247-b362d2a7cda5-metrics-client-ca\") pod \"prometheus-operator-5676c8c784-nbb94\" (UID: \"5d8cef8a-4146-403b-a247-b362d2a7cda5\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-nbb94" Apr 24 21:17:34.275000 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:34.274858 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5d8cef8a-4146-403b-a247-b362d2a7cda5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5676c8c784-nbb94\" (UID: \"5d8cef8a-4146-403b-a247-b362d2a7cda5\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-nbb94" Apr 24 21:17:34.275000 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:34.274894 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d8cef8a-4146-403b-a247-b362d2a7cda5-prometheus-operator-tls\") pod \"prometheus-operator-5676c8c784-nbb94\" (UID: \"5d8cef8a-4146-403b-a247-b362d2a7cda5\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-nbb94" Apr 24 21:17:34.275000 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:34.274924 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rkwms\" (UniqueName: \"kubernetes.io/projected/5d8cef8a-4146-403b-a247-b362d2a7cda5-kube-api-access-rkwms\") pod \"prometheus-operator-5676c8c784-nbb94\" (UID: \"5d8cef8a-4146-403b-a247-b362d2a7cda5\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-nbb94" Apr 24 21:17:34.275155 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:17:34.275028 2579 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Apr 24 21:17:34.275155 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:17:34.275112 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d8cef8a-4146-403b-a247-b362d2a7cda5-prometheus-operator-tls podName:5d8cef8a-4146-403b-a247-b362d2a7cda5 nodeName:}" failed. No retries permitted until 2026-04-24 21:17:34.775091516 +0000 UTC m=+59.637816584 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/5d8cef8a-4146-403b-a247-b362d2a7cda5-prometheus-operator-tls") pod "prometheus-operator-5676c8c784-nbb94" (UID: "5d8cef8a-4146-403b-a247-b362d2a7cda5") : secret "prometheus-operator-tls" not found Apr 24 21:17:34.275499 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:34.275482 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d8cef8a-4146-403b-a247-b362d2a7cda5-metrics-client-ca\") pod \"prometheus-operator-5676c8c784-nbb94\" (UID: \"5d8cef8a-4146-403b-a247-b362d2a7cda5\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-nbb94" Apr 24 21:17:34.277407 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:34.277366 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5d8cef8a-4146-403b-a247-b362d2a7cda5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5676c8c784-nbb94\" (UID: \"5d8cef8a-4146-403b-a247-b362d2a7cda5\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-nbb94" Apr 24 21:17:34.286084 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:34.286059 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkwms\" (UniqueName: \"kubernetes.io/projected/5d8cef8a-4146-403b-a247-b362d2a7cda5-kube-api-access-rkwms\") pod \"prometheus-operator-5676c8c784-nbb94\" (UID: \"5d8cef8a-4146-403b-a247-b362d2a7cda5\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-nbb94" Apr 24 21:17:34.780126 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:34.780078 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d8cef8a-4146-403b-a247-b362d2a7cda5-prometheus-operator-tls\") pod \"prometheus-operator-5676c8c784-nbb94\" (UID: \"5d8cef8a-4146-403b-a247-b362d2a7cda5\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-nbb94" Apr 24 21:17:34.782596 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:34.782572 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d8cef8a-4146-403b-a247-b362d2a7cda5-prometheus-operator-tls\") pod \"prometheus-operator-5676c8c784-nbb94\" (UID: \"5d8cef8a-4146-403b-a247-b362d2a7cda5\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-nbb94" Apr 24 21:17:35.028455 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:35.028419 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hxhnc" Apr 24 21:17:35.030658 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:35.030614 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5676c8c784-nbb94" Apr 24 21:17:35.159172 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:35.159132 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5676c8c784-nbb94"] Apr 24 21:17:35.162474 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:17:35.162447 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d8cef8a_4146_403b_a247_b362d2a7cda5.slice/crio-f1f1db3f5f3244851b6ca0323e6ee1a662ce8be80d7ef4ea170b81bf0475fc8f WatchSource:0}: Error finding container f1f1db3f5f3244851b6ca0323e6ee1a662ce8be80d7ef4ea170b81bf0475fc8f: Status 404 returned error can't find the container with id f1f1db3f5f3244851b6ca0323e6ee1a662ce8be80d7ef4ea170b81bf0475fc8f Apr 24 21:17:36.032655 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:36.032619 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5676c8c784-nbb94" event={"ID":"5d8cef8a-4146-403b-a247-b362d2a7cda5","Type":"ContainerStarted","Data":"f1f1db3f5f3244851b6ca0323e6ee1a662ce8be80d7ef4ea170b81bf0475fc8f"} Apr 24 21:17:37.036438 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:37.036398 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5676c8c784-nbb94" event={"ID":"5d8cef8a-4146-403b-a247-b362d2a7cda5","Type":"ContainerStarted","Data":"f510f35a04890fd648b058c3fc1091e04c0a78d32fc839754b4c173e60b656c7"} Apr 24 21:17:37.036438 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:37.036439 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5676c8c784-nbb94" event={"ID":"5d8cef8a-4146-403b-a247-b362d2a7cda5","Type":"ContainerStarted","Data":"58ff8d1d7ba1a6aaf5dcba37053130ebe4f92a6767833162738641b2d0afab05"} Apr 24 21:17:37.062601 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:37.062544 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5676c8c784-nbb94" podStartSLOduration=1.8679192100000002 podStartE2EDuration="3.062527754s" podCreationTimestamp="2026-04-24 21:17:34 +0000 UTC" firstStartedPulling="2026-04-24 21:17:35.164250581 +0000 UTC m=+60.026975644" lastFinishedPulling="2026-04-24 21:17:36.358859122 +0000 UTC m=+61.221584188" observedRunningTime="2026-04-24 21:17:37.061871176 +0000 UTC m=+61.924596285" watchObservedRunningTime="2026-04-24 21:17:37.062527754 +0000 UTC m=+61.925252839" Apr 24 21:17:39.194922 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:39.194890 2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-54c7ffcd54-p7j5r" Apr 24 21:17:39.195308 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:39.194932 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54c7ffcd54-p7j5r" Apr 24 21:17:39.199333 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:39.199311 2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-54c7ffcd54-p7j5r" Apr 24 21:17:40.048172 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.048143 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-54c7ffcd54-p7j5r" Apr 24 21:17:40.421792 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.421760 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/29637be2-89a9-414b-81e0-8c4ebdda7fe0-metrics-certs\") pod \"network-metrics-daemon-qvphd\" (UID: \"29637be2-89a9-414b-81e0-8c4ebdda7fe0\") " pod="openshift-multus/network-metrics-daemon-qvphd" Apr 24 21:17:40.425050 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.425025 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Apr 24 21:17:40.434552 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.434526 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/29637be2-89a9-414b-81e0-8c4ebdda7fe0-metrics-certs\") pod \"network-metrics-daemon-qvphd\" (UID: \"29637be2-89a9-414b-81e0-8c4ebdda7fe0\") " pod="openshift-multus/network-metrics-daemon-qvphd" Apr 24 21:17:40.500953 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.500911 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-mzs78"] Apr 24 21:17:40.522596 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.522561 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qdn2f\" (UniqueName: \"kubernetes.io/projected/b98dea0d-9954-40bd-a46c-865213211e17-kube-api-access-qdn2f\") pod \"network-check-target-s9p7t\" (UID: \"b98dea0d-9954-40bd-a46c-865213211e17\") " pod="openshift-network-diagnostics/network-check-target-s9p7t" Apr 24 21:17:40.531593 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.531567 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mzs78" Apr 24 21:17:40.533075 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.533056 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Apr 24 21:17:40.546773 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.546736 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Apr 24 21:17:40.547800 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.547782 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Apr 24 21:17:40.547910 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.547781 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Apr 24 21:17:40.548191 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.548176 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-gdtmb\"" Apr 24 21:17:40.548278 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.548270 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Apr 24 21:17:40.557164 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.557139 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdn2f\" (UniqueName: \"kubernetes.io/projected/b98dea0d-9954-40bd-a46c-865213211e17-kube-api-access-qdn2f\") pod \"network-check-target-s9p7t\" (UID: \"b98dea0d-9954-40bd-a46c-865213211e17\") " pod="openshift-network-diagnostics/network-check-target-s9p7t" Apr 24 21:17:40.573437 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.573412 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9d44df66c-pdpkm"] Apr 24 21:17:40.594316 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.594288 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-w24qg\"" Apr 24 21:17:40.594490 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.594429 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jphgp\"" Apr 24 21:17:40.598551 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.598531 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s9p7t" Apr 24 21:17:40.603848 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.603830 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvphd" Apr 24 21:17:40.603936 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.603918 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9d44df66c-pdpkm" Apr 24 21:17:40.611034 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.610870 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-jkph7\"" Apr 24 21:17:40.611174 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.611159 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Apr 24 21:17:40.612771 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.612751 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Apr 24 21:17:40.622974 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.622943 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ls6wr\" (UniqueName: \"kubernetes.io/projected/378b1166-0b5c-4ba5-a9e8-517d1bbbe6ae-kube-api-access-ls6wr\") pod \"node-exporter-mzs78\" (UID: \"378b1166-0b5c-4ba5-a9e8-517d1bbbe6ae\") " pod="openshift-monitoring/node-exporter-mzs78" Apr 24 21:17:40.623122 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.622997 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/378b1166-0b5c-4ba5-a9e8-517d1bbbe6ae-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mzs78\" (UID: \"378b1166-0b5c-4ba5-a9e8-517d1bbbe6ae\") " pod="openshift-monitoring/node-exporter-mzs78" Apr 24 21:17:40.623122 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.623024 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/378b1166-0b5c-4ba5-a9e8-517d1bbbe6ae-root\") pod \"node-exporter-mzs78\" (UID: \"378b1166-0b5c-4ba5-a9e8-517d1bbbe6ae\") " pod="openshift-monitoring/node-exporter-mzs78" Apr 24 21:17:40.623122 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.623047 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/378b1166-0b5c-4ba5-a9e8-517d1bbbe6ae-sys\") pod \"node-exporter-mzs78\" (UID: \"378b1166-0b5c-4ba5-a9e8-517d1bbbe6ae\") " pod="openshift-monitoring/node-exporter-mzs78" Apr 24 21:17:40.623122 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.623072 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/378b1166-0b5c-4ba5-a9e8-517d1bbbe6ae-node-exporter-accelerators-collector-config\") pod \"node-exporter-mzs78\" (UID: \"378b1166-0b5c-4ba5-a9e8-517d1bbbe6ae\") " pod="openshift-monitoring/node-exporter-mzs78" Apr 24 21:17:40.623122 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.623101 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/378b1166-0b5c-4ba5-a9e8-517d1bbbe6ae-node-exporter-wtmp\") pod \"node-exporter-mzs78\" (UID: \"378b1166-0b5c-4ba5-a9e8-517d1bbbe6ae\") " pod="openshift-monitoring/node-exporter-mzs78" Apr 24 21:17:40.623462 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.623129 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9afa8910-27c9-46a8-8bc6-2fdc29d4a667-metrics-client-ca\") pod \"openshift-state-metrics-9d44df66c-pdpkm\" (UID: \"9afa8910-27c9-46a8-8bc6-2fdc29d4a667\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-pdpkm" Apr 24 21:17:40.623462 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.623172 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/378b1166-0b5c-4ba5-a9e8-517d1bbbe6ae-node-exporter-textfile\") pod \"node-exporter-mzs78\" (UID: \"378b1166-0b5c-4ba5-a9e8-517d1bbbe6ae\") " pod="openshift-monitoring/node-exporter-mzs78" Apr 24 21:17:40.623462 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.623207 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpjp4\" (UniqueName: \"kubernetes.io/projected/9afa8910-27c9-46a8-8bc6-2fdc29d4a667-kube-api-access-kpjp4\") pod \"openshift-state-metrics-9d44df66c-pdpkm\" (UID: \"9afa8910-27c9-46a8-8bc6-2fdc29d4a667\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-pdpkm" Apr 24 21:17:40.623462 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.623232 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/378b1166-0b5c-4ba5-a9e8-517d1bbbe6ae-node-exporter-tls\") pod \"node-exporter-mzs78\" (UID: \"378b1166-0b5c-4ba5-a9e8-517d1bbbe6ae\") " pod="openshift-monitoring/node-exporter-mzs78" Apr 24 21:17:40.623462 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.623267 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9afa8910-27c9-46a8-8bc6-2fdc29d4a667-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9d44df66c-pdpkm\" (UID: \"9afa8910-27c9-46a8-8bc6-2fdc29d4a667\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-pdpkm" Apr 24 21:17:40.623462 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.623299 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9afa8910-27c9-46a8-8bc6-2fdc29d4a667-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9d44df66c-pdpkm\" (UID: \"9afa8910-27c9-46a8-8bc6-2fdc29d4a667\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-pdpkm" Apr 24 21:17:40.623462 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.623318 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/378b1166-0b5c-4ba5-a9e8-517d1bbbe6ae-metrics-client-ca\") pod \"node-exporter-mzs78\" (UID: \"378b1166-0b5c-4ba5-a9e8-517d1bbbe6ae\") " pod="openshift-monitoring/node-exporter-mzs78" Apr 24 21:17:40.624618 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.624596 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9d44df66c-pdpkm"] Apr 24 21:17:40.669898 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.669481 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-69db897b98-xr28v"] Apr 24 21:17:40.706472 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.706420 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-69db897b98-xr28v"] Apr 24 21:17:40.706645 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.706600 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-69db897b98-xr28v" Apr 24 21:17:40.710416 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.710384 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Apr 24 21:17:40.711170 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.710655 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Apr 24 21:17:40.711170 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.710822 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Apr 24 21:17:40.711170 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.711003 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-887nz\"" Apr 24 21:17:40.724624 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.724591 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/378b1166-0b5c-4ba5-a9e8-517d1bbbe6ae-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mzs78\" (UID: \"378b1166-0b5c-4ba5-a9e8-517d1bbbe6ae\") " pod="openshift-monitoring/node-exporter-mzs78" Apr 24 21:17:40.724754 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.724633 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/378b1166-0b5c-4ba5-a9e8-517d1bbbe6ae-root\") pod \"node-exporter-mzs78\" (UID: \"378b1166-0b5c-4ba5-a9e8-517d1bbbe6ae\") " pod="openshift-monitoring/node-exporter-mzs78" Apr 24 21:17:40.724754 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.724696 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/378b1166-0b5c-4ba5-a9e8-517d1bbbe6ae-root\") pod \"node-exporter-mzs78\" (UID: \"378b1166-0b5c-4ba5-a9e8-517d1bbbe6ae\") " pod="openshift-monitoring/node-exporter-mzs78" Apr 24 21:17:40.724877 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.724813 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11ea66de-db45-4d88-9833-f4d6f418572e-metrics-client-ca\") pod \"kube-state-metrics-69db897b98-xr28v\" (UID: \"11ea66de-db45-4d88-9833-f4d6f418572e\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-xr28v" Apr 24 21:17:40.724877 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.724851 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/11ea66de-db45-4d88-9833-f4d6f418572e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-69db897b98-xr28v\" (UID: \"11ea66de-db45-4d88-9833-f4d6f418572e\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-xr28v" Apr 24 21:17:40.724983 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.724891 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/378b1166-0b5c-4ba5-a9e8-517d1bbbe6ae-sys\") pod \"node-exporter-mzs78\" (UID: \"378b1166-0b5c-4ba5-a9e8-517d1bbbe6ae\") " pod="openshift-monitoring/node-exporter-mzs78" Apr 24 21:17:40.724983 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.724918 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/378b1166-0b5c-4ba5-a9e8-517d1bbbe6ae-node-exporter-accelerators-collector-config\") pod \"node-exporter-mzs78\" (UID: \"378b1166-0b5c-4ba5-a9e8-517d1bbbe6ae\") " pod="openshift-monitoring/node-exporter-mzs78" Apr 24 21:17:40.724983 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.724947 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/378b1166-0b5c-4ba5-a9e8-517d1bbbe6ae-node-exporter-wtmp\") pod \"node-exporter-mzs78\" (UID: \"378b1166-0b5c-4ba5-a9e8-517d1bbbe6ae\") " pod="openshift-monitoring/node-exporter-mzs78" Apr 24 21:17:40.724983 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.724958 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/378b1166-0b5c-4ba5-a9e8-517d1bbbe6ae-sys\") pod \"node-exporter-mzs78\" (UID: \"378b1166-0b5c-4ba5-a9e8-517d1bbbe6ae\") " pod="openshift-monitoring/node-exporter-mzs78" Apr 24 21:17:40.724983 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.724974 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9afa8910-27c9-46a8-8bc6-2fdc29d4a667-metrics-client-ca\") pod \"openshift-state-metrics-9d44df66c-pdpkm\" (UID: \"9afa8910-27c9-46a8-8bc6-2fdc29d4a667\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-pdpkm" Apr 24 21:17:40.725204 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.725017 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/378b1166-0b5c-4ba5-a9e8-517d1bbbe6ae-node-exporter-textfile\") pod \"node-exporter-mzs78\" (UID: \"378b1166-0b5c-4ba5-a9e8-517d1bbbe6ae\") " pod="openshift-monitoring/node-exporter-mzs78" Apr 24 21:17:40.725204 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.725058 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kpjp4\" (UniqueName: \"kubernetes.io/projected/9afa8910-27c9-46a8-8bc6-2fdc29d4a667-kube-api-access-kpjp4\") pod \"openshift-state-metrics-9d44df66c-pdpkm\" (UID: \"9afa8910-27c9-46a8-8bc6-2fdc29d4a667\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-pdpkm" Apr 24 21:17:40.725204 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.725075 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/378b1166-0b5c-4ba5-a9e8-517d1bbbe6ae-node-exporter-wtmp\") pod \"node-exporter-mzs78\" (UID: \"378b1166-0b5c-4ba5-a9e8-517d1bbbe6ae\") " pod="openshift-monitoring/node-exporter-mzs78" Apr 24 21:17:40.725204 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.725087 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kq5j\" (UniqueName: \"kubernetes.io/projected/11ea66de-db45-4d88-9833-f4d6f418572e-kube-api-access-2kq5j\") pod \"kube-state-metrics-69db897b98-xr28v\" (UID: \"11ea66de-db45-4d88-9833-f4d6f418572e\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-xr28v" Apr 24 21:17:40.725204 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.725114 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/378b1166-0b5c-4ba5-a9e8-517d1bbbe6ae-node-exporter-tls\") pod \"node-exporter-mzs78\" (UID: \"378b1166-0b5c-4ba5-a9e8-517d1bbbe6ae\") " pod="openshift-monitoring/node-exporter-mzs78" Apr 24 21:17:40.725447 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:17:40.725217 2579 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Apr 24 21:17:40.725447 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:17:40.725288 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/378b1166-0b5c-4ba5-a9e8-517d1bbbe6ae-node-exporter-tls podName:378b1166-0b5c-4ba5-a9e8-517d1bbbe6ae nodeName:}" failed. No retries permitted until 2026-04-24 21:17:41.225268198 +0000 UTC m=+66.087993273 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/378b1166-0b5c-4ba5-a9e8-517d1bbbe6ae-node-exporter-tls") pod "node-exporter-mzs78" (UID: "378b1166-0b5c-4ba5-a9e8-517d1bbbe6ae") : secret "node-exporter-tls" not found Apr 24 21:17:40.725556 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.725453 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9afa8910-27c9-46a8-8bc6-2fdc29d4a667-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9d44df66c-pdpkm\" (UID: \"9afa8910-27c9-46a8-8bc6-2fdc29d4a667\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-pdpkm" Apr 24 21:17:40.725556 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.725492 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/378b1166-0b5c-4ba5-a9e8-517d1bbbe6ae-node-exporter-textfile\") pod \"node-exporter-mzs78\" (UID: \"378b1166-0b5c-4ba5-a9e8-517d1bbbe6ae\") " pod="openshift-monitoring/node-exporter-mzs78" Apr 24 21:17:40.725556 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.725505 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/11ea66de-db45-4d88-9833-f4d6f418572e-volume-directive-shadow\") pod \"kube-state-metrics-69db897b98-xr28v\" (UID: \"11ea66de-db45-4d88-9833-f4d6f418572e\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-xr28v" Apr 24 21:17:40.725699 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.725608 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/11ea66de-db45-4d88-9833-f4d6f418572e-kube-state-metrics-tls\") pod \"kube-state-metrics-69db897b98-xr28v\" (UID: \"11ea66de-db45-4d88-9833-f4d6f418572e\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-xr28v" Apr 24 21:17:40.725699 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.725651 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9afa8910-27c9-46a8-8bc6-2fdc29d4a667-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9d44df66c-pdpkm\" (UID: \"9afa8910-27c9-46a8-8bc6-2fdc29d4a667\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-pdpkm" Apr 24 21:17:40.725699 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.725680 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/378b1166-0b5c-4ba5-a9e8-517d1bbbe6ae-metrics-client-ca\") pod \"node-exporter-mzs78\" (UID: \"378b1166-0b5c-4ba5-a9e8-517d1bbbe6ae\") " pod="openshift-monitoring/node-exporter-mzs78" Apr 24 21:17:40.725867 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.725721 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ls6wr\" (UniqueName: \"kubernetes.io/projected/378b1166-0b5c-4ba5-a9e8-517d1bbbe6ae-kube-api-access-ls6wr\") pod \"node-exporter-mzs78\" (UID: \"378b1166-0b5c-4ba5-a9e8-517d1bbbe6ae\") " pod="openshift-monitoring/node-exporter-mzs78" Apr 24 21:17:40.725867 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.725754 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/11ea66de-db45-4d88-9833-f4d6f418572e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-69db897b98-xr28v\" (UID: \"11ea66de-db45-4d88-9833-f4d6f418572e\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-xr28v" Apr 24 21:17:40.726065 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.726006 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9afa8910-27c9-46a8-8bc6-2fdc29d4a667-metrics-client-ca\") pod \"openshift-state-metrics-9d44df66c-pdpkm\" (UID: \"9afa8910-27c9-46a8-8bc6-2fdc29d4a667\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-pdpkm" Apr 24 21:17:40.726575 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.726530 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/378b1166-0b5c-4ba5-a9e8-517d1bbbe6ae-metrics-client-ca\") pod \"node-exporter-mzs78\" (UID: \"378b1166-0b5c-4ba5-a9e8-517d1bbbe6ae\") " pod="openshift-monitoring/node-exporter-mzs78" Apr 24 21:17:40.727252 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.727197 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/378b1166-0b5c-4ba5-a9e8-517d1bbbe6ae-node-exporter-accelerators-collector-config\") pod \"node-exporter-mzs78\" (UID: \"378b1166-0b5c-4ba5-a9e8-517d1bbbe6ae\") " pod="openshift-monitoring/node-exporter-mzs78" Apr 24 21:17:40.727628 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.727606 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/378b1166-0b5c-4ba5-a9e8-517d1bbbe6ae-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mzs78\" (UID: \"378b1166-0b5c-4ba5-a9e8-517d1bbbe6ae\") " pod="openshift-monitoring/node-exporter-mzs78" Apr 24 21:17:40.728104 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.728077 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9afa8910-27c9-46a8-8bc6-2fdc29d4a667-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9d44df66c-pdpkm\" (UID: \"9afa8910-27c9-46a8-8bc6-2fdc29d4a667\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-pdpkm" Apr 24 21:17:40.728188 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.728161 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9afa8910-27c9-46a8-8bc6-2fdc29d4a667-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9d44df66c-pdpkm\" (UID: \"9afa8910-27c9-46a8-8bc6-2fdc29d4a667\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-pdpkm" Apr 24 21:17:40.743586 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.743563 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ls6wr\" (UniqueName: \"kubernetes.io/projected/378b1166-0b5c-4ba5-a9e8-517d1bbbe6ae-kube-api-access-ls6wr\") pod \"node-exporter-mzs78\" (UID: \"378b1166-0b5c-4ba5-a9e8-517d1bbbe6ae\") " pod="openshift-monitoring/node-exporter-mzs78" Apr 24 21:17:40.753061 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.753029 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpjp4\" (UniqueName: \"kubernetes.io/projected/9afa8910-27c9-46a8-8bc6-2fdc29d4a667-kube-api-access-kpjp4\") pod \"openshift-state-metrics-9d44df66c-pdpkm\" (UID: \"9afa8910-27c9-46a8-8bc6-2fdc29d4a667\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-pdpkm" Apr 24 21:17:40.758839 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:17:40.758808 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb98dea0d_9954_40bd_a46c_865213211e17.slice/crio-a057855d2a629572252dfd0a335f036065109d2f431db1f1806c6d0d0835dde8 WatchSource:0}: Error finding container a057855d2a629572252dfd0a335f036065109d2f431db1f1806c6d0d0835dde8: Status 404 returned error can't find the container with id a057855d2a629572252dfd0a335f036065109d2f431db1f1806c6d0d0835dde8 Apr 24 21:17:40.761990 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.761971 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-s9p7t"] Apr 24 21:17:40.801805 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.801782 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qvphd"] Apr 24 21:17:40.803944 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:17:40.803915 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29637be2_89a9_414b_81e0_8c4ebdda7fe0.slice/crio-cd7640238bf4f49b92c13d5c199d22a045e45510a937bdce256c6e670aa84781 WatchSource:0}: Error finding container cd7640238bf4f49b92c13d5c199d22a045e45510a937bdce256c6e670aa84781: Status 404 returned error can't find the container with id cd7640238bf4f49b92c13d5c199d22a045e45510a937bdce256c6e670aa84781 Apr 24 21:17:40.827093 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.827066 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11ea66de-db45-4d88-9833-f4d6f418572e-metrics-client-ca\") pod \"kube-state-metrics-69db897b98-xr28v\" (UID: \"11ea66de-db45-4d88-9833-f4d6f418572e\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-xr28v" Apr 24 21:17:40.827093 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.827098 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/11ea66de-db45-4d88-9833-f4d6f418572e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-69db897b98-xr28v\" (UID: \"11ea66de-db45-4d88-9833-f4d6f418572e\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-xr28v" Apr 24 21:17:40.827288 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.827134 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2kq5j\" (UniqueName: \"kubernetes.io/projected/11ea66de-db45-4d88-9833-f4d6f418572e-kube-api-access-2kq5j\") pod \"kube-state-metrics-69db897b98-xr28v\" (UID: \"11ea66de-db45-4d88-9833-f4d6f418572e\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-xr28v" Apr 24 21:17:40.827288 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.827175 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/11ea66de-db45-4d88-9833-f4d6f418572e-volume-directive-shadow\") pod \"kube-state-metrics-69db897b98-xr28v\" (UID: \"11ea66de-db45-4d88-9833-f4d6f418572e\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-xr28v" Apr 24 21:17:40.827288 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.827200 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/11ea66de-db45-4d88-9833-f4d6f418572e-kube-state-metrics-tls\") pod \"kube-state-metrics-69db897b98-xr28v\" (UID: \"11ea66de-db45-4d88-9833-f4d6f418572e\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-xr28v" Apr 24 21:17:40.827288 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.827239 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/11ea66de-db45-4d88-9833-f4d6f418572e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-69db897b98-xr28v\" (UID: \"11ea66de-db45-4d88-9833-f4d6f418572e\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-xr28v" Apr 24 21:17:40.827599 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.827580 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/11ea66de-db45-4d88-9833-f4d6f418572e-volume-directive-shadow\") pod \"kube-state-metrics-69db897b98-xr28v\" (UID: \"11ea66de-db45-4d88-9833-f4d6f418572e\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-xr28v" Apr 24 21:17:40.827916 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.827862 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11ea66de-db45-4d88-9833-f4d6f418572e-metrics-client-ca\") pod \"kube-state-metrics-69db897b98-xr28v\" (UID: \"11ea66de-db45-4d88-9833-f4d6f418572e\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-xr28v" Apr 24 21:17:40.827916 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.827883 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/11ea66de-db45-4d88-9833-f4d6f418572e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-69db897b98-xr28v\" (UID: \"11ea66de-db45-4d88-9833-f4d6f418572e\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-xr28v" Apr 24 21:17:40.829786 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.829760 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/11ea66de-db45-4d88-9833-f4d6f418572e-kube-state-metrics-tls\") pod \"kube-state-metrics-69db897b98-xr28v\" (UID: \"11ea66de-db45-4d88-9833-f4d6f418572e\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-xr28v" Apr 24 21:17:40.829786 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.829781 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/11ea66de-db45-4d88-9833-f4d6f418572e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-69db897b98-xr28v\" (UID: \"11ea66de-db45-4d88-9833-f4d6f418572e\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-xr28v" Apr 24 21:17:40.843681 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.843660 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kq5j\" (UniqueName: \"kubernetes.io/projected/11ea66de-db45-4d88-9833-f4d6f418572e-kube-api-access-2kq5j\") pod \"kube-state-metrics-69db897b98-xr28v\" (UID: \"11ea66de-db45-4d88-9833-f4d6f418572e\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-xr28v" Apr 24 21:17:40.945898 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:40.945815 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9d44df66c-pdpkm" Apr 24 21:17:41.019652 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:41.019626 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-69db897b98-xr28v" Apr 24 21:17:41.047998 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:41.047964 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qvphd" event={"ID":"29637be2-89a9-414b-81e0-8c4ebdda7fe0","Type":"ContainerStarted","Data":"cd7640238bf4f49b92c13d5c199d22a045e45510a937bdce256c6e670aa84781"} Apr 24 21:17:41.049171 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:41.049140 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-s9p7t" event={"ID":"b98dea0d-9954-40bd-a46c-865213211e17","Type":"ContainerStarted","Data":"a057855d2a629572252dfd0a335f036065109d2f431db1f1806c6d0d0835dde8"} Apr 24 21:17:41.108471 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:41.108444 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9d44df66c-pdpkm"] Apr 24 21:17:41.113367 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:17:41.113323 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9afa8910_27c9_46a8_8bc6_2fdc29d4a667.slice/crio-41fa8504a83ede00c0ab3edcd825f42f9ca13f867ea3cf7905f3860b257b814c WatchSource:0}: Error finding container 41fa8504a83ede00c0ab3edcd825f42f9ca13f867ea3cf7905f3860b257b814c: Status 404 returned error can't find the container with id 41fa8504a83ede00c0ab3edcd825f42f9ca13f867ea3cf7905f3860b257b814c Apr 24 21:17:41.201639 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:17:41.201612 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11ea66de_db45_4d88_9833_f4d6f418572e.slice/crio-4f6b1d1e456adfddd7bf13b8d2f43379b187f8894945539b80e986152afe915b WatchSource:0}: Error finding container 4f6b1d1e456adfddd7bf13b8d2f43379b187f8894945539b80e986152afe915b: Status 404 returned error can't find the container with id 4f6b1d1e456adfddd7bf13b8d2f43379b187f8894945539b80e986152afe915b Apr 24 21:17:41.202905 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:41.202814 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-69db897b98-xr28v"] Apr 24 21:17:41.230372 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:41.230321 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/378b1166-0b5c-4ba5-a9e8-517d1bbbe6ae-node-exporter-tls\") pod \"node-exporter-mzs78\" (UID: \"378b1166-0b5c-4ba5-a9e8-517d1bbbe6ae\") " pod="openshift-monitoring/node-exporter-mzs78" Apr 24 21:17:41.232855 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:41.232833 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/378b1166-0b5c-4ba5-a9e8-517d1bbbe6ae-node-exporter-tls\") pod \"node-exporter-mzs78\" (UID: \"378b1166-0b5c-4ba5-a9e8-517d1bbbe6ae\") " pod="openshift-monitoring/node-exporter-mzs78" Apr 24 21:17:41.440782 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:41.440564 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mzs78" Apr 24 21:17:41.451534 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:17:41.451468 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod378b1166_0b5c_4ba5_a9e8_517d1bbbe6ae.slice/crio-faa7b03447dde8e7442986bfc8e77b45293840bded2271bb65a231eb78c96190 WatchSource:0}: Error finding container faa7b03447dde8e7442986bfc8e77b45293840bded2271bb65a231eb78c96190: Status 404 returned error can't find the container with id faa7b03447dde8e7442986bfc8e77b45293840bded2271bb65a231eb78c96190 Apr 24 21:17:41.806622 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:41.804973 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Apr 24 21:17:41.809516 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:41.809469 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:17:41.818151 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:41.817758 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Apr 24 21:17:41.818151 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:41.817820 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Apr 24 21:17:41.818151 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:41.817995 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Apr 24 21:17:41.818151 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:41.818064 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Apr 24 21:17:41.818786 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:41.818760 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-s6fd4\"" Apr 24 21:17:41.818881 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:41.818859 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Apr 24 21:17:41.819164 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:41.819144 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Apr 24 21:17:41.824132 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:41.824112 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Apr 24 21:17:41.826521 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:41.826499 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Apr 24 21:17:41.833505 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:41.833478 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Apr 24 21:17:41.835690 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:41.835657 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/35eae0e8-f86b-4321-b45c-b85993ce0a34-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"35eae0e8-f86b-4321-b45c-b85993ce0a34\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:17:41.835887 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:41.835707 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/35eae0e8-f86b-4321-b45c-b85993ce0a34-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"35eae0e8-f86b-4321-b45c-b85993ce0a34\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:17:41.835887 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:41.835733 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/35eae0e8-f86b-4321-b45c-b85993ce0a34-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"35eae0e8-f86b-4321-b45c-b85993ce0a34\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:17:41.835887 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:41.835759 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/35eae0e8-f86b-4321-b45c-b85993ce0a34-tls-assets\") pod \"alertmanager-main-0\" (UID: \"35eae0e8-f86b-4321-b45c-b85993ce0a34\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:17:41.835887 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:41.835778 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/35eae0e8-f86b-4321-b45c-b85993ce0a34-config-out\") pod \"alertmanager-main-0\" (UID: \"35eae0e8-f86b-4321-b45c-b85993ce0a34\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:17:41.835887 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:41.835792 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/35eae0e8-f86b-4321-b45c-b85993ce0a34-web-config\") pod \"alertmanager-main-0\" (UID: \"35eae0e8-f86b-4321-b45c-b85993ce0a34\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:17:41.835887 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:41.835809 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/35eae0e8-f86b-4321-b45c-b85993ce0a34-config-volume\") pod \"alertmanager-main-0\" (UID: \"35eae0e8-f86b-4321-b45c-b85993ce0a34\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:17:41.835887 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:41.835848 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35eae0e8-f86b-4321-b45c-b85993ce0a34-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"35eae0e8-f86b-4321-b45c-b85993ce0a34\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:17:41.835887 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:41.835870 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/35eae0e8-f86b-4321-b45c-b85993ce0a34-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"35eae0e8-f86b-4321-b45c-b85993ce0a34\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:17:41.835887 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:41.835891 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/35eae0e8-f86b-4321-b45c-b85993ce0a34-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"35eae0e8-f86b-4321-b45c-b85993ce0a34\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:17:41.836472 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:41.835913 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cvwp\" (UniqueName: \"kubernetes.io/projected/35eae0e8-f86b-4321-b45c-b85993ce0a34-kube-api-access-4cvwp\") pod \"alertmanager-main-0\" (UID: \"35eae0e8-f86b-4321-b45c-b85993ce0a34\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:17:41.836472 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:41.835936 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/35eae0e8-f86b-4321-b45c-b85993ce0a34-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"35eae0e8-f86b-4321-b45c-b85993ce0a34\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:17:41.836472 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:41.835955 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/35eae0e8-f86b-4321-b45c-b85993ce0a34-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"35eae0e8-f86b-4321-b45c-b85993ce0a34\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:17:41.862256 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:41.862227 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Apr 24 21:17:41.939771 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:41.939720 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/35eae0e8-f86b-4321-b45c-b85993ce0a34-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"35eae0e8-f86b-4321-b45c-b85993ce0a34\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:17:41.939771 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:41.939774 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/35eae0e8-f86b-4321-b45c-b85993ce0a34-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"35eae0e8-f86b-4321-b45c-b85993ce0a34\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:17:41.940009 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:41.939834 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/35eae0e8-f86b-4321-b45c-b85993ce0a34-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"35eae0e8-f86b-4321-b45c-b85993ce0a34\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:17:41.940009 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:41.939865 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/35eae0e8-f86b-4321-b45c-b85993ce0a34-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"35eae0e8-f86b-4321-b45c-b85993ce0a34\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:17:41.940009 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:41.939897 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/35eae0e8-f86b-4321-b45c-b85993ce0a34-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"35eae0e8-f86b-4321-b45c-b85993ce0a34\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:17:41.940009 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:41.939928 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/35eae0e8-f86b-4321-b45c-b85993ce0a34-tls-assets\") pod \"alertmanager-main-0\" (UID: \"35eae0e8-f86b-4321-b45c-b85993ce0a34\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:17:41.940009 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:41.939955 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/35eae0e8-f86b-4321-b45c-b85993ce0a34-config-out\") pod \"alertmanager-main-0\" (UID: \"35eae0e8-f86b-4321-b45c-b85993ce0a34\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:17:41.940009 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:41.939979 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/35eae0e8-f86b-4321-b45c-b85993ce0a34-web-config\") pod \"alertmanager-main-0\" (UID: \"35eae0e8-f86b-4321-b45c-b85993ce0a34\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:17:41.940009 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:41.940008 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/35eae0e8-f86b-4321-b45c-b85993ce0a34-config-volume\") pod \"alertmanager-main-0\" (UID: \"35eae0e8-f86b-4321-b45c-b85993ce0a34\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:17:41.940377 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:41.940057 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35eae0e8-f86b-4321-b45c-b85993ce0a34-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"35eae0e8-f86b-4321-b45c-b85993ce0a34\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:17:41.940377 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:41.940090 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/35eae0e8-f86b-4321-b45c-b85993ce0a34-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"35eae0e8-f86b-4321-b45c-b85993ce0a34\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:17:41.940377 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:41.940127 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/35eae0e8-f86b-4321-b45c-b85993ce0a34-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"35eae0e8-f86b-4321-b45c-b85993ce0a34\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:17:41.940377 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:41.940154 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4cvwp\" (UniqueName: \"kubernetes.io/projected/35eae0e8-f86b-4321-b45c-b85993ce0a34-kube-api-access-4cvwp\") pod \"alertmanager-main-0\" (UID: \"35eae0e8-f86b-4321-b45c-b85993ce0a34\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:17:41.940377 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:41.940249 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/35eae0e8-f86b-4321-b45c-b85993ce0a34-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"35eae0e8-f86b-4321-b45c-b85993ce0a34\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:17:41.941263 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:41.941235 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/35eae0e8-f86b-4321-b45c-b85993ce0a34-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"35eae0e8-f86b-4321-b45c-b85993ce0a34\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:17:41.943428 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:41.943406 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/35eae0e8-f86b-4321-b45c-b85993ce0a34-web-config\") pod \"alertmanager-main-0\" (UID: \"35eae0e8-f86b-4321-b45c-b85993ce0a34\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:17:41.944470 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:41.944389 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35eae0e8-f86b-4321-b45c-b85993ce0a34-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"35eae0e8-f86b-4321-b45c-b85993ce0a34\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:17:41.945976 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:41.945950 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/35eae0e8-f86b-4321-b45c-b85993ce0a34-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"35eae0e8-f86b-4321-b45c-b85993ce0a34\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:17:41.947065 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:41.946783 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/35eae0e8-f86b-4321-b45c-b85993ce0a34-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"35eae0e8-f86b-4321-b45c-b85993ce0a34\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:17:41.947065 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:41.947030 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/35eae0e8-f86b-4321-b45c-b85993ce0a34-config-out\") pod \"alertmanager-main-0\" (UID: \"35eae0e8-f86b-4321-b45c-b85993ce0a34\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:17:41.948734 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:41.948663 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/35eae0e8-f86b-4321-b45c-b85993ce0a34-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"35eae0e8-f86b-4321-b45c-b85993ce0a34\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:17:41.948734 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:41.948692 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/35eae0e8-f86b-4321-b45c-b85993ce0a34-tls-assets\") pod \"alertmanager-main-0\" (UID: \"35eae0e8-f86b-4321-b45c-b85993ce0a34\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:17:41.948734 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:41.948714 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/35eae0e8-f86b-4321-b45c-b85993ce0a34-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"35eae0e8-f86b-4321-b45c-b85993ce0a34\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:17:41.948998 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:41.948975 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/35eae0e8-f86b-4321-b45c-b85993ce0a34-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"35eae0e8-f86b-4321-b45c-b85993ce0a34\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:17:41.949177 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:41.949154 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/35eae0e8-f86b-4321-b45c-b85993ce0a34-config-volume\") pod \"alertmanager-main-0\" (UID: \"35eae0e8-f86b-4321-b45c-b85993ce0a34\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:17:41.969948 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:41.969880 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cvwp\" (UniqueName: \"kubernetes.io/projected/35eae0e8-f86b-4321-b45c-b85993ce0a34-kube-api-access-4cvwp\") pod \"alertmanager-main-0\" (UID: \"35eae0e8-f86b-4321-b45c-b85993ce0a34\") " pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:17:42.036285 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:42.035604 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hxhnc" Apr 24 21:17:42.055487 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:42.055447 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-69db897b98-xr28v" event={"ID":"11ea66de-db45-4d88-9833-f4d6f418572e","Type":"ContainerStarted","Data":"4f6b1d1e456adfddd7bf13b8d2f43379b187f8894945539b80e986152afe915b"} Apr 24 21:17:42.056740 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:42.056652 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mzs78" event={"ID":"378b1166-0b5c-4ba5-a9e8-517d1bbbe6ae","Type":"ContainerStarted","Data":"faa7b03447dde8e7442986bfc8e77b45293840bded2271bb65a231eb78c96190"} Apr 24 21:17:42.059681 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:42.059519 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9d44df66c-pdpkm" event={"ID":"9afa8910-27c9-46a8-8bc6-2fdc29d4a667","Type":"ContainerStarted","Data":"ed498e242593814141a8d3f80048758c7736a3d494de6de97835f0733d812c1f"} Apr 24 21:17:42.059681 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:42.059555 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9d44df66c-pdpkm" event={"ID":"9afa8910-27c9-46a8-8bc6-2fdc29d4a667","Type":"ContainerStarted","Data":"d17d629c1afd477c642d65c54d538bd5584e3d0c87fd96cb6d55bc73d8aa0677"} Apr 24 21:17:42.059681 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:42.059568 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9d44df66c-pdpkm" event={"ID":"9afa8910-27c9-46a8-8bc6-2fdc29d4a667","Type":"ContainerStarted","Data":"41fa8504a83ede00c0ab3edcd825f42f9ca13f867ea3cf7905f3860b257b814c"} Apr 24 21:17:42.123502 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:42.123477 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Apr 24 21:17:42.314410 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:42.314298 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Apr 24 21:17:42.813840 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:17:42.813796 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35eae0e8_f86b_4321_b45c_b85993ce0a34.slice/crio-57bacb4146f77a11eef756492f5eaa723d9fc684966f71040733a7e954c400b6 WatchSource:0}: Error finding container 57bacb4146f77a11eef756492f5eaa723d9fc684966f71040733a7e954c400b6: Status 404 returned error can't find the container with id 57bacb4146f77a11eef756492f5eaa723d9fc684966f71040733a7e954c400b6 Apr 24 21:17:43.063180 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:43.063148 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"35eae0e8-f86b-4321-b45c-b85993ce0a34","Type":"ContainerStarted","Data":"57bacb4146f77a11eef756492f5eaa723d9fc684966f71040733a7e954c400b6"} Apr 24 21:17:44.095088 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:44.095043 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qvphd" event={"ID":"29637be2-89a9-414b-81e0-8c4ebdda7fe0","Type":"ContainerStarted","Data":"9b604ec1ef9ae089fd9c19b7e1410cc9eaed7dd8ffa2e79a81ea22b72ca8841e"} Apr 24 21:17:45.099800 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.099763 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qvphd" event={"ID":"29637be2-89a9-414b-81e0-8c4ebdda7fe0","Type":"ContainerStarted","Data":"a674ffb8ba42094df87dc11262509815801dc3c40786b3bd71fe72a4e342868d"} Apr 24 21:17:45.101198 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.101172 2579 generic.go:358] "Generic (PLEG): container finished" podID="378b1166-0b5c-4ba5-a9e8-517d1bbbe6ae" containerID="1ce261cea99f3a0e0865711cbde8c24fd0021b83c196f36445af2707e4ec2526" exitCode=0 Apr 24 21:17:45.101335 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.101239 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mzs78" event={"ID":"378b1166-0b5c-4ba5-a9e8-517d1bbbe6ae","Type":"ContainerDied","Data":"1ce261cea99f3a0e0865711cbde8c24fd0021b83c196f36445af2707e4ec2526"} Apr 24 21:17:45.103031 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.102995 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9d44df66c-pdpkm" event={"ID":"9afa8910-27c9-46a8-8bc6-2fdc29d4a667","Type":"ContainerStarted","Data":"8047d9aefdc6e4bbf4031880a0ee4083db54e2840f84a9aedee13db154b36e2b"} Apr 24 21:17:45.104323 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.104303 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-s9p7t" event={"ID":"b98dea0d-9954-40bd-a46c-865213211e17","Type":"ContainerStarted","Data":"0cffa7f706c80770c362ae18108fabc17284504c8c7fb01b3e437c9be335b9d2"} Apr 24 21:17:45.104448 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.104397 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-s9p7t" Apr 24 21:17:45.106106 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.106084 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-69db897b98-xr28v" event={"ID":"11ea66de-db45-4d88-9833-f4d6f418572e","Type":"ContainerStarted","Data":"4cff4370b77d9340219cc6b5eafed3cf40cd3792b8f0125255ef595f1582a123"} Apr 24 21:17:45.106193 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.106113 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-69db897b98-xr28v" event={"ID":"11ea66de-db45-4d88-9833-f4d6f418572e","Type":"ContainerStarted","Data":"b09eac9e589a36fe93ce0e58c76e8bf8cebcae635b78d43550f44f2880825ba6"} Apr 24 21:17:45.106193 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.106128 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-69db897b98-xr28v" event={"ID":"11ea66de-db45-4d88-9833-f4d6f418572e","Type":"ContainerStarted","Data":"e085b5359da76f7e0bd9405cdb5c103172291a5dcfb86622c1743877507b6865"} Apr 24 21:17:45.107355 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.107320 2579 generic.go:358] "Generic (PLEG): container finished" podID="35eae0e8-f86b-4321-b45c-b85993ce0a34" containerID="0e07331dc8f03a0b1add4fb8dc2d3f51b4237c8b208b3c21b139a455de990904" exitCode=0 Apr 24 21:17:45.107442 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.107365 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"35eae0e8-f86b-4321-b45c-b85993ce0a34","Type":"ContainerDied","Data":"0e07331dc8f03a0b1add4fb8dc2d3f51b4237c8b208b3c21b139a455de990904"} Apr 24 21:17:45.120281 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.120233 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qvphd" podStartSLOduration=68.801042775 podStartE2EDuration="1m10.120218413s" podCreationTimestamp="2026-04-24 21:16:35 +0000 UTC" firstStartedPulling="2026-04-24 21:17:40.805738394 +0000 UTC m=+65.668463458" lastFinishedPulling="2026-04-24 21:17:42.124914027 +0000 UTC m=+66.987639096" observedRunningTime="2026-04-24 21:17:45.119118888 +0000 UTC m=+69.981844025" watchObservedRunningTime="2026-04-24 21:17:45.120218413 +0000 UTC m=+69.982943544" Apr 24 21:17:45.140563 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.140516 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-69db897b98-xr28v" podStartSLOduration=2.298839877 podStartE2EDuration="5.140502167s" podCreationTimestamp="2026-04-24 21:17:40 +0000 UTC" firstStartedPulling="2026-04-24 21:17:41.203433026 +0000 UTC m=+66.066158090" lastFinishedPulling="2026-04-24 21:17:44.045095317 +0000 UTC m=+68.907820380" observedRunningTime="2026-04-24 21:17:45.138495436 +0000 UTC m=+70.001220533" watchObservedRunningTime="2026-04-24 21:17:45.140502167 +0000 UTC m=+70.003227252" Apr 24 21:17:45.178037 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.177966 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-s9p7t" podStartSLOduration=66.805594006 podStartE2EDuration="1m10.177949424s" podCreationTimestamp="2026-04-24 21:16:35 +0000 UTC" firstStartedPulling="2026-04-24 21:17:40.761033442 +0000 UTC m=+65.623758505" lastFinishedPulling="2026-04-24 21:17:44.133388853 +0000 UTC m=+68.996113923" observedRunningTime="2026-04-24 21:17:45.177504413 +0000 UTC m=+70.040229511" watchObservedRunningTime="2026-04-24 21:17:45.177949424 +0000 UTC m=+70.040674511" Apr 24 21:17:45.252764 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.252706 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9d44df66c-pdpkm" podStartSLOduration=2.599257976 podStartE2EDuration="5.252689828s" podCreationTimestamp="2026-04-24 21:17:40 +0000 UTC" firstStartedPulling="2026-04-24 21:17:41.394416515 +0000 UTC m=+66.257141586" lastFinishedPulling="2026-04-24 21:17:44.047848372 +0000 UTC m=+68.910573438" observedRunningTime="2026-04-24 21:17:45.251659907 +0000 UTC m=+70.114384991" watchObservedRunningTime="2026-04-24 21:17:45.252689828 +0000 UTC m=+70.115414913" Apr 24 21:17:45.460214 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.460180 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-b5f7f674b-qcvqp"] Apr 24 21:17:45.463495 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.463479 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-b5f7f674b-qcvqp" Apr 24 21:17:45.467697 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.467672 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Apr 24 21:17:45.467830 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.467714 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-959c9vto8um3i\"" Apr 24 21:17:45.467991 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.467970 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Apr 24 21:17:45.471697 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.471676 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-hclgz\"" Apr 24 21:17:45.471843 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.471827 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Apr 24 21:17:45.471934 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.471921 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Apr 24 21:17:45.489704 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.489678 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-b5f7f674b-qcvqp"] Apr 24 21:17:45.570203 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.570171 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/47a3d2b1-d394-4594-9650-265f751c9c04-secret-metrics-server-tls\") pod \"metrics-server-b5f7f674b-qcvqp\" (UID: \"47a3d2b1-d394-4594-9650-265f751c9c04\") " pod="openshift-monitoring/metrics-server-b5f7f674b-qcvqp" Apr 24 21:17:45.570391 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.570218 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9p7z5\" (UniqueName: \"kubernetes.io/projected/47a3d2b1-d394-4594-9650-265f751c9c04-kube-api-access-9p7z5\") pod \"metrics-server-b5f7f674b-qcvqp\" (UID: \"47a3d2b1-d394-4594-9650-265f751c9c04\") " pod="openshift-monitoring/metrics-server-b5f7f674b-qcvqp" Apr 24 21:17:45.570391 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.570259 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/47a3d2b1-d394-4594-9650-265f751c9c04-audit-log\") pod \"metrics-server-b5f7f674b-qcvqp\" (UID: \"47a3d2b1-d394-4594-9650-265f751c9c04\") " pod="openshift-monitoring/metrics-server-b5f7f674b-qcvqp" Apr 24 21:17:45.570483 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.570420 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/47a3d2b1-d394-4594-9650-265f751c9c04-secret-metrics-server-client-certs\") pod \"metrics-server-b5f7f674b-qcvqp\" (UID: \"47a3d2b1-d394-4594-9650-265f751c9c04\") " pod="openshift-monitoring/metrics-server-b5f7f674b-qcvqp" Apr 24 21:17:45.570527 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.570463 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47a3d2b1-d394-4594-9650-265f751c9c04-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-b5f7f674b-qcvqp\" (UID: \"47a3d2b1-d394-4594-9650-265f751c9c04\") " pod="openshift-monitoring/metrics-server-b5f7f674b-qcvqp" Apr 24 21:17:45.570527 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.570510 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/47a3d2b1-d394-4594-9650-265f751c9c04-client-ca-bundle\") pod \"metrics-server-b5f7f674b-qcvqp\" (UID: \"47a3d2b1-d394-4594-9650-265f751c9c04\") " pod="openshift-monitoring/metrics-server-b5f7f674b-qcvqp" Apr 24 21:17:45.570616 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.570546 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/47a3d2b1-d394-4594-9650-265f751c9c04-metrics-server-audit-profiles\") pod \"metrics-server-b5f7f674b-qcvqp\" (UID: \"47a3d2b1-d394-4594-9650-265f751c9c04\") " pod="openshift-monitoring/metrics-server-b5f7f674b-qcvqp" Apr 24 21:17:45.671421 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.671371 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/47a3d2b1-d394-4594-9650-265f751c9c04-audit-log\") pod \"metrics-server-b5f7f674b-qcvqp\" (UID: \"47a3d2b1-d394-4594-9650-265f751c9c04\") " pod="openshift-monitoring/metrics-server-b5f7f674b-qcvqp" Apr 24 21:17:45.671585 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.671452 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/47a3d2b1-d394-4594-9650-265f751c9c04-secret-metrics-server-client-certs\") pod \"metrics-server-b5f7f674b-qcvqp\" (UID: \"47a3d2b1-d394-4594-9650-265f751c9c04\") " pod="openshift-monitoring/metrics-server-b5f7f674b-qcvqp" Apr 24 21:17:45.671585 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.671476 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47a3d2b1-d394-4594-9650-265f751c9c04-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-b5f7f674b-qcvqp\" (UID: \"47a3d2b1-d394-4594-9650-265f751c9c04\") " pod="openshift-monitoring/metrics-server-b5f7f674b-qcvqp" Apr 24 21:17:45.671585 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.671499 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/47a3d2b1-d394-4594-9650-265f751c9c04-client-ca-bundle\") pod \"metrics-server-b5f7f674b-qcvqp\" (UID: \"47a3d2b1-d394-4594-9650-265f751c9c04\") " pod="openshift-monitoring/metrics-server-b5f7f674b-qcvqp" Apr 24 21:17:45.671585 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.671524 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/47a3d2b1-d394-4594-9650-265f751c9c04-metrics-server-audit-profiles\") pod \"metrics-server-b5f7f674b-qcvqp\" (UID: \"47a3d2b1-d394-4594-9650-265f751c9c04\") " pod="openshift-monitoring/metrics-server-b5f7f674b-qcvqp" Apr 24 21:17:45.671585 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.671584 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/47a3d2b1-d394-4594-9650-265f751c9c04-secret-metrics-server-tls\") pod \"metrics-server-b5f7f674b-qcvqp\" (UID: \"47a3d2b1-d394-4594-9650-265f751c9c04\") " pod="openshift-monitoring/metrics-server-b5f7f674b-qcvqp" Apr 24 21:17:45.671853 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.671617 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9p7z5\" (UniqueName: \"kubernetes.io/projected/47a3d2b1-d394-4594-9650-265f751c9c04-kube-api-access-9p7z5\") pod \"metrics-server-b5f7f674b-qcvqp\" (UID: \"47a3d2b1-d394-4594-9650-265f751c9c04\") " pod="openshift-monitoring/metrics-server-b5f7f674b-qcvqp" Apr 24 21:17:45.671853 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.671807 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/47a3d2b1-d394-4594-9650-265f751c9c04-audit-log\") pod \"metrics-server-b5f7f674b-qcvqp\" (UID: \"47a3d2b1-d394-4594-9650-265f751c9c04\") " pod="openshift-monitoring/metrics-server-b5f7f674b-qcvqp" Apr 24 21:17:45.673840 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.673814 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/47a3d2b1-d394-4594-9650-265f751c9c04-metrics-server-audit-profiles\") pod \"metrics-server-b5f7f674b-qcvqp\" (UID: \"47a3d2b1-d394-4594-9650-265f751c9c04\") " pod="openshift-monitoring/metrics-server-b5f7f674b-qcvqp" Apr 24 21:17:45.673974 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.673890 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47a3d2b1-d394-4594-9650-265f751c9c04-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-b5f7f674b-qcvqp\" (UID: \"47a3d2b1-d394-4594-9650-265f751c9c04\") " pod="openshift-monitoring/metrics-server-b5f7f674b-qcvqp" Apr 24 21:17:45.674834 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.674800 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/47a3d2b1-d394-4594-9650-265f751c9c04-secret-metrics-server-client-certs\") pod \"metrics-server-b5f7f674b-qcvqp\" (UID: \"47a3d2b1-d394-4594-9650-265f751c9c04\") " pod="openshift-monitoring/metrics-server-b5f7f674b-qcvqp" Apr 24 21:17:45.674834 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.674796 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/47a3d2b1-d394-4594-9650-265f751c9c04-secret-metrics-server-tls\") pod \"metrics-server-b5f7f674b-qcvqp\" (UID: \"47a3d2b1-d394-4594-9650-265f751c9c04\") " pod="openshift-monitoring/metrics-server-b5f7f674b-qcvqp" Apr 24 21:17:45.675231 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.675206 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/47a3d2b1-d394-4594-9650-265f751c9c04-client-ca-bundle\") pod \"metrics-server-b5f7f674b-qcvqp\" (UID: \"47a3d2b1-d394-4594-9650-265f751c9c04\") " pod="openshift-monitoring/metrics-server-b5f7f674b-qcvqp" Apr 24 21:17:45.689088 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.689059 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9p7z5\" (UniqueName: \"kubernetes.io/projected/47a3d2b1-d394-4594-9650-265f751c9c04-kube-api-access-9p7z5\") pod \"metrics-server-b5f7f674b-qcvqp\" (UID: \"47a3d2b1-d394-4594-9650-265f751c9c04\") " pod="openshift-monitoring/metrics-server-b5f7f674b-qcvqp" Apr 24 21:17:45.715206 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.715122 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-76f654f8c8-rgjc6"] Apr 24 21:17:45.719597 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.719576 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76f654f8c8-rgjc6" Apr 24 21:17:45.731977 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.731950 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76f654f8c8-rgjc6"] Apr 24 21:17:45.747830 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.747802 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-677d7dd8cf-d74cz"] Apr 24 21:17:45.751328 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.751300 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-677d7dd8cf-d74cz" Apr 24 21:17:45.763946 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.761902 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Apr 24 21:17:45.763946 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.763483 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Apr 24 21:17:45.763946 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.763514 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Apr 24 21:17:45.763946 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.763536 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Apr 24 21:17:45.763946 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.763579 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-r4th9\"" Apr 24 21:17:45.763946 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.763516 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Apr 24 21:17:45.767284 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.767262 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Apr 24 21:17:45.772819 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.772796 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-b5f7f674b-qcvqp" Apr 24 21:17:45.772997 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.772945 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cabe4f9e-973f-4818-8e55-1ce9b8919a4c-console-config\") pod \"console-76f654f8c8-rgjc6\" (UID: \"cabe4f9e-973f-4818-8e55-1ce9b8919a4c\") " pod="openshift-console/console-76f654f8c8-rgjc6" Apr 24 21:17:45.772997 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.772991 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vxf5\" (UniqueName: \"kubernetes.io/projected/cabe4f9e-973f-4818-8e55-1ce9b8919a4c-kube-api-access-9vxf5\") pod \"console-76f654f8c8-rgjc6\" (UID: \"cabe4f9e-973f-4818-8e55-1ce9b8919a4c\") " pod="openshift-console/console-76f654f8c8-rgjc6" Apr 24 21:17:45.773110 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.773016 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cabe4f9e-973f-4818-8e55-1ce9b8919a4c-trusted-ca-bundle\") pod \"console-76f654f8c8-rgjc6\" (UID: \"cabe4f9e-973f-4818-8e55-1ce9b8919a4c\") " pod="openshift-console/console-76f654f8c8-rgjc6" Apr 24 21:17:45.773110 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.773090 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cabe4f9e-973f-4818-8e55-1ce9b8919a4c-console-oauth-config\") pod \"console-76f654f8c8-rgjc6\" (UID: \"cabe4f9e-973f-4818-8e55-1ce9b8919a4c\") " pod="openshift-console/console-76f654f8c8-rgjc6" Apr 24 21:17:45.773210 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.773158 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cabe4f9e-973f-4818-8e55-1ce9b8919a4c-console-serving-cert\") pod \"console-76f654f8c8-rgjc6\" (UID: \"cabe4f9e-973f-4818-8e55-1ce9b8919a4c\") " pod="openshift-console/console-76f654f8c8-rgjc6" Apr 24 21:17:45.773210 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.773191 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cabe4f9e-973f-4818-8e55-1ce9b8919a4c-oauth-serving-cert\") pod \"console-76f654f8c8-rgjc6\" (UID: \"cabe4f9e-973f-4818-8e55-1ce9b8919a4c\") " pod="openshift-console/console-76f654f8c8-rgjc6" Apr 24 21:17:45.773287 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.773238 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cabe4f9e-973f-4818-8e55-1ce9b8919a4c-service-ca\") pod \"console-76f654f8c8-rgjc6\" (UID: \"cabe4f9e-973f-4818-8e55-1ce9b8919a4c\") " pod="openshift-console/console-76f654f8c8-rgjc6" Apr 24 21:17:45.777908 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.777883 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-677d7dd8cf-d74cz"] Apr 24 21:17:45.875175 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.874641 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d3073940-999e-4548-b52b-d0fbd6a74e85-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-677d7dd8cf-d74cz\" (UID: \"d3073940-999e-4548-b52b-d0fbd6a74e85\") " pod="openshift-monitoring/telemeter-client-677d7dd8cf-d74cz" Apr 24 21:17:45.875175 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.874692 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d3073940-999e-4548-b52b-d0fbd6a74e85-secret-telemeter-client\") pod \"telemeter-client-677d7dd8cf-d74cz\" (UID: \"d3073940-999e-4548-b52b-d0fbd6a74e85\") " pod="openshift-monitoring/telemeter-client-677d7dd8cf-d74cz" Apr 24 21:17:45.875175 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.874718 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3073940-999e-4548-b52b-d0fbd6a74e85-metrics-client-ca\") pod \"telemeter-client-677d7dd8cf-d74cz\" (UID: \"d3073940-999e-4548-b52b-d0fbd6a74e85\") " pod="openshift-monitoring/telemeter-client-677d7dd8cf-d74cz" Apr 24 21:17:45.875175 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.874747 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3073940-999e-4548-b52b-d0fbd6a74e85-serving-certs-ca-bundle\") pod \"telemeter-client-677d7dd8cf-d74cz\" (UID: \"d3073940-999e-4548-b52b-d0fbd6a74e85\") " pod="openshift-monitoring/telemeter-client-677d7dd8cf-d74cz" Apr 24 21:17:45.875175 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.874775 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3073940-999e-4548-b52b-d0fbd6a74e85-telemeter-trusted-ca-bundle\") pod \"telemeter-client-677d7dd8cf-d74cz\" (UID: \"d3073940-999e-4548-b52b-d0fbd6a74e85\") " pod="openshift-monitoring/telemeter-client-677d7dd8cf-d74cz" Apr 24 21:17:45.875175 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.874835 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d3073940-999e-4548-b52b-d0fbd6a74e85-telemeter-client-tls\") pod \"telemeter-client-677d7dd8cf-d74cz\" (UID: \"d3073940-999e-4548-b52b-d0fbd6a74e85\") " pod="openshift-monitoring/telemeter-client-677d7dd8cf-d74cz" Apr 24 21:17:45.875175 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.874868 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cabe4f9e-973f-4818-8e55-1ce9b8919a4c-console-config\") pod \"console-76f654f8c8-rgjc6\" (UID: \"cabe4f9e-973f-4818-8e55-1ce9b8919a4c\") " pod="openshift-console/console-76f654f8c8-rgjc6" Apr 24 21:17:45.875175 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.874916 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9vxf5\" (UniqueName: \"kubernetes.io/projected/cabe4f9e-973f-4818-8e55-1ce9b8919a4c-kube-api-access-9vxf5\") pod \"console-76f654f8c8-rgjc6\" (UID: \"cabe4f9e-973f-4818-8e55-1ce9b8919a4c\") " pod="openshift-console/console-76f654f8c8-rgjc6" Apr 24 21:17:45.875175 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.874944 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cabe4f9e-973f-4818-8e55-1ce9b8919a4c-trusted-ca-bundle\") pod \"console-76f654f8c8-rgjc6\" (UID: \"cabe4f9e-973f-4818-8e55-1ce9b8919a4c\") " pod="openshift-console/console-76f654f8c8-rgjc6" Apr 24 21:17:45.875175 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.874981 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cabe4f9e-973f-4818-8e55-1ce9b8919a4c-console-oauth-config\") pod \"console-76f654f8c8-rgjc6\" (UID: \"cabe4f9e-973f-4818-8e55-1ce9b8919a4c\") " pod="openshift-console/console-76f654f8c8-rgjc6" Apr 24 21:17:45.875175 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.875051 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhd9k\" (UniqueName: \"kubernetes.io/projected/d3073940-999e-4548-b52b-d0fbd6a74e85-kube-api-access-qhd9k\") pod \"telemeter-client-677d7dd8cf-d74cz\" (UID: \"d3073940-999e-4548-b52b-d0fbd6a74e85\") " pod="openshift-monitoring/telemeter-client-677d7dd8cf-d74cz" Apr 24 21:17:45.875825 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.875673 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cabe4f9e-973f-4818-8e55-1ce9b8919a4c-console-serving-cert\") pod \"console-76f654f8c8-rgjc6\" (UID: \"cabe4f9e-973f-4818-8e55-1ce9b8919a4c\") " pod="openshift-console/console-76f654f8c8-rgjc6" Apr 24 21:17:45.876715 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.875906 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cabe4f9e-973f-4818-8e55-1ce9b8919a4c-console-config\") pod \"console-76f654f8c8-rgjc6\" (UID: \"cabe4f9e-973f-4818-8e55-1ce9b8919a4c\") " pod="openshift-console/console-76f654f8c8-rgjc6" Apr 24 21:17:45.876715 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.875975 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cabe4f9e-973f-4818-8e55-1ce9b8919a4c-oauth-serving-cert\") pod \"console-76f654f8c8-rgjc6\" (UID: \"cabe4f9e-973f-4818-8e55-1ce9b8919a4c\") " pod="openshift-console/console-76f654f8c8-rgjc6" Apr 24 21:17:45.876715 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.876013 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cabe4f9e-973f-4818-8e55-1ce9b8919a4c-service-ca\") pod \"console-76f654f8c8-rgjc6\" (UID: \"cabe4f9e-973f-4818-8e55-1ce9b8919a4c\") " pod="openshift-console/console-76f654f8c8-rgjc6" Apr 24 21:17:45.876715 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.876050 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d3073940-999e-4548-b52b-d0fbd6a74e85-federate-client-tls\") pod \"telemeter-client-677d7dd8cf-d74cz\" (UID: \"d3073940-999e-4548-b52b-d0fbd6a74e85\") " pod="openshift-monitoring/telemeter-client-677d7dd8cf-d74cz" Apr 24 21:17:45.876715 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.876612 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cabe4f9e-973f-4818-8e55-1ce9b8919a4c-oauth-serving-cert\") pod \"console-76f654f8c8-rgjc6\" (UID: \"cabe4f9e-973f-4818-8e55-1ce9b8919a4c\") " pod="openshift-console/console-76f654f8c8-rgjc6" Apr 24 21:17:45.876715 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.876617 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cabe4f9e-973f-4818-8e55-1ce9b8919a4c-trusted-ca-bundle\") pod \"console-76f654f8c8-rgjc6\" (UID: \"cabe4f9e-973f-4818-8e55-1ce9b8919a4c\") " pod="openshift-console/console-76f654f8c8-rgjc6" Apr 24 21:17:45.876715 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.876643 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cabe4f9e-973f-4818-8e55-1ce9b8919a4c-service-ca\") pod \"console-76f654f8c8-rgjc6\" (UID: \"cabe4f9e-973f-4818-8e55-1ce9b8919a4c\") " pod="openshift-console/console-76f654f8c8-rgjc6" Apr 24 21:17:45.879539 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.879519 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cabe4f9e-973f-4818-8e55-1ce9b8919a4c-console-oauth-config\") pod \"console-76f654f8c8-rgjc6\" (UID: \"cabe4f9e-973f-4818-8e55-1ce9b8919a4c\") " pod="openshift-console/console-76f654f8c8-rgjc6" Apr 24 21:17:45.880889 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.880751 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cabe4f9e-973f-4818-8e55-1ce9b8919a4c-console-serving-cert\") pod \"console-76f654f8c8-rgjc6\" (UID: \"cabe4f9e-973f-4818-8e55-1ce9b8919a4c\") " pod="openshift-console/console-76f654f8c8-rgjc6" Apr 24 21:17:45.884894 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.884871 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vxf5\" (UniqueName: \"kubernetes.io/projected/cabe4f9e-973f-4818-8e55-1ce9b8919a4c-kube-api-access-9vxf5\") pod \"console-76f654f8c8-rgjc6\" (UID: \"cabe4f9e-973f-4818-8e55-1ce9b8919a4c\") " pod="openshift-console/console-76f654f8c8-rgjc6" Apr 24 21:17:45.917885 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.917854 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-b5f7f674b-qcvqp"] Apr 24 21:17:45.921994 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:17:45.921967 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47a3d2b1_d394_4594_9650_265f751c9c04.slice/crio-ec65d74eba9be21e4c420ca43a80a0ec72fa15c2648f994c78119e1cd45f1285 WatchSource:0}: Error finding container ec65d74eba9be21e4c420ca43a80a0ec72fa15c2648f994c78119e1cd45f1285: Status 404 returned error can't find the container with id ec65d74eba9be21e4c420ca43a80a0ec72fa15c2648f994c78119e1cd45f1285 Apr 24 21:17:45.977555 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.977467 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d3073940-999e-4548-b52b-d0fbd6a74e85-telemeter-client-tls\") pod \"telemeter-client-677d7dd8cf-d74cz\" (UID: \"d3073940-999e-4548-b52b-d0fbd6a74e85\") " pod="openshift-monitoring/telemeter-client-677d7dd8cf-d74cz" Apr 24 21:17:45.977555 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.977547 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qhd9k\" (UniqueName: \"kubernetes.io/projected/d3073940-999e-4548-b52b-d0fbd6a74e85-kube-api-access-qhd9k\") pod \"telemeter-client-677d7dd8cf-d74cz\" (UID: \"d3073940-999e-4548-b52b-d0fbd6a74e85\") " pod="openshift-monitoring/telemeter-client-677d7dd8cf-d74cz" Apr 24 21:17:45.977745 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.977609 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d3073940-999e-4548-b52b-d0fbd6a74e85-federate-client-tls\") pod \"telemeter-client-677d7dd8cf-d74cz\" (UID: \"d3073940-999e-4548-b52b-d0fbd6a74e85\") " pod="openshift-monitoring/telemeter-client-677d7dd8cf-d74cz" Apr 24 21:17:45.977745 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.977637 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d3073940-999e-4548-b52b-d0fbd6a74e85-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-677d7dd8cf-d74cz\" (UID: \"d3073940-999e-4548-b52b-d0fbd6a74e85\") " pod="openshift-monitoring/telemeter-client-677d7dd8cf-d74cz" Apr 24 21:17:45.977745 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.977666 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d3073940-999e-4548-b52b-d0fbd6a74e85-secret-telemeter-client\") pod \"telemeter-client-677d7dd8cf-d74cz\" (UID: \"d3073940-999e-4548-b52b-d0fbd6a74e85\") " pod="openshift-monitoring/telemeter-client-677d7dd8cf-d74cz" Apr 24 21:17:45.977745 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.977692 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3073940-999e-4548-b52b-d0fbd6a74e85-metrics-client-ca\") pod \"telemeter-client-677d7dd8cf-d74cz\" (UID: \"d3073940-999e-4548-b52b-d0fbd6a74e85\") " pod="openshift-monitoring/telemeter-client-677d7dd8cf-d74cz" Apr 24 21:17:45.977745 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.977718 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3073940-999e-4548-b52b-d0fbd6a74e85-serving-certs-ca-bundle\") pod \"telemeter-client-677d7dd8cf-d74cz\" (UID: \"d3073940-999e-4548-b52b-d0fbd6a74e85\") " pod="openshift-monitoring/telemeter-client-677d7dd8cf-d74cz" Apr 24 21:17:45.977996 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.977747 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3073940-999e-4548-b52b-d0fbd6a74e85-telemeter-trusted-ca-bundle\") pod \"telemeter-client-677d7dd8cf-d74cz\" (UID: \"d3073940-999e-4548-b52b-d0fbd6a74e85\") " pod="openshift-monitoring/telemeter-client-677d7dd8cf-d74cz" Apr 24 21:17:45.979095 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.978935 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3073940-999e-4548-b52b-d0fbd6a74e85-telemeter-trusted-ca-bundle\") pod \"telemeter-client-677d7dd8cf-d74cz\" (UID: \"d3073940-999e-4548-b52b-d0fbd6a74e85\") " pod="openshift-monitoring/telemeter-client-677d7dd8cf-d74cz" Apr 24 21:17:45.979751 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.979629 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3073940-999e-4548-b52b-d0fbd6a74e85-metrics-client-ca\") pod \"telemeter-client-677d7dd8cf-d74cz\" (UID: \"d3073940-999e-4548-b52b-d0fbd6a74e85\") " pod="openshift-monitoring/telemeter-client-677d7dd8cf-d74cz" Apr 24 21:17:45.980536 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.980511 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3073940-999e-4548-b52b-d0fbd6a74e85-serving-certs-ca-bundle\") pod \"telemeter-client-677d7dd8cf-d74cz\" (UID: \"d3073940-999e-4548-b52b-d0fbd6a74e85\") " pod="openshift-monitoring/telemeter-client-677d7dd8cf-d74cz" Apr 24 21:17:45.980783 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.980761 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d3073940-999e-4548-b52b-d0fbd6a74e85-telemeter-client-tls\") pod \"telemeter-client-677d7dd8cf-d74cz\" (UID: \"d3073940-999e-4548-b52b-d0fbd6a74e85\") " pod="openshift-monitoring/telemeter-client-677d7dd8cf-d74cz" Apr 24 21:17:45.981193 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.981043 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d3073940-999e-4548-b52b-d0fbd6a74e85-secret-telemeter-client\") pod \"telemeter-client-677d7dd8cf-d74cz\" (UID: \"d3073940-999e-4548-b52b-d0fbd6a74e85\") " pod="openshift-monitoring/telemeter-client-677d7dd8cf-d74cz" Apr 24 21:17:45.981281 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.981265 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d3073940-999e-4548-b52b-d0fbd6a74e85-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-677d7dd8cf-d74cz\" (UID: \"d3073940-999e-4548-b52b-d0fbd6a74e85\") " pod="openshift-monitoring/telemeter-client-677d7dd8cf-d74cz" Apr 24 21:17:45.981405 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.981388 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d3073940-999e-4548-b52b-d0fbd6a74e85-federate-client-tls\") pod \"telemeter-client-677d7dd8cf-d74cz\" (UID: \"d3073940-999e-4548-b52b-d0fbd6a74e85\") " pod="openshift-monitoring/telemeter-client-677d7dd8cf-d74cz" Apr 24 21:17:45.990522 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:45.990500 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhd9k\" (UniqueName: \"kubernetes.io/projected/d3073940-999e-4548-b52b-d0fbd6a74e85-kube-api-access-qhd9k\") pod \"telemeter-client-677d7dd8cf-d74cz\" (UID: \"d3073940-999e-4548-b52b-d0fbd6a74e85\") " pod="openshift-monitoring/telemeter-client-677d7dd8cf-d74cz" Apr 24 21:17:46.031907 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:46.031872 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76f654f8c8-rgjc6" Apr 24 21:17:46.067031 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:46.066990 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-677d7dd8cf-d74cz" Apr 24 21:17:46.111734 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:46.111696 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-b5f7f674b-qcvqp" event={"ID":"47a3d2b1-d394-4594-9650-265f751c9c04","Type":"ContainerStarted","Data":"ec65d74eba9be21e4c420ca43a80a0ec72fa15c2648f994c78119e1cd45f1285"} Apr 24 21:17:46.114306 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:46.113762 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mzs78" event={"ID":"378b1166-0b5c-4ba5-a9e8-517d1bbbe6ae","Type":"ContainerStarted","Data":"641849c9d9ea4cd5b2aa1257944758fe25af2b5be12d5870cde163c6e83b1df9"} Apr 24 21:17:46.114306 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:46.113807 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mzs78" event={"ID":"378b1166-0b5c-4ba5-a9e8-517d1bbbe6ae","Type":"ContainerStarted","Data":"9939de1f9c5701a8bccbf376169ade5e14f99d9308cfb2cf9b5f51ac4b58c77a"} Apr 24 21:17:46.144199 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:46.144137 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-mzs78" podStartSLOduration=3.55104039 podStartE2EDuration="6.144118659s" podCreationTimestamp="2026-04-24 21:17:40 +0000 UTC" firstStartedPulling="2026-04-24 21:17:41.453479884 +0000 UTC m=+66.316204947" lastFinishedPulling="2026-04-24 21:17:44.046558152 +0000 UTC m=+68.909283216" observedRunningTime="2026-04-24 21:17:46.142754286 +0000 UTC m=+71.005479383" watchObservedRunningTime="2026-04-24 21:17:46.144118659 +0000 UTC m=+71.006843748" Apr 24 21:17:46.475638 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:46.475609 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76f654f8c8-rgjc6"] Apr 24 21:17:46.479845 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:17:46.479804 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcabe4f9e_973f_4818_8e55_1ce9b8919a4c.slice/crio-d966ebf5021123f9c53a28bfcb07ab8787774aca384a2845f5a195f0bdb5a2a5 WatchSource:0}: Error finding container d966ebf5021123f9c53a28bfcb07ab8787774aca384a2845f5a195f0bdb5a2a5: Status 404 returned error can't find the container with id d966ebf5021123f9c53a28bfcb07ab8787774aca384a2845f5a195f0bdb5a2a5 Apr 24 21:17:46.492031 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:46.492001 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-677d7dd8cf-d74cz"] Apr 24 21:17:46.495517 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:17:46.494463 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3073940_999e_4548_b52b_d0fbd6a74e85.slice/crio-2b699353f99dace1efea1b94fbab9022969ce66b2f9256bcd0fd582d003beed5 WatchSource:0}: Error finding container 2b699353f99dace1efea1b94fbab9022969ce66b2f9256bcd0fd582d003beed5: Status 404 returned error can't find the container with id 2b699353f99dace1efea1b94fbab9022969ce66b2f9256bcd0fd582d003beed5 Apr 24 21:17:47.119406 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:47.119364 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76f654f8c8-rgjc6" event={"ID":"cabe4f9e-973f-4818-8e55-1ce9b8919a4c","Type":"ContainerStarted","Data":"90bc1bf5ae43a35a13ba2871e29f0221d29ac4bd6b7daaf70655614649b22b4a"} Apr 24 21:17:47.119406 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:47.119408 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76f654f8c8-rgjc6" event={"ID":"cabe4f9e-973f-4818-8e55-1ce9b8919a4c","Type":"ContainerStarted","Data":"d966ebf5021123f9c53a28bfcb07ab8787774aca384a2845f5a195f0bdb5a2a5"} Apr 24 21:17:47.123048 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:47.122951 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"35eae0e8-f86b-4321-b45c-b85993ce0a34","Type":"ContainerStarted","Data":"87aa0b9ce2354b562f546a5f951991e2d024cce63f371a0a8ab51ba1b837c2f2"} Apr 24 21:17:47.123048 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:47.122985 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"35eae0e8-f86b-4321-b45c-b85993ce0a34","Type":"ContainerStarted","Data":"42e19674cd9ab18f30014b25398021afa4fb14625ecc03d86982d109aaa368c6"} Apr 24 21:17:47.123048 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:47.122999 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"35eae0e8-f86b-4321-b45c-b85993ce0a34","Type":"ContainerStarted","Data":"407646b65aa59e514207ad13851c843a2591739fa1b3ae6388ce6b4bd1992cc0"} Apr 24 21:17:47.123048 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:47.123011 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"35eae0e8-f86b-4321-b45c-b85993ce0a34","Type":"ContainerStarted","Data":"c6b6b38e73a2af9970ed032a624d6fef8280bbf34373b54030b12e62fa724e00"} Apr 24 21:17:47.123048 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:47.123022 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"35eae0e8-f86b-4321-b45c-b85993ce0a34","Type":"ContainerStarted","Data":"8921cd16b181b65db5c3e759c83844f9f4fa8449fe526a903d27921e0fd1cd59"} Apr 24 21:17:47.125082 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:47.125052 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-677d7dd8cf-d74cz" event={"ID":"d3073940-999e-4548-b52b-d0fbd6a74e85","Type":"ContainerStarted","Data":"2b699353f99dace1efea1b94fbab9022969ce66b2f9256bcd0fd582d003beed5"} Apr 24 21:17:47.138695 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:47.138639 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-76f654f8c8-rgjc6" podStartSLOduration=2.13862096 podStartE2EDuration="2.13862096s" podCreationTimestamp="2026-04-24 21:17:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-24 21:17:47.137096912 +0000 UTC m=+71.999821996" watchObservedRunningTime="2026-04-24 21:17:47.13862096 +0000 UTC m=+72.001346045" Apr 24 21:17:48.128740 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:48.128700 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-b5f7f674b-qcvqp" event={"ID":"47a3d2b1-d394-4594-9650-265f751c9c04","Type":"ContainerStarted","Data":"0108d83110c553da1779f6091c45aab4d1e79a195dc8744d1905a5757a32bfb3"} Apr 24 21:17:48.156886 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:48.156832 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-b5f7f674b-qcvqp" podStartSLOduration=1.6743048109999998 podStartE2EDuration="3.156816818s" podCreationTimestamp="2026-04-24 21:17:45 +0000 UTC" firstStartedPulling="2026-04-24 21:17:45.924001931 +0000 UTC m=+70.786726995" lastFinishedPulling="2026-04-24 21:17:47.40651394 +0000 UTC m=+72.269239002" observedRunningTime="2026-04-24 21:17:48.156002609 +0000 UTC m=+73.018727694" watchObservedRunningTime="2026-04-24 21:17:48.156816818 +0000 UTC m=+73.019541902" Apr 24 21:17:49.134652 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:49.134614 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"35eae0e8-f86b-4321-b45c-b85993ce0a34","Type":"ContainerStarted","Data":"33a24ae95f966ef77a928c56c4bd97ec7a3308d3714d910b6890d95fadf02fac"} Apr 24 21:17:49.136415 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:49.136378 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-677d7dd8cf-d74cz" event={"ID":"d3073940-999e-4548-b52b-d0fbd6a74e85","Type":"ContainerStarted","Data":"f7859fe5cad904b44d667c59def21f1199df7f8eb651e66f5c0a5f58ef00ad7c"} Apr 24 21:17:49.136415 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:49.136417 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-677d7dd8cf-d74cz" event={"ID":"d3073940-999e-4548-b52b-d0fbd6a74e85","Type":"ContainerStarted","Data":"97b039cea260e7f6ab461bf44522945a3646df50c0d7e06a414f6e119d1ce4af"} Apr 24 21:17:49.136415 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:49.136427 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-677d7dd8cf-d74cz" event={"ID":"d3073940-999e-4548-b52b-d0fbd6a74e85","Type":"ContainerStarted","Data":"b0852082e37547700521941a6a320659dc4aff47b5a35ea28aeee4005aaeaef8"} Apr 24 21:17:49.167388 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:49.167317 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.80912953 podStartE2EDuration="8.167299395s" podCreationTimestamp="2026-04-24 21:17:41 +0000 UTC" firstStartedPulling="2026-04-24 21:17:42.820135769 +0000 UTC m=+67.682860838" lastFinishedPulling="2026-04-24 21:17:48.178305636 +0000 UTC m=+73.041030703" observedRunningTime="2026-04-24 21:17:49.165534995 +0000 UTC m=+74.028260114" watchObservedRunningTime="2026-04-24 21:17:49.167299395 +0000 UTC m=+74.030024481" Apr 24 21:17:49.191057 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:49.190998 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-677d7dd8cf-d74cz" podStartSLOduration=2.51023298 podStartE2EDuration="4.190979758s" podCreationTimestamp="2026-04-24 21:17:45 +0000 UTC" firstStartedPulling="2026-04-24 21:17:46.497555914 +0000 UTC m=+71.360280982" lastFinishedPulling="2026-04-24 21:17:48.178302695 +0000 UTC m=+73.041027760" observedRunningTime="2026-04-24 21:17:49.190658183 +0000 UTC m=+74.053383268" watchObservedRunningTime="2026-04-24 21:17:49.190979758 +0000 UTC m=+74.053704844" Apr 24 21:17:52.221198 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:52.221090 2579 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76f654f8c8-rgjc6"] Apr 24 21:17:52.262011 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:52.261979 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c8f57c879-d244c"] Apr 24 21:17:52.265291 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:52.265271 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c8f57c879-d244c" Apr 24 21:17:52.279316 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:52.279291 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c8f57c879-d244c"] Apr 24 21:17:52.332213 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:52.332174 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c813787-c89c-4e7f-847c-ba67384c31bb-service-ca\") pod \"console-5c8f57c879-d244c\" (UID: \"0c813787-c89c-4e7f-847c-ba67384c31bb\") " pod="openshift-console/console-5c8f57c879-d244c" Apr 24 21:17:52.332213 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:52.332211 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c813787-c89c-4e7f-847c-ba67384c31bb-console-oauth-config\") pod \"console-5c8f57c879-d244c\" (UID: \"0c813787-c89c-4e7f-847c-ba67384c31bb\") " pod="openshift-console/console-5c8f57c879-d244c" Apr 24 21:17:52.332455 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:52.332266 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c813787-c89c-4e7f-847c-ba67384c31bb-trusted-ca-bundle\") pod \"console-5c8f57c879-d244c\" (UID: \"0c813787-c89c-4e7f-847c-ba67384c31bb\") " pod="openshift-console/console-5c8f57c879-d244c" Apr 24 21:17:52.332455 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:52.332292 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c813787-c89c-4e7f-847c-ba67384c31bb-console-serving-cert\") pod \"console-5c8f57c879-d244c\" (UID: \"0c813787-c89c-4e7f-847c-ba67384c31bb\") " pod="openshift-console/console-5c8f57c879-d244c" Apr 24 21:17:52.332455 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:52.332322 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c813787-c89c-4e7f-847c-ba67384c31bb-console-config\") pod \"console-5c8f57c879-d244c\" (UID: \"0c813787-c89c-4e7f-847c-ba67384c31bb\") " pod="openshift-console/console-5c8f57c879-d244c" Apr 24 21:17:52.332455 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:52.332350 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c813787-c89c-4e7f-847c-ba67384c31bb-oauth-serving-cert\") pod \"console-5c8f57c879-d244c\" (UID: \"0c813787-c89c-4e7f-847c-ba67384c31bb\") " pod="openshift-console/console-5c8f57c879-d244c" Apr 24 21:17:52.332455 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:52.332405 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qbcd\" (UniqueName: \"kubernetes.io/projected/0c813787-c89c-4e7f-847c-ba67384c31bb-kube-api-access-7qbcd\") pod \"console-5c8f57c879-d244c\" (UID: \"0c813787-c89c-4e7f-847c-ba67384c31bb\") " pod="openshift-console/console-5c8f57c879-d244c" Apr 24 21:17:52.433534 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:52.433496 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c813787-c89c-4e7f-847c-ba67384c31bb-console-config\") pod \"console-5c8f57c879-d244c\" (UID: \"0c813787-c89c-4e7f-847c-ba67384c31bb\") " pod="openshift-console/console-5c8f57c879-d244c" Apr 24 21:17:52.433534 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:52.433535 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c813787-c89c-4e7f-847c-ba67384c31bb-oauth-serving-cert\") pod \"console-5c8f57c879-d244c\" (UID: \"0c813787-c89c-4e7f-847c-ba67384c31bb\") " pod="openshift-console/console-5c8f57c879-d244c" Apr 24 21:17:52.433777 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:52.433553 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7qbcd\" (UniqueName: \"kubernetes.io/projected/0c813787-c89c-4e7f-847c-ba67384c31bb-kube-api-access-7qbcd\") pod \"console-5c8f57c879-d244c\" (UID: \"0c813787-c89c-4e7f-847c-ba67384c31bb\") " pod="openshift-console/console-5c8f57c879-d244c" Apr 24 21:17:52.433777 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:52.433585 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c813787-c89c-4e7f-847c-ba67384c31bb-service-ca\") pod \"console-5c8f57c879-d244c\" (UID: \"0c813787-c89c-4e7f-847c-ba67384c31bb\") " pod="openshift-console/console-5c8f57c879-d244c" Apr 24 21:17:52.433777 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:52.433607 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c813787-c89c-4e7f-847c-ba67384c31bb-console-oauth-config\") pod \"console-5c8f57c879-d244c\" (UID: \"0c813787-c89c-4e7f-847c-ba67384c31bb\") " pod="openshift-console/console-5c8f57c879-d244c" Apr 24 21:17:52.433777 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:52.433668 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c813787-c89c-4e7f-847c-ba67384c31bb-trusted-ca-bundle\") pod \"console-5c8f57c879-d244c\" (UID: \"0c813787-c89c-4e7f-847c-ba67384c31bb\") " pod="openshift-console/console-5c8f57c879-d244c" Apr 24 21:17:52.433777 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:52.433705 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c813787-c89c-4e7f-847c-ba67384c31bb-console-serving-cert\") pod \"console-5c8f57c879-d244c\" (UID: \"0c813787-c89c-4e7f-847c-ba67384c31bb\") " pod="openshift-console/console-5c8f57c879-d244c" Apr 24 21:17:52.434302 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:52.434277 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c813787-c89c-4e7f-847c-ba67384c31bb-service-ca\") pod \"console-5c8f57c879-d244c\" (UID: \"0c813787-c89c-4e7f-847c-ba67384c31bb\") " pod="openshift-console/console-5c8f57c879-d244c" Apr 24 21:17:52.434416 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:52.434312 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c813787-c89c-4e7f-847c-ba67384c31bb-console-config\") pod \"console-5c8f57c879-d244c\" (UID: \"0c813787-c89c-4e7f-847c-ba67384c31bb\") " pod="openshift-console/console-5c8f57c879-d244c" Apr 24 21:17:52.434416 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:52.434322 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c813787-c89c-4e7f-847c-ba67384c31bb-oauth-serving-cert\") pod \"console-5c8f57c879-d244c\" (UID: \"0c813787-c89c-4e7f-847c-ba67384c31bb\") " pod="openshift-console/console-5c8f57c879-d244c" Apr 24 21:17:52.434766 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:52.434743 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c813787-c89c-4e7f-847c-ba67384c31bb-trusted-ca-bundle\") pod \"console-5c8f57c879-d244c\" (UID: \"0c813787-c89c-4e7f-847c-ba67384c31bb\") " pod="openshift-console/console-5c8f57c879-d244c" Apr 24 21:17:52.436381 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:52.436356 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c813787-c89c-4e7f-847c-ba67384c31bb-console-oauth-config\") pod \"console-5c8f57c879-d244c\" (UID: \"0c813787-c89c-4e7f-847c-ba67384c31bb\") " pod="openshift-console/console-5c8f57c879-d244c" Apr 24 21:17:52.436469 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:52.436368 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c813787-c89c-4e7f-847c-ba67384c31bb-console-serving-cert\") pod \"console-5c8f57c879-d244c\" (UID: \"0c813787-c89c-4e7f-847c-ba67384c31bb\") " pod="openshift-console/console-5c8f57c879-d244c" Apr 24 21:17:52.443724 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:52.443700 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qbcd\" (UniqueName: \"kubernetes.io/projected/0c813787-c89c-4e7f-847c-ba67384c31bb-kube-api-access-7qbcd\") pod \"console-5c8f57c879-d244c\" (UID: \"0c813787-c89c-4e7f-847c-ba67384c31bb\") " pod="openshift-console/console-5c8f57c879-d244c" Apr 24 21:17:52.574002 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:52.573906 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c8f57c879-d244c" Apr 24 21:17:52.696235 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:52.696192 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c8f57c879-d244c"] Apr 24 21:17:52.700494 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:17:52.700464 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c813787_c89c_4e7f_847c_ba67384c31bb.slice/crio-aa373e29b044f927bc56898890b34dc2c96b934e83163b650193a99a47354889 WatchSource:0}: Error finding container aa373e29b044f927bc56898890b34dc2c96b934e83163b650193a99a47354889: Status 404 returned error can't find the container with id aa373e29b044f927bc56898890b34dc2c96b934e83163b650193a99a47354889 Apr 24 21:17:53.148711 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:53.148680 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c8f57c879-d244c" event={"ID":"0c813787-c89c-4e7f-847c-ba67384c31bb","Type":"ContainerStarted","Data":"561f8854b5f4e9676886b5e2d98dd733ccddb7464cdef32fc774f48a3924d80f"} Apr 24 21:17:53.148711 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:53.148713 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c8f57c879-d244c" event={"ID":"0c813787-c89c-4e7f-847c-ba67384c31bb","Type":"ContainerStarted","Data":"aa373e29b044f927bc56898890b34dc2c96b934e83163b650193a99a47354889"} Apr 24 21:17:53.191822 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:53.191775 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5c8f57c879-d244c" podStartSLOduration=1.1917608419999999 podStartE2EDuration="1.191760842s" podCreationTimestamp="2026-04-24 21:17:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-24 21:17:53.191524671 +0000 UTC m=+78.054249757" watchObservedRunningTime="2026-04-24 21:17:53.191760842 +0000 UTC m=+78.054485926" Apr 24 21:17:56.032689 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:17:56.032628 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-76f654f8c8-rgjc6" Apr 24 21:18:02.574282 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:02.574235 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c8f57c879-d244c" Apr 24 21:18:02.574915 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:02.574295 2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c8f57c879-d244c" Apr 24 21:18:02.578914 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:02.578890 2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c8f57c879-d244c" Apr 24 21:18:03.181023 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:03.180998 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c8f57c879-d244c" Apr 24 21:18:03.266006 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:03.265972 2579 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54c7ffcd54-p7j5r"] Apr 24 21:18:05.773595 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:05.773567 2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-b5f7f674b-qcvqp" Apr 24 21:18:05.773595 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:05.773603 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-b5f7f674b-qcvqp" Apr 24 21:18:16.116777 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:16.116747 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-s9p7t" Apr 24 21:18:17.240013 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:17.239976 2579 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-76f654f8c8-rgjc6" podUID="cabe4f9e-973f-4818-8e55-1ce9b8919a4c" containerName="console" containerID="cri-o://90bc1bf5ae43a35a13ba2871e29f0221d29ac4bd6b7daaf70655614649b22b4a" gracePeriod=15 Apr 24 21:18:17.533665 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:17.533643 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-76f654f8c8-rgjc6_cabe4f9e-973f-4818-8e55-1ce9b8919a4c/console/0.log" Apr 24 21:18:17.533780 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:17.533727 2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76f654f8c8-rgjc6" Apr 24 21:18:17.643329 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:17.643288 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cabe4f9e-973f-4818-8e55-1ce9b8919a4c-trusted-ca-bundle\") pod \"cabe4f9e-973f-4818-8e55-1ce9b8919a4c\" (UID: \"cabe4f9e-973f-4818-8e55-1ce9b8919a4c\") " Apr 24 21:18:17.643329 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:17.643335 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9vxf5\" (UniqueName: \"kubernetes.io/projected/cabe4f9e-973f-4818-8e55-1ce9b8919a4c-kube-api-access-9vxf5\") pod \"cabe4f9e-973f-4818-8e55-1ce9b8919a4c\" (UID: \"cabe4f9e-973f-4818-8e55-1ce9b8919a4c\") " Apr 24 21:18:17.643577 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:17.643376 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cabe4f9e-973f-4818-8e55-1ce9b8919a4c-console-serving-cert\") pod \"cabe4f9e-973f-4818-8e55-1ce9b8919a4c\" (UID: \"cabe4f9e-973f-4818-8e55-1ce9b8919a4c\") " Apr 24 21:18:17.643577 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:17.643392 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cabe4f9e-973f-4818-8e55-1ce9b8919a4c-oauth-serving-cert\") pod \"cabe4f9e-973f-4818-8e55-1ce9b8919a4c\" (UID: \"cabe4f9e-973f-4818-8e55-1ce9b8919a4c\") " Apr 24 21:18:17.643577 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:17.643414 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cabe4f9e-973f-4818-8e55-1ce9b8919a4c-console-oauth-config\") pod \"cabe4f9e-973f-4818-8e55-1ce9b8919a4c\" (UID: \"cabe4f9e-973f-4818-8e55-1ce9b8919a4c\") " Apr 24 21:18:17.643577 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:17.643496 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cabe4f9e-973f-4818-8e55-1ce9b8919a4c-console-config\") pod \"cabe4f9e-973f-4818-8e55-1ce9b8919a4c\" (UID: \"cabe4f9e-973f-4818-8e55-1ce9b8919a4c\") " Apr 24 21:18:17.643577 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:17.643516 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cabe4f9e-973f-4818-8e55-1ce9b8919a4c-service-ca\") pod \"cabe4f9e-973f-4818-8e55-1ce9b8919a4c\" (UID: \"cabe4f9e-973f-4818-8e55-1ce9b8919a4c\") " Apr 24 21:18:17.643813 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:17.643709 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cabe4f9e-973f-4818-8e55-1ce9b8919a4c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "cabe4f9e-973f-4818-8e55-1ce9b8919a4c" (UID: "cabe4f9e-973f-4818-8e55-1ce9b8919a4c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 24 21:18:17.643813 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:17.643763 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cabe4f9e-973f-4818-8e55-1ce9b8919a4c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cabe4f9e-973f-4818-8e55-1ce9b8919a4c" (UID: "cabe4f9e-973f-4818-8e55-1ce9b8919a4c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 24 21:18:17.643997 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:17.643972 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cabe4f9e-973f-4818-8e55-1ce9b8919a4c-service-ca" (OuterVolumeSpecName: "service-ca") pod "cabe4f9e-973f-4818-8e55-1ce9b8919a4c" (UID: "cabe4f9e-973f-4818-8e55-1ce9b8919a4c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 24 21:18:17.644091 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:17.643978 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cabe4f9e-973f-4818-8e55-1ce9b8919a4c-console-config" (OuterVolumeSpecName: "console-config") pod "cabe4f9e-973f-4818-8e55-1ce9b8919a4c" (UID: "cabe4f9e-973f-4818-8e55-1ce9b8919a4c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 24 21:18:17.645757 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:17.645731 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cabe4f9e-973f-4818-8e55-1ce9b8919a4c-kube-api-access-9vxf5" (OuterVolumeSpecName: "kube-api-access-9vxf5") pod "cabe4f9e-973f-4818-8e55-1ce9b8919a4c" (UID: "cabe4f9e-973f-4818-8e55-1ce9b8919a4c"). InnerVolumeSpecName "kube-api-access-9vxf5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 24 21:18:17.645869 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:17.645754 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cabe4f9e-973f-4818-8e55-1ce9b8919a4c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cabe4f9e-973f-4818-8e55-1ce9b8919a4c" (UID: "cabe4f9e-973f-4818-8e55-1ce9b8919a4c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 24 21:18:17.646030 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:17.646010 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cabe4f9e-973f-4818-8e55-1ce9b8919a4c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cabe4f9e-973f-4818-8e55-1ce9b8919a4c" (UID: "cabe4f9e-973f-4818-8e55-1ce9b8919a4c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 24 21:18:17.745179 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:17.745144 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cabe4f9e-973f-4818-8e55-1ce9b8919a4c-trusted-ca-bundle\") on node \"ip-10-0-142-241.ec2.internal\" DevicePath \"\"" Apr 24 21:18:17.745179 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:17.745182 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9vxf5\" (UniqueName: \"kubernetes.io/projected/cabe4f9e-973f-4818-8e55-1ce9b8919a4c-kube-api-access-9vxf5\") on node \"ip-10-0-142-241.ec2.internal\" DevicePath \"\"" Apr 24 21:18:17.745428 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:17.745197 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cabe4f9e-973f-4818-8e55-1ce9b8919a4c-console-serving-cert\") on node \"ip-10-0-142-241.ec2.internal\" DevicePath \"\"" Apr 24 21:18:17.745428 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:17.745210 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cabe4f9e-973f-4818-8e55-1ce9b8919a4c-oauth-serving-cert\") on node \"ip-10-0-142-241.ec2.internal\" DevicePath \"\"" Apr 24 21:18:17.745428 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:17.745224 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cabe4f9e-973f-4818-8e55-1ce9b8919a4c-console-oauth-config\") on node \"ip-10-0-142-241.ec2.internal\" DevicePath \"\"" Apr 24 21:18:17.745428 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:17.745236 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cabe4f9e-973f-4818-8e55-1ce9b8919a4c-console-config\") on node \"ip-10-0-142-241.ec2.internal\" DevicePath \"\"" Apr 24 21:18:17.745428 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:17.745249 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cabe4f9e-973f-4818-8e55-1ce9b8919a4c-service-ca\") on node \"ip-10-0-142-241.ec2.internal\" DevicePath \"\"" Apr 24 21:18:18.223027 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:18.222996 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-76f654f8c8-rgjc6_cabe4f9e-973f-4818-8e55-1ce9b8919a4c/console/0.log" Apr 24 21:18:18.223201 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:18.223047 2579 generic.go:358] "Generic (PLEG): container finished" podID="cabe4f9e-973f-4818-8e55-1ce9b8919a4c" containerID="90bc1bf5ae43a35a13ba2871e29f0221d29ac4bd6b7daaf70655614649b22b4a" exitCode=2 Apr 24 21:18:18.223201 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:18.223105 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76f654f8c8-rgjc6" event={"ID":"cabe4f9e-973f-4818-8e55-1ce9b8919a4c","Type":"ContainerDied","Data":"90bc1bf5ae43a35a13ba2871e29f0221d29ac4bd6b7daaf70655614649b22b4a"} Apr 24 21:18:18.223201 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:18.223128 2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76f654f8c8-rgjc6" Apr 24 21:18:18.223201 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:18.223160 2579 scope.go:117] "RemoveContainer" containerID="90bc1bf5ae43a35a13ba2871e29f0221d29ac4bd6b7daaf70655614649b22b4a" Apr 24 21:18:18.223396 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:18.223133 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76f654f8c8-rgjc6" event={"ID":"cabe4f9e-973f-4818-8e55-1ce9b8919a4c","Type":"ContainerDied","Data":"d966ebf5021123f9c53a28bfcb07ab8787774aca384a2845f5a195f0bdb5a2a5"} Apr 24 21:18:18.241480 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:18.241315 2579 scope.go:117] "RemoveContainer" containerID="90bc1bf5ae43a35a13ba2871e29f0221d29ac4bd6b7daaf70655614649b22b4a" Apr 24 21:18:18.241790 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:18:18.241692 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90bc1bf5ae43a35a13ba2871e29f0221d29ac4bd6b7daaf70655614649b22b4a\": container with ID starting with 90bc1bf5ae43a35a13ba2871e29f0221d29ac4bd6b7daaf70655614649b22b4a not found: ID does not exist" containerID="90bc1bf5ae43a35a13ba2871e29f0221d29ac4bd6b7daaf70655614649b22b4a" Apr 24 21:18:18.241790 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:18.241733 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90bc1bf5ae43a35a13ba2871e29f0221d29ac4bd6b7daaf70655614649b22b4a"} err="failed to get container status \"90bc1bf5ae43a35a13ba2871e29f0221d29ac4bd6b7daaf70655614649b22b4a\": rpc error: code = NotFound desc = could not find container \"90bc1bf5ae43a35a13ba2871e29f0221d29ac4bd6b7daaf70655614649b22b4a\": container with ID starting with 90bc1bf5ae43a35a13ba2871e29f0221d29ac4bd6b7daaf70655614649b22b4a not found: ID does not exist" Apr 24 21:18:18.242737 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:18.242709 2579 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76f654f8c8-rgjc6"] Apr 24 21:18:18.247088 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:18.247043 2579 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-76f654f8c8-rgjc6"] Apr 24 21:18:19.771834 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:19.771797 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cabe4f9e-973f-4818-8e55-1ce9b8919a4c" path="/var/lib/kubelet/pods/cabe4f9e-973f-4818-8e55-1ce9b8919a4c/volumes" Apr 24 21:18:25.778086 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:25.778057 2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-b5f7f674b-qcvqp" Apr 24 21:18:25.781865 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:25.781845 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-b5f7f674b-qcvqp" Apr 24 21:18:28.284407 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:28.284368 2579 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-54c7ffcd54-p7j5r" podUID="b8a272a5-98e2-4c95-b1ea-b7831db12313" containerName="console" containerID="cri-o://3eb2869900781f778ade0d08aaf8707e0a984d01017072c40354422cf30bba88" gracePeriod=15 Apr 24 21:18:28.521858 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:28.521836 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-54c7ffcd54-p7j5r_b8a272a5-98e2-4c95-b1ea-b7831db12313/console/0.log" Apr 24 21:18:28.522006 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:28.521906 2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54c7ffcd54-p7j5r" Apr 24 21:18:28.527376 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:28.527354 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b8a272a5-98e2-4c95-b1ea-b7831db12313-console-serving-cert\") pod \"b8a272a5-98e2-4c95-b1ea-b7831db12313\" (UID: \"b8a272a5-98e2-4c95-b1ea-b7831db12313\") " Apr 24 21:18:28.527505 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:28.527390 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b8a272a5-98e2-4c95-b1ea-b7831db12313-console-oauth-config\") pod \"b8a272a5-98e2-4c95-b1ea-b7831db12313\" (UID: \"b8a272a5-98e2-4c95-b1ea-b7831db12313\") " Apr 24 21:18:28.527505 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:28.527412 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w7dv4\" (UniqueName: \"kubernetes.io/projected/b8a272a5-98e2-4c95-b1ea-b7831db12313-kube-api-access-w7dv4\") pod \"b8a272a5-98e2-4c95-b1ea-b7831db12313\" (UID: \"b8a272a5-98e2-4c95-b1ea-b7831db12313\") " Apr 24 21:18:28.527505 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:28.527440 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b8a272a5-98e2-4c95-b1ea-b7831db12313-oauth-serving-cert\") pod \"b8a272a5-98e2-4c95-b1ea-b7831db12313\" (UID: \"b8a272a5-98e2-4c95-b1ea-b7831db12313\") " Apr 24 21:18:28.527505 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:28.527495 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8a272a5-98e2-4c95-b1ea-b7831db12313-trusted-ca-bundle\") pod \"b8a272a5-98e2-4c95-b1ea-b7831db12313\" (UID: \"b8a272a5-98e2-4c95-b1ea-b7831db12313\") " Apr 24 21:18:28.527714 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:28.527524 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b8a272a5-98e2-4c95-b1ea-b7831db12313-console-config\") pod \"b8a272a5-98e2-4c95-b1ea-b7831db12313\" (UID: \"b8a272a5-98e2-4c95-b1ea-b7831db12313\") " Apr 24 21:18:28.527714 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:28.527559 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b8a272a5-98e2-4c95-b1ea-b7831db12313-service-ca\") pod \"b8a272a5-98e2-4c95-b1ea-b7831db12313\" (UID: \"b8a272a5-98e2-4c95-b1ea-b7831db12313\") " Apr 24 21:18:28.527886 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:28.527856 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8a272a5-98e2-4c95-b1ea-b7831db12313-console-config" (OuterVolumeSpecName: "console-config") pod "b8a272a5-98e2-4c95-b1ea-b7831db12313" (UID: "b8a272a5-98e2-4c95-b1ea-b7831db12313"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 24 21:18:28.528050 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:28.527968 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8a272a5-98e2-4c95-b1ea-b7831db12313-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b8a272a5-98e2-4c95-b1ea-b7831db12313" (UID: "b8a272a5-98e2-4c95-b1ea-b7831db12313"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 24 21:18:28.528050 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:28.527990 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8a272a5-98e2-4c95-b1ea-b7831db12313-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b8a272a5-98e2-4c95-b1ea-b7831db12313" (UID: "b8a272a5-98e2-4c95-b1ea-b7831db12313"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 24 21:18:28.528050 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:28.528006 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8a272a5-98e2-4c95-b1ea-b7831db12313-service-ca" (OuterVolumeSpecName: "service-ca") pod "b8a272a5-98e2-4c95-b1ea-b7831db12313" (UID: "b8a272a5-98e2-4c95-b1ea-b7831db12313"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 24 21:18:28.529548 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:28.529528 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8a272a5-98e2-4c95-b1ea-b7831db12313-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b8a272a5-98e2-4c95-b1ea-b7831db12313" (UID: "b8a272a5-98e2-4c95-b1ea-b7831db12313"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 24 21:18:28.529637 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:28.529585 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8a272a5-98e2-4c95-b1ea-b7831db12313-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b8a272a5-98e2-4c95-b1ea-b7831db12313" (UID: "b8a272a5-98e2-4c95-b1ea-b7831db12313"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 24 21:18:28.529701 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:28.529661 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8a272a5-98e2-4c95-b1ea-b7831db12313-kube-api-access-w7dv4" (OuterVolumeSpecName: "kube-api-access-w7dv4") pod "b8a272a5-98e2-4c95-b1ea-b7831db12313" (UID: "b8a272a5-98e2-4c95-b1ea-b7831db12313"). InnerVolumeSpecName "kube-api-access-w7dv4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 24 21:18:28.628808 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:28.628714 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b8a272a5-98e2-4c95-b1ea-b7831db12313-oauth-serving-cert\") on node \"ip-10-0-142-241.ec2.internal\" DevicePath \"\"" Apr 24 21:18:28.628808 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:28.628746 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8a272a5-98e2-4c95-b1ea-b7831db12313-trusted-ca-bundle\") on node \"ip-10-0-142-241.ec2.internal\" DevicePath \"\"" Apr 24 21:18:28.628808 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:28.628761 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b8a272a5-98e2-4c95-b1ea-b7831db12313-console-config\") on node \"ip-10-0-142-241.ec2.internal\" DevicePath \"\"" Apr 24 21:18:28.628808 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:28.628773 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b8a272a5-98e2-4c95-b1ea-b7831db12313-service-ca\") on node \"ip-10-0-142-241.ec2.internal\" DevicePath \"\"" Apr 24 21:18:28.628808 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:28.628786 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b8a272a5-98e2-4c95-b1ea-b7831db12313-console-serving-cert\") on node \"ip-10-0-142-241.ec2.internal\" DevicePath \"\"" Apr 24 21:18:28.628808 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:28.628798 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b8a272a5-98e2-4c95-b1ea-b7831db12313-console-oauth-config\") on node \"ip-10-0-142-241.ec2.internal\" DevicePath \"\"" Apr 24 21:18:28.628808 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:28.628809 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w7dv4\" (UniqueName: \"kubernetes.io/projected/b8a272a5-98e2-4c95-b1ea-b7831db12313-kube-api-access-w7dv4\") on node \"ip-10-0-142-241.ec2.internal\" DevicePath \"\"" Apr 24 21:18:29.257294 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:29.257262 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-54c7ffcd54-p7j5r_b8a272a5-98e2-4c95-b1ea-b7831db12313/console/0.log" Apr 24 21:18:29.257490 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:29.257303 2579 generic.go:358] "Generic (PLEG): container finished" podID="b8a272a5-98e2-4c95-b1ea-b7831db12313" containerID="3eb2869900781f778ade0d08aaf8707e0a984d01017072c40354422cf30bba88" exitCode=2 Apr 24 21:18:29.257490 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:29.257385 2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54c7ffcd54-p7j5r" Apr 24 21:18:29.257490 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:29.257388 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54c7ffcd54-p7j5r" event={"ID":"b8a272a5-98e2-4c95-b1ea-b7831db12313","Type":"ContainerDied","Data":"3eb2869900781f778ade0d08aaf8707e0a984d01017072c40354422cf30bba88"} Apr 24 21:18:29.257490 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:29.257423 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54c7ffcd54-p7j5r" event={"ID":"b8a272a5-98e2-4c95-b1ea-b7831db12313","Type":"ContainerDied","Data":"a7acae9ceb8116e5e2074c917862d69fcb498e2ddab86e9e8869f0cde6fd040b"} Apr 24 21:18:29.257490 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:29.257437 2579 scope.go:117] "RemoveContainer" containerID="3eb2869900781f778ade0d08aaf8707e0a984d01017072c40354422cf30bba88" Apr 24 21:18:29.265948 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:29.265929 2579 scope.go:117] "RemoveContainer" containerID="3eb2869900781f778ade0d08aaf8707e0a984d01017072c40354422cf30bba88" Apr 24 21:18:29.266198 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:18:29.266180 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3eb2869900781f778ade0d08aaf8707e0a984d01017072c40354422cf30bba88\": container with ID starting with 3eb2869900781f778ade0d08aaf8707e0a984d01017072c40354422cf30bba88 not found: ID does not exist" containerID="3eb2869900781f778ade0d08aaf8707e0a984d01017072c40354422cf30bba88" Apr 24 21:18:29.266263 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:29.266205 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3eb2869900781f778ade0d08aaf8707e0a984d01017072c40354422cf30bba88"} err="failed to get container status \"3eb2869900781f778ade0d08aaf8707e0a984d01017072c40354422cf30bba88\": rpc error: code = NotFound desc = could not find container \"3eb2869900781f778ade0d08aaf8707e0a984d01017072c40354422cf30bba88\": container with ID starting with 3eb2869900781f778ade0d08aaf8707e0a984d01017072c40354422cf30bba88 not found: ID does not exist" Apr 24 21:18:29.277889 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:29.277868 2579 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54c7ffcd54-p7j5r"] Apr 24 21:18:29.281694 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:29.281672 2579 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-54c7ffcd54-p7j5r"] Apr 24 21:18:29.767964 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:18:29.767932 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8a272a5-98e2-4c95-b1ea-b7831db12313" path="/var/lib/kubelet/pods/b8a272a5-98e2-4c95-b1ea-b7831db12313/volumes" Apr 24 21:21:35.647650 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:21:35.647623 2579 kubelet.go:1628] "Image garbage collection succeeded" Apr 24 21:22:51.675848 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.675807 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Apr 24 21:22:51.676481 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.676083 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8a272a5-98e2-4c95-b1ea-b7831db12313" containerName="console" Apr 24 21:22:51.676481 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.676094 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8a272a5-98e2-4c95-b1ea-b7831db12313" containerName="console" Apr 24 21:22:51.676481 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.676103 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cabe4f9e-973f-4818-8e55-1ce9b8919a4c" containerName="console" Apr 24 21:22:51.676481 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.676108 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="cabe4f9e-973f-4818-8e55-1ce9b8919a4c" containerName="console" Apr 24 21:22:51.676481 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.676157 2579 memory_manager.go:356] "RemoveStaleState removing state" podUID="cabe4f9e-973f-4818-8e55-1ce9b8919a4c" containerName="console" Apr 24 21:22:51.676481 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.676166 2579 memory_manager.go:356] "RemoveStaleState removing state" podUID="b8a272a5-98e2-4c95-b1ea-b7831db12313" containerName="console" Apr 24 21:22:51.679971 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.679948 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:22:51.682717 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.682688 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Apr 24 21:22:51.683026 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.683010 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-58wtn\"" Apr 24 21:22:51.683868 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.683683 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Apr 24 21:22:51.684904 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.684651 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Apr 24 21:22:51.685010 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.684974 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Apr 24 21:22:51.685155 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.685137 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Apr 24 21:22:51.685504 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.685488 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-48c8om5fjsggb\"" Apr 24 21:22:51.685642 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.685531 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Apr 24 21:22:51.686209 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.686189 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Apr 24 21:22:51.686369 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.686229 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Apr 24 21:22:51.686450 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.686237 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Apr 24 21:22:51.687845 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.687825 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Apr 24 21:22:51.688279 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.688258 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Apr 24 21:22:51.689592 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.689572 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Apr 24 21:22:51.701765 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.701737 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Apr 24 21:22:51.755556 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.755522 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/054dff37-31ab-4fcd-a4ee-e9f18b50ff00-web-config\") pod \"prometheus-k8s-0\" (UID: \"054dff37-31ab-4fcd-a4ee-e9f18b50ff00\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:22:51.755847 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.755812 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/054dff37-31ab-4fcd-a4ee-e9f18b50ff00-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"054dff37-31ab-4fcd-a4ee-e9f18b50ff00\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:22:51.755981 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.755969 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/054dff37-31ab-4fcd-a4ee-e9f18b50ff00-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"054dff37-31ab-4fcd-a4ee-e9f18b50ff00\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:22:51.756113 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.756099 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/054dff37-31ab-4fcd-a4ee-e9f18b50ff00-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"054dff37-31ab-4fcd-a4ee-e9f18b50ff00\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:22:51.756253 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.756224 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/054dff37-31ab-4fcd-a4ee-e9f18b50ff00-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"054dff37-31ab-4fcd-a4ee-e9f18b50ff00\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:22:51.756421 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.756256 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/054dff37-31ab-4fcd-a4ee-e9f18b50ff00-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"054dff37-31ab-4fcd-a4ee-e9f18b50ff00\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:22:51.756421 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.756301 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/054dff37-31ab-4fcd-a4ee-e9f18b50ff00-config-out\") pod \"prometheus-k8s-0\" (UID: \"054dff37-31ab-4fcd-a4ee-e9f18b50ff00\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:22:51.756421 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.756327 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/054dff37-31ab-4fcd-a4ee-e9f18b50ff00-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"054dff37-31ab-4fcd-a4ee-e9f18b50ff00\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:22:51.756421 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.756366 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hln5h\" (UniqueName: \"kubernetes.io/projected/054dff37-31ab-4fcd-a4ee-e9f18b50ff00-kube-api-access-hln5h\") pod \"prometheus-k8s-0\" (UID: \"054dff37-31ab-4fcd-a4ee-e9f18b50ff00\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:22:51.756421 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.756417 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/054dff37-31ab-4fcd-a4ee-e9f18b50ff00-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"054dff37-31ab-4fcd-a4ee-e9f18b50ff00\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:22:51.756662 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.756448 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/054dff37-31ab-4fcd-a4ee-e9f18b50ff00-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"054dff37-31ab-4fcd-a4ee-e9f18b50ff00\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:22:51.756662 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.756470 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/054dff37-31ab-4fcd-a4ee-e9f18b50ff00-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"054dff37-31ab-4fcd-a4ee-e9f18b50ff00\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:22:51.756662 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.756487 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/054dff37-31ab-4fcd-a4ee-e9f18b50ff00-config\") pod \"prometheus-k8s-0\" (UID: \"054dff37-31ab-4fcd-a4ee-e9f18b50ff00\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:22:51.756662 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.756501 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/054dff37-31ab-4fcd-a4ee-e9f18b50ff00-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"054dff37-31ab-4fcd-a4ee-e9f18b50ff00\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:22:51.756662 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.756569 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/054dff37-31ab-4fcd-a4ee-e9f18b50ff00-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"054dff37-31ab-4fcd-a4ee-e9f18b50ff00\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:22:51.756662 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.756610 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/054dff37-31ab-4fcd-a4ee-e9f18b50ff00-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"054dff37-31ab-4fcd-a4ee-e9f18b50ff00\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:22:51.756662 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.756634 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/054dff37-31ab-4fcd-a4ee-e9f18b50ff00-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"054dff37-31ab-4fcd-a4ee-e9f18b50ff00\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:22:51.756662 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.756653 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/054dff37-31ab-4fcd-a4ee-e9f18b50ff00-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"054dff37-31ab-4fcd-a4ee-e9f18b50ff00\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:22:51.857475 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.857437 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/054dff37-31ab-4fcd-a4ee-e9f18b50ff00-config-out\") pod \"prometheus-k8s-0\" (UID: \"054dff37-31ab-4fcd-a4ee-e9f18b50ff00\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:22:51.857475 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.857474 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/054dff37-31ab-4fcd-a4ee-e9f18b50ff00-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"054dff37-31ab-4fcd-a4ee-e9f18b50ff00\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:22:51.857699 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.857490 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hln5h\" (UniqueName: \"kubernetes.io/projected/054dff37-31ab-4fcd-a4ee-e9f18b50ff00-kube-api-access-hln5h\") pod \"prometheus-k8s-0\" (UID: \"054dff37-31ab-4fcd-a4ee-e9f18b50ff00\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:22:51.857699 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.857645 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/054dff37-31ab-4fcd-a4ee-e9f18b50ff00-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"054dff37-31ab-4fcd-a4ee-e9f18b50ff00\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:22:51.857941 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.857911 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/054dff37-31ab-4fcd-a4ee-e9f18b50ff00-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"054dff37-31ab-4fcd-a4ee-e9f18b50ff00\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:22:51.858098 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.857962 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/054dff37-31ab-4fcd-a4ee-e9f18b50ff00-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"054dff37-31ab-4fcd-a4ee-e9f18b50ff00\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:22:51.858098 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.858007 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/054dff37-31ab-4fcd-a4ee-e9f18b50ff00-config\") pod \"prometheus-k8s-0\" (UID: \"054dff37-31ab-4fcd-a4ee-e9f18b50ff00\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:22:51.858098 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.858032 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/054dff37-31ab-4fcd-a4ee-e9f18b50ff00-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"054dff37-31ab-4fcd-a4ee-e9f18b50ff00\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:22:51.858098 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.858065 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/054dff37-31ab-4fcd-a4ee-e9f18b50ff00-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"054dff37-31ab-4fcd-a4ee-e9f18b50ff00\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:22:51.858098 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.858093 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/054dff37-31ab-4fcd-a4ee-e9f18b50ff00-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"054dff37-31ab-4fcd-a4ee-e9f18b50ff00\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:22:51.858375 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.858127 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/054dff37-31ab-4fcd-a4ee-e9f18b50ff00-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"054dff37-31ab-4fcd-a4ee-e9f18b50ff00\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:22:51.858375 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.858158 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/054dff37-31ab-4fcd-a4ee-e9f18b50ff00-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"054dff37-31ab-4fcd-a4ee-e9f18b50ff00\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:22:51.858375 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.858270 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/054dff37-31ab-4fcd-a4ee-e9f18b50ff00-web-config\") pod \"prometheus-k8s-0\" (UID: \"054dff37-31ab-4fcd-a4ee-e9f18b50ff00\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:22:51.858697 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.858387 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/054dff37-31ab-4fcd-a4ee-e9f18b50ff00-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"054dff37-31ab-4fcd-a4ee-e9f18b50ff00\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:22:51.858697 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.858469 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/054dff37-31ab-4fcd-a4ee-e9f18b50ff00-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"054dff37-31ab-4fcd-a4ee-e9f18b50ff00\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:22:51.858697 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.858526 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/054dff37-31ab-4fcd-a4ee-e9f18b50ff00-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"054dff37-31ab-4fcd-a4ee-e9f18b50ff00\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:22:51.858697 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.858558 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/054dff37-31ab-4fcd-a4ee-e9f18b50ff00-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"054dff37-31ab-4fcd-a4ee-e9f18b50ff00\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:22:51.858697 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.858583 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/054dff37-31ab-4fcd-a4ee-e9f18b50ff00-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"054dff37-31ab-4fcd-a4ee-e9f18b50ff00\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:22:51.858697 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.858654 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/054dff37-31ab-4fcd-a4ee-e9f18b50ff00-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"054dff37-31ab-4fcd-a4ee-e9f18b50ff00\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:22:51.861081 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.859772 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/054dff37-31ab-4fcd-a4ee-e9f18b50ff00-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"054dff37-31ab-4fcd-a4ee-e9f18b50ff00\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:22:51.861081 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.860103 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/054dff37-31ab-4fcd-a4ee-e9f18b50ff00-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"054dff37-31ab-4fcd-a4ee-e9f18b50ff00\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:22:51.861081 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.860960 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/054dff37-31ab-4fcd-a4ee-e9f18b50ff00-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"054dff37-31ab-4fcd-a4ee-e9f18b50ff00\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:22:51.861081 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.861032 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/054dff37-31ab-4fcd-a4ee-e9f18b50ff00-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"054dff37-31ab-4fcd-a4ee-e9f18b50ff00\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:22:51.862497 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.861801 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/054dff37-31ab-4fcd-a4ee-e9f18b50ff00-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"054dff37-31ab-4fcd-a4ee-e9f18b50ff00\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:22:51.862497 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.862037 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/054dff37-31ab-4fcd-a4ee-e9f18b50ff00-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"054dff37-31ab-4fcd-a4ee-e9f18b50ff00\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:22:51.862497 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.862181 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/054dff37-31ab-4fcd-a4ee-e9f18b50ff00-config\") pod \"prometheus-k8s-0\" (UID: \"054dff37-31ab-4fcd-a4ee-e9f18b50ff00\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:22:51.863167 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.863142 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/054dff37-31ab-4fcd-a4ee-e9f18b50ff00-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"054dff37-31ab-4fcd-a4ee-e9f18b50ff00\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:22:51.864084 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.863768 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/054dff37-31ab-4fcd-a4ee-e9f18b50ff00-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"054dff37-31ab-4fcd-a4ee-e9f18b50ff00\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:22:51.864084 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.863880 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/054dff37-31ab-4fcd-a4ee-e9f18b50ff00-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"054dff37-31ab-4fcd-a4ee-e9f18b50ff00\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:22:51.864569 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.864544 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/054dff37-31ab-4fcd-a4ee-e9f18b50ff00-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"054dff37-31ab-4fcd-a4ee-e9f18b50ff00\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:22:51.864673 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.864569 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/054dff37-31ab-4fcd-a4ee-e9f18b50ff00-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"054dff37-31ab-4fcd-a4ee-e9f18b50ff00\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:22:51.864918 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.864900 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/054dff37-31ab-4fcd-a4ee-e9f18b50ff00-config-out\") pod \"prometheus-k8s-0\" (UID: \"054dff37-31ab-4fcd-a4ee-e9f18b50ff00\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:22:51.865047 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.864924 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/054dff37-31ab-4fcd-a4ee-e9f18b50ff00-web-config\") pod \"prometheus-k8s-0\" (UID: \"054dff37-31ab-4fcd-a4ee-e9f18b50ff00\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:22:51.865706 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.865665 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/054dff37-31ab-4fcd-a4ee-e9f18b50ff00-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"054dff37-31ab-4fcd-a4ee-e9f18b50ff00\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:22:51.867224 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.867198 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/054dff37-31ab-4fcd-a4ee-e9f18b50ff00-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"054dff37-31ab-4fcd-a4ee-e9f18b50ff00\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:22:51.868842 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.868823 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hln5h\" (UniqueName: \"kubernetes.io/projected/054dff37-31ab-4fcd-a4ee-e9f18b50ff00-kube-api-access-hln5h\") pod \"prometheus-k8s-0\" (UID: \"054dff37-31ab-4fcd-a4ee-e9f18b50ff00\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:22:51.991705 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:51.991609 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:22:52.151138 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:52.151109 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Apr 24 21:22:52.152278 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:22:52.152249 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod054dff37_31ab_4fcd_a4ee_e9f18b50ff00.slice/crio-9c37360ffad43f9de8d0b8480186bd2a5ce5fa05e088134b1078117d5646e64b WatchSource:0}: Error finding container 9c37360ffad43f9de8d0b8480186bd2a5ce5fa05e088134b1078117d5646e64b: Status 404 returned error can't find the container with id 9c37360ffad43f9de8d0b8480186bd2a5ce5fa05e088134b1078117d5646e64b Apr 24 21:22:52.154485 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:52.154468 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Apr 24 21:22:52.947730 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:52.947697 2579 generic.go:358] "Generic (PLEG): container finished" podID="054dff37-31ab-4fcd-a4ee-e9f18b50ff00" containerID="d8e24e7d40d83f615e7d92cedb636da9810011f3da438fe06cbdb09c30bae186" exitCode=0 Apr 24 21:22:52.948070 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:52.947761 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"054dff37-31ab-4fcd-a4ee-e9f18b50ff00","Type":"ContainerDied","Data":"d8e24e7d40d83f615e7d92cedb636da9810011f3da438fe06cbdb09c30bae186"} Apr 24 21:22:52.948070 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:52.947782 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"054dff37-31ab-4fcd-a4ee-e9f18b50ff00","Type":"ContainerStarted","Data":"9c37360ffad43f9de8d0b8480186bd2a5ce5fa05e088134b1078117d5646e64b"} Apr 24 21:22:55.960510 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:55.960464 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"054dff37-31ab-4fcd-a4ee-e9f18b50ff00","Type":"ContainerStarted","Data":"5d9b290fb6e075303bdb55de23762c4215eff3562ad4764de66e98ae32a3b829"} Apr 24 21:22:55.960510 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:55.960508 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"054dff37-31ab-4fcd-a4ee-e9f18b50ff00","Type":"ContainerStarted","Data":"2ed5b2330cd4f6aa2ac7091960c85d56b6fc5e8aecb1b06d26a58f42852f947c"} Apr 24 21:22:57.970479 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:57.970450 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"054dff37-31ab-4fcd-a4ee-e9f18b50ff00","Type":"ContainerStarted","Data":"02edfab931e345620d2cdc903de4c3b35f10589bde6dc629ab6a76e267940a00"} Apr 24 21:22:57.970479 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:57.970483 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"054dff37-31ab-4fcd-a4ee-e9f18b50ff00","Type":"ContainerStarted","Data":"6407f0e50681650a4e3783d73ddb6f0f5f5361f78efdcb393fcaa1f5da1654d2"} Apr 24 21:22:57.970824 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:57.970492 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"054dff37-31ab-4fcd-a4ee-e9f18b50ff00","Type":"ContainerStarted","Data":"465509173cfc1b91a385248e74da3959e367b6e9853bc70d63febbba6bc932de"} Apr 24 21:22:58.976738 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:58.976703 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"054dff37-31ab-4fcd-a4ee-e9f18b50ff00","Type":"ContainerStarted","Data":"1869a9bea962a8ddf0a051f1a6e5545106b2a7060ab9145faec7d0e0dcc46c04"} Apr 24 21:22:59.011035 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:22:59.010980 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.244432473 podStartE2EDuration="8.010962583s" podCreationTimestamp="2026-04-24 21:22:51 +0000 UTC" firstStartedPulling="2026-04-24 21:22:52.948887657 +0000 UTC m=+377.811612724" lastFinishedPulling="2026-04-24 21:22:57.715417747 +0000 UTC m=+382.578142834" observedRunningTime="2026-04-24 21:22:59.008789024 +0000 UTC m=+383.871514110" watchObservedRunningTime="2026-04-24 21:22:59.010962583 +0000 UTC m=+383.873687668" Apr 24 21:23:01.992649 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:23:01.992616 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:23:51.992739 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:23:51.992695 2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:23:52.012937 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:23:52.012905 2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:23:52.146080 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:23:52.146016 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Apr 24 21:24:29.276070 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:24:29.276035 2579 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c8f57c879-d244c"] Apr 24 21:24:44.606110 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:24:44.606075 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-4nrzf"] Apr 24 21:24:44.608796 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:24:44.608781 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4nrzf" Apr 24 21:24:44.613302 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:24:44.613283 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Apr 24 21:24:44.616868 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:24:44.616845 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0c682db3-321c-48d1-92ef-e349458df8ad-dbus\") pod \"global-pull-secret-syncer-4nrzf\" (UID: \"0c682db3-321c-48d1-92ef-e349458df8ad\") " pod="kube-system/global-pull-secret-syncer-4nrzf" Apr 24 21:24:44.616968 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:24:44.616883 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0c682db3-321c-48d1-92ef-e349458df8ad-kubelet-config\") pod \"global-pull-secret-syncer-4nrzf\" (UID: \"0c682db3-321c-48d1-92ef-e349458df8ad\") " pod="kube-system/global-pull-secret-syncer-4nrzf" Apr 24 21:24:44.616968 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:24:44.616910 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0c682db3-321c-48d1-92ef-e349458df8ad-original-pull-secret\") pod \"global-pull-secret-syncer-4nrzf\" (UID: \"0c682db3-321c-48d1-92ef-e349458df8ad\") " pod="kube-system/global-pull-secret-syncer-4nrzf" Apr 24 21:24:44.622306 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:24:44.622288 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4nrzf"] Apr 24 21:24:44.717803 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:24:44.717760 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0c682db3-321c-48d1-92ef-e349458df8ad-dbus\") pod \"global-pull-secret-syncer-4nrzf\" (UID: \"0c682db3-321c-48d1-92ef-e349458df8ad\") " pod="kube-system/global-pull-secret-syncer-4nrzf" Apr 24 21:24:44.717963 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:24:44.717829 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0c682db3-321c-48d1-92ef-e349458df8ad-kubelet-config\") pod \"global-pull-secret-syncer-4nrzf\" (UID: \"0c682db3-321c-48d1-92ef-e349458df8ad\") " pod="kube-system/global-pull-secret-syncer-4nrzf" Apr 24 21:24:44.717963 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:24:44.717854 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0c682db3-321c-48d1-92ef-e349458df8ad-original-pull-secret\") pod \"global-pull-secret-syncer-4nrzf\" (UID: \"0c682db3-321c-48d1-92ef-e349458df8ad\") " pod="kube-system/global-pull-secret-syncer-4nrzf" Apr 24 21:24:44.717963 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:24:44.717908 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0c682db3-321c-48d1-92ef-e349458df8ad-dbus\") pod \"global-pull-secret-syncer-4nrzf\" (UID: \"0c682db3-321c-48d1-92ef-e349458df8ad\") " pod="kube-system/global-pull-secret-syncer-4nrzf" Apr 24 21:24:44.717963 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:24:44.717910 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0c682db3-321c-48d1-92ef-e349458df8ad-kubelet-config\") pod \"global-pull-secret-syncer-4nrzf\" (UID: \"0c682db3-321c-48d1-92ef-e349458df8ad\") " pod="kube-system/global-pull-secret-syncer-4nrzf" Apr 24 21:24:44.720153 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:24:44.720128 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0c682db3-321c-48d1-92ef-e349458df8ad-original-pull-secret\") pod \"global-pull-secret-syncer-4nrzf\" (UID: \"0c682db3-321c-48d1-92ef-e349458df8ad\") " pod="kube-system/global-pull-secret-syncer-4nrzf" Apr 24 21:24:44.917664 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:24:44.917632 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4nrzf" Apr 24 21:24:45.038994 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:24:45.038973 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4nrzf"] Apr 24 21:24:45.041527 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:24:45.041487 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c682db3_321c_48d1_92ef_e349458df8ad.slice/crio-ade8a28b14c7ef04f74a8acd42e9ac828bb35cbe360465e5ceba9dd28e8a114a WatchSource:0}: Error finding container ade8a28b14c7ef04f74a8acd42e9ac828bb35cbe360465e5ceba9dd28e8a114a: Status 404 returned error can't find the container with id ade8a28b14c7ef04f74a8acd42e9ac828bb35cbe360465e5ceba9dd28e8a114a Apr 24 21:24:45.281678 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:24:45.281583 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4nrzf" event={"ID":"0c682db3-321c-48d1-92ef-e349458df8ad","Type":"ContainerStarted","Data":"ade8a28b14c7ef04f74a8acd42e9ac828bb35cbe360465e5ceba9dd28e8a114a"} Apr 24 21:24:49.295646 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:24:49.295600 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4nrzf" event={"ID":"0c682db3-321c-48d1-92ef-e349458df8ad","Type":"ContainerStarted","Data":"56d5a1b1b22a3a00572947f91a6e6c4ca9d08a7e000e9db07a0f4668399150c7"} Apr 24 21:24:49.333770 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:24:49.333717 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4nrzf" podStartSLOduration=1.815828676 podStartE2EDuration="5.333702244s" podCreationTimestamp="2026-04-24 21:24:44 +0000 UTC" firstStartedPulling="2026-04-24 21:24:45.04302466 +0000 UTC m=+489.905749723" lastFinishedPulling="2026-04-24 21:24:48.560898227 +0000 UTC m=+493.423623291" observedRunningTime="2026-04-24 21:24:49.333045426 +0000 UTC m=+494.195770511" watchObservedRunningTime="2026-04-24 21:24:49.333702244 +0000 UTC m=+494.196427361" Apr 24 21:24:54.295528 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:24:54.295473 2579 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-5c8f57c879-d244c" podUID="0c813787-c89c-4e7f-847c-ba67384c31bb" containerName="console" containerID="cri-o://561f8854b5f4e9676886b5e2d98dd733ccddb7464cdef32fc774f48a3924d80f" gracePeriod=15 Apr 24 21:24:54.532576 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:24:54.532554 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5c8f57c879-d244c_0c813787-c89c-4e7f-847c-ba67384c31bb/console/0.log" Apr 24 21:24:54.532678 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:24:54.532612 2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c8f57c879-d244c" Apr 24 21:24:54.600932 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:24:54.600834 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c813787-c89c-4e7f-847c-ba67384c31bb-service-ca\") pod \"0c813787-c89c-4e7f-847c-ba67384c31bb\" (UID: \"0c813787-c89c-4e7f-847c-ba67384c31bb\") " Apr 24 21:24:54.600932 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:24:54.600897 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7qbcd\" (UniqueName: \"kubernetes.io/projected/0c813787-c89c-4e7f-847c-ba67384c31bb-kube-api-access-7qbcd\") pod \"0c813787-c89c-4e7f-847c-ba67384c31bb\" (UID: \"0c813787-c89c-4e7f-847c-ba67384c31bb\") " Apr 24 21:24:54.600932 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:24:54.600931 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c813787-c89c-4e7f-847c-ba67384c31bb-console-serving-cert\") pod \"0c813787-c89c-4e7f-847c-ba67384c31bb\" (UID: \"0c813787-c89c-4e7f-847c-ba67384c31bb\") " Apr 24 21:24:54.601176 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:24:54.600949 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c813787-c89c-4e7f-847c-ba67384c31bb-console-oauth-config\") pod \"0c813787-c89c-4e7f-847c-ba67384c31bb\" (UID: \"0c813787-c89c-4e7f-847c-ba67384c31bb\") " Apr 24 21:24:54.601176 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:24:54.600989 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c813787-c89c-4e7f-847c-ba67384c31bb-console-config\") pod \"0c813787-c89c-4e7f-847c-ba67384c31bb\" (UID: \"0c813787-c89c-4e7f-847c-ba67384c31bb\") " Apr 24 21:24:54.601176 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:24:54.601019 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c813787-c89c-4e7f-847c-ba67384c31bb-oauth-serving-cert\") pod \"0c813787-c89c-4e7f-847c-ba67384c31bb\" (UID: \"0c813787-c89c-4e7f-847c-ba67384c31bb\") " Apr 24 21:24:54.601176 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:24:54.601069 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c813787-c89c-4e7f-847c-ba67384c31bb-trusted-ca-bundle\") pod \"0c813787-c89c-4e7f-847c-ba67384c31bb\" (UID: \"0c813787-c89c-4e7f-847c-ba67384c31bb\") " Apr 24 21:24:54.601412 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:24:54.601273 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c813787-c89c-4e7f-847c-ba67384c31bb-service-ca" (OuterVolumeSpecName: "service-ca") pod "0c813787-c89c-4e7f-847c-ba67384c31bb" (UID: "0c813787-c89c-4e7f-847c-ba67384c31bb"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 24 21:24:54.601545 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:24:54.601523 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c813787-c89c-4e7f-847c-ba67384c31bb-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0c813787-c89c-4e7f-847c-ba67384c31bb" (UID: "0c813787-c89c-4e7f-847c-ba67384c31bb"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 24 21:24:54.601617 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:24:54.601550 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c813787-c89c-4e7f-847c-ba67384c31bb-console-config" (OuterVolumeSpecName: "console-config") pod "0c813787-c89c-4e7f-847c-ba67384c31bb" (UID: "0c813787-c89c-4e7f-847c-ba67384c31bb"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 24 21:24:54.601617 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:24:54.601556 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c813787-c89c-4e7f-847c-ba67384c31bb-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0c813787-c89c-4e7f-847c-ba67384c31bb" (UID: "0c813787-c89c-4e7f-847c-ba67384c31bb"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 24 21:24:54.603312 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:24:54.603280 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c813787-c89c-4e7f-847c-ba67384c31bb-kube-api-access-7qbcd" (OuterVolumeSpecName: "kube-api-access-7qbcd") pod "0c813787-c89c-4e7f-847c-ba67384c31bb" (UID: "0c813787-c89c-4e7f-847c-ba67384c31bb"). InnerVolumeSpecName "kube-api-access-7qbcd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 24 21:24:54.603668 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:24:54.603647 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c813787-c89c-4e7f-847c-ba67384c31bb-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0c813787-c89c-4e7f-847c-ba67384c31bb" (UID: "0c813787-c89c-4e7f-847c-ba67384c31bb"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 24 21:24:54.603778 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:24:54.603756 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c813787-c89c-4e7f-847c-ba67384c31bb-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0c813787-c89c-4e7f-847c-ba67384c31bb" (UID: "0c813787-c89c-4e7f-847c-ba67384c31bb"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 24 21:24:54.701899 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:24:54.701858 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7qbcd\" (UniqueName: \"kubernetes.io/projected/0c813787-c89c-4e7f-847c-ba67384c31bb-kube-api-access-7qbcd\") on node \"ip-10-0-142-241.ec2.internal\" DevicePath \"\"" Apr 24 21:24:54.701899 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:24:54.701893 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c813787-c89c-4e7f-847c-ba67384c31bb-console-serving-cert\") on node \"ip-10-0-142-241.ec2.internal\" DevicePath \"\"" Apr 24 21:24:54.701899 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:24:54.701905 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c813787-c89c-4e7f-847c-ba67384c31bb-console-oauth-config\") on node \"ip-10-0-142-241.ec2.internal\" DevicePath \"\"" Apr 24 21:24:54.702132 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:24:54.701917 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c813787-c89c-4e7f-847c-ba67384c31bb-console-config\") on node \"ip-10-0-142-241.ec2.internal\" DevicePath \"\"" Apr 24 21:24:54.702132 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:24:54.701929 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c813787-c89c-4e7f-847c-ba67384c31bb-oauth-serving-cert\") on node \"ip-10-0-142-241.ec2.internal\" DevicePath \"\"" Apr 24 21:24:54.702132 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:24:54.701942 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c813787-c89c-4e7f-847c-ba67384c31bb-trusted-ca-bundle\") on node \"ip-10-0-142-241.ec2.internal\" DevicePath \"\"" Apr 24 21:24:54.702132 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:24:54.701952 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c813787-c89c-4e7f-847c-ba67384c31bb-service-ca\") on node \"ip-10-0-142-241.ec2.internal\" DevicePath \"\"" Apr 24 21:24:55.317357 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:24:55.317319 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5c8f57c879-d244c_0c813787-c89c-4e7f-847c-ba67384c31bb/console/0.log" Apr 24 21:24:55.317784 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:24:55.317375 2579 generic.go:358] "Generic (PLEG): container finished" podID="0c813787-c89c-4e7f-847c-ba67384c31bb" containerID="561f8854b5f4e9676886b5e2d98dd733ccddb7464cdef32fc774f48a3924d80f" exitCode=2 Apr 24 21:24:55.317784 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:24:55.317417 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c8f57c879-d244c" event={"ID":"0c813787-c89c-4e7f-847c-ba67384c31bb","Type":"ContainerDied","Data":"561f8854b5f4e9676886b5e2d98dd733ccddb7464cdef32fc774f48a3924d80f"} Apr 24 21:24:55.317784 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:24:55.317436 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c8f57c879-d244c" event={"ID":"0c813787-c89c-4e7f-847c-ba67384c31bb","Type":"ContainerDied","Data":"aa373e29b044f927bc56898890b34dc2c96b934e83163b650193a99a47354889"} Apr 24 21:24:55.317784 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:24:55.317449 2579 scope.go:117] "RemoveContainer" containerID="561f8854b5f4e9676886b5e2d98dd733ccddb7464cdef32fc774f48a3924d80f" Apr 24 21:24:55.317784 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:24:55.317464 2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c8f57c879-d244c" Apr 24 21:24:55.325658 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:24:55.325639 2579 scope.go:117] "RemoveContainer" containerID="561f8854b5f4e9676886b5e2d98dd733ccddb7464cdef32fc774f48a3924d80f" Apr 24 21:24:55.325909 ip-10-0-142-241 kubenswrapper[2579]: E0424 21:24:55.325879 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"561f8854b5f4e9676886b5e2d98dd733ccddb7464cdef32fc774f48a3924d80f\": container with ID starting with 561f8854b5f4e9676886b5e2d98dd733ccddb7464cdef32fc774f48a3924d80f not found: ID does not exist" containerID="561f8854b5f4e9676886b5e2d98dd733ccddb7464cdef32fc774f48a3924d80f" Apr 24 21:24:55.326001 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:24:55.325907 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"561f8854b5f4e9676886b5e2d98dd733ccddb7464cdef32fc774f48a3924d80f"} err="failed to get container status \"561f8854b5f4e9676886b5e2d98dd733ccddb7464cdef32fc774f48a3924d80f\": rpc error: code = NotFound desc = could not find container \"561f8854b5f4e9676886b5e2d98dd733ccddb7464cdef32fc774f48a3924d80f\": container with ID starting with 561f8854b5f4e9676886b5e2d98dd733ccddb7464cdef32fc774f48a3924d80f not found: ID does not exist" Apr 24 21:24:55.339593 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:24:55.339567 2579 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c8f57c879-d244c"] Apr 24 21:24:55.343805 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:24:55.343783 2579 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5c8f57c879-d244c"] Apr 24 21:24:55.768180 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:24:55.768144 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c813787-c89c-4e7f-847c-ba67384c31bb" path="/var/lib/kubelet/pods/0c813787-c89c-4e7f-847c-ba67384c31bb/volumes" Apr 24 21:25:05.494605 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:25:05.494576 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-767dbbc9d6-5cxlp"] Apr 24 21:25:05.495049 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:25:05.494998 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c813787-c89c-4e7f-847c-ba67384c31bb" containerName="console" Apr 24 21:25:05.495049 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:25:05.495017 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c813787-c89c-4e7f-847c-ba67384c31bb" containerName="console" Apr 24 21:25:05.495157 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:25:05.495090 2579 memory_manager.go:356] "RemoveStaleState removing state" podUID="0c813787-c89c-4e7f-847c-ba67384c31bb" containerName="console" Apr 24 21:25:05.499651 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:25:05.499629 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-767dbbc9d6-5cxlp" Apr 24 21:25:05.511891 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:25:05.511868 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Apr 24 21:25:05.512023 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:25:05.511874 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Apr 24 21:25:05.512023 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:25:05.511932 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Apr 24 21:25:05.512861 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:25:05.512840 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Apr 24 21:25:05.512946 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:25:05.512924 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Apr 24 21:25:05.513159 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:25:05.513143 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Apr 24 21:25:05.513251 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:25:05.513234 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Apr 24 21:25:05.516592 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:25:05.516574 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-767dbbc9d6-5cxlp"] Apr 24 21:25:05.587696 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:25:05.587663 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/8611f107-e8c5-4729-9521-286f440d8120-ca\") pod \"cluster-proxy-proxy-agent-767dbbc9d6-5cxlp\" (UID: \"8611f107-e8c5-4729-9521-286f440d8120\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-767dbbc9d6-5cxlp" Apr 24 21:25:05.587696 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:25:05.587701 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/8611f107-e8c5-4729-9521-286f440d8120-hub\") pod \"cluster-proxy-proxy-agent-767dbbc9d6-5cxlp\" (UID: \"8611f107-e8c5-4729-9521-286f440d8120\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-767dbbc9d6-5cxlp" Apr 24 21:25:05.587938 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:25:05.587771 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7vgv\" (UniqueName: \"kubernetes.io/projected/8611f107-e8c5-4729-9521-286f440d8120-kube-api-access-d7vgv\") pod \"cluster-proxy-proxy-agent-767dbbc9d6-5cxlp\" (UID: \"8611f107-e8c5-4729-9521-286f440d8120\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-767dbbc9d6-5cxlp" Apr 24 21:25:05.587938 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:25:05.587821 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/8611f107-e8c5-4729-9521-286f440d8120-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-767dbbc9d6-5cxlp\" (UID: \"8611f107-e8c5-4729-9521-286f440d8120\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-767dbbc9d6-5cxlp" Apr 24 21:25:05.587938 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:25:05.587876 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8611f107-e8c5-4729-9521-286f440d8120-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-767dbbc9d6-5cxlp\" (UID: \"8611f107-e8c5-4729-9521-286f440d8120\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-767dbbc9d6-5cxlp" Apr 24 21:25:05.587938 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:25:05.587906 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/8611f107-e8c5-4729-9521-286f440d8120-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-767dbbc9d6-5cxlp\" (UID: \"8611f107-e8c5-4729-9521-286f440d8120\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-767dbbc9d6-5cxlp" Apr 24 21:25:05.688548 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:25:05.688517 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/8611f107-e8c5-4729-9521-286f440d8120-ca\") pod \"cluster-proxy-proxy-agent-767dbbc9d6-5cxlp\" (UID: \"8611f107-e8c5-4729-9521-286f440d8120\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-767dbbc9d6-5cxlp" Apr 24 21:25:05.688548 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:25:05.688551 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/8611f107-e8c5-4729-9521-286f440d8120-hub\") pod \"cluster-proxy-proxy-agent-767dbbc9d6-5cxlp\" (UID: \"8611f107-e8c5-4729-9521-286f440d8120\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-767dbbc9d6-5cxlp" Apr 24 21:25:05.688771 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:25:05.688583 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d7vgv\" (UniqueName: \"kubernetes.io/projected/8611f107-e8c5-4729-9521-286f440d8120-kube-api-access-d7vgv\") pod \"cluster-proxy-proxy-agent-767dbbc9d6-5cxlp\" (UID: \"8611f107-e8c5-4729-9521-286f440d8120\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-767dbbc9d6-5cxlp" Apr 24 21:25:05.688771 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:25:05.688613 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/8611f107-e8c5-4729-9521-286f440d8120-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-767dbbc9d6-5cxlp\" (UID: \"8611f107-e8c5-4729-9521-286f440d8120\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-767dbbc9d6-5cxlp" Apr 24 21:25:05.688771 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:25:05.688742 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8611f107-e8c5-4729-9521-286f440d8120-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-767dbbc9d6-5cxlp\" (UID: \"8611f107-e8c5-4729-9521-286f440d8120\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-767dbbc9d6-5cxlp" Apr 24 21:25:05.688905 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:25:05.688805 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/8611f107-e8c5-4729-9521-286f440d8120-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-767dbbc9d6-5cxlp\" (UID: \"8611f107-e8c5-4729-9521-286f440d8120\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-767dbbc9d6-5cxlp" Apr 24 21:25:05.689267 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:25:05.689243 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/8611f107-e8c5-4729-9521-286f440d8120-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-767dbbc9d6-5cxlp\" (UID: \"8611f107-e8c5-4729-9521-286f440d8120\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-767dbbc9d6-5cxlp" Apr 24 21:25:05.691230 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:25:05.691210 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/8611f107-e8c5-4729-9521-286f440d8120-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-767dbbc9d6-5cxlp\" (UID: \"8611f107-e8c5-4729-9521-286f440d8120\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-767dbbc9d6-5cxlp" Apr 24 21:25:05.691452 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:25:05.691426 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8611f107-e8c5-4729-9521-286f440d8120-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-767dbbc9d6-5cxlp\" (UID: \"8611f107-e8c5-4729-9521-286f440d8120\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-767dbbc9d6-5cxlp" Apr 24 21:25:05.691694 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:25:05.691672 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/8611f107-e8c5-4729-9521-286f440d8120-ca\") pod \"cluster-proxy-proxy-agent-767dbbc9d6-5cxlp\" (UID: \"8611f107-e8c5-4729-9521-286f440d8120\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-767dbbc9d6-5cxlp" Apr 24 21:25:05.691781 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:25:05.691768 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/8611f107-e8c5-4729-9521-286f440d8120-hub\") pod \"cluster-proxy-proxy-agent-767dbbc9d6-5cxlp\" (UID: \"8611f107-e8c5-4729-9521-286f440d8120\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-767dbbc9d6-5cxlp" Apr 24 21:25:05.697753 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:25:05.697729 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7vgv\" (UniqueName: \"kubernetes.io/projected/8611f107-e8c5-4729-9521-286f440d8120-kube-api-access-d7vgv\") pod \"cluster-proxy-proxy-agent-767dbbc9d6-5cxlp\" (UID: \"8611f107-e8c5-4729-9521-286f440d8120\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-767dbbc9d6-5cxlp" Apr 24 21:25:05.816076 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:25:05.816002 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-767dbbc9d6-5cxlp" Apr 24 21:25:05.939614 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:25:05.939502 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-767dbbc9d6-5cxlp"] Apr 24 21:25:05.942255 ip-10-0-142-241 kubenswrapper[2579]: W0424 21:25:05.942226 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8611f107_e8c5_4729_9521_286f440d8120.slice/crio-4bd370cf247b2a1b1456471e5584c6450595b0b6d181f6e5cb22334a7a62a3f3 WatchSource:0}: Error finding container 4bd370cf247b2a1b1456471e5584c6450595b0b6d181f6e5cb22334a7a62a3f3: Status 404 returned error can't find the container with id 4bd370cf247b2a1b1456471e5584c6450595b0b6d181f6e5cb22334a7a62a3f3 Apr 24 21:25:06.349565 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:25:06.349531 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-767dbbc9d6-5cxlp" event={"ID":"8611f107-e8c5-4729-9521-286f440d8120","Type":"ContainerStarted","Data":"4bd370cf247b2a1b1456471e5584c6450595b0b6d181f6e5cb22334a7a62a3f3"} Apr 24 21:25:09.364355 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:25:09.364296 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-767dbbc9d6-5cxlp" event={"ID":"8611f107-e8c5-4729-9521-286f440d8120","Type":"ContainerStarted","Data":"e2a17734d603d37efc804903fc9dd59b068e1a8bdd6678ff1ad73d25e79b3a2d"} Apr 24 21:25:11.372577 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:25:11.372532 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-767dbbc9d6-5cxlp" event={"ID":"8611f107-e8c5-4729-9521-286f440d8120","Type":"ContainerStarted","Data":"4c55ef2848cdf81a86ab33e6ef8eb906520951061754db307c0c526df7d8474e"} Apr 24 21:25:11.372577 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:25:11.372576 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-767dbbc9d6-5cxlp" event={"ID":"8611f107-e8c5-4729-9521-286f440d8120","Type":"ContainerStarted","Data":"a6b26c16178e8af86aef211477e446f092d434b44ebe35c5d9e40830d84de81d"} Apr 24 21:25:11.393391 ip-10-0-142-241 kubenswrapper[2579]: I0424 21:25:11.393326 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-767dbbc9d6-5cxlp" podStartSLOduration=1.792924264 podStartE2EDuration="6.393312897s" podCreationTimestamp="2026-04-24 21:25:05 +0000 UTC" firstStartedPulling="2026-04-24 21:25:05.943934012 +0000 UTC m=+510.806659075" lastFinishedPulling="2026-04-24 21:25:10.544322641 +0000 UTC m=+515.407047708" observedRunningTime="2026-04-24 21:25:11.391429818 +0000 UTC m=+516.254154902" watchObservedRunningTime="2026-04-24 21:25:11.393312897 +0000 UTC m=+516.256037981" Apr 24 22:07:39.785669 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:07:39.785632 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bzvjw/must-gather-w7c8r"] Apr 24 22:07:39.789043 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:07:39.789024 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bzvjw/must-gather-w7c8r" Apr 24 22:07:39.791666 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:07:39.791647 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bzvjw\"/\"openshift-service-ca.crt\"" Apr 24 22:07:39.791786 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:07:39.791667 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bzvjw\"/\"kube-root-ca.crt\"" Apr 24 22:07:39.791786 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:07:39.791647 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-bzvjw\"/\"default-dockercfg-t5zjd\"" Apr 24 22:07:39.806810 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:07:39.806788 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bzvjw/must-gather-w7c8r"] Apr 24 22:07:39.911396 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:07:39.911330 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fcd7c2c9-e904-48bf-a1d8-d37b63b1cec4-must-gather-output\") pod \"must-gather-w7c8r\" (UID: \"fcd7c2c9-e904-48bf-a1d8-d37b63b1cec4\") " pod="openshift-must-gather-bzvjw/must-gather-w7c8r" Apr 24 22:07:39.911580 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:07:39.911472 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmds6\" (UniqueName: \"kubernetes.io/projected/fcd7c2c9-e904-48bf-a1d8-d37b63b1cec4-kube-api-access-rmds6\") pod \"must-gather-w7c8r\" (UID: \"fcd7c2c9-e904-48bf-a1d8-d37b63b1cec4\") " pod="openshift-must-gather-bzvjw/must-gather-w7c8r" Apr 24 22:07:40.012092 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:07:40.012055 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fcd7c2c9-e904-48bf-a1d8-d37b63b1cec4-must-gather-output\") pod \"must-gather-w7c8r\" (UID: \"fcd7c2c9-e904-48bf-a1d8-d37b63b1cec4\") " pod="openshift-must-gather-bzvjw/must-gather-w7c8r" Apr 24 22:07:40.012268 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:07:40.012110 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rmds6\" (UniqueName: \"kubernetes.io/projected/fcd7c2c9-e904-48bf-a1d8-d37b63b1cec4-kube-api-access-rmds6\") pod \"must-gather-w7c8r\" (UID: \"fcd7c2c9-e904-48bf-a1d8-d37b63b1cec4\") " pod="openshift-must-gather-bzvjw/must-gather-w7c8r" Apr 24 22:07:40.012434 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:07:40.012404 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fcd7c2c9-e904-48bf-a1d8-d37b63b1cec4-must-gather-output\") pod \"must-gather-w7c8r\" (UID: \"fcd7c2c9-e904-48bf-a1d8-d37b63b1cec4\") " pod="openshift-must-gather-bzvjw/must-gather-w7c8r" Apr 24 22:07:40.020408 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:07:40.020385 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmds6\" (UniqueName: \"kubernetes.io/projected/fcd7c2c9-e904-48bf-a1d8-d37b63b1cec4-kube-api-access-rmds6\") pod \"must-gather-w7c8r\" (UID: \"fcd7c2c9-e904-48bf-a1d8-d37b63b1cec4\") " pod="openshift-must-gather-bzvjw/must-gather-w7c8r" Apr 24 22:07:40.097546 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:07:40.097467 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bzvjw/must-gather-w7c8r" Apr 24 22:07:40.213097 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:07:40.213036 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bzvjw/must-gather-w7c8r"] Apr 24 22:07:40.216078 ip-10-0-142-241 kubenswrapper[2579]: W0424 22:07:40.216048 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfcd7c2c9_e904_48bf_a1d8_d37b63b1cec4.slice/crio-2827c009d2e165957fe9fc1214aa9395dac0354a28e2a8c3ba0479994d5e38cc WatchSource:0}: Error finding container 2827c009d2e165957fe9fc1214aa9395dac0354a28e2a8c3ba0479994d5e38cc: Status 404 returned error can't find the container with id 2827c009d2e165957fe9fc1214aa9395dac0354a28e2a8c3ba0479994d5e38cc Apr 24 22:07:40.218143 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:07:40.218127 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Apr 24 22:07:40.561776 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:07:40.561745 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bzvjw/must-gather-w7c8r" event={"ID":"fcd7c2c9-e904-48bf-a1d8-d37b63b1cec4","Type":"ContainerStarted","Data":"2827c009d2e165957fe9fc1214aa9395dac0354a28e2a8c3ba0479994d5e38cc"} Apr 24 22:07:46.582441 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:07:46.582396 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bzvjw/must-gather-w7c8r" event={"ID":"fcd7c2c9-e904-48bf-a1d8-d37b63b1cec4","Type":"ContainerStarted","Data":"7a5b2c9e9611b3c1b68631d3d0f534e3dc83b980aa0bb467238c301fb1acf4ad"} Apr 24 22:07:46.582895 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:07:46.582450 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bzvjw/must-gather-w7c8r" event={"ID":"fcd7c2c9-e904-48bf-a1d8-d37b63b1cec4","Type":"ContainerStarted","Data":"8436abc2caa72222427d9f9736f92a0c507e5e49234691ee06d3f38515e9712f"} Apr 24 22:07:46.604331 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:07:46.604270 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-bzvjw/must-gather-w7c8r" podStartSLOduration=2.100355512 podStartE2EDuration="7.604247995s" podCreationTimestamp="2026-04-24 22:07:39 +0000 UTC" firstStartedPulling="2026-04-24 22:07:40.218253761 +0000 UTC m=+3065.080978824" lastFinishedPulling="2026-04-24 22:07:45.722146244 +0000 UTC m=+3070.584871307" observedRunningTime="2026-04-24 22:07:46.601330533 +0000 UTC m=+3071.464055612" watchObservedRunningTime="2026-04-24 22:07:46.604247995 +0000 UTC m=+3071.466973081" Apr 24 22:08:04.636643 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:04.636557 2579 generic.go:358] "Generic (PLEG): container finished" podID="fcd7c2c9-e904-48bf-a1d8-d37b63b1cec4" containerID="8436abc2caa72222427d9f9736f92a0c507e5e49234691ee06d3f38515e9712f" exitCode=0 Apr 24 22:08:04.636643 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:04.636633 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bzvjw/must-gather-w7c8r" event={"ID":"fcd7c2c9-e904-48bf-a1d8-d37b63b1cec4","Type":"ContainerDied","Data":"8436abc2caa72222427d9f9736f92a0c507e5e49234691ee06d3f38515e9712f"} Apr 24 22:08:04.637042 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:04.636956 2579 scope.go:117] "RemoveContainer" containerID="8436abc2caa72222427d9f9736f92a0c507e5e49234691ee06d3f38515e9712f" Apr 24 22:08:05.228844 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:05.228818 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-bzvjw_must-gather-w7c8r_fcd7c2c9-e904-48bf-a1d8-d37b63b1cec4/gather/0.log" Apr 24 22:08:08.432108 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:08.432063 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4nrzf_0c682db3-321c-48d1-92ef-e349458df8ad/global-pull-secret-syncer/0.log" Apr 24 22:08:08.658671 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:08.658637 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-rrmd6_452067fc-581a-48e2-876d-0b6afa08e24b/konnectivity-agent/0.log" Apr 24 22:08:08.722888 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:08.722814 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-241.ec2.internal_228671878d0b972ea78e6fdc693250e2/haproxy/0.log" Apr 24 22:08:10.648726 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:10.648679 2579 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-bzvjw/must-gather-w7c8r"] Apr 24 22:08:10.649167 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:10.648905 2579 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-must-gather-bzvjw/must-gather-w7c8r" podUID="fcd7c2c9-e904-48bf-a1d8-d37b63b1cec4" containerName="copy" containerID="cri-o://7a5b2c9e9611b3c1b68631d3d0f534e3dc83b980aa0bb467238c301fb1acf4ad" gracePeriod=2 Apr 24 22:08:10.653485 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:10.653460 2579 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-bzvjw/must-gather-w7c8r"] Apr 24 22:08:10.871701 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:10.871675 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-bzvjw_must-gather-w7c8r_fcd7c2c9-e904-48bf-a1d8-d37b63b1cec4/copy/0.log" Apr 24 22:08:10.872008 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:10.871990 2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bzvjw/must-gather-w7c8r" Apr 24 22:08:10.874150 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:10.874124 2579 status_manager.go:895] "Failed to get status for pod" podUID="fcd7c2c9-e904-48bf-a1d8-d37b63b1cec4" pod="openshift-must-gather-bzvjw/must-gather-w7c8r" err="pods \"must-gather-w7c8r\" is forbidden: User \"system:node:ip-10-0-142-241.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-bzvjw\": no relationship found between node 'ip-10-0-142-241.ec2.internal' and this object" Apr 24 22:08:10.981716 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:10.981682 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fcd7c2c9-e904-48bf-a1d8-d37b63b1cec4-must-gather-output\") pod \"fcd7c2c9-e904-48bf-a1d8-d37b63b1cec4\" (UID: \"fcd7c2c9-e904-48bf-a1d8-d37b63b1cec4\") " Apr 24 22:08:10.981883 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:10.981727 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rmds6\" (UniqueName: \"kubernetes.io/projected/fcd7c2c9-e904-48bf-a1d8-d37b63b1cec4-kube-api-access-rmds6\") pod \"fcd7c2c9-e904-48bf-a1d8-d37b63b1cec4\" (UID: \"fcd7c2c9-e904-48bf-a1d8-d37b63b1cec4\") " Apr 24 22:08:10.983371 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:10.983322 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcd7c2c9-e904-48bf-a1d8-d37b63b1cec4-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "fcd7c2c9-e904-48bf-a1d8-d37b63b1cec4" (UID: "fcd7c2c9-e904-48bf-a1d8-d37b63b1cec4"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Apr 24 22:08:10.983962 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:10.983943 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fcd7c2c9-e904-48bf-a1d8-d37b63b1cec4-kube-api-access-rmds6" (OuterVolumeSpecName: "kube-api-access-rmds6") pod "fcd7c2c9-e904-48bf-a1d8-d37b63b1cec4" (UID: "fcd7c2c9-e904-48bf-a1d8-d37b63b1cec4"). InnerVolumeSpecName "kube-api-access-rmds6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 24 22:08:11.082462 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:11.082424 2579 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fcd7c2c9-e904-48bf-a1d8-d37b63b1cec4-must-gather-output\") on node \"ip-10-0-142-241.ec2.internal\" DevicePath \"\"" Apr 24 22:08:11.082462 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:11.082454 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rmds6\" (UniqueName: \"kubernetes.io/projected/fcd7c2c9-e904-48bf-a1d8-d37b63b1cec4-kube-api-access-rmds6\") on node \"ip-10-0-142-241.ec2.internal\" DevicePath \"\"" Apr 24 22:08:11.660023 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:11.659992 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-bzvjw_must-gather-w7c8r_fcd7c2c9-e904-48bf-a1d8-d37b63b1cec4/copy/0.log" Apr 24 22:08:11.660487 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:11.660390 2579 generic.go:358] "Generic (PLEG): container finished" podID="fcd7c2c9-e904-48bf-a1d8-d37b63b1cec4" containerID="7a5b2c9e9611b3c1b68631d3d0f534e3dc83b980aa0bb467238c301fb1acf4ad" exitCode=143 Apr 24 22:08:11.660487 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:11.660438 2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bzvjw/must-gather-w7c8r" Apr 24 22:08:11.660576 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:11.660492 2579 scope.go:117] "RemoveContainer" containerID="7a5b2c9e9611b3c1b68631d3d0f534e3dc83b980aa0bb467238c301fb1acf4ad" Apr 24 22:08:11.662462 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:11.662433 2579 status_manager.go:895] "Failed to get status for pod" podUID="fcd7c2c9-e904-48bf-a1d8-d37b63b1cec4" pod="openshift-must-gather-bzvjw/must-gather-w7c8r" err="pods \"must-gather-w7c8r\" is forbidden: User \"system:node:ip-10-0-142-241.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-bzvjw\": no relationship found between node 'ip-10-0-142-241.ec2.internal' and this object" Apr 24 22:08:11.668539 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:11.668523 2579 scope.go:117] "RemoveContainer" containerID="8436abc2caa72222427d9f9736f92a0c507e5e49234691ee06d3f38515e9712f" Apr 24 22:08:11.671508 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:11.671464 2579 status_manager.go:895] "Failed to get status for pod" podUID="fcd7c2c9-e904-48bf-a1d8-d37b63b1cec4" pod="openshift-must-gather-bzvjw/must-gather-w7c8r" err="pods \"must-gather-w7c8r\" is forbidden: User \"system:node:ip-10-0-142-241.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-bzvjw\": no relationship found between node 'ip-10-0-142-241.ec2.internal' and this object" Apr 24 22:08:11.679590 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:11.679574 2579 scope.go:117] "RemoveContainer" containerID="7a5b2c9e9611b3c1b68631d3d0f534e3dc83b980aa0bb467238c301fb1acf4ad" Apr 24 22:08:11.679838 ip-10-0-142-241 kubenswrapper[2579]: E0424 22:08:11.679817 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a5b2c9e9611b3c1b68631d3d0f534e3dc83b980aa0bb467238c301fb1acf4ad\": container with ID starting with 7a5b2c9e9611b3c1b68631d3d0f534e3dc83b980aa0bb467238c301fb1acf4ad not found: ID does not exist" containerID="7a5b2c9e9611b3c1b68631d3d0f534e3dc83b980aa0bb467238c301fb1acf4ad" Apr 24 22:08:11.679884 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:11.679847 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a5b2c9e9611b3c1b68631d3d0f534e3dc83b980aa0bb467238c301fb1acf4ad"} err="failed to get container status \"7a5b2c9e9611b3c1b68631d3d0f534e3dc83b980aa0bb467238c301fb1acf4ad\": rpc error: code = NotFound desc = could not find container \"7a5b2c9e9611b3c1b68631d3d0f534e3dc83b980aa0bb467238c301fb1acf4ad\": container with ID starting with 7a5b2c9e9611b3c1b68631d3d0f534e3dc83b980aa0bb467238c301fb1acf4ad not found: ID does not exist" Apr 24 22:08:11.679884 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:11.679871 2579 scope.go:117] "RemoveContainer" containerID="8436abc2caa72222427d9f9736f92a0c507e5e49234691ee06d3f38515e9712f" Apr 24 22:08:11.680095 ip-10-0-142-241 kubenswrapper[2579]: E0424 22:08:11.680080 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8436abc2caa72222427d9f9736f92a0c507e5e49234691ee06d3f38515e9712f\": container with ID starting with 8436abc2caa72222427d9f9736f92a0c507e5e49234691ee06d3f38515e9712f not found: ID does not exist" containerID="8436abc2caa72222427d9f9736f92a0c507e5e49234691ee06d3f38515e9712f" Apr 24 22:08:11.680142 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:11.680101 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8436abc2caa72222427d9f9736f92a0c507e5e49234691ee06d3f38515e9712f"} err="failed to get container status \"8436abc2caa72222427d9f9736f92a0c507e5e49234691ee06d3f38515e9712f\": rpc error: code = NotFound desc = could not find container \"8436abc2caa72222427d9f9736f92a0c507e5e49234691ee06d3f38515e9712f\": container with ID starting with 8436abc2caa72222427d9f9736f92a0c507e5e49234691ee06d3f38515e9712f not found: ID does not exist" Apr 24 22:08:11.768513 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:11.768484 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fcd7c2c9-e904-48bf-a1d8-d37b63b1cec4" path="/var/lib/kubelet/pods/fcd7c2c9-e904-48bf-a1d8-d37b63b1cec4/volumes" Apr 24 22:08:11.962062 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:11.961984 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_35eae0e8-f86b-4321-b45c-b85993ce0a34/alertmanager/0.log" Apr 24 22:08:11.989362 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:11.989314 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_35eae0e8-f86b-4321-b45c-b85993ce0a34/config-reloader/0.log" Apr 24 22:08:12.012141 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:12.012118 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_35eae0e8-f86b-4321-b45c-b85993ce0a34/kube-rbac-proxy-web/0.log" Apr 24 22:08:12.041828 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:12.041787 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_35eae0e8-f86b-4321-b45c-b85993ce0a34/kube-rbac-proxy/0.log" Apr 24 22:08:12.069619 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:12.069597 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_35eae0e8-f86b-4321-b45c-b85993ce0a34/kube-rbac-proxy-metric/0.log" Apr 24 22:08:12.096841 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:12.096813 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_35eae0e8-f86b-4321-b45c-b85993ce0a34/prom-label-proxy/0.log" Apr 24 22:08:12.120432 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:12.120407 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_35eae0e8-f86b-4321-b45c-b85993ce0a34/init-config-reloader/0.log" Apr 24 22:08:12.182936 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:12.182906 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-69db897b98-xr28v_11ea66de-db45-4d88-9833-f4d6f418572e/kube-state-metrics/0.log" Apr 24 22:08:12.203875 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:12.203849 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-69db897b98-xr28v_11ea66de-db45-4d88-9833-f4d6f418572e/kube-rbac-proxy-main/0.log" Apr 24 22:08:12.223988 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:12.223922 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-69db897b98-xr28v_11ea66de-db45-4d88-9833-f4d6f418572e/kube-rbac-proxy-self/0.log" Apr 24 22:08:12.251945 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:12.251922 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-b5f7f674b-qcvqp_47a3d2b1-d394-4594-9650-265f751c9c04/metrics-server/0.log" Apr 24 22:08:12.392476 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:12.392449 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mzs78_378b1166-0b5c-4ba5-a9e8-517d1bbbe6ae/node-exporter/0.log" Apr 24 22:08:12.415812 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:12.415792 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mzs78_378b1166-0b5c-4ba5-a9e8-517d1bbbe6ae/kube-rbac-proxy/0.log" Apr 24 22:08:12.440163 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:12.440139 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mzs78_378b1166-0b5c-4ba5-a9e8-517d1bbbe6ae/init-textfile/0.log" Apr 24 22:08:12.551076 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:12.551047 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9d44df66c-pdpkm_9afa8910-27c9-46a8-8bc6-2fdc29d4a667/kube-rbac-proxy-main/0.log" Apr 24 22:08:12.576350 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:12.576312 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9d44df66c-pdpkm_9afa8910-27c9-46a8-8bc6-2fdc29d4a667/kube-rbac-proxy-self/0.log" Apr 24 22:08:12.597188 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:12.597156 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9d44df66c-pdpkm_9afa8910-27c9-46a8-8bc6-2fdc29d4a667/openshift-state-metrics/0.log" Apr 24 22:08:12.638392 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:12.638365 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_054dff37-31ab-4fcd-a4ee-e9f18b50ff00/prometheus/0.log" Apr 24 22:08:12.658236 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:12.658217 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_054dff37-31ab-4fcd-a4ee-e9f18b50ff00/config-reloader/0.log" Apr 24 22:08:12.679593 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:12.679567 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_054dff37-31ab-4fcd-a4ee-e9f18b50ff00/thanos-sidecar/0.log" Apr 24 22:08:12.703162 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:12.703143 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_054dff37-31ab-4fcd-a4ee-e9f18b50ff00/kube-rbac-proxy-web/0.log" Apr 24 22:08:12.724848 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:12.724819 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_054dff37-31ab-4fcd-a4ee-e9f18b50ff00/kube-rbac-proxy/0.log" Apr 24 22:08:12.746143 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:12.746122 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_054dff37-31ab-4fcd-a4ee-e9f18b50ff00/kube-rbac-proxy-thanos/0.log" Apr 24 22:08:12.767529 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:12.767480 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_054dff37-31ab-4fcd-a4ee-e9f18b50ff00/init-config-reloader/0.log" Apr 24 22:08:12.794588 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:12.794554 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5676c8c784-nbb94_5d8cef8a-4146-403b-a247-b362d2a7cda5/prometheus-operator/0.log" Apr 24 22:08:12.814633 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:12.814612 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5676c8c784-nbb94_5d8cef8a-4146-403b-a247-b362d2a7cda5/kube-rbac-proxy/0.log" Apr 24 22:08:12.839146 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:12.839124 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-57cf98b594-fpb4d_24b77528-b555-42c1-b5f2-c77c5a41fe8e/prometheus-operator-admission-webhook/0.log" Apr 24 22:08:12.867878 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:12.867851 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-677d7dd8cf-d74cz_d3073940-999e-4548-b52b-d0fbd6a74e85/telemeter-client/0.log" Apr 24 22:08:12.891774 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:12.891754 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-677d7dd8cf-d74cz_d3073940-999e-4548-b52b-d0fbd6a74e85/reload/0.log" Apr 24 22:08:12.920046 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:12.920020 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-677d7dd8cf-d74cz_d3073940-999e-4548-b52b-d0fbd6a74e85/kube-rbac-proxy/0.log" Apr 24 22:08:15.712659 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:15.712626 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bccfr/perf-node-gather-daemonset-f7p7w"] Apr 24 22:08:15.713048 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:15.712972 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcd7c2c9-e904-48bf-a1d8-d37b63b1cec4" containerName="copy" Apr 24 22:08:15.713048 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:15.712987 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcd7c2c9-e904-48bf-a1d8-d37b63b1cec4" containerName="copy" Apr 24 22:08:15.713048 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:15.713000 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcd7c2c9-e904-48bf-a1d8-d37b63b1cec4" containerName="gather" Apr 24 22:08:15.713048 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:15.713005 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcd7c2c9-e904-48bf-a1d8-d37b63b1cec4" containerName="gather" Apr 24 22:08:15.713173 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:15.713060 2579 memory_manager.go:356] "RemoveStaleState removing state" podUID="fcd7c2c9-e904-48bf-a1d8-d37b63b1cec4" containerName="gather" Apr 24 22:08:15.713173 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:15.713068 2579 memory_manager.go:356] "RemoveStaleState removing state" podUID="fcd7c2c9-e904-48bf-a1d8-d37b63b1cec4" containerName="copy" Apr 24 22:08:15.718268 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:15.718247 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bccfr/perf-node-gather-daemonset-f7p7w" Apr 24 22:08:15.720573 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:15.720543 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bccfr\"/\"openshift-service-ca.crt\"" Apr 24 22:08:15.720573 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:15.720569 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bccfr\"/\"kube-root-ca.crt\"" Apr 24 22:08:15.720746 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:15.720574 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-bccfr\"/\"default-dockercfg-vcvfc\"" Apr 24 22:08:15.723684 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:15.723662 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bccfr/perf-node-gather-daemonset-f7p7w"] Apr 24 22:08:15.821259 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:15.821230 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ff1029e1-4e52-4c4d-956f-806576ab3917-sys\") pod \"perf-node-gather-daemonset-f7p7w\" (UID: \"ff1029e1-4e52-4c4d-956f-806576ab3917\") " pod="openshift-must-gather-bccfr/perf-node-gather-daemonset-f7p7w" Apr 24 22:08:15.821259 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:15.821265 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2hnc\" (UniqueName: \"kubernetes.io/projected/ff1029e1-4e52-4c4d-956f-806576ab3917-kube-api-access-g2hnc\") pod \"perf-node-gather-daemonset-f7p7w\" (UID: \"ff1029e1-4e52-4c4d-956f-806576ab3917\") " pod="openshift-must-gather-bccfr/perf-node-gather-daemonset-f7p7w" Apr 24 22:08:15.821478 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:15.821309 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ff1029e1-4e52-4c4d-956f-806576ab3917-proc\") pod \"perf-node-gather-daemonset-f7p7w\" (UID: \"ff1029e1-4e52-4c4d-956f-806576ab3917\") " pod="openshift-must-gather-bccfr/perf-node-gather-daemonset-f7p7w" Apr 24 22:08:15.821478 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:15.821370 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ff1029e1-4e52-4c4d-956f-806576ab3917-lib-modules\") pod \"perf-node-gather-daemonset-f7p7w\" (UID: \"ff1029e1-4e52-4c4d-956f-806576ab3917\") " pod="openshift-must-gather-bccfr/perf-node-gather-daemonset-f7p7w" Apr 24 22:08:15.821478 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:15.821394 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ff1029e1-4e52-4c4d-956f-806576ab3917-podres\") pod \"perf-node-gather-daemonset-f7p7w\" (UID: \"ff1029e1-4e52-4c4d-956f-806576ab3917\") " pod="openshift-must-gather-bccfr/perf-node-gather-daemonset-f7p7w" Apr 24 22:08:15.922481 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:15.922444 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ff1029e1-4e52-4c4d-956f-806576ab3917-podres\") pod \"perf-node-gather-daemonset-f7p7w\" (UID: \"ff1029e1-4e52-4c4d-956f-806576ab3917\") " pod="openshift-must-gather-bccfr/perf-node-gather-daemonset-f7p7w" Apr 24 22:08:15.922648 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:15.922495 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ff1029e1-4e52-4c4d-956f-806576ab3917-sys\") pod \"perf-node-gather-daemonset-f7p7w\" (UID: \"ff1029e1-4e52-4c4d-956f-806576ab3917\") " pod="openshift-must-gather-bccfr/perf-node-gather-daemonset-f7p7w" Apr 24 22:08:15.922648 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:15.922574 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ff1029e1-4e52-4c4d-956f-806576ab3917-sys\") pod \"perf-node-gather-daemonset-f7p7w\" (UID: \"ff1029e1-4e52-4c4d-956f-806576ab3917\") " pod="openshift-must-gather-bccfr/perf-node-gather-daemonset-f7p7w" Apr 24 22:08:15.922648 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:15.922619 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ff1029e1-4e52-4c4d-956f-806576ab3917-podres\") pod \"perf-node-gather-daemonset-f7p7w\" (UID: \"ff1029e1-4e52-4c4d-956f-806576ab3917\") " pod="openshift-must-gather-bccfr/perf-node-gather-daemonset-f7p7w" Apr 24 22:08:15.922776 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:15.922618 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g2hnc\" (UniqueName: \"kubernetes.io/projected/ff1029e1-4e52-4c4d-956f-806576ab3917-kube-api-access-g2hnc\") pod \"perf-node-gather-daemonset-f7p7w\" (UID: \"ff1029e1-4e52-4c4d-956f-806576ab3917\") " pod="openshift-must-gather-bccfr/perf-node-gather-daemonset-f7p7w" Apr 24 22:08:15.922776 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:15.922723 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ff1029e1-4e52-4c4d-956f-806576ab3917-proc\") pod \"perf-node-gather-daemonset-f7p7w\" (UID: \"ff1029e1-4e52-4c4d-956f-806576ab3917\") " pod="openshift-must-gather-bccfr/perf-node-gather-daemonset-f7p7w" Apr 24 22:08:15.922888 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:15.922788 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ff1029e1-4e52-4c4d-956f-806576ab3917-lib-modules\") pod \"perf-node-gather-daemonset-f7p7w\" (UID: \"ff1029e1-4e52-4c4d-956f-806576ab3917\") " pod="openshift-must-gather-bccfr/perf-node-gather-daemonset-f7p7w" Apr 24 22:08:15.922888 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:15.922844 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ff1029e1-4e52-4c4d-956f-806576ab3917-proc\") pod \"perf-node-gather-daemonset-f7p7w\" (UID: \"ff1029e1-4e52-4c4d-956f-806576ab3917\") " pod="openshift-must-gather-bccfr/perf-node-gather-daemonset-f7p7w" Apr 24 22:08:15.922957 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:15.922937 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ff1029e1-4e52-4c4d-956f-806576ab3917-lib-modules\") pod \"perf-node-gather-daemonset-f7p7w\" (UID: \"ff1029e1-4e52-4c4d-956f-806576ab3917\") " pod="openshift-must-gather-bccfr/perf-node-gather-daemonset-f7p7w" Apr 24 22:08:15.930551 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:15.930526 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2hnc\" (UniqueName: \"kubernetes.io/projected/ff1029e1-4e52-4c4d-956f-806576ab3917-kube-api-access-g2hnc\") pod \"perf-node-gather-daemonset-f7p7w\" (UID: \"ff1029e1-4e52-4c4d-956f-806576ab3917\") " pod="openshift-must-gather-bccfr/perf-node-gather-daemonset-f7p7w" Apr 24 22:08:16.028934 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:16.028858 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bccfr/perf-node-gather-daemonset-f7p7w" Apr 24 22:08:16.061568 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:16.061544 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hxhnc_f1603a03-2d10-41d3-bf9b-34d45b271773/dns/0.log" Apr 24 22:08:16.082552 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:16.082530 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hxhnc_f1603a03-2d10-41d3-bf9b-34d45b271773/kube-rbac-proxy/0.log" Apr 24 22:08:16.146703 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:16.146662 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bccfr/perf-node-gather-daemonset-f7p7w"] Apr 24 22:08:16.149783 ip-10-0-142-241 kubenswrapper[2579]: W0424 22:08:16.149755 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podff1029e1_4e52_4c4d_956f_806576ab3917.slice/crio-3e5f0fd84b233fb80823336b2fd98699b0201ccda0e00a2605e6c0d17e42f5d8 WatchSource:0}: Error finding container 3e5f0fd84b233fb80823336b2fd98699b0201ccda0e00a2605e6c0d17e42f5d8: Status 404 returned error can't find the container with id 3e5f0fd84b233fb80823336b2fd98699b0201ccda0e00a2605e6c0d17e42f5d8 Apr 24 22:08:16.254624 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:16.254600 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jwzsk_1d4e12bc-30b8-4123-b939-ae3d8fa15235/dns-node-resolver/0.log" Apr 24 22:08:16.678564 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:16.678530 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bccfr/perf-node-gather-daemonset-f7p7w" event={"ID":"ff1029e1-4e52-4c4d-956f-806576ab3917","Type":"ContainerStarted","Data":"bb8c66f73b2da5e27f60c1ea1c443af1b38b0ecfd19918e61d9e6bb961c749a1"} Apr 24 22:08:16.678564 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:16.678565 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bccfr/perf-node-gather-daemonset-f7p7w" event={"ID":"ff1029e1-4e52-4c4d-956f-806576ab3917","Type":"ContainerStarted","Data":"3e5f0fd84b233fb80823336b2fd98699b0201ccda0e00a2605e6c0d17e42f5d8"} Apr 24 22:08:16.678770 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:16.678588 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-bccfr/perf-node-gather-daemonset-f7p7w" Apr 24 22:08:16.694727 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:16.694677 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-bccfr/perf-node-gather-daemonset-f7p7w" podStartSLOduration=1.694663776 podStartE2EDuration="1.694663776s" podCreationTimestamp="2026-04-24 22:08:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-24 22:08:16.692774347 +0000 UTC m=+3101.555499444" watchObservedRunningTime="2026-04-24 22:08:16.694663776 +0000 UTC m=+3101.557388860" Apr 24 22:08:16.735745 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:16.735714 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wglcz_215d3361-bff8-4125-b4d2-ed78b228872a/node-ca/0.log" Apr 24 22:08:17.758306 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:17.758279 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nj869_403124c9-db4a-4d6b-a7b2-d59c7568de7e/serve-healthcheck-canary/0.log" Apr 24 22:08:18.275036 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:18.275008 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qs276_285b2b48-f737-45d2-80ef-45b4bc73abd2/kube-rbac-proxy/0.log" Apr 24 22:08:18.293163 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:18.293139 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qs276_285b2b48-f737-45d2-80ef-45b4bc73abd2/exporter/0.log" Apr 24 22:08:18.312355 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:18.312314 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qs276_285b2b48-f737-45d2-80ef-45b4bc73abd2/extractor/0.log" Apr 24 22:08:22.691508 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:22.691478 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-bccfr/perf-node-gather-daemonset-f7p7w" Apr 24 22:08:25.544547 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:25.544497 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-6wpnd_6186d834-bc6e-496f-b37d-1bf65365610b/kube-multus/0.log" Apr 24 22:08:25.591429 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:25.591408 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7mrlq_9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4/kube-multus-additional-cni-plugins/0.log" Apr 24 22:08:25.614890 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:25.614869 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7mrlq_9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4/egress-router-binary-copy/0.log" Apr 24 22:08:25.639024 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:25.638998 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7mrlq_9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4/cni-plugins/0.log" Apr 24 22:08:25.664536 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:25.664511 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7mrlq_9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4/bond-cni-plugin/0.log" Apr 24 22:08:25.698048 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:25.698023 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7mrlq_9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4/routeoverride-cni/0.log" Apr 24 22:08:25.723946 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:25.723920 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7mrlq_9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4/whereabouts-cni-bincopy/0.log" Apr 24 22:08:25.750631 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:25.750608 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7mrlq_9acf9fa8-3c6f-40f6-8b74-f67a8d8df8b4/whereabouts-cni/0.log" Apr 24 22:08:26.588291 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:26.588261 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qvphd_29637be2-89a9-414b-81e0-8c4ebdda7fe0/network-metrics-daemon/0.log" Apr 24 22:08:26.610487 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:26.610465 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qvphd_29637be2-89a9-414b-81e0-8c4ebdda7fe0/kube-rbac-proxy/0.log" Apr 24 22:08:27.421597 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:27.421557 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bbpmt_d1e4bd81-6e20-4f1b-b9d3-28105e397f45/ovn-controller/0.log" Apr 24 22:08:27.459471 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:27.459425 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bbpmt_d1e4bd81-6e20-4f1b-b9d3-28105e397f45/ovn-acl-logging/0.log" Apr 24 22:08:27.476470 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:27.476446 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bbpmt_d1e4bd81-6e20-4f1b-b9d3-28105e397f45/kube-rbac-proxy-node/0.log" Apr 24 22:08:27.500899 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:27.500873 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bbpmt_d1e4bd81-6e20-4f1b-b9d3-28105e397f45/kube-rbac-proxy-ovn-metrics/0.log" Apr 24 22:08:27.520601 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:27.520577 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bbpmt_d1e4bd81-6e20-4f1b-b9d3-28105e397f45/northd/0.log" Apr 24 22:08:27.539109 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:27.539085 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bbpmt_d1e4bd81-6e20-4f1b-b9d3-28105e397f45/nbdb/0.log" Apr 24 22:08:27.558941 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:27.558888 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bbpmt_d1e4bd81-6e20-4f1b-b9d3-28105e397f45/sbdb/0.log" Apr 24 22:08:27.647327 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:27.647296 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bbpmt_d1e4bd81-6e20-4f1b-b9d3-28105e397f45/ovnkube-controller/0.log" Apr 24 22:08:29.359814 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:29.359786 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-s9p7t_b98dea0d-9954-40bd-a46c-865213211e17/network-check-target-container/0.log" Apr 24 22:08:30.244063 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:30.244030 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-ks7fr_42cf6af5-0cd5-4da4-876e-4b7ee6eaf49e/iptables-alerter/0.log" Apr 24 22:08:30.985919 ip-10-0-142-241 kubenswrapper[2579]: I0424 22:08:30.985887 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-sz2jd_1f929846-6c97-466b-9af3-7a619ca05ce6/tuned/0.log"