May 21 10:30:06.978235 ip-10-0-142-214 systemd[1]: Starting Kubernetes Kubelet... May 21 10:30:07.376180 ip-10-0-142-214 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 10:30:07.376180 ip-10-0-142-214 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 21 10:30:07.376180 ip-10-0-142-214 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 10:30:07.376180 ip-10-0-142-214 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 21 10:30:07.377317 ip-10-0-142-214 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 10:30:07.378408 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.378315 2565 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 21 10:30:07.382404 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382389 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 10:30:07.382404 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382404 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 10:30:07.382476 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382408 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 10:30:07.382476 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382412 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 10:30:07.382476 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382415 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 10:30:07.382476 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382418 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 10:30:07.382476 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382421 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 10:30:07.382476 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382425 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 10:30:07.382476 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382427 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 10:30:07.382476 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382431 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 10:30:07.382476 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382434 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 10:30:07.382476 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382437 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 10:30:07.382476 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382448 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 10:30:07.382476 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382452 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 10:30:07.382476 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382456 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 10:30:07.382476 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382459 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 10:30:07.382476 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382462 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 10:30:07.382476 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382465 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 10:30:07.382476 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382468 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 10:30:07.382476 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382470 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 10:30:07.382476 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382474 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 10:30:07.382935 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382477 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 10:30:07.382935 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382479 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 10:30:07.382935 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382482 2565 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 10:30:07.382935 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382485 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 10:30:07.382935 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382489 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 10:30:07.382935 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382492 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 10:30:07.382935 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382495 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 10:30:07.382935 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382498 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 10:30:07.382935 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382501 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 10:30:07.382935 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382504 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 10:30:07.382935 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382507 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 10:30:07.382935 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382509 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 10:30:07.382935 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382512 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 10:30:07.382935 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382514 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 10:30:07.382935 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382517 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 10:30:07.382935 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382519 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 10:30:07.382935 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382522 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 10:30:07.382935 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382525 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 10:30:07.382935 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382528 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 10:30:07.382935 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382530 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 10:30:07.383448 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382533 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 10:30:07.383448 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382535 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 10:30:07.383448 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382538 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 10:30:07.383448 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382540 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 10:30:07.383448 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382542 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 10:30:07.383448 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382545 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 10:30:07.383448 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382548 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 10:30:07.383448 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382550 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 10:30:07.383448 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382553 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 10:30:07.383448 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382558 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 10:30:07.383448 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382561 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 10:30:07.383448 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382564 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 10:30:07.383448 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382566 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 10:30:07.383448 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382571 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 10:30:07.383448 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382574 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 10:30:07.383448 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382577 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 10:30:07.383448 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382579 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 10:30:07.383448 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382582 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 10:30:07.383448 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382584 2565 feature_gate.go:328] unrecognized feature gate: Example2 May 21 10:30:07.383921 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382587 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 10:30:07.383921 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382589 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 10:30:07.383921 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382592 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 10:30:07.383921 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382595 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 10:30:07.383921 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382597 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 10:30:07.383921 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382600 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 10:30:07.383921 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382603 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 10:30:07.383921 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382605 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 10:30:07.383921 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382608 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 10:30:07.383921 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382610 2565 feature_gate.go:328] unrecognized feature gate: Example May 21 10:30:07.383921 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382613 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 10:30:07.383921 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382616 2565 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 10:30:07.383921 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382618 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 10:30:07.383921 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382622 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 10:30:07.383921 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382625 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 10:30:07.383921 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382627 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 10:30:07.383921 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382630 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 10:30:07.383921 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382632 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 10:30:07.383921 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382634 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 10:30:07.383921 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382637 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 10:30:07.384509 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382640 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 10:30:07.384509 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382642 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 10:30:07.384509 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382645 2565 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 10:30:07.384509 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382647 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 10:30:07.384509 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382650 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 10:30:07.384509 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.382652 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 10:30:07.385005 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.384993 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 10:30:07.385005 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385004 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 10:30:07.385068 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385007 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 10:30:07.385068 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385010 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 10:30:07.385068 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385014 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 10:30:07.385068 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385017 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 10:30:07.385068 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385019 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 10:30:07.385068 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385022 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 10:30:07.385068 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385025 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 10:30:07.385068 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385029 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 10:30:07.385068 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385032 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 10:30:07.385068 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385034 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 10:30:07.385068 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385037 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 10:30:07.385068 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385041 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 10:30:07.385068 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385044 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 10:30:07.385068 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385048 2565 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 10:30:07.385068 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385050 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 10:30:07.385068 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385053 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 10:30:07.385068 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385056 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 10:30:07.385068 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385059 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 10:30:07.385068 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385062 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 10:30:07.385068 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385065 2565 feature_gate.go:328] unrecognized feature gate: Example May 21 10:30:07.385557 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385067 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 10:30:07.385557 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385070 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 10:30:07.385557 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385073 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 10:30:07.385557 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385075 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 10:30:07.385557 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385078 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 10:30:07.385557 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385081 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 10:30:07.385557 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385084 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 10:30:07.385557 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385087 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 10:30:07.385557 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385090 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 10:30:07.385557 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385092 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 10:30:07.385557 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385095 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 10:30:07.385557 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385098 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 10:30:07.385557 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385101 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 10:30:07.385557 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385103 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 10:30:07.385557 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385105 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 10:30:07.385557 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385108 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 10:30:07.385557 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385110 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 10:30:07.385557 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385113 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 10:30:07.385557 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385115 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 10:30:07.385557 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385118 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 10:30:07.386194 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385121 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 10:30:07.386194 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385123 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 10:30:07.386194 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385126 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 10:30:07.386194 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385128 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 10:30:07.386194 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385131 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 10:30:07.386194 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385134 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 10:30:07.386194 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385136 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 10:30:07.386194 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385139 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 10:30:07.386194 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385142 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 10:30:07.386194 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385144 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 10:30:07.386194 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385147 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 10:30:07.386194 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385149 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 10:30:07.386194 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385152 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 10:30:07.386194 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385155 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 10:30:07.386194 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385158 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 10:30:07.386194 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385161 2565 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 10:30:07.386194 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385163 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 10:30:07.386194 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385166 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 10:30:07.386194 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385168 2565 feature_gate.go:328] unrecognized feature gate: Example2 May 21 10:30:07.386194 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385171 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 10:30:07.387013 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385173 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 10:30:07.387013 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385176 2565 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 10:30:07.387013 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385178 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 10:30:07.387013 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385181 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 10:30:07.387013 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385183 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 10:30:07.387013 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385186 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 10:30:07.387013 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385188 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 10:30:07.387013 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385192 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 10:30:07.387013 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385194 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 10:30:07.387013 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385197 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 10:30:07.387013 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385199 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 10:30:07.387013 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385202 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 10:30:07.387013 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385204 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 10:30:07.387013 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385208 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 10:30:07.387013 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385212 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 10:30:07.387013 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385214 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 10:30:07.387013 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385217 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 10:30:07.387013 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385219 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 10:30:07.387013 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385222 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 10:30:07.387511 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385224 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 10:30:07.387511 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385227 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 10:30:07.387511 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385229 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 10:30:07.387511 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385232 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 10:30:07.387511 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.385235 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 10:30:07.387511 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385305 2565 flags.go:64] FLAG: --address="0.0.0.0" May 21 10:30:07.387511 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385313 2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 21 10:30:07.387511 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385319 2565 flags.go:64] FLAG: --anonymous-auth="true" May 21 10:30:07.387511 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385326 2565 flags.go:64] FLAG: --application-metrics-count-limit="100" May 21 10:30:07.387511 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385331 2565 flags.go:64] FLAG: --authentication-token-webhook="false" May 21 10:30:07.387511 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385334 2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 21 10:30:07.387511 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385339 2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 21 10:30:07.387511 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385343 2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 21 10:30:07.387511 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385347 2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 21 10:30:07.387511 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385350 2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 21 10:30:07.387511 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385353 2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 21 10:30:07.387511 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385357 2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 21 10:30:07.387511 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385360 2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 21 10:30:07.387511 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385363 2565 flags.go:64] FLAG: --cgroup-root="" May 21 10:30:07.387511 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385366 2565 flags.go:64] FLAG: --cgroups-per-qos="true" May 21 10:30:07.387511 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385369 2565 flags.go:64] FLAG: --client-ca-file="" May 21 10:30:07.387511 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385372 2565 flags.go:64] FLAG: --cloud-config="" May 21 10:30:07.387511 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385375 2565 flags.go:64] FLAG: --cloud-provider="external" May 21 10:30:07.388118 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385378 2565 flags.go:64] FLAG: --cluster-dns="[]" May 21 10:30:07.388118 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385382 2565 flags.go:64] FLAG: --cluster-domain="" May 21 10:30:07.388118 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385385 2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 21 10:30:07.388118 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385389 2565 flags.go:64] FLAG: --config-dir="" May 21 10:30:07.388118 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385393 2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 21 10:30:07.388118 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385411 2565 flags.go:64] FLAG: --container-log-max-files="5" May 21 10:30:07.388118 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385416 2565 flags.go:64] FLAG: --container-log-max-size="10Mi" May 21 10:30:07.388118 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385420 2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 21 10:30:07.388118 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385423 2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 21 10:30:07.388118 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385427 2565 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 21 10:30:07.388118 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385430 2565 flags.go:64] FLAG: --contention-profiling="false" May 21 10:30:07.388118 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385433 2565 flags.go:64] FLAG: --cpu-cfs-quota="true" May 21 10:30:07.388118 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385436 2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 21 10:30:07.388118 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385440 2565 flags.go:64] FLAG: --cpu-manager-policy="none" May 21 10:30:07.388118 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385443 2565 flags.go:64] FLAG: --cpu-manager-policy-options="" May 21 10:30:07.388118 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385447 2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 21 10:30:07.388118 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385451 2565 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 21 10:30:07.388118 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385454 2565 flags.go:64] FLAG: --enable-debugging-handlers="true" May 21 10:30:07.388118 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385457 2565 flags.go:64] FLAG: --enable-load-reader="false" May 21 10:30:07.388118 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385461 2565 flags.go:64] FLAG: --enable-server="true" May 21 10:30:07.388118 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385464 2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 21 10:30:07.388118 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385467 2565 flags.go:64] FLAG: --event-burst="100" May 21 10:30:07.388118 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385471 2565 flags.go:64] FLAG: --event-qps="50" May 21 10:30:07.388118 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385474 2565 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 21 10:30:07.388118 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385477 2565 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 21 10:30:07.388738 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385480 2565 flags.go:64] FLAG: --eviction-hard="" May 21 10:30:07.388738 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385484 2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 21 10:30:07.388738 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385487 2565 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 21 10:30:07.388738 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385490 2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 21 10:30:07.388738 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385493 2565 flags.go:64] FLAG: --eviction-soft="" May 21 10:30:07.388738 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385496 2565 flags.go:64] FLAG: --eviction-soft-grace-period="" May 21 10:30:07.388738 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385498 2565 flags.go:64] FLAG: --exit-on-lock-contention="false" May 21 10:30:07.388738 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385501 2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 21 10:30:07.388738 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385505 2565 flags.go:64] FLAG: --experimental-mounter-path="" May 21 10:30:07.388738 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385507 2565 flags.go:64] FLAG: --fail-cgroupv1="false" May 21 10:30:07.388738 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385510 2565 flags.go:64] FLAG: --fail-swap-on="true" May 21 10:30:07.388738 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385513 2565 flags.go:64] FLAG: --feature-gates="" May 21 10:30:07.388738 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385518 2565 flags.go:64] FLAG: --file-check-frequency="20s" May 21 10:30:07.388738 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385521 2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 21 10:30:07.388738 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385525 2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 21 10:30:07.388738 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385528 2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 21 10:30:07.388738 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385531 2565 flags.go:64] FLAG: --healthz-port="10248" May 21 10:30:07.388738 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385535 2565 flags.go:64] FLAG: --help="false" May 21 10:30:07.388738 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385538 2565 flags.go:64] FLAG: --hostname-override="ip-10-0-142-214.ec2.internal" May 21 10:30:07.388738 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385541 2565 flags.go:64] FLAG: --housekeeping-interval="10s" May 21 10:30:07.388738 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385544 2565 flags.go:64] FLAG: --http-check-frequency="20s" May 21 10:30:07.388738 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385547 2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 21 10:30:07.388738 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385551 2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 21 10:30:07.388738 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385555 2565 flags.go:64] FLAG: --image-gc-high-threshold="85" May 21 10:30:07.389338 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385558 2565 flags.go:64] FLAG: --image-gc-low-threshold="80" May 21 10:30:07.389338 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385561 2565 flags.go:64] FLAG: --image-service-endpoint="" May 21 10:30:07.389338 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385564 2565 flags.go:64] FLAG: --kernel-memcg-notification="false" May 21 10:30:07.389338 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385568 2565 flags.go:64] FLAG: --kube-api-burst="100" May 21 10:30:07.389338 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385571 2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 21 10:30:07.389338 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385574 2565 flags.go:64] FLAG: --kube-api-qps="50" May 21 10:30:07.389338 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385577 2565 flags.go:64] FLAG: --kube-reserved="" May 21 10:30:07.389338 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385580 2565 flags.go:64] FLAG: --kube-reserved-cgroup="" May 21 10:30:07.389338 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385583 2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 21 10:30:07.389338 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385586 2565 flags.go:64] FLAG: --kubelet-cgroups="" May 21 10:30:07.389338 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385589 2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 21 10:30:07.389338 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385592 2565 flags.go:64] FLAG: --lock-file="" May 21 10:30:07.389338 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385595 2565 flags.go:64] FLAG: --log-cadvisor-usage="false" May 21 10:30:07.389338 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385598 2565 flags.go:64] FLAG: --log-flush-frequency="5s" May 21 10:30:07.389338 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385600 2565 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 21 10:30:07.389338 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385606 2565 flags.go:64] FLAG: --log-json-split-stream="false" May 21 10:30:07.389338 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385609 2565 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 21 10:30:07.389338 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385612 2565 flags.go:64] FLAG: --log-text-split-stream="false" May 21 10:30:07.389338 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385615 2565 flags.go:64] FLAG: --logging-format="text" May 21 10:30:07.389338 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385618 2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 21 10:30:07.389338 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385622 2565 flags.go:64] FLAG: --make-iptables-util-chains="true" May 21 10:30:07.389338 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385626 2565 flags.go:64] FLAG: --manifest-url="" May 21 10:30:07.389338 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385629 2565 flags.go:64] FLAG: --manifest-url-header="" May 21 10:30:07.389338 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385633 2565 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 21 10:30:07.389338 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385637 2565 flags.go:64] FLAG: --max-open-files="1000000" May 21 10:30:07.389929 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385641 2565 flags.go:64] FLAG: --max-pods="110" May 21 10:30:07.389929 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385644 2565 flags.go:64] FLAG: --maximum-dead-containers="-1" May 21 10:30:07.389929 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385647 2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 21 10:30:07.389929 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385650 2565 flags.go:64] FLAG: --memory-manager-policy="None" May 21 10:30:07.389929 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385653 2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 21 10:30:07.389929 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385656 2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 21 10:30:07.389929 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385659 2565 flags.go:64] FLAG: --node-ip="0.0.0.0" May 21 10:30:07.389929 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385663 2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 21 10:30:07.389929 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385670 2565 flags.go:64] FLAG: --node-status-max-images="50" May 21 10:30:07.389929 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385673 2565 flags.go:64] FLAG: --node-status-update-frequency="10s" May 21 10:30:07.389929 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385676 2565 flags.go:64] FLAG: --oom-score-adj="-999" May 21 10:30:07.389929 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385679 2565 flags.go:64] FLAG: --pod-cidr="" May 21 10:30:07.389929 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385682 2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 21 10:30:07.389929 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385687 2565 flags.go:64] FLAG: --pod-manifest-path="" May 21 10:30:07.389929 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385691 2565 flags.go:64] FLAG: --pod-max-pids="-1" May 21 10:30:07.389929 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385694 2565 flags.go:64] FLAG: --pods-per-core="0" May 21 10:30:07.389929 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385697 2565 flags.go:64] FLAG: --port="10250" May 21 10:30:07.389929 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385700 2565 flags.go:64] FLAG: --protect-kernel-defaults="false" May 21 10:30:07.389929 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385704 2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03a8c10178432090a" May 21 10:30:07.389929 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385707 2565 flags.go:64] FLAG: --qos-reserved="" May 21 10:30:07.389929 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385710 2565 flags.go:64] FLAG: --read-only-port="10255" May 21 10:30:07.389929 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385713 2565 flags.go:64] FLAG: --register-node="true" May 21 10:30:07.389929 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385716 2565 flags.go:64] FLAG: --register-schedulable="true" May 21 10:30:07.389929 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385719 2565 flags.go:64] FLAG: --register-with-taints="" May 21 10:30:07.390533 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385723 2565 flags.go:64] FLAG: --registry-burst="10" May 21 10:30:07.390533 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385726 2565 flags.go:64] FLAG: --registry-qps="5" May 21 10:30:07.390533 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385729 2565 flags.go:64] FLAG: --reserved-cpus="" May 21 10:30:07.390533 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385732 2565 flags.go:64] FLAG: --reserved-memory="" May 21 10:30:07.390533 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385736 2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 21 10:30:07.390533 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385739 2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 21 10:30:07.390533 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385742 2565 flags.go:64] FLAG: --rotate-certificates="false" May 21 10:30:07.390533 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385745 2565 flags.go:64] FLAG: --rotate-server-certificates="false" May 21 10:30:07.390533 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385748 2565 flags.go:64] FLAG: --runonce="false" May 21 10:30:07.390533 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385751 2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 21 10:30:07.390533 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385754 2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 21 10:30:07.390533 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385757 2565 flags.go:64] FLAG: --seccomp-default="false" May 21 10:30:07.390533 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385763 2565 flags.go:64] FLAG: --serialize-image-pulls="true" May 21 10:30:07.390533 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385766 2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 21 10:30:07.390533 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385772 2565 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 21 10:30:07.390533 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385776 2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 21 10:30:07.390533 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385779 2565 flags.go:64] FLAG: --storage-driver-password="root" May 21 10:30:07.390533 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385782 2565 flags.go:64] FLAG: --storage-driver-secure="false" May 21 10:30:07.390533 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385785 2565 flags.go:64] FLAG: --storage-driver-table="stats" May 21 10:30:07.390533 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385788 2565 flags.go:64] FLAG: --storage-driver-user="root" May 21 10:30:07.390533 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385791 2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 21 10:30:07.390533 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385794 2565 flags.go:64] FLAG: --sync-frequency="1m0s" May 21 10:30:07.390533 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385797 2565 flags.go:64] FLAG: --system-cgroups="" May 21 10:30:07.390533 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385800 2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 21 10:30:07.390533 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385805 2565 flags.go:64] FLAG: --system-reserved-cgroup="" May 21 10:30:07.391203 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385808 2565 flags.go:64] FLAG: --tls-cert-file="" May 21 10:30:07.391203 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385811 2565 flags.go:64] FLAG: --tls-cipher-suites="[]" May 21 10:30:07.391203 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385815 2565 flags.go:64] FLAG: --tls-min-version="" May 21 10:30:07.391203 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385818 2565 flags.go:64] FLAG: --tls-private-key-file="" May 21 10:30:07.391203 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385821 2565 flags.go:64] FLAG: --topology-manager-policy="none" May 21 10:30:07.391203 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385824 2565 flags.go:64] FLAG: --topology-manager-policy-options="" May 21 10:30:07.391203 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385827 2565 flags.go:64] FLAG: --topology-manager-scope="container" May 21 10:30:07.391203 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385830 2565 flags.go:64] FLAG: --v="2" May 21 10:30:07.391203 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385834 2565 flags.go:64] FLAG: --version="false" May 21 10:30:07.391203 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385838 2565 flags.go:64] FLAG: --vmodule="" May 21 10:30:07.391203 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385843 2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 21 10:30:07.391203 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.385846 2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 21 10:30:07.391203 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387144 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 10:30:07.391203 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387157 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 10:30:07.391203 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387160 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 10:30:07.391203 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387163 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 10:30:07.391203 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387166 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 10:30:07.391203 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387169 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 10:30:07.391203 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387172 2565 feature_gate.go:328] unrecognized feature gate: Example May 21 10:30:07.391203 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387175 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 10:30:07.391203 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387178 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 10:30:07.391203 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387181 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 10:30:07.391203 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387184 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 10:30:07.391775 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387200 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 10:30:07.391775 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387204 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 10:30:07.391775 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387207 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 10:30:07.391775 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387210 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 10:30:07.391775 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387213 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 10:30:07.391775 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387216 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 10:30:07.391775 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387219 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 10:30:07.391775 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387221 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 10:30:07.391775 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387224 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 10:30:07.391775 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387227 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 10:30:07.391775 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387229 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 10:30:07.391775 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387232 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 10:30:07.391775 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387235 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 10:30:07.391775 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387237 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 10:30:07.391775 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387240 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 10:30:07.391775 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387242 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 10:30:07.391775 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387245 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 10:30:07.391775 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387248 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 10:30:07.391775 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387250 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 10:30:07.392287 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387253 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 10:30:07.392287 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387257 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 10:30:07.392287 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387262 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 10:30:07.392287 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387267 2565 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 10:30:07.392287 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387270 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 10:30:07.392287 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387272 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 10:30:07.392287 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387275 2565 feature_gate.go:328] unrecognized feature gate: Example2 May 21 10:30:07.392287 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387277 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 10:30:07.392287 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387280 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 10:30:07.392287 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387282 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 10:30:07.392287 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387285 2565 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 10:30:07.392287 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387287 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 10:30:07.392287 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387290 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 10:30:07.392287 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387293 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 10:30:07.392287 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387295 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 10:30:07.392287 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387298 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 10:30:07.392287 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387301 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 10:30:07.392287 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387303 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 10:30:07.392287 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387306 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 10:30:07.392287 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387308 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 10:30:07.392778 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387311 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 10:30:07.392778 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387313 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 10:30:07.392778 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387316 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 10:30:07.392778 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387318 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 10:30:07.392778 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387321 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 10:30:07.392778 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387324 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 10:30:07.392778 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387326 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 10:30:07.392778 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387329 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 10:30:07.392778 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387331 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 10:30:07.392778 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387334 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 10:30:07.392778 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387337 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 10:30:07.392778 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387339 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 10:30:07.392778 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387342 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 10:30:07.392778 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387344 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 10:30:07.392778 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387347 2565 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 10:30:07.392778 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387351 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 10:30:07.392778 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387354 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 10:30:07.392778 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387357 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 10:30:07.392778 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387359 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 10:30:07.393442 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387362 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 10:30:07.393442 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387364 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 10:30:07.393442 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387367 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 10:30:07.393442 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387369 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 10:30:07.393442 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387372 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 10:30:07.393442 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387374 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 10:30:07.393442 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387377 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 10:30:07.393442 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387380 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 10:30:07.393442 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387383 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 10:30:07.393442 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387386 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 10:30:07.393442 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387389 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 10:30:07.393442 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387391 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 10:30:07.393442 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387394 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 10:30:07.393442 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387396 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 10:30:07.393442 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387399 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 10:30:07.393442 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387401 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 10:30:07.393442 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.387404 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 10:30:07.394198 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.388008 2565 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 10:30:07.394849 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.394825 2565 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 21 10:30:07.394849 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.394849 2565 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 21 10:30:07.395077 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.394917 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 10:30:07.395077 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.394925 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 10:30:07.395077 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.394931 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 10:30:07.395077 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.394952 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 10:30:07.395077 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.394957 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 10:30:07.395077 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.394961 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 10:30:07.395077 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.394965 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 10:30:07.395077 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.394969 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 10:30:07.395077 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.394974 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 10:30:07.395077 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.394977 2565 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 10:30:07.395077 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.394981 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 10:30:07.395077 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.394985 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 10:30:07.395077 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.394989 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 10:30:07.395077 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.394993 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 10:30:07.395077 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.394997 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 10:30:07.395077 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395001 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 10:30:07.395077 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395005 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 10:30:07.395077 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395008 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 10:30:07.395077 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395014 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 10:30:07.395077 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395018 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 10:30:07.395969 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395021 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 10:30:07.395969 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395025 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 10:30:07.395969 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395030 2565 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 10:30:07.395969 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395033 2565 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 10:30:07.395969 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395037 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 10:30:07.395969 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395042 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 10:30:07.395969 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395047 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 10:30:07.395969 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395051 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 10:30:07.395969 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395055 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 10:30:07.395969 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395059 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 10:30:07.395969 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395063 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 10:30:07.395969 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395071 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 10:30:07.395969 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395075 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 10:30:07.395969 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395079 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 10:30:07.395969 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395083 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 10:30:07.395969 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395088 2565 feature_gate.go:328] unrecognized feature gate: Example2 May 21 10:30:07.395969 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395092 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 10:30:07.395969 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395096 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 10:30:07.395969 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395100 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 10:30:07.395969 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395105 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 10:30:07.396564 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395109 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 10:30:07.396564 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395114 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 10:30:07.396564 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395118 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 10:30:07.396564 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395122 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 10:30:07.396564 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395126 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 10:30:07.396564 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395130 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 10:30:07.396564 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395135 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 10:30:07.396564 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395139 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 10:30:07.396564 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395146 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 10:30:07.396564 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395153 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 10:30:07.396564 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395158 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 10:30:07.396564 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395162 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 10:30:07.396564 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395166 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 10:30:07.396564 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395171 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 10:30:07.396564 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395175 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 10:30:07.396564 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395180 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 10:30:07.396564 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395184 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 10:30:07.396564 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395197 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 10:30:07.396564 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395201 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 10:30:07.397136 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395206 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 10:30:07.397136 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395210 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 10:30:07.397136 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395215 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 10:30:07.397136 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395219 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 10:30:07.397136 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395223 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 10:30:07.397136 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395230 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 10:30:07.397136 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395234 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 10:30:07.397136 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395240 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 10:30:07.397136 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395247 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 10:30:07.397136 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395251 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 10:30:07.397136 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395255 2565 feature_gate.go:328] unrecognized feature gate: Example May 21 10:30:07.397136 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395259 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 10:30:07.397136 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395264 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 10:30:07.397136 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395268 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 10:30:07.397136 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395273 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 10:30:07.397136 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395277 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 10:30:07.397136 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395281 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 10:30:07.397136 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395286 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 10:30:07.397136 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395290 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 10:30:07.397136 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395294 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 10:30:07.397872 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395299 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 10:30:07.397872 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395303 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 10:30:07.397872 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395308 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 10:30:07.397872 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395312 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 10:30:07.397872 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395316 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 10:30:07.397872 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395320 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 10:30:07.397872 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395325 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 10:30:07.397872 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.395333 2565 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 10:30:07.397872 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395489 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 10:30:07.397872 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395497 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 10:30:07.397872 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395502 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 10:30:07.397872 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395507 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 10:30:07.397872 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395512 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 10:30:07.397872 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395516 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 10:30:07.397872 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395521 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 10:30:07.398276 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395525 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 10:30:07.398276 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395529 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 10:30:07.398276 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395533 2565 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 10:30:07.398276 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395540 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 10:30:07.398276 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395545 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 10:30:07.398276 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395549 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 10:30:07.398276 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395554 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 10:30:07.398276 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395558 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 10:30:07.398276 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395562 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 10:30:07.398276 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395567 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 10:30:07.398276 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395571 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 10:30:07.398276 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395575 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 10:30:07.398276 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395579 2565 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 10:30:07.398276 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395584 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 10:30:07.398276 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395589 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 10:30:07.398276 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395593 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 10:30:07.398276 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395598 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 10:30:07.398276 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395604 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 10:30:07.398276 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395609 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 10:30:07.398276 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395613 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 10:30:07.398792 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395617 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 10:30:07.398792 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395621 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 10:30:07.398792 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395626 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 10:30:07.398792 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395630 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 10:30:07.398792 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395634 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 10:30:07.398792 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395639 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 10:30:07.398792 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395643 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 10:30:07.398792 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395647 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 10:30:07.398792 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395651 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 10:30:07.398792 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395655 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 10:30:07.398792 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395659 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 10:30:07.398792 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395663 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 10:30:07.398792 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395667 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 10:30:07.398792 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395671 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 10:30:07.398792 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395675 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 10:30:07.398792 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395680 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 10:30:07.398792 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395685 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 10:30:07.398792 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395690 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 10:30:07.398792 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395694 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 10:30:07.399324 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395699 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 10:30:07.399324 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395703 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 10:30:07.399324 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395707 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 10:30:07.399324 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395711 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 10:30:07.399324 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395715 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 10:30:07.399324 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395720 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 10:30:07.399324 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395724 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 10:30:07.399324 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395728 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 10:30:07.399324 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395732 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 10:30:07.399324 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395736 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 10:30:07.399324 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395740 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 10:30:07.399324 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395744 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 10:30:07.399324 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395748 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 10:30:07.399324 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395752 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 10:30:07.399324 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395757 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 10:30:07.399324 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395761 2565 feature_gate.go:328] unrecognized feature gate: Example2 May 21 10:30:07.399324 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395765 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 10:30:07.399324 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395769 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 10:30:07.399324 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395773 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 10:30:07.399324 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395777 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 10:30:07.399826 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395781 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 10:30:07.399826 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395785 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 10:30:07.399826 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395789 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 10:30:07.399826 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395796 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 10:30:07.399826 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395802 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 10:30:07.399826 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395807 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 10:30:07.399826 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395812 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 10:30:07.399826 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395817 2565 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 10:30:07.399826 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395821 2565 feature_gate.go:328] unrecognized feature gate: Example May 21 10:30:07.399826 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395826 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 10:30:07.399826 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395831 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 10:30:07.399826 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395835 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 10:30:07.399826 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395839 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 10:30:07.399826 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395843 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 10:30:07.399826 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395848 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 10:30:07.399826 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395852 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 10:30:07.399826 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395856 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 10:30:07.399826 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395860 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 10:30:07.399826 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395864 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 10:30:07.399826 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:07.395868 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 10:30:07.400396 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.395876 2565 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 10:30:07.400396 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.396644 2565 server.go:962] "Client rotation is on, will bootstrap in background" May 21 10:30:07.403050 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.403032 2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 21 10:30:07.404028 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.403923 2565 server.go:1019] "Starting client certificate rotation" May 21 10:30:07.404089 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.404048 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 10:30:07.404089 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.404087 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 10:30:07.427075 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.427051 2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 10:30:07.428706 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.428684 2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 10:30:07.439568 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.439426 2565 log.go:25] "Validated CRI v1 runtime API" May 21 10:30:07.446699 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.446680 2565 log.go:25] "Validated CRI v1 image API" May 21 10:30:07.447906 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.447887 2565 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 21 10:30:07.453633 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.453607 2565 fs.go:135] Filesystem UUIDs: map[02dca836-57fe-4863-883a-bcd4548187b2:/dev/nvme0n1p4 2d1310bc-8a64-48cf-9352-654e4dbed7ea:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] May 21 10:30:07.453713 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.453633 2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 21 10:30:07.456989 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.456966 2565 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 10:30:07.458066 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.457934 2565 manager.go:217] Machine: {Timestamp:2026-05-21 10:30:07.457439943 +0000 UTC m=+0.370819004 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3050365 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2df135c7a93a4eb21cb433cb59f942 SystemUUID:ec2df135-c7a9-3a4e-b21c-b433cb59f942 BootID:34e23d2d-3130-4159-8778-16700ea0076e Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c2:25:ab:0d:f3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c2:25:ab:0d:f3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:aa:29:92:ca:c6:67 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 21 10:30:07.458706 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.458694 2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 21 10:30:07.458820 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.458804 2565 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 21 10:30:07.460508 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.460485 2565 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 21 10:30:07.460720 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.460511 2565 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-214.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 21 10:30:07.460800 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.460735 2565 topology_manager.go:138] "Creating topology manager with none policy" May 21 10:30:07.460800 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.460749 2565 container_manager_linux.go:306] "Creating device plugin manager" May 21 10:30:07.460800 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.460760 2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 10:30:07.462279 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.462267 2565 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 10:30:07.463816 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.463803 2565 state_mem.go:36] "Initialized new in-memory state store" May 21 10:30:07.463964 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.463953 2565 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 21 10:30:07.465866 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.465855 2565 kubelet.go:491] "Attempting to sync node with API server" May 21 10:30:07.465932 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.465880 2565 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 21 10:30:07.465932 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.465896 2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 21 10:30:07.465932 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.465909 2565 kubelet.go:397] "Adding apiserver pod source" May 21 10:30:07.465932 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.465922 2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 21 10:30:07.466908 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.466895 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 10:30:07.466991 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.466918 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 10:30:07.469533 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.469516 2565 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 21 10:30:07.471252 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.471238 2565 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 21 10:30:07.472125 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.472114 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 21 10:30:07.472161 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.472130 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 21 10:30:07.472161 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.472137 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 21 10:30:07.472161 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.472143 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 21 10:30:07.472161 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.472153 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 21 10:30:07.472161 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.472159 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 21 10:30:07.472302 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.472165 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 21 10:30:07.472302 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.472174 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 21 10:30:07.472302 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.472183 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 21 10:30:07.472302 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.472189 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 21 10:30:07.472302 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.472198 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 21 10:30:07.472560 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.472551 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 21 10:30:07.473396 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.473384 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 21 10:30:07.473396 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.473396 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 21 10:30:07.476550 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.476535 2565 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 21 10:30:07.476628 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.476573 2565 server.go:1295] "Started kubelet" May 21 10:30:07.476713 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.476681 2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 21 10:30:07.476764 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.476696 2565 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 21 10:30:07.476810 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.476772 2565 server_v1.go:47] "podresources" method="list" useActivePods=true May 21 10:30:07.477439 ip-10-0-142-214 systemd[1]: Started Kubernetes Kubelet. May 21 10:30:07.478179 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.477902 2565 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 21 10:30:07.478461 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.478444 2565 server.go:317] "Adding debug handlers to kubelet server" May 21 10:30:07.478730 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.478712 2565 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-214.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 21 10:30:07.479142 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:07.479114 2565 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 21 10:30:07.479142 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:07.479114 2565 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-214.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 21 10:30:07.483180 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.483158 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 21 10:30:07.483679 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.483664 2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 21 10:30:07.483927 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.483909 2565 volume_manager.go:295] "The desired_state_of_world populator starts" May 21 10:30:07.484079 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.484068 2565 volume_manager.go:297] "Starting Kubelet Volume Manager" May 21 10:30:07.484709 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.484692 2565 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 21 10:30:07.484990 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:07.484739 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-214.ec2.internal\" not found" May 21 10:30:07.484990 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.484904 2565 reconstruct.go:97] "Volume reconstruction finished" May 21 10:30:07.485112 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.485003 2565 reconciler.go:26] "Reconciler: start to sync state" May 21 10:30:07.485843 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.485824 2565 factory.go:55] Registering systemd factory May 21 10:30:07.485843 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.485844 2565 factory.go:223] Registration of the systemd container factory successfully May 21 10:30:07.486157 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.486142 2565 factory.go:153] Registering CRI-O factory May 21 10:30:07.486226 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.486162 2565 factory.go:223] Registration of the crio container factory successfully May 21 10:30:07.486280 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.486229 2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 21 10:30:07.486280 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.486255 2565 factory.go:103] Registering Raw factory May 21 10:30:07.486280 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.486278 2565 manager.go:1196] Started watching for new ooms in manager May 21 10:30:07.487894 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.487874 2565 manager.go:319] Starting recovery of all containers May 21 10:30:07.488062 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:07.488022 2565 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" May 21 10:30:07.489576 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:07.489511 2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-214.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" May 21 10:30:07.492618 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:07.488489 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-214.ec2.internal.18b18df42263a37f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-214.ec2.internal,UID:ip-10-0-142-214.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-214.ec2.internal,},FirstTimestamp:2026-05-21 10:30:07.476548479 +0000 UTC m=+0.389927540,LastTimestamp:2026-05-21 10:30:07.476548479 +0000 UTC m=+0.389927540,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-214.ec2.internal,}" May 21 10:30:07.495864 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:07.495798 2565 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 21 10:30:07.496077 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.496053 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7gm8r" May 21 10:30:07.499397 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.499369 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7gm8r" May 21 10:30:07.501554 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.501534 2565 manager.go:324] Recovery completed May 21 10:30:07.503180 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:07.503161 2565 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory May 21 10:30:07.506095 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.505997 2565 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 10:30:07.509403 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.509389 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-214.ec2.internal" event="NodeHasSufficientMemory" May 21 10:30:07.509471 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.509418 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-214.ec2.internal" event="NodeHasNoDiskPressure" May 21 10:30:07.509471 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.509428 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-214.ec2.internal" event="NodeHasSufficientPID" May 21 10:30:07.509962 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.509934 2565 cpu_manager.go:222] "Starting CPU manager" policy="none" May 21 10:30:07.509962 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.509961 2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 21 10:30:07.510052 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.509975 2565 state_mem.go:36] "Initialized new in-memory state store" May 21 10:30:07.511385 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:07.511318 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-214.ec2.internal.18b18df42458f8d2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-214.ec2.internal,UID:ip-10-0-142-214.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-214.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-214.ec2.internal,},FirstTimestamp:2026-05-21 10:30:07.509403858 +0000 UTC m=+0.422782919,LastTimestamp:2026-05-21 10:30:07.509403858 +0000 UTC m=+0.422782919,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-214.ec2.internal,}" May 21 10:30:07.512313 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.512300 2565 policy_none.go:49] "None policy: Start" May 21 10:30:07.512375 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.512316 2565 memory_manager.go:186] "Starting memorymanager" policy="None" May 21 10:30:07.512375 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.512327 2565 state_mem.go:35] "Initializing new in-memory state store" May 21 10:30:07.568042 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.553542 2565 manager.go:341] "Starting Device Plugin manager" May 21 10:30:07.568042 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:07.553579 2565 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 21 10:30:07.568042 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.553590 2565 server.go:85] "Starting device plugin registration server" May 21 10:30:07.568042 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.553849 2565 eviction_manager.go:189] "Eviction manager: starting control loop" May 21 10:30:07.568042 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.553862 2565 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 21 10:30:07.568042 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.553973 2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 21 10:30:07.568042 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.554055 2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 21 10:30:07.568042 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.554064 2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 21 10:30:07.568042 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:07.554803 2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 21 10:30:07.568042 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:07.554858 2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-214.ec2.internal\" not found" May 21 10:30:07.630117 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.630046 2565 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 21 10:30:07.631237 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.631223 2565 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 21 10:30:07.631318 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.631249 2565 status_manager.go:230] "Starting to sync pod status with apiserver" May 21 10:30:07.631318 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.631268 2565 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 21 10:30:07.631318 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.631274 2565 kubelet.go:2451] "Starting kubelet main sync loop" May 21 10:30:07.631318 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:07.631314 2565 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 21 10:30:07.637739 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.637720 2565 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 10:30:07.654861 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.654844 2565 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 10:30:07.656238 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.656223 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-214.ec2.internal" event="NodeHasSufficientMemory" May 21 10:30:07.656294 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.656253 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-214.ec2.internal" event="NodeHasNoDiskPressure" May 21 10:30:07.656294 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.656265 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-214.ec2.internal" event="NodeHasSufficientPID" May 21 10:30:07.656363 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.656298 2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-214.ec2.internal" May 21 10:30:07.664224 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.664209 2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-214.ec2.internal" May 21 10:30:07.664273 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:07.664231 2565 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-214.ec2.internal\": node \"ip-10-0-142-214.ec2.internal\" not found" May 21 10:30:07.676564 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:07.676541 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-214.ec2.internal\" not found" May 21 10:30:07.731917 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.731884 2565 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-214.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-214.ec2.internal"] May 21 10:30:07.732068 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.731998 2565 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 10:30:07.733873 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.733850 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-214.ec2.internal" event="NodeHasSufficientMemory" May 21 10:30:07.734000 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.733882 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-214.ec2.internal" event="NodeHasNoDiskPressure" May 21 10:30:07.734000 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.733892 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-214.ec2.internal" event="NodeHasSufficientPID" May 21 10:30:07.736249 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.736235 2565 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 10:30:07.736422 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.736407 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-214.ec2.internal" May 21 10:30:07.736468 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.736439 2565 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 10:30:07.736902 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.736884 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-214.ec2.internal" event="NodeHasSufficientMemory" May 21 10:30:07.736902 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.736894 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-214.ec2.internal" event="NodeHasSufficientMemory" May 21 10:30:07.737048 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.736911 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-214.ec2.internal" event="NodeHasNoDiskPressure" May 21 10:30:07.737048 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.736915 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-214.ec2.internal" event="NodeHasNoDiskPressure" May 21 10:30:07.737048 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.736924 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-214.ec2.internal" event="NodeHasSufficientPID" May 21 10:30:07.737048 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.736925 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-214.ec2.internal" event="NodeHasSufficientPID" May 21 10:30:07.739169 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.739156 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-214.ec2.internal" May 21 10:30:07.739235 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.739180 2565 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 10:30:07.739780 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.739769 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-214.ec2.internal" event="NodeHasSufficientMemory" May 21 10:30:07.739836 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.739786 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-214.ec2.internal" event="NodeHasNoDiskPressure" May 21 10:30:07.739836 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.739795 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-214.ec2.internal" event="NodeHasSufficientPID" May 21 10:30:07.762476 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:07.762457 2565 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-214.ec2.internal\" not found" node="ip-10-0-142-214.ec2.internal" May 21 10:30:07.768403 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:07.768385 2565 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-214.ec2.internal\" not found" node="ip-10-0-142-214.ec2.internal" May 21 10:30:07.777380 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:07.777364 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-214.ec2.internal\" not found" May 21 10:30:07.786751 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.786735 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/311b254f6fec6ca06a2a63845d2409b9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-214.ec2.internal\" (UID: \"311b254f6fec6ca06a2a63845d2409b9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-214.ec2.internal" May 21 10:30:07.786817 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.786760 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/311b254f6fec6ca06a2a63845d2409b9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-214.ec2.internal\" (UID: \"311b254f6fec6ca06a2a63845d2409b9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-214.ec2.internal" May 21 10:30:07.786817 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.786777 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/84135066f8c765a27568c2cb628cbfb6-config\") pod \"kube-apiserver-proxy-ip-10-0-142-214.ec2.internal\" (UID: \"84135066f8c765a27568c2cb628cbfb6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-214.ec2.internal" May 21 10:30:07.877481 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:07.877450 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-214.ec2.internal\" not found" May 21 10:30:07.887797 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.887749 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/311b254f6fec6ca06a2a63845d2409b9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-214.ec2.internal\" (UID: \"311b254f6fec6ca06a2a63845d2409b9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-214.ec2.internal" May 21 10:30:07.887797 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.887782 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/311b254f6fec6ca06a2a63845d2409b9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-214.ec2.internal\" (UID: \"311b254f6fec6ca06a2a63845d2409b9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-214.ec2.internal" May 21 10:30:07.887901 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.887803 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/84135066f8c765a27568c2cb628cbfb6-config\") pod \"kube-apiserver-proxy-ip-10-0-142-214.ec2.internal\" (UID: \"84135066f8c765a27568c2cb628cbfb6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-214.ec2.internal" May 21 10:30:07.887901 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.887844 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/311b254f6fec6ca06a2a63845d2409b9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-214.ec2.internal\" (UID: \"311b254f6fec6ca06a2a63845d2409b9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-214.ec2.internal" May 21 10:30:07.887901 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.887850 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/311b254f6fec6ca06a2a63845d2409b9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-214.ec2.internal\" (UID: \"311b254f6fec6ca06a2a63845d2409b9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-214.ec2.internal" May 21 10:30:07.887901 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:07.887896 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/84135066f8c765a27568c2cb628cbfb6-config\") pod \"kube-apiserver-proxy-ip-10-0-142-214.ec2.internal\" (UID: \"84135066f8c765a27568c2cb628cbfb6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-214.ec2.internal" May 21 10:30:07.977991 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:07.977955 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-214.ec2.internal\" not found" May 21 10:30:08.065475 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:08.065435 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-214.ec2.internal" May 21 10:30:08.070365 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:08.070347 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-214.ec2.internal" May 21 10:30:08.078779 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:08.078758 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-214.ec2.internal\" not found" May 21 10:30:08.179499 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:08.179413 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-214.ec2.internal\" not found" May 21 10:30:08.280015 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:08.279985 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-214.ec2.internal\" not found" May 21 10:30:08.297770 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:08.297747 2565 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 21 10:30:08.380919 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:08.380892 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-214.ec2.internal\" not found" May 21 10:30:08.404364 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:08.404338 2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 21 10:30:08.404525 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:08.404503 2565 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 21 10:30:08.404581 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:08.404518 2565 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 21 10:30:08.481624 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:08.481551 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-214.ec2.internal\" not found" May 21 10:30:08.483510 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:08.483497 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 21 10:30:08.498007 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:08.497986 2565 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 10:30:08.500918 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:08.500894 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-20 10:25:07 +0000 UTC" deadline="2027-11-26 08:02:02.086415988 +0000 UTC" May 21 10:30:08.500990 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:08.500918 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13293h31m53.585500712s" May 21 10:30:08.504594 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:08.504581 2565 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 21 10:30:08.518749 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:08.518726 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-vsclg" May 21 10:30:08.528017 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:08.527992 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vsclg" May 21 10:30:08.585498 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:08.585473 2565 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-214.ec2.internal" May 21 10:30:08.595821 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:08.595802 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 10:30:08.596668 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:08.596655 2565 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-214.ec2.internal" May 21 10:30:08.607678 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:08.607663 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 10:30:08.653584 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:08.653554 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod311b254f6fec6ca06a2a63845d2409b9.slice/crio-3dd67614fb734f40a8a02790fc01aeff9f0c1e68b0a3ca86acc9d6bb59baa7b7 WatchSource:0}: Error finding container 3dd67614fb734f40a8a02790fc01aeff9f0c1e68b0a3ca86acc9d6bb59baa7b7: Status 404 returned error can't find the container with id 3dd67614fb734f40a8a02790fc01aeff9f0c1e68b0a3ca86acc9d6bb59baa7b7 May 21 10:30:08.653917 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:08.653889 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84135066f8c765a27568c2cb628cbfb6.slice/crio-e9b8e7cd90d11ebd1d23b0a002024d6f752fcf22f37317a3b7db144398e87bcf WatchSource:0}: Error finding container e9b8e7cd90d11ebd1d23b0a002024d6f752fcf22f37317a3b7db144398e87bcf: Status 404 returned error can't find the container with id e9b8e7cd90d11ebd1d23b0a002024d6f752fcf22f37317a3b7db144398e87bcf May 21 10:30:08.657722 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:08.657707 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 10:30:09.012915 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.012879 2565 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 21 10:30:09.269536 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.269468 2565 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 10:30:09.467270 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.467017 2565 apiserver.go:52] "Watching apiserver" May 21 10:30:09.478286 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.478259 2565 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 21 10:30:09.480635 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.480606 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-n9txr","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtl4g","openshift-cluster-node-tuning-operator/tuned-zrxmj","openshift-dns/node-resolver-ml6nr","openshift-image-registry/node-ca-xgzdb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-214.ec2.internal","openshift-multus/multus-additional-cni-plugins-mk4n7","openshift-multus/network-metrics-daemon-flzlz","kube-system/kube-apiserver-proxy-ip-10-0-142-214.ec2.internal","openshift-multus/multus-g4lt2","openshift-network-diagnostics/network-check-target-pqqfc","openshift-network-operator/iptables-alerter-5r5hl","openshift-ovn-kubernetes/ovnkube-node-fhjht"] May 21 10:30:09.483416 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.483393 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mk4n7" May 21 10:30:09.486059 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.485613 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtl4g" May 21 10:30:09.486059 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.485850 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 21 10:30:09.486597 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.486239 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 21 10:30:09.486597 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.486316 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 21 10:30:09.486597 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.486241 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 21 10:30:09.486597 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.486372 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 21 10:30:09.486834 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.486660 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-lp89k\"" May 21 10:30:09.487698 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.487597 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-db48l\"" May 21 10:30:09.489351 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.488014 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zrxmj" May 21 10:30:09.489351 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.488491 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 21 10:30:09.489351 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.488542 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 21 10:30:09.489351 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.488875 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 21 10:30:09.490834 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.490811 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 21 10:30:09.491257 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.491237 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 21 10:30:09.491487 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.491460 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-x7t5h\"" May 21 10:30:09.493129 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.493107 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xgzdb" May 21 10:30:09.496242 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.495580 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ml6nr" May 21 10:30:09.496242 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.496213 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 21 10:30:09.496365 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.496319 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 21 10:30:09.496422 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.496380 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-pl6fr\"" May 21 10:30:09.496422 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.496393 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 21 10:30:09.497587 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.496898 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f4bb88d2-7c86-4029-a362-fa3f5c3650cb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dtl4g\" (UID: \"f4bb88d2-7c86-4029-a362-fa3f5c3650cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtl4g" May 21 10:30:09.497587 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.496933 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f4bb88d2-7c86-4029-a362-fa3f5c3650cb-registration-dir\") pod \"aws-ebs-csi-driver-node-dtl4g\" (UID: \"f4bb88d2-7c86-4029-a362-fa3f5c3650cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtl4g" May 21 10:30:09.497587 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.496976 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9d668cb7-db54-4720-9850-d1cbfd659b3d-etc-sysctl-d\") pod \"tuned-zrxmj\" (UID: \"9d668cb7-db54-4720-9850-d1cbfd659b3d\") " pod="openshift-cluster-node-tuning-operator/tuned-zrxmj" May 21 10:30:09.497587 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.497025 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9d668cb7-db54-4720-9850-d1cbfd659b3d-etc-sysctl-conf\") pod \"tuned-zrxmj\" (UID: \"9d668cb7-db54-4720-9850-d1cbfd659b3d\") " pod="openshift-cluster-node-tuning-operator/tuned-zrxmj" May 21 10:30:09.497587 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.497068 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9d668cb7-db54-4720-9850-d1cbfd659b3d-etc-systemd\") pod \"tuned-zrxmj\" (UID: \"9d668cb7-db54-4720-9850-d1cbfd659b3d\") " pod="openshift-cluster-node-tuning-operator/tuned-zrxmj" May 21 10:30:09.497587 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.497095 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9d668cb7-db54-4720-9850-d1cbfd659b3d-lib-modules\") pod \"tuned-zrxmj\" (UID: \"9d668cb7-db54-4720-9850-d1cbfd659b3d\") " pod="openshift-cluster-node-tuning-operator/tuned-zrxmj" May 21 10:30:09.497587 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.497121 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/762ee6cc-7e36-4827-9350-d26f6580b8db-os-release\") pod \"multus-additional-cni-plugins-mk4n7\" (UID: \"762ee6cc-7e36-4827-9350-d26f6580b8db\") " pod="openshift-multus/multus-additional-cni-plugins-mk4n7" May 21 10:30:09.497587 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.497146 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/762ee6cc-7e36-4827-9350-d26f6580b8db-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mk4n7\" (UID: \"762ee6cc-7e36-4827-9350-d26f6580b8db\") " pod="openshift-multus/multus-additional-cni-plugins-mk4n7" May 21 10:30:09.497587 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.497179 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9d668cb7-db54-4720-9850-d1cbfd659b3d-etc-tuned\") pod \"tuned-zrxmj\" (UID: \"9d668cb7-db54-4720-9850-d1cbfd659b3d\") " pod="openshift-cluster-node-tuning-operator/tuned-zrxmj" May 21 10:30:09.497587 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.497213 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/762ee6cc-7e36-4827-9350-d26f6580b8db-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mk4n7\" (UID: \"762ee6cc-7e36-4827-9350-d26f6580b8db\") " pod="openshift-multus/multus-additional-cni-plugins-mk4n7" May 21 10:30:09.497587 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.497238 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f4bb88d2-7c86-4029-a362-fa3f5c3650cb-etc-selinux\") pod \"aws-ebs-csi-driver-node-dtl4g\" (UID: \"f4bb88d2-7c86-4029-a362-fa3f5c3650cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtl4g" May 21 10:30:09.497587 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.497259 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9d668cb7-db54-4720-9850-d1cbfd659b3d-sys\") pod \"tuned-zrxmj\" (UID: \"9d668cb7-db54-4720-9850-d1cbfd659b3d\") " pod="openshift-cluster-node-tuning-operator/tuned-zrxmj" May 21 10:30:09.497587 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.497282 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgmbc\" (UniqueName: \"kubernetes.io/projected/9d668cb7-db54-4720-9850-d1cbfd659b3d-kube-api-access-sgmbc\") pod \"tuned-zrxmj\" (UID: \"9d668cb7-db54-4720-9850-d1cbfd659b3d\") " pod="openshift-cluster-node-tuning-operator/tuned-zrxmj" May 21 10:30:09.497587 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.497313 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h94nq\" (UniqueName: \"kubernetes.io/projected/f4bb88d2-7c86-4029-a362-fa3f5c3650cb-kube-api-access-h94nq\") pod \"aws-ebs-csi-driver-node-dtl4g\" (UID: \"f4bb88d2-7c86-4029-a362-fa3f5c3650cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtl4g" May 21 10:30:09.497587 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.497337 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9d668cb7-db54-4720-9850-d1cbfd659b3d-etc-modprobe-d\") pod \"tuned-zrxmj\" (UID: \"9d668cb7-db54-4720-9850-d1cbfd659b3d\") " pod="openshift-cluster-node-tuning-operator/tuned-zrxmj" May 21 10:30:09.497587 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.497360 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9d668cb7-db54-4720-9850-d1cbfd659b3d-etc-sysconfig\") pod \"tuned-zrxmj\" (UID: \"9d668cb7-db54-4720-9850-d1cbfd659b3d\") " pod="openshift-cluster-node-tuning-operator/tuned-zrxmj" May 21 10:30:09.498473 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.497382 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/762ee6cc-7e36-4827-9350-d26f6580b8db-system-cni-dir\") pod \"multus-additional-cni-plugins-mk4n7\" (UID: \"762ee6cc-7e36-4827-9350-d26f6580b8db\") " pod="openshift-multus/multus-additional-cni-plugins-mk4n7" May 21 10:30:09.498473 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.497403 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f4bb88d2-7c86-4029-a362-fa3f5c3650cb-socket-dir\") pod \"aws-ebs-csi-driver-node-dtl4g\" (UID: \"f4bb88d2-7c86-4029-a362-fa3f5c3650cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtl4g" May 21 10:30:09.498473 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.497426 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f4bb88d2-7c86-4029-a362-fa3f5c3650cb-device-dir\") pod \"aws-ebs-csi-driver-node-dtl4g\" (UID: \"f4bb88d2-7c86-4029-a362-fa3f5c3650cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtl4g" May 21 10:30:09.498473 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.497449 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9d668cb7-db54-4720-9850-d1cbfd659b3d-var-lib-kubelet\") pod \"tuned-zrxmj\" (UID: \"9d668cb7-db54-4720-9850-d1cbfd659b3d\") " pod="openshift-cluster-node-tuning-operator/tuned-zrxmj" May 21 10:30:09.498473 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.497471 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9d668cb7-db54-4720-9850-d1cbfd659b3d-host\") pod \"tuned-zrxmj\" (UID: \"9d668cb7-db54-4720-9850-d1cbfd659b3d\") " pod="openshift-cluster-node-tuning-operator/tuned-zrxmj" May 21 10:30:09.498473 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.497492 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9d668cb7-db54-4720-9850-d1cbfd659b3d-tmp\") pod \"tuned-zrxmj\" (UID: \"9d668cb7-db54-4720-9850-d1cbfd659b3d\") " pod="openshift-cluster-node-tuning-operator/tuned-zrxmj" May 21 10:30:09.498473 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.497513 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/762ee6cc-7e36-4827-9350-d26f6580b8db-cnibin\") pod \"multus-additional-cni-plugins-mk4n7\" (UID: \"762ee6cc-7e36-4827-9350-d26f6580b8db\") " pod="openshift-multus/multus-additional-cni-plugins-mk4n7" May 21 10:30:09.498473 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.497537 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/762ee6cc-7e36-4827-9350-d26f6580b8db-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mk4n7\" (UID: \"762ee6cc-7e36-4827-9350-d26f6580b8db\") " pod="openshift-multus/multus-additional-cni-plugins-mk4n7" May 21 10:30:09.498473 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.497562 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvx45\" (UniqueName: \"kubernetes.io/projected/762ee6cc-7e36-4827-9350-d26f6580b8db-kube-api-access-jvx45\") pod \"multus-additional-cni-plugins-mk4n7\" (UID: \"762ee6cc-7e36-4827-9350-d26f6580b8db\") " pod="openshift-multus/multus-additional-cni-plugins-mk4n7" May 21 10:30:09.498473 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.497583 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9d668cb7-db54-4720-9850-d1cbfd659b3d-run\") pod \"tuned-zrxmj\" (UID: \"9d668cb7-db54-4720-9850-d1cbfd659b3d\") " pod="openshift-cluster-node-tuning-operator/tuned-zrxmj" May 21 10:30:09.498473 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.497604 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/762ee6cc-7e36-4827-9350-d26f6580b8db-cni-binary-copy\") pod \"multus-additional-cni-plugins-mk4n7\" (UID: \"762ee6cc-7e36-4827-9350-d26f6580b8db\") " pod="openshift-multus/multus-additional-cni-plugins-mk4n7" May 21 10:30:09.498473 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.497629 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 21 10:30:09.498473 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.497629 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f4bb88d2-7c86-4029-a362-fa3f5c3650cb-sys-fs\") pod \"aws-ebs-csi-driver-node-dtl4g\" (UID: \"f4bb88d2-7c86-4029-a362-fa3f5c3650cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtl4g" May 21 10:30:09.498473 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.497696 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9d668cb7-db54-4720-9850-d1cbfd659b3d-etc-kubernetes\") pod \"tuned-zrxmj\" (UID: \"9d668cb7-db54-4720-9850-d1cbfd659b3d\") " pod="openshift-cluster-node-tuning-operator/tuned-zrxmj" May 21 10:30:09.498473 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.497929 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-n9txr" May 21 10:30:09.498473 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.498040 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flzlz" May 21 10:30:09.498473 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:09.498114 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-flzlz" podUID="35d22f25-59d6-48b0-a885-ddbcfcdf5cb0" May 21 10:30:09.498473 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.498125 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-89cnq\"" May 21 10:30:09.498473 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.498204 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 21 10:30:09.500254 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.500232 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 21 10:30:09.500344 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.500324 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 21 10:30:09.500671 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.500653 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hvhtd\"" May 21 10:30:09.502887 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.502684 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-g4lt2" May 21 10:30:09.502887 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.502793 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqqfc" May 21 10:30:09.502887 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:09.502850 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqqfc" podUID="03cc5e6e-7e76-47ec-80e8-795d0a71d2f8" May 21 10:30:09.504849 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.504829 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-dmdzv\"" May 21 10:30:09.504971 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.504934 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 21 10:30:09.505054 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.505036 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5r5hl" May 21 10:30:09.507189 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.507167 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vkm5q\"" May 21 10:30:09.507288 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.507167 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 21 10:30:09.507344 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.507295 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 21 10:30:09.507560 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.507540 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 21 10:30:09.507651 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.507574 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" May 21 10:30:09.509595 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.509574 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 21 10:30:09.510107 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.509801 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 21 10:30:09.510107 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.509970 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-q5dh5\"" May 21 10:30:09.510107 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.509978 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 21 10:30:09.510315 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.510255 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 21 10:30:09.510374 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.510354 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 21 10:30:09.510927 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.510909 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 21 10:30:09.528568 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.528536 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 10:25:08 +0000 UTC" deadline="2028-01-18 23:28:22.295326042 +0000 UTC" May 21 10:30:09.528568 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.528565 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14580h58m12.766764644s" May 21 10:30:09.586800 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.586773 2565 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 21 10:30:09.598730 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.598705 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/24a7e4d2-b048-41e9-8bc4-9993aed09fd4-ovnkube-script-lib\") pod \"ovnkube-node-fhjht\" (UID: \"24a7e4d2-b048-41e9-8bc4-9993aed09fd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" May 21 10:30:09.598872 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.598743 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a41a87f2-f6ab-4cb1-9b97-906ce5eece4d-multus-conf-dir\") pod \"multus-g4lt2\" (UID: \"a41a87f2-f6ab-4cb1-9b97-906ce5eece4d\") " pod="openshift-multus/multus-g4lt2" May 21 10:30:09.598872 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.598769 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1c7a9fbd-e4f0-4c8f-b533-fc8a4a1911f0-host-slash\") pod \"iptables-alerter-5r5hl\" (UID: \"1c7a9fbd-e4f0-4c8f-b533-fc8a4a1911f0\") " pod="openshift-network-operator/iptables-alerter-5r5hl" May 21 10:30:09.598872 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.598797 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/762ee6cc-7e36-4827-9350-d26f6580b8db-cni-binary-copy\") pod \"multus-additional-cni-plugins-mk4n7\" (UID: \"762ee6cc-7e36-4827-9350-d26f6580b8db\") " pod="openshift-multus/multus-additional-cni-plugins-mk4n7" May 21 10:30:09.598872 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.598841 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9d668cb7-db54-4720-9850-d1cbfd659b3d-etc-kubernetes\") pod \"tuned-zrxmj\" (UID: \"9d668cb7-db54-4720-9850-d1cbfd659b3d\") " pod="openshift-cluster-node-tuning-operator/tuned-zrxmj" May 21 10:30:09.599079 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.598905 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9d668cb7-db54-4720-9850-d1cbfd659b3d-etc-kubernetes\") pod \"tuned-zrxmj\" (UID: \"9d668cb7-db54-4720-9850-d1cbfd659b3d\") " pod="openshift-cluster-node-tuning-operator/tuned-zrxmj" May 21 10:30:09.599079 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.598959 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f4bb88d2-7c86-4029-a362-fa3f5c3650cb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dtl4g\" (UID: \"f4bb88d2-7c86-4029-a362-fa3f5c3650cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtl4g" May 21 10:30:09.599079 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.598998 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a41a87f2-f6ab-4cb1-9b97-906ce5eece4d-cni-binary-copy\") pod \"multus-g4lt2\" (UID: \"a41a87f2-f6ab-4cb1-9b97-906ce5eece4d\") " pod="openshift-multus/multus-g4lt2" May 21 10:30:09.599079 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.599021 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/24a7e4d2-b048-41e9-8bc4-9993aed09fd4-host-kubelet\") pod \"ovnkube-node-fhjht\" (UID: \"24a7e4d2-b048-41e9-8bc4-9993aed09fd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" May 21 10:30:09.599079 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.599025 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f4bb88d2-7c86-4029-a362-fa3f5c3650cb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dtl4g\" (UID: \"f4bb88d2-7c86-4029-a362-fa3f5c3650cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtl4g" May 21 10:30:09.599079 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.599043 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/24a7e4d2-b048-41e9-8bc4-9993aed09fd4-run-openvswitch\") pod \"ovnkube-node-fhjht\" (UID: \"24a7e4d2-b048-41e9-8bc4-9993aed09fd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" May 21 10:30:09.599079 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.599068 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9d668cb7-db54-4720-9850-d1cbfd659b3d-etc-tuned\") pod \"tuned-zrxmj\" (UID: \"9d668cb7-db54-4720-9850-d1cbfd659b3d\") " pod="openshift-cluster-node-tuning-operator/tuned-zrxmj" May 21 10:30:09.599358 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.599094 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/24a7e4d2-b048-41e9-8bc4-9993aed09fd4-systemd-units\") pod \"ovnkube-node-fhjht\" (UID: \"24a7e4d2-b048-41e9-8bc4-9993aed09fd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" May 21 10:30:09.599358 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.599121 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5z5pr\" (UniqueName: \"kubernetes.io/projected/f4a6b193-47ea-4a0e-b63a-3dd25c6aab85-kube-api-access-5z5pr\") pod \"node-resolver-ml6nr\" (UID: \"f4a6b193-47ea-4a0e-b63a-3dd25c6aab85\") " pod="openshift-dns/node-resolver-ml6nr" May 21 10:30:09.599358 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.599148 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a41a87f2-f6ab-4cb1-9b97-906ce5eece4d-host-run-netns\") pod \"multus-g4lt2\" (UID: \"a41a87f2-f6ab-4cb1-9b97-906ce5eece4d\") " pod="openshift-multus/multus-g4lt2" May 21 10:30:09.599358 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.599171 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a41a87f2-f6ab-4cb1-9b97-906ce5eece4d-host-var-lib-kubelet\") pod \"multus-g4lt2\" (UID: \"a41a87f2-f6ab-4cb1-9b97-906ce5eece4d\") " pod="openshift-multus/multus-g4lt2" May 21 10:30:09.599358 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.599221 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/762ee6cc-7e36-4827-9350-d26f6580b8db-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mk4n7\" (UID: \"762ee6cc-7e36-4827-9350-d26f6580b8db\") " pod="openshift-multus/multus-additional-cni-plugins-mk4n7" May 21 10:30:09.599358 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.599249 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9d668cb7-db54-4720-9850-d1cbfd659b3d-sys\") pod \"tuned-zrxmj\" (UID: \"9d668cb7-db54-4720-9850-d1cbfd659b3d\") " pod="openshift-cluster-node-tuning-operator/tuned-zrxmj" May 21 10:30:09.599358 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.599293 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9d668cb7-db54-4720-9850-d1cbfd659b3d-sys\") pod \"tuned-zrxmj\" (UID: \"9d668cb7-db54-4720-9850-d1cbfd659b3d\") " pod="openshift-cluster-node-tuning-operator/tuned-zrxmj" May 21 10:30:09.599358 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.599327 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sgmbc\" (UniqueName: \"kubernetes.io/projected/9d668cb7-db54-4720-9850-d1cbfd659b3d-kube-api-access-sgmbc\") pod \"tuned-zrxmj\" (UID: \"9d668cb7-db54-4720-9850-d1cbfd659b3d\") " pod="openshift-cluster-node-tuning-operator/tuned-zrxmj" May 21 10:30:09.599358 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.599360 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a41a87f2-f6ab-4cb1-9b97-906ce5eece4d-system-cni-dir\") pod \"multus-g4lt2\" (UID: \"a41a87f2-f6ab-4cb1-9b97-906ce5eece4d\") " pod="openshift-multus/multus-g4lt2" May 21 10:30:09.599781 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.599379 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a41a87f2-f6ab-4cb1-9b97-906ce5eece4d-cnibin\") pod \"multus-g4lt2\" (UID: \"a41a87f2-f6ab-4cb1-9b97-906ce5eece4d\") " pod="openshift-multus/multus-g4lt2" May 21 10:30:09.599781 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.599384 2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 21 10:30:09.599781 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.599400 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a41a87f2-f6ab-4cb1-9b97-906ce5eece4d-os-release\") pod \"multus-g4lt2\" (UID: \"a41a87f2-f6ab-4cb1-9b97-906ce5eece4d\") " pod="openshift-multus/multus-g4lt2" May 21 10:30:09.599781 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.599422 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a41a87f2-f6ab-4cb1-9b97-906ce5eece4d-hostroot\") pod \"multus-g4lt2\" (UID: \"a41a87f2-f6ab-4cb1-9b97-906ce5eece4d\") " pod="openshift-multus/multus-g4lt2" May 21 10:30:09.599781 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.599462 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/762ee6cc-7e36-4827-9350-d26f6580b8db-cni-binary-copy\") pod \"multus-additional-cni-plugins-mk4n7\" (UID: \"762ee6cc-7e36-4827-9350-d26f6580b8db\") " pod="openshift-multus/multus-additional-cni-plugins-mk4n7" May 21 10:30:09.599781 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.599499 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9d668cb7-db54-4720-9850-d1cbfd659b3d-etc-modprobe-d\") pod \"tuned-zrxmj\" (UID: \"9d668cb7-db54-4720-9850-d1cbfd659b3d\") " pod="openshift-cluster-node-tuning-operator/tuned-zrxmj" May 21 10:30:09.599781 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.599536 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9d668cb7-db54-4720-9850-d1cbfd659b3d-etc-sysconfig\") pod \"tuned-zrxmj\" (UID: \"9d668cb7-db54-4720-9850-d1cbfd659b3d\") " pod="openshift-cluster-node-tuning-operator/tuned-zrxmj" May 21 10:30:09.599781 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.599563 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/24a7e4d2-b048-41e9-8bc4-9993aed09fd4-run-ovn\") pod \"ovnkube-node-fhjht\" (UID: \"24a7e4d2-b048-41e9-8bc4-9993aed09fd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" May 21 10:30:09.599781 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.599584 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/24a7e4d2-b048-41e9-8bc4-9993aed09fd4-node-log\") pod \"ovnkube-node-fhjht\" (UID: \"24a7e4d2-b048-41e9-8bc4-9993aed09fd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" May 21 10:30:09.599781 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.599610 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/24a7e4d2-b048-41e9-8bc4-9993aed09fd4-host-cni-netd\") pod \"ovnkube-node-fhjht\" (UID: \"24a7e4d2-b048-41e9-8bc4-9993aed09fd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" May 21 10:30:09.599781 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.599618 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9d668cb7-db54-4720-9850-d1cbfd659b3d-etc-modprobe-d\") pod \"tuned-zrxmj\" (UID: \"9d668cb7-db54-4720-9850-d1cbfd659b3d\") " pod="openshift-cluster-node-tuning-operator/tuned-zrxmj" May 21 10:30:09.599781 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.599633 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8d7bae5e-e157-4bde-8a8c-e82e63427b92-host\") pod \"node-ca-xgzdb\" (UID: \"8d7bae5e-e157-4bde-8a8c-e82e63427b92\") " pod="openshift-image-registry/node-ca-xgzdb" May 21 10:30:09.599781 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.599654 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9d668cb7-db54-4720-9850-d1cbfd659b3d-etc-sysconfig\") pod \"tuned-zrxmj\" (UID: \"9d668cb7-db54-4720-9850-d1cbfd659b3d\") " pod="openshift-cluster-node-tuning-operator/tuned-zrxmj" May 21 10:30:09.599781 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.599664 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f4bb88d2-7c86-4029-a362-fa3f5c3650cb-device-dir\") pod \"aws-ebs-csi-driver-node-dtl4g\" (UID: \"f4bb88d2-7c86-4029-a362-fa3f5c3650cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtl4g" May 21 10:30:09.599781 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.599699 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9d668cb7-db54-4720-9850-d1cbfd659b3d-tmp\") pod \"tuned-zrxmj\" (UID: \"9d668cb7-db54-4720-9850-d1cbfd659b3d\") " pod="openshift-cluster-node-tuning-operator/tuned-zrxmj" May 21 10:30:09.599781 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.599742 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a41a87f2-f6ab-4cb1-9b97-906ce5eece4d-multus-daemon-config\") pod \"multus-g4lt2\" (UID: \"a41a87f2-f6ab-4cb1-9b97-906ce5eece4d\") " pod="openshift-multus/multus-g4lt2" May 21 10:30:09.599781 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.599747 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/762ee6cc-7e36-4827-9350-d26f6580b8db-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mk4n7\" (UID: \"762ee6cc-7e36-4827-9350-d26f6580b8db\") " pod="openshift-multus/multus-additional-cni-plugins-mk4n7" May 21 10:30:09.599781 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.599751 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f4bb88d2-7c86-4029-a362-fa3f5c3650cb-device-dir\") pod \"aws-ebs-csi-driver-node-dtl4g\" (UID: \"f4bb88d2-7c86-4029-a362-fa3f5c3650cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtl4g" May 21 10:30:09.600710 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.599809 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1c7a9fbd-e4f0-4c8f-b533-fc8a4a1911f0-iptables-alerter-script\") pod \"iptables-alerter-5r5hl\" (UID: \"1c7a9fbd-e4f0-4c8f-b533-fc8a4a1911f0\") " pod="openshift-network-operator/iptables-alerter-5r5hl" May 21 10:30:09.600710 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.599844 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/762ee6cc-7e36-4827-9350-d26f6580b8db-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mk4n7\" (UID: \"762ee6cc-7e36-4827-9350-d26f6580b8db\") " pod="openshift-multus/multus-additional-cni-plugins-mk4n7" May 21 10:30:09.600710 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.599885 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jvx45\" (UniqueName: \"kubernetes.io/projected/762ee6cc-7e36-4827-9350-d26f6580b8db-kube-api-access-jvx45\") pod \"multus-additional-cni-plugins-mk4n7\" (UID: \"762ee6cc-7e36-4827-9350-d26f6580b8db\") " pod="openshift-multus/multus-additional-cni-plugins-mk4n7" May 21 10:30:09.600710 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.599914 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srcg8\" (UniqueName: \"kubernetes.io/projected/8d7bae5e-e157-4bde-8a8c-e82e63427b92-kube-api-access-srcg8\") pod \"node-ca-xgzdb\" (UID: \"8d7bae5e-e157-4bde-8a8c-e82e63427b92\") " pod="openshift-image-registry/node-ca-xgzdb" May 21 10:30:09.600710 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.600019 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/762ee6cc-7e36-4827-9350-d26f6580b8db-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mk4n7\" (UID: \"762ee6cc-7e36-4827-9350-d26f6580b8db\") " pod="openshift-multus/multus-additional-cni-plugins-mk4n7" May 21 10:30:09.600710 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.600054 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f4bb88d2-7c86-4029-a362-fa3f5c3650cb-sys-fs\") pod \"aws-ebs-csi-driver-node-dtl4g\" (UID: \"f4bb88d2-7c86-4029-a362-fa3f5c3650cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtl4g" May 21 10:30:09.600710 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.600084 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c9e91e4e-88b6-4364-8536-e995ba46046c-konnectivity-ca\") pod \"konnectivity-agent-n9txr\" (UID: \"c9e91e4e-88b6-4364-8536-e995ba46046c\") " pod="kube-system/konnectivity-agent-n9txr" May 21 10:30:09.600710 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.600118 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/24a7e4d2-b048-41e9-8bc4-9993aed09fd4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fhjht\" (UID: \"24a7e4d2-b048-41e9-8bc4-9993aed09fd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" May 21 10:30:09.600710 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.600140 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/24a7e4d2-b048-41e9-8bc4-9993aed09fd4-env-overrides\") pod \"ovnkube-node-fhjht\" (UID: \"24a7e4d2-b048-41e9-8bc4-9993aed09fd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" May 21 10:30:09.600710 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.600186 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f4bb88d2-7c86-4029-a362-fa3f5c3650cb-sys-fs\") pod \"aws-ebs-csi-driver-node-dtl4g\" (UID: \"f4bb88d2-7c86-4029-a362-fa3f5c3650cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtl4g" May 21 10:30:09.600710 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.600201 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktwpw\" (UniqueName: \"kubernetes.io/projected/24a7e4d2-b048-41e9-8bc4-9993aed09fd4-kube-api-access-ktwpw\") pod \"ovnkube-node-fhjht\" (UID: \"24a7e4d2-b048-41e9-8bc4-9993aed09fd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" May 21 10:30:09.600710 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.600245 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4b5xg\" (UniqueName: \"kubernetes.io/projected/1c7a9fbd-e4f0-4c8f-b533-fc8a4a1911f0-kube-api-access-4b5xg\") pod \"iptables-alerter-5r5hl\" (UID: \"1c7a9fbd-e4f0-4c8f-b533-fc8a4a1911f0\") " pod="openshift-network-operator/iptables-alerter-5r5hl" May 21 10:30:09.600710 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.600293 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f4bb88d2-7c86-4029-a362-fa3f5c3650cb-registration-dir\") pod \"aws-ebs-csi-driver-node-dtl4g\" (UID: \"f4bb88d2-7c86-4029-a362-fa3f5c3650cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtl4g" May 21 10:30:09.600710 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.600321 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9d668cb7-db54-4720-9850-d1cbfd659b3d-etc-sysctl-d\") pod \"tuned-zrxmj\" (UID: \"9d668cb7-db54-4720-9850-d1cbfd659b3d\") " pod="openshift-cluster-node-tuning-operator/tuned-zrxmj" May 21 10:30:09.600710 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.600342 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9d668cb7-db54-4720-9850-d1cbfd659b3d-etc-sysctl-conf\") pod \"tuned-zrxmj\" (UID: \"9d668cb7-db54-4720-9850-d1cbfd659b3d\") " pod="openshift-cluster-node-tuning-operator/tuned-zrxmj" May 21 10:30:09.600710 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.600377 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9d668cb7-db54-4720-9850-d1cbfd659b3d-etc-systemd\") pod \"tuned-zrxmj\" (UID: \"9d668cb7-db54-4720-9850-d1cbfd659b3d\") " pod="openshift-cluster-node-tuning-operator/tuned-zrxmj" May 21 10:30:09.601427 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.600391 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f4bb88d2-7c86-4029-a362-fa3f5c3650cb-registration-dir\") pod \"aws-ebs-csi-driver-node-dtl4g\" (UID: \"f4bb88d2-7c86-4029-a362-fa3f5c3650cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtl4g" May 21 10:30:09.601427 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.600400 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9d668cb7-db54-4720-9850-d1cbfd659b3d-lib-modules\") pod \"tuned-zrxmj\" (UID: \"9d668cb7-db54-4720-9850-d1cbfd659b3d\") " pod="openshift-cluster-node-tuning-operator/tuned-zrxmj" May 21 10:30:09.601427 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.600436 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/24a7e4d2-b048-41e9-8bc4-9993aed09fd4-log-socket\") pod \"ovnkube-node-fhjht\" (UID: \"24a7e4d2-b048-41e9-8bc4-9993aed09fd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" May 21 10:30:09.601427 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.600447 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9d668cb7-db54-4720-9850-d1cbfd659b3d-etc-sysctl-d\") pod \"tuned-zrxmj\" (UID: \"9d668cb7-db54-4720-9850-d1cbfd659b3d\") " pod="openshift-cluster-node-tuning-operator/tuned-zrxmj" May 21 10:30:09.601427 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.600465 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/24a7e4d2-b048-41e9-8bc4-9993aed09fd4-host-cni-bin\") pod \"ovnkube-node-fhjht\" (UID: \"24a7e4d2-b048-41e9-8bc4-9993aed09fd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" May 21 10:30:09.601427 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.600484 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9d668cb7-db54-4720-9850-d1cbfd659b3d-lib-modules\") pod \"tuned-zrxmj\" (UID: \"9d668cb7-db54-4720-9850-d1cbfd659b3d\") " pod="openshift-cluster-node-tuning-operator/tuned-zrxmj" May 21 10:30:09.601427 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.600493 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/762ee6cc-7e36-4827-9350-d26f6580b8db-os-release\") pod \"multus-additional-cni-plugins-mk4n7\" (UID: \"762ee6cc-7e36-4827-9350-d26f6580b8db\") " pod="openshift-multus/multus-additional-cni-plugins-mk4n7" May 21 10:30:09.601427 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.600502 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9d668cb7-db54-4720-9850-d1cbfd659b3d-etc-sysctl-conf\") pod \"tuned-zrxmj\" (UID: \"9d668cb7-db54-4720-9850-d1cbfd659b3d\") " pod="openshift-cluster-node-tuning-operator/tuned-zrxmj" May 21 10:30:09.601427 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.600502 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9d668cb7-db54-4720-9850-d1cbfd659b3d-etc-systemd\") pod \"tuned-zrxmj\" (UID: \"9d668cb7-db54-4720-9850-d1cbfd659b3d\") " pod="openshift-cluster-node-tuning-operator/tuned-zrxmj" May 21 10:30:09.601427 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.600516 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a41a87f2-f6ab-4cb1-9b97-906ce5eece4d-multus-cni-dir\") pod \"multus-g4lt2\" (UID: \"a41a87f2-f6ab-4cb1-9b97-906ce5eece4d\") " pod="openshift-multus/multus-g4lt2" May 21 10:30:09.601427 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.600560 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/762ee6cc-7e36-4827-9350-d26f6580b8db-os-release\") pod \"multus-additional-cni-plugins-mk4n7\" (UID: \"762ee6cc-7e36-4827-9350-d26f6580b8db\") " pod="openshift-multus/multus-additional-cni-plugins-mk4n7" May 21 10:30:09.601427 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.600592 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a41a87f2-f6ab-4cb1-9b97-906ce5eece4d-host-run-k8s-cni-cncf-io\") pod \"multus-g4lt2\" (UID: \"a41a87f2-f6ab-4cb1-9b97-906ce5eece4d\") " pod="openshift-multus/multus-g4lt2" May 21 10:30:09.601427 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.600620 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a41a87f2-f6ab-4cb1-9b97-906ce5eece4d-host-run-multus-certs\") pod \"multus-g4lt2\" (UID: \"a41a87f2-f6ab-4cb1-9b97-906ce5eece4d\") " pod="openshift-multus/multus-g4lt2" May 21 10:30:09.601427 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.600645 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a41a87f2-f6ab-4cb1-9b97-906ce5eece4d-etc-kubernetes\") pod \"multus-g4lt2\" (UID: \"a41a87f2-f6ab-4cb1-9b97-906ce5eece4d\") " pod="openshift-multus/multus-g4lt2" May 21 10:30:09.601427 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.600675 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/762ee6cc-7e36-4827-9350-d26f6580b8db-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mk4n7\" (UID: \"762ee6cc-7e36-4827-9350-d26f6580b8db\") " pod="openshift-multus/multus-additional-cni-plugins-mk4n7" May 21 10:30:09.601427 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.600701 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/24a7e4d2-b048-41e9-8bc4-9993aed09fd4-run-systemd\") pod \"ovnkube-node-fhjht\" (UID: \"24a7e4d2-b048-41e9-8bc4-9993aed09fd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" May 21 10:30:09.601427 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.600727 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/24a7e4d2-b048-41e9-8bc4-9993aed09fd4-host-run-ovn-kubernetes\") pod \"ovnkube-node-fhjht\" (UID: \"24a7e4d2-b048-41e9-8bc4-9993aed09fd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" May 21 10:30:09.602214 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.600752 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f4a6b193-47ea-4a0e-b63a-3dd25c6aab85-hosts-file\") pod \"node-resolver-ml6nr\" (UID: \"f4a6b193-47ea-4a0e-b63a-3dd25c6aab85\") " pod="openshift-dns/node-resolver-ml6nr" May 21 10:30:09.602214 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.600772 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tmrn\" (UniqueName: \"kubernetes.io/projected/a41a87f2-f6ab-4cb1-9b97-906ce5eece4d-kube-api-access-9tmrn\") pod \"multus-g4lt2\" (UID: \"a41a87f2-f6ab-4cb1-9b97-906ce5eece4d\") " pod="openshift-multus/multus-g4lt2" May 21 10:30:09.602214 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.600813 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f4bb88d2-7c86-4029-a362-fa3f5c3650cb-etc-selinux\") pod \"aws-ebs-csi-driver-node-dtl4g\" (UID: \"f4bb88d2-7c86-4029-a362-fa3f5c3650cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtl4g" May 21 10:30:09.602214 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.600843 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c9e91e4e-88b6-4364-8536-e995ba46046c-agent-certs\") pod \"konnectivity-agent-n9txr\" (UID: \"c9e91e4e-88b6-4364-8536-e995ba46046c\") " pod="kube-system/konnectivity-agent-n9txr" May 21 10:30:09.602214 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.600866 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8d7bae5e-e157-4bde-8a8c-e82e63427b92-serviceca\") pod \"node-ca-xgzdb\" (UID: \"8d7bae5e-e157-4bde-8a8c-e82e63427b92\") " pod="openshift-image-registry/node-ca-xgzdb" May 21 10:30:09.602214 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.600876 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f4bb88d2-7c86-4029-a362-fa3f5c3650cb-etc-selinux\") pod \"aws-ebs-csi-driver-node-dtl4g\" (UID: \"f4bb88d2-7c86-4029-a362-fa3f5c3650cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtl4g" May 21 10:30:09.602214 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.600912 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h94nq\" (UniqueName: \"kubernetes.io/projected/f4bb88d2-7c86-4029-a362-fa3f5c3650cb-kube-api-access-h94nq\") pod \"aws-ebs-csi-driver-node-dtl4g\" (UID: \"f4bb88d2-7c86-4029-a362-fa3f5c3650cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtl4g" May 21 10:30:09.602214 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.600972 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/24a7e4d2-b048-41e9-8bc4-9993aed09fd4-host-slash\") pod \"ovnkube-node-fhjht\" (UID: \"24a7e4d2-b048-41e9-8bc4-9993aed09fd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" May 21 10:30:09.602214 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.600999 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/24a7e4d2-b048-41e9-8bc4-9993aed09fd4-host-run-netns\") pod \"ovnkube-node-fhjht\" (UID: \"24a7e4d2-b048-41e9-8bc4-9993aed09fd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" May 21 10:30:09.602214 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.601014 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/24a7e4d2-b048-41e9-8bc4-9993aed09fd4-ovn-node-metrics-cert\") pod \"ovnkube-node-fhjht\" (UID: \"24a7e4d2-b048-41e9-8bc4-9993aed09fd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" May 21 10:30:09.602214 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.601042 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4a6b193-47ea-4a0e-b63a-3dd25c6aab85-tmp-dir\") pod \"node-resolver-ml6nr\" (UID: \"f4a6b193-47ea-4a0e-b63a-3dd25c6aab85\") " pod="openshift-dns/node-resolver-ml6nr" May 21 10:30:09.602214 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.601058 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35d22f25-59d6-48b0-a885-ddbcfcdf5cb0-metrics-certs\") pod \"network-metrics-daemon-flzlz\" (UID: \"35d22f25-59d6-48b0-a885-ddbcfcdf5cb0\") " pod="openshift-multus/network-metrics-daemon-flzlz" May 21 10:30:09.602214 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.601074 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a41a87f2-f6ab-4cb1-9b97-906ce5eece4d-multus-socket-dir-parent\") pod \"multus-g4lt2\" (UID: \"a41a87f2-f6ab-4cb1-9b97-906ce5eece4d\") " pod="openshift-multus/multus-g4lt2" May 21 10:30:09.602214 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.601088 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a41a87f2-f6ab-4cb1-9b97-906ce5eece4d-host-var-lib-cni-bin\") pod \"multus-g4lt2\" (UID: \"a41a87f2-f6ab-4cb1-9b97-906ce5eece4d\") " pod="openshift-multus/multus-g4lt2" May 21 10:30:09.602214 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.601114 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/762ee6cc-7e36-4827-9350-d26f6580b8db-system-cni-dir\") pod \"multus-additional-cni-plugins-mk4n7\" (UID: \"762ee6cc-7e36-4827-9350-d26f6580b8db\") " pod="openshift-multus/multus-additional-cni-plugins-mk4n7" May 21 10:30:09.602214 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.601141 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f4bb88d2-7c86-4029-a362-fa3f5c3650cb-socket-dir\") pod \"aws-ebs-csi-driver-node-dtl4g\" (UID: \"f4bb88d2-7c86-4029-a362-fa3f5c3650cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtl4g" May 21 10:30:09.602214 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.601186 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9d668cb7-db54-4720-9850-d1cbfd659b3d-var-lib-kubelet\") pod \"tuned-zrxmj\" (UID: \"9d668cb7-db54-4720-9850-d1cbfd659b3d\") " pod="openshift-cluster-node-tuning-operator/tuned-zrxmj" May 21 10:30:09.602951 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.601194 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/762ee6cc-7e36-4827-9350-d26f6580b8db-system-cni-dir\") pod \"multus-additional-cni-plugins-mk4n7\" (UID: \"762ee6cc-7e36-4827-9350-d26f6580b8db\") " pod="openshift-multus/multus-additional-cni-plugins-mk4n7" May 21 10:30:09.602951 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.601208 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9d668cb7-db54-4720-9850-d1cbfd659b3d-host\") pod \"tuned-zrxmj\" (UID: \"9d668cb7-db54-4720-9850-d1cbfd659b3d\") " pod="openshift-cluster-node-tuning-operator/tuned-zrxmj" May 21 10:30:09.602951 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.601215 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/762ee6cc-7e36-4827-9350-d26f6580b8db-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mk4n7\" (UID: \"762ee6cc-7e36-4827-9350-d26f6580b8db\") " pod="openshift-multus/multus-additional-cni-plugins-mk4n7" May 21 10:30:09.602951 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.601232 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/24a7e4d2-b048-41e9-8bc4-9993aed09fd4-var-lib-openvswitch\") pod \"ovnkube-node-fhjht\" (UID: \"24a7e4d2-b048-41e9-8bc4-9993aed09fd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" May 21 10:30:09.602951 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.601263 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/24a7e4d2-b048-41e9-8bc4-9993aed09fd4-ovnkube-config\") pod \"ovnkube-node-fhjht\" (UID: \"24a7e4d2-b048-41e9-8bc4-9993aed09fd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" May 21 10:30:09.602951 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.601295 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9d668cb7-db54-4720-9850-d1cbfd659b3d-host\") pod \"tuned-zrxmj\" (UID: \"9d668cb7-db54-4720-9850-d1cbfd659b3d\") " pod="openshift-cluster-node-tuning-operator/tuned-zrxmj" May 21 10:30:09.602951 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.601302 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f4bb88d2-7c86-4029-a362-fa3f5c3650cb-socket-dir\") pod \"aws-ebs-csi-driver-node-dtl4g\" (UID: \"f4bb88d2-7c86-4029-a362-fa3f5c3650cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtl4g" May 21 10:30:09.602951 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.601334 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ftcf\" (UniqueName: \"kubernetes.io/projected/35d22f25-59d6-48b0-a885-ddbcfcdf5cb0-kube-api-access-5ftcf\") pod \"network-metrics-daemon-flzlz\" (UID: \"35d22f25-59d6-48b0-a885-ddbcfcdf5cb0\") " pod="openshift-multus/network-metrics-daemon-flzlz" May 21 10:30:09.602951 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.601356 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9d668cb7-db54-4720-9850-d1cbfd659b3d-var-lib-kubelet\") pod \"tuned-zrxmj\" (UID: \"9d668cb7-db54-4720-9850-d1cbfd659b3d\") " pod="openshift-cluster-node-tuning-operator/tuned-zrxmj" May 21 10:30:09.602951 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.601396 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a41a87f2-f6ab-4cb1-9b97-906ce5eece4d-host-var-lib-cni-multus\") pod \"multus-g4lt2\" (UID: \"a41a87f2-f6ab-4cb1-9b97-906ce5eece4d\") " pod="openshift-multus/multus-g4lt2" May 21 10:30:09.602951 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.601424 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/762ee6cc-7e36-4827-9350-d26f6580b8db-cnibin\") pod \"multus-additional-cni-plugins-mk4n7\" (UID: \"762ee6cc-7e36-4827-9350-d26f6580b8db\") " pod="openshift-multus/multus-additional-cni-plugins-mk4n7" May 21 10:30:09.602951 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.601463 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9d668cb7-db54-4720-9850-d1cbfd659b3d-run\") pod \"tuned-zrxmj\" (UID: \"9d668cb7-db54-4720-9850-d1cbfd659b3d\") " pod="openshift-cluster-node-tuning-operator/tuned-zrxmj" May 21 10:30:09.602951 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.601491 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vd7xq\" (UniqueName: \"kubernetes.io/projected/03cc5e6e-7e76-47ec-80e8-795d0a71d2f8-kube-api-access-vd7xq\") pod \"network-check-target-pqqfc\" (UID: \"03cc5e6e-7e76-47ec-80e8-795d0a71d2f8\") " pod="openshift-network-diagnostics/network-check-target-pqqfc" May 21 10:30:09.602951 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.601517 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/24a7e4d2-b048-41e9-8bc4-9993aed09fd4-etc-openvswitch\") pod \"ovnkube-node-fhjht\" (UID: \"24a7e4d2-b048-41e9-8bc4-9993aed09fd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" May 21 10:30:09.602951 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.601523 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/762ee6cc-7e36-4827-9350-d26f6580b8db-cnibin\") pod \"multus-additional-cni-plugins-mk4n7\" (UID: \"762ee6cc-7e36-4827-9350-d26f6580b8db\") " pod="openshift-multus/multus-additional-cni-plugins-mk4n7" May 21 10:30:09.602951 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.601571 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9d668cb7-db54-4720-9850-d1cbfd659b3d-run\") pod \"tuned-zrxmj\" (UID: \"9d668cb7-db54-4720-9850-d1cbfd659b3d\") " pod="openshift-cluster-node-tuning-operator/tuned-zrxmj" May 21 10:30:09.603562 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.602961 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9d668cb7-db54-4720-9850-d1cbfd659b3d-tmp\") pod \"tuned-zrxmj\" (UID: \"9d668cb7-db54-4720-9850-d1cbfd659b3d\") " pod="openshift-cluster-node-tuning-operator/tuned-zrxmj" May 21 10:30:09.603562 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.603043 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9d668cb7-db54-4720-9850-d1cbfd659b3d-etc-tuned\") pod \"tuned-zrxmj\" (UID: \"9d668cb7-db54-4720-9850-d1cbfd659b3d\") " pod="openshift-cluster-node-tuning-operator/tuned-zrxmj" May 21 10:30:09.609491 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.609471 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgmbc\" (UniqueName: \"kubernetes.io/projected/9d668cb7-db54-4720-9850-d1cbfd659b3d-kube-api-access-sgmbc\") pod \"tuned-zrxmj\" (UID: \"9d668cb7-db54-4720-9850-d1cbfd659b3d\") " pod="openshift-cluster-node-tuning-operator/tuned-zrxmj" May 21 10:30:09.609783 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.609762 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvx45\" (UniqueName: \"kubernetes.io/projected/762ee6cc-7e36-4827-9350-d26f6580b8db-kube-api-access-jvx45\") pod \"multus-additional-cni-plugins-mk4n7\" (UID: \"762ee6cc-7e36-4827-9350-d26f6580b8db\") " pod="openshift-multus/multus-additional-cni-plugins-mk4n7" May 21 10:30:09.609857 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.609765 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h94nq\" (UniqueName: \"kubernetes.io/projected/f4bb88d2-7c86-4029-a362-fa3f5c3650cb-kube-api-access-h94nq\") pod \"aws-ebs-csi-driver-node-dtl4g\" (UID: \"f4bb88d2-7c86-4029-a362-fa3f5c3650cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtl4g" May 21 10:30:09.636286 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.636243 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-214.ec2.internal" event={"ID":"311b254f6fec6ca06a2a63845d2409b9","Type":"ContainerStarted","Data":"3dd67614fb734f40a8a02790fc01aeff9f0c1e68b0a3ca86acc9d6bb59baa7b7"} May 21 10:30:09.637270 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.637249 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-214.ec2.internal" event={"ID":"84135066f8c765a27568c2cb628cbfb6","Type":"ContainerStarted","Data":"e9b8e7cd90d11ebd1d23b0a002024d6f752fcf22f37317a3b7db144398e87bcf"} May 21 10:30:09.702013 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.701989 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/24a7e4d2-b048-41e9-8bc4-9993aed09fd4-host-slash\") pod \"ovnkube-node-fhjht\" (UID: \"24a7e4d2-b048-41e9-8bc4-9993aed09fd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" May 21 10:30:09.702112 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.702020 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/24a7e4d2-b048-41e9-8bc4-9993aed09fd4-host-run-netns\") pod \"ovnkube-node-fhjht\" (UID: \"24a7e4d2-b048-41e9-8bc4-9993aed09fd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" May 21 10:30:09.702112 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.702045 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/24a7e4d2-b048-41e9-8bc4-9993aed09fd4-ovn-node-metrics-cert\") pod \"ovnkube-node-fhjht\" (UID: \"24a7e4d2-b048-41e9-8bc4-9993aed09fd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" May 21 10:30:09.702112 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.702069 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4a6b193-47ea-4a0e-b63a-3dd25c6aab85-tmp-dir\") pod \"node-resolver-ml6nr\" (UID: \"f4a6b193-47ea-4a0e-b63a-3dd25c6aab85\") " pod="openshift-dns/node-resolver-ml6nr" May 21 10:30:09.702112 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.702079 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/24a7e4d2-b048-41e9-8bc4-9993aed09fd4-host-slash\") pod \"ovnkube-node-fhjht\" (UID: \"24a7e4d2-b048-41e9-8bc4-9993aed09fd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" May 21 10:30:09.702306 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.702113 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/24a7e4d2-b048-41e9-8bc4-9993aed09fd4-host-run-netns\") pod \"ovnkube-node-fhjht\" (UID: \"24a7e4d2-b048-41e9-8bc4-9993aed09fd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" May 21 10:30:09.702306 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.702122 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35d22f25-59d6-48b0-a885-ddbcfcdf5cb0-metrics-certs\") pod \"network-metrics-daemon-flzlz\" (UID: \"35d22f25-59d6-48b0-a885-ddbcfcdf5cb0\") " pod="openshift-multus/network-metrics-daemon-flzlz" May 21 10:30:09.702306 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.702180 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a41a87f2-f6ab-4cb1-9b97-906ce5eece4d-multus-socket-dir-parent\") pod \"multus-g4lt2\" (UID: \"a41a87f2-f6ab-4cb1-9b97-906ce5eece4d\") " pod="openshift-multus/multus-g4lt2" May 21 10:30:09.702306 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:09.702198 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 10:30:09.702306 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.702206 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a41a87f2-f6ab-4cb1-9b97-906ce5eece4d-host-var-lib-cni-bin\") pod \"multus-g4lt2\" (UID: \"a41a87f2-f6ab-4cb1-9b97-906ce5eece4d\") " pod="openshift-multus/multus-g4lt2" May 21 10:30:09.702306 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.702236 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/24a7e4d2-b048-41e9-8bc4-9993aed09fd4-var-lib-openvswitch\") pod \"ovnkube-node-fhjht\" (UID: \"24a7e4d2-b048-41e9-8bc4-9993aed09fd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" May 21 10:30:09.702306 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:09.702269 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35d22f25-59d6-48b0-a885-ddbcfcdf5cb0-metrics-certs podName:35d22f25-59d6-48b0-a885-ddbcfcdf5cb0 nodeName:}" failed. No retries permitted until 2026-05-21 10:30:10.202235572 +0000 UTC m=+3.115614620 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/35d22f25-59d6-48b0-a885-ddbcfcdf5cb0-metrics-certs") pod "network-metrics-daemon-flzlz" (UID: "35d22f25-59d6-48b0-a885-ddbcfcdf5cb0") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 10:30:09.702306 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.702286 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a41a87f2-f6ab-4cb1-9b97-906ce5eece4d-multus-socket-dir-parent\") pod \"multus-g4lt2\" (UID: \"a41a87f2-f6ab-4cb1-9b97-906ce5eece4d\") " pod="openshift-multus/multus-g4lt2" May 21 10:30:09.702306 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.702299 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4a6b193-47ea-4a0e-b63a-3dd25c6aab85-tmp-dir\") pod \"node-resolver-ml6nr\" (UID: \"f4a6b193-47ea-4a0e-b63a-3dd25c6aab85\") " pod="openshift-dns/node-resolver-ml6nr" May 21 10:30:09.702306 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.702303 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a41a87f2-f6ab-4cb1-9b97-906ce5eece4d-host-var-lib-cni-bin\") pod \"multus-g4lt2\" (UID: \"a41a87f2-f6ab-4cb1-9b97-906ce5eece4d\") " pod="openshift-multus/multus-g4lt2" May 21 10:30:09.702776 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.702299 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/24a7e4d2-b048-41e9-8bc4-9993aed09fd4-ovnkube-config\") pod \"ovnkube-node-fhjht\" (UID: \"24a7e4d2-b048-41e9-8bc4-9993aed09fd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" May 21 10:30:09.702776 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.702330 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/24a7e4d2-b048-41e9-8bc4-9993aed09fd4-var-lib-openvswitch\") pod \"ovnkube-node-fhjht\" (UID: \"24a7e4d2-b048-41e9-8bc4-9993aed09fd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" May 21 10:30:09.702776 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.702348 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5ftcf\" (UniqueName: \"kubernetes.io/projected/35d22f25-59d6-48b0-a885-ddbcfcdf5cb0-kube-api-access-5ftcf\") pod \"network-metrics-daemon-flzlz\" (UID: \"35d22f25-59d6-48b0-a885-ddbcfcdf5cb0\") " pod="openshift-multus/network-metrics-daemon-flzlz" May 21 10:30:09.702776 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.702374 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a41a87f2-f6ab-4cb1-9b97-906ce5eece4d-host-var-lib-cni-multus\") pod \"multus-g4lt2\" (UID: \"a41a87f2-f6ab-4cb1-9b97-906ce5eece4d\") " pod="openshift-multus/multus-g4lt2" May 21 10:30:09.702776 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.702401 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vd7xq\" (UniqueName: \"kubernetes.io/projected/03cc5e6e-7e76-47ec-80e8-795d0a71d2f8-kube-api-access-vd7xq\") pod \"network-check-target-pqqfc\" (UID: \"03cc5e6e-7e76-47ec-80e8-795d0a71d2f8\") " pod="openshift-network-diagnostics/network-check-target-pqqfc" May 21 10:30:09.702776 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.702425 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/24a7e4d2-b048-41e9-8bc4-9993aed09fd4-etc-openvswitch\") pod \"ovnkube-node-fhjht\" (UID: \"24a7e4d2-b048-41e9-8bc4-9993aed09fd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" May 21 10:30:09.702776 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.702427 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a41a87f2-f6ab-4cb1-9b97-906ce5eece4d-host-var-lib-cni-multus\") pod \"multus-g4lt2\" (UID: \"a41a87f2-f6ab-4cb1-9b97-906ce5eece4d\") " pod="openshift-multus/multus-g4lt2" May 21 10:30:09.702776 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.702448 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/24a7e4d2-b048-41e9-8bc4-9993aed09fd4-ovnkube-script-lib\") pod \"ovnkube-node-fhjht\" (UID: \"24a7e4d2-b048-41e9-8bc4-9993aed09fd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" May 21 10:30:09.702776 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.702482 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a41a87f2-f6ab-4cb1-9b97-906ce5eece4d-multus-conf-dir\") pod \"multus-g4lt2\" (UID: \"a41a87f2-f6ab-4cb1-9b97-906ce5eece4d\") " pod="openshift-multus/multus-g4lt2" May 21 10:30:09.702776 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.702509 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1c7a9fbd-e4f0-4c8f-b533-fc8a4a1911f0-host-slash\") pod \"iptables-alerter-5r5hl\" (UID: \"1c7a9fbd-e4f0-4c8f-b533-fc8a4a1911f0\") " pod="openshift-network-operator/iptables-alerter-5r5hl" May 21 10:30:09.702776 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.702564 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/24a7e4d2-b048-41e9-8bc4-9993aed09fd4-etc-openvswitch\") pod \"ovnkube-node-fhjht\" (UID: \"24a7e4d2-b048-41e9-8bc4-9993aed09fd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" May 21 10:30:09.702776 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.702577 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a41a87f2-f6ab-4cb1-9b97-906ce5eece4d-multus-conf-dir\") pod \"multus-g4lt2\" (UID: \"a41a87f2-f6ab-4cb1-9b97-906ce5eece4d\") " pod="openshift-multus/multus-g4lt2" May 21 10:30:09.702776 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.702629 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1c7a9fbd-e4f0-4c8f-b533-fc8a4a1911f0-host-slash\") pod \"iptables-alerter-5r5hl\" (UID: \"1c7a9fbd-e4f0-4c8f-b533-fc8a4a1911f0\") " pod="openshift-network-operator/iptables-alerter-5r5hl" May 21 10:30:09.702776 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.702675 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a41a87f2-f6ab-4cb1-9b97-906ce5eece4d-cni-binary-copy\") pod \"multus-g4lt2\" (UID: \"a41a87f2-f6ab-4cb1-9b97-906ce5eece4d\") " pod="openshift-multus/multus-g4lt2" May 21 10:30:09.702776 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.702735 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/24a7e4d2-b048-41e9-8bc4-9993aed09fd4-host-kubelet\") pod \"ovnkube-node-fhjht\" (UID: \"24a7e4d2-b048-41e9-8bc4-9993aed09fd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" May 21 10:30:09.702776 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.702762 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/24a7e4d2-b048-41e9-8bc4-9993aed09fd4-run-openvswitch\") pod \"ovnkube-node-fhjht\" (UID: \"24a7e4d2-b048-41e9-8bc4-9993aed09fd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" May 21 10:30:09.703438 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.702790 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/24a7e4d2-b048-41e9-8bc4-9993aed09fd4-systemd-units\") pod \"ovnkube-node-fhjht\" (UID: \"24a7e4d2-b048-41e9-8bc4-9993aed09fd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" May 21 10:30:09.703438 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.702805 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/24a7e4d2-b048-41e9-8bc4-9993aed09fd4-ovnkube-config\") pod \"ovnkube-node-fhjht\" (UID: \"24a7e4d2-b048-41e9-8bc4-9993aed09fd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" May 21 10:30:09.703438 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.702837 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/24a7e4d2-b048-41e9-8bc4-9993aed09fd4-systemd-units\") pod \"ovnkube-node-fhjht\" (UID: \"24a7e4d2-b048-41e9-8bc4-9993aed09fd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" May 21 10:30:09.703438 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.702837 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/24a7e4d2-b048-41e9-8bc4-9993aed09fd4-host-kubelet\") pod \"ovnkube-node-fhjht\" (UID: \"24a7e4d2-b048-41e9-8bc4-9993aed09fd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" May 21 10:30:09.703438 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.702861 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/24a7e4d2-b048-41e9-8bc4-9993aed09fd4-run-openvswitch\") pod \"ovnkube-node-fhjht\" (UID: \"24a7e4d2-b048-41e9-8bc4-9993aed09fd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" May 21 10:30:09.703438 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.702865 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5z5pr\" (UniqueName: \"kubernetes.io/projected/f4a6b193-47ea-4a0e-b63a-3dd25c6aab85-kube-api-access-5z5pr\") pod \"node-resolver-ml6nr\" (UID: \"f4a6b193-47ea-4a0e-b63a-3dd25c6aab85\") " pod="openshift-dns/node-resolver-ml6nr" May 21 10:30:09.703438 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.702896 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a41a87f2-f6ab-4cb1-9b97-906ce5eece4d-host-run-netns\") pod \"multus-g4lt2\" (UID: \"a41a87f2-f6ab-4cb1-9b97-906ce5eece4d\") " pod="openshift-multus/multus-g4lt2" May 21 10:30:09.703438 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.702913 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a41a87f2-f6ab-4cb1-9b97-906ce5eece4d-host-var-lib-kubelet\") pod \"multus-g4lt2\" (UID: \"a41a87f2-f6ab-4cb1-9b97-906ce5eece4d\") " pod="openshift-multus/multus-g4lt2" May 21 10:30:09.703438 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.702931 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a41a87f2-f6ab-4cb1-9b97-906ce5eece4d-system-cni-dir\") pod \"multus-g4lt2\" (UID: \"a41a87f2-f6ab-4cb1-9b97-906ce5eece4d\") " pod="openshift-multus/multus-g4lt2" May 21 10:30:09.703438 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.702954 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/24a7e4d2-b048-41e9-8bc4-9993aed09fd4-ovnkube-script-lib\") pod \"ovnkube-node-fhjht\" (UID: \"24a7e4d2-b048-41e9-8bc4-9993aed09fd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" May 21 10:30:09.703438 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.702970 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a41a87f2-f6ab-4cb1-9b97-906ce5eece4d-cnibin\") pod \"multus-g4lt2\" (UID: \"a41a87f2-f6ab-4cb1-9b97-906ce5eece4d\") " pod="openshift-multus/multus-g4lt2" May 21 10:30:09.703438 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.702974 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a41a87f2-f6ab-4cb1-9b97-906ce5eece4d-host-run-netns\") pod \"multus-g4lt2\" (UID: \"a41a87f2-f6ab-4cb1-9b97-906ce5eece4d\") " pod="openshift-multus/multus-g4lt2" May 21 10:30:09.703438 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.702986 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a41a87f2-f6ab-4cb1-9b97-906ce5eece4d-host-var-lib-kubelet\") pod \"multus-g4lt2\" (UID: \"a41a87f2-f6ab-4cb1-9b97-906ce5eece4d\") " pod="openshift-multus/multus-g4lt2" May 21 10:30:09.703438 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.702997 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a41a87f2-f6ab-4cb1-9b97-906ce5eece4d-os-release\") pod \"multus-g4lt2\" (UID: \"a41a87f2-f6ab-4cb1-9b97-906ce5eece4d\") " pod="openshift-multus/multus-g4lt2" May 21 10:30:09.703438 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.703107 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a41a87f2-f6ab-4cb1-9b97-906ce5eece4d-system-cni-dir\") pod \"multus-g4lt2\" (UID: \"a41a87f2-f6ab-4cb1-9b97-906ce5eece4d\") " pod="openshift-multus/multus-g4lt2" May 21 10:30:09.703438 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.703120 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a41a87f2-f6ab-4cb1-9b97-906ce5eece4d-os-release\") pod \"multus-g4lt2\" (UID: \"a41a87f2-f6ab-4cb1-9b97-906ce5eece4d\") " pod="openshift-multus/multus-g4lt2" May 21 10:30:09.703438 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.703120 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a41a87f2-f6ab-4cb1-9b97-906ce5eece4d-cnibin\") pod \"multus-g4lt2\" (UID: \"a41a87f2-f6ab-4cb1-9b97-906ce5eece4d\") " pod="openshift-multus/multus-g4lt2" May 21 10:30:09.703438 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.703148 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a41a87f2-f6ab-4cb1-9b97-906ce5eece4d-hostroot\") pod \"multus-g4lt2\" (UID: \"a41a87f2-f6ab-4cb1-9b97-906ce5eece4d\") " pod="openshift-multus/multus-g4lt2" May 21 10:30:09.704330 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.703177 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/24a7e4d2-b048-41e9-8bc4-9993aed09fd4-run-ovn\") pod \"ovnkube-node-fhjht\" (UID: \"24a7e4d2-b048-41e9-8bc4-9993aed09fd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" May 21 10:30:09.704330 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.703212 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/24a7e4d2-b048-41e9-8bc4-9993aed09fd4-node-log\") pod \"ovnkube-node-fhjht\" (UID: \"24a7e4d2-b048-41e9-8bc4-9993aed09fd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" May 21 10:30:09.704330 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.703219 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/24a7e4d2-b048-41e9-8bc4-9993aed09fd4-run-ovn\") pod \"ovnkube-node-fhjht\" (UID: \"24a7e4d2-b048-41e9-8bc4-9993aed09fd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" May 21 10:30:09.704330 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.703229 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a41a87f2-f6ab-4cb1-9b97-906ce5eece4d-hostroot\") pod \"multus-g4lt2\" (UID: \"a41a87f2-f6ab-4cb1-9b97-906ce5eece4d\") " pod="openshift-multus/multus-g4lt2" May 21 10:30:09.704330 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.703238 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/24a7e4d2-b048-41e9-8bc4-9993aed09fd4-host-cni-netd\") pod \"ovnkube-node-fhjht\" (UID: \"24a7e4d2-b048-41e9-8bc4-9993aed09fd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" May 21 10:30:09.704330 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.703248 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/24a7e4d2-b048-41e9-8bc4-9993aed09fd4-node-log\") pod \"ovnkube-node-fhjht\" (UID: \"24a7e4d2-b048-41e9-8bc4-9993aed09fd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" May 21 10:30:09.704330 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.703239 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a41a87f2-f6ab-4cb1-9b97-906ce5eece4d-cni-binary-copy\") pod \"multus-g4lt2\" (UID: \"a41a87f2-f6ab-4cb1-9b97-906ce5eece4d\") " pod="openshift-multus/multus-g4lt2" May 21 10:30:09.704330 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.703267 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8d7bae5e-e157-4bde-8a8c-e82e63427b92-host\") pod \"node-ca-xgzdb\" (UID: \"8d7bae5e-e157-4bde-8a8c-e82e63427b92\") " pod="openshift-image-registry/node-ca-xgzdb" May 21 10:30:09.704330 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.703277 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/24a7e4d2-b048-41e9-8bc4-9993aed09fd4-host-cni-netd\") pod \"ovnkube-node-fhjht\" (UID: \"24a7e4d2-b048-41e9-8bc4-9993aed09fd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" May 21 10:30:09.704330 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.703294 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a41a87f2-f6ab-4cb1-9b97-906ce5eece4d-multus-daemon-config\") pod \"multus-g4lt2\" (UID: \"a41a87f2-f6ab-4cb1-9b97-906ce5eece4d\") " pod="openshift-multus/multus-g4lt2" May 21 10:30:09.704330 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.703321 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1c7a9fbd-e4f0-4c8f-b533-fc8a4a1911f0-iptables-alerter-script\") pod \"iptables-alerter-5r5hl\" (UID: \"1c7a9fbd-e4f0-4c8f-b533-fc8a4a1911f0\") " pod="openshift-network-operator/iptables-alerter-5r5hl" May 21 10:30:09.704330 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.703349 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-srcg8\" (UniqueName: \"kubernetes.io/projected/8d7bae5e-e157-4bde-8a8c-e82e63427b92-kube-api-access-srcg8\") pod \"node-ca-xgzdb\" (UID: \"8d7bae5e-e157-4bde-8a8c-e82e63427b92\") " pod="openshift-image-registry/node-ca-xgzdb" May 21 10:30:09.704330 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.703358 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8d7bae5e-e157-4bde-8a8c-e82e63427b92-host\") pod \"node-ca-xgzdb\" (UID: \"8d7bae5e-e157-4bde-8a8c-e82e63427b92\") " pod="openshift-image-registry/node-ca-xgzdb" May 21 10:30:09.704330 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.703376 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c9e91e4e-88b6-4364-8536-e995ba46046c-konnectivity-ca\") pod \"konnectivity-agent-n9txr\" (UID: \"c9e91e4e-88b6-4364-8536-e995ba46046c\") " pod="kube-system/konnectivity-agent-n9txr" May 21 10:30:09.704330 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.703403 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/24a7e4d2-b048-41e9-8bc4-9993aed09fd4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fhjht\" (UID: \"24a7e4d2-b048-41e9-8bc4-9993aed09fd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" May 21 10:30:09.704330 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.703429 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/24a7e4d2-b048-41e9-8bc4-9993aed09fd4-env-overrides\") pod \"ovnkube-node-fhjht\" (UID: \"24a7e4d2-b048-41e9-8bc4-9993aed09fd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" May 21 10:30:09.704330 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.703455 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ktwpw\" (UniqueName: \"kubernetes.io/projected/24a7e4d2-b048-41e9-8bc4-9993aed09fd4-kube-api-access-ktwpw\") pod \"ovnkube-node-fhjht\" (UID: \"24a7e4d2-b048-41e9-8bc4-9993aed09fd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" May 21 10:30:09.704330 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.703482 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4b5xg\" (UniqueName: \"kubernetes.io/projected/1c7a9fbd-e4f0-4c8f-b533-fc8a4a1911f0-kube-api-access-4b5xg\") pod \"iptables-alerter-5r5hl\" (UID: \"1c7a9fbd-e4f0-4c8f-b533-fc8a4a1911f0\") " pod="openshift-network-operator/iptables-alerter-5r5hl" May 21 10:30:09.705123 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.703513 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/24a7e4d2-b048-41e9-8bc4-9993aed09fd4-log-socket\") pod \"ovnkube-node-fhjht\" (UID: \"24a7e4d2-b048-41e9-8bc4-9993aed09fd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" May 21 10:30:09.705123 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.703544 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/24a7e4d2-b048-41e9-8bc4-9993aed09fd4-host-cni-bin\") pod \"ovnkube-node-fhjht\" (UID: \"24a7e4d2-b048-41e9-8bc4-9993aed09fd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" May 21 10:30:09.705123 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.703572 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a41a87f2-f6ab-4cb1-9b97-906ce5eece4d-multus-cni-dir\") pod \"multus-g4lt2\" (UID: \"a41a87f2-f6ab-4cb1-9b97-906ce5eece4d\") " pod="openshift-multus/multus-g4lt2" May 21 10:30:09.705123 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.703612 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a41a87f2-f6ab-4cb1-9b97-906ce5eece4d-host-run-k8s-cni-cncf-io\") pod \"multus-g4lt2\" (UID: \"a41a87f2-f6ab-4cb1-9b97-906ce5eece4d\") " pod="openshift-multus/multus-g4lt2" May 21 10:30:09.705123 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.703639 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a41a87f2-f6ab-4cb1-9b97-906ce5eece4d-host-run-multus-certs\") pod \"multus-g4lt2\" (UID: \"a41a87f2-f6ab-4cb1-9b97-906ce5eece4d\") " pod="openshift-multus/multus-g4lt2" May 21 10:30:09.705123 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.703664 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a41a87f2-f6ab-4cb1-9b97-906ce5eece4d-etc-kubernetes\") pod \"multus-g4lt2\" (UID: \"a41a87f2-f6ab-4cb1-9b97-906ce5eece4d\") " pod="openshift-multus/multus-g4lt2" May 21 10:30:09.705123 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.703691 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/24a7e4d2-b048-41e9-8bc4-9993aed09fd4-run-systemd\") pod \"ovnkube-node-fhjht\" (UID: \"24a7e4d2-b048-41e9-8bc4-9993aed09fd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" May 21 10:30:09.705123 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.703717 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/24a7e4d2-b048-41e9-8bc4-9993aed09fd4-host-run-ovn-kubernetes\") pod \"ovnkube-node-fhjht\" (UID: \"24a7e4d2-b048-41e9-8bc4-9993aed09fd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" May 21 10:30:09.705123 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.703743 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f4a6b193-47ea-4a0e-b63a-3dd25c6aab85-hosts-file\") pod \"node-resolver-ml6nr\" (UID: \"f4a6b193-47ea-4a0e-b63a-3dd25c6aab85\") " pod="openshift-dns/node-resolver-ml6nr" May 21 10:30:09.705123 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.703747 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/24a7e4d2-b048-41e9-8bc4-9993aed09fd4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fhjht\" (UID: \"24a7e4d2-b048-41e9-8bc4-9993aed09fd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" May 21 10:30:09.705123 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.703769 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9tmrn\" (UniqueName: \"kubernetes.io/projected/a41a87f2-f6ab-4cb1-9b97-906ce5eece4d-kube-api-access-9tmrn\") pod \"multus-g4lt2\" (UID: \"a41a87f2-f6ab-4cb1-9b97-906ce5eece4d\") " pod="openshift-multus/multus-g4lt2" May 21 10:30:09.705123 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.703798 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c9e91e4e-88b6-4364-8536-e995ba46046c-agent-certs\") pod \"konnectivity-agent-n9txr\" (UID: \"c9e91e4e-88b6-4364-8536-e995ba46046c\") " pod="kube-system/konnectivity-agent-n9txr" May 21 10:30:09.705123 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.703822 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8d7bae5e-e157-4bde-8a8c-e82e63427b92-serviceca\") pod \"node-ca-xgzdb\" (UID: \"8d7bae5e-e157-4bde-8a8c-e82e63427b92\") " pod="openshift-image-registry/node-ca-xgzdb" May 21 10:30:09.705123 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.703848 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a41a87f2-f6ab-4cb1-9b97-906ce5eece4d-multus-daemon-config\") pod \"multus-g4lt2\" (UID: \"a41a87f2-f6ab-4cb1-9b97-906ce5eece4d\") " pod="openshift-multus/multus-g4lt2" May 21 10:30:09.705123 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.703859 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1c7a9fbd-e4f0-4c8f-b533-fc8a4a1911f0-iptables-alerter-script\") pod \"iptables-alerter-5r5hl\" (UID: \"1c7a9fbd-e4f0-4c8f-b533-fc8a4a1911f0\") " pod="openshift-network-operator/iptables-alerter-5r5hl" May 21 10:30:09.705123 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.703890 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c9e91e4e-88b6-4364-8536-e995ba46046c-konnectivity-ca\") pod \"konnectivity-agent-n9txr\" (UID: \"c9e91e4e-88b6-4364-8536-e995ba46046c\") " pod="kube-system/konnectivity-agent-n9txr" May 21 10:30:09.705123 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.703909 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a41a87f2-f6ab-4cb1-9b97-906ce5eece4d-etc-kubernetes\") pod \"multus-g4lt2\" (UID: \"a41a87f2-f6ab-4cb1-9b97-906ce5eece4d\") " pod="openshift-multus/multus-g4lt2" May 21 10:30:09.705123 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.703955 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/24a7e4d2-b048-41e9-8bc4-9993aed09fd4-log-socket\") pod \"ovnkube-node-fhjht\" (UID: \"24a7e4d2-b048-41e9-8bc4-9993aed09fd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" May 21 10:30:09.705684 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.703984 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a41a87f2-f6ab-4cb1-9b97-906ce5eece4d-host-run-multus-certs\") pod \"multus-g4lt2\" (UID: \"a41a87f2-f6ab-4cb1-9b97-906ce5eece4d\") " pod="openshift-multus/multus-g4lt2" May 21 10:30:09.705684 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.704001 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/24a7e4d2-b048-41e9-8bc4-9993aed09fd4-host-cni-bin\") pod \"ovnkube-node-fhjht\" (UID: \"24a7e4d2-b048-41e9-8bc4-9993aed09fd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" May 21 10:30:09.705684 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.704033 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/24a7e4d2-b048-41e9-8bc4-9993aed09fd4-run-systemd\") pod \"ovnkube-node-fhjht\" (UID: \"24a7e4d2-b048-41e9-8bc4-9993aed09fd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" May 21 10:30:09.705684 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.704055 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a41a87f2-f6ab-4cb1-9b97-906ce5eece4d-multus-cni-dir\") pod \"multus-g4lt2\" (UID: \"a41a87f2-f6ab-4cb1-9b97-906ce5eece4d\") " pod="openshift-multus/multus-g4lt2" May 21 10:30:09.705684 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.704084 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/24a7e4d2-b048-41e9-8bc4-9993aed09fd4-host-run-ovn-kubernetes\") pod \"ovnkube-node-fhjht\" (UID: \"24a7e4d2-b048-41e9-8bc4-9993aed09fd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" May 21 10:30:09.705684 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.704098 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a41a87f2-f6ab-4cb1-9b97-906ce5eece4d-host-run-k8s-cni-cncf-io\") pod \"multus-g4lt2\" (UID: \"a41a87f2-f6ab-4cb1-9b97-906ce5eece4d\") " pod="openshift-multus/multus-g4lt2" May 21 10:30:09.705684 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.704118 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/24a7e4d2-b048-41e9-8bc4-9993aed09fd4-env-overrides\") pod \"ovnkube-node-fhjht\" (UID: \"24a7e4d2-b048-41e9-8bc4-9993aed09fd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" May 21 10:30:09.705684 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.704147 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f4a6b193-47ea-4a0e-b63a-3dd25c6aab85-hosts-file\") pod \"node-resolver-ml6nr\" (UID: \"f4a6b193-47ea-4a0e-b63a-3dd25c6aab85\") " pod="openshift-dns/node-resolver-ml6nr" May 21 10:30:09.705684 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.704228 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8d7bae5e-e157-4bde-8a8c-e82e63427b92-serviceca\") pod \"node-ca-xgzdb\" (UID: \"8d7bae5e-e157-4bde-8a8c-e82e63427b92\") " pod="openshift-image-registry/node-ca-xgzdb" May 21 10:30:09.705684 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.705297 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/24a7e4d2-b048-41e9-8bc4-9993aed09fd4-ovn-node-metrics-cert\") pod \"ovnkube-node-fhjht\" (UID: \"24a7e4d2-b048-41e9-8bc4-9993aed09fd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" May 21 10:30:09.706235 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.706217 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c9e91e4e-88b6-4364-8536-e995ba46046c-agent-certs\") pod \"konnectivity-agent-n9txr\" (UID: \"c9e91e4e-88b6-4364-8536-e995ba46046c\") " pod="kube-system/konnectivity-agent-n9txr" May 21 10:30:09.711014 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:09.710995 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 10:30:09.711014 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:09.711016 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 10:30:09.711118 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:09.711025 2565 projected.go:194] Error preparing data for projected volume kube-api-access-vd7xq for pod openshift-network-diagnostics/network-check-target-pqqfc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 10:30:09.711118 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:09.711084 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03cc5e6e-7e76-47ec-80e8-795d0a71d2f8-kube-api-access-vd7xq podName:03cc5e6e-7e76-47ec-80e8-795d0a71d2f8 nodeName:}" failed. No retries permitted until 2026-05-21 10:30:10.211068062 +0000 UTC m=+3.124447114 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vd7xq" (UniqueName: "kubernetes.io/projected/03cc5e6e-7e76-47ec-80e8-795d0a71d2f8-kube-api-access-vd7xq") pod "network-check-target-pqqfc" (UID: "03cc5e6e-7e76-47ec-80e8-795d0a71d2f8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 10:30:09.711743 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.711723 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ftcf\" (UniqueName: \"kubernetes.io/projected/35d22f25-59d6-48b0-a885-ddbcfcdf5cb0-kube-api-access-5ftcf\") pod \"network-metrics-daemon-flzlz\" (UID: \"35d22f25-59d6-48b0-a885-ddbcfcdf5cb0\") " pod="openshift-multus/network-metrics-daemon-flzlz" May 21 10:30:09.714832 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.714807 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktwpw\" (UniqueName: \"kubernetes.io/projected/24a7e4d2-b048-41e9-8bc4-9993aed09fd4-kube-api-access-ktwpw\") pod \"ovnkube-node-fhjht\" (UID: \"24a7e4d2-b048-41e9-8bc4-9993aed09fd4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" May 21 10:30:09.715606 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.715585 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5z5pr\" (UniqueName: \"kubernetes.io/projected/f4a6b193-47ea-4a0e-b63a-3dd25c6aab85-kube-api-access-5z5pr\") pod \"node-resolver-ml6nr\" (UID: \"f4a6b193-47ea-4a0e-b63a-3dd25c6aab85\") " pod="openshift-dns/node-resolver-ml6nr" May 21 10:30:09.715693 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.715635 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-srcg8\" (UniqueName: \"kubernetes.io/projected/8d7bae5e-e157-4bde-8a8c-e82e63427b92-kube-api-access-srcg8\") pod \"node-ca-xgzdb\" (UID: \"8d7bae5e-e157-4bde-8a8c-e82e63427b92\") " pod="openshift-image-registry/node-ca-xgzdb" May 21 10:30:09.715734 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.715708 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4b5xg\" (UniqueName: \"kubernetes.io/projected/1c7a9fbd-e4f0-4c8f-b533-fc8a4a1911f0-kube-api-access-4b5xg\") pod \"iptables-alerter-5r5hl\" (UID: \"1c7a9fbd-e4f0-4c8f-b533-fc8a4a1911f0\") " pod="openshift-network-operator/iptables-alerter-5r5hl" May 21 10:30:09.721868 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.721847 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tmrn\" (UniqueName: \"kubernetes.io/projected/a41a87f2-f6ab-4cb1-9b97-906ce5eece4d-kube-api-access-9tmrn\") pod \"multus-g4lt2\" (UID: \"a41a87f2-f6ab-4cb1-9b97-906ce5eece4d\") " pod="openshift-multus/multus-g4lt2" May 21 10:30:09.800022 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.799935 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mk4n7" May 21 10:30:09.806846 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.806823 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtl4g" May 21 10:30:09.816515 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.816488 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zrxmj" May 21 10:30:09.823088 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.823067 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" May 21 10:30:09.831637 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.831608 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xgzdb" May 21 10:30:09.839173 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.839155 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ml6nr" May 21 10:30:09.845736 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.845719 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-n9txr" May 21 10:30:09.852218 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.852201 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-g4lt2" May 21 10:30:09.858769 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:09.858737 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5r5hl" May 21 10:30:10.027480 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:10.027450 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-8f7qb"] May 21 10:30:10.030251 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:10.030232 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8f7qb" May 21 10:30:10.030380 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:10.030301 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8f7qb" podUID="c5972469-00d2-4517-ba14-6672a94436d7" May 21 10:30:10.107664 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:10.107638 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c5972469-00d2-4517-ba14-6672a94436d7-dbus\") pod \"global-pull-secret-syncer-8f7qb\" (UID: \"c5972469-00d2-4517-ba14-6672a94436d7\") " pod="kube-system/global-pull-secret-syncer-8f7qb" May 21 10:30:10.107664 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:10.107670 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c5972469-00d2-4517-ba14-6672a94436d7-original-pull-secret\") pod \"global-pull-secret-syncer-8f7qb\" (UID: \"c5972469-00d2-4517-ba14-6672a94436d7\") " pod="kube-system/global-pull-secret-syncer-8f7qb" May 21 10:30:10.107891 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:10.107698 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c5972469-00d2-4517-ba14-6672a94436d7-kubelet-config\") pod \"global-pull-secret-syncer-8f7qb\" (UID: \"c5972469-00d2-4517-ba14-6672a94436d7\") " pod="kube-system/global-pull-secret-syncer-8f7qb" May 21 10:30:10.208344 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:10.208319 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c5972469-00d2-4517-ba14-6672a94436d7-kubelet-config\") pod \"global-pull-secret-syncer-8f7qb\" (UID: \"c5972469-00d2-4517-ba14-6672a94436d7\") " pod="kube-system/global-pull-secret-syncer-8f7qb" May 21 10:30:10.208456 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:10.208363 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35d22f25-59d6-48b0-a885-ddbcfcdf5cb0-metrics-certs\") pod \"network-metrics-daemon-flzlz\" (UID: \"35d22f25-59d6-48b0-a885-ddbcfcdf5cb0\") " pod="openshift-multus/network-metrics-daemon-flzlz" May 21 10:30:10.208456 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:10.208437 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c5972469-00d2-4517-ba14-6672a94436d7-kubelet-config\") pod \"global-pull-secret-syncer-8f7qb\" (UID: \"c5972469-00d2-4517-ba14-6672a94436d7\") " pod="kube-system/global-pull-secret-syncer-8f7qb" May 21 10:30:10.208541 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:10.208442 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 10:30:10.208541 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:10.208475 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c5972469-00d2-4517-ba14-6672a94436d7-dbus\") pod \"global-pull-secret-syncer-8f7qb\" (UID: \"c5972469-00d2-4517-ba14-6672a94436d7\") " pod="kube-system/global-pull-secret-syncer-8f7qb" May 21 10:30:10.208541 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:10.208509 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c5972469-00d2-4517-ba14-6672a94436d7-original-pull-secret\") pod \"global-pull-secret-syncer-8f7qb\" (UID: \"c5972469-00d2-4517-ba14-6672a94436d7\") " pod="kube-system/global-pull-secret-syncer-8f7qb" May 21 10:30:10.208541 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:10.208540 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35d22f25-59d6-48b0-a885-ddbcfcdf5cb0-metrics-certs podName:35d22f25-59d6-48b0-a885-ddbcfcdf5cb0 nodeName:}" failed. No retries permitted until 2026-05-21 10:30:11.208528002 +0000 UTC m=+4.121907049 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/35d22f25-59d6-48b0-a885-ddbcfcdf5cb0-metrics-certs") pod "network-metrics-daemon-flzlz" (UID: "35d22f25-59d6-48b0-a885-ddbcfcdf5cb0") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 10:30:10.208724 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:10.208634 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 10:30:10.208724 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:10.208680 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c5972469-00d2-4517-ba14-6672a94436d7-dbus\") pod \"global-pull-secret-syncer-8f7qb\" (UID: \"c5972469-00d2-4517-ba14-6672a94436d7\") " pod="kube-system/global-pull-secret-syncer-8f7qb" May 21 10:30:10.208724 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:10.208692 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5972469-00d2-4517-ba14-6672a94436d7-original-pull-secret podName:c5972469-00d2-4517-ba14-6672a94436d7 nodeName:}" failed. No retries permitted until 2026-05-21 10:30:10.708673294 +0000 UTC m=+3.622052357 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c5972469-00d2-4517-ba14-6672a94436d7-original-pull-secret") pod "global-pull-secret-syncer-8f7qb" (UID: "c5972469-00d2-4517-ba14-6672a94436d7") : object "kube-system"/"original-pull-secret" not registered May 21 10:30:10.222074 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:10.222049 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c7a9fbd_e4f0_4c8f_b533_fc8a4a1911f0.slice/crio-2c0caaa34afefe3c0b851291faaa4799bc1bd4f2178ec11cfadd9d294c33042c WatchSource:0}: Error finding container 2c0caaa34afefe3c0b851291faaa4799bc1bd4f2178ec11cfadd9d294c33042c: Status 404 returned error can't find the container with id 2c0caaa34afefe3c0b851291faaa4799bc1bd4f2178ec11cfadd9d294c33042c May 21 10:30:10.223474 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:10.223439 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda41a87f2_f6ab_4cb1_9b97_906ce5eece4d.slice/crio-4f3c0f0e84b5dd7542e9342ff3057f113682e639572936f02b4dad2f256ea088 WatchSource:0}: Error finding container 4f3c0f0e84b5dd7542e9342ff3057f113682e639572936f02b4dad2f256ea088: Status 404 returned error can't find the container with id 4f3c0f0e84b5dd7542e9342ff3057f113682e639572936f02b4dad2f256ea088 May 21 10:30:10.226821 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:10.226800 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4bb88d2_7c86_4029_a362_fa3f5c3650cb.slice/crio-2851d3db473a9cdbd45bc1f203434c5864413c41fc3b3163f4e0d6b1e3a93f6e WatchSource:0}: Error finding container 2851d3db473a9cdbd45bc1f203434c5864413c41fc3b3163f4e0d6b1e3a93f6e: Status 404 returned error can't find the container with id 2851d3db473a9cdbd45bc1f203434c5864413c41fc3b3163f4e0d6b1e3a93f6e May 21 10:30:10.227678 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:10.227656 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4a6b193_47ea_4a0e_b63a_3dd25c6aab85.slice/crio-5af2ecc4f3bb99a44052bba7a913776d3bdccaebc4b56392edcf9de39776f25e WatchSource:0}: Error finding container 5af2ecc4f3bb99a44052bba7a913776d3bdccaebc4b56392edcf9de39776f25e: Status 404 returned error can't find the container with id 5af2ecc4f3bb99a44052bba7a913776d3bdccaebc4b56392edcf9de39776f25e May 21 10:30:10.228442 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:10.228386 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod762ee6cc_7e36_4827_9350_d26f6580b8db.slice/crio-24d98050255afa3249fce5bf2afe1cbcb06e6fa536d43985447ad0a69d5a91cc WatchSource:0}: Error finding container 24d98050255afa3249fce5bf2afe1cbcb06e6fa536d43985447ad0a69d5a91cc: Status 404 returned error can't find the container with id 24d98050255afa3249fce5bf2afe1cbcb06e6fa536d43985447ad0a69d5a91cc May 21 10:30:10.229419 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:10.229297 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9e91e4e_88b6_4364_8536_e995ba46046c.slice/crio-d72ecebbc8a0bb6aee88b1aac07b522e4ec270565945e5763005750967769c14 WatchSource:0}: Error finding container d72ecebbc8a0bb6aee88b1aac07b522e4ec270565945e5763005750967769c14: Status 404 returned error can't find the container with id d72ecebbc8a0bb6aee88b1aac07b522e4ec270565945e5763005750967769c14 May 21 10:30:10.231004 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:10.230833 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d7bae5e_e157_4bde_8a8c_e82e63427b92.slice/crio-bf956578863ff87417d6e84489ea62ec27d9e246e4add86d6468e344060c4c50 WatchSource:0}: Error finding container bf956578863ff87417d6e84489ea62ec27d9e246e4add86d6468e344060c4c50: Status 404 returned error can't find the container with id bf956578863ff87417d6e84489ea62ec27d9e246e4add86d6468e344060c4c50 May 21 10:30:10.231319 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:10.231295 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d668cb7_db54_4720_9850_d1cbfd659b3d.slice/crio-1e55cc6e4ae4594daff5ff7349e3cec6cf798d9696148bec7bbc7eccfca2e5f7 WatchSource:0}: Error finding container 1e55cc6e4ae4594daff5ff7349e3cec6cf798d9696148bec7bbc7eccfca2e5f7: Status 404 returned error can't find the container with id 1e55cc6e4ae4594daff5ff7349e3cec6cf798d9696148bec7bbc7eccfca2e5f7 May 21 10:30:10.234555 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:10.234530 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24a7e4d2_b048_41e9_8bc4_9993aed09fd4.slice/crio-312b8de0240ef5def7359c890cd551aa6bb5a159b6d1e34d4f3fb8d6a6b9abfe WatchSource:0}: Error finding container 312b8de0240ef5def7359c890cd551aa6bb5a159b6d1e34d4f3fb8d6a6b9abfe: Status 404 returned error can't find the container with id 312b8de0240ef5def7359c890cd551aa6bb5a159b6d1e34d4f3fb8d6a6b9abfe May 21 10:30:10.308724 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:10.308704 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vd7xq\" (UniqueName: \"kubernetes.io/projected/03cc5e6e-7e76-47ec-80e8-795d0a71d2f8-kube-api-access-vd7xq\") pod \"network-check-target-pqqfc\" (UID: \"03cc5e6e-7e76-47ec-80e8-795d0a71d2f8\") " pod="openshift-network-diagnostics/network-check-target-pqqfc" May 21 10:30:10.308880 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:10.308863 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 10:30:10.308965 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:10.308887 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 10:30:10.308965 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:10.308899 2565 projected.go:194] Error preparing data for projected volume kube-api-access-vd7xq for pod openshift-network-diagnostics/network-check-target-pqqfc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 10:30:10.309053 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:10.308978 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03cc5e6e-7e76-47ec-80e8-795d0a71d2f8-kube-api-access-vd7xq podName:03cc5e6e-7e76-47ec-80e8-795d0a71d2f8 nodeName:}" failed. No retries permitted until 2026-05-21 10:30:11.308955602 +0000 UTC m=+4.222334666 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vd7xq" (UniqueName: "kubernetes.io/projected/03cc5e6e-7e76-47ec-80e8-795d0a71d2f8-kube-api-access-vd7xq") pod "network-check-target-pqqfc" (UID: "03cc5e6e-7e76-47ec-80e8-795d0a71d2f8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 10:30:10.529299 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:10.529251 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 10:25:08 +0000 UTC" deadline="2028-02-23 11:14:18.221414752 +0000 UTC" May 21 10:30:10.529299 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:10.529294 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15432h44m7.692124149s" May 21 10:30:10.631612 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:10.631565 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqqfc" May 21 10:30:10.631791 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:10.631694 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqqfc" podUID="03cc5e6e-7e76-47ec-80e8-795d0a71d2f8" May 21 10:30:10.640633 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:10.640602 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-n9txr" event={"ID":"c9e91e4e-88b6-4364-8536-e995ba46046c","Type":"ContainerStarted","Data":"d72ecebbc8a0bb6aee88b1aac07b522e4ec270565945e5763005750967769c14"} May 21 10:30:10.642603 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:10.642571 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-g4lt2" event={"ID":"a41a87f2-f6ab-4cb1-9b97-906ce5eece4d","Type":"ContainerStarted","Data":"4f3c0f0e84b5dd7542e9342ff3057f113682e639572936f02b4dad2f256ea088"} May 21 10:30:10.645714 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:10.644729 2565 generic.go:358] "Generic (PLEG): container finished" podID="311b254f6fec6ca06a2a63845d2409b9" containerID="da6d566a1bda63c680c35ac26aa4ac21769835c75b13ca0a7c57d4c1e81ab7db" exitCode=0 May 21 10:30:10.645714 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:10.645389 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-214.ec2.internal" event={"ID":"311b254f6fec6ca06a2a63845d2409b9","Type":"ContainerDied","Data":"da6d566a1bda63c680c35ac26aa4ac21769835c75b13ca0a7c57d4c1e81ab7db"} May 21 10:30:10.647520 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:10.647493 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zrxmj" event={"ID":"9d668cb7-db54-4720-9850-d1cbfd659b3d","Type":"ContainerStarted","Data":"1e55cc6e4ae4594daff5ff7349e3cec6cf798d9696148bec7bbc7eccfca2e5f7"} May 21 10:30:10.649568 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:10.649197 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xgzdb" event={"ID":"8d7bae5e-e157-4bde-8a8c-e82e63427b92","Type":"ContainerStarted","Data":"bf956578863ff87417d6e84489ea62ec27d9e246e4add86d6468e344060c4c50"} May 21 10:30:10.652972 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:10.652889 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mk4n7" event={"ID":"762ee6cc-7e36-4827-9350-d26f6580b8db","Type":"ContainerStarted","Data":"24d98050255afa3249fce5bf2afe1cbcb06e6fa536d43985447ad0a69d5a91cc"} May 21 10:30:10.654830 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:10.654770 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ml6nr" event={"ID":"f4a6b193-47ea-4a0e-b63a-3dd25c6aab85","Type":"ContainerStarted","Data":"5af2ecc4f3bb99a44052bba7a913776d3bdccaebc4b56392edcf9de39776f25e"} May 21 10:30:10.660421 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:10.657080 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtl4g" event={"ID":"f4bb88d2-7c86-4029-a362-fa3f5c3650cb","Type":"ContainerStarted","Data":"2851d3db473a9cdbd45bc1f203434c5864413c41fc3b3163f4e0d6b1e3a93f6e"} May 21 10:30:10.660421 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:10.658280 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5r5hl" event={"ID":"1c7a9fbd-e4f0-4c8f-b533-fc8a4a1911f0","Type":"ContainerStarted","Data":"2c0caaa34afefe3c0b851291faaa4799bc1bd4f2178ec11cfadd9d294c33042c"} May 21 10:30:10.661422 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:10.661390 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-214.ec2.internal" event={"ID":"84135066f8c765a27568c2cb628cbfb6","Type":"ContainerStarted","Data":"c4029b789673afb701d78336d5c3cdef09605398cefaa4357474288a07fa6d44"} May 21 10:30:10.667734 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:10.667701 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" event={"ID":"24a7e4d2-b048-41e9-8bc4-9993aed09fd4","Type":"ContainerStarted","Data":"312b8de0240ef5def7359c890cd551aa6bb5a159b6d1e34d4f3fb8d6a6b9abfe"} May 21 10:30:10.711470 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:10.711393 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c5972469-00d2-4517-ba14-6672a94436d7-original-pull-secret\") pod \"global-pull-secret-syncer-8f7qb\" (UID: \"c5972469-00d2-4517-ba14-6672a94436d7\") " pod="kube-system/global-pull-secret-syncer-8f7qb" May 21 10:30:10.711608 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:10.711563 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 10:30:10.711673 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:10.711625 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5972469-00d2-4517-ba14-6672a94436d7-original-pull-secret podName:c5972469-00d2-4517-ba14-6672a94436d7 nodeName:}" failed. No retries permitted until 2026-05-21 10:30:11.711606358 +0000 UTC m=+4.624985426 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c5972469-00d2-4517-ba14-6672a94436d7-original-pull-secret") pod "global-pull-secret-syncer-8f7qb" (UID: "c5972469-00d2-4517-ba14-6672a94436d7") : object "kube-system"/"original-pull-secret" not registered May 21 10:30:10.983554 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:10.983474 2565 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 21 10:30:11.215733 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:11.215687 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35d22f25-59d6-48b0-a885-ddbcfcdf5cb0-metrics-certs\") pod \"network-metrics-daemon-flzlz\" (UID: \"35d22f25-59d6-48b0-a885-ddbcfcdf5cb0\") " pod="openshift-multus/network-metrics-daemon-flzlz" May 21 10:30:11.215914 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:11.215857 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 10:30:11.216005 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:11.215921 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35d22f25-59d6-48b0-a885-ddbcfcdf5cb0-metrics-certs podName:35d22f25-59d6-48b0-a885-ddbcfcdf5cb0 nodeName:}" failed. No retries permitted until 2026-05-21 10:30:13.215901372 +0000 UTC m=+6.129280422 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/35d22f25-59d6-48b0-a885-ddbcfcdf5cb0-metrics-certs") pod "network-metrics-daemon-flzlz" (UID: "35d22f25-59d6-48b0-a885-ddbcfcdf5cb0") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 10:30:11.316476 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:11.316443 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vd7xq\" (UniqueName: \"kubernetes.io/projected/03cc5e6e-7e76-47ec-80e8-795d0a71d2f8-kube-api-access-vd7xq\") pod \"network-check-target-pqqfc\" (UID: \"03cc5e6e-7e76-47ec-80e8-795d0a71d2f8\") " pod="openshift-network-diagnostics/network-check-target-pqqfc" May 21 10:30:11.316654 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:11.316623 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 10:30:11.316654 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:11.316644 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 10:30:11.316762 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:11.316657 2565 projected.go:194] Error preparing data for projected volume kube-api-access-vd7xq for pod openshift-network-diagnostics/network-check-target-pqqfc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 10:30:11.316762 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:11.316717 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03cc5e6e-7e76-47ec-80e8-795d0a71d2f8-kube-api-access-vd7xq podName:03cc5e6e-7e76-47ec-80e8-795d0a71d2f8 nodeName:}" failed. No retries permitted until 2026-05-21 10:30:13.316697902 +0000 UTC m=+6.230076967 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vd7xq" (UniqueName: "kubernetes.io/projected/03cc5e6e-7e76-47ec-80e8-795d0a71d2f8-kube-api-access-vd7xq") pod "network-check-target-pqqfc" (UID: "03cc5e6e-7e76-47ec-80e8-795d0a71d2f8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 10:30:11.634729 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:11.634650 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8f7qb" May 21 10:30:11.635190 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:11.634789 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8f7qb" podUID="c5972469-00d2-4517-ba14-6672a94436d7" May 21 10:30:11.635284 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:11.635236 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flzlz" May 21 10:30:11.635359 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:11.635336 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-flzlz" podUID="35d22f25-59d6-48b0-a885-ddbcfcdf5cb0" May 21 10:30:11.682051 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:11.682002 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-214.ec2.internal" event={"ID":"311b254f6fec6ca06a2a63845d2409b9","Type":"ContainerStarted","Data":"adcb6eb1019d6eed6c93b15fbc052fc4cb004053a83e4a2c65d3376fd1528ff5"} May 21 10:30:11.697386 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:11.697334 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-214.ec2.internal" podStartSLOduration=3.697318102 podStartE2EDuration="3.697318102s" podCreationTimestamp="2026-05-21 10:30:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 10:30:11.697215925 +0000 UTC m=+4.610594997" watchObservedRunningTime="2026-05-21 10:30:11.697318102 +0000 UTC m=+4.610697164" May 21 10:30:11.697652 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:11.697620 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-214.ec2.internal" podStartSLOduration=3.697611651 podStartE2EDuration="3.697611651s" podCreationTimestamp="2026-05-21 10:30:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 10:30:10.679754755 +0000 UTC m=+3.593133826" watchObservedRunningTime="2026-05-21 10:30:11.697611651 +0000 UTC m=+4.610990729" May 21 10:30:11.720479 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:11.720290 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c5972469-00d2-4517-ba14-6672a94436d7-original-pull-secret\") pod \"global-pull-secret-syncer-8f7qb\" (UID: \"c5972469-00d2-4517-ba14-6672a94436d7\") " pod="kube-system/global-pull-secret-syncer-8f7qb" May 21 10:30:11.720479 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:11.720408 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 10:30:11.720479 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:11.720467 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5972469-00d2-4517-ba14-6672a94436d7-original-pull-secret podName:c5972469-00d2-4517-ba14-6672a94436d7 nodeName:}" failed. No retries permitted until 2026-05-21 10:30:13.720450412 +0000 UTC m=+6.633829465 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c5972469-00d2-4517-ba14-6672a94436d7-original-pull-secret") pod "global-pull-secret-syncer-8f7qb" (UID: "c5972469-00d2-4517-ba14-6672a94436d7") : object "kube-system"/"original-pull-secret" not registered May 21 10:30:12.631616 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:12.631582 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqqfc" May 21 10:30:12.631805 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:12.631691 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqqfc" podUID="03cc5e6e-7e76-47ec-80e8-795d0a71d2f8" May 21 10:30:13.233871 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:13.233833 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35d22f25-59d6-48b0-a885-ddbcfcdf5cb0-metrics-certs\") pod \"network-metrics-daemon-flzlz\" (UID: \"35d22f25-59d6-48b0-a885-ddbcfcdf5cb0\") " pod="openshift-multus/network-metrics-daemon-flzlz" May 21 10:30:13.234292 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:13.234015 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 10:30:13.234292 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:13.234081 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35d22f25-59d6-48b0-a885-ddbcfcdf5cb0-metrics-certs podName:35d22f25-59d6-48b0-a885-ddbcfcdf5cb0 nodeName:}" failed. No retries permitted until 2026-05-21 10:30:17.234063193 +0000 UTC m=+10.147442248 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/35d22f25-59d6-48b0-a885-ddbcfcdf5cb0-metrics-certs") pod "network-metrics-daemon-flzlz" (UID: "35d22f25-59d6-48b0-a885-ddbcfcdf5cb0") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 10:30:13.335621 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:13.335576 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vd7xq\" (UniqueName: \"kubernetes.io/projected/03cc5e6e-7e76-47ec-80e8-795d0a71d2f8-kube-api-access-vd7xq\") pod \"network-check-target-pqqfc\" (UID: \"03cc5e6e-7e76-47ec-80e8-795d0a71d2f8\") " pod="openshift-network-diagnostics/network-check-target-pqqfc" May 21 10:30:13.335840 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:13.335822 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 10:30:13.335910 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:13.335846 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 10:30:13.335910 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:13.335876 2565 projected.go:194] Error preparing data for projected volume kube-api-access-vd7xq for pod openshift-network-diagnostics/network-check-target-pqqfc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 10:30:13.336046 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:13.335962 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03cc5e6e-7e76-47ec-80e8-795d0a71d2f8-kube-api-access-vd7xq podName:03cc5e6e-7e76-47ec-80e8-795d0a71d2f8 nodeName:}" failed. No retries permitted until 2026-05-21 10:30:17.335926266 +0000 UTC m=+10.249305319 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vd7xq" (UniqueName: "kubernetes.io/projected/03cc5e6e-7e76-47ec-80e8-795d0a71d2f8-kube-api-access-vd7xq") pod "network-check-target-pqqfc" (UID: "03cc5e6e-7e76-47ec-80e8-795d0a71d2f8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 10:30:13.634115 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:13.633758 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8f7qb" May 21 10:30:13.634115 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:13.633852 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8f7qb" podUID="c5972469-00d2-4517-ba14-6672a94436d7" May 21 10:30:13.634115 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:13.633867 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flzlz" May 21 10:30:13.634115 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:13.633995 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-flzlz" podUID="35d22f25-59d6-48b0-a885-ddbcfcdf5cb0" May 21 10:30:13.738482 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:13.738435 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c5972469-00d2-4517-ba14-6672a94436d7-original-pull-secret\") pod \"global-pull-secret-syncer-8f7qb\" (UID: \"c5972469-00d2-4517-ba14-6672a94436d7\") " pod="kube-system/global-pull-secret-syncer-8f7qb" May 21 10:30:13.738633 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:13.738578 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 10:30:13.738677 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:13.738642 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5972469-00d2-4517-ba14-6672a94436d7-original-pull-secret podName:c5972469-00d2-4517-ba14-6672a94436d7 nodeName:}" failed. No retries permitted until 2026-05-21 10:30:17.73862312 +0000 UTC m=+10.652002174 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c5972469-00d2-4517-ba14-6672a94436d7-original-pull-secret") pod "global-pull-secret-syncer-8f7qb" (UID: "c5972469-00d2-4517-ba14-6672a94436d7") : object "kube-system"/"original-pull-secret" not registered May 21 10:30:14.631803 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:14.631771 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqqfc" May 21 10:30:14.632281 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:14.631885 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqqfc" podUID="03cc5e6e-7e76-47ec-80e8-795d0a71d2f8" May 21 10:30:15.632995 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:15.632327 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flzlz" May 21 10:30:15.632995 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:15.632466 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-flzlz" podUID="35d22f25-59d6-48b0-a885-ddbcfcdf5cb0" May 21 10:30:15.632995 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:15.632848 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8f7qb" May 21 10:30:15.632995 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:15.632951 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8f7qb" podUID="c5972469-00d2-4517-ba14-6672a94436d7" May 21 10:30:16.631601 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:16.631571 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqqfc" May 21 10:30:16.631771 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:16.631697 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqqfc" podUID="03cc5e6e-7e76-47ec-80e8-795d0a71d2f8" May 21 10:30:17.268961 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:17.268341 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35d22f25-59d6-48b0-a885-ddbcfcdf5cb0-metrics-certs\") pod \"network-metrics-daemon-flzlz\" (UID: \"35d22f25-59d6-48b0-a885-ddbcfcdf5cb0\") " pod="openshift-multus/network-metrics-daemon-flzlz" May 21 10:30:17.268961 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:17.268543 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 10:30:17.268961 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:17.268610 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35d22f25-59d6-48b0-a885-ddbcfcdf5cb0-metrics-certs podName:35d22f25-59d6-48b0-a885-ddbcfcdf5cb0 nodeName:}" failed. No retries permitted until 2026-05-21 10:30:25.26859022 +0000 UTC m=+18.181969271 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/35d22f25-59d6-48b0-a885-ddbcfcdf5cb0-metrics-certs") pod "network-metrics-daemon-flzlz" (UID: "35d22f25-59d6-48b0-a885-ddbcfcdf5cb0") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 10:30:17.368979 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:17.368927 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vd7xq\" (UniqueName: \"kubernetes.io/projected/03cc5e6e-7e76-47ec-80e8-795d0a71d2f8-kube-api-access-vd7xq\") pod \"network-check-target-pqqfc\" (UID: \"03cc5e6e-7e76-47ec-80e8-795d0a71d2f8\") " pod="openshift-network-diagnostics/network-check-target-pqqfc" May 21 10:30:17.369154 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:17.369101 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 10:30:17.369154 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:17.369126 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 10:30:17.369154 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:17.369139 2565 projected.go:194] Error preparing data for projected volume kube-api-access-vd7xq for pod openshift-network-diagnostics/network-check-target-pqqfc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 10:30:17.369297 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:17.369203 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03cc5e6e-7e76-47ec-80e8-795d0a71d2f8-kube-api-access-vd7xq podName:03cc5e6e-7e76-47ec-80e8-795d0a71d2f8 nodeName:}" failed. No retries permitted until 2026-05-21 10:30:25.369182264 +0000 UTC m=+18.282561332 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vd7xq" (UniqueName: "kubernetes.io/projected/03cc5e6e-7e76-47ec-80e8-795d0a71d2f8-kube-api-access-vd7xq") pod "network-check-target-pqqfc" (UID: "03cc5e6e-7e76-47ec-80e8-795d0a71d2f8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 10:30:17.636668 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:17.636626 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8f7qb" May 21 10:30:17.636964 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:17.636891 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8f7qb" podUID="c5972469-00d2-4517-ba14-6672a94436d7" May 21 10:30:17.636964 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:17.636956 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flzlz" May 21 10:30:17.637345 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:17.637307 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-flzlz" podUID="35d22f25-59d6-48b0-a885-ddbcfcdf5cb0" May 21 10:30:17.772990 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:17.772933 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c5972469-00d2-4517-ba14-6672a94436d7-original-pull-secret\") pod \"global-pull-secret-syncer-8f7qb\" (UID: \"c5972469-00d2-4517-ba14-6672a94436d7\") " pod="kube-system/global-pull-secret-syncer-8f7qb" May 21 10:30:17.773155 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:17.773125 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 10:30:17.773686 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:17.773185 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5972469-00d2-4517-ba14-6672a94436d7-original-pull-secret podName:c5972469-00d2-4517-ba14-6672a94436d7 nodeName:}" failed. No retries permitted until 2026-05-21 10:30:25.773166832 +0000 UTC m=+18.686545889 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c5972469-00d2-4517-ba14-6672a94436d7-original-pull-secret") pod "global-pull-secret-syncer-8f7qb" (UID: "c5972469-00d2-4517-ba14-6672a94436d7") : object "kube-system"/"original-pull-secret" not registered May 21 10:30:18.631758 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:18.631602 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqqfc" May 21 10:30:18.631758 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:18.631706 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqqfc" podUID="03cc5e6e-7e76-47ec-80e8-795d0a71d2f8" May 21 10:30:19.632688 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:19.632487 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8f7qb" May 21 10:30:19.633155 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:19.632548 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flzlz" May 21 10:30:19.633155 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:19.632816 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8f7qb" podUID="c5972469-00d2-4517-ba14-6672a94436d7" May 21 10:30:19.633155 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:19.632868 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-flzlz" podUID="35d22f25-59d6-48b0-a885-ddbcfcdf5cb0" May 21 10:30:20.632548 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:20.632438 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqqfc" May 21 10:30:20.632734 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:20.632569 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqqfc" podUID="03cc5e6e-7e76-47ec-80e8-795d0a71d2f8" May 21 10:30:21.632484 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:21.632454 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flzlz" May 21 10:30:21.632670 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:21.632454 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8f7qb" May 21 10:30:21.632670 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:21.632579 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-flzlz" podUID="35d22f25-59d6-48b0-a885-ddbcfcdf5cb0" May 21 10:30:21.632670 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:21.632654 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8f7qb" podUID="c5972469-00d2-4517-ba14-6672a94436d7" May 21 10:30:22.632028 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:22.631996 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqqfc" May 21 10:30:22.632215 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:22.632123 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqqfc" podUID="03cc5e6e-7e76-47ec-80e8-795d0a71d2f8" May 21 10:30:23.631927 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:23.631889 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8f7qb" May 21 10:30:23.631927 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:23.631908 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flzlz" May 21 10:30:23.632440 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:23.632030 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8f7qb" podUID="c5972469-00d2-4517-ba14-6672a94436d7" May 21 10:30:23.632440 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:23.632167 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-flzlz" podUID="35d22f25-59d6-48b0-a885-ddbcfcdf5cb0" May 21 10:30:24.631795 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:24.631759 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqqfc" May 21 10:30:24.632019 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:24.631883 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqqfc" podUID="03cc5e6e-7e76-47ec-80e8-795d0a71d2f8" May 21 10:30:25.329869 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:25.329833 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35d22f25-59d6-48b0-a885-ddbcfcdf5cb0-metrics-certs\") pod \"network-metrics-daemon-flzlz\" (UID: \"35d22f25-59d6-48b0-a885-ddbcfcdf5cb0\") " pod="openshift-multus/network-metrics-daemon-flzlz" May 21 10:30:25.330054 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:25.329974 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 10:30:25.330054 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:25.330045 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35d22f25-59d6-48b0-a885-ddbcfcdf5cb0-metrics-certs podName:35d22f25-59d6-48b0-a885-ddbcfcdf5cb0 nodeName:}" failed. No retries permitted until 2026-05-21 10:30:41.330023189 +0000 UTC m=+34.243402238 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/35d22f25-59d6-48b0-a885-ddbcfcdf5cb0-metrics-certs") pod "network-metrics-daemon-flzlz" (UID: "35d22f25-59d6-48b0-a885-ddbcfcdf5cb0") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 10:30:25.430379 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:25.430335 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vd7xq\" (UniqueName: \"kubernetes.io/projected/03cc5e6e-7e76-47ec-80e8-795d0a71d2f8-kube-api-access-vd7xq\") pod \"network-check-target-pqqfc\" (UID: \"03cc5e6e-7e76-47ec-80e8-795d0a71d2f8\") " pod="openshift-network-diagnostics/network-check-target-pqqfc" May 21 10:30:25.430559 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:25.430532 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 10:30:25.430630 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:25.430562 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 10:30:25.430630 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:25.430576 2565 projected.go:194] Error preparing data for projected volume kube-api-access-vd7xq for pod openshift-network-diagnostics/network-check-target-pqqfc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 10:30:25.430716 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:25.430630 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03cc5e6e-7e76-47ec-80e8-795d0a71d2f8-kube-api-access-vd7xq podName:03cc5e6e-7e76-47ec-80e8-795d0a71d2f8 nodeName:}" failed. No retries permitted until 2026-05-21 10:30:41.43061514 +0000 UTC m=+34.343994187 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vd7xq" (UniqueName: "kubernetes.io/projected/03cc5e6e-7e76-47ec-80e8-795d0a71d2f8-kube-api-access-vd7xq") pod "network-check-target-pqqfc" (UID: "03cc5e6e-7e76-47ec-80e8-795d0a71d2f8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 10:30:25.631623 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:25.631539 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flzlz" May 21 10:30:25.631774 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:25.631688 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-flzlz" podUID="35d22f25-59d6-48b0-a885-ddbcfcdf5cb0" May 21 10:30:25.631774 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:25.631720 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8f7qb" May 21 10:30:25.631887 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:25.631795 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8f7qb" podUID="c5972469-00d2-4517-ba14-6672a94436d7" May 21 10:30:25.832822 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:25.832784 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c5972469-00d2-4517-ba14-6672a94436d7-original-pull-secret\") pod \"global-pull-secret-syncer-8f7qb\" (UID: \"c5972469-00d2-4517-ba14-6672a94436d7\") " pod="kube-system/global-pull-secret-syncer-8f7qb" May 21 10:30:25.833252 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:25.832956 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 10:30:25.833252 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:25.833033 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5972469-00d2-4517-ba14-6672a94436d7-original-pull-secret podName:c5972469-00d2-4517-ba14-6672a94436d7 nodeName:}" failed. No retries permitted until 2026-05-21 10:30:41.833011687 +0000 UTC m=+34.746390745 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c5972469-00d2-4517-ba14-6672a94436d7-original-pull-secret") pod "global-pull-secret-syncer-8f7qb" (UID: "c5972469-00d2-4517-ba14-6672a94436d7") : object "kube-system"/"original-pull-secret" not registered May 21 10:30:26.631469 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:26.631432 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqqfc" May 21 10:30:26.631639 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:26.631555 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqqfc" podUID="03cc5e6e-7e76-47ec-80e8-795d0a71d2f8" May 21 10:30:27.632764 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:27.632730 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flzlz" May 21 10:30:27.633208 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:27.632858 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-flzlz" podUID="35d22f25-59d6-48b0-a885-ddbcfcdf5cb0" May 21 10:30:27.633208 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:27.632905 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8f7qb" May 21 10:30:27.633208 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:27.633033 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8f7qb" podUID="c5972469-00d2-4517-ba14-6672a94436d7" May 21 10:30:28.632265 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:28.632211 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqqfc" May 21 10:30:28.632372 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:28.632329 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqqfc" podUID="03cc5e6e-7e76-47ec-80e8-795d0a71d2f8" May 21 10:30:28.723497 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:28.723445 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-n9txr" event={"ID":"c9e91e4e-88b6-4364-8536-e995ba46046c","Type":"ContainerStarted","Data":"5a5f60aaef3ab146c6b47a7d287969ed5e95e0a6a50d000ae3d0f5e14b2015fa"} May 21 10:30:29.632068 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:29.631874 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8f7qb" May 21 10:30:29.632248 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:29.631966 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flzlz" May 21 10:30:29.632248 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:29.632137 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8f7qb" podUID="c5972469-00d2-4517-ba14-6672a94436d7" May 21 10:30:29.632357 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:29.632253 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-flzlz" podUID="35d22f25-59d6-48b0-a885-ddbcfcdf5cb0" May 21 10:30:29.725773 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:29.725750 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zrxmj" event={"ID":"9d668cb7-db54-4720-9850-d1cbfd659b3d","Type":"ContainerStarted","Data":"157d87ba9e34079d6993f3f62befc6989c5405705ed0a404902086d3ce43eb1a"} May 21 10:30:29.727023 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:29.726998 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xgzdb" event={"ID":"8d7bae5e-e157-4bde-8a8c-e82e63427b92","Type":"ContainerStarted","Data":"159255c9c994750a57d4c69c73ca992711ab538bd102161474a25bbffc6c20a9"} May 21 10:30:29.728289 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:29.728266 2565 generic.go:358] "Generic (PLEG): container finished" podID="762ee6cc-7e36-4827-9350-d26f6580b8db" containerID="622811ff30401a55ac04ec33508f4241d2d36618fe3e4fe58bad9bbf88b95ffa" exitCode=0 May 21 10:30:29.728377 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:29.728333 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mk4n7" event={"ID":"762ee6cc-7e36-4827-9350-d26f6580b8db","Type":"ContainerDied","Data":"622811ff30401a55ac04ec33508f4241d2d36618fe3e4fe58bad9bbf88b95ffa"} May 21 10:30:29.729595 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:29.729568 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ml6nr" event={"ID":"f4a6b193-47ea-4a0e-b63a-3dd25c6aab85","Type":"ContainerStarted","Data":"c97c94b2b433571fb51e33f2bc9d194721e9ade43176a22c256a9d079b82652e"} May 21 10:30:29.730818 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:29.730800 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtl4g" event={"ID":"f4bb88d2-7c86-4029-a362-fa3f5c3650cb","Type":"ContainerStarted","Data":"3e83a663fa9b03d77dfbdb809e20cca59b2fcdcd6af39f32a626c14cdbc58d8a"} May 21 10:30:29.735654 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:29.735610 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" event={"ID":"24a7e4d2-b048-41e9-8bc4-9993aed09fd4","Type":"ContainerStarted","Data":"ac6961c54301c0752edd00f3b64b4a8e8f14052f1a5dbc9c8f4f5ed196f8950c"} May 21 10:30:29.735654 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:29.735634 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" event={"ID":"24a7e4d2-b048-41e9-8bc4-9993aed09fd4","Type":"ContainerStarted","Data":"4e9804ef8c1db5f8cdb2184601ebf7c7e0039fb95643f61d3a60f0b7e669e792"} May 21 10:30:29.735654 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:29.735643 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" event={"ID":"24a7e4d2-b048-41e9-8bc4-9993aed09fd4","Type":"ContainerStarted","Data":"489a713c3ac07c327afbc07a5781bf4b2876f9e21ef5276abd11c53bf9844449"} May 21 10:30:29.735654 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:29.735656 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" event={"ID":"24a7e4d2-b048-41e9-8bc4-9993aed09fd4","Type":"ContainerStarted","Data":"f706c6a6819160e16b4516e060bf918f3e2e636e10bb66d0d46eab4aa8341f22"} May 21 10:30:29.735902 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:29.735666 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" event={"ID":"24a7e4d2-b048-41e9-8bc4-9993aed09fd4","Type":"ContainerStarted","Data":"b5171244a824a348e45642b3bb5e4ae586cffc9f3850f0170d318488a903eff2"} May 21 10:30:29.735902 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:29.735675 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" event={"ID":"24a7e4d2-b048-41e9-8bc4-9993aed09fd4","Type":"ContainerStarted","Data":"79ebcc840996da056b5e415e437c73cd4adeeaaede5decf045464ae83eb10639"} May 21 10:30:29.736768 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:29.736735 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-g4lt2" event={"ID":"a41a87f2-f6ab-4cb1-9b97-906ce5eece4d","Type":"ContainerStarted","Data":"f39a62f9fc627cd8aa4857cda6305fbeb444b321be731b341420ef9ba19d9867"} May 21 10:30:29.762880 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:29.762838 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xgzdb" podStartSLOduration=4.433748423 podStartE2EDuration="22.762828152s" podCreationTimestamp="2026-05-21 10:30:07 +0000 UTC" firstStartedPulling="2026-05-21 10:30:10.23484801 +0000 UTC m=+3.148227061" lastFinishedPulling="2026-05-21 10:30:28.563927741 +0000 UTC m=+21.477306790" observedRunningTime="2026-05-21 10:30:29.762705177 +0000 UTC m=+22.676084247" watchObservedRunningTime="2026-05-21 10:30:29.762828152 +0000 UTC m=+22.676207222" May 21 10:30:29.763388 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:29.763363 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-zrxmj" podStartSLOduration=4.434545161 podStartE2EDuration="22.763356553s" podCreationTimestamp="2026-05-21 10:30:07 +0000 UTC" firstStartedPulling="2026-05-21 10:30:10.236726468 +0000 UTC m=+3.150105516" lastFinishedPulling="2026-05-21 10:30:28.565537854 +0000 UTC m=+21.478916908" observedRunningTime="2026-05-21 10:30:29.746790163 +0000 UTC m=+22.660169232" watchObservedRunningTime="2026-05-21 10:30:29.763356553 +0000 UTC m=+22.676735622" May 21 10:30:29.803101 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:29.803055 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-ml6nr" podStartSLOduration=8.437512208 podStartE2EDuration="22.803040651s" podCreationTimestamp="2026-05-21 10:30:07 +0000 UTC" firstStartedPulling="2026-05-21 10:30:10.230232658 +0000 UTC m=+3.143611709" lastFinishedPulling="2026-05-21 10:30:24.595760894 +0000 UTC m=+17.509140152" observedRunningTime="2026-05-21 10:30:29.803029271 +0000 UTC m=+22.716408341" watchObservedRunningTime="2026-05-21 10:30:29.803040651 +0000 UTC m=+22.716419734" May 21 10:30:29.833010 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:29.832968 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-g4lt2" podStartSLOduration=4.463651539 podStartE2EDuration="22.832954783s" podCreationTimestamp="2026-05-21 10:30:07 +0000 UTC" firstStartedPulling="2026-05-21 10:30:10.225234448 +0000 UTC m=+3.138613497" lastFinishedPulling="2026-05-21 10:30:28.594537692 +0000 UTC m=+21.507916741" observedRunningTime="2026-05-21 10:30:29.832390619 +0000 UTC m=+22.745769701" watchObservedRunningTime="2026-05-21 10:30:29.832954783 +0000 UTC m=+22.746333844" May 21 10:30:29.851277 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:29.851241 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-n9txr" podStartSLOduration=8.48653131 podStartE2EDuration="22.85122784s" podCreationTimestamp="2026-05-21 10:30:07 +0000 UTC" firstStartedPulling="2026-05-21 10:30:10.231066299 +0000 UTC m=+3.144445360" lastFinishedPulling="2026-05-21 10:30:24.595762821 +0000 UTC m=+17.509141890" observedRunningTime="2026-05-21 10:30:29.85096488 +0000 UTC m=+22.764343947" watchObservedRunningTime="2026-05-21 10:30:29.85122784 +0000 UTC m=+22.764606942" May 21 10:30:29.861698 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:29.861499 2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 21 10:30:30.567276 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:30.567083 2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-21T10:30:29.861669691Z","UUID":"60b31b27-4928-4f36-9d57-2c881e4d7305","Handler":null,"Name":"","Endpoint":""} May 21 10:30:30.570333 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:30.570299 2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 21 10:30:30.570333 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:30.570328 2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 21 10:30:30.631829 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:30.631796 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqqfc" May 21 10:30:30.632159 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:30.631953 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqqfc" podUID="03cc5e6e-7e76-47ec-80e8-795d0a71d2f8" May 21 10:30:30.740900 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:30.740868 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtl4g" event={"ID":"f4bb88d2-7c86-4029-a362-fa3f5c3650cb","Type":"ContainerStarted","Data":"34ba90851e3e454eb13d8e5c47d3466dc7ee3398cb00620bfcb62190bd5092de"} May 21 10:30:30.740900 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:30.740904 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtl4g" event={"ID":"f4bb88d2-7c86-4029-a362-fa3f5c3650cb","Type":"ContainerStarted","Data":"0385bd253ff6834b5b44974c7913af997e650e225fe3f9acc2ed3b5e3d11d86b"} May 21 10:30:30.742387 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:30.742363 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5r5hl" event={"ID":"1c7a9fbd-e4f0-4c8f-b533-fc8a4a1911f0","Type":"ContainerStarted","Data":"231de45882ab34f2dbf7567cbd9930f17dc3b149f93734428b02c07c356b4cc8"} May 21 10:30:30.762025 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:30.761982 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtl4g" podStartSLOduration=3.395772954 podStartE2EDuration="23.761970437s" podCreationTimestamp="2026-05-21 10:30:07 +0000 UTC" firstStartedPulling="2026-05-21 10:30:10.228665415 +0000 UTC m=+3.142044464" lastFinishedPulling="2026-05-21 10:30:30.594862896 +0000 UTC m=+23.508241947" observedRunningTime="2026-05-21 10:30:30.761849984 +0000 UTC m=+23.675229054" watchObservedRunningTime="2026-05-21 10:30:30.761970437 +0000 UTC m=+23.675349507" May 21 10:30:30.777768 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:30.777724 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-5r5hl" podStartSLOduration=5.437828834 podStartE2EDuration="23.777710173s" podCreationTimestamp="2026-05-21 10:30:07 +0000 UTC" firstStartedPulling="2026-05-21 10:30:10.223864413 +0000 UTC m=+3.137243461" lastFinishedPulling="2026-05-21 10:30:28.56374574 +0000 UTC m=+21.477124800" observedRunningTime="2026-05-21 10:30:30.777470714 +0000 UTC m=+23.690849786" watchObservedRunningTime="2026-05-21 10:30:30.777710173 +0000 UTC m=+23.691089243" May 21 10:30:31.631643 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:31.631608 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flzlz" May 21 10:30:31.631863 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:31.631624 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8f7qb" May 21 10:30:31.631863 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:31.631756 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-flzlz" podUID="35d22f25-59d6-48b0-a885-ddbcfcdf5cb0" May 21 10:30:31.632028 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:31.631858 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8f7qb" podUID="c5972469-00d2-4517-ba14-6672a94436d7" May 21 10:30:31.747745 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:31.747651 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" event={"ID":"24a7e4d2-b048-41e9-8bc4-9993aed09fd4","Type":"ContainerStarted","Data":"26c006a9407857ebeeeafc3c05533f2b1b5f45f15c026100ea045c327bab0f86"} May 21 10:30:32.631629 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:32.631593 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqqfc" May 21 10:30:32.631813 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:32.631703 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqqfc" podUID="03cc5e6e-7e76-47ec-80e8-795d0a71d2f8" May 21 10:30:33.631596 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:33.631564 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8f7qb" May 21 10:30:33.632102 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:33.631678 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8f7qb" podUID="c5972469-00d2-4517-ba14-6672a94436d7" May 21 10:30:33.632102 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:33.631730 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flzlz" May 21 10:30:33.632102 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:33.631829 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-flzlz" podUID="35d22f25-59d6-48b0-a885-ddbcfcdf5cb0" May 21 10:30:33.756358 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:33.753990 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" event={"ID":"24a7e4d2-b048-41e9-8bc4-9993aed09fd4","Type":"ContainerStarted","Data":"302022ccef96b77121d771f51c190295b442925535ebb5d123a3c0351e2c3878"} May 21 10:30:33.756358 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:33.754598 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" May 21 10:30:33.756358 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:33.754637 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" May 21 10:30:33.756358 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:33.754652 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" May 21 10:30:33.771510 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:33.771480 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" May 21 10:30:33.772299 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:33.772076 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" May 21 10:30:33.786142 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:33.785138 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" podStartSLOduration=8.200937247 podStartE2EDuration="26.785123532s" podCreationTimestamp="2026-05-21 10:30:07 +0000 UTC" firstStartedPulling="2026-05-21 10:30:10.237691121 +0000 UTC m=+3.151070172" lastFinishedPulling="2026-05-21 10:30:28.821877406 +0000 UTC m=+21.735256457" observedRunningTime="2026-05-21 10:30:33.784853278 +0000 UTC m=+26.698232373" watchObservedRunningTime="2026-05-21 10:30:33.785123532 +0000 UTC m=+26.698502605" May 21 10:30:34.003345 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:34.003314 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-n9txr" May 21 10:30:34.003870 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:34.003855 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-n9txr" May 21 10:30:34.631557 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:34.631525 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqqfc" May 21 10:30:34.631728 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:34.631621 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqqfc" podUID="03cc5e6e-7e76-47ec-80e8-795d0a71d2f8" May 21 10:30:34.757285 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:34.757254 2565 generic.go:358] "Generic (PLEG): container finished" podID="762ee6cc-7e36-4827-9350-d26f6580b8db" containerID="c77102091a342a28312907dcff1f94e8eca8297894276ed6dbf11d56d7c8b5c1" exitCode=0 May 21 10:30:34.757417 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:34.757339 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mk4n7" event={"ID":"762ee6cc-7e36-4827-9350-d26f6580b8db","Type":"ContainerDied","Data":"c77102091a342a28312907dcff1f94e8eca8297894276ed6dbf11d56d7c8b5c1"} May 21 10:30:35.632267 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:35.632197 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flzlz" May 21 10:30:35.632267 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:35.632217 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8f7qb" May 21 10:30:35.632666 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:35.632334 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-flzlz" podUID="35d22f25-59d6-48b0-a885-ddbcfcdf5cb0" May 21 10:30:35.632666 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:35.632484 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8f7qb" podUID="c5972469-00d2-4517-ba14-6672a94436d7" May 21 10:30:35.761140 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:35.760964 2565 generic.go:358] "Generic (PLEG): container finished" podID="762ee6cc-7e36-4827-9350-d26f6580b8db" containerID="e5c9f49d279dcde5ac2a8a27145c79949d3057e8dffc12b21547298d59d9928c" exitCode=0 May 21 10:30:35.761256 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:35.761035 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mk4n7" event={"ID":"762ee6cc-7e36-4827-9350-d26f6580b8db","Type":"ContainerDied","Data":"e5c9f49d279dcde5ac2a8a27145c79949d3057e8dffc12b21547298d59d9928c"} May 21 10:30:35.860097 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:35.860018 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-flzlz"] May 21 10:30:35.860234 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:35.860152 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flzlz" May 21 10:30:35.860288 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:35.860262 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-flzlz" podUID="35d22f25-59d6-48b0-a885-ddbcfcdf5cb0" May 21 10:30:35.862556 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:35.862534 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8f7qb"] May 21 10:30:35.862672 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:35.862636 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8f7qb" May 21 10:30:35.862749 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:35.862724 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8f7qb" podUID="c5972469-00d2-4517-ba14-6672a94436d7" May 21 10:30:35.874289 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:35.874269 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pqqfc"] May 21 10:30:35.874378 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:35.874349 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqqfc" May 21 10:30:35.874432 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:35.874416 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqqfc" podUID="03cc5e6e-7e76-47ec-80e8-795d0a71d2f8" May 21 10:30:36.765209 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:36.765119 2565 generic.go:358] "Generic (PLEG): container finished" podID="762ee6cc-7e36-4827-9350-d26f6580b8db" containerID="f4acf5aa573359ea8b937779e6f0a07e1794f982b2723ab5032285c26799f073" exitCode=0 May 21 10:30:36.765209 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:36.765160 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mk4n7" event={"ID":"762ee6cc-7e36-4827-9350-d26f6580b8db","Type":"ContainerDied","Data":"f4acf5aa573359ea8b937779e6f0a07e1794f982b2723ab5032285c26799f073"} May 21 10:30:37.275467 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:37.275432 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-n9txr" May 21 10:30:37.275635 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:37.275564 2565 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" May 21 10:30:37.276156 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:37.276136 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-n9txr" May 21 10:30:37.636894 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:37.636865 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqqfc" May 21 10:30:37.637159 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:37.637139 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8f7qb" May 21 10:30:37.637259 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:37.637158 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flzlz" May 21 10:30:37.637452 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:37.637427 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8f7qb" podUID="c5972469-00d2-4517-ba14-6672a94436d7" May 21 10:30:37.637575 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:37.637495 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-flzlz" podUID="35d22f25-59d6-48b0-a885-ddbcfcdf5cb0" May 21 10:30:37.638565 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:37.637624 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqqfc" podUID="03cc5e6e-7e76-47ec-80e8-795d0a71d2f8" May 21 10:30:39.632004 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:39.631975 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8f7qb" May 21 10:30:39.632784 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:39.631975 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flzlz" May 21 10:30:39.632784 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:39.632094 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8f7qb" podUID="c5972469-00d2-4517-ba14-6672a94436d7" May 21 10:30:39.632784 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:39.632102 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqqfc" May 21 10:30:39.632784 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:39.632172 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-flzlz" podUID="35d22f25-59d6-48b0-a885-ddbcfcdf5cb0" May 21 10:30:39.632784 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:39.632232 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqqfc" podUID="03cc5e6e-7e76-47ec-80e8-795d0a71d2f8" May 21 10:30:41.350217 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:41.350172 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35d22f25-59d6-48b0-a885-ddbcfcdf5cb0-metrics-certs\") pod \"network-metrics-daemon-flzlz\" (UID: \"35d22f25-59d6-48b0-a885-ddbcfcdf5cb0\") " pod="openshift-multus/network-metrics-daemon-flzlz" May 21 10:30:41.350666 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:41.350302 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 10:30:41.350666 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:41.350366 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35d22f25-59d6-48b0-a885-ddbcfcdf5cb0-metrics-certs podName:35d22f25-59d6-48b0-a885-ddbcfcdf5cb0 nodeName:}" failed. No retries permitted until 2026-05-21 10:31:13.350350713 +0000 UTC m=+66.263729761 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/35d22f25-59d6-48b0-a885-ddbcfcdf5cb0-metrics-certs") pod "network-metrics-daemon-flzlz" (UID: "35d22f25-59d6-48b0-a885-ddbcfcdf5cb0") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 10:30:41.450907 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:41.450876 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vd7xq\" (UniqueName: \"kubernetes.io/projected/03cc5e6e-7e76-47ec-80e8-795d0a71d2f8-kube-api-access-vd7xq\") pod \"network-check-target-pqqfc\" (UID: \"03cc5e6e-7e76-47ec-80e8-795d0a71d2f8\") " pod="openshift-network-diagnostics/network-check-target-pqqfc" May 21 10:30:41.451085 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:41.451039 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 10:30:41.451085 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:41.451056 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 10:30:41.451085 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:41.451065 2565 projected.go:194] Error preparing data for projected volume kube-api-access-vd7xq for pod openshift-network-diagnostics/network-check-target-pqqfc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 10:30:41.451190 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:41.451114 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03cc5e6e-7e76-47ec-80e8-795d0a71d2f8-kube-api-access-vd7xq podName:03cc5e6e-7e76-47ec-80e8-795d0a71d2f8 nodeName:}" failed. No retries permitted until 2026-05-21 10:31:13.45110143 +0000 UTC m=+66.364480483 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vd7xq" (UniqueName: "kubernetes.io/projected/03cc5e6e-7e76-47ec-80e8-795d0a71d2f8-kube-api-access-vd7xq") pod "network-check-target-pqqfc" (UID: "03cc5e6e-7e76-47ec-80e8-795d0a71d2f8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 10:30:41.631718 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:41.631635 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8f7qb" May 21 10:30:41.631718 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:41.631659 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flzlz" May 21 10:30:41.631924 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:41.631742 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8f7qb" podUID="c5972469-00d2-4517-ba14-6672a94436d7" May 21 10:30:41.631924 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:41.631634 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqqfc" May 21 10:30:41.631924 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:41.631841 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-flzlz" podUID="35d22f25-59d6-48b0-a885-ddbcfcdf5cb0" May 21 10:30:41.631924 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:41.631910 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqqfc" podUID="03cc5e6e-7e76-47ec-80e8-795d0a71d2f8" May 21 10:30:41.853439 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:41.853404 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c5972469-00d2-4517-ba14-6672a94436d7-original-pull-secret\") pod \"global-pull-secret-syncer-8f7qb\" (UID: \"c5972469-00d2-4517-ba14-6672a94436d7\") " pod="kube-system/global-pull-secret-syncer-8f7qb" May 21 10:30:41.853615 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:41.853557 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 10:30:41.853681 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:41.853629 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5972469-00d2-4517-ba14-6672a94436d7-original-pull-secret podName:c5972469-00d2-4517-ba14-6672a94436d7 nodeName:}" failed. No retries permitted until 2026-05-21 10:31:13.85360938 +0000 UTC m=+66.766988435 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c5972469-00d2-4517-ba14-6672a94436d7-original-pull-secret") pod "global-pull-secret-syncer-8f7qb" (UID: "c5972469-00d2-4517-ba14-6672a94436d7") : object "kube-system"/"original-pull-secret" not registered May 21 10:30:42.413653 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:42.413582 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-214.ec2.internal" event="NodeReady" May 21 10:30:42.414008 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:42.413715 2565 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 21 10:30:42.481247 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:42.481217 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-2z5ml"] May 21 10:30:42.505885 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:42.505854 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7zn72"] May 21 10:30:42.506058 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:42.506025 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2z5ml" May 21 10:30:42.511268 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:42.510605 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 21 10:30:42.511268 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:42.510910 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-j2794\"" May 21 10:30:42.511268 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:42.511075 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 21 10:30:42.521819 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:42.521772 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2z5ml"] May 21 10:30:42.521819 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:42.521804 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7zn72"] May 21 10:30:42.522028 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:42.521927 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7zn72" May 21 10:30:42.524468 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:42.524448 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4ntqv\"" May 21 10:30:42.525093 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:42.525074 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 21 10:30:42.525204 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:42.525116 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 21 10:30:42.525204 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:42.525126 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 21 10:30:42.660838 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:42.660788 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlbht\" (UniqueName: \"kubernetes.io/projected/22843d5b-6950-4f00-bffa-8a509e8009a0-kube-api-access-jlbht\") pod \"ingress-canary-7zn72\" (UID: \"22843d5b-6950-4f00-bffa-8a509e8009a0\") " pod="openshift-ingress-canary/ingress-canary-7zn72" May 21 10:30:42.661059 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:42.660861 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/136577a1-cdb0-4499-8f87-5c04dbd94f14-metrics-tls\") pod \"dns-default-2z5ml\" (UID: \"136577a1-cdb0-4499-8f87-5c04dbd94f14\") " pod="openshift-dns/dns-default-2z5ml" May 21 10:30:42.661059 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:42.660959 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/22843d5b-6950-4f00-bffa-8a509e8009a0-cert\") pod \"ingress-canary-7zn72\" (UID: \"22843d5b-6950-4f00-bffa-8a509e8009a0\") " pod="openshift-ingress-canary/ingress-canary-7zn72" May 21 10:30:42.661059 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:42.661013 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/136577a1-cdb0-4499-8f87-5c04dbd94f14-config-volume\") pod \"dns-default-2z5ml\" (UID: \"136577a1-cdb0-4499-8f87-5c04dbd94f14\") " pod="openshift-dns/dns-default-2z5ml" May 21 10:30:42.661059 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:42.661041 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/136577a1-cdb0-4499-8f87-5c04dbd94f14-tmp-dir\") pod \"dns-default-2z5ml\" (UID: \"136577a1-cdb0-4499-8f87-5c04dbd94f14\") " pod="openshift-dns/dns-default-2z5ml" May 21 10:30:42.661274 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:42.661075 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cb4h\" (UniqueName: \"kubernetes.io/projected/136577a1-cdb0-4499-8f87-5c04dbd94f14-kube-api-access-2cb4h\") pod \"dns-default-2z5ml\" (UID: \"136577a1-cdb0-4499-8f87-5c04dbd94f14\") " pod="openshift-dns/dns-default-2z5ml" May 21 10:30:42.762110 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:42.762036 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/136577a1-cdb0-4499-8f87-5c04dbd94f14-metrics-tls\") pod \"dns-default-2z5ml\" (UID: \"136577a1-cdb0-4499-8f87-5c04dbd94f14\") " pod="openshift-dns/dns-default-2z5ml" May 21 10:30:42.762110 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:42.762086 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/22843d5b-6950-4f00-bffa-8a509e8009a0-cert\") pod \"ingress-canary-7zn72\" (UID: \"22843d5b-6950-4f00-bffa-8a509e8009a0\") " pod="openshift-ingress-canary/ingress-canary-7zn72" May 21 10:30:42.762330 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:42.762190 2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 10:30:42.762330 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:42.762200 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 10:30:42.762330 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:42.762243 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22843d5b-6950-4f00-bffa-8a509e8009a0-cert podName:22843d5b-6950-4f00-bffa-8a509e8009a0 nodeName:}" failed. No retries permitted until 2026-05-21 10:30:43.262224328 +0000 UTC m=+36.175603376 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/22843d5b-6950-4f00-bffa-8a509e8009a0-cert") pod "ingress-canary-7zn72" (UID: "22843d5b-6950-4f00-bffa-8a509e8009a0") : secret "canary-serving-cert" not found May 21 10:30:42.762330 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:42.762261 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/136577a1-cdb0-4499-8f87-5c04dbd94f14-config-volume\") pod \"dns-default-2z5ml\" (UID: \"136577a1-cdb0-4499-8f87-5c04dbd94f14\") " pod="openshift-dns/dns-default-2z5ml" May 21 10:30:42.762330 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:42.762271 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/136577a1-cdb0-4499-8f87-5c04dbd94f14-metrics-tls podName:136577a1-cdb0-4499-8f87-5c04dbd94f14 nodeName:}" failed. No retries permitted until 2026-05-21 10:30:43.262253838 +0000 UTC m=+36.175632901 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/136577a1-cdb0-4499-8f87-5c04dbd94f14-metrics-tls") pod "dns-default-2z5ml" (UID: "136577a1-cdb0-4499-8f87-5c04dbd94f14") : secret "dns-default-metrics-tls" not found May 21 10:30:42.762330 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:42.762307 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/136577a1-cdb0-4499-8f87-5c04dbd94f14-tmp-dir\") pod \"dns-default-2z5ml\" (UID: \"136577a1-cdb0-4499-8f87-5c04dbd94f14\") " pod="openshift-dns/dns-default-2z5ml" May 21 10:30:42.762623 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:42.762345 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2cb4h\" (UniqueName: \"kubernetes.io/projected/136577a1-cdb0-4499-8f87-5c04dbd94f14-kube-api-access-2cb4h\") pod \"dns-default-2z5ml\" (UID: \"136577a1-cdb0-4499-8f87-5c04dbd94f14\") " pod="openshift-dns/dns-default-2z5ml" May 21 10:30:42.762623 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:42.762422 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jlbht\" (UniqueName: \"kubernetes.io/projected/22843d5b-6950-4f00-bffa-8a509e8009a0-kube-api-access-jlbht\") pod \"ingress-canary-7zn72\" (UID: \"22843d5b-6950-4f00-bffa-8a509e8009a0\") " pod="openshift-ingress-canary/ingress-canary-7zn72" May 21 10:30:42.762815 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:42.762790 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/136577a1-cdb0-4499-8f87-5c04dbd94f14-tmp-dir\") pod \"dns-default-2z5ml\" (UID: \"136577a1-cdb0-4499-8f87-5c04dbd94f14\") " pod="openshift-dns/dns-default-2z5ml" May 21 10:30:42.762897 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:42.762834 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/136577a1-cdb0-4499-8f87-5c04dbd94f14-config-volume\") pod \"dns-default-2z5ml\" (UID: \"136577a1-cdb0-4499-8f87-5c04dbd94f14\") " pod="openshift-dns/dns-default-2z5ml" May 21 10:30:42.774922 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:42.774755 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cb4h\" (UniqueName: \"kubernetes.io/projected/136577a1-cdb0-4499-8f87-5c04dbd94f14-kube-api-access-2cb4h\") pod \"dns-default-2z5ml\" (UID: \"136577a1-cdb0-4499-8f87-5c04dbd94f14\") " pod="openshift-dns/dns-default-2z5ml" May 21 10:30:42.775060 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:42.774822 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlbht\" (UniqueName: \"kubernetes.io/projected/22843d5b-6950-4f00-bffa-8a509e8009a0-kube-api-access-jlbht\") pod \"ingress-canary-7zn72\" (UID: \"22843d5b-6950-4f00-bffa-8a509e8009a0\") " pod="openshift-ingress-canary/ingress-canary-7zn72" May 21 10:30:43.266681 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:43.266645 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/136577a1-cdb0-4499-8f87-5c04dbd94f14-metrics-tls\") pod \"dns-default-2z5ml\" (UID: \"136577a1-cdb0-4499-8f87-5c04dbd94f14\") " pod="openshift-dns/dns-default-2z5ml" May 21 10:30:43.266875 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:43.266693 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/22843d5b-6950-4f00-bffa-8a509e8009a0-cert\") pod \"ingress-canary-7zn72\" (UID: \"22843d5b-6950-4f00-bffa-8a509e8009a0\") " pod="openshift-ingress-canary/ingress-canary-7zn72" May 21 10:30:43.266875 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:43.266786 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 10:30:43.266875 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:43.266809 2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 10:30:43.266875 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:43.266865 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/136577a1-cdb0-4499-8f87-5c04dbd94f14-metrics-tls podName:136577a1-cdb0-4499-8f87-5c04dbd94f14 nodeName:}" failed. No retries permitted until 2026-05-21 10:30:44.266843793 +0000 UTC m=+37.180222853 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/136577a1-cdb0-4499-8f87-5c04dbd94f14-metrics-tls") pod "dns-default-2z5ml" (UID: "136577a1-cdb0-4499-8f87-5c04dbd94f14") : secret "dns-default-metrics-tls" not found May 21 10:30:43.267087 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:43.266885 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22843d5b-6950-4f00-bffa-8a509e8009a0-cert podName:22843d5b-6950-4f00-bffa-8a509e8009a0 nodeName:}" failed. No retries permitted until 2026-05-21 10:30:44.266876126 +0000 UTC m=+37.180255174 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/22843d5b-6950-4f00-bffa-8a509e8009a0-cert") pod "ingress-canary-7zn72" (UID: "22843d5b-6950-4f00-bffa-8a509e8009a0") : secret "canary-serving-cert" not found May 21 10:30:43.632214 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:43.632132 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flzlz" May 21 10:30:43.632653 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:43.632132 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqqfc" May 21 10:30:43.632653 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:43.632297 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8f7qb" May 21 10:30:43.638921 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:43.638896 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 10:30:43.639516 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:43.639488 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hwkcp\"" May 21 10:30:43.640021 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:43.640000 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 21 10:30:43.640132 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:43.640040 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 21 10:30:43.640968 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:43.640693 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5vwxr\"" May 21 10:30:43.640968 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:43.640929 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 21 10:30:44.277349 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:44.277315 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/136577a1-cdb0-4499-8f87-5c04dbd94f14-metrics-tls\") pod \"dns-default-2z5ml\" (UID: \"136577a1-cdb0-4499-8f87-5c04dbd94f14\") " pod="openshift-dns/dns-default-2z5ml" May 21 10:30:44.277556 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:44.277364 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/22843d5b-6950-4f00-bffa-8a509e8009a0-cert\") pod \"ingress-canary-7zn72\" (UID: \"22843d5b-6950-4f00-bffa-8a509e8009a0\") " pod="openshift-ingress-canary/ingress-canary-7zn72" May 21 10:30:44.277556 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:44.277495 2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 10:30:44.277556 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:44.277551 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22843d5b-6950-4f00-bffa-8a509e8009a0-cert podName:22843d5b-6950-4f00-bffa-8a509e8009a0 nodeName:}" failed. No retries permitted until 2026-05-21 10:30:46.277537715 +0000 UTC m=+39.190916763 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/22843d5b-6950-4f00-bffa-8a509e8009a0-cert") pod "ingress-canary-7zn72" (UID: "22843d5b-6950-4f00-bffa-8a509e8009a0") : secret "canary-serving-cert" not found May 21 10:30:44.277696 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:44.277494 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 10:30:44.277696 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:44.277657 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/136577a1-cdb0-4499-8f87-5c04dbd94f14-metrics-tls podName:136577a1-cdb0-4499-8f87-5c04dbd94f14 nodeName:}" failed. No retries permitted until 2026-05-21 10:30:46.277639436 +0000 UTC m=+39.191018492 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/136577a1-cdb0-4499-8f87-5c04dbd94f14-metrics-tls") pod "dns-default-2z5ml" (UID: "136577a1-cdb0-4499-8f87-5c04dbd94f14") : secret "dns-default-metrics-tls" not found May 21 10:30:45.783095 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:45.783063 2565 generic.go:358] "Generic (PLEG): container finished" podID="762ee6cc-7e36-4827-9350-d26f6580b8db" containerID="1389c1b1f7deb611d729e6bf2b834fe2a39cd531c00e356db7fa8c3fe42dd0d2" exitCode=0 May 21 10:30:45.783480 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:45.783117 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mk4n7" event={"ID":"762ee6cc-7e36-4827-9350-d26f6580b8db","Type":"ContainerDied","Data":"1389c1b1f7deb611d729e6bf2b834fe2a39cd531c00e356db7fa8c3fe42dd0d2"} May 21 10:30:46.293058 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:46.293015 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/136577a1-cdb0-4499-8f87-5c04dbd94f14-metrics-tls\") pod \"dns-default-2z5ml\" (UID: \"136577a1-cdb0-4499-8f87-5c04dbd94f14\") " pod="openshift-dns/dns-default-2z5ml" May 21 10:30:46.293058 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:46.293060 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/22843d5b-6950-4f00-bffa-8a509e8009a0-cert\") pod \"ingress-canary-7zn72\" (UID: \"22843d5b-6950-4f00-bffa-8a509e8009a0\") " pod="openshift-ingress-canary/ingress-canary-7zn72" May 21 10:30:46.293266 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:46.293149 2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 10:30:46.293266 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:46.293155 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 10:30:46.293266 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:46.293208 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22843d5b-6950-4f00-bffa-8a509e8009a0-cert podName:22843d5b-6950-4f00-bffa-8a509e8009a0 nodeName:}" failed. No retries permitted until 2026-05-21 10:30:50.293191441 +0000 UTC m=+43.206570490 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/22843d5b-6950-4f00-bffa-8a509e8009a0-cert") pod "ingress-canary-7zn72" (UID: "22843d5b-6950-4f00-bffa-8a509e8009a0") : secret "canary-serving-cert" not found May 21 10:30:46.293266 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:46.293223 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/136577a1-cdb0-4499-8f87-5c04dbd94f14-metrics-tls podName:136577a1-cdb0-4499-8f87-5c04dbd94f14 nodeName:}" failed. No retries permitted until 2026-05-21 10:30:50.293217054 +0000 UTC m=+43.206596101 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/136577a1-cdb0-4499-8f87-5c04dbd94f14-metrics-tls") pod "dns-default-2z5ml" (UID: "136577a1-cdb0-4499-8f87-5c04dbd94f14") : secret "dns-default-metrics-tls" not found May 21 10:30:46.787395 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:46.787363 2565 generic.go:358] "Generic (PLEG): container finished" podID="762ee6cc-7e36-4827-9350-d26f6580b8db" containerID="4eab6e48e5c0affa0affed28fc26ec311bbab85143fc9a8a4ebac036bf833de8" exitCode=0 May 21 10:30:46.787756 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:46.787416 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mk4n7" event={"ID":"762ee6cc-7e36-4827-9350-d26f6580b8db","Type":"ContainerDied","Data":"4eab6e48e5c0affa0affed28fc26ec311bbab85143fc9a8a4ebac036bf833de8"} May 21 10:30:47.791862 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:47.791827 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mk4n7" event={"ID":"762ee6cc-7e36-4827-9350-d26f6580b8db","Type":"ContainerStarted","Data":"eb1dbc6278a83eafa97bc1e1e4ae449f550735bbe8c10609e3c585b0a3e7391b"} May 21 10:30:47.834215 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:47.834172 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-mk4n7" podStartSLOduration=6.11837497 podStartE2EDuration="40.834159732s" podCreationTimestamp="2026-05-21 10:30:07 +0000 UTC" firstStartedPulling="2026-05-21 10:30:10.230079294 +0000 UTC m=+3.143458351" lastFinishedPulling="2026-05-21 10:30:44.945864066 +0000 UTC m=+37.859243113" observedRunningTime="2026-05-21 10:30:47.830852101 +0000 UTC m=+40.744231196" watchObservedRunningTime="2026-05-21 10:30:47.834159732 +0000 UTC m=+40.747538801" May 21 10:30:48.316909 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:48.316877 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f655ccc44-lvng6"] May 21 10:30:48.340964 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:48.340927 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f655ccc44-lvng6"] May 21 10:30:48.341095 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:48.341050 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f655ccc44-lvng6" May 21 10:30:48.344867 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:48.344846 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" May 21 10:30:48.345012 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:48.344873 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" May 21 10:30:48.345192 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:48.345177 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" May 21 10:30:48.345235 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:48.345204 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" May 21 10:30:48.345276 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:48.345178 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-vz8vg\"" May 21 10:30:48.408592 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:48.408558 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/eda5a125-6b56-4dee-839c-6441bfe27a49-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6f655ccc44-lvng6\" (UID: \"eda5a125-6b56-4dee-839c-6441bfe27a49\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f655ccc44-lvng6" May 21 10:30:48.408769 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:48.408653 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkllm\" (UniqueName: \"kubernetes.io/projected/eda5a125-6b56-4dee-839c-6441bfe27a49-kube-api-access-fkllm\") pod \"managed-serviceaccount-addon-agent-6f655ccc44-lvng6\" (UID: \"eda5a125-6b56-4dee-839c-6441bfe27a49\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f655ccc44-lvng6" May 21 10:30:48.509338 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:48.509298 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fkllm\" (UniqueName: \"kubernetes.io/projected/eda5a125-6b56-4dee-839c-6441bfe27a49-kube-api-access-fkllm\") pod \"managed-serviceaccount-addon-agent-6f655ccc44-lvng6\" (UID: \"eda5a125-6b56-4dee-839c-6441bfe27a49\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f655ccc44-lvng6" May 21 10:30:48.509488 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:48.509388 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/eda5a125-6b56-4dee-839c-6441bfe27a49-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6f655ccc44-lvng6\" (UID: \"eda5a125-6b56-4dee-839c-6441bfe27a49\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f655ccc44-lvng6" May 21 10:30:48.512556 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:48.512537 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/eda5a125-6b56-4dee-839c-6441bfe27a49-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6f655ccc44-lvng6\" (UID: \"eda5a125-6b56-4dee-839c-6441bfe27a49\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f655ccc44-lvng6" May 21 10:30:48.518954 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:48.518910 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkllm\" (UniqueName: \"kubernetes.io/projected/eda5a125-6b56-4dee-839c-6441bfe27a49-kube-api-access-fkllm\") pod \"managed-serviceaccount-addon-agent-6f655ccc44-lvng6\" (UID: \"eda5a125-6b56-4dee-839c-6441bfe27a49\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f655ccc44-lvng6" May 21 10:30:48.664614 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:48.664521 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f655ccc44-lvng6" May 21 10:30:48.865325 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:48.865290 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f655ccc44-lvng6"] May 21 10:30:48.870427 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:30:48.870392 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeda5a125_6b56_4dee_839c_6441bfe27a49.slice/crio-dd8a141d5aad73a63afc3a37c28f99164fa38a3e96646f9a1d171c958b2a0e07 WatchSource:0}: Error finding container dd8a141d5aad73a63afc3a37c28f99164fa38a3e96646f9a1d171c958b2a0e07: Status 404 returned error can't find the container with id dd8a141d5aad73a63afc3a37c28f99164fa38a3e96646f9a1d171c958b2a0e07 May 21 10:30:49.796839 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:49.796801 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f655ccc44-lvng6" event={"ID":"eda5a125-6b56-4dee-839c-6441bfe27a49","Type":"ContainerStarted","Data":"dd8a141d5aad73a63afc3a37c28f99164fa38a3e96646f9a1d171c958b2a0e07"} May 21 10:30:50.321024 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:50.320969 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/136577a1-cdb0-4499-8f87-5c04dbd94f14-metrics-tls\") pod \"dns-default-2z5ml\" (UID: \"136577a1-cdb0-4499-8f87-5c04dbd94f14\") " pod="openshift-dns/dns-default-2z5ml" May 21 10:30:50.321510 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:50.321030 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/22843d5b-6950-4f00-bffa-8a509e8009a0-cert\") pod \"ingress-canary-7zn72\" (UID: \"22843d5b-6950-4f00-bffa-8a509e8009a0\") " pod="openshift-ingress-canary/ingress-canary-7zn72" May 21 10:30:50.321510 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:50.321145 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 10:30:50.321510 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:50.321191 2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 10:30:50.321510 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:50.321228 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/136577a1-cdb0-4499-8f87-5c04dbd94f14-metrics-tls podName:136577a1-cdb0-4499-8f87-5c04dbd94f14 nodeName:}" failed. No retries permitted until 2026-05-21 10:30:58.321205786 +0000 UTC m=+51.234584839 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/136577a1-cdb0-4499-8f87-5c04dbd94f14-metrics-tls") pod "dns-default-2z5ml" (UID: "136577a1-cdb0-4499-8f87-5c04dbd94f14") : secret "dns-default-metrics-tls" not found May 21 10:30:50.321510 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:50.321270 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22843d5b-6950-4f00-bffa-8a509e8009a0-cert podName:22843d5b-6950-4f00-bffa-8a509e8009a0 nodeName:}" failed. No retries permitted until 2026-05-21 10:30:58.321252655 +0000 UTC m=+51.234631709 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/22843d5b-6950-4f00-bffa-8a509e8009a0-cert") pod "ingress-canary-7zn72" (UID: "22843d5b-6950-4f00-bffa-8a509e8009a0") : secret "canary-serving-cert" not found May 21 10:30:52.804265 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:52.804179 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f655ccc44-lvng6" event={"ID":"eda5a125-6b56-4dee-839c-6441bfe27a49","Type":"ContainerStarted","Data":"87ef1e1bdd3a631b01aed81a50c8d00c67195fb0279b2375be095e43f14a3306"} May 21 10:30:52.823085 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:52.823039 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f655ccc44-lvng6" podStartSLOduration=1.156780174 podStartE2EDuration="4.823025504s" podCreationTimestamp="2026-05-21 10:30:48 +0000 UTC" firstStartedPulling="2026-05-21 10:30:48.872374911 +0000 UTC m=+41.785753961" lastFinishedPulling="2026-05-21 10:30:52.538620243 +0000 UTC m=+45.451999291" observedRunningTime="2026-05-21 10:30:52.822988342 +0000 UTC m=+45.736367413" watchObservedRunningTime="2026-05-21 10:30:52.823025504 +0000 UTC m=+45.736404573" May 21 10:30:58.379884 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:58.379845 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/136577a1-cdb0-4499-8f87-5c04dbd94f14-metrics-tls\") pod \"dns-default-2z5ml\" (UID: \"136577a1-cdb0-4499-8f87-5c04dbd94f14\") " pod="openshift-dns/dns-default-2z5ml" May 21 10:30:58.379884 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:30:58.379887 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/22843d5b-6950-4f00-bffa-8a509e8009a0-cert\") pod \"ingress-canary-7zn72\" (UID: \"22843d5b-6950-4f00-bffa-8a509e8009a0\") " pod="openshift-ingress-canary/ingress-canary-7zn72" May 21 10:30:58.380409 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:58.379991 2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 10:30:58.380409 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:58.380000 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 10:30:58.380409 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:58.380044 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22843d5b-6950-4f00-bffa-8a509e8009a0-cert podName:22843d5b-6950-4f00-bffa-8a509e8009a0 nodeName:}" failed. No retries permitted until 2026-05-21 10:31:14.380029673 +0000 UTC m=+67.293408721 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/22843d5b-6950-4f00-bffa-8a509e8009a0-cert") pod "ingress-canary-7zn72" (UID: "22843d5b-6950-4f00-bffa-8a509e8009a0") : secret "canary-serving-cert" not found May 21 10:30:58.380409 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:30:58.380063 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/136577a1-cdb0-4499-8f87-5c04dbd94f14-metrics-tls podName:136577a1-cdb0-4499-8f87-5c04dbd94f14 nodeName:}" failed. No retries permitted until 2026-05-21 10:31:14.380049641 +0000 UTC m=+67.293428688 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/136577a1-cdb0-4499-8f87-5c04dbd94f14-metrics-tls") pod "dns-default-2z5ml" (UID: "136577a1-cdb0-4499-8f87-5c04dbd94f14") : secret "dns-default-metrics-tls" not found May 21 10:31:05.775721 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:31:05.775688 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fhjht" May 21 10:31:13.384921 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:31:13.384880 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35d22f25-59d6-48b0-a885-ddbcfcdf5cb0-metrics-certs\") pod \"network-metrics-daemon-flzlz\" (UID: \"35d22f25-59d6-48b0-a885-ddbcfcdf5cb0\") " pod="openshift-multus/network-metrics-daemon-flzlz" May 21 10:31:13.387412 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:31:13.387392 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 10:31:13.395438 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:31:13.395423 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 21 10:31:13.395508 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:31:13.395498 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35d22f25-59d6-48b0-a885-ddbcfcdf5cb0-metrics-certs podName:35d22f25-59d6-48b0-a885-ddbcfcdf5cb0 nodeName:}" failed. No retries permitted until 2026-05-21 10:32:17.395483021 +0000 UTC m=+130.308862069 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/35d22f25-59d6-48b0-a885-ddbcfcdf5cb0-metrics-certs") pod "network-metrics-daemon-flzlz" (UID: "35d22f25-59d6-48b0-a885-ddbcfcdf5cb0") : secret "metrics-daemon-secret" not found May 21 10:31:13.486200 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:31:13.486167 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vd7xq\" (UniqueName: \"kubernetes.io/projected/03cc5e6e-7e76-47ec-80e8-795d0a71d2f8-kube-api-access-vd7xq\") pod \"network-check-target-pqqfc\" (UID: \"03cc5e6e-7e76-47ec-80e8-795d0a71d2f8\") " pod="openshift-network-diagnostics/network-check-target-pqqfc" May 21 10:31:13.488774 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:31:13.488756 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 21 10:31:13.499148 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:31:13.499128 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 21 10:31:13.509537 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:31:13.509509 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vd7xq\" (UniqueName: \"kubernetes.io/projected/03cc5e6e-7e76-47ec-80e8-795d0a71d2f8-kube-api-access-vd7xq\") pod \"network-check-target-pqqfc\" (UID: \"03cc5e6e-7e76-47ec-80e8-795d0a71d2f8\") " pod="openshift-network-diagnostics/network-check-target-pqqfc" May 21 10:31:13.656198 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:31:13.656121 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5vwxr\"" May 21 10:31:13.663660 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:31:13.663639 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqqfc" May 21 10:31:13.796753 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:31:13.796692 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pqqfc"] May 21 10:31:13.800161 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:31:13.800134 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03cc5e6e_7e76_47ec_80e8_795d0a71d2f8.slice/crio-9f65f0ca83ce131782522fa0b8d1f129e5740ea040401807af25ee6860a61094 WatchSource:0}: Error finding container 9f65f0ca83ce131782522fa0b8d1f129e5740ea040401807af25ee6860a61094: Status 404 returned error can't find the container with id 9f65f0ca83ce131782522fa0b8d1f129e5740ea040401807af25ee6860a61094 May 21 10:31:13.842844 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:31:13.842811 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pqqfc" event={"ID":"03cc5e6e-7e76-47ec-80e8-795d0a71d2f8","Type":"ContainerStarted","Data":"9f65f0ca83ce131782522fa0b8d1f129e5740ea040401807af25ee6860a61094"} May 21 10:31:13.890330 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:31:13.890300 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c5972469-00d2-4517-ba14-6672a94436d7-original-pull-secret\") pod \"global-pull-secret-syncer-8f7qb\" (UID: \"c5972469-00d2-4517-ba14-6672a94436d7\") " pod="kube-system/global-pull-secret-syncer-8f7qb" May 21 10:31:13.893424 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:31:13.893402 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 21 10:31:13.902947 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:31:13.902919 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c5972469-00d2-4517-ba14-6672a94436d7-original-pull-secret\") pod \"global-pull-secret-syncer-8f7qb\" (UID: \"c5972469-00d2-4517-ba14-6672a94436d7\") " pod="kube-system/global-pull-secret-syncer-8f7qb" May 21 10:31:13.959994 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:31:13.959879 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8f7qb" May 21 10:31:14.084116 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:31:14.084081 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8f7qb"] May 21 10:31:14.087285 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:31:14.087259 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5972469_00d2_4517_ba14_6672a94436d7.slice/crio-77ef61e07ca8e8746d8fe5aacc47c42b8d80a61c53748f536eb43456337c862a WatchSource:0}: Error finding container 77ef61e07ca8e8746d8fe5aacc47c42b8d80a61c53748f536eb43456337c862a: Status 404 returned error can't find the container with id 77ef61e07ca8e8746d8fe5aacc47c42b8d80a61c53748f536eb43456337c862a May 21 10:31:14.393802 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:31:14.393731 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/22843d5b-6950-4f00-bffa-8a509e8009a0-cert\") pod \"ingress-canary-7zn72\" (UID: \"22843d5b-6950-4f00-bffa-8a509e8009a0\") " pod="openshift-ingress-canary/ingress-canary-7zn72" May 21 10:31:14.394287 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:31:14.393836 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/136577a1-cdb0-4499-8f87-5c04dbd94f14-metrics-tls\") pod \"dns-default-2z5ml\" (UID: \"136577a1-cdb0-4499-8f87-5c04dbd94f14\") " pod="openshift-dns/dns-default-2z5ml" May 21 10:31:14.394287 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:31:14.393892 2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 10:31:14.394287 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:31:14.393928 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 10:31:14.394287 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:31:14.393966 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22843d5b-6950-4f00-bffa-8a509e8009a0-cert podName:22843d5b-6950-4f00-bffa-8a509e8009a0 nodeName:}" failed. No retries permitted until 2026-05-21 10:31:46.393934021 +0000 UTC m=+99.307313293 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/22843d5b-6950-4f00-bffa-8a509e8009a0-cert") pod "ingress-canary-7zn72" (UID: "22843d5b-6950-4f00-bffa-8a509e8009a0") : secret "canary-serving-cert" not found May 21 10:31:14.394287 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:31:14.393995 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/136577a1-cdb0-4499-8f87-5c04dbd94f14-metrics-tls podName:136577a1-cdb0-4499-8f87-5c04dbd94f14 nodeName:}" failed. No retries permitted until 2026-05-21 10:31:46.39398499 +0000 UTC m=+99.307364038 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/136577a1-cdb0-4499-8f87-5c04dbd94f14-metrics-tls") pod "dns-default-2z5ml" (UID: "136577a1-cdb0-4499-8f87-5c04dbd94f14") : secret "dns-default-metrics-tls" not found May 21 10:31:14.847151 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:31:14.847107 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8f7qb" event={"ID":"c5972469-00d2-4517-ba14-6672a94436d7","Type":"ContainerStarted","Data":"77ef61e07ca8e8746d8fe5aacc47c42b8d80a61c53748f536eb43456337c862a"} May 21 10:31:18.856143 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:31:18.856103 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8f7qb" event={"ID":"c5972469-00d2-4517-ba14-6672a94436d7","Type":"ContainerStarted","Data":"6f1f43c82a9001f3dd73dbc71e0e8f52d11b2d19e17854038da3648fca4382d6"} May 21 10:31:18.857366 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:31:18.857340 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pqqfc" event={"ID":"03cc5e6e-7e76-47ec-80e8-795d0a71d2f8","Type":"ContainerStarted","Data":"fc92e06bfd005d7776cb2ce5dba16c68833d8ff2a0e9f4491e87347a995f1b3d"} May 21 10:31:18.857481 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:31:18.857456 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-pqqfc" May 21 10:31:18.888220 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:31:18.888179 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-8f7qb" podStartSLOduration=64.54425143 podStartE2EDuration="1m8.888168499s" podCreationTimestamp="2026-05-21 10:30:10 +0000 UTC" firstStartedPulling="2026-05-21 10:31:14.089036411 +0000 UTC m=+67.002415459" lastFinishedPulling="2026-05-21 10:31:18.43295348 +0000 UTC m=+71.346332528" observedRunningTime="2026-05-21 10:31:18.888031684 +0000 UTC m=+71.801410753" watchObservedRunningTime="2026-05-21 10:31:18.888168499 +0000 UTC m=+71.801547566" May 21 10:31:46.415863 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:31:46.415819 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/22843d5b-6950-4f00-bffa-8a509e8009a0-cert\") pod \"ingress-canary-7zn72\" (UID: \"22843d5b-6950-4f00-bffa-8a509e8009a0\") " pod="openshift-ingress-canary/ingress-canary-7zn72" May 21 10:31:46.416313 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:31:46.415894 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/136577a1-cdb0-4499-8f87-5c04dbd94f14-metrics-tls\") pod \"dns-default-2z5ml\" (UID: \"136577a1-cdb0-4499-8f87-5c04dbd94f14\") " pod="openshift-dns/dns-default-2z5ml" May 21 10:31:46.416313 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:31:46.415996 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 10:31:46.416313 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:31:46.416000 2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 10:31:46.416313 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:31:46.416063 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/136577a1-cdb0-4499-8f87-5c04dbd94f14-metrics-tls podName:136577a1-cdb0-4499-8f87-5c04dbd94f14 nodeName:}" failed. No retries permitted until 2026-05-21 10:32:50.416046088 +0000 UTC m=+163.329425136 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/136577a1-cdb0-4499-8f87-5c04dbd94f14-metrics-tls") pod "dns-default-2z5ml" (UID: "136577a1-cdb0-4499-8f87-5c04dbd94f14") : secret "dns-default-metrics-tls" not found May 21 10:31:46.416313 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:31:46.416078 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22843d5b-6950-4f00-bffa-8a509e8009a0-cert podName:22843d5b-6950-4f00-bffa-8a509e8009a0 nodeName:}" failed. No retries permitted until 2026-05-21 10:32:50.416072398 +0000 UTC m=+163.329451445 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/22843d5b-6950-4f00-bffa-8a509e8009a0-cert") pod "ingress-canary-7zn72" (UID: "22843d5b-6950-4f00-bffa-8a509e8009a0") : secret "canary-serving-cert" not found May 21 10:31:49.861160 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:31:49.861133 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-pqqfc" May 21 10:31:49.879426 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:31:49.879379 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-pqqfc" podStartSLOduration=98.259029093 podStartE2EDuration="1m42.879365717s" podCreationTimestamp="2026-05-21 10:30:07 +0000 UTC" firstStartedPulling="2026-05-21 10:31:13.801925073 +0000 UTC m=+66.715304138" lastFinishedPulling="2026-05-21 10:31:18.422261698 +0000 UTC m=+71.335640762" observedRunningTime="2026-05-21 10:31:18.913138171 +0000 UTC m=+71.826517240" watchObservedRunningTime="2026-05-21 10:31:49.879365717 +0000 UTC m=+102.792744786" May 21 10:32:17.434295 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:17.434256 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35d22f25-59d6-48b0-a885-ddbcfcdf5cb0-metrics-certs\") pod \"network-metrics-daemon-flzlz\" (UID: \"35d22f25-59d6-48b0-a885-ddbcfcdf5cb0\") " pod="openshift-multus/network-metrics-daemon-flzlz" May 21 10:32:17.434780 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:32:17.434372 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 21 10:32:17.434780 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:32:17.434427 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35d22f25-59d6-48b0-a885-ddbcfcdf5cb0-metrics-certs podName:35d22f25-59d6-48b0-a885-ddbcfcdf5cb0 nodeName:}" failed. No retries permitted until 2026-05-21 10:34:19.434412965 +0000 UTC m=+252.347792013 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/35d22f25-59d6-48b0-a885-ddbcfcdf5cb0-metrics-certs") pod "network-metrics-daemon-flzlz" (UID: "35d22f25-59d6-48b0-a885-ddbcfcdf5cb0") : secret "metrics-daemon-secret" not found May 21 10:32:30.420571 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.420534 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-r8m7n"] May 21 10:32:30.424934 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.424908 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-r8m7n" May 21 10:32:30.428579 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.428555 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-kzqrb\"" May 21 10:32:30.446479 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.446452 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-r8m7n"] May 21 10:32:30.523063 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.523015 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtcgh\" (UniqueName: \"kubernetes.io/projected/940906e5-ef79-4610-9794-695bfd224d06-kube-api-access-wtcgh\") pod \"network-check-source-7f44b6dd87-r8m7n\" (UID: \"940906e5-ef79-4610-9794-695bfd224d06\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-r8m7n" May 21 10:32:30.542304 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.542271 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-kfvw2"] May 21 10:32:30.543849 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.543833 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5546c4f488-zdc6s"] May 21 10:32:30.544013 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.543993 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-kfvw2" May 21 10:32:30.545626 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.545608 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5546c4f488-zdc6s" May 21 10:32:30.546413 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.546391 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" May 21 10:32:30.546483 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.546391 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" May 21 10:32:30.548463 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.548446 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" May 21 10:32:30.548680 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.548654 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-mmqb7\"" May 21 10:32:30.556270 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.556249 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" May 21 10:32:30.556367 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.556252 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 21 10:32:30.556577 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.556555 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 21 10:32:30.556721 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.556601 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" May 21 10:32:30.556793 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.556655 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-8b2lc\"" May 21 10:32:30.556849 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.556655 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" May 21 10:32:30.557445 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.557427 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-f86f8cb9b-92xdp"] May 21 10:32:30.558948 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.558923 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f86f8cb9b-92xdp" May 21 10:32:30.562773 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.562756 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 21 10:32:30.562773 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.562766 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9spk4\"" May 21 10:32:30.563230 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.563213 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 21 10:32:30.563476 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.563462 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 21 10:32:30.571145 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.571122 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-kfvw2"] May 21 10:32:30.575026 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.575003 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5546c4f488-zdc6s"] May 21 10:32:30.576655 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.576631 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 21 10:32:30.577707 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.577688 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-f86f8cb9b-92xdp"] May 21 10:32:30.624351 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.624322 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc-bound-sa-token\") pod \"image-registry-f86f8cb9b-92xdp\" (UID: \"cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc\") " pod="openshift-image-registry/image-registry-f86f8cb9b-92xdp" May 21 10:32:30.624541 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.624362 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wtcgh\" (UniqueName: \"kubernetes.io/projected/940906e5-ef79-4610-9794-695bfd224d06-kube-api-access-wtcgh\") pod \"network-check-source-7f44b6dd87-r8m7n\" (UID: \"940906e5-ef79-4610-9794-695bfd224d06\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-r8m7n" May 21 10:32:30.624541 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.624383 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jww4f\" (UniqueName: \"kubernetes.io/projected/8e73c6a9-cff0-4599-ada0-33846ca2a332-kube-api-access-jww4f\") pod \"volume-data-source-validator-5cf8c89d64-kfvw2\" (UID: \"8e73c6a9-cff0-4599-ada0-33846ca2a332\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-kfvw2" May 21 10:32:30.624541 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.624489 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2714d3c9-b9b4-4905-88df-0ddd2e25c008-stats-auth\") pod \"router-default-5546c4f488-zdc6s\" (UID: \"2714d3c9-b9b4-4905-88df-0ddd2e25c008\") " pod="openshift-ingress/router-default-5546c4f488-zdc6s" May 21 10:32:30.624541 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.624515 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc-installation-pull-secrets\") pod \"image-registry-f86f8cb9b-92xdp\" (UID: \"cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc\") " pod="openshift-image-registry/image-registry-f86f8cb9b-92xdp" May 21 10:32:30.624541 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.624540 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9p9g\" (UniqueName: \"kubernetes.io/projected/cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc-kube-api-access-n9p9g\") pod \"image-registry-f86f8cb9b-92xdp\" (UID: \"cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc\") " pod="openshift-image-registry/image-registry-f86f8cb9b-92xdp" May 21 10:32:30.624723 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.624566 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ntnm\" (UniqueName: \"kubernetes.io/projected/2714d3c9-b9b4-4905-88df-0ddd2e25c008-kube-api-access-7ntnm\") pod \"router-default-5546c4f488-zdc6s\" (UID: \"2714d3c9-b9b4-4905-88df-0ddd2e25c008\") " pod="openshift-ingress/router-default-5546c4f488-zdc6s" May 21 10:32:30.624723 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.624646 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2714d3c9-b9b4-4905-88df-0ddd2e25c008-metrics-certs\") pod \"router-default-5546c4f488-zdc6s\" (UID: \"2714d3c9-b9b4-4905-88df-0ddd2e25c008\") " pod="openshift-ingress/router-default-5546c4f488-zdc6s" May 21 10:32:30.624723 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.624676 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc-image-registry-private-configuration\") pod \"image-registry-f86f8cb9b-92xdp\" (UID: \"cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc\") " pod="openshift-image-registry/image-registry-f86f8cb9b-92xdp" May 21 10:32:30.624723 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.624695 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc-registry-tls\") pod \"image-registry-f86f8cb9b-92xdp\" (UID: \"cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc\") " pod="openshift-image-registry/image-registry-f86f8cb9b-92xdp" May 21 10:32:30.624862 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.624730 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc-trusted-ca\") pod \"image-registry-f86f8cb9b-92xdp\" (UID: \"cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc\") " pod="openshift-image-registry/image-registry-f86f8cb9b-92xdp" May 21 10:32:30.624862 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.624756 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2714d3c9-b9b4-4905-88df-0ddd2e25c008-default-certificate\") pod \"router-default-5546c4f488-zdc6s\" (UID: \"2714d3c9-b9b4-4905-88df-0ddd2e25c008\") " pod="openshift-ingress/router-default-5546c4f488-zdc6s" May 21 10:32:30.624862 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.624796 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2714d3c9-b9b4-4905-88df-0ddd2e25c008-service-ca-bundle\") pod \"router-default-5546c4f488-zdc6s\" (UID: \"2714d3c9-b9b4-4905-88df-0ddd2e25c008\") " pod="openshift-ingress/router-default-5546c4f488-zdc6s" May 21 10:32:30.624862 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.624815 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc-ca-trust-extracted\") pod \"image-registry-f86f8cb9b-92xdp\" (UID: \"cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc\") " pod="openshift-image-registry/image-registry-f86f8cb9b-92xdp" May 21 10:32:30.624862 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.624832 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc-registry-certificates\") pod \"image-registry-f86f8cb9b-92xdp\" (UID: \"cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc\") " pod="openshift-image-registry/image-registry-f86f8cb9b-92xdp" May 21 10:32:30.646583 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.646553 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtcgh\" (UniqueName: \"kubernetes.io/projected/940906e5-ef79-4610-9794-695bfd224d06-kube-api-access-wtcgh\") pod \"network-check-source-7f44b6dd87-r8m7n\" (UID: \"940906e5-ef79-4610-9794-695bfd224d06\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-r8m7n" May 21 10:32:30.726016 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.725906 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2714d3c9-b9b4-4905-88df-0ddd2e25c008-metrics-certs\") pod \"router-default-5546c4f488-zdc6s\" (UID: \"2714d3c9-b9b4-4905-88df-0ddd2e25c008\") " pod="openshift-ingress/router-default-5546c4f488-zdc6s" May 21 10:32:30.726016 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.725973 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc-image-registry-private-configuration\") pod \"image-registry-f86f8cb9b-92xdp\" (UID: \"cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc\") " pod="openshift-image-registry/image-registry-f86f8cb9b-92xdp" May 21 10:32:30.726016 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.726000 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc-registry-tls\") pod \"image-registry-f86f8cb9b-92xdp\" (UID: \"cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc\") " pod="openshift-image-registry/image-registry-f86f8cb9b-92xdp" May 21 10:32:30.726252 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.726038 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc-trusted-ca\") pod \"image-registry-f86f8cb9b-92xdp\" (UID: \"cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc\") " pod="openshift-image-registry/image-registry-f86f8cb9b-92xdp" May 21 10:32:30.726252 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:32:30.726070 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 21 10:32:30.726252 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:32:30.726143 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2714d3c9-b9b4-4905-88df-0ddd2e25c008-metrics-certs podName:2714d3c9-b9b4-4905-88df-0ddd2e25c008 nodeName:}" failed. No retries permitted until 2026-05-21 10:32:31.226126941 +0000 UTC m=+144.139505993 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2714d3c9-b9b4-4905-88df-0ddd2e25c008-metrics-certs") pod "router-default-5546c4f488-zdc6s" (UID: "2714d3c9-b9b4-4905-88df-0ddd2e25c008") : secret "router-metrics-certs-default" not found May 21 10:32:30.726252 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.726073 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2714d3c9-b9b4-4905-88df-0ddd2e25c008-default-certificate\") pod \"router-default-5546c4f488-zdc6s\" (UID: \"2714d3c9-b9b4-4905-88df-0ddd2e25c008\") " pod="openshift-ingress/router-default-5546c4f488-zdc6s" May 21 10:32:30.726252 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:32:30.726160 2565 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 10:32:30.726252 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.726179 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2714d3c9-b9b4-4905-88df-0ddd2e25c008-service-ca-bundle\") pod \"router-default-5546c4f488-zdc6s\" (UID: \"2714d3c9-b9b4-4905-88df-0ddd2e25c008\") " pod="openshift-ingress/router-default-5546c4f488-zdc6s" May 21 10:32:30.726252 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:32:30.726187 2565 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f86f8cb9b-92xdp: secret "image-registry-tls" not found May 21 10:32:30.726252 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:32:30.726241 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc-registry-tls podName:cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc nodeName:}" failed. No retries permitted until 2026-05-21 10:32:31.226226375 +0000 UTC m=+144.139605428 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc-registry-tls") pod "image-registry-f86f8cb9b-92xdp" (UID: "cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc") : secret "image-registry-tls" not found May 21 10:32:30.726651 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:32:30.726278 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2714d3c9-b9b4-4905-88df-0ddd2e25c008-service-ca-bundle podName:2714d3c9-b9b4-4905-88df-0ddd2e25c008 nodeName:}" failed. No retries permitted until 2026-05-21 10:32:31.226264982 +0000 UTC m=+144.139644047 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2714d3c9-b9b4-4905-88df-0ddd2e25c008-service-ca-bundle") pod "router-default-5546c4f488-zdc6s" (UID: "2714d3c9-b9b4-4905-88df-0ddd2e25c008") : configmap references non-existent config key: service-ca.crt May 21 10:32:30.726651 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.726281 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc-ca-trust-extracted\") pod \"image-registry-f86f8cb9b-92xdp\" (UID: \"cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc\") " pod="openshift-image-registry/image-registry-f86f8cb9b-92xdp" May 21 10:32:30.726651 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.726325 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc-registry-certificates\") pod \"image-registry-f86f8cb9b-92xdp\" (UID: \"cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc\") " pod="openshift-image-registry/image-registry-f86f8cb9b-92xdp" May 21 10:32:30.726651 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.726403 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc-bound-sa-token\") pod \"image-registry-f86f8cb9b-92xdp\" (UID: \"cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc\") " pod="openshift-image-registry/image-registry-f86f8cb9b-92xdp" May 21 10:32:30.726651 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.726432 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jww4f\" (UniqueName: \"kubernetes.io/projected/8e73c6a9-cff0-4599-ada0-33846ca2a332-kube-api-access-jww4f\") pod \"volume-data-source-validator-5cf8c89d64-kfvw2\" (UID: \"8e73c6a9-cff0-4599-ada0-33846ca2a332\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-kfvw2" May 21 10:32:30.726651 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.726458 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2714d3c9-b9b4-4905-88df-0ddd2e25c008-stats-auth\") pod \"router-default-5546c4f488-zdc6s\" (UID: \"2714d3c9-b9b4-4905-88df-0ddd2e25c008\") " pod="openshift-ingress/router-default-5546c4f488-zdc6s" May 21 10:32:30.726651 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.726484 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc-installation-pull-secrets\") pod \"image-registry-f86f8cb9b-92xdp\" (UID: \"cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc\") " pod="openshift-image-registry/image-registry-f86f8cb9b-92xdp" May 21 10:32:30.726651 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.726513 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n9p9g\" (UniqueName: \"kubernetes.io/projected/cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc-kube-api-access-n9p9g\") pod \"image-registry-f86f8cb9b-92xdp\" (UID: \"cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc\") " pod="openshift-image-registry/image-registry-f86f8cb9b-92xdp" May 21 10:32:30.726651 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.726543 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7ntnm\" (UniqueName: \"kubernetes.io/projected/2714d3c9-b9b4-4905-88df-0ddd2e25c008-kube-api-access-7ntnm\") pod \"router-default-5546c4f488-zdc6s\" (UID: \"2714d3c9-b9b4-4905-88df-0ddd2e25c008\") " pod="openshift-ingress/router-default-5546c4f488-zdc6s" May 21 10:32:30.727073 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.726816 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc-ca-trust-extracted\") pod \"image-registry-f86f8cb9b-92xdp\" (UID: \"cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc\") " pod="openshift-image-registry/image-registry-f86f8cb9b-92xdp" May 21 10:32:30.727299 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.727277 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc-trusted-ca\") pod \"image-registry-f86f8cb9b-92xdp\" (UID: \"cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc\") " pod="openshift-image-registry/image-registry-f86f8cb9b-92xdp" May 21 10:32:30.727392 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.727332 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc-registry-certificates\") pod \"image-registry-f86f8cb9b-92xdp\" (UID: \"cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc\") " pod="openshift-image-registry/image-registry-f86f8cb9b-92xdp" May 21 10:32:30.728957 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.728918 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc-installation-pull-secrets\") pod \"image-registry-f86f8cb9b-92xdp\" (UID: \"cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc\") " pod="openshift-image-registry/image-registry-f86f8cb9b-92xdp" May 21 10:32:30.729074 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.729058 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2714d3c9-b9b4-4905-88df-0ddd2e25c008-default-certificate\") pod \"router-default-5546c4f488-zdc6s\" (UID: \"2714d3c9-b9b4-4905-88df-0ddd2e25c008\") " pod="openshift-ingress/router-default-5546c4f488-zdc6s" May 21 10:32:30.729136 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.729114 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc-image-registry-private-configuration\") pod \"image-registry-f86f8cb9b-92xdp\" (UID: \"cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc\") " pod="openshift-image-registry/image-registry-f86f8cb9b-92xdp" May 21 10:32:30.729184 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.729161 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2714d3c9-b9b4-4905-88df-0ddd2e25c008-stats-auth\") pod \"router-default-5546c4f488-zdc6s\" (UID: \"2714d3c9-b9b4-4905-88df-0ddd2e25c008\") " pod="openshift-ingress/router-default-5546c4f488-zdc6s" May 21 10:32:30.733909 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.733892 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-r8m7n" May 21 10:32:30.742566 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.742535 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jww4f\" (UniqueName: \"kubernetes.io/projected/8e73c6a9-cff0-4599-ada0-33846ca2a332-kube-api-access-jww4f\") pod \"volume-data-source-validator-5cf8c89d64-kfvw2\" (UID: \"8e73c6a9-cff0-4599-ada0-33846ca2a332\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-kfvw2" May 21 10:32:30.743528 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.743493 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc-bound-sa-token\") pod \"image-registry-f86f8cb9b-92xdp\" (UID: \"cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc\") " pod="openshift-image-registry/image-registry-f86f8cb9b-92xdp" May 21 10:32:30.745011 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.744989 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ntnm\" (UniqueName: \"kubernetes.io/projected/2714d3c9-b9b4-4905-88df-0ddd2e25c008-kube-api-access-7ntnm\") pod \"router-default-5546c4f488-zdc6s\" (UID: \"2714d3c9-b9b4-4905-88df-0ddd2e25c008\") " pod="openshift-ingress/router-default-5546c4f488-zdc6s" May 21 10:32:30.746156 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.746134 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9p9g\" (UniqueName: \"kubernetes.io/projected/cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc-kube-api-access-n9p9g\") pod \"image-registry-f86f8cb9b-92xdp\" (UID: \"cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc\") " pod="openshift-image-registry/image-registry-f86f8cb9b-92xdp" May 21 10:32:30.854072 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.854036 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-kfvw2" May 21 10:32:30.867874 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.867850 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-r8m7n"] May 21 10:32:30.870210 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:32:30.870176 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod940906e5_ef79_4610_9794_695bfd224d06.slice/crio-121d5e65428f50942a8560a3f309dfae2e3a152ca7aba0fd70e9638e12de989f WatchSource:0}: Error finding container 121d5e65428f50942a8560a3f309dfae2e3a152ca7aba0fd70e9638e12de989f: Status 404 returned error can't find the container with id 121d5e65428f50942a8560a3f309dfae2e3a152ca7aba0fd70e9638e12de989f May 21 10:32:30.989211 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.989136 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-kfvw2"] May 21 10:32:30.993157 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:32:30.993117 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e73c6a9_cff0_4599_ada0_33846ca2a332.slice/crio-ecab7a76efc8597b51dd2db24201033f1dadd1df37277154c6d2b9c039088af7 WatchSource:0}: Error finding container ecab7a76efc8597b51dd2db24201033f1dadd1df37277154c6d2b9c039088af7: Status 404 returned error can't find the container with id ecab7a76efc8597b51dd2db24201033f1dadd1df37277154c6d2b9c039088af7 May 21 10:32:30.995094 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.995065 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-r8m7n" event={"ID":"940906e5-ef79-4610-9794-695bfd224d06","Type":"ContainerStarted","Data":"6848231814ed2001199531f676b57828fed392483b354121251a362c98847b60"} May 21 10:32:30.995094 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:30.995101 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-r8m7n" event={"ID":"940906e5-ef79-4610-9794-695bfd224d06","Type":"ContainerStarted","Data":"121d5e65428f50942a8560a3f309dfae2e3a152ca7aba0fd70e9638e12de989f"} May 21 10:32:31.016558 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:31.016511 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-r8m7n" podStartSLOduration=1.016495212 podStartE2EDuration="1.016495212s" podCreationTimestamp="2026-05-21 10:32:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 10:32:31.015742826 +0000 UTC m=+143.929121896" watchObservedRunningTime="2026-05-21 10:32:31.016495212 +0000 UTC m=+143.929874281" May 21 10:32:31.234402 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:31.230996 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2714d3c9-b9b4-4905-88df-0ddd2e25c008-metrics-certs\") pod \"router-default-5546c4f488-zdc6s\" (UID: \"2714d3c9-b9b4-4905-88df-0ddd2e25c008\") " pod="openshift-ingress/router-default-5546c4f488-zdc6s" May 21 10:32:31.234402 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:31.231079 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc-registry-tls\") pod \"image-registry-f86f8cb9b-92xdp\" (UID: \"cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc\") " pod="openshift-image-registry/image-registry-f86f8cb9b-92xdp" May 21 10:32:31.234402 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:31.231149 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2714d3c9-b9b4-4905-88df-0ddd2e25c008-service-ca-bundle\") pod \"router-default-5546c4f488-zdc6s\" (UID: \"2714d3c9-b9b4-4905-88df-0ddd2e25c008\") " pod="openshift-ingress/router-default-5546c4f488-zdc6s" May 21 10:32:31.234402 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:32:31.231245 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 21 10:32:31.234402 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:32:31.231306 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2714d3c9-b9b4-4905-88df-0ddd2e25c008-service-ca-bundle podName:2714d3c9-b9b4-4905-88df-0ddd2e25c008 nodeName:}" failed. No retries permitted until 2026-05-21 10:32:32.23127963 +0000 UTC m=+145.144658682 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2714d3c9-b9b4-4905-88df-0ddd2e25c008-service-ca-bundle") pod "router-default-5546c4f488-zdc6s" (UID: "2714d3c9-b9b4-4905-88df-0ddd2e25c008") : configmap references non-existent config key: service-ca.crt May 21 10:32:31.234402 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:32:31.231336 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2714d3c9-b9b4-4905-88df-0ddd2e25c008-metrics-certs podName:2714d3c9-b9b4-4905-88df-0ddd2e25c008 nodeName:}" failed. No retries permitted until 2026-05-21 10:32:32.231315746 +0000 UTC m=+145.144694813 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2714d3c9-b9b4-4905-88df-0ddd2e25c008-metrics-certs") pod "router-default-5546c4f488-zdc6s" (UID: "2714d3c9-b9b4-4905-88df-0ddd2e25c008") : secret "router-metrics-certs-default" not found May 21 10:32:31.234402 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:32:31.231414 2565 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 10:32:31.234402 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:32:31.231426 2565 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f86f8cb9b-92xdp: secret "image-registry-tls" not found May 21 10:32:31.234402 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:32:31.231464 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc-registry-tls podName:cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc nodeName:}" failed. No retries permitted until 2026-05-21 10:32:32.231454023 +0000 UTC m=+145.144833085 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc-registry-tls") pod "image-registry-f86f8cb9b-92xdp" (UID: "cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc") : secret "image-registry-tls" not found May 21 10:32:31.998375 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:31.998333 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-kfvw2" event={"ID":"8e73c6a9-cff0-4599-ada0-33846ca2a332","Type":"ContainerStarted","Data":"ecab7a76efc8597b51dd2db24201033f1dadd1df37277154c6d2b9c039088af7"} May 21 10:32:32.238455 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:32.238405 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2714d3c9-b9b4-4905-88df-0ddd2e25c008-metrics-certs\") pod \"router-default-5546c4f488-zdc6s\" (UID: \"2714d3c9-b9b4-4905-88df-0ddd2e25c008\") " pod="openshift-ingress/router-default-5546c4f488-zdc6s" May 21 10:32:32.238621 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:32:32.238539 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 21 10:32:32.238621 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:32.238551 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc-registry-tls\") pod \"image-registry-f86f8cb9b-92xdp\" (UID: \"cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc\") " pod="openshift-image-registry/image-registry-f86f8cb9b-92xdp" May 21 10:32:32.238755 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:32:32.238629 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2714d3c9-b9b4-4905-88df-0ddd2e25c008-metrics-certs podName:2714d3c9-b9b4-4905-88df-0ddd2e25c008 nodeName:}" failed. No retries permitted until 2026-05-21 10:32:34.238609937 +0000 UTC m=+147.151988990 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2714d3c9-b9b4-4905-88df-0ddd2e25c008-metrics-certs") pod "router-default-5546c4f488-zdc6s" (UID: "2714d3c9-b9b4-4905-88df-0ddd2e25c008") : secret "router-metrics-certs-default" not found May 21 10:32:32.238755 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:32.238657 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2714d3c9-b9b4-4905-88df-0ddd2e25c008-service-ca-bundle\") pod \"router-default-5546c4f488-zdc6s\" (UID: \"2714d3c9-b9b4-4905-88df-0ddd2e25c008\") " pod="openshift-ingress/router-default-5546c4f488-zdc6s" May 21 10:32:32.238755 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:32:32.238689 2565 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 10:32:32.238755 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:32:32.238711 2565 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f86f8cb9b-92xdp: secret "image-registry-tls" not found May 21 10:32:32.238977 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:32:32.238781 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc-registry-tls podName:cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc nodeName:}" failed. No retries permitted until 2026-05-21 10:32:34.23876393 +0000 UTC m=+147.152142993 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc-registry-tls") pod "image-registry-f86f8cb9b-92xdp" (UID: "cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc") : secret "image-registry-tls" not found May 21 10:32:32.238977 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:32:32.238801 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2714d3c9-b9b4-4905-88df-0ddd2e25c008-service-ca-bundle podName:2714d3c9-b9b4-4905-88df-0ddd2e25c008 nodeName:}" failed. No retries permitted until 2026-05-21 10:32:34.238792269 +0000 UTC m=+147.152171319 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2714d3c9-b9b4-4905-88df-0ddd2e25c008-service-ca-bundle") pod "router-default-5546c4f488-zdc6s" (UID: "2714d3c9-b9b4-4905-88df-0ddd2e25c008") : configmap references non-existent config key: service-ca.crt May 21 10:32:33.001159 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:33.001124 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-kfvw2" event={"ID":"8e73c6a9-cff0-4599-ada0-33846ca2a332","Type":"ContainerStarted","Data":"6dbd8f706c2c0d1d00abb925dfb3e9ea5232d0ab02b9f1811a841314da97f105"} May 21 10:32:33.026573 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:33.026525 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-kfvw2" podStartSLOduration=1.188272272 podStartE2EDuration="3.026512198s" podCreationTimestamp="2026-05-21 10:32:30 +0000 UTC" firstStartedPulling="2026-05-21 10:32:30.995053295 +0000 UTC m=+143.908432344" lastFinishedPulling="2026-05-21 10:32:32.833293221 +0000 UTC m=+145.746672270" observedRunningTime="2026-05-21 10:32:33.026265728 +0000 UTC m=+145.939644799" watchObservedRunningTime="2026-05-21 10:32:33.026512198 +0000 UTC m=+145.939891268" May 21 10:32:34.255012 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:34.254965 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2714d3c9-b9b4-4905-88df-0ddd2e25c008-metrics-certs\") pod \"router-default-5546c4f488-zdc6s\" (UID: \"2714d3c9-b9b4-4905-88df-0ddd2e25c008\") " pod="openshift-ingress/router-default-5546c4f488-zdc6s" May 21 10:32:34.255378 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:34.255024 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc-registry-tls\") pod \"image-registry-f86f8cb9b-92xdp\" (UID: \"cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc\") " pod="openshift-image-registry/image-registry-f86f8cb9b-92xdp" May 21 10:32:34.255378 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:34.255079 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2714d3c9-b9b4-4905-88df-0ddd2e25c008-service-ca-bundle\") pod \"router-default-5546c4f488-zdc6s\" (UID: \"2714d3c9-b9b4-4905-88df-0ddd2e25c008\") " pod="openshift-ingress/router-default-5546c4f488-zdc6s" May 21 10:32:34.255378 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:32:34.255098 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 21 10:32:34.255378 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:32:34.255164 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2714d3c9-b9b4-4905-88df-0ddd2e25c008-metrics-certs podName:2714d3c9-b9b4-4905-88df-0ddd2e25c008 nodeName:}" failed. No retries permitted until 2026-05-21 10:32:38.255145743 +0000 UTC m=+151.168524815 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2714d3c9-b9b4-4905-88df-0ddd2e25c008-metrics-certs") pod "router-default-5546c4f488-zdc6s" (UID: "2714d3c9-b9b4-4905-88df-0ddd2e25c008") : secret "router-metrics-certs-default" not found May 21 10:32:34.255378 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:32:34.255162 2565 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 10:32:34.255378 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:32:34.255183 2565 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f86f8cb9b-92xdp: secret "image-registry-tls" not found May 21 10:32:34.255378 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:32:34.255196 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2714d3c9-b9b4-4905-88df-0ddd2e25c008-service-ca-bundle podName:2714d3c9-b9b4-4905-88df-0ddd2e25c008 nodeName:}" failed. No retries permitted until 2026-05-21 10:32:38.255185222 +0000 UTC m=+151.168564271 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2714d3c9-b9b4-4905-88df-0ddd2e25c008-service-ca-bundle") pod "router-default-5546c4f488-zdc6s" (UID: "2714d3c9-b9b4-4905-88df-0ddd2e25c008") : configmap references non-existent config key: service-ca.crt May 21 10:32:34.255378 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:32:34.255222 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc-registry-tls podName:cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc nodeName:}" failed. No retries permitted until 2026-05-21 10:32:38.255204306 +0000 UTC m=+151.168583369 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc-registry-tls") pod "image-registry-f86f8cb9b-92xdp" (UID: "cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc") : secret "image-registry-tls" not found May 21 10:32:37.973458 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:37.973421 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-hgbxx"] May 21 10:32:37.975191 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:37.975175 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-hgbxx" May 21 10:32:37.982006 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:37.981986 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" May 21 10:32:37.982120 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:37.982006 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" May 21 10:32:37.983434 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:37.983418 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" May 21 10:32:37.983481 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:37.983434 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-7wkkn\"" May 21 10:32:37.983671 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:37.983653 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" May 21 10:32:37.990828 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:37.990805 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-hgbxx"] May 21 10:32:38.083992 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:38.083930 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e0f66bf1-d59f-4a3f-ad49-3a90acfa6844-signing-key\") pod \"service-ca-67d667c7d-hgbxx\" (UID: \"e0f66bf1-d59f-4a3f-ad49-3a90acfa6844\") " pod="openshift-service-ca/service-ca-67d667c7d-hgbxx" May 21 10:32:38.083992 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:38.083988 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e0f66bf1-d59f-4a3f-ad49-3a90acfa6844-signing-cabundle\") pod \"service-ca-67d667c7d-hgbxx\" (UID: \"e0f66bf1-d59f-4a3f-ad49-3a90acfa6844\") " pod="openshift-service-ca/service-ca-67d667c7d-hgbxx" May 21 10:32:38.084209 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:38.084128 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvtdn\" (UniqueName: \"kubernetes.io/projected/e0f66bf1-d59f-4a3f-ad49-3a90acfa6844-kube-api-access-cvtdn\") pod \"service-ca-67d667c7d-hgbxx\" (UID: \"e0f66bf1-d59f-4a3f-ad49-3a90acfa6844\") " pod="openshift-service-ca/service-ca-67d667c7d-hgbxx" May 21 10:32:38.089006 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:38.088988 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ml6nr_f4a6b193-47ea-4a0e-b63a-3dd25c6aab85/dns-node-resolver/0.log" May 21 10:32:38.184910 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:38.184875 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e0f66bf1-d59f-4a3f-ad49-3a90acfa6844-signing-key\") pod \"service-ca-67d667c7d-hgbxx\" (UID: \"e0f66bf1-d59f-4a3f-ad49-3a90acfa6844\") " pod="openshift-service-ca/service-ca-67d667c7d-hgbxx" May 21 10:32:38.185035 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:38.184914 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e0f66bf1-d59f-4a3f-ad49-3a90acfa6844-signing-cabundle\") pod \"service-ca-67d667c7d-hgbxx\" (UID: \"e0f66bf1-d59f-4a3f-ad49-3a90acfa6844\") " pod="openshift-service-ca/service-ca-67d667c7d-hgbxx" May 21 10:32:38.185184 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:38.185165 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cvtdn\" (UniqueName: \"kubernetes.io/projected/e0f66bf1-d59f-4a3f-ad49-3a90acfa6844-kube-api-access-cvtdn\") pod \"service-ca-67d667c7d-hgbxx\" (UID: \"e0f66bf1-d59f-4a3f-ad49-3a90acfa6844\") " pod="openshift-service-ca/service-ca-67d667c7d-hgbxx" May 21 10:32:38.185652 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:38.185623 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e0f66bf1-d59f-4a3f-ad49-3a90acfa6844-signing-cabundle\") pod \"service-ca-67d667c7d-hgbxx\" (UID: \"e0f66bf1-d59f-4a3f-ad49-3a90acfa6844\") " pod="openshift-service-ca/service-ca-67d667c7d-hgbxx" May 21 10:32:38.187348 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:38.187328 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e0f66bf1-d59f-4a3f-ad49-3a90acfa6844-signing-key\") pod \"service-ca-67d667c7d-hgbxx\" (UID: \"e0f66bf1-d59f-4a3f-ad49-3a90acfa6844\") " pod="openshift-service-ca/service-ca-67d667c7d-hgbxx" May 21 10:32:38.196282 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:38.196260 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvtdn\" (UniqueName: \"kubernetes.io/projected/e0f66bf1-d59f-4a3f-ad49-3a90acfa6844-kube-api-access-cvtdn\") pod \"service-ca-67d667c7d-hgbxx\" (UID: \"e0f66bf1-d59f-4a3f-ad49-3a90acfa6844\") " pod="openshift-service-ca/service-ca-67d667c7d-hgbxx" May 21 10:32:38.283770 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:38.283695 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-hgbxx" May 21 10:32:38.285500 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:38.285479 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2714d3c9-b9b4-4905-88df-0ddd2e25c008-metrics-certs\") pod \"router-default-5546c4f488-zdc6s\" (UID: \"2714d3c9-b9b4-4905-88df-0ddd2e25c008\") " pod="openshift-ingress/router-default-5546c4f488-zdc6s" May 21 10:32:38.285562 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:38.285510 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc-registry-tls\") pod \"image-registry-f86f8cb9b-92xdp\" (UID: \"cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc\") " pod="openshift-image-registry/image-registry-f86f8cb9b-92xdp" May 21 10:32:38.285562 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:38.285542 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2714d3c9-b9b4-4905-88df-0ddd2e25c008-service-ca-bundle\") pod \"router-default-5546c4f488-zdc6s\" (UID: \"2714d3c9-b9b4-4905-88df-0ddd2e25c008\") " pod="openshift-ingress/router-default-5546c4f488-zdc6s" May 21 10:32:38.285642 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:32:38.285625 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 21 10:32:38.285680 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:32:38.285650 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2714d3c9-b9b4-4905-88df-0ddd2e25c008-service-ca-bundle podName:2714d3c9-b9b4-4905-88df-0ddd2e25c008 nodeName:}" failed. No retries permitted until 2026-05-21 10:32:46.285636119 +0000 UTC m=+159.199015188 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2714d3c9-b9b4-4905-88df-0ddd2e25c008-service-ca-bundle") pod "router-default-5546c4f488-zdc6s" (UID: "2714d3c9-b9b4-4905-88df-0ddd2e25c008") : configmap references non-existent config key: service-ca.crt May 21 10:32:38.285730 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:32:38.285688 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2714d3c9-b9b4-4905-88df-0ddd2e25c008-metrics-certs podName:2714d3c9-b9b4-4905-88df-0ddd2e25c008 nodeName:}" failed. No retries permitted until 2026-05-21 10:32:46.285673985 +0000 UTC m=+159.199053032 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2714d3c9-b9b4-4905-88df-0ddd2e25c008-metrics-certs") pod "router-default-5546c4f488-zdc6s" (UID: "2714d3c9-b9b4-4905-88df-0ddd2e25c008") : secret "router-metrics-certs-default" not found May 21 10:32:38.285730 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:32:38.285630 2565 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 10:32:38.285730 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:32:38.285707 2565 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f86f8cb9b-92xdp: secret "image-registry-tls" not found May 21 10:32:38.285838 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:32:38.285735 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc-registry-tls podName:cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc nodeName:}" failed. No retries permitted until 2026-05-21 10:32:46.285728304 +0000 UTC m=+159.199107351 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc-registry-tls") pod "image-registry-f86f8cb9b-92xdp" (UID: "cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc") : secret "image-registry-tls" not found May 21 10:32:38.406727 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:38.406695 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-hgbxx"] May 21 10:32:38.409775 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:32:38.409748 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0f66bf1_d59f_4a3f_ad49_3a90acfa6844.slice/crio-e5eef130c58a59242598f3e585f16fe8177aaad2303fbc1d04f29edcc343bc2e WatchSource:0}: Error finding container e5eef130c58a59242598f3e585f16fe8177aaad2303fbc1d04f29edcc343bc2e: Status 404 returned error can't find the container with id e5eef130c58a59242598f3e585f16fe8177aaad2303fbc1d04f29edcc343bc2e May 21 10:32:39.013786 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:39.013743 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-hgbxx" event={"ID":"e0f66bf1-d59f-4a3f-ad49-3a90acfa6844","Type":"ContainerStarted","Data":"e5eef130c58a59242598f3e585f16fe8177aaad2303fbc1d04f29edcc343bc2e"} May 21 10:32:39.295350 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:39.295268 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xgzdb_8d7bae5e-e157-4bde-8a8c-e82e63427b92/node-ca/0.log" May 21 10:32:41.019331 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:41.019293 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-hgbxx" event={"ID":"e0f66bf1-d59f-4a3f-ad49-3a90acfa6844","Type":"ContainerStarted","Data":"7ed79f1047da8a20f56fb6f91971325b45417fcf6e9c57202058dcc8d3010ce9"} May 21 10:32:41.051000 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:41.050924 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-hgbxx" podStartSLOduration=2.360069433 podStartE2EDuration="4.050908358s" podCreationTimestamp="2026-05-21 10:32:37 +0000 UTC" firstStartedPulling="2026-05-21 10:32:38.411495514 +0000 UTC m=+151.324874562" lastFinishedPulling="2026-05-21 10:32:40.102334437 +0000 UTC m=+153.015713487" observedRunningTime="2026-05-21 10:32:41.05071529 +0000 UTC m=+153.964094353" watchObservedRunningTime="2026-05-21 10:32:41.050908358 +0000 UTC m=+153.964287427" May 21 10:32:45.518173 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:32:45.518073 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-2z5ml" podUID="136577a1-cdb0-4499-8f87-5c04dbd94f14" May 21 10:32:45.532211 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:32:45.532160 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-7zn72" podUID="22843d5b-6950-4f00-bffa-8a509e8009a0" May 21 10:32:46.031252 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:46.031220 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7zn72" May 21 10:32:46.031423 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:46.031220 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2z5ml" May 21 10:32:46.355446 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:46.355409 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2714d3c9-b9b4-4905-88df-0ddd2e25c008-metrics-certs\") pod \"router-default-5546c4f488-zdc6s\" (UID: \"2714d3c9-b9b4-4905-88df-0ddd2e25c008\") " pod="openshift-ingress/router-default-5546c4f488-zdc6s" May 21 10:32:46.355446 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:46.355460 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc-registry-tls\") pod \"image-registry-f86f8cb9b-92xdp\" (UID: \"cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc\") " pod="openshift-image-registry/image-registry-f86f8cb9b-92xdp" May 21 10:32:46.355711 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:46.355509 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2714d3c9-b9b4-4905-88df-0ddd2e25c008-service-ca-bundle\") pod \"router-default-5546c4f488-zdc6s\" (UID: \"2714d3c9-b9b4-4905-88df-0ddd2e25c008\") " pod="openshift-ingress/router-default-5546c4f488-zdc6s" May 21 10:32:46.355711 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:32:46.355561 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 21 10:32:46.355711 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:32:46.355649 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2714d3c9-b9b4-4905-88df-0ddd2e25c008-metrics-certs podName:2714d3c9-b9b4-4905-88df-0ddd2e25c008 nodeName:}" failed. No retries permitted until 2026-05-21 10:33:02.355628135 +0000 UTC m=+175.269007194 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2714d3c9-b9b4-4905-88df-0ddd2e25c008-metrics-certs") pod "router-default-5546c4f488-zdc6s" (UID: "2714d3c9-b9b4-4905-88df-0ddd2e25c008") : secret "router-metrics-certs-default" not found May 21 10:32:46.355711 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:32:46.355670 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2714d3c9-b9b4-4905-88df-0ddd2e25c008-service-ca-bundle podName:2714d3c9-b9b4-4905-88df-0ddd2e25c008 nodeName:}" failed. No retries permitted until 2026-05-21 10:33:02.355661425 +0000 UTC m=+175.269040511 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2714d3c9-b9b4-4905-88df-0ddd2e25c008-service-ca-bundle") pod "router-default-5546c4f488-zdc6s" (UID: "2714d3c9-b9b4-4905-88df-0ddd2e25c008") : configmap references non-existent config key: service-ca.crt May 21 10:32:46.357833 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:46.357802 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc-registry-tls\") pod \"image-registry-f86f8cb9b-92xdp\" (UID: \"cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc\") " pod="openshift-image-registry/image-registry-f86f8cb9b-92xdp" May 21 10:32:46.467104 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:46.467050 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f86f8cb9b-92xdp" May 21 10:32:46.639596 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:46.639524 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-f86f8cb9b-92xdp"] May 21 10:32:46.642932 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:32:46.642901 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbd91b37_dbe8_4a7b_a9d5_3684fe692dfc.slice/crio-42ef04aafddb39a7b30b5b51a0561a775a8c2360616ba7f9f87be44a5f22d0fb WatchSource:0}: Error finding container 42ef04aafddb39a7b30b5b51a0561a775a8c2360616ba7f9f87be44a5f22d0fb: Status 404 returned error can't find the container with id 42ef04aafddb39a7b30b5b51a0561a775a8c2360616ba7f9f87be44a5f22d0fb May 21 10:32:46.644630 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:32:46.644603 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-flzlz" podUID="35d22f25-59d6-48b0-a885-ddbcfcdf5cb0" May 21 10:32:47.035483 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:47.035383 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f86f8cb9b-92xdp" event={"ID":"cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc","Type":"ContainerStarted","Data":"a24d37ff55eea37d6e9220eb2c5ca7c6556590e26ee4aea91effd3368b1c5196"} May 21 10:32:47.035483 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:47.035422 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f86f8cb9b-92xdp" event={"ID":"cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc","Type":"ContainerStarted","Data":"42ef04aafddb39a7b30b5b51a0561a775a8c2360616ba7f9f87be44a5f22d0fb"} May 21 10:32:47.035709 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:47.035502 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-f86f8cb9b-92xdp" May 21 10:32:50.492596 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:50.492542 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/136577a1-cdb0-4499-8f87-5c04dbd94f14-metrics-tls\") pod \"dns-default-2z5ml\" (UID: \"136577a1-cdb0-4499-8f87-5c04dbd94f14\") " pod="openshift-dns/dns-default-2z5ml" May 21 10:32:50.492596 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:50.492608 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/22843d5b-6950-4f00-bffa-8a509e8009a0-cert\") pod \"ingress-canary-7zn72\" (UID: \"22843d5b-6950-4f00-bffa-8a509e8009a0\") " pod="openshift-ingress-canary/ingress-canary-7zn72" May 21 10:32:50.494965 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:50.494918 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/136577a1-cdb0-4499-8f87-5c04dbd94f14-metrics-tls\") pod \"dns-default-2z5ml\" (UID: \"136577a1-cdb0-4499-8f87-5c04dbd94f14\") " pod="openshift-dns/dns-default-2z5ml" May 21 10:32:50.495157 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:50.495135 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/22843d5b-6950-4f00-bffa-8a509e8009a0-cert\") pod \"ingress-canary-7zn72\" (UID: \"22843d5b-6950-4f00-bffa-8a509e8009a0\") " pod="openshift-ingress-canary/ingress-canary-7zn72" May 21 10:32:50.534848 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:50.534818 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-j2794\"" May 21 10:32:50.535678 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:50.535660 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4ntqv\"" May 21 10:32:50.542321 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:50.542304 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7zn72" May 21 10:32:50.542448 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:50.542431 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2z5ml" May 21 10:32:50.705958 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:50.705895 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-f86f8cb9b-92xdp" podStartSLOduration=20.705880418 podStartE2EDuration="20.705880418s" podCreationTimestamp="2026-05-21 10:32:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 10:32:47.06670302 +0000 UTC m=+159.980082090" watchObservedRunningTime="2026-05-21 10:32:50.705880418 +0000 UTC m=+163.619259487" May 21 10:32:50.707251 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:50.706900 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7zn72"] May 21 10:32:50.708082 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:50.708056 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2z5ml"] May 21 10:32:50.710873 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:32:50.710847 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod136577a1_cdb0_4499_8f87_5c04dbd94f14.slice/crio-22c01d8a1dae1895c5f9c62617410688dc6c590ab1ea2ce0fa1474159b0d176f WatchSource:0}: Error finding container 22c01d8a1dae1895c5f9c62617410688dc6c590ab1ea2ce0fa1474159b0d176f: Status 404 returned error can't find the container with id 22c01d8a1dae1895c5f9c62617410688dc6c590ab1ea2ce0fa1474159b0d176f May 21 10:32:50.711754 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:32:50.711724 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22843d5b_6950_4f00_bffa_8a509e8009a0.slice/crio-0ebb71f1e92bb20b477de03140b4ac9850ff0624fea2df307681e6bb718d19cf WatchSource:0}: Error finding container 0ebb71f1e92bb20b477de03140b4ac9850ff0624fea2df307681e6bb718d19cf: Status 404 returned error can't find the container with id 0ebb71f1e92bb20b477de03140b4ac9850ff0624fea2df307681e6bb718d19cf May 21 10:32:51.046059 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:51.046017 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7zn72" event={"ID":"22843d5b-6950-4f00-bffa-8a509e8009a0","Type":"ContainerStarted","Data":"0ebb71f1e92bb20b477de03140b4ac9850ff0624fea2df307681e6bb718d19cf"} May 21 10:32:51.047031 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:51.046999 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2z5ml" event={"ID":"136577a1-cdb0-4499-8f87-5c04dbd94f14","Type":"ContainerStarted","Data":"22c01d8a1dae1895c5f9c62617410688dc6c590ab1ea2ce0fa1474159b0d176f"} May 21 10:32:53.053380 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:53.053289 2565 generic.go:358] "Generic (PLEG): container finished" podID="eda5a125-6b56-4dee-839c-6441bfe27a49" containerID="87ef1e1bdd3a631b01aed81a50c8d00c67195fb0279b2375be095e43f14a3306" exitCode=255 May 21 10:32:53.053380 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:53.053368 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f655ccc44-lvng6" event={"ID":"eda5a125-6b56-4dee-839c-6441bfe27a49","Type":"ContainerDied","Data":"87ef1e1bdd3a631b01aed81a50c8d00c67195fb0279b2375be095e43f14a3306"} May 21 10:32:53.054778 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:53.054752 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7zn72" event={"ID":"22843d5b-6950-4f00-bffa-8a509e8009a0","Type":"ContainerStarted","Data":"2bd33131fe2348d3785d1ab752b004c60dcd5e8f0c012efffe73cead9b4163ab"} May 21 10:32:53.056340 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:53.056318 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2z5ml" event={"ID":"136577a1-cdb0-4499-8f87-5c04dbd94f14","Type":"ContainerStarted","Data":"a6e78576055564e1f4f4b091456d92107ca9010a3c30d8a2fa9c924f44954bde"} May 21 10:32:53.056436 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:53.056345 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2z5ml" event={"ID":"136577a1-cdb0-4499-8f87-5c04dbd94f14","Type":"ContainerStarted","Data":"0eba7b5ff63e4897337cebbc0bea38317508be74365c9e9970eeb8bd5f8ea546"} May 21 10:32:53.056473 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:53.056468 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-2z5ml" May 21 10:32:53.059579 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:53.059561 2565 scope.go:117] "RemoveContainer" containerID="87ef1e1bdd3a631b01aed81a50c8d00c67195fb0279b2375be095e43f14a3306" May 21 10:32:53.133066 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:53.133015 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7zn72" podStartSLOduration=129.209809207 podStartE2EDuration="2m11.132994955s" podCreationTimestamp="2026-05-21 10:30:42 +0000 UTC" firstStartedPulling="2026-05-21 10:32:50.713893763 +0000 UTC m=+163.627272824" lastFinishedPulling="2026-05-21 10:32:52.63707952 +0000 UTC m=+165.550458572" observedRunningTime="2026-05-21 10:32:53.105264503 +0000 UTC m=+166.018643572" watchObservedRunningTime="2026-05-21 10:32:53.132994955 +0000 UTC m=+166.046374025" May 21 10:32:53.134236 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:53.134194 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-2z5ml" podStartSLOduration=129.209845825 podStartE2EDuration="2m11.134181502s" podCreationTimestamp="2026-05-21 10:30:42 +0000 UTC" firstStartedPulling="2026-05-21 10:32:50.712685247 +0000 UTC m=+163.626064299" lastFinishedPulling="2026-05-21 10:32:52.637020925 +0000 UTC m=+165.550399976" observedRunningTime="2026-05-21 10:32:53.132995717 +0000 UTC m=+166.046374787" watchObservedRunningTime="2026-05-21 10:32:53.134181502 +0000 UTC m=+166.047560572" May 21 10:32:54.060897 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:32:54.060858 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f655ccc44-lvng6" event={"ID":"eda5a125-6b56-4dee-839c-6441bfe27a49","Type":"ContainerStarted","Data":"81e08937c46b0d49b1fd999b2127eddd3dda98d7d34448532ea05c5d6394c109"} May 21 10:33:00.090279 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:00.090205 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-gfz5s"] May 21 10:33:00.093369 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:00.093347 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gfz5s" May 21 10:33:00.097683 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:00.097661 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 21 10:33:00.097826 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:00.097700 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 21 10:33:00.101450 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:00.101431 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-w9dw4\"" May 21 10:33:00.101720 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:00.101705 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 21 10:33:00.106041 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:00.106027 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 21 10:33:00.117052 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:00.117025 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gfz5s"] May 21 10:33:00.148196 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:00.148171 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-f86f8cb9b-92xdp"] May 21 10:33:00.174521 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:00.174496 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6ade753c-243c-4077-9f45-12bb257db737-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gfz5s\" (UID: \"6ade753c-243c-4077-9f45-12bb257db737\") " pod="openshift-insights/insights-runtime-extractor-gfz5s" May 21 10:33:00.174663 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:00.174535 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6ade753c-243c-4077-9f45-12bb257db737-crio-socket\") pod \"insights-runtime-extractor-gfz5s\" (UID: \"6ade753c-243c-4077-9f45-12bb257db737\") " pod="openshift-insights/insights-runtime-extractor-gfz5s" May 21 10:33:00.174663 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:00.174565 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qs56x\" (UniqueName: \"kubernetes.io/projected/6ade753c-243c-4077-9f45-12bb257db737-kube-api-access-qs56x\") pod \"insights-runtime-extractor-gfz5s\" (UID: \"6ade753c-243c-4077-9f45-12bb257db737\") " pod="openshift-insights/insights-runtime-extractor-gfz5s" May 21 10:33:00.174663 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:00.174650 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6ade753c-243c-4077-9f45-12bb257db737-data-volume\") pod \"insights-runtime-extractor-gfz5s\" (UID: \"6ade753c-243c-4077-9f45-12bb257db737\") " pod="openshift-insights/insights-runtime-extractor-gfz5s" May 21 10:33:00.174791 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:00.174731 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6ade753c-243c-4077-9f45-12bb257db737-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gfz5s\" (UID: \"6ade753c-243c-4077-9f45-12bb257db737\") " pod="openshift-insights/insights-runtime-extractor-gfz5s" May 21 10:33:00.275444 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:00.275410 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6ade753c-243c-4077-9f45-12bb257db737-crio-socket\") pod \"insights-runtime-extractor-gfz5s\" (UID: \"6ade753c-243c-4077-9f45-12bb257db737\") " pod="openshift-insights/insights-runtime-extractor-gfz5s" May 21 10:33:00.275444 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:00.275454 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qs56x\" (UniqueName: \"kubernetes.io/projected/6ade753c-243c-4077-9f45-12bb257db737-kube-api-access-qs56x\") pod \"insights-runtime-extractor-gfz5s\" (UID: \"6ade753c-243c-4077-9f45-12bb257db737\") " pod="openshift-insights/insights-runtime-extractor-gfz5s" May 21 10:33:00.275661 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:00.275477 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6ade753c-243c-4077-9f45-12bb257db737-data-volume\") pod \"insights-runtime-extractor-gfz5s\" (UID: \"6ade753c-243c-4077-9f45-12bb257db737\") " pod="openshift-insights/insights-runtime-extractor-gfz5s" May 21 10:33:00.275661 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:00.275542 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6ade753c-243c-4077-9f45-12bb257db737-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gfz5s\" (UID: \"6ade753c-243c-4077-9f45-12bb257db737\") " pod="openshift-insights/insights-runtime-extractor-gfz5s" May 21 10:33:00.275661 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:00.275592 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6ade753c-243c-4077-9f45-12bb257db737-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gfz5s\" (UID: \"6ade753c-243c-4077-9f45-12bb257db737\") " pod="openshift-insights/insights-runtime-extractor-gfz5s" May 21 10:33:00.275661 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:00.275542 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6ade753c-243c-4077-9f45-12bb257db737-crio-socket\") pod \"insights-runtime-extractor-gfz5s\" (UID: \"6ade753c-243c-4077-9f45-12bb257db737\") " pod="openshift-insights/insights-runtime-extractor-gfz5s" May 21 10:33:00.275900 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:00.275880 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6ade753c-243c-4077-9f45-12bb257db737-data-volume\") pod \"insights-runtime-extractor-gfz5s\" (UID: \"6ade753c-243c-4077-9f45-12bb257db737\") " pod="openshift-insights/insights-runtime-extractor-gfz5s" May 21 10:33:00.276178 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:00.276157 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6ade753c-243c-4077-9f45-12bb257db737-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gfz5s\" (UID: \"6ade753c-243c-4077-9f45-12bb257db737\") " pod="openshift-insights/insights-runtime-extractor-gfz5s" May 21 10:33:00.277830 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:00.277808 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6ade753c-243c-4077-9f45-12bb257db737-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gfz5s\" (UID: \"6ade753c-243c-4077-9f45-12bb257db737\") " pod="openshift-insights/insights-runtime-extractor-gfz5s" May 21 10:33:00.293098 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:00.293068 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qs56x\" (UniqueName: \"kubernetes.io/projected/6ade753c-243c-4077-9f45-12bb257db737-kube-api-access-qs56x\") pod \"insights-runtime-extractor-gfz5s\" (UID: \"6ade753c-243c-4077-9f45-12bb257db737\") " pod="openshift-insights/insights-runtime-extractor-gfz5s" May 21 10:33:00.401935 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:00.401849 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gfz5s" May 21 10:33:00.544133 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:00.544102 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gfz5s"] May 21 10:33:00.547349 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:33:00.547316 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ade753c_243c_4077_9f45_12bb257db737.slice/crio-5125858b7cea67ed1238336d9bf0cf2928d0edcdf5903ec64b0bbdcfdf0f9849 WatchSource:0}: Error finding container 5125858b7cea67ed1238336d9bf0cf2928d0edcdf5903ec64b0bbdcfdf0f9849: Status 404 returned error can't find the container with id 5125858b7cea67ed1238336d9bf0cf2928d0edcdf5903ec64b0bbdcfdf0f9849 May 21 10:33:01.081520 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:01.081476 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gfz5s" event={"ID":"6ade753c-243c-4077-9f45-12bb257db737","Type":"ContainerStarted","Data":"497aa5b28b90fe76f5048257bea9caaa0d0948c4c959f2b0614a5b4ec8f4ea14"} May 21 10:33:01.081520 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:01.081515 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gfz5s" event={"ID":"6ade753c-243c-4077-9f45-12bb257db737","Type":"ContainerStarted","Data":"5125858b7cea67ed1238336d9bf0cf2928d0edcdf5903ec64b0bbdcfdf0f9849"} May 21 10:33:01.632530 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:01.632482 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flzlz" May 21 10:33:02.085466 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:02.085432 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gfz5s" event={"ID":"6ade753c-243c-4077-9f45-12bb257db737","Type":"ContainerStarted","Data":"7075ac0a35e52dbd496b442d0baf62ed7195d2b5027cdd6b781ebb0ea63b50a4"} May 21 10:33:02.395304 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:02.395225 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2714d3c9-b9b4-4905-88df-0ddd2e25c008-metrics-certs\") pod \"router-default-5546c4f488-zdc6s\" (UID: \"2714d3c9-b9b4-4905-88df-0ddd2e25c008\") " pod="openshift-ingress/router-default-5546c4f488-zdc6s" May 21 10:33:02.395304 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:02.395271 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2714d3c9-b9b4-4905-88df-0ddd2e25c008-service-ca-bundle\") pod \"router-default-5546c4f488-zdc6s\" (UID: \"2714d3c9-b9b4-4905-88df-0ddd2e25c008\") " pod="openshift-ingress/router-default-5546c4f488-zdc6s" May 21 10:33:02.395874 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:02.395851 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2714d3c9-b9b4-4905-88df-0ddd2e25c008-service-ca-bundle\") pod \"router-default-5546c4f488-zdc6s\" (UID: \"2714d3c9-b9b4-4905-88df-0ddd2e25c008\") " pod="openshift-ingress/router-default-5546c4f488-zdc6s" May 21 10:33:02.397550 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:02.397523 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2714d3c9-b9b4-4905-88df-0ddd2e25c008-metrics-certs\") pod \"router-default-5546c4f488-zdc6s\" (UID: \"2714d3c9-b9b4-4905-88df-0ddd2e25c008\") " pod="openshift-ingress/router-default-5546c4f488-zdc6s" May 21 10:33:02.658861 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:02.658771 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5546c4f488-zdc6s" May 21 10:33:02.818244 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:02.818207 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5546c4f488-zdc6s"] May 21 10:33:02.821175 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:33:02.821146 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2714d3c9_b9b4_4905_88df_0ddd2e25c008.slice/crio-c590bb4f73c962fdf417e1895c836612f1568a54976fa4195128b3c027852db3 WatchSource:0}: Error finding container c590bb4f73c962fdf417e1895c836612f1568a54976fa4195128b3c027852db3: Status 404 returned error can't find the container with id c590bb4f73c962fdf417e1895c836612f1568a54976fa4195128b3c027852db3 May 21 10:33:03.063444 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:03.063413 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-2z5ml" May 21 10:33:03.089482 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:03.089443 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5546c4f488-zdc6s" event={"ID":"2714d3c9-b9b4-4905-88df-0ddd2e25c008","Type":"ContainerStarted","Data":"7c605ba29eab8f84b658e873f2e8ba987c9d4cba0dc9e6c0e2933ce6016ccf4d"} May 21 10:33:03.089482 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:03.089487 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5546c4f488-zdc6s" event={"ID":"2714d3c9-b9b4-4905-88df-0ddd2e25c008","Type":"ContainerStarted","Data":"c590bb4f73c962fdf417e1895c836612f1568a54976fa4195128b3c027852db3"} May 21 10:33:03.126439 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:03.126383 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-5546c4f488-zdc6s" podStartSLOduration=33.126363426 podStartE2EDuration="33.126363426s" podCreationTimestamp="2026-05-21 10:32:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 10:33:03.124571459 +0000 UTC m=+176.037950799" watchObservedRunningTime="2026-05-21 10:33:03.126363426 +0000 UTC m=+176.039742498" May 21 10:33:03.659132 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:03.659107 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5546c4f488-zdc6s" May 21 10:33:03.661696 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:03.661674 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5546c4f488-zdc6s" May 21 10:33:04.093638 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:04.093606 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gfz5s" event={"ID":"6ade753c-243c-4077-9f45-12bb257db737","Type":"ContainerStarted","Data":"47cc6f1469b1e0c048ce7bcb8784866c4fc1995b37c7dcffa7e2650c9339e888"} May 21 10:33:04.094032 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:04.094014 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5546c4f488-zdc6s" May 21 10:33:04.095224 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:04.095203 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5546c4f488-zdc6s" May 21 10:33:04.133543 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:04.133490 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-gfz5s" podStartSLOduration=1.147137929 podStartE2EDuration="4.133453598s" podCreationTimestamp="2026-05-21 10:33:00 +0000 UTC" firstStartedPulling="2026-05-21 10:33:00.610825223 +0000 UTC m=+173.524204271" lastFinishedPulling="2026-05-21 10:33:03.597140878 +0000 UTC m=+176.510519940" observedRunningTime="2026-05-21 10:33:04.132689695 +0000 UTC m=+177.046068775" watchObservedRunningTime="2026-05-21 10:33:04.133453598 +0000 UTC m=+177.046832667" May 21 10:33:05.534882 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:05.534850 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-86f5598957-kfljn"] May 21 10:33:05.538073 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:05.538051 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86f5598957-kfljn" May 21 10:33:05.540457 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:05.540432 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" May 21 10:33:05.541402 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:05.541324 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" May 21 10:33:05.541402 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:05.541356 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-p6w48\"" May 21 10:33:05.541402 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:05.541363 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" May 21 10:33:05.541890 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:05.541875 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" May 21 10:33:05.542337 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:05.542323 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" May 21 10:33:05.542337 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:05.542341 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" May 21 10:33:05.542484 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:05.542468 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" May 21 10:33:05.557226 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:05.557207 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86f5598957-kfljn"] May 21 10:33:05.623575 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:05.623533 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sm8lh\" (UniqueName: \"kubernetes.io/projected/d416785a-b408-4452-a55a-a0b95e9583c1-kube-api-access-sm8lh\") pod \"console-86f5598957-kfljn\" (UID: \"d416785a-b408-4452-a55a-a0b95e9583c1\") " pod="openshift-console/console-86f5598957-kfljn" May 21 10:33:05.623747 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:05.623631 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d416785a-b408-4452-a55a-a0b95e9583c1-service-ca\") pod \"console-86f5598957-kfljn\" (UID: \"d416785a-b408-4452-a55a-a0b95e9583c1\") " pod="openshift-console/console-86f5598957-kfljn" May 21 10:33:05.623747 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:05.623662 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d416785a-b408-4452-a55a-a0b95e9583c1-console-config\") pod \"console-86f5598957-kfljn\" (UID: \"d416785a-b408-4452-a55a-a0b95e9583c1\") " pod="openshift-console/console-86f5598957-kfljn" May 21 10:33:05.623747 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:05.623688 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d416785a-b408-4452-a55a-a0b95e9583c1-console-oauth-config\") pod \"console-86f5598957-kfljn\" (UID: \"d416785a-b408-4452-a55a-a0b95e9583c1\") " pod="openshift-console/console-86f5598957-kfljn" May 21 10:33:05.623747 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:05.623710 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d416785a-b408-4452-a55a-a0b95e9583c1-oauth-serving-cert\") pod \"console-86f5598957-kfljn\" (UID: \"d416785a-b408-4452-a55a-a0b95e9583c1\") " pod="openshift-console/console-86f5598957-kfljn" May 21 10:33:05.623747 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:05.623729 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d416785a-b408-4452-a55a-a0b95e9583c1-console-serving-cert\") pod \"console-86f5598957-kfljn\" (UID: \"d416785a-b408-4452-a55a-a0b95e9583c1\") " pod="openshift-console/console-86f5598957-kfljn" May 21 10:33:05.724400 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:05.724358 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sm8lh\" (UniqueName: \"kubernetes.io/projected/d416785a-b408-4452-a55a-a0b95e9583c1-kube-api-access-sm8lh\") pod \"console-86f5598957-kfljn\" (UID: \"d416785a-b408-4452-a55a-a0b95e9583c1\") " pod="openshift-console/console-86f5598957-kfljn" May 21 10:33:05.724574 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:05.724418 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d416785a-b408-4452-a55a-a0b95e9583c1-service-ca\") pod \"console-86f5598957-kfljn\" (UID: \"d416785a-b408-4452-a55a-a0b95e9583c1\") " pod="openshift-console/console-86f5598957-kfljn" May 21 10:33:05.724574 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:05.724437 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d416785a-b408-4452-a55a-a0b95e9583c1-console-config\") pod \"console-86f5598957-kfljn\" (UID: \"d416785a-b408-4452-a55a-a0b95e9583c1\") " pod="openshift-console/console-86f5598957-kfljn" May 21 10:33:05.724574 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:05.724455 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d416785a-b408-4452-a55a-a0b95e9583c1-console-oauth-config\") pod \"console-86f5598957-kfljn\" (UID: \"d416785a-b408-4452-a55a-a0b95e9583c1\") " pod="openshift-console/console-86f5598957-kfljn" May 21 10:33:05.724574 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:05.724474 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d416785a-b408-4452-a55a-a0b95e9583c1-oauth-serving-cert\") pod \"console-86f5598957-kfljn\" (UID: \"d416785a-b408-4452-a55a-a0b95e9583c1\") " pod="openshift-console/console-86f5598957-kfljn" May 21 10:33:05.724574 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:05.724493 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d416785a-b408-4452-a55a-a0b95e9583c1-console-serving-cert\") pod \"console-86f5598957-kfljn\" (UID: \"d416785a-b408-4452-a55a-a0b95e9583c1\") " pod="openshift-console/console-86f5598957-kfljn" May 21 10:33:05.725186 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:05.725158 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d416785a-b408-4452-a55a-a0b95e9583c1-console-config\") pod \"console-86f5598957-kfljn\" (UID: \"d416785a-b408-4452-a55a-a0b95e9583c1\") " pod="openshift-console/console-86f5598957-kfljn" May 21 10:33:05.725307 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:05.725181 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d416785a-b408-4452-a55a-a0b95e9583c1-service-ca\") pod \"console-86f5598957-kfljn\" (UID: \"d416785a-b408-4452-a55a-a0b95e9583c1\") " pod="openshift-console/console-86f5598957-kfljn" May 21 10:33:05.725307 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:05.725209 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d416785a-b408-4452-a55a-a0b95e9583c1-oauth-serving-cert\") pod \"console-86f5598957-kfljn\" (UID: \"d416785a-b408-4452-a55a-a0b95e9583c1\") " pod="openshift-console/console-86f5598957-kfljn" May 21 10:33:05.726885 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:05.726857 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d416785a-b408-4452-a55a-a0b95e9583c1-console-oauth-config\") pod \"console-86f5598957-kfljn\" (UID: \"d416785a-b408-4452-a55a-a0b95e9583c1\") " pod="openshift-console/console-86f5598957-kfljn" May 21 10:33:05.727036 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:05.727019 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d416785a-b408-4452-a55a-a0b95e9583c1-console-serving-cert\") pod \"console-86f5598957-kfljn\" (UID: \"d416785a-b408-4452-a55a-a0b95e9583c1\") " pod="openshift-console/console-86f5598957-kfljn" May 21 10:33:05.739636 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:05.739604 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sm8lh\" (UniqueName: \"kubernetes.io/projected/d416785a-b408-4452-a55a-a0b95e9583c1-kube-api-access-sm8lh\") pod \"console-86f5598957-kfljn\" (UID: \"d416785a-b408-4452-a55a-a0b95e9583c1\") " pod="openshift-console/console-86f5598957-kfljn" May 21 10:33:05.847155 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:05.847124 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86f5598957-kfljn" May 21 10:33:06.027108 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:06.027068 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86f5598957-kfljn"] May 21 10:33:06.030110 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:33:06.030082 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd416785a_b408_4452_a55a_a0b95e9583c1.slice/crio-5fdda3d264a7bc085ef9cd5e5c54030ff69d4249e207a5cb11e98d591518e9de WatchSource:0}: Error finding container 5fdda3d264a7bc085ef9cd5e5c54030ff69d4249e207a5cb11e98d591518e9de: Status 404 returned error can't find the container with id 5fdda3d264a7bc085ef9cd5e5c54030ff69d4249e207a5cb11e98d591518e9de May 21 10:33:06.100466 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:06.100383 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86f5598957-kfljn" event={"ID":"d416785a-b408-4452-a55a-a0b95e9583c1","Type":"ContainerStarted","Data":"5fdda3d264a7bc085ef9cd5e5c54030ff69d4249e207a5cb11e98d591518e9de"} May 21 10:33:06.167866 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:06.167839 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-r8llm"] May 21 10:33:06.172051 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:06.172033 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-r8llm" May 21 10:33:06.175029 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:06.175005 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-6lhzh\"" May 21 10:33:06.175147 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:06.175102 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" May 21 10:33:06.189882 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:06.189857 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-r8llm"] May 21 10:33:06.328751 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:06.328717 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/28424576-00fd-4711-96a3-63a112c70ee8-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-r8llm\" (UID: \"28424576-00fd-4711-96a3-63a112c70ee8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-r8llm" May 21 10:33:06.429236 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:06.429154 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/28424576-00fd-4711-96a3-63a112c70ee8-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-r8llm\" (UID: \"28424576-00fd-4711-96a3-63a112c70ee8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-r8llm" May 21 10:33:06.431519 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:06.431496 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/28424576-00fd-4711-96a3-63a112c70ee8-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-r8llm\" (UID: \"28424576-00fd-4711-96a3-63a112c70ee8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-r8llm" May 21 10:33:06.480842 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:06.480811 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-r8llm" May 21 10:33:06.607443 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:06.607406 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-r8llm"] May 21 10:33:06.610558 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:33:06.610520 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28424576_00fd_4711_96a3_63a112c70ee8.slice/crio-afe1926476ff0e9116228d05e55181155021a17b1a0a48e7e57c979931839b19 WatchSource:0}: Error finding container afe1926476ff0e9116228d05e55181155021a17b1a0a48e7e57c979931839b19: Status 404 returned error can't find the container with id afe1926476ff0e9116228d05e55181155021a17b1a0a48e7e57c979931839b19 May 21 10:33:07.110017 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:07.109924 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-r8llm" event={"ID":"28424576-00fd-4711-96a3-63a112c70ee8","Type":"ContainerStarted","Data":"afe1926476ff0e9116228d05e55181155021a17b1a0a48e7e57c979931839b19"} May 21 10:33:09.116431 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:09.116396 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86f5598957-kfljn" event={"ID":"d416785a-b408-4452-a55a-a0b95e9583c1","Type":"ContainerStarted","Data":"3568c1129f151a58293c92dd0a570030e7b212087db04661b5b4fbcc7c41d531"} May 21 10:33:09.117678 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:09.117653 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-r8llm" event={"ID":"28424576-00fd-4711-96a3-63a112c70ee8","Type":"ContainerStarted","Data":"7bdcb76685becaed82d5d16dca0c85a38fa7f9a69844302a7faf9af33e9c52bb"} May 21 10:33:09.117862 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:09.117843 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-r8llm" May 21 10:33:09.122538 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:09.122519 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-r8llm" May 21 10:33:09.136335 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:09.136293 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-86f5598957-kfljn" podStartSLOduration=1.177856727 podStartE2EDuration="4.136281245s" podCreationTimestamp="2026-05-21 10:33:05 +0000 UTC" firstStartedPulling="2026-05-21 10:33:06.031934395 +0000 UTC m=+178.945313447" lastFinishedPulling="2026-05-21 10:33:08.990358917 +0000 UTC m=+181.903737965" observedRunningTime="2026-05-21 10:33:09.135718948 +0000 UTC m=+182.049098030" watchObservedRunningTime="2026-05-21 10:33:09.136281245 +0000 UTC m=+182.049660315" May 21 10:33:09.155482 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:09.155440 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-r8llm" podStartSLOduration=0.783637092 podStartE2EDuration="3.155427134s" podCreationTimestamp="2026-05-21 10:33:06 +0000 UTC" firstStartedPulling="2026-05-21 10:33:06.612739915 +0000 UTC m=+179.526118977" lastFinishedPulling="2026-05-21 10:33:08.984529962 +0000 UTC m=+181.897909019" observedRunningTime="2026-05-21 10:33:09.154807535 +0000 UTC m=+182.068186606" watchObservedRunningTime="2026-05-21 10:33:09.155427134 +0000 UTC m=+182.068806205" May 21 10:33:10.154969 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:10.154909 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-f86f8cb9b-92xdp" May 21 10:33:14.883936 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:14.883900 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6794c6745f-sv894"] May 21 10:33:14.887390 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:14.887370 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6794c6745f-sv894" May 21 10:33:14.894728 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:14.894706 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" May 21 10:33:14.896992 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:14.896968 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6794c6745f-sv894"] May 21 10:33:14.997467 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:14.997427 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8820f2db-b345-4b16-9e47-fd3c512b8afd-oauth-serving-cert\") pod \"console-6794c6745f-sv894\" (UID: \"8820f2db-b345-4b16-9e47-fd3c512b8afd\") " pod="openshift-console/console-6794c6745f-sv894" May 21 10:33:14.997467 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:14.997476 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8820f2db-b345-4b16-9e47-fd3c512b8afd-console-serving-cert\") pod \"console-6794c6745f-sv894\" (UID: \"8820f2db-b345-4b16-9e47-fd3c512b8afd\") " pod="openshift-console/console-6794c6745f-sv894" May 21 10:33:14.997721 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:14.997503 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8820f2db-b345-4b16-9e47-fd3c512b8afd-console-oauth-config\") pod \"console-6794c6745f-sv894\" (UID: \"8820f2db-b345-4b16-9e47-fd3c512b8afd\") " pod="openshift-console/console-6794c6745f-sv894" May 21 10:33:14.997721 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:14.997549 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8820f2db-b345-4b16-9e47-fd3c512b8afd-trusted-ca-bundle\") pod \"console-6794c6745f-sv894\" (UID: \"8820f2db-b345-4b16-9e47-fd3c512b8afd\") " pod="openshift-console/console-6794c6745f-sv894" May 21 10:33:14.997721 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:14.997594 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8820f2db-b345-4b16-9e47-fd3c512b8afd-console-config\") pod \"console-6794c6745f-sv894\" (UID: \"8820f2db-b345-4b16-9e47-fd3c512b8afd\") " pod="openshift-console/console-6794c6745f-sv894" May 21 10:33:14.997721 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:14.997617 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8820f2db-b345-4b16-9e47-fd3c512b8afd-service-ca\") pod \"console-6794c6745f-sv894\" (UID: \"8820f2db-b345-4b16-9e47-fd3c512b8afd\") " pod="openshift-console/console-6794c6745f-sv894" May 21 10:33:14.997721 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:14.997652 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pv5fv\" (UniqueName: \"kubernetes.io/projected/8820f2db-b345-4b16-9e47-fd3c512b8afd-kube-api-access-pv5fv\") pod \"console-6794c6745f-sv894\" (UID: \"8820f2db-b345-4b16-9e47-fd3c512b8afd\") " pod="openshift-console/console-6794c6745f-sv894" May 21 10:33:15.098302 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:15.098267 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8820f2db-b345-4b16-9e47-fd3c512b8afd-console-serving-cert\") pod \"console-6794c6745f-sv894\" (UID: \"8820f2db-b345-4b16-9e47-fd3c512b8afd\") " pod="openshift-console/console-6794c6745f-sv894" May 21 10:33:15.098302 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:15.098308 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8820f2db-b345-4b16-9e47-fd3c512b8afd-console-oauth-config\") pod \"console-6794c6745f-sv894\" (UID: \"8820f2db-b345-4b16-9e47-fd3c512b8afd\") " pod="openshift-console/console-6794c6745f-sv894" May 21 10:33:15.098537 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:15.098324 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8820f2db-b345-4b16-9e47-fd3c512b8afd-trusted-ca-bundle\") pod \"console-6794c6745f-sv894\" (UID: \"8820f2db-b345-4b16-9e47-fd3c512b8afd\") " pod="openshift-console/console-6794c6745f-sv894" May 21 10:33:15.098537 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:15.098346 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8820f2db-b345-4b16-9e47-fd3c512b8afd-console-config\") pod \"console-6794c6745f-sv894\" (UID: \"8820f2db-b345-4b16-9e47-fd3c512b8afd\") " pod="openshift-console/console-6794c6745f-sv894" May 21 10:33:15.098537 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:15.098491 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8820f2db-b345-4b16-9e47-fd3c512b8afd-service-ca\") pod \"console-6794c6745f-sv894\" (UID: \"8820f2db-b345-4b16-9e47-fd3c512b8afd\") " pod="openshift-console/console-6794c6745f-sv894" May 21 10:33:15.098683 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:15.098550 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pv5fv\" (UniqueName: \"kubernetes.io/projected/8820f2db-b345-4b16-9e47-fd3c512b8afd-kube-api-access-pv5fv\") pod \"console-6794c6745f-sv894\" (UID: \"8820f2db-b345-4b16-9e47-fd3c512b8afd\") " pod="openshift-console/console-6794c6745f-sv894" May 21 10:33:15.098683 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:15.098643 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8820f2db-b345-4b16-9e47-fd3c512b8afd-oauth-serving-cert\") pod \"console-6794c6745f-sv894\" (UID: \"8820f2db-b345-4b16-9e47-fd3c512b8afd\") " pod="openshift-console/console-6794c6745f-sv894" May 21 10:33:15.099212 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:15.099182 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8820f2db-b345-4b16-9e47-fd3c512b8afd-service-ca\") pod \"console-6794c6745f-sv894\" (UID: \"8820f2db-b345-4b16-9e47-fd3c512b8afd\") " pod="openshift-console/console-6794c6745f-sv894" May 21 10:33:15.099330 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:15.099225 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8820f2db-b345-4b16-9e47-fd3c512b8afd-oauth-serving-cert\") pod \"console-6794c6745f-sv894\" (UID: \"8820f2db-b345-4b16-9e47-fd3c512b8afd\") " pod="openshift-console/console-6794c6745f-sv894" May 21 10:33:15.099370 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:15.099358 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8820f2db-b345-4b16-9e47-fd3c512b8afd-trusted-ca-bundle\") pod \"console-6794c6745f-sv894\" (UID: \"8820f2db-b345-4b16-9e47-fd3c512b8afd\") " pod="openshift-console/console-6794c6745f-sv894" May 21 10:33:15.099409 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:15.099390 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8820f2db-b345-4b16-9e47-fd3c512b8afd-console-config\") pod \"console-6794c6745f-sv894\" (UID: \"8820f2db-b345-4b16-9e47-fd3c512b8afd\") " pod="openshift-console/console-6794c6745f-sv894" May 21 10:33:15.100886 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:15.100857 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8820f2db-b345-4b16-9e47-fd3c512b8afd-console-oauth-config\") pod \"console-6794c6745f-sv894\" (UID: \"8820f2db-b345-4b16-9e47-fd3c512b8afd\") " pod="openshift-console/console-6794c6745f-sv894" May 21 10:33:15.101022 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:15.100964 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8820f2db-b345-4b16-9e47-fd3c512b8afd-console-serving-cert\") pod \"console-6794c6745f-sv894\" (UID: \"8820f2db-b345-4b16-9e47-fd3c512b8afd\") " pod="openshift-console/console-6794c6745f-sv894" May 21 10:33:15.106282 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:15.106253 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pv5fv\" (UniqueName: \"kubernetes.io/projected/8820f2db-b345-4b16-9e47-fd3c512b8afd-kube-api-access-pv5fv\") pod \"console-6794c6745f-sv894\" (UID: \"8820f2db-b345-4b16-9e47-fd3c512b8afd\") " pod="openshift-console/console-6794c6745f-sv894" May 21 10:33:15.196630 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:15.196548 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6794c6745f-sv894" May 21 10:33:15.322548 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:15.322512 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6794c6745f-sv894"] May 21 10:33:15.325536 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:33:15.325509 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8820f2db_b345_4b16_9e47_fd3c512b8afd.slice/crio-832823d15b823159bcdd1adffd189b6b49366471a61c8aca302c70bd9d359097 WatchSource:0}: Error finding container 832823d15b823159bcdd1adffd189b6b49366471a61c8aca302c70bd9d359097: Status 404 returned error can't find the container with id 832823d15b823159bcdd1adffd189b6b49366471a61c8aca302c70bd9d359097 May 21 10:33:15.847322 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:15.847290 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-86f5598957-kfljn" May 21 10:33:15.847322 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:15.847330 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-86f5598957-kfljn" May 21 10:33:15.851722 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:15.851696 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-86f5598957-kfljn" May 21 10:33:16.137140 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:16.137060 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6794c6745f-sv894" event={"ID":"8820f2db-b345-4b16-9e47-fd3c512b8afd","Type":"ContainerStarted","Data":"7dd46f8d2978d8457ad70b435ff8c4908685e623242c8aa34de9566c717d651a"} May 21 10:33:16.137140 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:16.137102 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6794c6745f-sv894" event={"ID":"8820f2db-b345-4b16-9e47-fd3c512b8afd","Type":"ContainerStarted","Data":"832823d15b823159bcdd1adffd189b6b49366471a61c8aca302c70bd9d359097"} May 21 10:33:16.140873 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:16.140854 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-86f5598957-kfljn" May 21 10:33:16.158377 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:16.158322 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6794c6745f-sv894" podStartSLOduration=2.158308101 podStartE2EDuration="2.158308101s" podCreationTimestamp="2026-05-21 10:33:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 10:33:16.158124421 +0000 UTC m=+189.071503503" watchObservedRunningTime="2026-05-21 10:33:16.158308101 +0000 UTC m=+189.071687171" May 21 10:33:21.870910 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:21.870869 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-zrdzr"] May 21 10:33:21.875669 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:21.875647 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-zrdzr" May 21 10:33:21.883452 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:21.883422 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" May 21 10:33:21.884350 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:21.884123 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 21 10:33:21.884350 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:21.884133 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" May 21 10:33:21.884350 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:21.884192 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-9j762\"" May 21 10:33:21.884350 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:21.884134 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 21 10:33:21.884886 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:21.884414 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 21 10:33:21.893436 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:21.893415 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-zrdzr"] May 21 10:33:21.942718 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:21.942680 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/00a00434-c44c-4e86-9e0c-857966a8b08d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-zrdzr\" (UID: \"00a00434-c44c-4e86-9e0c-857966a8b08d\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-zrdzr" May 21 10:33:21.942868 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:21.942737 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hr47b\" (UniqueName: \"kubernetes.io/projected/00a00434-c44c-4e86-9e0c-857966a8b08d-kube-api-access-hr47b\") pod \"openshift-state-metrics-9c959559f-zrdzr\" (UID: \"00a00434-c44c-4e86-9e0c-857966a8b08d\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-zrdzr" May 21 10:33:21.942868 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:21.942827 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/00a00434-c44c-4e86-9e0c-857966a8b08d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-zrdzr\" (UID: \"00a00434-c44c-4e86-9e0c-857966a8b08d\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-zrdzr" May 21 10:33:21.942994 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:21.942875 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/00a00434-c44c-4e86-9e0c-857966a8b08d-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-zrdzr\" (UID: \"00a00434-c44c-4e86-9e0c-857966a8b08d\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-zrdzr" May 21 10:33:21.952287 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:21.952263 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-q44qc"] May 21 10:33:21.955809 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:21.955791 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-q44qc" May 21 10:33:21.958896 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:21.958877 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 21 10:33:21.959178 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:21.959159 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 21 10:33:21.959751 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:21.959735 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 21 10:33:21.959931 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:21.959914 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-l8f84\"" May 21 10:33:22.043403 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:22.043376 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4e58fb5d-ddc2-489e-ab5d-d7ee49f51750-root\") pod \"node-exporter-q44qc\" (UID: \"4e58fb5d-ddc2-489e-ab5d-d7ee49f51750\") " pod="openshift-monitoring/node-exporter-q44qc" May 21 10:33:22.043575 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:22.043414 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4e58fb5d-ddc2-489e-ab5d-d7ee49f51750-node-exporter-tls\") pod \"node-exporter-q44qc\" (UID: \"4e58fb5d-ddc2-489e-ab5d-d7ee49f51750\") " pod="openshift-monitoring/node-exporter-q44qc" May 21 10:33:22.043575 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:22.043451 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4e58fb5d-ddc2-489e-ab5d-d7ee49f51750-node-exporter-accelerators-collector-config\") pod \"node-exporter-q44qc\" (UID: \"4e58fb5d-ddc2-489e-ab5d-d7ee49f51750\") " pod="openshift-monitoring/node-exporter-q44qc" May 21 10:33:22.043575 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:22.043490 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/00a00434-c44c-4e86-9e0c-857966a8b08d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-zrdzr\" (UID: \"00a00434-c44c-4e86-9e0c-857966a8b08d\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-zrdzr" May 21 10:33:22.043575 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:22.043541 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e58fb5d-ddc2-489e-ab5d-d7ee49f51750-metrics-client-ca\") pod \"node-exporter-q44qc\" (UID: \"4e58fb5d-ddc2-489e-ab5d-d7ee49f51750\") " pod="openshift-monitoring/node-exporter-q44qc" May 21 10:33:22.043575 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:22.043576 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4e58fb5d-ddc2-489e-ab5d-d7ee49f51750-node-exporter-textfile\") pod \"node-exporter-q44qc\" (UID: \"4e58fb5d-ddc2-489e-ab5d-d7ee49f51750\") " pod="openshift-monitoring/node-exporter-q44qc" May 21 10:33:22.043805 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:22.043607 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/00a00434-c44c-4e86-9e0c-857966a8b08d-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-zrdzr\" (UID: \"00a00434-c44c-4e86-9e0c-857966a8b08d\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-zrdzr" May 21 10:33:22.043805 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:22.043624 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d68fb\" (UniqueName: \"kubernetes.io/projected/4e58fb5d-ddc2-489e-ab5d-d7ee49f51750-kube-api-access-d68fb\") pod \"node-exporter-q44qc\" (UID: \"4e58fb5d-ddc2-489e-ab5d-d7ee49f51750\") " pod="openshift-monitoring/node-exporter-q44qc" May 21 10:33:22.043805 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:22.043644 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4e58fb5d-ddc2-489e-ab5d-d7ee49f51750-sys\") pod \"node-exporter-q44qc\" (UID: \"4e58fb5d-ddc2-489e-ab5d-d7ee49f51750\") " pod="openshift-monitoring/node-exporter-q44qc" May 21 10:33:22.043805 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:22.043672 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/00a00434-c44c-4e86-9e0c-857966a8b08d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-zrdzr\" (UID: \"00a00434-c44c-4e86-9e0c-857966a8b08d\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-zrdzr" May 21 10:33:22.043805 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:22.043692 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4e58fb5d-ddc2-489e-ab5d-d7ee49f51750-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-q44qc\" (UID: \"4e58fb5d-ddc2-489e-ab5d-d7ee49f51750\") " pod="openshift-monitoring/node-exporter-q44qc" May 21 10:33:22.043805 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:22.043738 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hr47b\" (UniqueName: \"kubernetes.io/projected/00a00434-c44c-4e86-9e0c-857966a8b08d-kube-api-access-hr47b\") pod \"openshift-state-metrics-9c959559f-zrdzr\" (UID: \"00a00434-c44c-4e86-9e0c-857966a8b08d\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-zrdzr" May 21 10:33:22.043805 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:22.043770 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4e58fb5d-ddc2-489e-ab5d-d7ee49f51750-node-exporter-wtmp\") pod \"node-exporter-q44qc\" (UID: \"4e58fb5d-ddc2-489e-ab5d-d7ee49f51750\") " pod="openshift-monitoring/node-exporter-q44qc" May 21 10:33:22.044280 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:22.044262 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/00a00434-c44c-4e86-9e0c-857966a8b08d-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-zrdzr\" (UID: \"00a00434-c44c-4e86-9e0c-857966a8b08d\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-zrdzr" May 21 10:33:22.045908 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:22.045886 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/00a00434-c44c-4e86-9e0c-857966a8b08d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-zrdzr\" (UID: \"00a00434-c44c-4e86-9e0c-857966a8b08d\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-zrdzr" May 21 10:33:22.046045 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:22.045974 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/00a00434-c44c-4e86-9e0c-857966a8b08d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-zrdzr\" (UID: \"00a00434-c44c-4e86-9e0c-857966a8b08d\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-zrdzr" May 21 10:33:22.066635 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:22.066606 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hr47b\" (UniqueName: \"kubernetes.io/projected/00a00434-c44c-4e86-9e0c-857966a8b08d-kube-api-access-hr47b\") pod \"openshift-state-metrics-9c959559f-zrdzr\" (UID: \"00a00434-c44c-4e86-9e0c-857966a8b08d\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-zrdzr" May 21 10:33:22.144584 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:22.144499 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4e58fb5d-ddc2-489e-ab5d-d7ee49f51750-sys\") pod \"node-exporter-q44qc\" (UID: \"4e58fb5d-ddc2-489e-ab5d-d7ee49f51750\") " pod="openshift-monitoring/node-exporter-q44qc" May 21 10:33:22.144584 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:22.144551 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4e58fb5d-ddc2-489e-ab5d-d7ee49f51750-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-q44qc\" (UID: \"4e58fb5d-ddc2-489e-ab5d-d7ee49f51750\") " pod="openshift-monitoring/node-exporter-q44qc" May 21 10:33:22.144763 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:22.144613 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4e58fb5d-ddc2-489e-ab5d-d7ee49f51750-sys\") pod \"node-exporter-q44qc\" (UID: \"4e58fb5d-ddc2-489e-ab5d-d7ee49f51750\") " pod="openshift-monitoring/node-exporter-q44qc" May 21 10:33:22.144763 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:22.144653 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4e58fb5d-ddc2-489e-ab5d-d7ee49f51750-node-exporter-wtmp\") pod \"node-exporter-q44qc\" (UID: \"4e58fb5d-ddc2-489e-ab5d-d7ee49f51750\") " pod="openshift-monitoring/node-exporter-q44qc" May 21 10:33:22.144763 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:22.144702 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4e58fb5d-ddc2-489e-ab5d-d7ee49f51750-root\") pod \"node-exporter-q44qc\" (UID: \"4e58fb5d-ddc2-489e-ab5d-d7ee49f51750\") " pod="openshift-monitoring/node-exporter-q44qc" May 21 10:33:22.144763 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:22.144725 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4e58fb5d-ddc2-489e-ab5d-d7ee49f51750-node-exporter-tls\") pod \"node-exporter-q44qc\" (UID: \"4e58fb5d-ddc2-489e-ab5d-d7ee49f51750\") " pod="openshift-monitoring/node-exporter-q44qc" May 21 10:33:22.144763 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:22.144756 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4e58fb5d-ddc2-489e-ab5d-d7ee49f51750-node-exporter-accelerators-collector-config\") pod \"node-exporter-q44qc\" (UID: \"4e58fb5d-ddc2-489e-ab5d-d7ee49f51750\") " pod="openshift-monitoring/node-exporter-q44qc" May 21 10:33:22.144959 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:22.144778 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e58fb5d-ddc2-489e-ab5d-d7ee49f51750-metrics-client-ca\") pod \"node-exporter-q44qc\" (UID: \"4e58fb5d-ddc2-489e-ab5d-d7ee49f51750\") " pod="openshift-monitoring/node-exporter-q44qc" May 21 10:33:22.144959 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:22.144796 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4e58fb5d-ddc2-489e-ab5d-d7ee49f51750-root\") pod \"node-exporter-q44qc\" (UID: \"4e58fb5d-ddc2-489e-ab5d-d7ee49f51750\") " pod="openshift-monitoring/node-exporter-q44qc" May 21 10:33:22.144959 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:22.144816 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4e58fb5d-ddc2-489e-ab5d-d7ee49f51750-node-exporter-textfile\") pod \"node-exporter-q44qc\" (UID: \"4e58fb5d-ddc2-489e-ab5d-d7ee49f51750\") " pod="openshift-monitoring/node-exporter-q44qc" May 21 10:33:22.144959 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:22.144824 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4e58fb5d-ddc2-489e-ab5d-d7ee49f51750-node-exporter-wtmp\") pod \"node-exporter-q44qc\" (UID: \"4e58fb5d-ddc2-489e-ab5d-d7ee49f51750\") " pod="openshift-monitoring/node-exporter-q44qc" May 21 10:33:22.144959 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:22.144854 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d68fb\" (UniqueName: \"kubernetes.io/projected/4e58fb5d-ddc2-489e-ab5d-d7ee49f51750-kube-api-access-d68fb\") pod \"node-exporter-q44qc\" (UID: \"4e58fb5d-ddc2-489e-ab5d-d7ee49f51750\") " pod="openshift-monitoring/node-exporter-q44qc" May 21 10:33:22.145259 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:22.145233 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4e58fb5d-ddc2-489e-ab5d-d7ee49f51750-node-exporter-textfile\") pod \"node-exporter-q44qc\" (UID: \"4e58fb5d-ddc2-489e-ab5d-d7ee49f51750\") " pod="openshift-monitoring/node-exporter-q44qc" May 21 10:33:22.145453 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:22.145431 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4e58fb5d-ddc2-489e-ab5d-d7ee49f51750-node-exporter-accelerators-collector-config\") pod \"node-exporter-q44qc\" (UID: \"4e58fb5d-ddc2-489e-ab5d-d7ee49f51750\") " pod="openshift-monitoring/node-exporter-q44qc" May 21 10:33:22.145505 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:22.145431 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e58fb5d-ddc2-489e-ab5d-d7ee49f51750-metrics-client-ca\") pod \"node-exporter-q44qc\" (UID: \"4e58fb5d-ddc2-489e-ab5d-d7ee49f51750\") " pod="openshift-monitoring/node-exporter-q44qc" May 21 10:33:22.147003 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:22.146962 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4e58fb5d-ddc2-489e-ab5d-d7ee49f51750-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-q44qc\" (UID: \"4e58fb5d-ddc2-489e-ab5d-d7ee49f51750\") " pod="openshift-monitoring/node-exporter-q44qc" May 21 10:33:22.147127 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:22.147040 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4e58fb5d-ddc2-489e-ab5d-d7ee49f51750-node-exporter-tls\") pod \"node-exporter-q44qc\" (UID: \"4e58fb5d-ddc2-489e-ab5d-d7ee49f51750\") " pod="openshift-monitoring/node-exporter-q44qc" May 21 10:33:22.160448 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:22.160428 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d68fb\" (UniqueName: \"kubernetes.io/projected/4e58fb5d-ddc2-489e-ab5d-d7ee49f51750-kube-api-access-d68fb\") pod \"node-exporter-q44qc\" (UID: \"4e58fb5d-ddc2-489e-ab5d-d7ee49f51750\") " pod="openshift-monitoring/node-exporter-q44qc" May 21 10:33:22.188405 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:22.188366 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-zrdzr" May 21 10:33:22.271127 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:22.271097 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-q44qc" May 21 10:33:22.281190 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:33:22.281150 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e58fb5d_ddc2_489e_ab5d_d7ee49f51750.slice/crio-94f2431fd0a40161c580389022c650253c3e97fbdb73b8978b3d5c417ca9a228 WatchSource:0}: Error finding container 94f2431fd0a40161c580389022c650253c3e97fbdb73b8978b3d5c417ca9a228: Status 404 returned error can't find the container with id 94f2431fd0a40161c580389022c650253c3e97fbdb73b8978b3d5c417ca9a228 May 21 10:33:22.326977 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:22.326923 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-zrdzr"] May 21 10:33:22.331222 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:33:22.331194 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00a00434_c44c_4e86_9e0c_857966a8b08d.slice/crio-2b3b467c5346495f1f82a682230c2bd9142f38c506371faf957aa98d8b61c7ec WatchSource:0}: Error finding container 2b3b467c5346495f1f82a682230c2bd9142f38c506371faf957aa98d8b61c7ec: Status 404 returned error can't find the container with id 2b3b467c5346495f1f82a682230c2bd9142f38c506371faf957aa98d8b61c7ec May 21 10:33:22.995170 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:22.995140 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 21 10:33:22.999206 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:22.999184 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 21 10:33:23.004036 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:23.004010 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" May 21 10:33:23.004435 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:23.004167 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" May 21 10:33:23.004435 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:23.004229 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" May 21 10:33:23.004435 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:23.004304 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" May 21 10:33:23.004639 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:23.004524 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" May 21 10:33:23.004639 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:23.004530 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" May 21 10:33:23.004639 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:23.004577 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" May 21 10:33:23.004791 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:23.004652 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-gnfw6\"" May 21 10:33:23.005004 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:23.004982 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" May 21 10:33:23.014526 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:23.014506 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" May 21 10:33:23.049014 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:23.048973 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 21 10:33:23.051095 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:23.051054 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/06722450-040f-47b8-ace4-68e8134bfa9d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"06722450-040f-47b8-ace4-68e8134bfa9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 10:33:23.051245 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:23.051107 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/06722450-040f-47b8-ace4-68e8134bfa9d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"06722450-040f-47b8-ace4-68e8134bfa9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 10:33:23.051245 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:23.051139 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/06722450-040f-47b8-ace4-68e8134bfa9d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"06722450-040f-47b8-ace4-68e8134bfa9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 10:33:23.051245 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:23.051178 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/06722450-040f-47b8-ace4-68e8134bfa9d-config-volume\") pod \"alertmanager-main-0\" (UID: \"06722450-040f-47b8-ace4-68e8134bfa9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 10:33:23.051245 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:23.051214 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/06722450-040f-47b8-ace4-68e8134bfa9d-web-config\") pod \"alertmanager-main-0\" (UID: \"06722450-040f-47b8-ace4-68e8134bfa9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 10:33:23.051245 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:23.051238 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/06722450-040f-47b8-ace4-68e8134bfa9d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"06722450-040f-47b8-ace4-68e8134bfa9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 10:33:23.051467 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:23.051341 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06722450-040f-47b8-ace4-68e8134bfa9d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"06722450-040f-47b8-ace4-68e8134bfa9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 10:33:23.051467 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:23.051376 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/06722450-040f-47b8-ace4-68e8134bfa9d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"06722450-040f-47b8-ace4-68e8134bfa9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 10:33:23.051467 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:23.051395 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/06722450-040f-47b8-ace4-68e8134bfa9d-config-out\") pod \"alertmanager-main-0\" (UID: \"06722450-040f-47b8-ace4-68e8134bfa9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 10:33:23.051467 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:23.051417 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06722450-040f-47b8-ace4-68e8134bfa9d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"06722450-040f-47b8-ace4-68e8134bfa9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 10:33:23.051467 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:23.051459 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/06722450-040f-47b8-ace4-68e8134bfa9d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"06722450-040f-47b8-ace4-68e8134bfa9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 10:33:23.051712 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:23.051486 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/06722450-040f-47b8-ace4-68e8134bfa9d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"06722450-040f-47b8-ace4-68e8134bfa9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 10:33:23.051712 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:23.051512 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jg2k8\" (UniqueName: \"kubernetes.io/projected/06722450-040f-47b8-ace4-68e8134bfa9d-kube-api-access-jg2k8\") pod \"alertmanager-main-0\" (UID: \"06722450-040f-47b8-ace4-68e8134bfa9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 10:33:23.151987 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:23.151926 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06722450-040f-47b8-ace4-68e8134bfa9d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"06722450-040f-47b8-ace4-68e8134bfa9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 10:33:23.152168 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:23.152089 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/06722450-040f-47b8-ace4-68e8134bfa9d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"06722450-040f-47b8-ace4-68e8134bfa9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 10:33:23.152168 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:23.152122 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/06722450-040f-47b8-ace4-68e8134bfa9d-config-out\") pod \"alertmanager-main-0\" (UID: \"06722450-040f-47b8-ace4-68e8134bfa9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 10:33:23.152168 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:23.152152 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06722450-040f-47b8-ace4-68e8134bfa9d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"06722450-040f-47b8-ace4-68e8134bfa9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 10:33:23.152337 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:23.152189 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/06722450-040f-47b8-ace4-68e8134bfa9d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"06722450-040f-47b8-ace4-68e8134bfa9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 10:33:23.152337 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:23.152215 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/06722450-040f-47b8-ace4-68e8134bfa9d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"06722450-040f-47b8-ace4-68e8134bfa9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 10:33:23.152337 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:23.152233 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jg2k8\" (UniqueName: \"kubernetes.io/projected/06722450-040f-47b8-ace4-68e8134bfa9d-kube-api-access-jg2k8\") pod \"alertmanager-main-0\" (UID: \"06722450-040f-47b8-ace4-68e8134bfa9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 10:33:23.152337 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:23.152262 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/06722450-040f-47b8-ace4-68e8134bfa9d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"06722450-040f-47b8-ace4-68e8134bfa9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 10:33:23.152337 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:23.152287 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/06722450-040f-47b8-ace4-68e8134bfa9d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"06722450-040f-47b8-ace4-68e8134bfa9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 10:33:23.152337 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:23.152321 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/06722450-040f-47b8-ace4-68e8134bfa9d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"06722450-040f-47b8-ace4-68e8134bfa9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 10:33:23.152609 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:23.152352 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/06722450-040f-47b8-ace4-68e8134bfa9d-config-volume\") pod \"alertmanager-main-0\" (UID: \"06722450-040f-47b8-ace4-68e8134bfa9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 10:33:23.152934 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:23.152411 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/06722450-040f-47b8-ace4-68e8134bfa9d-web-config\") pod \"alertmanager-main-0\" (UID: \"06722450-040f-47b8-ace4-68e8134bfa9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 10:33:23.153176 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:23.153148 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/06722450-040f-47b8-ace4-68e8134bfa9d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"06722450-040f-47b8-ace4-68e8134bfa9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 10:33:23.155835 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:23.153584 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06722450-040f-47b8-ace4-68e8134bfa9d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"06722450-040f-47b8-ace4-68e8134bfa9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 10:33:23.155835 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:23.153798 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06722450-040f-47b8-ace4-68e8134bfa9d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"06722450-040f-47b8-ace4-68e8134bfa9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 10:33:23.155835 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:23.154633 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/06722450-040f-47b8-ace4-68e8134bfa9d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"06722450-040f-47b8-ace4-68e8134bfa9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 10:33:23.157279 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:23.157253 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/06722450-040f-47b8-ace4-68e8134bfa9d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"06722450-040f-47b8-ace4-68e8134bfa9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 10:33:23.159599 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:23.159565 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/06722450-040f-47b8-ace4-68e8134bfa9d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"06722450-040f-47b8-ace4-68e8134bfa9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 10:33:23.159679 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:23.159597 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/06722450-040f-47b8-ace4-68e8134bfa9d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"06722450-040f-47b8-ace4-68e8134bfa9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 10:33:23.160080 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:23.160045 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/06722450-040f-47b8-ace4-68e8134bfa9d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"06722450-040f-47b8-ace4-68e8134bfa9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 10:33:23.162035 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:23.161988 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/06722450-040f-47b8-ace4-68e8134bfa9d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"06722450-040f-47b8-ace4-68e8134bfa9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 10:33:23.162035 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:23.161995 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/06722450-040f-47b8-ace4-68e8134bfa9d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"06722450-040f-47b8-ace4-68e8134bfa9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 10:33:23.162193 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:23.162060 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/06722450-040f-47b8-ace4-68e8134bfa9d-config-volume\") pod \"alertmanager-main-0\" (UID: \"06722450-040f-47b8-ace4-68e8134bfa9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 10:33:23.162193 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:23.162068 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/06722450-040f-47b8-ace4-68e8134bfa9d-config-out\") pod \"alertmanager-main-0\" (UID: \"06722450-040f-47b8-ace4-68e8134bfa9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 10:33:23.163268 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:23.163248 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/06722450-040f-47b8-ace4-68e8134bfa9d-web-config\") pod \"alertmanager-main-0\" (UID: \"06722450-040f-47b8-ace4-68e8134bfa9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 10:33:23.163935 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:23.163910 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q44qc" event={"ID":"4e58fb5d-ddc2-489e-ab5d-d7ee49f51750","Type":"ContainerStarted","Data":"94f2431fd0a40161c580389022c650253c3e97fbdb73b8978b3d5c417ca9a228"} May 21 10:33:23.165588 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:23.165567 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-zrdzr" event={"ID":"00a00434-c44c-4e86-9e0c-857966a8b08d","Type":"ContainerStarted","Data":"9d1edbb804d6061c1e1e4975cd4ce9d4da197f043c0a62ddbe8116a3093b38b5"} May 21 10:33:23.165662 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:23.165596 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-zrdzr" event={"ID":"00a00434-c44c-4e86-9e0c-857966a8b08d","Type":"ContainerStarted","Data":"3e1850c5a60a597c107b2bdd2194b06280d752f1e2263866d9156036a995df71"} May 21 10:33:23.165662 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:23.165612 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-zrdzr" event={"ID":"00a00434-c44c-4e86-9e0c-857966a8b08d","Type":"ContainerStarted","Data":"2b3b467c5346495f1f82a682230c2bd9142f38c506371faf957aa98d8b61c7ec"} May 21 10:33:23.176061 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:23.176039 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jg2k8\" (UniqueName: \"kubernetes.io/projected/06722450-040f-47b8-ace4-68e8134bfa9d-kube-api-access-jg2k8\") pod \"alertmanager-main-0\" (UID: \"06722450-040f-47b8-ace4-68e8134bfa9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 10:33:23.309602 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:23.309419 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 21 10:33:23.466367 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:23.466334 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 21 10:33:23.470626 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:33:23.470587 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06722450_040f_47b8_ace4_68e8134bfa9d.slice/crio-6968ff57287f75aa1e12266b7428fd47f9390a2c2db9dbae3a28b26f7dc76952 WatchSource:0}: Error finding container 6968ff57287f75aa1e12266b7428fd47f9390a2c2db9dbae3a28b26f7dc76952: Status 404 returned error can't find the container with id 6968ff57287f75aa1e12266b7428fd47f9390a2c2db9dbae3a28b26f7dc76952 May 21 10:33:24.170861 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:24.170770 2565 generic.go:358] "Generic (PLEG): container finished" podID="4e58fb5d-ddc2-489e-ab5d-d7ee49f51750" containerID="ddce18f90401bfeb5e3ad0bd8806368d10b05a0dfff5c814faff969da730e7a3" exitCode=0 May 21 10:33:24.171324 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:24.170856 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q44qc" event={"ID":"4e58fb5d-ddc2-489e-ab5d-d7ee49f51750","Type":"ContainerDied","Data":"ddce18f90401bfeb5e3ad0bd8806368d10b05a0dfff5c814faff969da730e7a3"} May 21 10:33:24.173177 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:24.173154 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-zrdzr" event={"ID":"00a00434-c44c-4e86-9e0c-857966a8b08d","Type":"ContainerStarted","Data":"c04005a27fe7ffca6b715129f79bf007511c763fc867445869ada4e5e8ed428b"} May 21 10:33:24.174771 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:24.174718 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"06722450-040f-47b8-ace4-68e8134bfa9d","Type":"ContainerStarted","Data":"6968ff57287f75aa1e12266b7428fd47f9390a2c2db9dbae3a28b26f7dc76952"} May 21 10:33:24.229618 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:24.229574 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-zrdzr" podStartSLOduration=1.785755166 podStartE2EDuration="3.229559346s" podCreationTimestamp="2026-05-21 10:33:21 +0000 UTC" firstStartedPulling="2026-05-21 10:33:22.454538221 +0000 UTC m=+195.367917273" lastFinishedPulling="2026-05-21 10:33:23.898342387 +0000 UTC m=+196.811721453" observedRunningTime="2026-05-21 10:33:24.227887391 +0000 UTC m=+197.141266462" watchObservedRunningTime="2026-05-21 10:33:24.229559346 +0000 UTC m=+197.142938439" May 21 10:33:24.891960 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:24.891145 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-d94ffccc-wxpld"] May 21 10:33:24.899480 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:24.899452 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-d94ffccc-wxpld" May 21 10:33:24.904985 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:24.904962 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" May 21 10:33:24.905123 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:24.904965 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" May 21 10:33:24.905190 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:24.905138 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" May 21 10:33:24.905190 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:24.905140 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" May 21 10:33:24.909387 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:24.909368 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" May 21 10:33:24.909604 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:24.909590 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-dh9n4\"" May 21 10:33:24.910850 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:24.910836 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-70it7vm3cfu5t\"" May 21 10:33:24.924608 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:24.924586 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-d94ffccc-wxpld"] May 21 10:33:24.971149 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:24.971126 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5a6283b1-365e-4c49-bfd8-f283b1926bbd-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-d94ffccc-wxpld\" (UID: \"5a6283b1-365e-4c49-bfd8-f283b1926bbd\") " pod="openshift-monitoring/thanos-querier-d94ffccc-wxpld" May 21 10:33:24.971270 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:24.971159 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5a6283b1-365e-4c49-bfd8-f283b1926bbd-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-d94ffccc-wxpld\" (UID: \"5a6283b1-365e-4c49-bfd8-f283b1926bbd\") " pod="openshift-monitoring/thanos-querier-d94ffccc-wxpld" May 21 10:33:24.971270 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:24.971190 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5a6283b1-365e-4c49-bfd8-f283b1926bbd-secret-grpc-tls\") pod \"thanos-querier-d94ffccc-wxpld\" (UID: \"5a6283b1-365e-4c49-bfd8-f283b1926bbd\") " pod="openshift-monitoring/thanos-querier-d94ffccc-wxpld" May 21 10:33:24.971270 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:24.971244 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5a6283b1-365e-4c49-bfd8-f283b1926bbd-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-d94ffccc-wxpld\" (UID: \"5a6283b1-365e-4c49-bfd8-f283b1926bbd\") " pod="openshift-monitoring/thanos-querier-d94ffccc-wxpld" May 21 10:33:24.971395 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:24.971334 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-595gl\" (UniqueName: \"kubernetes.io/projected/5a6283b1-365e-4c49-bfd8-f283b1926bbd-kube-api-access-595gl\") pod \"thanos-querier-d94ffccc-wxpld\" (UID: \"5a6283b1-365e-4c49-bfd8-f283b1926bbd\") " pod="openshift-monitoring/thanos-querier-d94ffccc-wxpld" May 21 10:33:24.971395 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:24.971385 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5a6283b1-365e-4c49-bfd8-f283b1926bbd-secret-thanos-querier-tls\") pod \"thanos-querier-d94ffccc-wxpld\" (UID: \"5a6283b1-365e-4c49-bfd8-f283b1926bbd\") " pod="openshift-monitoring/thanos-querier-d94ffccc-wxpld" May 21 10:33:24.971465 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:24.971424 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a6283b1-365e-4c49-bfd8-f283b1926bbd-metrics-client-ca\") pod \"thanos-querier-d94ffccc-wxpld\" (UID: \"5a6283b1-365e-4c49-bfd8-f283b1926bbd\") " pod="openshift-monitoring/thanos-querier-d94ffccc-wxpld" May 21 10:33:24.971465 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:24.971453 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5a6283b1-365e-4c49-bfd8-f283b1926bbd-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-d94ffccc-wxpld\" (UID: \"5a6283b1-365e-4c49-bfd8-f283b1926bbd\") " pod="openshift-monitoring/thanos-querier-d94ffccc-wxpld" May 21 10:33:25.072422 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:25.072389 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5a6283b1-365e-4c49-bfd8-f283b1926bbd-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-d94ffccc-wxpld\" (UID: \"5a6283b1-365e-4c49-bfd8-f283b1926bbd\") " pod="openshift-monitoring/thanos-querier-d94ffccc-wxpld" May 21 10:33:25.072611 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:25.072434 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-595gl\" (UniqueName: \"kubernetes.io/projected/5a6283b1-365e-4c49-bfd8-f283b1926bbd-kube-api-access-595gl\") pod \"thanos-querier-d94ffccc-wxpld\" (UID: \"5a6283b1-365e-4c49-bfd8-f283b1926bbd\") " pod="openshift-monitoring/thanos-querier-d94ffccc-wxpld" May 21 10:33:25.072611 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:25.072472 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5a6283b1-365e-4c49-bfd8-f283b1926bbd-secret-thanos-querier-tls\") pod \"thanos-querier-d94ffccc-wxpld\" (UID: \"5a6283b1-365e-4c49-bfd8-f283b1926bbd\") " pod="openshift-monitoring/thanos-querier-d94ffccc-wxpld" May 21 10:33:25.072611 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:25.072514 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a6283b1-365e-4c49-bfd8-f283b1926bbd-metrics-client-ca\") pod \"thanos-querier-d94ffccc-wxpld\" (UID: \"5a6283b1-365e-4c49-bfd8-f283b1926bbd\") " pod="openshift-monitoring/thanos-querier-d94ffccc-wxpld" May 21 10:33:25.072611 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:25.072589 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5a6283b1-365e-4c49-bfd8-f283b1926bbd-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-d94ffccc-wxpld\" (UID: \"5a6283b1-365e-4c49-bfd8-f283b1926bbd\") " pod="openshift-monitoring/thanos-querier-d94ffccc-wxpld" May 21 10:33:25.072827 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:25.072649 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5a6283b1-365e-4c49-bfd8-f283b1926bbd-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-d94ffccc-wxpld\" (UID: \"5a6283b1-365e-4c49-bfd8-f283b1926bbd\") " pod="openshift-monitoring/thanos-querier-d94ffccc-wxpld" May 21 10:33:25.072827 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:25.072684 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5a6283b1-365e-4c49-bfd8-f283b1926bbd-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-d94ffccc-wxpld\" (UID: \"5a6283b1-365e-4c49-bfd8-f283b1926bbd\") " pod="openshift-monitoring/thanos-querier-d94ffccc-wxpld" May 21 10:33:25.072827 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:25.072731 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5a6283b1-365e-4c49-bfd8-f283b1926bbd-secret-grpc-tls\") pod \"thanos-querier-d94ffccc-wxpld\" (UID: \"5a6283b1-365e-4c49-bfd8-f283b1926bbd\") " pod="openshift-monitoring/thanos-querier-d94ffccc-wxpld" May 21 10:33:25.073403 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:25.073342 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a6283b1-365e-4c49-bfd8-f283b1926bbd-metrics-client-ca\") pod \"thanos-querier-d94ffccc-wxpld\" (UID: \"5a6283b1-365e-4c49-bfd8-f283b1926bbd\") " pod="openshift-monitoring/thanos-querier-d94ffccc-wxpld" May 21 10:33:25.075534 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:25.075508 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5a6283b1-365e-4c49-bfd8-f283b1926bbd-secret-thanos-querier-tls\") pod \"thanos-querier-d94ffccc-wxpld\" (UID: \"5a6283b1-365e-4c49-bfd8-f283b1926bbd\") " pod="openshift-monitoring/thanos-querier-d94ffccc-wxpld" May 21 10:33:25.075644 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:25.075547 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5a6283b1-365e-4c49-bfd8-f283b1926bbd-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-d94ffccc-wxpld\" (UID: \"5a6283b1-365e-4c49-bfd8-f283b1926bbd\") " pod="openshift-monitoring/thanos-querier-d94ffccc-wxpld" May 21 10:33:25.075644 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:25.075611 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5a6283b1-365e-4c49-bfd8-f283b1926bbd-secret-grpc-tls\") pod \"thanos-querier-d94ffccc-wxpld\" (UID: \"5a6283b1-365e-4c49-bfd8-f283b1926bbd\") " pod="openshift-monitoring/thanos-querier-d94ffccc-wxpld" May 21 10:33:25.075919 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:25.075902 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5a6283b1-365e-4c49-bfd8-f283b1926bbd-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-d94ffccc-wxpld\" (UID: \"5a6283b1-365e-4c49-bfd8-f283b1926bbd\") " pod="openshift-monitoring/thanos-querier-d94ffccc-wxpld" May 21 10:33:25.076017 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:25.076000 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5a6283b1-365e-4c49-bfd8-f283b1926bbd-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-d94ffccc-wxpld\" (UID: \"5a6283b1-365e-4c49-bfd8-f283b1926bbd\") " pod="openshift-monitoring/thanos-querier-d94ffccc-wxpld" May 21 10:33:25.076102 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:25.076083 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5a6283b1-365e-4c49-bfd8-f283b1926bbd-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-d94ffccc-wxpld\" (UID: \"5a6283b1-365e-4c49-bfd8-f283b1926bbd\") " pod="openshift-monitoring/thanos-querier-d94ffccc-wxpld" May 21 10:33:25.080103 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:25.080082 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-595gl\" (UniqueName: \"kubernetes.io/projected/5a6283b1-365e-4c49-bfd8-f283b1926bbd-kube-api-access-595gl\") pod \"thanos-querier-d94ffccc-wxpld\" (UID: \"5a6283b1-365e-4c49-bfd8-f283b1926bbd\") " pod="openshift-monitoring/thanos-querier-d94ffccc-wxpld" May 21 10:33:25.168281 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:25.168166 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-f86f8cb9b-92xdp" podUID="cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc" containerName="registry" containerID="cri-o://a24d37ff55eea37d6e9220eb2c5ca7c6556590e26ee4aea91effd3368b1c5196" gracePeriod=30 May 21 10:33:25.179655 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:25.179623 2565 generic.go:358] "Generic (PLEG): container finished" podID="06722450-040f-47b8-ace4-68e8134bfa9d" containerID="e7a844c7b108bef47d6134e914557f059d7104efcd1d714751f23e6373dddf37" exitCode=0 May 21 10:33:25.180046 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:25.179703 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"06722450-040f-47b8-ace4-68e8134bfa9d","Type":"ContainerDied","Data":"e7a844c7b108bef47d6134e914557f059d7104efcd1d714751f23e6373dddf37"} May 21 10:33:25.181743 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:25.181711 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q44qc" event={"ID":"4e58fb5d-ddc2-489e-ab5d-d7ee49f51750","Type":"ContainerStarted","Data":"4411b589bd0569396c438e4fa6cf147354d4e24ea84a78e6aa77362517e0a236"} May 21 10:33:25.181743 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:25.181749 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q44qc" event={"ID":"4e58fb5d-ddc2-489e-ab5d-d7ee49f51750","Type":"ContainerStarted","Data":"397e70be94243cb5f795841291e0e991c6197207c9961e71f7e8cb25c6d8fc05"} May 21 10:33:25.196848 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:25.196827 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6794c6745f-sv894" May 21 10:33:25.197004 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:25.196860 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6794c6745f-sv894" May 21 10:33:25.201219 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:25.201197 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6794c6745f-sv894" May 21 10:33:25.237294 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:25.237267 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-d94ffccc-wxpld" May 21 10:33:25.247748 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:25.247691 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-q44qc" podStartSLOduration=3.348708681 podStartE2EDuration="4.24767292s" podCreationTimestamp="2026-05-21 10:33:21 +0000 UTC" firstStartedPulling="2026-05-21 10:33:22.283144225 +0000 UTC m=+195.196523274" lastFinishedPulling="2026-05-21 10:33:23.182108461 +0000 UTC m=+196.095487513" observedRunningTime="2026-05-21 10:33:25.246441702 +0000 UTC m=+198.159820799" watchObservedRunningTime="2026-05-21 10:33:25.24767292 +0000 UTC m=+198.161051991" May 21 10:33:25.396128 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:25.396099 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-d94ffccc-wxpld"] May 21 10:33:25.398648 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:33:25.398618 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a6283b1_365e_4c49_bfd8_f283b1926bbd.slice/crio-53d32e877287a6ebadc52e52f419e0af1633c46f173b8dd6bcdbd821a8285708 WatchSource:0}: Error finding container 53d32e877287a6ebadc52e52f419e0af1633c46f173b8dd6bcdbd821a8285708: Status 404 returned error can't find the container with id 53d32e877287a6ebadc52e52f419e0af1633c46f173b8dd6bcdbd821a8285708 May 21 10:33:25.421322 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:25.421265 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f86f8cb9b-92xdp" May 21 10:33:25.476973 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:25.476928 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc-installation-pull-secrets\") pod \"cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc\" (UID: \"cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc\") " May 21 10:33:25.477120 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:25.476981 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc-trusted-ca\") pod \"cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc\" (UID: \"cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc\") " May 21 10:33:25.477120 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:25.477010 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc-registry-tls\") pod \"cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc\" (UID: \"cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc\") " May 21 10:33:25.477120 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:25.477033 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc-image-registry-private-configuration\") pod \"cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc\" (UID: \"cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc\") " May 21 10:33:25.477120 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:25.477076 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n9p9g\" (UniqueName: \"kubernetes.io/projected/cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc-kube-api-access-n9p9g\") pod \"cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc\" (UID: \"cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc\") " May 21 10:33:25.477120 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:25.477116 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc-registry-certificates\") pod \"cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc\" (UID: \"cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc\") " May 21 10:33:25.477356 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:25.477180 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc-bound-sa-token\") pod \"cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc\" (UID: \"cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc\") " May 21 10:33:25.477356 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:25.477206 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc-ca-trust-extracted\") pod \"cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc\" (UID: \"cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc\") " May 21 10:33:25.477625 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:25.477594 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc" (UID: "cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 10:33:25.477748 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:25.477682 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc" (UID: "cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 10:33:25.479253 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:25.479230 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc" (UID: "cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 10:33:25.479413 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:25.479393 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc" (UID: "cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 10:33:25.479648 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:25.479627 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc" (UID: "cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 10:33:25.479709 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:25.479634 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc-kube-api-access-n9p9g" (OuterVolumeSpecName: "kube-api-access-n9p9g") pod "cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc" (UID: "cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc"). InnerVolumeSpecName "kube-api-access-n9p9g". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 10:33:25.479747 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:25.479732 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc" (UID: "cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 10:33:25.485529 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:25.485506 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc" (UID: "cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 10:33:25.578298 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:25.578264 2565 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc-bound-sa-token\") on node \"ip-10-0-142-214.ec2.internal\" DevicePath \"\"" May 21 10:33:25.578298 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:25.578294 2565 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc-ca-trust-extracted\") on node \"ip-10-0-142-214.ec2.internal\" DevicePath \"\"" May 21 10:33:25.578298 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:25.578304 2565 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc-installation-pull-secrets\") on node \"ip-10-0-142-214.ec2.internal\" DevicePath \"\"" May 21 10:33:25.578514 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:25.578314 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc-trusted-ca\") on node \"ip-10-0-142-214.ec2.internal\" DevicePath \"\"" May 21 10:33:25.578514 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:25.578322 2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc-registry-tls\") on node \"ip-10-0-142-214.ec2.internal\" DevicePath \"\"" May 21 10:33:25.578514 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:25.578333 2565 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc-image-registry-private-configuration\") on node \"ip-10-0-142-214.ec2.internal\" DevicePath \"\"" May 21 10:33:25.578514 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:25.578341 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n9p9g\" (UniqueName: \"kubernetes.io/projected/cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc-kube-api-access-n9p9g\") on node \"ip-10-0-142-214.ec2.internal\" DevicePath \"\"" May 21 10:33:25.578514 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:25.578350 2565 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc-registry-certificates\") on node \"ip-10-0-142-214.ec2.internal\" DevicePath \"\"" May 21 10:33:26.188056 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:26.188017 2565 generic.go:358] "Generic (PLEG): container finished" podID="cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc" containerID="a24d37ff55eea37d6e9220eb2c5ca7c6556590e26ee4aea91effd3368b1c5196" exitCode=0 May 21 10:33:26.188503 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:26.188102 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f86f8cb9b-92xdp" May 21 10:33:26.188503 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:26.188129 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f86f8cb9b-92xdp" event={"ID":"cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc","Type":"ContainerDied","Data":"a24d37ff55eea37d6e9220eb2c5ca7c6556590e26ee4aea91effd3368b1c5196"} May 21 10:33:26.188503 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:26.188197 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f86f8cb9b-92xdp" event={"ID":"cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc","Type":"ContainerDied","Data":"42ef04aafddb39a7b30b5b51a0561a775a8c2360616ba7f9f87be44a5f22d0fb"} May 21 10:33:26.188503 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:26.188220 2565 scope.go:117] "RemoveContainer" containerID="a24d37ff55eea37d6e9220eb2c5ca7c6556590e26ee4aea91effd3368b1c5196" May 21 10:33:26.194862 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:26.194153 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d94ffccc-wxpld" event={"ID":"5a6283b1-365e-4c49-bfd8-f283b1926bbd","Type":"ContainerStarted","Data":"53d32e877287a6ebadc52e52f419e0af1633c46f173b8dd6bcdbd821a8285708"} May 21 10:33:26.199378 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:26.199332 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6794c6745f-sv894" May 21 10:33:26.202351 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:26.202328 2565 scope.go:117] "RemoveContainer" containerID="a24d37ff55eea37d6e9220eb2c5ca7c6556590e26ee4aea91effd3368b1c5196" May 21 10:33:26.202719 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:33:26.202633 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a24d37ff55eea37d6e9220eb2c5ca7c6556590e26ee4aea91effd3368b1c5196\": container with ID starting with a24d37ff55eea37d6e9220eb2c5ca7c6556590e26ee4aea91effd3368b1c5196 not found: ID does not exist" containerID="a24d37ff55eea37d6e9220eb2c5ca7c6556590e26ee4aea91effd3368b1c5196" May 21 10:33:26.202719 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:26.202671 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a24d37ff55eea37d6e9220eb2c5ca7c6556590e26ee4aea91effd3368b1c5196"} err="failed to get container status \"a24d37ff55eea37d6e9220eb2c5ca7c6556590e26ee4aea91effd3368b1c5196\": rpc error: code = NotFound desc = could not find container \"a24d37ff55eea37d6e9220eb2c5ca7c6556590e26ee4aea91effd3368b1c5196\": container with ID starting with a24d37ff55eea37d6e9220eb2c5ca7c6556590e26ee4aea91effd3368b1c5196 not found: ID does not exist" May 21 10:33:26.212866 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:26.212819 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-f86f8cb9b-92xdp"] May 21 10:33:26.217350 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:26.217323 2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-f86f8cb9b-92xdp"] May 21 10:33:26.268895 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:26.268855 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86f5598957-kfljn"] May 21 10:33:27.198480 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:27.198386 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"06722450-040f-47b8-ace4-68e8134bfa9d","Type":"ContainerStarted","Data":"7ecf29c1939972b220e984e027f5ea5ad19454e68a5a668617ddf33ef4802bbb"} May 21 10:33:27.198480 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:27.198439 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"06722450-040f-47b8-ace4-68e8134bfa9d","Type":"ContainerStarted","Data":"dac7294497cf937bda8496c93d9076833ad85694a0d29811eea555d9de3cd33a"} May 21 10:33:27.638019 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:27.637989 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc" path="/var/lib/kubelet/pods/cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc/volumes" May 21 10:33:28.204832 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:28.204739 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"06722450-040f-47b8-ace4-68e8134bfa9d","Type":"ContainerStarted","Data":"044401c29ee38f0b82e6dd3d9e91da7f74a37dc34d68fd1d70ea977aa3d35a39"} May 21 10:33:28.204832 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:28.204773 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"06722450-040f-47b8-ace4-68e8134bfa9d","Type":"ContainerStarted","Data":"c5b527a1181a4db5e97fae5c2789f56e84b3899f367d42bae67c0258a5f63826"} May 21 10:33:28.204832 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:28.204782 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"06722450-040f-47b8-ace4-68e8134bfa9d","Type":"ContainerStarted","Data":"019884c5520ee51c357eef856b4b01574ab4d27ac755e07bc3111c9619af5c34"} May 21 10:33:28.206465 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:28.206432 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d94ffccc-wxpld" event={"ID":"5a6283b1-365e-4c49-bfd8-f283b1926bbd","Type":"ContainerStarted","Data":"a709bd6fba56741d9ebbc4f89b0a9f6fd34add7a896681ca56ea0a3ae6485f60"} May 21 10:33:28.206465 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:28.206462 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d94ffccc-wxpld" event={"ID":"5a6283b1-365e-4c49-bfd8-f283b1926bbd","Type":"ContainerStarted","Data":"54d0be0fd28e59cb5e005ace6d3c7efc5d88574837155de9033949ab0cc45e34"} May 21 10:33:28.206606 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:28.206473 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d94ffccc-wxpld" event={"ID":"5a6283b1-365e-4c49-bfd8-f283b1926bbd","Type":"ContainerStarted","Data":"676f39e3cf4a69f963f1765b9471197871ecccb6aaf6d7c808e2fd2f88ac1abb"} May 21 10:33:29.217268 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:29.217235 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"06722450-040f-47b8-ace4-68e8134bfa9d","Type":"ContainerStarted","Data":"2d25aca34e51d02d840c0bb0c0ee9854004fb1d4177aa2e162e75d5968007adf"} May 21 10:33:29.219777 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:29.219751 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d94ffccc-wxpld" event={"ID":"5a6283b1-365e-4c49-bfd8-f283b1926bbd","Type":"ContainerStarted","Data":"766c3656626ff0e220723075c9093d2669e14f4250849c3d8e0cbd91d6dd5e11"} May 21 10:33:29.219880 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:29.219782 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d94ffccc-wxpld" event={"ID":"5a6283b1-365e-4c49-bfd8-f283b1926bbd","Type":"ContainerStarted","Data":"90035517efed0ff02d5f357be2432c871696a942b10db2dceb7dcd05ea018845"} May 21 10:33:29.219880 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:29.219796 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d94ffccc-wxpld" event={"ID":"5a6283b1-365e-4c49-bfd8-f283b1926bbd","Type":"ContainerStarted","Data":"dd7476d2f2299f3f6205efb03cdaa3278c7f0b2e8caca332461ed85d8fd19fda"} May 21 10:33:29.219994 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:29.219925 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-d94ffccc-wxpld" May 21 10:33:29.257445 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:29.257391 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.075737221 podStartE2EDuration="7.257373969s" podCreationTimestamp="2026-05-21 10:33:22 +0000 UTC" firstStartedPulling="2026-05-21 10:33:23.47257896 +0000 UTC m=+196.385958007" lastFinishedPulling="2026-05-21 10:33:28.654215696 +0000 UTC m=+201.567594755" observedRunningTime="2026-05-21 10:33:29.255375611 +0000 UTC m=+202.168754692" watchObservedRunningTime="2026-05-21 10:33:29.257373969 +0000 UTC m=+202.170753043" May 21 10:33:29.282451 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:29.282399 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-d94ffccc-wxpld" podStartSLOduration=2.030168574 podStartE2EDuration="5.282384614s" podCreationTimestamp="2026-05-21 10:33:24 +0000 UTC" firstStartedPulling="2026-05-21 10:33:25.400432439 +0000 UTC m=+198.313811487" lastFinishedPulling="2026-05-21 10:33:28.652648464 +0000 UTC m=+201.566027527" observedRunningTime="2026-05-21 10:33:29.28133558 +0000 UTC m=+202.194714649" watchObservedRunningTime="2026-05-21 10:33:29.282384614 +0000 UTC m=+202.195763719" May 21 10:33:30.509317 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:30.509277 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6878678fd5-5hnvd"] May 21 10:33:30.509784 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:30.509703 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc" containerName="registry" May 21 10:33:30.509784 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:30.509723 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc" containerName="registry" May 21 10:33:30.509893 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:30.509817 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="cbd91b37-dbe8-4a7b-a9d5-3684fe692dfc" containerName="registry" May 21 10:33:30.512908 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:30.512886 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6878678fd5-5hnvd" May 21 10:33:30.527463 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:30.527439 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6878678fd5-5hnvd"] May 21 10:33:30.621477 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:30.621438 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/85b23d9c-1d13-47a6-8a02-3c715681a862-console-oauth-config\") pod \"console-6878678fd5-5hnvd\" (UID: \"85b23d9c-1d13-47a6-8a02-3c715681a862\") " pod="openshift-console/console-6878678fd5-5hnvd" May 21 10:33:30.621630 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:30.621492 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/85b23d9c-1d13-47a6-8a02-3c715681a862-service-ca\") pod \"console-6878678fd5-5hnvd\" (UID: \"85b23d9c-1d13-47a6-8a02-3c715681a862\") " pod="openshift-console/console-6878678fd5-5hnvd" May 21 10:33:30.621630 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:30.621546 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/85b23d9c-1d13-47a6-8a02-3c715681a862-oauth-serving-cert\") pod \"console-6878678fd5-5hnvd\" (UID: \"85b23d9c-1d13-47a6-8a02-3c715681a862\") " pod="openshift-console/console-6878678fd5-5hnvd" May 21 10:33:30.621630 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:30.621606 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85b23d9c-1d13-47a6-8a02-3c715681a862-trusted-ca-bundle\") pod \"console-6878678fd5-5hnvd\" (UID: \"85b23d9c-1d13-47a6-8a02-3c715681a862\") " pod="openshift-console/console-6878678fd5-5hnvd" May 21 10:33:30.621764 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:30.621638 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fr59l\" (UniqueName: \"kubernetes.io/projected/85b23d9c-1d13-47a6-8a02-3c715681a862-kube-api-access-fr59l\") pod \"console-6878678fd5-5hnvd\" (UID: \"85b23d9c-1d13-47a6-8a02-3c715681a862\") " pod="openshift-console/console-6878678fd5-5hnvd" May 21 10:33:30.621764 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:30.621689 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/85b23d9c-1d13-47a6-8a02-3c715681a862-console-config\") pod \"console-6878678fd5-5hnvd\" (UID: \"85b23d9c-1d13-47a6-8a02-3c715681a862\") " pod="openshift-console/console-6878678fd5-5hnvd" May 21 10:33:30.621764 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:30.621738 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/85b23d9c-1d13-47a6-8a02-3c715681a862-console-serving-cert\") pod \"console-6878678fd5-5hnvd\" (UID: \"85b23d9c-1d13-47a6-8a02-3c715681a862\") " pod="openshift-console/console-6878678fd5-5hnvd" May 21 10:33:30.722262 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:30.722232 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/85b23d9c-1d13-47a6-8a02-3c715681a862-console-serving-cert\") pod \"console-6878678fd5-5hnvd\" (UID: \"85b23d9c-1d13-47a6-8a02-3c715681a862\") " pod="openshift-console/console-6878678fd5-5hnvd" May 21 10:33:30.722262 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:30.722268 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/85b23d9c-1d13-47a6-8a02-3c715681a862-console-oauth-config\") pod \"console-6878678fd5-5hnvd\" (UID: \"85b23d9c-1d13-47a6-8a02-3c715681a862\") " pod="openshift-console/console-6878678fd5-5hnvd" May 21 10:33:30.722438 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:30.722298 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/85b23d9c-1d13-47a6-8a02-3c715681a862-service-ca\") pod \"console-6878678fd5-5hnvd\" (UID: \"85b23d9c-1d13-47a6-8a02-3c715681a862\") " pod="openshift-console/console-6878678fd5-5hnvd" May 21 10:33:30.722506 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:30.722486 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/85b23d9c-1d13-47a6-8a02-3c715681a862-oauth-serving-cert\") pod \"console-6878678fd5-5hnvd\" (UID: \"85b23d9c-1d13-47a6-8a02-3c715681a862\") " pod="openshift-console/console-6878678fd5-5hnvd" May 21 10:33:30.722569 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:30.722553 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85b23d9c-1d13-47a6-8a02-3c715681a862-trusted-ca-bundle\") pod \"console-6878678fd5-5hnvd\" (UID: \"85b23d9c-1d13-47a6-8a02-3c715681a862\") " pod="openshift-console/console-6878678fd5-5hnvd" May 21 10:33:30.722619 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:30.722604 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fr59l\" (UniqueName: \"kubernetes.io/projected/85b23d9c-1d13-47a6-8a02-3c715681a862-kube-api-access-fr59l\") pod \"console-6878678fd5-5hnvd\" (UID: \"85b23d9c-1d13-47a6-8a02-3c715681a862\") " pod="openshift-console/console-6878678fd5-5hnvd" May 21 10:33:30.722676 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:30.722661 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/85b23d9c-1d13-47a6-8a02-3c715681a862-console-config\") pod \"console-6878678fd5-5hnvd\" (UID: \"85b23d9c-1d13-47a6-8a02-3c715681a862\") " pod="openshift-console/console-6878678fd5-5hnvd" May 21 10:33:30.723128 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:30.723101 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/85b23d9c-1d13-47a6-8a02-3c715681a862-service-ca\") pod \"console-6878678fd5-5hnvd\" (UID: \"85b23d9c-1d13-47a6-8a02-3c715681a862\") " pod="openshift-console/console-6878678fd5-5hnvd" May 21 10:33:30.723235 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:30.723176 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/85b23d9c-1d13-47a6-8a02-3c715681a862-oauth-serving-cert\") pod \"console-6878678fd5-5hnvd\" (UID: \"85b23d9c-1d13-47a6-8a02-3c715681a862\") " pod="openshift-console/console-6878678fd5-5hnvd" May 21 10:33:30.723297 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:30.723266 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/85b23d9c-1d13-47a6-8a02-3c715681a862-console-config\") pod \"console-6878678fd5-5hnvd\" (UID: \"85b23d9c-1d13-47a6-8a02-3c715681a862\") " pod="openshift-console/console-6878678fd5-5hnvd" May 21 10:33:30.723528 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:30.723506 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85b23d9c-1d13-47a6-8a02-3c715681a862-trusted-ca-bundle\") pod \"console-6878678fd5-5hnvd\" (UID: \"85b23d9c-1d13-47a6-8a02-3c715681a862\") " pod="openshift-console/console-6878678fd5-5hnvd" May 21 10:33:30.724723 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:30.724699 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/85b23d9c-1d13-47a6-8a02-3c715681a862-console-serving-cert\") pod \"console-6878678fd5-5hnvd\" (UID: \"85b23d9c-1d13-47a6-8a02-3c715681a862\") " pod="openshift-console/console-6878678fd5-5hnvd" May 21 10:33:30.724808 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:30.724789 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/85b23d9c-1d13-47a6-8a02-3c715681a862-console-oauth-config\") pod \"console-6878678fd5-5hnvd\" (UID: \"85b23d9c-1d13-47a6-8a02-3c715681a862\") " pod="openshift-console/console-6878678fd5-5hnvd" May 21 10:33:30.732243 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:30.732218 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fr59l\" (UniqueName: \"kubernetes.io/projected/85b23d9c-1d13-47a6-8a02-3c715681a862-kube-api-access-fr59l\") pod \"console-6878678fd5-5hnvd\" (UID: \"85b23d9c-1d13-47a6-8a02-3c715681a862\") " pod="openshift-console/console-6878678fd5-5hnvd" May 21 10:33:30.822155 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:30.822121 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6878678fd5-5hnvd" May 21 10:33:30.953818 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:30.953786 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6878678fd5-5hnvd"] May 21 10:33:30.957038 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:33:30.957014 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85b23d9c_1d13_47a6_8a02_3c715681a862.slice/crio-86ca5143f85200626129e91b9a7110d7d40af0deaa4c8b9826a974c7651f00a5 WatchSource:0}: Error finding container 86ca5143f85200626129e91b9a7110d7d40af0deaa4c8b9826a974c7651f00a5: Status 404 returned error can't find the container with id 86ca5143f85200626129e91b9a7110d7d40af0deaa4c8b9826a974c7651f00a5 May 21 10:33:31.226419 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:31.226340 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6878678fd5-5hnvd" event={"ID":"85b23d9c-1d13-47a6-8a02-3c715681a862","Type":"ContainerStarted","Data":"593d5fd6ad6cd4587cafef1b53b9c19dd81bd8a081930e5dabd55afbf5c3dcc8"} May 21 10:33:31.226419 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:31.226375 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6878678fd5-5hnvd" event={"ID":"85b23d9c-1d13-47a6-8a02-3c715681a862","Type":"ContainerStarted","Data":"86ca5143f85200626129e91b9a7110d7d40af0deaa4c8b9826a974c7651f00a5"} May 21 10:33:35.228702 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:35.228673 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-d94ffccc-wxpld" May 21 10:33:35.254669 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:35.254618 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6878678fd5-5hnvd" podStartSLOduration=5.254604509 podStartE2EDuration="5.254604509s" podCreationTimestamp="2026-05-21 10:33:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 10:33:31.272585148 +0000 UTC m=+204.185964218" watchObservedRunningTime="2026-05-21 10:33:35.254604509 +0000 UTC m=+208.167983579" May 21 10:33:40.823014 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:40.822974 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6878678fd5-5hnvd" May 21 10:33:40.823014 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:40.823016 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6878678fd5-5hnvd" May 21 10:33:40.827515 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:40.827494 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6878678fd5-5hnvd" May 21 10:33:41.261461 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:41.261378 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6878678fd5-5hnvd" May 21 10:33:41.310472 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:41.310434 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6794c6745f-sv894"] May 21 10:33:51.291369 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:51.291316 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-86f5598957-kfljn" podUID="d416785a-b408-4452-a55a-a0b95e9583c1" containerName="console" containerID="cri-o://3568c1129f151a58293c92dd0a570030e7b212087db04661b5b4fbcc7c41d531" gracePeriod=15 May 21 10:33:51.534278 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:51.534253 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-86f5598957-kfljn_d416785a-b408-4452-a55a-a0b95e9583c1/console/0.log" May 21 10:33:51.534392 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:51.534311 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86f5598957-kfljn" May 21 10:33:51.611194 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:51.611166 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d416785a-b408-4452-a55a-a0b95e9583c1-console-config\") pod \"d416785a-b408-4452-a55a-a0b95e9583c1\" (UID: \"d416785a-b408-4452-a55a-a0b95e9583c1\") " May 21 10:33:51.611360 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:51.611202 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d416785a-b408-4452-a55a-a0b95e9583c1-console-serving-cert\") pod \"d416785a-b408-4452-a55a-a0b95e9583c1\" (UID: \"d416785a-b408-4452-a55a-a0b95e9583c1\") " May 21 10:33:51.611360 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:51.611247 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d416785a-b408-4452-a55a-a0b95e9583c1-oauth-serving-cert\") pod \"d416785a-b408-4452-a55a-a0b95e9583c1\" (UID: \"d416785a-b408-4452-a55a-a0b95e9583c1\") " May 21 10:33:51.611360 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:51.611292 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d416785a-b408-4452-a55a-a0b95e9583c1-service-ca\") pod \"d416785a-b408-4452-a55a-a0b95e9583c1\" (UID: \"d416785a-b408-4452-a55a-a0b95e9583c1\") " May 21 10:33:51.611360 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:51.611344 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sm8lh\" (UniqueName: \"kubernetes.io/projected/d416785a-b408-4452-a55a-a0b95e9583c1-kube-api-access-sm8lh\") pod \"d416785a-b408-4452-a55a-a0b95e9583c1\" (UID: \"d416785a-b408-4452-a55a-a0b95e9583c1\") " May 21 10:33:51.611577 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:51.611369 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d416785a-b408-4452-a55a-a0b95e9583c1-console-oauth-config\") pod \"d416785a-b408-4452-a55a-a0b95e9583c1\" (UID: \"d416785a-b408-4452-a55a-a0b95e9583c1\") " May 21 10:33:51.611676 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:51.611646 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d416785a-b408-4452-a55a-a0b95e9583c1-console-config" (OuterVolumeSpecName: "console-config") pod "d416785a-b408-4452-a55a-a0b95e9583c1" (UID: "d416785a-b408-4452-a55a-a0b95e9583c1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 10:33:51.611728 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:51.611669 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d416785a-b408-4452-a55a-a0b95e9583c1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d416785a-b408-4452-a55a-a0b95e9583c1" (UID: "d416785a-b408-4452-a55a-a0b95e9583c1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 10:33:51.611728 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:51.611716 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d416785a-b408-4452-a55a-a0b95e9583c1-service-ca" (OuterVolumeSpecName: "service-ca") pod "d416785a-b408-4452-a55a-a0b95e9583c1" (UID: "d416785a-b408-4452-a55a-a0b95e9583c1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 10:33:51.613664 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:51.613628 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d416785a-b408-4452-a55a-a0b95e9583c1-kube-api-access-sm8lh" (OuterVolumeSpecName: "kube-api-access-sm8lh") pod "d416785a-b408-4452-a55a-a0b95e9583c1" (UID: "d416785a-b408-4452-a55a-a0b95e9583c1"). InnerVolumeSpecName "kube-api-access-sm8lh". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 10:33:51.613777 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:51.613655 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d416785a-b408-4452-a55a-a0b95e9583c1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d416785a-b408-4452-a55a-a0b95e9583c1" (UID: "d416785a-b408-4452-a55a-a0b95e9583c1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 10:33:51.613777 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:51.613666 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d416785a-b408-4452-a55a-a0b95e9583c1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d416785a-b408-4452-a55a-a0b95e9583c1" (UID: "d416785a-b408-4452-a55a-a0b95e9583c1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 10:33:51.712807 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:51.712774 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d416785a-b408-4452-a55a-a0b95e9583c1-service-ca\") on node \"ip-10-0-142-214.ec2.internal\" DevicePath \"\"" May 21 10:33:51.712807 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:51.712801 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sm8lh\" (UniqueName: \"kubernetes.io/projected/d416785a-b408-4452-a55a-a0b95e9583c1-kube-api-access-sm8lh\") on node \"ip-10-0-142-214.ec2.internal\" DevicePath \"\"" May 21 10:33:51.712807 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:51.712814 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d416785a-b408-4452-a55a-a0b95e9583c1-console-oauth-config\") on node \"ip-10-0-142-214.ec2.internal\" DevicePath \"\"" May 21 10:33:51.713050 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:51.712824 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d416785a-b408-4452-a55a-a0b95e9583c1-console-config\") on node \"ip-10-0-142-214.ec2.internal\" DevicePath \"\"" May 21 10:33:51.713050 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:51.712835 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d416785a-b408-4452-a55a-a0b95e9583c1-console-serving-cert\") on node \"ip-10-0-142-214.ec2.internal\" DevicePath \"\"" May 21 10:33:51.713050 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:51.712844 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d416785a-b408-4452-a55a-a0b95e9583c1-oauth-serving-cert\") on node \"ip-10-0-142-214.ec2.internal\" DevicePath \"\"" May 21 10:33:52.293323 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:52.293295 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-86f5598957-kfljn_d416785a-b408-4452-a55a-a0b95e9583c1/console/0.log" May 21 10:33:52.293842 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:52.293335 2565 generic.go:358] "Generic (PLEG): container finished" podID="d416785a-b408-4452-a55a-a0b95e9583c1" containerID="3568c1129f151a58293c92dd0a570030e7b212087db04661b5b4fbcc7c41d531" exitCode=2 May 21 10:33:52.293842 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:52.293371 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86f5598957-kfljn" event={"ID":"d416785a-b408-4452-a55a-a0b95e9583c1","Type":"ContainerDied","Data":"3568c1129f151a58293c92dd0a570030e7b212087db04661b5b4fbcc7c41d531"} May 21 10:33:52.293842 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:52.293398 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86f5598957-kfljn" May 21 10:33:52.293842 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:52.293420 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86f5598957-kfljn" event={"ID":"d416785a-b408-4452-a55a-a0b95e9583c1","Type":"ContainerDied","Data":"5fdda3d264a7bc085ef9cd5e5c54030ff69d4249e207a5cb11e98d591518e9de"} May 21 10:33:52.293842 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:52.293441 2565 scope.go:117] "RemoveContainer" containerID="3568c1129f151a58293c92dd0a570030e7b212087db04661b5b4fbcc7c41d531" May 21 10:33:52.301094 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:52.301076 2565 scope.go:117] "RemoveContainer" containerID="3568c1129f151a58293c92dd0a570030e7b212087db04661b5b4fbcc7c41d531" May 21 10:33:52.301364 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:33:52.301329 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3568c1129f151a58293c92dd0a570030e7b212087db04661b5b4fbcc7c41d531\": container with ID starting with 3568c1129f151a58293c92dd0a570030e7b212087db04661b5b4fbcc7c41d531 not found: ID does not exist" containerID="3568c1129f151a58293c92dd0a570030e7b212087db04661b5b4fbcc7c41d531" May 21 10:33:52.301364 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:52.301354 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3568c1129f151a58293c92dd0a570030e7b212087db04661b5b4fbcc7c41d531"} err="failed to get container status \"3568c1129f151a58293c92dd0a570030e7b212087db04661b5b4fbcc7c41d531\": rpc error: code = NotFound desc = could not find container \"3568c1129f151a58293c92dd0a570030e7b212087db04661b5b4fbcc7c41d531\": container with ID starting with 3568c1129f151a58293c92dd0a570030e7b212087db04661b5b4fbcc7c41d531 not found: ID does not exist" May 21 10:33:52.311602 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:52.311573 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86f5598957-kfljn"] May 21 10:33:52.315742 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:52.315722 2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-86f5598957-kfljn"] May 21 10:33:53.635826 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:33:53.635794 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d416785a-b408-4452-a55a-a0b95e9583c1" path="/var/lib/kubelet/pods/d416785a-b408-4452-a55a-a0b95e9583c1/volumes" May 21 10:34:06.334558 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:06.334492 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-6794c6745f-sv894" podUID="8820f2db-b345-4b16-9e47-fd3c512b8afd" containerName="console" containerID="cri-o://7dd46f8d2978d8457ad70b435ff8c4908685e623242c8aa34de9566c717d651a" gracePeriod=15 May 21 10:34:06.587073 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:06.587019 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6794c6745f-sv894_8820f2db-b345-4b16-9e47-fd3c512b8afd/console/0.log" May 21 10:34:06.587182 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:06.587081 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6794c6745f-sv894" May 21 10:34:06.641244 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:06.641213 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pv5fv\" (UniqueName: \"kubernetes.io/projected/8820f2db-b345-4b16-9e47-fd3c512b8afd-kube-api-access-pv5fv\") pod \"8820f2db-b345-4b16-9e47-fd3c512b8afd\" (UID: \"8820f2db-b345-4b16-9e47-fd3c512b8afd\") " May 21 10:34:06.641405 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:06.641262 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8820f2db-b345-4b16-9e47-fd3c512b8afd-console-config\") pod \"8820f2db-b345-4b16-9e47-fd3c512b8afd\" (UID: \"8820f2db-b345-4b16-9e47-fd3c512b8afd\") " May 21 10:34:06.641405 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:06.641298 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8820f2db-b345-4b16-9e47-fd3c512b8afd-trusted-ca-bundle\") pod \"8820f2db-b345-4b16-9e47-fd3c512b8afd\" (UID: \"8820f2db-b345-4b16-9e47-fd3c512b8afd\") " May 21 10:34:06.641517 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:06.641415 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8820f2db-b345-4b16-9e47-fd3c512b8afd-console-oauth-config\") pod \"8820f2db-b345-4b16-9e47-fd3c512b8afd\" (UID: \"8820f2db-b345-4b16-9e47-fd3c512b8afd\") " May 21 10:34:06.641517 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:06.641478 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8820f2db-b345-4b16-9e47-fd3c512b8afd-console-serving-cert\") pod \"8820f2db-b345-4b16-9e47-fd3c512b8afd\" (UID: \"8820f2db-b345-4b16-9e47-fd3c512b8afd\") " May 21 10:34:06.641612 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:06.641517 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8820f2db-b345-4b16-9e47-fd3c512b8afd-service-ca\") pod \"8820f2db-b345-4b16-9e47-fd3c512b8afd\" (UID: \"8820f2db-b345-4b16-9e47-fd3c512b8afd\") " May 21 10:34:06.641612 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:06.641562 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8820f2db-b345-4b16-9e47-fd3c512b8afd-oauth-serving-cert\") pod \"8820f2db-b345-4b16-9e47-fd3c512b8afd\" (UID: \"8820f2db-b345-4b16-9e47-fd3c512b8afd\") " May 21 10:34:06.641713 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:06.641684 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8820f2db-b345-4b16-9e47-fd3c512b8afd-console-config" (OuterVolumeSpecName: "console-config") pod "8820f2db-b345-4b16-9e47-fd3c512b8afd" (UID: "8820f2db-b345-4b16-9e47-fd3c512b8afd"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 10:34:06.641713 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:06.641704 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8820f2db-b345-4b16-9e47-fd3c512b8afd-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8820f2db-b345-4b16-9e47-fd3c512b8afd" (UID: "8820f2db-b345-4b16-9e47-fd3c512b8afd"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 10:34:06.641878 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:06.641861 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8820f2db-b345-4b16-9e47-fd3c512b8afd-console-config\") on node \"ip-10-0-142-214.ec2.internal\" DevicePath \"\"" May 21 10:34:06.641936 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:06.641884 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8820f2db-b345-4b16-9e47-fd3c512b8afd-trusted-ca-bundle\") on node \"ip-10-0-142-214.ec2.internal\" DevicePath \"\"" May 21 10:34:06.642012 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:06.641934 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8820f2db-b345-4b16-9e47-fd3c512b8afd-service-ca" (OuterVolumeSpecName: "service-ca") pod "8820f2db-b345-4b16-9e47-fd3c512b8afd" (UID: "8820f2db-b345-4b16-9e47-fd3c512b8afd"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 10:34:06.642012 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:06.642002 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8820f2db-b345-4b16-9e47-fd3c512b8afd-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8820f2db-b345-4b16-9e47-fd3c512b8afd" (UID: "8820f2db-b345-4b16-9e47-fd3c512b8afd"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 10:34:06.643520 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:06.643495 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8820f2db-b345-4b16-9e47-fd3c512b8afd-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8820f2db-b345-4b16-9e47-fd3c512b8afd" (UID: "8820f2db-b345-4b16-9e47-fd3c512b8afd"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 10:34:06.643801 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:06.643780 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8820f2db-b345-4b16-9e47-fd3c512b8afd-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8820f2db-b345-4b16-9e47-fd3c512b8afd" (UID: "8820f2db-b345-4b16-9e47-fd3c512b8afd"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 10:34:06.643862 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:06.643800 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8820f2db-b345-4b16-9e47-fd3c512b8afd-kube-api-access-pv5fv" (OuterVolumeSpecName: "kube-api-access-pv5fv") pod "8820f2db-b345-4b16-9e47-fd3c512b8afd" (UID: "8820f2db-b345-4b16-9e47-fd3c512b8afd"). InnerVolumeSpecName "kube-api-access-pv5fv". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 10:34:06.742545 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:06.742511 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8820f2db-b345-4b16-9e47-fd3c512b8afd-console-oauth-config\") on node \"ip-10-0-142-214.ec2.internal\" DevicePath \"\"" May 21 10:34:06.742545 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:06.742540 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8820f2db-b345-4b16-9e47-fd3c512b8afd-console-serving-cert\") on node \"ip-10-0-142-214.ec2.internal\" DevicePath \"\"" May 21 10:34:06.742545 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:06.742550 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8820f2db-b345-4b16-9e47-fd3c512b8afd-service-ca\") on node \"ip-10-0-142-214.ec2.internal\" DevicePath \"\"" May 21 10:34:06.742824 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:06.742560 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8820f2db-b345-4b16-9e47-fd3c512b8afd-oauth-serving-cert\") on node \"ip-10-0-142-214.ec2.internal\" DevicePath \"\"" May 21 10:34:06.742824 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:06.742570 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pv5fv\" (UniqueName: \"kubernetes.io/projected/8820f2db-b345-4b16-9e47-fd3c512b8afd-kube-api-access-pv5fv\") on node \"ip-10-0-142-214.ec2.internal\" DevicePath \"\"" May 21 10:34:07.346585 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:07.346558 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6794c6745f-sv894_8820f2db-b345-4b16-9e47-fd3c512b8afd/console/0.log" May 21 10:34:07.347048 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:07.346602 2565 generic.go:358] "Generic (PLEG): container finished" podID="8820f2db-b345-4b16-9e47-fd3c512b8afd" containerID="7dd46f8d2978d8457ad70b435ff8c4908685e623242c8aa34de9566c717d651a" exitCode=2 May 21 10:34:07.347048 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:07.346664 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6794c6745f-sv894" May 21 10:34:07.347048 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:07.346674 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6794c6745f-sv894" event={"ID":"8820f2db-b345-4b16-9e47-fd3c512b8afd","Type":"ContainerDied","Data":"7dd46f8d2978d8457ad70b435ff8c4908685e623242c8aa34de9566c717d651a"} May 21 10:34:07.347048 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:07.346713 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6794c6745f-sv894" event={"ID":"8820f2db-b345-4b16-9e47-fd3c512b8afd","Type":"ContainerDied","Data":"832823d15b823159bcdd1adffd189b6b49366471a61c8aca302c70bd9d359097"} May 21 10:34:07.347048 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:07.346737 2565 scope.go:117] "RemoveContainer" containerID="7dd46f8d2978d8457ad70b435ff8c4908685e623242c8aa34de9566c717d651a" May 21 10:34:07.355256 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:07.355049 2565 scope.go:117] "RemoveContainer" containerID="7dd46f8d2978d8457ad70b435ff8c4908685e623242c8aa34de9566c717d651a" May 21 10:34:07.355485 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:34:07.355459 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7dd46f8d2978d8457ad70b435ff8c4908685e623242c8aa34de9566c717d651a\": container with ID starting with 7dd46f8d2978d8457ad70b435ff8c4908685e623242c8aa34de9566c717d651a not found: ID does not exist" containerID="7dd46f8d2978d8457ad70b435ff8c4908685e623242c8aa34de9566c717d651a" May 21 10:34:07.355574 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:07.355495 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7dd46f8d2978d8457ad70b435ff8c4908685e623242c8aa34de9566c717d651a"} err="failed to get container status \"7dd46f8d2978d8457ad70b435ff8c4908685e623242c8aa34de9566c717d651a\": rpc error: code = NotFound desc = could not find container \"7dd46f8d2978d8457ad70b435ff8c4908685e623242c8aa34de9566c717d651a\": container with ID starting with 7dd46f8d2978d8457ad70b435ff8c4908685e623242c8aa34de9566c717d651a not found: ID does not exist" May 21 10:34:07.374826 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:07.374803 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6794c6745f-sv894"] May 21 10:34:07.377583 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:07.377564 2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6794c6745f-sv894"] May 21 10:34:07.636167 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:07.636090 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8820f2db-b345-4b16-9e47-fd3c512b8afd" path="/var/lib/kubelet/pods/8820f2db-b345-4b16-9e47-fd3c512b8afd/volumes" May 21 10:34:19.532607 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:19.532556 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35d22f25-59d6-48b0-a885-ddbcfcdf5cb0-metrics-certs\") pod \"network-metrics-daemon-flzlz\" (UID: \"35d22f25-59d6-48b0-a885-ddbcfcdf5cb0\") " pod="openshift-multus/network-metrics-daemon-flzlz" May 21 10:34:19.536649 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:19.536587 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35d22f25-59d6-48b0-a885-ddbcfcdf5cb0-metrics-certs\") pod \"network-metrics-daemon-flzlz\" (UID: \"35d22f25-59d6-48b0-a885-ddbcfcdf5cb0\") " pod="openshift-multus/network-metrics-daemon-flzlz" May 21 10:34:19.638306 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:19.638278 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hwkcp\"" May 21 10:34:19.645507 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:19.645483 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flzlz" May 21 10:34:19.801692 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:19.801578 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-flzlz"] May 21 10:34:19.806535 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:34:19.806509 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35d22f25_59d6_48b0_a885_ddbcfcdf5cb0.slice/crio-0690c3062bdc2b4950c5df5e9ae58253646e5a03ed5663b71b8d330e23766b43 WatchSource:0}: Error finding container 0690c3062bdc2b4950c5df5e9ae58253646e5a03ed5663b71b8d330e23766b43: Status 404 returned error can't find the container with id 0690c3062bdc2b4950c5df5e9ae58253646e5a03ed5663b71b8d330e23766b43 May 21 10:34:20.390180 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:20.390138 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-flzlz" event={"ID":"35d22f25-59d6-48b0-a885-ddbcfcdf5cb0","Type":"ContainerStarted","Data":"0690c3062bdc2b4950c5df5e9ae58253646e5a03ed5663b71b8d330e23766b43"} May 21 10:34:21.395302 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:21.395263 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-flzlz" event={"ID":"35d22f25-59d6-48b0-a885-ddbcfcdf5cb0","Type":"ContainerStarted","Data":"b2b9e160d8aa2f8d518872d2a529cd74c422d2b010cebe88b2b69d6ea849f36f"} May 21 10:34:21.395302 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:21.395304 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-flzlz" event={"ID":"35d22f25-59d6-48b0-a885-ddbcfcdf5cb0","Type":"ContainerStarted","Data":"73ce83127ef42241f58399df1d840565402dc1c14213dfb0afc1b068661ff7ea"} May 21 10:34:21.412786 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:21.412740 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-flzlz" podStartSLOduration=253.334790243 podStartE2EDuration="4m14.412727053s" podCreationTimestamp="2026-05-21 10:30:07 +0000 UTC" firstStartedPulling="2026-05-21 10:34:19.808351835 +0000 UTC m=+252.721730884" lastFinishedPulling="2026-05-21 10:34:20.886288637 +0000 UTC m=+253.799667694" observedRunningTime="2026-05-21 10:34:21.411895873 +0000 UTC m=+254.325274943" watchObservedRunningTime="2026-05-21 10:34:21.412727053 +0000 UTC m=+254.326106122" May 21 10:34:46.263754 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:46.263718 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5448ccd757-f4bf4"] May 21 10:34:46.265408 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:46.265372 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d416785a-b408-4452-a55a-a0b95e9583c1" containerName="console" May 21 10:34:46.265408 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:46.265407 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d416785a-b408-4452-a55a-a0b95e9583c1" containerName="console" May 21 10:34:46.265615 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:46.265446 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8820f2db-b345-4b16-9e47-fd3c512b8afd" containerName="console" May 21 10:34:46.265615 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:46.265456 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8820f2db-b345-4b16-9e47-fd3c512b8afd" containerName="console" May 21 10:34:46.265615 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:46.265611 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="d416785a-b408-4452-a55a-a0b95e9583c1" containerName="console" May 21 10:34:46.265756 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:46.265625 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="8820f2db-b345-4b16-9e47-fd3c512b8afd" containerName="console" May 21 10:34:46.270910 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:46.270883 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5448ccd757-f4bf4" May 21 10:34:46.273796 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:46.273776 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" May 21 10:34:46.273898 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:46.273779 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" May 21 10:34:46.274064 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:46.274047 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" May 21 10:34:46.274429 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:46.274412 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" May 21 10:34:46.274535 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:46.274459 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-dpn9f\"" May 21 10:34:46.274969 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:46.274956 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" May 21 10:34:46.280457 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:46.280440 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" May 21 10:34:46.286893 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:46.286874 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5448ccd757-f4bf4"] May 21 10:34:46.335264 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:46.335229 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e88421ce-3e27-4298-9045-5b5634695b5e-serving-certs-ca-bundle\") pod \"telemeter-client-5448ccd757-f4bf4\" (UID: \"e88421ce-3e27-4298-9045-5b5634695b5e\") " pod="openshift-monitoring/telemeter-client-5448ccd757-f4bf4" May 21 10:34:46.335264 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:46.335267 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e88421ce-3e27-4298-9045-5b5634695b5e-secret-telemeter-client\") pod \"telemeter-client-5448ccd757-f4bf4\" (UID: \"e88421ce-3e27-4298-9045-5b5634695b5e\") " pod="openshift-monitoring/telemeter-client-5448ccd757-f4bf4" May 21 10:34:46.335476 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:46.335289 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e88421ce-3e27-4298-9045-5b5634695b5e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5448ccd757-f4bf4\" (UID: \"e88421ce-3e27-4298-9045-5b5634695b5e\") " pod="openshift-monitoring/telemeter-client-5448ccd757-f4bf4" May 21 10:34:46.335476 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:46.335370 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e88421ce-3e27-4298-9045-5b5634695b5e-federate-client-tls\") pod \"telemeter-client-5448ccd757-f4bf4\" (UID: \"e88421ce-3e27-4298-9045-5b5634695b5e\") " pod="openshift-monitoring/telemeter-client-5448ccd757-f4bf4" May 21 10:34:46.335476 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:46.335400 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e88421ce-3e27-4298-9045-5b5634695b5e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5448ccd757-f4bf4\" (UID: \"e88421ce-3e27-4298-9045-5b5634695b5e\") " pod="openshift-monitoring/telemeter-client-5448ccd757-f4bf4" May 21 10:34:46.335476 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:46.335435 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e88421ce-3e27-4298-9045-5b5634695b5e-telemeter-client-tls\") pod \"telemeter-client-5448ccd757-f4bf4\" (UID: \"e88421ce-3e27-4298-9045-5b5634695b5e\") " pod="openshift-monitoring/telemeter-client-5448ccd757-f4bf4" May 21 10:34:46.335476 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:46.335453 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e88421ce-3e27-4298-9045-5b5634695b5e-metrics-client-ca\") pod \"telemeter-client-5448ccd757-f4bf4\" (UID: \"e88421ce-3e27-4298-9045-5b5634695b5e\") " pod="openshift-monitoring/telemeter-client-5448ccd757-f4bf4" May 21 10:34:46.335650 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:46.335493 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2774n\" (UniqueName: \"kubernetes.io/projected/e88421ce-3e27-4298-9045-5b5634695b5e-kube-api-access-2774n\") pod \"telemeter-client-5448ccd757-f4bf4\" (UID: \"e88421ce-3e27-4298-9045-5b5634695b5e\") " pod="openshift-monitoring/telemeter-client-5448ccd757-f4bf4" May 21 10:34:46.436112 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:46.436063 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2774n\" (UniqueName: \"kubernetes.io/projected/e88421ce-3e27-4298-9045-5b5634695b5e-kube-api-access-2774n\") pod \"telemeter-client-5448ccd757-f4bf4\" (UID: \"e88421ce-3e27-4298-9045-5b5634695b5e\") " pod="openshift-monitoring/telemeter-client-5448ccd757-f4bf4" May 21 10:34:46.436293 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:46.436132 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e88421ce-3e27-4298-9045-5b5634695b5e-serving-certs-ca-bundle\") pod \"telemeter-client-5448ccd757-f4bf4\" (UID: \"e88421ce-3e27-4298-9045-5b5634695b5e\") " pod="openshift-monitoring/telemeter-client-5448ccd757-f4bf4" May 21 10:34:46.436293 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:46.436153 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e88421ce-3e27-4298-9045-5b5634695b5e-secret-telemeter-client\") pod \"telemeter-client-5448ccd757-f4bf4\" (UID: \"e88421ce-3e27-4298-9045-5b5634695b5e\") " pod="openshift-monitoring/telemeter-client-5448ccd757-f4bf4" May 21 10:34:46.436293 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:46.436175 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e88421ce-3e27-4298-9045-5b5634695b5e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5448ccd757-f4bf4\" (UID: \"e88421ce-3e27-4298-9045-5b5634695b5e\") " pod="openshift-monitoring/telemeter-client-5448ccd757-f4bf4" May 21 10:34:46.436293 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:46.436198 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e88421ce-3e27-4298-9045-5b5634695b5e-federate-client-tls\") pod \"telemeter-client-5448ccd757-f4bf4\" (UID: \"e88421ce-3e27-4298-9045-5b5634695b5e\") " pod="openshift-monitoring/telemeter-client-5448ccd757-f4bf4" May 21 10:34:46.436293 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:46.436216 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e88421ce-3e27-4298-9045-5b5634695b5e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5448ccd757-f4bf4\" (UID: \"e88421ce-3e27-4298-9045-5b5634695b5e\") " pod="openshift-monitoring/telemeter-client-5448ccd757-f4bf4" May 21 10:34:46.436293 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:46.436254 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e88421ce-3e27-4298-9045-5b5634695b5e-telemeter-client-tls\") pod \"telemeter-client-5448ccd757-f4bf4\" (UID: \"e88421ce-3e27-4298-9045-5b5634695b5e\") " pod="openshift-monitoring/telemeter-client-5448ccd757-f4bf4" May 21 10:34:46.436293 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:46.436279 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e88421ce-3e27-4298-9045-5b5634695b5e-metrics-client-ca\") pod \"telemeter-client-5448ccd757-f4bf4\" (UID: \"e88421ce-3e27-4298-9045-5b5634695b5e\") " pod="openshift-monitoring/telemeter-client-5448ccd757-f4bf4" May 21 10:34:46.437083 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:46.437057 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e88421ce-3e27-4298-9045-5b5634695b5e-serving-certs-ca-bundle\") pod \"telemeter-client-5448ccd757-f4bf4\" (UID: \"e88421ce-3e27-4298-9045-5b5634695b5e\") " pod="openshift-monitoring/telemeter-client-5448ccd757-f4bf4" May 21 10:34:46.437209 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:46.437092 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e88421ce-3e27-4298-9045-5b5634695b5e-metrics-client-ca\") pod \"telemeter-client-5448ccd757-f4bf4\" (UID: \"e88421ce-3e27-4298-9045-5b5634695b5e\") " pod="openshift-monitoring/telemeter-client-5448ccd757-f4bf4" May 21 10:34:46.437209 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:46.437142 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e88421ce-3e27-4298-9045-5b5634695b5e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5448ccd757-f4bf4\" (UID: \"e88421ce-3e27-4298-9045-5b5634695b5e\") " pod="openshift-monitoring/telemeter-client-5448ccd757-f4bf4" May 21 10:34:46.438876 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:46.438849 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e88421ce-3e27-4298-9045-5b5634695b5e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5448ccd757-f4bf4\" (UID: \"e88421ce-3e27-4298-9045-5b5634695b5e\") " pod="openshift-monitoring/telemeter-client-5448ccd757-f4bf4" May 21 10:34:46.439013 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:46.438911 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e88421ce-3e27-4298-9045-5b5634695b5e-telemeter-client-tls\") pod \"telemeter-client-5448ccd757-f4bf4\" (UID: \"e88421ce-3e27-4298-9045-5b5634695b5e\") " pod="openshift-monitoring/telemeter-client-5448ccd757-f4bf4" May 21 10:34:46.439087 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:46.439030 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e88421ce-3e27-4298-9045-5b5634695b5e-federate-client-tls\") pod \"telemeter-client-5448ccd757-f4bf4\" (UID: \"e88421ce-3e27-4298-9045-5b5634695b5e\") " pod="openshift-monitoring/telemeter-client-5448ccd757-f4bf4" May 21 10:34:46.439197 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:46.439179 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e88421ce-3e27-4298-9045-5b5634695b5e-secret-telemeter-client\") pod \"telemeter-client-5448ccd757-f4bf4\" (UID: \"e88421ce-3e27-4298-9045-5b5634695b5e\") " pod="openshift-monitoring/telemeter-client-5448ccd757-f4bf4" May 21 10:34:46.450349 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:46.450331 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2774n\" (UniqueName: \"kubernetes.io/projected/e88421ce-3e27-4298-9045-5b5634695b5e-kube-api-access-2774n\") pod \"telemeter-client-5448ccd757-f4bf4\" (UID: \"e88421ce-3e27-4298-9045-5b5634695b5e\") " pod="openshift-monitoring/telemeter-client-5448ccd757-f4bf4" May 21 10:34:46.581001 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:46.580968 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5448ccd757-f4bf4" May 21 10:34:46.723457 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:46.723412 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5448ccd757-f4bf4"] May 21 10:34:46.727855 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:34:46.727826 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode88421ce_3e27_4298_9045_5b5634695b5e.slice/crio-068a0de1f1222dc9dee96db5e1c7252120adcbe405dc40703ed9fc5fbe3e6c9f WatchSource:0}: Error finding container 068a0de1f1222dc9dee96db5e1c7252120adcbe405dc40703ed9fc5fbe3e6c9f: Status 404 returned error can't find the container with id 068a0de1f1222dc9dee96db5e1c7252120adcbe405dc40703ed9fc5fbe3e6c9f May 21 10:34:47.477143 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:47.477107 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5448ccd757-f4bf4" event={"ID":"e88421ce-3e27-4298-9045-5b5634695b5e","Type":"ContainerStarted","Data":"068a0de1f1222dc9dee96db5e1c7252120adcbe405dc40703ed9fc5fbe3e6c9f"} May 21 10:34:49.483206 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:49.483170 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5448ccd757-f4bf4" event={"ID":"e88421ce-3e27-4298-9045-5b5634695b5e","Type":"ContainerStarted","Data":"324c162910267ede1b7bba116f601ec9d5d99ad22c00a0b7536518de0cd96851"} May 21 10:34:49.483206 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:49.483208 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5448ccd757-f4bf4" event={"ID":"e88421ce-3e27-4298-9045-5b5634695b5e","Type":"ContainerStarted","Data":"7e14b646eac9d53d23021510c8869fc4e388764dce5f1461987b2ac1ada1d72b"} May 21 10:34:49.483669 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:49.483217 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5448ccd757-f4bf4" event={"ID":"e88421ce-3e27-4298-9045-5b5634695b5e","Type":"ContainerStarted","Data":"279106177e629d0978cada9849f7d2b0ce48f2028d088c6adc9d0b7aa72ea198"} May 21 10:34:49.507785 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:49.507696 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5448ccd757-f4bf4" podStartSLOduration=1.207236268 podStartE2EDuration="3.507684568s" podCreationTimestamp="2026-05-21 10:34:46 +0000 UTC" firstStartedPulling="2026-05-21 10:34:46.729665969 +0000 UTC m=+279.643045017" lastFinishedPulling="2026-05-21 10:34:49.030114269 +0000 UTC m=+281.943493317" observedRunningTime="2026-05-21 10:34:49.50711572 +0000 UTC m=+282.420494792" watchObservedRunningTime="2026-05-21 10:34:49.507684568 +0000 UTC m=+282.421063638" May 21 10:34:50.286326 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:50.286293 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-57c6df8bb9-vmlcd"] May 21 10:34:50.289683 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:50.289661 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57c6df8bb9-vmlcd" May 21 10:34:50.311715 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:50.311691 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57c6df8bb9-vmlcd"] May 21 10:34:50.370330 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:50.370293 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f317b41d-ffc9-4c25-bfdc-31452af86799-oauth-serving-cert\") pod \"console-57c6df8bb9-vmlcd\" (UID: \"f317b41d-ffc9-4c25-bfdc-31452af86799\") " pod="openshift-console/console-57c6df8bb9-vmlcd" May 21 10:34:50.370509 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:50.370382 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f317b41d-ffc9-4c25-bfdc-31452af86799-service-ca\") pod \"console-57c6df8bb9-vmlcd\" (UID: \"f317b41d-ffc9-4c25-bfdc-31452af86799\") " pod="openshift-console/console-57c6df8bb9-vmlcd" May 21 10:34:50.370509 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:50.370408 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ctnz\" (UniqueName: \"kubernetes.io/projected/f317b41d-ffc9-4c25-bfdc-31452af86799-kube-api-access-5ctnz\") pod \"console-57c6df8bb9-vmlcd\" (UID: \"f317b41d-ffc9-4c25-bfdc-31452af86799\") " pod="openshift-console/console-57c6df8bb9-vmlcd" May 21 10:34:50.370509 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:50.370437 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f317b41d-ffc9-4c25-bfdc-31452af86799-console-config\") pod \"console-57c6df8bb9-vmlcd\" (UID: \"f317b41d-ffc9-4c25-bfdc-31452af86799\") " pod="openshift-console/console-57c6df8bb9-vmlcd" May 21 10:34:50.370672 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:50.370505 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f317b41d-ffc9-4c25-bfdc-31452af86799-console-oauth-config\") pod \"console-57c6df8bb9-vmlcd\" (UID: \"f317b41d-ffc9-4c25-bfdc-31452af86799\") " pod="openshift-console/console-57c6df8bb9-vmlcd" May 21 10:34:50.370672 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:50.370564 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f317b41d-ffc9-4c25-bfdc-31452af86799-console-serving-cert\") pod \"console-57c6df8bb9-vmlcd\" (UID: \"f317b41d-ffc9-4c25-bfdc-31452af86799\") " pod="openshift-console/console-57c6df8bb9-vmlcd" May 21 10:34:50.370672 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:50.370596 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f317b41d-ffc9-4c25-bfdc-31452af86799-trusted-ca-bundle\") pod \"console-57c6df8bb9-vmlcd\" (UID: \"f317b41d-ffc9-4c25-bfdc-31452af86799\") " pod="openshift-console/console-57c6df8bb9-vmlcd" May 21 10:34:50.471402 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:50.471363 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f317b41d-ffc9-4c25-bfdc-31452af86799-service-ca\") pod \"console-57c6df8bb9-vmlcd\" (UID: \"f317b41d-ffc9-4c25-bfdc-31452af86799\") " pod="openshift-console/console-57c6df8bb9-vmlcd" May 21 10:34:50.471402 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:50.471401 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5ctnz\" (UniqueName: \"kubernetes.io/projected/f317b41d-ffc9-4c25-bfdc-31452af86799-kube-api-access-5ctnz\") pod \"console-57c6df8bb9-vmlcd\" (UID: \"f317b41d-ffc9-4c25-bfdc-31452af86799\") " pod="openshift-console/console-57c6df8bb9-vmlcd" May 21 10:34:50.471748 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:50.471419 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f317b41d-ffc9-4c25-bfdc-31452af86799-console-config\") pod \"console-57c6df8bb9-vmlcd\" (UID: \"f317b41d-ffc9-4c25-bfdc-31452af86799\") " pod="openshift-console/console-57c6df8bb9-vmlcd" May 21 10:34:50.471748 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:50.471439 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f317b41d-ffc9-4c25-bfdc-31452af86799-console-oauth-config\") pod \"console-57c6df8bb9-vmlcd\" (UID: \"f317b41d-ffc9-4c25-bfdc-31452af86799\") " pod="openshift-console/console-57c6df8bb9-vmlcd" May 21 10:34:50.471748 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:50.471458 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f317b41d-ffc9-4c25-bfdc-31452af86799-console-serving-cert\") pod \"console-57c6df8bb9-vmlcd\" (UID: \"f317b41d-ffc9-4c25-bfdc-31452af86799\") " pod="openshift-console/console-57c6df8bb9-vmlcd" May 21 10:34:50.471748 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:50.471474 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f317b41d-ffc9-4c25-bfdc-31452af86799-trusted-ca-bundle\") pod \"console-57c6df8bb9-vmlcd\" (UID: \"f317b41d-ffc9-4c25-bfdc-31452af86799\") " pod="openshift-console/console-57c6df8bb9-vmlcd" May 21 10:34:50.471748 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:50.471522 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f317b41d-ffc9-4c25-bfdc-31452af86799-oauth-serving-cert\") pod \"console-57c6df8bb9-vmlcd\" (UID: \"f317b41d-ffc9-4c25-bfdc-31452af86799\") " pod="openshift-console/console-57c6df8bb9-vmlcd" May 21 10:34:50.472259 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:50.472228 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f317b41d-ffc9-4c25-bfdc-31452af86799-service-ca\") pod \"console-57c6df8bb9-vmlcd\" (UID: \"f317b41d-ffc9-4c25-bfdc-31452af86799\") " pod="openshift-console/console-57c6df8bb9-vmlcd" May 21 10:34:50.472376 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:50.472270 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f317b41d-ffc9-4c25-bfdc-31452af86799-console-config\") pod \"console-57c6df8bb9-vmlcd\" (UID: \"f317b41d-ffc9-4c25-bfdc-31452af86799\") " pod="openshift-console/console-57c6df8bb9-vmlcd" May 21 10:34:50.472376 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:50.472317 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f317b41d-ffc9-4c25-bfdc-31452af86799-oauth-serving-cert\") pod \"console-57c6df8bb9-vmlcd\" (UID: \"f317b41d-ffc9-4c25-bfdc-31452af86799\") " pod="openshift-console/console-57c6df8bb9-vmlcd" May 21 10:34:50.472376 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:50.472368 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f317b41d-ffc9-4c25-bfdc-31452af86799-trusted-ca-bundle\") pod \"console-57c6df8bb9-vmlcd\" (UID: \"f317b41d-ffc9-4c25-bfdc-31452af86799\") " pod="openshift-console/console-57c6df8bb9-vmlcd" May 21 10:34:50.473918 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:50.473888 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f317b41d-ffc9-4c25-bfdc-31452af86799-console-serving-cert\") pod \"console-57c6df8bb9-vmlcd\" (UID: \"f317b41d-ffc9-4c25-bfdc-31452af86799\") " pod="openshift-console/console-57c6df8bb9-vmlcd" May 21 10:34:50.474041 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:50.473918 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f317b41d-ffc9-4c25-bfdc-31452af86799-console-oauth-config\") pod \"console-57c6df8bb9-vmlcd\" (UID: \"f317b41d-ffc9-4c25-bfdc-31452af86799\") " pod="openshift-console/console-57c6df8bb9-vmlcd" May 21 10:34:50.479952 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:50.479924 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ctnz\" (UniqueName: \"kubernetes.io/projected/f317b41d-ffc9-4c25-bfdc-31452af86799-kube-api-access-5ctnz\") pod \"console-57c6df8bb9-vmlcd\" (UID: \"f317b41d-ffc9-4c25-bfdc-31452af86799\") " pod="openshift-console/console-57c6df8bb9-vmlcd" May 21 10:34:50.598712 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:50.598667 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57c6df8bb9-vmlcd" May 21 10:34:50.727213 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:50.727189 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57c6df8bb9-vmlcd"] May 21 10:34:50.729773 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:34:50.729739 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf317b41d_ffc9_4c25_bfdc_31452af86799.slice/crio-3909e0bb8a3b33c27733a4057f910d8891709974d13d2fa7a2b6d331b546c1e4 WatchSource:0}: Error finding container 3909e0bb8a3b33c27733a4057f910d8891709974d13d2fa7a2b6d331b546c1e4: Status 404 returned error can't find the container with id 3909e0bb8a3b33c27733a4057f910d8891709974d13d2fa7a2b6d331b546c1e4 May 21 10:34:51.491089 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:51.491052 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57c6df8bb9-vmlcd" event={"ID":"f317b41d-ffc9-4c25-bfdc-31452af86799","Type":"ContainerStarted","Data":"27fa8d2b2dbc0e9965b278abd50e773422d7c9143ce93813ad6fb2ab2c43f53a"} May 21 10:34:51.491089 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:51.491088 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57c6df8bb9-vmlcd" event={"ID":"f317b41d-ffc9-4c25-bfdc-31452af86799","Type":"ContainerStarted","Data":"3909e0bb8a3b33c27733a4057f910d8891709974d13d2fa7a2b6d331b546c1e4"} May 21 10:34:51.510064 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:51.510011 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-57c6df8bb9-vmlcd" podStartSLOduration=1.5099958679999999 podStartE2EDuration="1.509995868s" podCreationTimestamp="2026-05-21 10:34:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 10:34:51.5098386 +0000 UTC m=+284.423217670" watchObservedRunningTime="2026-05-21 10:34:51.509995868 +0000 UTC m=+284.423374938" May 21 10:34:57.199716 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:57.199678 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57c6df8bb9-vmlcd"] May 21 10:34:57.238633 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:57.238604 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-74dbdff65c-hwrrg"] May 21 10:34:57.241760 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:57.241743 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74dbdff65c-hwrrg" May 21 10:34:57.253054 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:57.253027 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74dbdff65c-hwrrg"] May 21 10:34:57.332823 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:57.332781 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d8ffe04-0c7d-4805-9d12-e321d093a44b-console-serving-cert\") pod \"console-74dbdff65c-hwrrg\" (UID: \"3d8ffe04-0c7d-4805-9d12-e321d093a44b\") " pod="openshift-console/console-74dbdff65c-hwrrg" May 21 10:34:57.332823 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:57.332827 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d8ffe04-0c7d-4805-9d12-e321d093a44b-oauth-serving-cert\") pod \"console-74dbdff65c-hwrrg\" (UID: \"3d8ffe04-0c7d-4805-9d12-e321d093a44b\") " pod="openshift-console/console-74dbdff65c-hwrrg" May 21 10:34:57.333129 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:57.332851 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d8ffe04-0c7d-4805-9d12-e321d093a44b-console-config\") pod \"console-74dbdff65c-hwrrg\" (UID: \"3d8ffe04-0c7d-4805-9d12-e321d093a44b\") " pod="openshift-console/console-74dbdff65c-hwrrg" May 21 10:34:57.333129 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:57.332997 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d8ffe04-0c7d-4805-9d12-e321d093a44b-service-ca\") pod \"console-74dbdff65c-hwrrg\" (UID: \"3d8ffe04-0c7d-4805-9d12-e321d093a44b\") " pod="openshift-console/console-74dbdff65c-hwrrg" May 21 10:34:57.333129 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:57.333032 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6f8p\" (UniqueName: \"kubernetes.io/projected/3d8ffe04-0c7d-4805-9d12-e321d093a44b-kube-api-access-p6f8p\") pod \"console-74dbdff65c-hwrrg\" (UID: \"3d8ffe04-0c7d-4805-9d12-e321d093a44b\") " pod="openshift-console/console-74dbdff65c-hwrrg" May 21 10:34:57.333129 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:57.333093 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d8ffe04-0c7d-4805-9d12-e321d093a44b-trusted-ca-bundle\") pod \"console-74dbdff65c-hwrrg\" (UID: \"3d8ffe04-0c7d-4805-9d12-e321d093a44b\") " pod="openshift-console/console-74dbdff65c-hwrrg" May 21 10:34:57.333283 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:57.333132 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d8ffe04-0c7d-4805-9d12-e321d093a44b-console-oauth-config\") pod \"console-74dbdff65c-hwrrg\" (UID: \"3d8ffe04-0c7d-4805-9d12-e321d093a44b\") " pod="openshift-console/console-74dbdff65c-hwrrg" May 21 10:34:57.433510 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:57.433474 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d8ffe04-0c7d-4805-9d12-e321d093a44b-trusted-ca-bundle\") pod \"console-74dbdff65c-hwrrg\" (UID: \"3d8ffe04-0c7d-4805-9d12-e321d093a44b\") " pod="openshift-console/console-74dbdff65c-hwrrg" May 21 10:34:57.433510 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:57.433516 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d8ffe04-0c7d-4805-9d12-e321d093a44b-console-oauth-config\") pod \"console-74dbdff65c-hwrrg\" (UID: \"3d8ffe04-0c7d-4805-9d12-e321d093a44b\") " pod="openshift-console/console-74dbdff65c-hwrrg" May 21 10:34:57.433776 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:57.433537 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d8ffe04-0c7d-4805-9d12-e321d093a44b-console-serving-cert\") pod \"console-74dbdff65c-hwrrg\" (UID: \"3d8ffe04-0c7d-4805-9d12-e321d093a44b\") " pod="openshift-console/console-74dbdff65c-hwrrg" May 21 10:34:57.433776 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:57.433570 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d8ffe04-0c7d-4805-9d12-e321d093a44b-oauth-serving-cert\") pod \"console-74dbdff65c-hwrrg\" (UID: \"3d8ffe04-0c7d-4805-9d12-e321d093a44b\") " pod="openshift-console/console-74dbdff65c-hwrrg" May 21 10:34:57.433776 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:57.433588 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d8ffe04-0c7d-4805-9d12-e321d093a44b-console-config\") pod \"console-74dbdff65c-hwrrg\" (UID: \"3d8ffe04-0c7d-4805-9d12-e321d093a44b\") " pod="openshift-console/console-74dbdff65c-hwrrg" May 21 10:34:57.433776 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:57.433644 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d8ffe04-0c7d-4805-9d12-e321d093a44b-service-ca\") pod \"console-74dbdff65c-hwrrg\" (UID: \"3d8ffe04-0c7d-4805-9d12-e321d093a44b\") " pod="openshift-console/console-74dbdff65c-hwrrg" May 21 10:34:57.433776 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:57.433668 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p6f8p\" (UniqueName: \"kubernetes.io/projected/3d8ffe04-0c7d-4805-9d12-e321d093a44b-kube-api-access-p6f8p\") pod \"console-74dbdff65c-hwrrg\" (UID: \"3d8ffe04-0c7d-4805-9d12-e321d093a44b\") " pod="openshift-console/console-74dbdff65c-hwrrg" May 21 10:34:57.434449 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:57.434417 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d8ffe04-0c7d-4805-9d12-e321d093a44b-service-ca\") pod \"console-74dbdff65c-hwrrg\" (UID: \"3d8ffe04-0c7d-4805-9d12-e321d093a44b\") " pod="openshift-console/console-74dbdff65c-hwrrg" May 21 10:34:57.434576 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:57.434417 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d8ffe04-0c7d-4805-9d12-e321d093a44b-oauth-serving-cert\") pod \"console-74dbdff65c-hwrrg\" (UID: \"3d8ffe04-0c7d-4805-9d12-e321d093a44b\") " pod="openshift-console/console-74dbdff65c-hwrrg" May 21 10:34:57.434576 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:57.434490 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d8ffe04-0c7d-4805-9d12-e321d093a44b-trusted-ca-bundle\") pod \"console-74dbdff65c-hwrrg\" (UID: \"3d8ffe04-0c7d-4805-9d12-e321d093a44b\") " pod="openshift-console/console-74dbdff65c-hwrrg" May 21 10:34:57.434702 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:57.434581 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d8ffe04-0c7d-4805-9d12-e321d093a44b-console-config\") pod \"console-74dbdff65c-hwrrg\" (UID: \"3d8ffe04-0c7d-4805-9d12-e321d093a44b\") " pod="openshift-console/console-74dbdff65c-hwrrg" May 21 10:34:57.436007 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:57.435981 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d8ffe04-0c7d-4805-9d12-e321d093a44b-console-oauth-config\") pod \"console-74dbdff65c-hwrrg\" (UID: \"3d8ffe04-0c7d-4805-9d12-e321d093a44b\") " pod="openshift-console/console-74dbdff65c-hwrrg" May 21 10:34:57.436122 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:57.436096 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d8ffe04-0c7d-4805-9d12-e321d093a44b-console-serving-cert\") pod \"console-74dbdff65c-hwrrg\" (UID: \"3d8ffe04-0c7d-4805-9d12-e321d093a44b\") " pod="openshift-console/console-74dbdff65c-hwrrg" May 21 10:34:57.441695 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:57.441671 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6f8p\" (UniqueName: \"kubernetes.io/projected/3d8ffe04-0c7d-4805-9d12-e321d093a44b-kube-api-access-p6f8p\") pod \"console-74dbdff65c-hwrrg\" (UID: \"3d8ffe04-0c7d-4805-9d12-e321d093a44b\") " pod="openshift-console/console-74dbdff65c-hwrrg" May 21 10:34:57.550958 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:57.550843 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74dbdff65c-hwrrg" May 21 10:34:57.687215 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:57.687189 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74dbdff65c-hwrrg"] May 21 10:34:57.690171 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:34:57.690133 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d8ffe04_0c7d_4805_9d12_e321d093a44b.slice/crio-438463d1bc338471ffd1c1e905edfc5c953c1d3aaad915cac6addc4fc6ae27af WatchSource:0}: Error finding container 438463d1bc338471ffd1c1e905edfc5c953c1d3aaad915cac6addc4fc6ae27af: Status 404 returned error can't find the container with id 438463d1bc338471ffd1c1e905edfc5c953c1d3aaad915cac6addc4fc6ae27af May 21 10:34:58.515622 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:58.515582 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74dbdff65c-hwrrg" event={"ID":"3d8ffe04-0c7d-4805-9d12-e321d093a44b","Type":"ContainerStarted","Data":"6a9625d2bd39ac3c9a9bc9c3e8f61cba6d656302e9bb743fd7c30758fe485b4f"} May 21 10:34:58.515622 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:58.515621 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74dbdff65c-hwrrg" event={"ID":"3d8ffe04-0c7d-4805-9d12-e321d093a44b","Type":"ContainerStarted","Data":"438463d1bc338471ffd1c1e905edfc5c953c1d3aaad915cac6addc4fc6ae27af"} May 21 10:34:58.535730 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:34:58.535679 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-74dbdff65c-hwrrg" podStartSLOduration=1.535664604 podStartE2EDuration="1.535664604s" podCreationTimestamp="2026-05-21 10:34:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 10:34:58.534260986 +0000 UTC m=+291.447640056" watchObservedRunningTime="2026-05-21 10:34:58.535664604 +0000 UTC m=+291.449043674" May 21 10:35:00.599106 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:00.599067 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-57c6df8bb9-vmlcd" May 21 10:35:07.528550 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:07.528524 2565 kubelet.go:1628] "Image garbage collection succeeded" May 21 10:35:07.551868 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:07.551839 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-74dbdff65c-hwrrg" May 21 10:35:07.552028 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:07.551885 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-74dbdff65c-hwrrg" May 21 10:35:07.557008 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:07.556866 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-74dbdff65c-hwrrg" May 21 10:35:08.546927 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:08.546896 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-74dbdff65c-hwrrg" May 21 10:35:08.597687 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:08.597656 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6878678fd5-5hnvd"] May 21 10:35:22.218116 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:22.218053 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-57c6df8bb9-vmlcd" podUID="f317b41d-ffc9-4c25-bfdc-31452af86799" containerName="console" containerID="cri-o://27fa8d2b2dbc0e9965b278abd50e773422d7c9143ce93813ad6fb2ab2c43f53a" gracePeriod=15 May 21 10:35:22.463650 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:22.463626 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-57c6df8bb9-vmlcd_f317b41d-ffc9-4c25-bfdc-31452af86799/console/0.log" May 21 10:35:22.463786 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:22.463702 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57c6df8bb9-vmlcd" May 21 10:35:22.560742 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:22.560711 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5ctnz\" (UniqueName: \"kubernetes.io/projected/f317b41d-ffc9-4c25-bfdc-31452af86799-kube-api-access-5ctnz\") pod \"f317b41d-ffc9-4c25-bfdc-31452af86799\" (UID: \"f317b41d-ffc9-4c25-bfdc-31452af86799\") " May 21 10:35:22.560911 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:22.560758 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f317b41d-ffc9-4c25-bfdc-31452af86799-trusted-ca-bundle\") pod \"f317b41d-ffc9-4c25-bfdc-31452af86799\" (UID: \"f317b41d-ffc9-4c25-bfdc-31452af86799\") " May 21 10:35:22.560911 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:22.560804 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f317b41d-ffc9-4c25-bfdc-31452af86799-service-ca\") pod \"f317b41d-ffc9-4c25-bfdc-31452af86799\" (UID: \"f317b41d-ffc9-4c25-bfdc-31452af86799\") " May 21 10:35:22.560911 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:22.560827 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f317b41d-ffc9-4c25-bfdc-31452af86799-console-config\") pod \"f317b41d-ffc9-4c25-bfdc-31452af86799\" (UID: \"f317b41d-ffc9-4c25-bfdc-31452af86799\") " May 21 10:35:22.560911 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:22.560864 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f317b41d-ffc9-4c25-bfdc-31452af86799-console-oauth-config\") pod \"f317b41d-ffc9-4c25-bfdc-31452af86799\" (UID: \"f317b41d-ffc9-4c25-bfdc-31452af86799\") " May 21 10:35:22.560911 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:22.560885 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f317b41d-ffc9-4c25-bfdc-31452af86799-oauth-serving-cert\") pod \"f317b41d-ffc9-4c25-bfdc-31452af86799\" (UID: \"f317b41d-ffc9-4c25-bfdc-31452af86799\") " May 21 10:35:22.561201 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:22.560913 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f317b41d-ffc9-4c25-bfdc-31452af86799-console-serving-cert\") pod \"f317b41d-ffc9-4c25-bfdc-31452af86799\" (UID: \"f317b41d-ffc9-4c25-bfdc-31452af86799\") " May 21 10:35:22.561359 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:22.561318 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f317b41d-ffc9-4c25-bfdc-31452af86799-console-config" (OuterVolumeSpecName: "console-config") pod "f317b41d-ffc9-4c25-bfdc-31452af86799" (UID: "f317b41d-ffc9-4c25-bfdc-31452af86799"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 10:35:22.561359 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:22.561327 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f317b41d-ffc9-4c25-bfdc-31452af86799-service-ca" (OuterVolumeSpecName: "service-ca") pod "f317b41d-ffc9-4c25-bfdc-31452af86799" (UID: "f317b41d-ffc9-4c25-bfdc-31452af86799"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 10:35:22.561359 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:22.561345 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f317b41d-ffc9-4c25-bfdc-31452af86799-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f317b41d-ffc9-4c25-bfdc-31452af86799" (UID: "f317b41d-ffc9-4c25-bfdc-31452af86799"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 10:35:22.561536 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:22.561350 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f317b41d-ffc9-4c25-bfdc-31452af86799-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f317b41d-ffc9-4c25-bfdc-31452af86799" (UID: "f317b41d-ffc9-4c25-bfdc-31452af86799"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 10:35:22.562919 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:22.562896 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f317b41d-ffc9-4c25-bfdc-31452af86799-kube-api-access-5ctnz" (OuterVolumeSpecName: "kube-api-access-5ctnz") pod "f317b41d-ffc9-4c25-bfdc-31452af86799" (UID: "f317b41d-ffc9-4c25-bfdc-31452af86799"). InnerVolumeSpecName "kube-api-access-5ctnz". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 10:35:22.563105 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:22.563074 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f317b41d-ffc9-4c25-bfdc-31452af86799-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f317b41d-ffc9-4c25-bfdc-31452af86799" (UID: "f317b41d-ffc9-4c25-bfdc-31452af86799"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 10:35:22.563155 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:22.563091 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f317b41d-ffc9-4c25-bfdc-31452af86799-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f317b41d-ffc9-4c25-bfdc-31452af86799" (UID: "f317b41d-ffc9-4c25-bfdc-31452af86799"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 10:35:22.583624 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:22.583600 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-57c6df8bb9-vmlcd_f317b41d-ffc9-4c25-bfdc-31452af86799/console/0.log" May 21 10:35:22.583736 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:22.583641 2565 generic.go:358] "Generic (PLEG): container finished" podID="f317b41d-ffc9-4c25-bfdc-31452af86799" containerID="27fa8d2b2dbc0e9965b278abd50e773422d7c9143ce93813ad6fb2ab2c43f53a" exitCode=2 May 21 10:35:22.583736 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:22.583715 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57c6df8bb9-vmlcd" May 21 10:35:22.583839 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:22.583725 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57c6df8bb9-vmlcd" event={"ID":"f317b41d-ffc9-4c25-bfdc-31452af86799","Type":"ContainerDied","Data":"27fa8d2b2dbc0e9965b278abd50e773422d7c9143ce93813ad6fb2ab2c43f53a"} May 21 10:35:22.583839 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:22.583763 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57c6df8bb9-vmlcd" event={"ID":"f317b41d-ffc9-4c25-bfdc-31452af86799","Type":"ContainerDied","Data":"3909e0bb8a3b33c27733a4057f910d8891709974d13d2fa7a2b6d331b546c1e4"} May 21 10:35:22.583839 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:22.583778 2565 scope.go:117] "RemoveContainer" containerID="27fa8d2b2dbc0e9965b278abd50e773422d7c9143ce93813ad6fb2ab2c43f53a" May 21 10:35:22.591733 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:22.591717 2565 scope.go:117] "RemoveContainer" containerID="27fa8d2b2dbc0e9965b278abd50e773422d7c9143ce93813ad6fb2ab2c43f53a" May 21 10:35:22.591996 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:35:22.591976 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27fa8d2b2dbc0e9965b278abd50e773422d7c9143ce93813ad6fb2ab2c43f53a\": container with ID starting with 27fa8d2b2dbc0e9965b278abd50e773422d7c9143ce93813ad6fb2ab2c43f53a not found: ID does not exist" containerID="27fa8d2b2dbc0e9965b278abd50e773422d7c9143ce93813ad6fb2ab2c43f53a" May 21 10:35:22.592075 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:22.592003 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27fa8d2b2dbc0e9965b278abd50e773422d7c9143ce93813ad6fb2ab2c43f53a"} err="failed to get container status \"27fa8d2b2dbc0e9965b278abd50e773422d7c9143ce93813ad6fb2ab2c43f53a\": rpc error: code = NotFound desc = could not find container \"27fa8d2b2dbc0e9965b278abd50e773422d7c9143ce93813ad6fb2ab2c43f53a\": container with ID starting with 27fa8d2b2dbc0e9965b278abd50e773422d7c9143ce93813ad6fb2ab2c43f53a not found: ID does not exist" May 21 10:35:22.605825 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:22.605797 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57c6df8bb9-vmlcd"] May 21 10:35:22.610336 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:22.610315 2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-57c6df8bb9-vmlcd"] May 21 10:35:22.661874 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:22.661849 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f317b41d-ffc9-4c25-bfdc-31452af86799-service-ca\") on node \"ip-10-0-142-214.ec2.internal\" DevicePath \"\"" May 21 10:35:22.661874 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:22.661872 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f317b41d-ffc9-4c25-bfdc-31452af86799-console-config\") on node \"ip-10-0-142-214.ec2.internal\" DevicePath \"\"" May 21 10:35:22.661874 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:22.661881 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f317b41d-ffc9-4c25-bfdc-31452af86799-console-oauth-config\") on node \"ip-10-0-142-214.ec2.internal\" DevicePath \"\"" May 21 10:35:22.662087 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:22.661893 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f317b41d-ffc9-4c25-bfdc-31452af86799-oauth-serving-cert\") on node \"ip-10-0-142-214.ec2.internal\" DevicePath \"\"" May 21 10:35:22.662087 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:22.661903 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f317b41d-ffc9-4c25-bfdc-31452af86799-console-serving-cert\") on node \"ip-10-0-142-214.ec2.internal\" DevicePath \"\"" May 21 10:35:22.662087 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:22.661912 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5ctnz\" (UniqueName: \"kubernetes.io/projected/f317b41d-ffc9-4c25-bfdc-31452af86799-kube-api-access-5ctnz\") on node \"ip-10-0-142-214.ec2.internal\" DevicePath \"\"" May 21 10:35:22.662087 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:22.661921 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f317b41d-ffc9-4c25-bfdc-31452af86799-trusted-ca-bundle\") on node \"ip-10-0-142-214.ec2.internal\" DevicePath \"\"" May 21 10:35:23.635618 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:23.635587 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f317b41d-ffc9-4c25-bfdc-31452af86799" path="/var/lib/kubelet/pods/f317b41d-ffc9-4c25-bfdc-31452af86799/volumes" May 21 10:35:33.618230 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:33.618173 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-6878678fd5-5hnvd" podUID="85b23d9c-1d13-47a6-8a02-3c715681a862" containerName="console" containerID="cri-o://593d5fd6ad6cd4587cafef1b53b9c19dd81bd8a081930e5dabd55afbf5c3dcc8" gracePeriod=15 May 21 10:35:33.857252 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:33.857223 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6878678fd5-5hnvd_85b23d9c-1d13-47a6-8a02-3c715681a862/console/0.log" May 21 10:35:33.857362 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:33.857283 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6878678fd5-5hnvd" May 21 10:35:33.954088 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:33.954004 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/85b23d9c-1d13-47a6-8a02-3c715681a862-oauth-serving-cert\") pod \"85b23d9c-1d13-47a6-8a02-3c715681a862\" (UID: \"85b23d9c-1d13-47a6-8a02-3c715681a862\") " May 21 10:35:33.954088 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:33.954056 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fr59l\" (UniqueName: \"kubernetes.io/projected/85b23d9c-1d13-47a6-8a02-3c715681a862-kube-api-access-fr59l\") pod \"85b23d9c-1d13-47a6-8a02-3c715681a862\" (UID: \"85b23d9c-1d13-47a6-8a02-3c715681a862\") " May 21 10:35:33.954088 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:33.954088 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85b23d9c-1d13-47a6-8a02-3c715681a862-trusted-ca-bundle\") pod \"85b23d9c-1d13-47a6-8a02-3c715681a862\" (UID: \"85b23d9c-1d13-47a6-8a02-3c715681a862\") " May 21 10:35:33.954312 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:33.954192 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/85b23d9c-1d13-47a6-8a02-3c715681a862-service-ca\") pod \"85b23d9c-1d13-47a6-8a02-3c715681a862\" (UID: \"85b23d9c-1d13-47a6-8a02-3c715681a862\") " May 21 10:35:33.954312 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:33.954229 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/85b23d9c-1d13-47a6-8a02-3c715681a862-console-oauth-config\") pod \"85b23d9c-1d13-47a6-8a02-3c715681a862\" (UID: \"85b23d9c-1d13-47a6-8a02-3c715681a862\") " May 21 10:35:33.954312 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:33.954261 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/85b23d9c-1d13-47a6-8a02-3c715681a862-console-serving-cert\") pod \"85b23d9c-1d13-47a6-8a02-3c715681a862\" (UID: \"85b23d9c-1d13-47a6-8a02-3c715681a862\") " May 21 10:35:33.954312 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:33.954295 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/85b23d9c-1d13-47a6-8a02-3c715681a862-console-config\") pod \"85b23d9c-1d13-47a6-8a02-3c715681a862\" (UID: \"85b23d9c-1d13-47a6-8a02-3c715681a862\") " May 21 10:35:33.954523 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:33.954492 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85b23d9c-1d13-47a6-8a02-3c715681a862-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "85b23d9c-1d13-47a6-8a02-3c715681a862" (UID: "85b23d9c-1d13-47a6-8a02-3c715681a862"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 10:35:33.954586 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:33.954500 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85b23d9c-1d13-47a6-8a02-3c715681a862-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "85b23d9c-1d13-47a6-8a02-3c715681a862" (UID: "85b23d9c-1d13-47a6-8a02-3c715681a862"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 10:35:33.954644 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:33.954581 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/85b23d9c-1d13-47a6-8a02-3c715681a862-oauth-serving-cert\") on node \"ip-10-0-142-214.ec2.internal\" DevicePath \"\"" May 21 10:35:33.954644 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:33.954599 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85b23d9c-1d13-47a6-8a02-3c715681a862-trusted-ca-bundle\") on node \"ip-10-0-142-214.ec2.internal\" DevicePath \"\"" May 21 10:35:33.954751 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:33.954730 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85b23d9c-1d13-47a6-8a02-3c715681a862-service-ca" (OuterVolumeSpecName: "service-ca") pod "85b23d9c-1d13-47a6-8a02-3c715681a862" (UID: "85b23d9c-1d13-47a6-8a02-3c715681a862"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 10:35:33.954795 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:33.954747 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85b23d9c-1d13-47a6-8a02-3c715681a862-console-config" (OuterVolumeSpecName: "console-config") pod "85b23d9c-1d13-47a6-8a02-3c715681a862" (UID: "85b23d9c-1d13-47a6-8a02-3c715681a862"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 10:35:33.956357 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:33.956330 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85b23d9c-1d13-47a6-8a02-3c715681a862-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "85b23d9c-1d13-47a6-8a02-3c715681a862" (UID: "85b23d9c-1d13-47a6-8a02-3c715681a862"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 10:35:33.956357 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:33.956334 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85b23d9c-1d13-47a6-8a02-3c715681a862-kube-api-access-fr59l" (OuterVolumeSpecName: "kube-api-access-fr59l") pod "85b23d9c-1d13-47a6-8a02-3c715681a862" (UID: "85b23d9c-1d13-47a6-8a02-3c715681a862"). InnerVolumeSpecName "kube-api-access-fr59l". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 10:35:33.956498 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:33.956387 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85b23d9c-1d13-47a6-8a02-3c715681a862-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "85b23d9c-1d13-47a6-8a02-3c715681a862" (UID: "85b23d9c-1d13-47a6-8a02-3c715681a862"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 10:35:34.055125 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:34.055078 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fr59l\" (UniqueName: \"kubernetes.io/projected/85b23d9c-1d13-47a6-8a02-3c715681a862-kube-api-access-fr59l\") on node \"ip-10-0-142-214.ec2.internal\" DevicePath \"\"" May 21 10:35:34.055125 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:34.055122 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/85b23d9c-1d13-47a6-8a02-3c715681a862-service-ca\") on node \"ip-10-0-142-214.ec2.internal\" DevicePath \"\"" May 21 10:35:34.055325 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:34.055135 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/85b23d9c-1d13-47a6-8a02-3c715681a862-console-oauth-config\") on node \"ip-10-0-142-214.ec2.internal\" DevicePath \"\"" May 21 10:35:34.055325 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:34.055147 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/85b23d9c-1d13-47a6-8a02-3c715681a862-console-serving-cert\") on node \"ip-10-0-142-214.ec2.internal\" DevicePath \"\"" May 21 10:35:34.055325 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:34.055160 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/85b23d9c-1d13-47a6-8a02-3c715681a862-console-config\") on node \"ip-10-0-142-214.ec2.internal\" DevicePath \"\"" May 21 10:35:34.620814 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:34.620784 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6878678fd5-5hnvd_85b23d9c-1d13-47a6-8a02-3c715681a862/console/0.log" May 21 10:35:34.621274 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:34.620826 2565 generic.go:358] "Generic (PLEG): container finished" podID="85b23d9c-1d13-47a6-8a02-3c715681a862" containerID="593d5fd6ad6cd4587cafef1b53b9c19dd81bd8a081930e5dabd55afbf5c3dcc8" exitCode=2 May 21 10:35:34.621274 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:34.620891 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6878678fd5-5hnvd" May 21 10:35:34.621274 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:34.620896 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6878678fd5-5hnvd" event={"ID":"85b23d9c-1d13-47a6-8a02-3c715681a862","Type":"ContainerDied","Data":"593d5fd6ad6cd4587cafef1b53b9c19dd81bd8a081930e5dabd55afbf5c3dcc8"} May 21 10:35:34.621274 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:34.620934 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6878678fd5-5hnvd" event={"ID":"85b23d9c-1d13-47a6-8a02-3c715681a862","Type":"ContainerDied","Data":"86ca5143f85200626129e91b9a7110d7d40af0deaa4c8b9826a974c7651f00a5"} May 21 10:35:34.621274 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:34.620978 2565 scope.go:117] "RemoveContainer" containerID="593d5fd6ad6cd4587cafef1b53b9c19dd81bd8a081930e5dabd55afbf5c3dcc8" May 21 10:35:34.628887 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:34.628867 2565 scope.go:117] "RemoveContainer" containerID="593d5fd6ad6cd4587cafef1b53b9c19dd81bd8a081930e5dabd55afbf5c3dcc8" May 21 10:35:34.629152 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:35:34.629133 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"593d5fd6ad6cd4587cafef1b53b9c19dd81bd8a081930e5dabd55afbf5c3dcc8\": container with ID starting with 593d5fd6ad6cd4587cafef1b53b9c19dd81bd8a081930e5dabd55afbf5c3dcc8 not found: ID does not exist" containerID="593d5fd6ad6cd4587cafef1b53b9c19dd81bd8a081930e5dabd55afbf5c3dcc8" May 21 10:35:34.629235 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:34.629165 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"593d5fd6ad6cd4587cafef1b53b9c19dd81bd8a081930e5dabd55afbf5c3dcc8"} err="failed to get container status \"593d5fd6ad6cd4587cafef1b53b9c19dd81bd8a081930e5dabd55afbf5c3dcc8\": rpc error: code = NotFound desc = could not find container \"593d5fd6ad6cd4587cafef1b53b9c19dd81bd8a081930e5dabd55afbf5c3dcc8\": container with ID starting with 593d5fd6ad6cd4587cafef1b53b9c19dd81bd8a081930e5dabd55afbf5c3dcc8 not found: ID does not exist" May 21 10:35:34.641742 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:34.641718 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6878678fd5-5hnvd"] May 21 10:35:34.646095 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:34.646074 2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6878678fd5-5hnvd"] May 21 10:35:35.635421 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:35:35.635388 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85b23d9c-1d13-47a6-8a02-3c715681a862" path="/var/lib/kubelet/pods/85b23d9c-1d13-47a6-8a02-3c715681a862/volumes" May 21 10:36:11.737249 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:11.737213 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dp4v6f"] May 21 10:36:11.737654 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:11.737512 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f317b41d-ffc9-4c25-bfdc-31452af86799" containerName="console" May 21 10:36:11.737654 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:11.737523 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f317b41d-ffc9-4c25-bfdc-31452af86799" containerName="console" May 21 10:36:11.737654 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:11.737536 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85b23d9c-1d13-47a6-8a02-3c715681a862" containerName="console" May 21 10:36:11.737654 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:11.737541 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="85b23d9c-1d13-47a6-8a02-3c715681a862" containerName="console" May 21 10:36:11.737654 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:11.737591 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="85b23d9c-1d13-47a6-8a02-3c715681a862" containerName="console" May 21 10:36:11.737654 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:11.737600 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="f317b41d-ffc9-4c25-bfdc-31452af86799" containerName="console" May 21 10:36:11.741870 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:11.741851 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dp4v6f" May 21 10:36:11.744421 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:11.744400 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 21 10:36:11.745261 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:11.745244 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-s2j7w\"" May 21 10:36:11.745346 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:11.745245 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 21 10:36:11.755829 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:11.755800 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dp4v6f"] May 21 10:36:11.759505 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:11.759485 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a42a277-5adc-4644-98fe-1b4b75117269-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dp4v6f\" (UID: \"9a42a277-5adc-4644-98fe-1b4b75117269\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dp4v6f" May 21 10:36:11.759599 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:11.759518 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a42a277-5adc-4644-98fe-1b4b75117269-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dp4v6f\" (UID: \"9a42a277-5adc-4644-98fe-1b4b75117269\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dp4v6f" May 21 10:36:11.759599 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:11.759545 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jg4nc\" (UniqueName: \"kubernetes.io/projected/9a42a277-5adc-4644-98fe-1b4b75117269-kube-api-access-jg4nc\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dp4v6f\" (UID: \"9a42a277-5adc-4644-98fe-1b4b75117269\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dp4v6f" May 21 10:36:11.860354 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:11.860314 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a42a277-5adc-4644-98fe-1b4b75117269-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dp4v6f\" (UID: \"9a42a277-5adc-4644-98fe-1b4b75117269\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dp4v6f" May 21 10:36:11.860354 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:11.860362 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jg4nc\" (UniqueName: \"kubernetes.io/projected/9a42a277-5adc-4644-98fe-1b4b75117269-kube-api-access-jg4nc\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dp4v6f\" (UID: \"9a42a277-5adc-4644-98fe-1b4b75117269\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dp4v6f" May 21 10:36:11.860634 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:11.860421 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a42a277-5adc-4644-98fe-1b4b75117269-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dp4v6f\" (UID: \"9a42a277-5adc-4644-98fe-1b4b75117269\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dp4v6f" May 21 10:36:11.860687 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:11.860666 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a42a277-5adc-4644-98fe-1b4b75117269-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dp4v6f\" (UID: \"9a42a277-5adc-4644-98fe-1b4b75117269\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dp4v6f" May 21 10:36:11.860741 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:11.860726 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a42a277-5adc-4644-98fe-1b4b75117269-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dp4v6f\" (UID: \"9a42a277-5adc-4644-98fe-1b4b75117269\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dp4v6f" May 21 10:36:11.870031 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:11.870007 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jg4nc\" (UniqueName: \"kubernetes.io/projected/9a42a277-5adc-4644-98fe-1b4b75117269-kube-api-access-jg4nc\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dp4v6f\" (UID: \"9a42a277-5adc-4644-98fe-1b4b75117269\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dp4v6f" May 21 10:36:12.050755 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:12.050663 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dp4v6f" May 21 10:36:12.186037 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:12.186011 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dp4v6f"] May 21 10:36:12.188347 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:36:12.188314 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a42a277_5adc_4644_98fe_1b4b75117269.slice/crio-52314dbd1d148edccf173d57f088c5ec36d60a47c1e7b7556cb238944c60a2af WatchSource:0}: Error finding container 52314dbd1d148edccf173d57f088c5ec36d60a47c1e7b7556cb238944c60a2af: Status 404 returned error can't find the container with id 52314dbd1d148edccf173d57f088c5ec36d60a47c1e7b7556cb238944c60a2af May 21 10:36:12.190178 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:12.190157 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 10:36:12.729238 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:12.729201 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dp4v6f" event={"ID":"9a42a277-5adc-4644-98fe-1b4b75117269","Type":"ContainerStarted","Data":"52314dbd1d148edccf173d57f088c5ec36d60a47c1e7b7556cb238944c60a2af"} May 21 10:36:19.751258 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:19.751224 2565 generic.go:358] "Generic (PLEG): container finished" podID="9a42a277-5adc-4644-98fe-1b4b75117269" containerID="f6d8bef80c73e74201f50939c95aeb34750200e05bd46ce752d4fb81bc4f4dca" exitCode=0 May 21 10:36:19.751661 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:19.751275 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dp4v6f" event={"ID":"9a42a277-5adc-4644-98fe-1b4b75117269","Type":"ContainerDied","Data":"f6d8bef80c73e74201f50939c95aeb34750200e05bd46ce752d4fb81bc4f4dca"} May 21 10:36:22.760867 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:22.760773 2565 generic.go:358] "Generic (PLEG): container finished" podID="9a42a277-5adc-4644-98fe-1b4b75117269" containerID="645c39abc3c6b5badf6c162450cc6071fc91fc76836259e7b31a37042416c4ae" exitCode=0 May 21 10:36:22.760867 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:22.760840 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dp4v6f" event={"ID":"9a42a277-5adc-4644-98fe-1b4b75117269","Type":"ContainerDied","Data":"645c39abc3c6b5badf6c162450cc6071fc91fc76836259e7b31a37042416c4ae"} May 21 10:36:29.784411 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:29.784373 2565 generic.go:358] "Generic (PLEG): container finished" podID="9a42a277-5adc-4644-98fe-1b4b75117269" containerID="cdff49db2d4483df897493f00fcb6eba01a14ee5b0d559931c0592e379c5098a" exitCode=0 May 21 10:36:29.784875 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:29.784450 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dp4v6f" event={"ID":"9a42a277-5adc-4644-98fe-1b4b75117269","Type":"ContainerDied","Data":"cdff49db2d4483df897493f00fcb6eba01a14ee5b0d559931c0592e379c5098a"} May 21 10:36:30.906225 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:30.906202 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dp4v6f" May 21 10:36:31.042830 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:31.042734 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a42a277-5adc-4644-98fe-1b4b75117269-util\") pod \"9a42a277-5adc-4644-98fe-1b4b75117269\" (UID: \"9a42a277-5adc-4644-98fe-1b4b75117269\") " May 21 10:36:31.042830 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:31.042788 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a42a277-5adc-4644-98fe-1b4b75117269-bundle\") pod \"9a42a277-5adc-4644-98fe-1b4b75117269\" (UID: \"9a42a277-5adc-4644-98fe-1b4b75117269\") " May 21 10:36:31.043107 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:31.042897 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jg4nc\" (UniqueName: \"kubernetes.io/projected/9a42a277-5adc-4644-98fe-1b4b75117269-kube-api-access-jg4nc\") pod \"9a42a277-5adc-4644-98fe-1b4b75117269\" (UID: \"9a42a277-5adc-4644-98fe-1b4b75117269\") " May 21 10:36:31.043477 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:31.043442 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a42a277-5adc-4644-98fe-1b4b75117269-bundle" (OuterVolumeSpecName: "bundle") pod "9a42a277-5adc-4644-98fe-1b4b75117269" (UID: "9a42a277-5adc-4644-98fe-1b4b75117269"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 10:36:31.045056 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:31.045027 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a42a277-5adc-4644-98fe-1b4b75117269-kube-api-access-jg4nc" (OuterVolumeSpecName: "kube-api-access-jg4nc") pod "9a42a277-5adc-4644-98fe-1b4b75117269" (UID: "9a42a277-5adc-4644-98fe-1b4b75117269"). InnerVolumeSpecName "kube-api-access-jg4nc". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 10:36:31.046978 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:31.046935 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a42a277-5adc-4644-98fe-1b4b75117269-util" (OuterVolumeSpecName: "util") pod "9a42a277-5adc-4644-98fe-1b4b75117269" (UID: "9a42a277-5adc-4644-98fe-1b4b75117269"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 10:36:31.143665 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:31.143628 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jg4nc\" (UniqueName: \"kubernetes.io/projected/9a42a277-5adc-4644-98fe-1b4b75117269-kube-api-access-jg4nc\") on node \"ip-10-0-142-214.ec2.internal\" DevicePath \"\"" May 21 10:36:31.143665 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:31.143661 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a42a277-5adc-4644-98fe-1b4b75117269-util\") on node \"ip-10-0-142-214.ec2.internal\" DevicePath \"\"" May 21 10:36:31.143665 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:31.143673 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a42a277-5adc-4644-98fe-1b4b75117269-bundle\") on node \"ip-10-0-142-214.ec2.internal\" DevicePath \"\"" May 21 10:36:31.792119 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:31.792086 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dp4v6f" event={"ID":"9a42a277-5adc-4644-98fe-1b4b75117269","Type":"ContainerDied","Data":"52314dbd1d148edccf173d57f088c5ec36d60a47c1e7b7556cb238944c60a2af"} May 21 10:36:31.792119 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:31.792119 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="52314dbd1d148edccf173d57f088c5ec36d60a47c1e7b7556cb238944c60a2af" May 21 10:36:31.792327 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:31.792139 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dp4v6f" May 21 10:36:35.181321 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:35.181290 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-9j9c4"] May 21 10:36:35.181796 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:35.181595 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a42a277-5adc-4644-98fe-1b4b75117269" containerName="pull" May 21 10:36:35.181796 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:35.181605 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a42a277-5adc-4644-98fe-1b4b75117269" containerName="pull" May 21 10:36:35.181796 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:35.181616 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a42a277-5adc-4644-98fe-1b4b75117269" containerName="extract" May 21 10:36:35.181796 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:35.181622 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a42a277-5adc-4644-98fe-1b4b75117269" containerName="extract" May 21 10:36:35.181796 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:35.181634 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a42a277-5adc-4644-98fe-1b4b75117269" containerName="util" May 21 10:36:35.181796 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:35.181640 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a42a277-5adc-4644-98fe-1b4b75117269" containerName="util" May 21 10:36:35.181796 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:35.181694 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="9a42a277-5adc-4644-98fe-1b4b75117269" containerName="extract" May 21 10:36:35.225406 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:35.225376 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-9j9c4"] May 21 10:36:35.225567 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:35.225488 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-9j9c4" May 21 10:36:35.230422 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:35.230389 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" May 21 10:36:35.230638 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:35.230621 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" May 21 10:36:35.230694 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:35.230681 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-bvskr\"" May 21 10:36:35.382543 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:35.382507 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcshw\" (UniqueName: \"kubernetes.io/projected/f02c7f22-c5ef-474d-bc47-2eeb9b491d19-kube-api-access-xcshw\") pod \"cert-manager-operator-controller-manager-54b9655956-9j9c4\" (UID: \"f02c7f22-c5ef-474d-bc47-2eeb9b491d19\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-9j9c4" May 21 10:36:35.382727 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:35.382578 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f02c7f22-c5ef-474d-bc47-2eeb9b491d19-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-9j9c4\" (UID: \"f02c7f22-c5ef-474d-bc47-2eeb9b491d19\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-9j9c4" May 21 10:36:35.483199 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:35.483103 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xcshw\" (UniqueName: \"kubernetes.io/projected/f02c7f22-c5ef-474d-bc47-2eeb9b491d19-kube-api-access-xcshw\") pod \"cert-manager-operator-controller-manager-54b9655956-9j9c4\" (UID: \"f02c7f22-c5ef-474d-bc47-2eeb9b491d19\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-9j9c4" May 21 10:36:35.483376 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:35.483206 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f02c7f22-c5ef-474d-bc47-2eeb9b491d19-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-9j9c4\" (UID: \"f02c7f22-c5ef-474d-bc47-2eeb9b491d19\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-9j9c4" May 21 10:36:35.483587 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:35.483566 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f02c7f22-c5ef-474d-bc47-2eeb9b491d19-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-9j9c4\" (UID: \"f02c7f22-c5ef-474d-bc47-2eeb9b491d19\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-9j9c4" May 21 10:36:35.506882 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:35.506852 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcshw\" (UniqueName: \"kubernetes.io/projected/f02c7f22-c5ef-474d-bc47-2eeb9b491d19-kube-api-access-xcshw\") pod \"cert-manager-operator-controller-manager-54b9655956-9j9c4\" (UID: \"f02c7f22-c5ef-474d-bc47-2eeb9b491d19\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-9j9c4" May 21 10:36:35.535357 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:35.535329 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-9j9c4" May 21 10:36:35.679145 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:35.679114 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-9j9c4"] May 21 10:36:35.681738 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:36:35.681710 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf02c7f22_c5ef_474d_bc47_2eeb9b491d19.slice/crio-3d5ec5728a893b5ee2551d6768b109b51cd7e3951a91dba9d5fdc4516cb0c4f7 WatchSource:0}: Error finding container 3d5ec5728a893b5ee2551d6768b109b51cd7e3951a91dba9d5fdc4516cb0c4f7: Status 404 returned error can't find the container with id 3d5ec5728a893b5ee2551d6768b109b51cd7e3951a91dba9d5fdc4516cb0c4f7 May 21 10:36:35.804213 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:35.804127 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-9j9c4" event={"ID":"f02c7f22-c5ef-474d-bc47-2eeb9b491d19","Type":"ContainerStarted","Data":"3d5ec5728a893b5ee2551d6768b109b51cd7e3951a91dba9d5fdc4516cb0c4f7"} May 21 10:36:38.816175 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:38.816130 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-9j9c4" event={"ID":"f02c7f22-c5ef-474d-bc47-2eeb9b491d19","Type":"ContainerStarted","Data":"1f1e895d7648232574f057bfc31ce4a1c2b97578eefd7428b86a9344bbd731d1"} May 21 10:36:38.847210 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:38.847146 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-9j9c4" podStartSLOduration=1.53081043 podStartE2EDuration="3.847125904s" podCreationTimestamp="2026-05-21 10:36:35 +0000 UTC" firstStartedPulling="2026-05-21 10:36:35.684265835 +0000 UTC m=+388.597644883" lastFinishedPulling="2026-05-21 10:36:38.00058129 +0000 UTC m=+390.913960357" observedRunningTime="2026-05-21 10:36:38.844393703 +0000 UTC m=+391.757772773" watchObservedRunningTime="2026-05-21 10:36:38.847125904 +0000 UTC m=+391.760504975" May 21 10:36:40.643447 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:40.643413 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-k6cpf"] May 21 10:36:40.669049 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:40.669022 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-k6cpf"] May 21 10:36:40.669241 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:40.669117 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-k6cpf" May 21 10:36:40.672407 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:40.672384 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" May 21 10:36:40.673175 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:40.673132 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" May 21 10:36:40.673445 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:40.673428 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-plll7\"" May 21 10:36:40.828874 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:40.828833 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7d188219-decc-4ce8-8979-e55cea93c536-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-k6cpf\" (UID: \"7d188219-decc-4ce8-8979-e55cea93c536\") " pod="cert-manager/cert-manager-webhook-587ccfb98-k6cpf" May 21 10:36:40.828874 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:40.828874 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvpwk\" (UniqueName: \"kubernetes.io/projected/7d188219-decc-4ce8-8979-e55cea93c536-kube-api-access-lvpwk\") pod \"cert-manager-webhook-587ccfb98-k6cpf\" (UID: \"7d188219-decc-4ce8-8979-e55cea93c536\") " pod="cert-manager/cert-manager-webhook-587ccfb98-k6cpf" May 21 10:36:40.930398 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:40.930300 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7d188219-decc-4ce8-8979-e55cea93c536-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-k6cpf\" (UID: \"7d188219-decc-4ce8-8979-e55cea93c536\") " pod="cert-manager/cert-manager-webhook-587ccfb98-k6cpf" May 21 10:36:40.930398 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:40.930345 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lvpwk\" (UniqueName: \"kubernetes.io/projected/7d188219-decc-4ce8-8979-e55cea93c536-kube-api-access-lvpwk\") pod \"cert-manager-webhook-587ccfb98-k6cpf\" (UID: \"7d188219-decc-4ce8-8979-e55cea93c536\") " pod="cert-manager/cert-manager-webhook-587ccfb98-k6cpf" May 21 10:36:40.939783 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:40.939751 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7d188219-decc-4ce8-8979-e55cea93c536-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-k6cpf\" (UID: \"7d188219-decc-4ce8-8979-e55cea93c536\") " pod="cert-manager/cert-manager-webhook-587ccfb98-k6cpf" May 21 10:36:40.941684 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:40.941661 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvpwk\" (UniqueName: \"kubernetes.io/projected/7d188219-decc-4ce8-8979-e55cea93c536-kube-api-access-lvpwk\") pod \"cert-manager-webhook-587ccfb98-k6cpf\" (UID: \"7d188219-decc-4ce8-8979-e55cea93c536\") " pod="cert-manager/cert-manager-webhook-587ccfb98-k6cpf" May 21 10:36:40.978680 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:40.978647 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-k6cpf" May 21 10:36:41.105392 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:41.105258 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-k6cpf"] May 21 10:36:41.107968 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:36:41.107930 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7d188219_decc_4ce8_8979_e55cea93c536.slice/crio-8c7b8e96fc4190a24fef3d8b60a12ccbf3c79ea68c0290633cd74f8e58bfd31a WatchSource:0}: Error finding container 8c7b8e96fc4190a24fef3d8b60a12ccbf3c79ea68c0290633cd74f8e58bfd31a: Status 404 returned error can't find the container with id 8c7b8e96fc4190a24fef3d8b60a12ccbf3c79ea68c0290633cd74f8e58bfd31a May 21 10:36:41.827077 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:41.827029 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-k6cpf" event={"ID":"7d188219-decc-4ce8-8979-e55cea93c536","Type":"ContainerStarted","Data":"8c7b8e96fc4190a24fef3d8b60a12ccbf3c79ea68c0290633cd74f8e58bfd31a"} May 21 10:36:44.626518 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:44.626487 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-w9d5m"] May 21 10:36:44.628714 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:44.628694 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-w9d5m" May 21 10:36:44.631809 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:44.631790 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-fpc9t\"" May 21 10:36:44.637987 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:44.637963 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-w9d5m"] May 21 10:36:44.764145 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:44.764098 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1a0c662b-6284-4c55-9d2f-14001632524e-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-w9d5m\" (UID: \"1a0c662b-6284-4c55-9d2f-14001632524e\") " pod="cert-manager/cert-manager-cainjector-68b757865b-w9d5m" May 21 10:36:44.764329 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:44.764173 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qt5p7\" (UniqueName: \"kubernetes.io/projected/1a0c662b-6284-4c55-9d2f-14001632524e-kube-api-access-qt5p7\") pod \"cert-manager-cainjector-68b757865b-w9d5m\" (UID: \"1a0c662b-6284-4c55-9d2f-14001632524e\") " pod="cert-manager/cert-manager-cainjector-68b757865b-w9d5m" May 21 10:36:44.838828 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:44.838792 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-k6cpf" event={"ID":"7d188219-decc-4ce8-8979-e55cea93c536","Type":"ContainerStarted","Data":"4b1457ff3b78a90eb92f297f7d8753b59fc640ebcb7729d6f0179d7f0b561695"} May 21 10:36:44.839014 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:44.838923 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-k6cpf" May 21 10:36:44.856889 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:44.856844 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-k6cpf" podStartSLOduration=2.107495855 podStartE2EDuration="4.856830387s" podCreationTimestamp="2026-05-21 10:36:40 +0000 UTC" firstStartedPulling="2026-05-21 10:36:41.109839771 +0000 UTC m=+394.023218819" lastFinishedPulling="2026-05-21 10:36:43.859174304 +0000 UTC m=+396.772553351" observedRunningTime="2026-05-21 10:36:44.856137237 +0000 UTC m=+397.769516307" watchObservedRunningTime="2026-05-21 10:36:44.856830387 +0000 UTC m=+397.770209456" May 21 10:36:44.865475 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:44.865448 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qt5p7\" (UniqueName: \"kubernetes.io/projected/1a0c662b-6284-4c55-9d2f-14001632524e-kube-api-access-qt5p7\") pod \"cert-manager-cainjector-68b757865b-w9d5m\" (UID: \"1a0c662b-6284-4c55-9d2f-14001632524e\") " pod="cert-manager/cert-manager-cainjector-68b757865b-w9d5m" May 21 10:36:44.865586 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:44.865523 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1a0c662b-6284-4c55-9d2f-14001632524e-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-w9d5m\" (UID: \"1a0c662b-6284-4c55-9d2f-14001632524e\") " pod="cert-manager/cert-manager-cainjector-68b757865b-w9d5m" May 21 10:36:44.873236 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:44.873210 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1a0c662b-6284-4c55-9d2f-14001632524e-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-w9d5m\" (UID: \"1a0c662b-6284-4c55-9d2f-14001632524e\") " pod="cert-manager/cert-manager-cainjector-68b757865b-w9d5m" May 21 10:36:44.873322 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:44.873285 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qt5p7\" (UniqueName: \"kubernetes.io/projected/1a0c662b-6284-4c55-9d2f-14001632524e-kube-api-access-qt5p7\") pod \"cert-manager-cainjector-68b757865b-w9d5m\" (UID: \"1a0c662b-6284-4c55-9d2f-14001632524e\") " pod="cert-manager/cert-manager-cainjector-68b757865b-w9d5m" May 21 10:36:44.938152 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:44.938069 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-w9d5m" May 21 10:36:45.063554 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:45.063525 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-w9d5m"] May 21 10:36:45.066621 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:36:45.066591 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1a0c662b_6284_4c55_9d2f_14001632524e.slice/crio-c1bff799ca7eebc42cefca18919007ee01d22a763187a92e1550dd05267b57bb WatchSource:0}: Error finding container c1bff799ca7eebc42cefca18919007ee01d22a763187a92e1550dd05267b57bb: Status 404 returned error can't find the container with id c1bff799ca7eebc42cefca18919007ee01d22a763187a92e1550dd05267b57bb May 21 10:36:45.843463 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:45.843430 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-w9d5m" event={"ID":"1a0c662b-6284-4c55-9d2f-14001632524e","Type":"ContainerStarted","Data":"b5bee5b16e45e1a8aa043f223637769e8da396647eaa5297723490c4f06eb929"} May 21 10:36:45.843463 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:45.843468 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-w9d5m" event={"ID":"1a0c662b-6284-4c55-9d2f-14001632524e","Type":"ContainerStarted","Data":"c1bff799ca7eebc42cefca18919007ee01d22a763187a92e1550dd05267b57bb"} May 21 10:36:45.874242 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:45.874188 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-w9d5m" podStartSLOduration=1.8741738890000001 podStartE2EDuration="1.874173889s" podCreationTimestamp="2026-05-21 10:36:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 10:36:45.873328693 +0000 UTC m=+398.786707766" watchObservedRunningTime="2026-05-21 10:36:45.874173889 +0000 UTC m=+398.787552959" May 21 10:36:50.845822 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:36:50.845784 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-k6cpf" May 21 10:37:08.990870 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:08.990835 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5ct7r8"] May 21 10:37:08.993217 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:08.993200 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5ct7r8" May 21 10:37:08.995699 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:08.995676 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 21 10:37:08.995816 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:08.995759 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 21 10:37:08.996679 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:08.996654 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-s2j7w\"" May 21 10:37:09.002453 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:09.002430 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5ct7r8"] May 21 10:37:09.073926 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:09.073895 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7212b78-1a27-48fe-a606-2aadf6c18d25-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5ct7r8\" (UID: \"c7212b78-1a27-48fe-a606-2aadf6c18d25\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5ct7r8" May 21 10:37:09.074115 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:09.073986 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7212b78-1a27-48fe-a606-2aadf6c18d25-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5ct7r8\" (UID: \"c7212b78-1a27-48fe-a606-2aadf6c18d25\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5ct7r8" May 21 10:37:09.074115 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:09.074015 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5fxh\" (UniqueName: \"kubernetes.io/projected/c7212b78-1a27-48fe-a606-2aadf6c18d25-kube-api-access-f5fxh\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5ct7r8\" (UID: \"c7212b78-1a27-48fe-a606-2aadf6c18d25\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5ct7r8" May 21 10:37:09.175038 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:09.174992 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7212b78-1a27-48fe-a606-2aadf6c18d25-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5ct7r8\" (UID: \"c7212b78-1a27-48fe-a606-2aadf6c18d25\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5ct7r8" May 21 10:37:09.175245 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:09.175070 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7212b78-1a27-48fe-a606-2aadf6c18d25-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5ct7r8\" (UID: \"c7212b78-1a27-48fe-a606-2aadf6c18d25\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5ct7r8" May 21 10:37:09.175245 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:09.175091 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f5fxh\" (UniqueName: \"kubernetes.io/projected/c7212b78-1a27-48fe-a606-2aadf6c18d25-kube-api-access-f5fxh\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5ct7r8\" (UID: \"c7212b78-1a27-48fe-a606-2aadf6c18d25\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5ct7r8" May 21 10:37:09.175516 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:09.175493 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7212b78-1a27-48fe-a606-2aadf6c18d25-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5ct7r8\" (UID: \"c7212b78-1a27-48fe-a606-2aadf6c18d25\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5ct7r8" May 21 10:37:09.175585 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:09.175535 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7212b78-1a27-48fe-a606-2aadf6c18d25-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5ct7r8\" (UID: \"c7212b78-1a27-48fe-a606-2aadf6c18d25\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5ct7r8" May 21 10:37:09.184303 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:09.184273 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5fxh\" (UniqueName: \"kubernetes.io/projected/c7212b78-1a27-48fe-a606-2aadf6c18d25-kube-api-access-f5fxh\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5ct7r8\" (UID: \"c7212b78-1a27-48fe-a606-2aadf6c18d25\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5ct7r8" May 21 10:37:09.303170 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:09.303084 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5ct7r8" May 21 10:37:09.434566 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:09.434397 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5ct7r8"] May 21 10:37:09.437266 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:37:09.437232 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7212b78_1a27_48fe_a606_2aadf6c18d25.slice/crio-8f0d1ae22e9a545475f08377c4589ef21ecae099076d14997f20eaa9b0643982 WatchSource:0}: Error finding container 8f0d1ae22e9a545475f08377c4589ef21ecae099076d14997f20eaa9b0643982: Status 404 returned error can't find the container with id 8f0d1ae22e9a545475f08377c4589ef21ecae099076d14997f20eaa9b0643982 May 21 10:37:09.926031 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:09.925990 2565 generic.go:358] "Generic (PLEG): container finished" podID="c7212b78-1a27-48fe-a606-2aadf6c18d25" containerID="235fd4f354040727b9b93bda90ebc6e293e7722f83288b23e89e7e304ff19b76" exitCode=0 May 21 10:37:09.926239 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:09.926055 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5ct7r8" event={"ID":"c7212b78-1a27-48fe-a606-2aadf6c18d25","Type":"ContainerDied","Data":"235fd4f354040727b9b93bda90ebc6e293e7722f83288b23e89e7e304ff19b76"} May 21 10:37:09.926239 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:09.926077 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5ct7r8" event={"ID":"c7212b78-1a27-48fe-a606-2aadf6c18d25","Type":"ContainerStarted","Data":"8f0d1ae22e9a545475f08377c4589ef21ecae099076d14997f20eaa9b0643982"} May 21 10:37:10.930697 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:10.930613 2565 generic.go:358] "Generic (PLEG): container finished" podID="c7212b78-1a27-48fe-a606-2aadf6c18d25" containerID="c7fe449d43789ea52bf690bc195ea58b473f12718bee48ed6cd73302e8985ef8" exitCode=0 May 21 10:37:10.930697 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:10.930662 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5ct7r8" event={"ID":"c7212b78-1a27-48fe-a606-2aadf6c18d25","Type":"ContainerDied","Data":"c7fe449d43789ea52bf690bc195ea58b473f12718bee48ed6cd73302e8985ef8"} May 21 10:37:11.935428 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:11.935393 2565 generic.go:358] "Generic (PLEG): container finished" podID="c7212b78-1a27-48fe-a606-2aadf6c18d25" containerID="70ae0fef18865a37786f01790a8e4e54b8a365bf0bf306a4466557fcd3221186" exitCode=0 May 21 10:37:11.935791 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:11.935462 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5ct7r8" event={"ID":"c7212b78-1a27-48fe-a606-2aadf6c18d25","Type":"ContainerDied","Data":"70ae0fef18865a37786f01790a8e4e54b8a365bf0bf306a4466557fcd3221186"} May 21 10:37:13.063066 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:13.063039 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5ct7r8" May 21 10:37:13.112848 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:13.112810 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7212b78-1a27-48fe-a606-2aadf6c18d25-util\") pod \"c7212b78-1a27-48fe-a606-2aadf6c18d25\" (UID: \"c7212b78-1a27-48fe-a606-2aadf6c18d25\") " May 21 10:37:13.113058 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:13.112865 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7212b78-1a27-48fe-a606-2aadf6c18d25-bundle\") pod \"c7212b78-1a27-48fe-a606-2aadf6c18d25\" (UID: \"c7212b78-1a27-48fe-a606-2aadf6c18d25\") " May 21 10:37:13.113058 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:13.112928 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f5fxh\" (UniqueName: \"kubernetes.io/projected/c7212b78-1a27-48fe-a606-2aadf6c18d25-kube-api-access-f5fxh\") pod \"c7212b78-1a27-48fe-a606-2aadf6c18d25\" (UID: \"c7212b78-1a27-48fe-a606-2aadf6c18d25\") " May 21 10:37:13.113641 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:13.113608 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7212b78-1a27-48fe-a606-2aadf6c18d25-bundle" (OuterVolumeSpecName: "bundle") pod "c7212b78-1a27-48fe-a606-2aadf6c18d25" (UID: "c7212b78-1a27-48fe-a606-2aadf6c18d25"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 10:37:13.115002 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:13.114973 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7212b78-1a27-48fe-a606-2aadf6c18d25-kube-api-access-f5fxh" (OuterVolumeSpecName: "kube-api-access-f5fxh") pod "c7212b78-1a27-48fe-a606-2aadf6c18d25" (UID: "c7212b78-1a27-48fe-a606-2aadf6c18d25"). InnerVolumeSpecName "kube-api-access-f5fxh". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 10:37:13.118022 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:13.117988 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7212b78-1a27-48fe-a606-2aadf6c18d25-util" (OuterVolumeSpecName: "util") pod "c7212b78-1a27-48fe-a606-2aadf6c18d25" (UID: "c7212b78-1a27-48fe-a606-2aadf6c18d25"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 10:37:13.214329 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:13.214247 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7212b78-1a27-48fe-a606-2aadf6c18d25-util\") on node \"ip-10-0-142-214.ec2.internal\" DevicePath \"\"" May 21 10:37:13.214329 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:13.214273 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7212b78-1a27-48fe-a606-2aadf6c18d25-bundle\") on node \"ip-10-0-142-214.ec2.internal\" DevicePath \"\"" May 21 10:37:13.214329 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:13.214284 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f5fxh\" (UniqueName: \"kubernetes.io/projected/c7212b78-1a27-48fe-a606-2aadf6c18d25-kube-api-access-f5fxh\") on node \"ip-10-0-142-214.ec2.internal\" DevicePath \"\"" May 21 10:37:13.943832 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:13.943758 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5ct7r8" May 21 10:37:13.943988 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:13.943757 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5ct7r8" event={"ID":"c7212b78-1a27-48fe-a606-2aadf6c18d25","Type":"ContainerDied","Data":"8f0d1ae22e9a545475f08377c4589ef21ecae099076d14997f20eaa9b0643982"} May 21 10:37:13.943988 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:13.943863 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8f0d1ae22e9a545475f08377c4589ef21ecae099076d14997f20eaa9b0643982" May 21 10:37:19.656241 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:19.656205 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-9b6f47d4-b9bnk"] May 21 10:37:19.656708 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:19.656527 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7212b78-1a27-48fe-a606-2aadf6c18d25" containerName="extract" May 21 10:37:19.656708 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:19.656539 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7212b78-1a27-48fe-a606-2aadf6c18d25" containerName="extract" May 21 10:37:19.656708 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:19.656559 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7212b78-1a27-48fe-a606-2aadf6c18d25" containerName="util" May 21 10:37:19.656708 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:19.656565 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7212b78-1a27-48fe-a606-2aadf6c18d25" containerName="util" May 21 10:37:19.656708 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:19.656574 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7212b78-1a27-48fe-a606-2aadf6c18d25" containerName="pull" May 21 10:37:19.656708 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:19.656580 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7212b78-1a27-48fe-a606-2aadf6c18d25" containerName="pull" May 21 10:37:19.656708 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:19.656627 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="c7212b78-1a27-48fe-a606-2aadf6c18d25" containerName="extract" May 21 10:37:19.658882 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:19.658863 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-9b6f47d4-b9bnk" May 21 10:37:19.666226 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:19.666205 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" May 21 10:37:19.666827 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:19.666810 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-25h9w\"" May 21 10:37:19.667430 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:19.667415 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" May 21 10:37:19.668106 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:19.668091 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" May 21 10:37:19.668986 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:19.668971 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" May 21 10:37:19.669132 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:19.669117 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" May 21 10:37:19.690220 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:19.690193 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-9b6f47d4-b9bnk"] May 21 10:37:19.770588 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:19.770542 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d156b60e-5ed5-4b84-9f88-7de088a6d886-metrics-cert\") pod \"lws-controller-manager-9b6f47d4-b9bnk\" (UID: \"d156b60e-5ed5-4b84-9f88-7de088a6d886\") " pod="openshift-lws-operator/lws-controller-manager-9b6f47d4-b9bnk" May 21 10:37:19.770787 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:19.770643 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d156b60e-5ed5-4b84-9f88-7de088a6d886-cert\") pod \"lws-controller-manager-9b6f47d4-b9bnk\" (UID: \"d156b60e-5ed5-4b84-9f88-7de088a6d886\") " pod="openshift-lws-operator/lws-controller-manager-9b6f47d4-b9bnk" May 21 10:37:19.770787 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:19.770747 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d156b60e-5ed5-4b84-9f88-7de088a6d886-manager-config\") pod \"lws-controller-manager-9b6f47d4-b9bnk\" (UID: \"d156b60e-5ed5-4b84-9f88-7de088a6d886\") " pod="openshift-lws-operator/lws-controller-manager-9b6f47d4-b9bnk" May 21 10:37:19.770904 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:19.770815 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cv7qj\" (UniqueName: \"kubernetes.io/projected/d156b60e-5ed5-4b84-9f88-7de088a6d886-kube-api-access-cv7qj\") pod \"lws-controller-manager-9b6f47d4-b9bnk\" (UID: \"d156b60e-5ed5-4b84-9f88-7de088a6d886\") " pod="openshift-lws-operator/lws-controller-manager-9b6f47d4-b9bnk" May 21 10:37:19.871885 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:19.871848 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d156b60e-5ed5-4b84-9f88-7de088a6d886-metrics-cert\") pod \"lws-controller-manager-9b6f47d4-b9bnk\" (UID: \"d156b60e-5ed5-4b84-9f88-7de088a6d886\") " pod="openshift-lws-operator/lws-controller-manager-9b6f47d4-b9bnk" May 21 10:37:19.872076 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:19.871898 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d156b60e-5ed5-4b84-9f88-7de088a6d886-cert\") pod \"lws-controller-manager-9b6f47d4-b9bnk\" (UID: \"d156b60e-5ed5-4b84-9f88-7de088a6d886\") " pod="openshift-lws-operator/lws-controller-manager-9b6f47d4-b9bnk" May 21 10:37:19.872076 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:19.871951 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d156b60e-5ed5-4b84-9f88-7de088a6d886-manager-config\") pod \"lws-controller-manager-9b6f47d4-b9bnk\" (UID: \"d156b60e-5ed5-4b84-9f88-7de088a6d886\") " pod="openshift-lws-operator/lws-controller-manager-9b6f47d4-b9bnk" May 21 10:37:19.872076 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:19.871981 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cv7qj\" (UniqueName: \"kubernetes.io/projected/d156b60e-5ed5-4b84-9f88-7de088a6d886-kube-api-access-cv7qj\") pod \"lws-controller-manager-9b6f47d4-b9bnk\" (UID: \"d156b60e-5ed5-4b84-9f88-7de088a6d886\") " pod="openshift-lws-operator/lws-controller-manager-9b6f47d4-b9bnk" May 21 10:37:19.872655 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:19.872632 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d156b60e-5ed5-4b84-9f88-7de088a6d886-manager-config\") pod \"lws-controller-manager-9b6f47d4-b9bnk\" (UID: \"d156b60e-5ed5-4b84-9f88-7de088a6d886\") " pod="openshift-lws-operator/lws-controller-manager-9b6f47d4-b9bnk" May 21 10:37:19.874371 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:19.874351 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d156b60e-5ed5-4b84-9f88-7de088a6d886-cert\") pod \"lws-controller-manager-9b6f47d4-b9bnk\" (UID: \"d156b60e-5ed5-4b84-9f88-7de088a6d886\") " pod="openshift-lws-operator/lws-controller-manager-9b6f47d4-b9bnk" May 21 10:37:19.874460 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:19.874434 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d156b60e-5ed5-4b84-9f88-7de088a6d886-metrics-cert\") pod \"lws-controller-manager-9b6f47d4-b9bnk\" (UID: \"d156b60e-5ed5-4b84-9f88-7de088a6d886\") " pod="openshift-lws-operator/lws-controller-manager-9b6f47d4-b9bnk" May 21 10:37:19.883685 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:19.883662 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cv7qj\" (UniqueName: \"kubernetes.io/projected/d156b60e-5ed5-4b84-9f88-7de088a6d886-kube-api-access-cv7qj\") pod \"lws-controller-manager-9b6f47d4-b9bnk\" (UID: \"d156b60e-5ed5-4b84-9f88-7de088a6d886\") " pod="openshift-lws-operator/lws-controller-manager-9b6f47d4-b9bnk" May 21 10:37:19.968994 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:19.968706 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-9b6f47d4-b9bnk" May 21 10:37:20.140870 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:20.140838 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-9b6f47d4-b9bnk"] May 21 10:37:20.142395 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:37:20.142334 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd156b60e_5ed5_4b84_9f88_7de088a6d886.slice/crio-8582b1e830242d1aff639c35b20969ef29d4d80455dcdebdc7fed5e82e89c752 WatchSource:0}: Error finding container 8582b1e830242d1aff639c35b20969ef29d4d80455dcdebdc7fed5e82e89c752: Status 404 returned error can't find the container with id 8582b1e830242d1aff639c35b20969ef29d4d80455dcdebdc7fed5e82e89c752 May 21 10:37:20.968777 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:20.968739 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-9b6f47d4-b9bnk" event={"ID":"d156b60e-5ed5-4b84-9f88-7de088a6d886","Type":"ContainerStarted","Data":"8582b1e830242d1aff639c35b20969ef29d4d80455dcdebdc7fed5e82e89c752"} May 21 10:37:21.930496 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:21.930456 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5fc5c76ccc-4x6p8"] May 21 10:37:21.934783 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:21.934749 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5fc5c76ccc-4x6p8" May 21 10:37:21.937652 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:21.937626 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 21 10:37:21.938826 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:21.938805 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 21 10:37:21.940348 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:21.940326 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 21 10:37:21.940483 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:21.940406 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 21 10:37:21.940747 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:21.940727 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-7hxq7\"" May 21 10:37:21.964867 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:21.964834 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5fc5c76ccc-4x6p8"] May 21 10:37:22.093445 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:22.093395 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xz2pm\" (UniqueName: \"kubernetes.io/projected/8792aeb4-d72b-410e-8692-02a3b7cb0f5c-kube-api-access-xz2pm\") pod \"opendatahub-operator-controller-manager-5fc5c76ccc-4x6p8\" (UID: \"8792aeb4-d72b-410e-8692-02a3b7cb0f5c\") " pod="opendatahub/opendatahub-operator-controller-manager-5fc5c76ccc-4x6p8" May 21 10:37:22.093880 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:22.093482 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8792aeb4-d72b-410e-8692-02a3b7cb0f5c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5fc5c76ccc-4x6p8\" (UID: \"8792aeb4-d72b-410e-8692-02a3b7cb0f5c\") " pod="opendatahub/opendatahub-operator-controller-manager-5fc5c76ccc-4x6p8" May 21 10:37:22.093880 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:22.093520 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8792aeb4-d72b-410e-8692-02a3b7cb0f5c-webhook-cert\") pod \"opendatahub-operator-controller-manager-5fc5c76ccc-4x6p8\" (UID: \"8792aeb4-d72b-410e-8692-02a3b7cb0f5c\") " pod="opendatahub/opendatahub-operator-controller-manager-5fc5c76ccc-4x6p8" May 21 10:37:22.194753 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:22.194664 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xz2pm\" (UniqueName: \"kubernetes.io/projected/8792aeb4-d72b-410e-8692-02a3b7cb0f5c-kube-api-access-xz2pm\") pod \"opendatahub-operator-controller-manager-5fc5c76ccc-4x6p8\" (UID: \"8792aeb4-d72b-410e-8692-02a3b7cb0f5c\") " pod="opendatahub/opendatahub-operator-controller-manager-5fc5c76ccc-4x6p8" May 21 10:37:22.194929 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:22.194754 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8792aeb4-d72b-410e-8692-02a3b7cb0f5c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5fc5c76ccc-4x6p8\" (UID: \"8792aeb4-d72b-410e-8692-02a3b7cb0f5c\") " pod="opendatahub/opendatahub-operator-controller-manager-5fc5c76ccc-4x6p8" May 21 10:37:22.194929 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:22.194787 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8792aeb4-d72b-410e-8692-02a3b7cb0f5c-webhook-cert\") pod \"opendatahub-operator-controller-manager-5fc5c76ccc-4x6p8\" (UID: \"8792aeb4-d72b-410e-8692-02a3b7cb0f5c\") " pod="opendatahub/opendatahub-operator-controller-manager-5fc5c76ccc-4x6p8" May 21 10:37:22.197441 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:22.197409 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8792aeb4-d72b-410e-8692-02a3b7cb0f5c-webhook-cert\") pod \"opendatahub-operator-controller-manager-5fc5c76ccc-4x6p8\" (UID: \"8792aeb4-d72b-410e-8692-02a3b7cb0f5c\") " pod="opendatahub/opendatahub-operator-controller-manager-5fc5c76ccc-4x6p8" May 21 10:37:22.197551 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:22.197417 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8792aeb4-d72b-410e-8692-02a3b7cb0f5c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5fc5c76ccc-4x6p8\" (UID: \"8792aeb4-d72b-410e-8692-02a3b7cb0f5c\") " pod="opendatahub/opendatahub-operator-controller-manager-5fc5c76ccc-4x6p8" May 21 10:37:22.207179 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:22.207133 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xz2pm\" (UniqueName: \"kubernetes.io/projected/8792aeb4-d72b-410e-8692-02a3b7cb0f5c-kube-api-access-xz2pm\") pod \"opendatahub-operator-controller-manager-5fc5c76ccc-4x6p8\" (UID: \"8792aeb4-d72b-410e-8692-02a3b7cb0f5c\") " pod="opendatahub/opendatahub-operator-controller-manager-5fc5c76ccc-4x6p8" May 21 10:37:22.247978 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:22.247919 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5fc5c76ccc-4x6p8" May 21 10:37:23.015701 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:23.015676 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5fc5c76ccc-4x6p8"] May 21 10:37:23.019109 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:37:23.019073 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8792aeb4_d72b_410e_8692_02a3b7cb0f5c.slice/crio-8f7cc2743a861c53f12ce0650ec75349e5214b43f06f5dc96215d5af3914df25 WatchSource:0}: Error finding container 8f7cc2743a861c53f12ce0650ec75349e5214b43f06f5dc96215d5af3914df25: Status 404 returned error can't find the container with id 8f7cc2743a861c53f12ce0650ec75349e5214b43f06f5dc96215d5af3914df25 May 21 10:37:23.987004 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:23.986962 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-9b6f47d4-b9bnk" event={"ID":"d156b60e-5ed5-4b84-9f88-7de088a6d886","Type":"ContainerStarted","Data":"4b55eeed7d15ec06d93b404ad329728bbdf521947963784dcbf83ce2e0fc2ce8"} May 21 10:37:23.987482 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:23.987080 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-9b6f47d4-b9bnk" May 21 10:37:23.988463 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:23.988433 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5fc5c76ccc-4x6p8" event={"ID":"8792aeb4-d72b-410e-8692-02a3b7cb0f5c","Type":"ContainerStarted","Data":"8f7cc2743a861c53f12ce0650ec75349e5214b43f06f5dc96215d5af3914df25"} May 21 10:37:24.006672 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:24.006605 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-9b6f47d4-b9bnk" podStartSLOduration=2.242893183 podStartE2EDuration="5.006584167s" podCreationTimestamp="2026-05-21 10:37:19 +0000 UTC" firstStartedPulling="2026-05-21 10:37:20.144664303 +0000 UTC m=+433.058043358" lastFinishedPulling="2026-05-21 10:37:22.908355293 +0000 UTC m=+435.821734342" observedRunningTime="2026-05-21 10:37:24.005854228 +0000 UTC m=+436.919233312" watchObservedRunningTime="2026-05-21 10:37:24.006584167 +0000 UTC m=+436.919963237" May 21 10:37:25.996827 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:25.996789 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5fc5c76ccc-4x6p8" event={"ID":"8792aeb4-d72b-410e-8692-02a3b7cb0f5c","Type":"ContainerStarted","Data":"49fc714e699638b0da2a847b8802cc84e1b805d789e428d2e5e9a961a9454bd2"} May 21 10:37:25.997234 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:25.996898 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5fc5c76ccc-4x6p8" May 21 10:37:26.020889 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:26.020821 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5fc5c76ccc-4x6p8" podStartSLOduration=2.687719125 podStartE2EDuration="5.02080167s" podCreationTimestamp="2026-05-21 10:37:21 +0000 UTC" firstStartedPulling="2026-05-21 10:37:23.020583044 +0000 UTC m=+435.933962108" lastFinishedPulling="2026-05-21 10:37:25.353665591 +0000 UTC m=+438.267044653" observedRunningTime="2026-05-21 10:37:26.01911935 +0000 UTC m=+438.932498429" watchObservedRunningTime="2026-05-21 10:37:26.02080167 +0000 UTC m=+438.934180741" May 21 10:37:34.995421 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:34.995346 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-9b6f47d4-b9bnk" May 21 10:37:37.002914 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:37:37.002881 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5fc5c76ccc-4x6p8" May 21 10:38:17.388333 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:17.388053 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8hst4b"] May 21 10:38:17.391745 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:17.391722 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8hst4b" May 21 10:38:17.394453 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:17.394422 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" May 21 10:38:17.394453 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:17.394422 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-cc4nq\"" May 21 10:38:17.404090 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:17.404059 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8hst4b"] May 21 10:38:17.483732 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:17.483683 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3677da8-2d2c-4577-beb7-dbc8a652094e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8hst4b\" (UID: \"d3677da8-2d2c-4577-beb7-dbc8a652094e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8hst4b" May 21 10:38:17.483732 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:17.483731 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3677da8-2d2c-4577-beb7-dbc8a652094e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8hst4b\" (UID: \"d3677da8-2d2c-4577-beb7-dbc8a652094e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8hst4b" May 21 10:38:17.484031 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:17.483753 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3677da8-2d2c-4577-beb7-dbc8a652094e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8hst4b\" (UID: \"d3677da8-2d2c-4577-beb7-dbc8a652094e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8hst4b" May 21 10:38:17.484031 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:17.483771 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3677da8-2d2c-4577-beb7-dbc8a652094e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8hst4b\" (UID: \"d3677da8-2d2c-4577-beb7-dbc8a652094e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8hst4b" May 21 10:38:17.484031 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:17.483810 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bw78s\" (UniqueName: \"kubernetes.io/projected/d3677da8-2d2c-4577-beb7-dbc8a652094e-kube-api-access-bw78s\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8hst4b\" (UID: \"d3677da8-2d2c-4577-beb7-dbc8a652094e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8hst4b" May 21 10:38:17.484031 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:17.483871 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3677da8-2d2c-4577-beb7-dbc8a652094e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8hst4b\" (UID: \"d3677da8-2d2c-4577-beb7-dbc8a652094e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8hst4b" May 21 10:38:17.484031 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:17.483917 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3677da8-2d2c-4577-beb7-dbc8a652094e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8hst4b\" (UID: \"d3677da8-2d2c-4577-beb7-dbc8a652094e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8hst4b" May 21 10:38:17.484031 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:17.484024 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3677da8-2d2c-4577-beb7-dbc8a652094e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8hst4b\" (UID: \"d3677da8-2d2c-4577-beb7-dbc8a652094e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8hst4b" May 21 10:38:17.484236 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:17.484063 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3677da8-2d2c-4577-beb7-dbc8a652094e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8hst4b\" (UID: \"d3677da8-2d2c-4577-beb7-dbc8a652094e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8hst4b" May 21 10:38:17.585331 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:17.585293 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3677da8-2d2c-4577-beb7-dbc8a652094e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8hst4b\" (UID: \"d3677da8-2d2c-4577-beb7-dbc8a652094e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8hst4b" May 21 10:38:17.585535 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:17.585339 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3677da8-2d2c-4577-beb7-dbc8a652094e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8hst4b\" (UID: \"d3677da8-2d2c-4577-beb7-dbc8a652094e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8hst4b" May 21 10:38:17.585535 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:17.585378 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3677da8-2d2c-4577-beb7-dbc8a652094e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8hst4b\" (UID: \"d3677da8-2d2c-4577-beb7-dbc8a652094e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8hst4b" May 21 10:38:17.585535 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:17.585412 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3677da8-2d2c-4577-beb7-dbc8a652094e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8hst4b\" (UID: \"d3677da8-2d2c-4577-beb7-dbc8a652094e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8hst4b" May 21 10:38:17.585535 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:17.585465 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3677da8-2d2c-4577-beb7-dbc8a652094e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8hst4b\" (UID: \"d3677da8-2d2c-4577-beb7-dbc8a652094e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8hst4b" May 21 10:38:17.585535 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:17.585491 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3677da8-2d2c-4577-beb7-dbc8a652094e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8hst4b\" (UID: \"d3677da8-2d2c-4577-beb7-dbc8a652094e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8hst4b" May 21 10:38:17.585535 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:17.585519 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3677da8-2d2c-4577-beb7-dbc8a652094e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8hst4b\" (UID: \"d3677da8-2d2c-4577-beb7-dbc8a652094e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8hst4b" May 21 10:38:17.585842 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:17.585551 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3677da8-2d2c-4577-beb7-dbc8a652094e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8hst4b\" (UID: \"d3677da8-2d2c-4577-beb7-dbc8a652094e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8hst4b" May 21 10:38:17.585959 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:17.585911 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bw78s\" (UniqueName: \"kubernetes.io/projected/d3677da8-2d2c-4577-beb7-dbc8a652094e-kube-api-access-bw78s\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8hst4b\" (UID: \"d3677da8-2d2c-4577-beb7-dbc8a652094e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8hst4b" May 21 10:38:17.586027 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:17.585973 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3677da8-2d2c-4577-beb7-dbc8a652094e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8hst4b\" (UID: \"d3677da8-2d2c-4577-beb7-dbc8a652094e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8hst4b" May 21 10:38:17.586027 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:17.585987 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3677da8-2d2c-4577-beb7-dbc8a652094e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8hst4b\" (UID: \"d3677da8-2d2c-4577-beb7-dbc8a652094e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8hst4b" May 21 10:38:17.586027 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:17.585973 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3677da8-2d2c-4577-beb7-dbc8a652094e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8hst4b\" (UID: \"d3677da8-2d2c-4577-beb7-dbc8a652094e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8hst4b" May 21 10:38:17.586194 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:17.586097 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3677da8-2d2c-4577-beb7-dbc8a652094e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8hst4b\" (UID: \"d3677da8-2d2c-4577-beb7-dbc8a652094e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8hst4b" May 21 10:38:17.586331 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:17.586311 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3677da8-2d2c-4577-beb7-dbc8a652094e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8hst4b\" (UID: \"d3677da8-2d2c-4577-beb7-dbc8a652094e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8hst4b" May 21 10:38:17.587795 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:17.587777 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3677da8-2d2c-4577-beb7-dbc8a652094e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8hst4b\" (UID: \"d3677da8-2d2c-4577-beb7-dbc8a652094e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8hst4b" May 21 10:38:17.588067 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:17.588048 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3677da8-2d2c-4577-beb7-dbc8a652094e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8hst4b\" (UID: \"d3677da8-2d2c-4577-beb7-dbc8a652094e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8hst4b" May 21 10:38:17.593081 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:17.593056 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3677da8-2d2c-4577-beb7-dbc8a652094e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8hst4b\" (UID: \"d3677da8-2d2c-4577-beb7-dbc8a652094e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8hst4b" May 21 10:38:17.593260 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:17.593241 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bw78s\" (UniqueName: \"kubernetes.io/projected/d3677da8-2d2c-4577-beb7-dbc8a652094e-kube-api-access-bw78s\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8hst4b\" (UID: \"d3677da8-2d2c-4577-beb7-dbc8a652094e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8hst4b" May 21 10:38:17.702367 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:17.702283 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8hst4b" May 21 10:38:17.838380 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:17.838354 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8hst4b"] May 21 10:38:17.840604 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:38:17.840575 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3677da8_2d2c_4577_beb7_dbc8a652094e.slice/crio-9bef70d23e2d0e3ae6bce5b345fdcee3d9116c10c13bb64a4a6aa1cf49115e0f WatchSource:0}: Error finding container 9bef70d23e2d0e3ae6bce5b345fdcee3d9116c10c13bb64a4a6aa1cf49115e0f: Status 404 returned error can't find the container with id 9bef70d23e2d0e3ae6bce5b345fdcee3d9116c10c13bb64a4a6aa1cf49115e0f May 21 10:38:18.178242 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:18.178204 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8hst4b" event={"ID":"d3677da8-2d2c-4577-beb7-dbc8a652094e","Type":"ContainerStarted","Data":"9bef70d23e2d0e3ae6bce5b345fdcee3d9116c10c13bb64a4a6aa1cf49115e0f"} May 21 10:38:22.081594 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:22.081550 2565 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} May 21 10:38:22.081866 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:22.081630 2565 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} May 21 10:38:22.081866 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:22.081665 2565 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} May 21 10:38:22.193644 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:22.193606 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8hst4b" event={"ID":"d3677da8-2d2c-4577-beb7-dbc8a652094e","Type":"ContainerStarted","Data":"42a02e2b35e0c42e01431d318c8102b8c213d21e28876c72f57621e4c3e0ab2a"} May 21 10:38:22.218471 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:22.218410 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8hst4b" podStartSLOduration=0.979531249 podStartE2EDuration="5.218389428s" podCreationTimestamp="2026-05-21 10:38:17 +0000 UTC" firstStartedPulling="2026-05-21 10:38:17.842440476 +0000 UTC m=+490.755819538" lastFinishedPulling="2026-05-21 10:38:22.081298668 +0000 UTC m=+494.994677717" observedRunningTime="2026-05-21 10:38:22.215711023 +0000 UTC m=+495.129090095" watchObservedRunningTime="2026-05-21 10:38:22.218389428 +0000 UTC m=+495.131768499" May 21 10:38:22.703282 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:22.703241 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8hst4b" May 21 10:38:23.707561 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:23.707531 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8hst4b" May 21 10:38:24.200353 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:24.200326 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8hst4b" May 21 10:38:24.201401 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:24.201385 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8hst4b" May 21 10:38:41.400038 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:41.400000 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9n7kp"] May 21 10:38:41.405694 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:41.405671 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9n7kp" May 21 10:38:41.408101 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:41.408078 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-kxzws\"" May 21 10:38:41.408897 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:41.408879 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 21 10:38:41.408995 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:41.408878 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 21 10:38:41.412688 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:41.412657 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9n7kp"] May 21 10:38:41.491470 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:41.491434 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xbhs\" (UniqueName: \"kubernetes.io/projected/cd5a63f1-0b79-4db3-911f-a8bd30b4bb54-kube-api-access-4xbhs\") pod \"kuadrant-operator-catalog-9n7kp\" (UID: \"cd5a63f1-0b79-4db3-911f-a8bd30b4bb54\") " pod="kuadrant-system/kuadrant-operator-catalog-9n7kp" May 21 10:38:41.592811 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:41.592750 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4xbhs\" (UniqueName: \"kubernetes.io/projected/cd5a63f1-0b79-4db3-911f-a8bd30b4bb54-kube-api-access-4xbhs\") pod \"kuadrant-operator-catalog-9n7kp\" (UID: \"cd5a63f1-0b79-4db3-911f-a8bd30b4bb54\") " pod="kuadrant-system/kuadrant-operator-catalog-9n7kp" May 21 10:38:41.600680 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:41.600654 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xbhs\" (UniqueName: \"kubernetes.io/projected/cd5a63f1-0b79-4db3-911f-a8bd30b4bb54-kube-api-access-4xbhs\") pod \"kuadrant-operator-catalog-9n7kp\" (UID: \"cd5a63f1-0b79-4db3-911f-a8bd30b4bb54\") " pod="kuadrant-system/kuadrant-operator-catalog-9n7kp" May 21 10:38:41.716257 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:41.716168 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9n7kp" May 21 10:38:41.765480 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:41.765451 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9n7kp"] May 21 10:38:41.845142 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:41.845118 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9n7kp"] May 21 10:38:41.847172 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:38:41.847145 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd5a63f1_0b79_4db3_911f_a8bd30b4bb54.slice/crio-f8a84db4943731d67eece5101eaccbe44595336d64508db0ab0f172862f57453 WatchSource:0}: Error finding container f8a84db4943731d67eece5101eaccbe44595336d64508db0ab0f172862f57453: Status 404 returned error can't find the container with id f8a84db4943731d67eece5101eaccbe44595336d64508db0ab0f172862f57453 May 21 10:38:42.262719 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:42.262679 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9n7kp" event={"ID":"cd5a63f1-0b79-4db3-911f-a8bd30b4bb54","Type":"ContainerStarted","Data":"f8a84db4943731d67eece5101eaccbe44595336d64508db0ab0f172862f57453"} May 21 10:38:44.271604 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:44.271518 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9n7kp" event={"ID":"cd5a63f1-0b79-4db3-911f-a8bd30b4bb54","Type":"ContainerStarted","Data":"fac4a63e832dcf8466e5a8a501b36eaa41e5283d0e6a3313dc2c4651bfb1a8a4"} May 21 10:38:44.272055 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:44.271630 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-9n7kp" podUID="cd5a63f1-0b79-4db3-911f-a8bd30b4bb54" containerName="registry-server" containerID="cri-o://fac4a63e832dcf8466e5a8a501b36eaa41e5283d0e6a3313dc2c4651bfb1a8a4" gracePeriod=2 May 21 10:38:44.288633 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:44.288584 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-9n7kp" podStartSLOduration=1.265258019 podStartE2EDuration="3.288570749s" podCreationTimestamp="2026-05-21 10:38:41 +0000 UTC" firstStartedPulling="2026-05-21 10:38:41.84853609 +0000 UTC m=+514.761915138" lastFinishedPulling="2026-05-21 10:38:43.871848818 +0000 UTC m=+516.785227868" observedRunningTime="2026-05-21 10:38:44.286988166 +0000 UTC m=+517.200367229" watchObservedRunningTime="2026-05-21 10:38:44.288570749 +0000 UTC m=+517.201949845" May 21 10:38:44.525724 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:44.525657 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9n7kp" May 21 10:38:44.618055 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:44.618018 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4xbhs\" (UniqueName: \"kubernetes.io/projected/cd5a63f1-0b79-4db3-911f-a8bd30b4bb54-kube-api-access-4xbhs\") pod \"cd5a63f1-0b79-4db3-911f-a8bd30b4bb54\" (UID: \"cd5a63f1-0b79-4db3-911f-a8bd30b4bb54\") " May 21 10:38:44.620186 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:44.620162 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd5a63f1-0b79-4db3-911f-a8bd30b4bb54-kube-api-access-4xbhs" (OuterVolumeSpecName: "kube-api-access-4xbhs") pod "cd5a63f1-0b79-4db3-911f-a8bd30b4bb54" (UID: "cd5a63f1-0b79-4db3-911f-a8bd30b4bb54"). InnerVolumeSpecName "kube-api-access-4xbhs". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 10:38:44.719438 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:44.719407 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4xbhs\" (UniqueName: \"kubernetes.io/projected/cd5a63f1-0b79-4db3-911f-a8bd30b4bb54-kube-api-access-4xbhs\") on node \"ip-10-0-142-214.ec2.internal\" DevicePath \"\"" May 21 10:38:45.275427 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:45.275395 2565 generic.go:358] "Generic (PLEG): container finished" podID="cd5a63f1-0b79-4db3-911f-a8bd30b4bb54" containerID="fac4a63e832dcf8466e5a8a501b36eaa41e5283d0e6a3313dc2c4651bfb1a8a4" exitCode=0 May 21 10:38:45.275814 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:45.275454 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9n7kp" May 21 10:38:45.275814 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:45.275483 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9n7kp" event={"ID":"cd5a63f1-0b79-4db3-911f-a8bd30b4bb54","Type":"ContainerDied","Data":"fac4a63e832dcf8466e5a8a501b36eaa41e5283d0e6a3313dc2c4651bfb1a8a4"} May 21 10:38:45.275814 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:45.275524 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9n7kp" event={"ID":"cd5a63f1-0b79-4db3-911f-a8bd30b4bb54","Type":"ContainerDied","Data":"f8a84db4943731d67eece5101eaccbe44595336d64508db0ab0f172862f57453"} May 21 10:38:45.275814 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:45.275544 2565 scope.go:117] "RemoveContainer" containerID="fac4a63e832dcf8466e5a8a501b36eaa41e5283d0e6a3313dc2c4651bfb1a8a4" May 21 10:38:45.284844 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:45.284828 2565 scope.go:117] "RemoveContainer" containerID="fac4a63e832dcf8466e5a8a501b36eaa41e5283d0e6a3313dc2c4651bfb1a8a4" May 21 10:38:45.285119 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:38:45.285096 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fac4a63e832dcf8466e5a8a501b36eaa41e5283d0e6a3313dc2c4651bfb1a8a4\": container with ID starting with fac4a63e832dcf8466e5a8a501b36eaa41e5283d0e6a3313dc2c4651bfb1a8a4 not found: ID does not exist" containerID="fac4a63e832dcf8466e5a8a501b36eaa41e5283d0e6a3313dc2c4651bfb1a8a4" May 21 10:38:45.285193 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:45.285144 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fac4a63e832dcf8466e5a8a501b36eaa41e5283d0e6a3313dc2c4651bfb1a8a4"} err="failed to get container status \"fac4a63e832dcf8466e5a8a501b36eaa41e5283d0e6a3313dc2c4651bfb1a8a4\": rpc error: code = NotFound desc = could not find container \"fac4a63e832dcf8466e5a8a501b36eaa41e5283d0e6a3313dc2c4651bfb1a8a4\": container with ID starting with fac4a63e832dcf8466e5a8a501b36eaa41e5283d0e6a3313dc2c4651bfb1a8a4 not found: ID does not exist" May 21 10:38:45.297056 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:45.297032 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9n7kp"] May 21 10:38:45.302241 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:45.302219 2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9n7kp"] May 21 10:38:45.636135 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:38:45.636101 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd5a63f1-0b79-4db3-911f-a8bd30b4bb54" path="/var/lib/kubelet/pods/cd5a63f1-0b79-4db3-911f-a8bd30b4bb54/volumes" May 21 10:39:03.794904 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:03.794823 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h5xbw"] May 21 10:39:03.795425 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:03.795256 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd5a63f1-0b79-4db3-911f-a8bd30b4bb54" containerName="registry-server" May 21 10:39:03.795425 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:03.795281 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd5a63f1-0b79-4db3-911f-a8bd30b4bb54" containerName="registry-server" May 21 10:39:03.795425 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:03.795331 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="cd5a63f1-0b79-4db3-911f-a8bd30b4bb54" containerName="registry-server" May 21 10:39:03.798784 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:03.798766 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h5xbw" May 21 10:39:03.801452 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:03.801434 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 21 10:39:03.802161 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:03.802136 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-w62hv\"" May 21 10:39:03.802244 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:03.802139 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 21 10:39:03.808168 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:03.808147 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h5xbw"] May 21 10:39:03.878826 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:03.878784 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fc035aa4-6724-4b90-a9c3-2bf5bb0eab58-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h5xbw\" (UID: \"fc035aa4-6724-4b90-a9c3-2bf5bb0eab58\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h5xbw" May 21 10:39:03.879040 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:03.878846 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvq86\" (UniqueName: \"kubernetes.io/projected/fc035aa4-6724-4b90-a9c3-2bf5bb0eab58-kube-api-access-rvq86\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h5xbw\" (UID: \"fc035aa4-6724-4b90-a9c3-2bf5bb0eab58\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h5xbw" May 21 10:39:03.879040 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:03.878896 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fc035aa4-6724-4b90-a9c3-2bf5bb0eab58-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h5xbw\" (UID: \"fc035aa4-6724-4b90-a9c3-2bf5bb0eab58\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h5xbw" May 21 10:39:03.980029 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:03.979992 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rvq86\" (UniqueName: \"kubernetes.io/projected/fc035aa4-6724-4b90-a9c3-2bf5bb0eab58-kube-api-access-rvq86\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h5xbw\" (UID: \"fc035aa4-6724-4b90-a9c3-2bf5bb0eab58\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h5xbw" May 21 10:39:03.980233 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:03.980049 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fc035aa4-6724-4b90-a9c3-2bf5bb0eab58-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h5xbw\" (UID: \"fc035aa4-6724-4b90-a9c3-2bf5bb0eab58\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h5xbw" May 21 10:39:03.980233 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:03.980115 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fc035aa4-6724-4b90-a9c3-2bf5bb0eab58-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h5xbw\" (UID: \"fc035aa4-6724-4b90-a9c3-2bf5bb0eab58\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h5xbw" May 21 10:39:03.980541 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:03.980517 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fc035aa4-6724-4b90-a9c3-2bf5bb0eab58-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h5xbw\" (UID: \"fc035aa4-6724-4b90-a9c3-2bf5bb0eab58\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h5xbw" May 21 10:39:03.980595 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:03.980528 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fc035aa4-6724-4b90-a9c3-2bf5bb0eab58-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h5xbw\" (UID: \"fc035aa4-6724-4b90-a9c3-2bf5bb0eab58\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h5xbw" May 21 10:39:03.989356 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:03.989330 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvq86\" (UniqueName: \"kubernetes.io/projected/fc035aa4-6724-4b90-a9c3-2bf5bb0eab58-kube-api-access-rvq86\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h5xbw\" (UID: \"fc035aa4-6724-4b90-a9c3-2bf5bb0eab58\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h5xbw" May 21 10:39:04.107861 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:04.107828 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h5xbw" May 21 10:39:04.191990 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:04.191912 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d59rj"] May 21 10:39:04.198589 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:04.198563 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d59rj" May 21 10:39:04.206014 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:04.205980 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d59rj"] May 21 10:39:04.237277 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:04.237253 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h5xbw"] May 21 10:39:04.239770 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:39:04.239738 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc035aa4_6724_4b90_a9c3_2bf5bb0eab58.slice/crio-34e024bf41636e802ed34b997cc569118ab62c2fdf68ccd903b97fe393035b7a WatchSource:0}: Error finding container 34e024bf41636e802ed34b997cc569118ab62c2fdf68ccd903b97fe393035b7a: Status 404 returned error can't find the container with id 34e024bf41636e802ed34b997cc569118ab62c2fdf68ccd903b97fe393035b7a May 21 10:39:04.282434 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:04.282399 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kv2hj\" (UniqueName: \"kubernetes.io/projected/97ddb0d6-6040-43f0-a69c-606c977c478b-kube-api-access-kv2hj\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d59rj\" (UID: \"97ddb0d6-6040-43f0-a69c-606c977c478b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d59rj" May 21 10:39:04.282580 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:04.282445 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/97ddb0d6-6040-43f0-a69c-606c977c478b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d59rj\" (UID: \"97ddb0d6-6040-43f0-a69c-606c977c478b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d59rj" May 21 10:39:04.282580 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:04.282477 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/97ddb0d6-6040-43f0-a69c-606c977c478b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d59rj\" (UID: \"97ddb0d6-6040-43f0-a69c-606c977c478b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d59rj" May 21 10:39:04.341907 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:04.341876 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h5xbw" event={"ID":"fc035aa4-6724-4b90-a9c3-2bf5bb0eab58","Type":"ContainerStarted","Data":"6b9d4724c5fac1c3dea4fe7b6e9fbc477dec5c0129b4d176f56903f21659901b"} May 21 10:39:04.342050 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:04.341909 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h5xbw" event={"ID":"fc035aa4-6724-4b90-a9c3-2bf5bb0eab58","Type":"ContainerStarted","Data":"34e024bf41636e802ed34b997cc569118ab62c2fdf68ccd903b97fe393035b7a"} May 21 10:39:04.382976 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:04.382892 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kv2hj\" (UniqueName: \"kubernetes.io/projected/97ddb0d6-6040-43f0-a69c-606c977c478b-kube-api-access-kv2hj\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d59rj\" (UID: \"97ddb0d6-6040-43f0-a69c-606c977c478b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d59rj" May 21 10:39:04.382976 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:04.382926 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/97ddb0d6-6040-43f0-a69c-606c977c478b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d59rj\" (UID: \"97ddb0d6-6040-43f0-a69c-606c977c478b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d59rj" May 21 10:39:04.383130 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:04.382980 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/97ddb0d6-6040-43f0-a69c-606c977c478b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d59rj\" (UID: \"97ddb0d6-6040-43f0-a69c-606c977c478b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d59rj" May 21 10:39:04.383399 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:04.383378 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/97ddb0d6-6040-43f0-a69c-606c977c478b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d59rj\" (UID: \"97ddb0d6-6040-43f0-a69c-606c977c478b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d59rj" May 21 10:39:04.383442 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:04.383392 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/97ddb0d6-6040-43f0-a69c-606c977c478b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d59rj\" (UID: \"97ddb0d6-6040-43f0-a69c-606c977c478b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d59rj" May 21 10:39:04.395211 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:04.395193 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kv2hj\" (UniqueName: \"kubernetes.io/projected/97ddb0d6-6040-43f0-a69c-606c977c478b-kube-api-access-kv2hj\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d59rj\" (UID: \"97ddb0d6-6040-43f0-a69c-606c977c478b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d59rj" May 21 10:39:04.510311 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:04.510271 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d59rj" May 21 10:39:04.607141 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:04.607097 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598g8rp"] May 21 10:39:04.612783 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:04.612759 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598g8rp" May 21 10:39:04.618261 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:04.618216 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598g8rp"] May 21 10:39:04.641520 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:04.641493 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d59rj"] May 21 10:39:04.643897 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:39:04.643869 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97ddb0d6_6040_43f0_a69c_606c977c478b.slice/crio-0e0f67a56dda9f088c6a6b77e09145dec0726cc12932020a91a4d9c62c81682b WatchSource:0}: Error finding container 0e0f67a56dda9f088c6a6b77e09145dec0726cc12932020a91a4d9c62c81682b: Status 404 returned error can't find the container with id 0e0f67a56dda9f088c6a6b77e09145dec0726cc12932020a91a4d9c62c81682b May 21 10:39:04.686174 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:04.686151 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbp7r\" (UniqueName: \"kubernetes.io/projected/d0be0f23-40f8-443a-93e3-e2949d565db9-kube-api-access-pbp7r\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598g8rp\" (UID: \"d0be0f23-40f8-443a-93e3-e2949d565db9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598g8rp" May 21 10:39:04.686265 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:04.686192 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d0be0f23-40f8-443a-93e3-e2949d565db9-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598g8rp\" (UID: \"d0be0f23-40f8-443a-93e3-e2949d565db9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598g8rp" May 21 10:39:04.686265 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:04.686211 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d0be0f23-40f8-443a-93e3-e2949d565db9-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598g8rp\" (UID: \"d0be0f23-40f8-443a-93e3-e2949d565db9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598g8rp" May 21 10:39:04.787342 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:04.787305 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pbp7r\" (UniqueName: \"kubernetes.io/projected/d0be0f23-40f8-443a-93e3-e2949d565db9-kube-api-access-pbp7r\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598g8rp\" (UID: \"d0be0f23-40f8-443a-93e3-e2949d565db9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598g8rp" May 21 10:39:04.787510 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:04.787361 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d0be0f23-40f8-443a-93e3-e2949d565db9-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598g8rp\" (UID: \"d0be0f23-40f8-443a-93e3-e2949d565db9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598g8rp" May 21 10:39:04.787575 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:04.787530 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d0be0f23-40f8-443a-93e3-e2949d565db9-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598g8rp\" (UID: \"d0be0f23-40f8-443a-93e3-e2949d565db9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598g8rp" May 21 10:39:04.787655 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:04.787638 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d0be0f23-40f8-443a-93e3-e2949d565db9-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598g8rp\" (UID: \"d0be0f23-40f8-443a-93e3-e2949d565db9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598g8rp" May 21 10:39:04.787813 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:04.787794 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d0be0f23-40f8-443a-93e3-e2949d565db9-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598g8rp\" (UID: \"d0be0f23-40f8-443a-93e3-e2949d565db9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598g8rp" May 21 10:39:04.797276 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:04.797255 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbp7r\" (UniqueName: \"kubernetes.io/projected/d0be0f23-40f8-443a-93e3-e2949d565db9-kube-api-access-pbp7r\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598g8rp\" (UID: \"d0be0f23-40f8-443a-93e3-e2949d565db9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598g8rp" May 21 10:39:04.923925 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:04.923849 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598g8rp" May 21 10:39:05.050621 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:05.050597 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598g8rp"] May 21 10:39:05.053451 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:39:05.053422 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0be0f23_40f8_443a_93e3_e2949d565db9.slice/crio-17c6da229aceaadb61afca61dd63417b8b8f581b118408fef7fa4ebd99b5ee33 WatchSource:0}: Error finding container 17c6da229aceaadb61afca61dd63417b8b8f581b118408fef7fa4ebd99b5ee33: Status 404 returned error can't find the container with id 17c6da229aceaadb61afca61dd63417b8b8f581b118408fef7fa4ebd99b5ee33 May 21 10:39:05.347231 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:05.347195 2565 generic.go:358] "Generic (PLEG): container finished" podID="fc035aa4-6724-4b90-a9c3-2bf5bb0eab58" containerID="6b9d4724c5fac1c3dea4fe7b6e9fbc477dec5c0129b4d176f56903f21659901b" exitCode=0 May 21 10:39:05.347417 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:05.347283 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h5xbw" event={"ID":"fc035aa4-6724-4b90-a9c3-2bf5bb0eab58","Type":"ContainerDied","Data":"6b9d4724c5fac1c3dea4fe7b6e9fbc477dec5c0129b4d176f56903f21659901b"} May 21 10:39:05.348626 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:05.348605 2565 generic.go:358] "Generic (PLEG): container finished" podID="97ddb0d6-6040-43f0-a69c-606c977c478b" containerID="a5508b1384856074c9f40e83e9333d919f0e5c6b0bc7f9cde8895bb4db961d19" exitCode=0 May 21 10:39:05.348710 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:05.348689 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d59rj" event={"ID":"97ddb0d6-6040-43f0-a69c-606c977c478b","Type":"ContainerDied","Data":"a5508b1384856074c9f40e83e9333d919f0e5c6b0bc7f9cde8895bb4db961d19"} May 21 10:39:05.348768 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:05.348721 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d59rj" event={"ID":"97ddb0d6-6040-43f0-a69c-606c977c478b","Type":"ContainerStarted","Data":"0e0f67a56dda9f088c6a6b77e09145dec0726cc12932020a91a4d9c62c81682b"} May 21 10:39:05.350236 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:05.350141 2565 generic.go:358] "Generic (PLEG): container finished" podID="d0be0f23-40f8-443a-93e3-e2949d565db9" containerID="0edff6a32411365b35ff49e6c89a9ef286b0ca6fb22b2db08713e1768c4a9094" exitCode=0 May 21 10:39:05.350236 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:05.350199 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598g8rp" event={"ID":"d0be0f23-40f8-443a-93e3-e2949d565db9","Type":"ContainerDied","Data":"0edff6a32411365b35ff49e6c89a9ef286b0ca6fb22b2db08713e1768c4a9094"} May 21 10:39:05.350236 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:05.350220 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598g8rp" event={"ID":"d0be0f23-40f8-443a-93e3-e2949d565db9","Type":"ContainerStarted","Data":"17c6da229aceaadb61afca61dd63417b8b8f581b118408fef7fa4ebd99b5ee33"} May 21 10:39:06.357271 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:06.357241 2565 generic.go:358] "Generic (PLEG): container finished" podID="fc035aa4-6724-4b90-a9c3-2bf5bb0eab58" containerID="186b710441ffb502f89ee5dac232a1fda6daa8f272e93b94d16183c7c6177296" exitCode=0 May 21 10:39:06.357681 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:06.357278 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h5xbw" event={"ID":"fc035aa4-6724-4b90-a9c3-2bf5bb0eab58","Type":"ContainerDied","Data":"186b710441ffb502f89ee5dac232a1fda6daa8f272e93b94d16183c7c6177296"} May 21 10:39:06.359130 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:06.359091 2565 generic.go:358] "Generic (PLEG): container finished" podID="97ddb0d6-6040-43f0-a69c-606c977c478b" containerID="5c7de3a56094fb1d44a93fd2f71e56a36c9069ab944251f4272ddab7d536a64a" exitCode=0 May 21 10:39:06.359243 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:06.359167 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d59rj" event={"ID":"97ddb0d6-6040-43f0-a69c-606c977c478b","Type":"ContainerDied","Data":"5c7de3a56094fb1d44a93fd2f71e56a36c9069ab944251f4272ddab7d536a64a"} May 21 10:39:07.364553 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:07.364521 2565 generic.go:358] "Generic (PLEG): container finished" podID="d0be0f23-40f8-443a-93e3-e2949d565db9" containerID="fb1de53b96b60460e303116bcba4545da24ef4689e1dc38c43fe3b9d37582790" exitCode=0 May 21 10:39:07.365006 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:07.364617 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598g8rp" event={"ID":"d0be0f23-40f8-443a-93e3-e2949d565db9","Type":"ContainerDied","Data":"fb1de53b96b60460e303116bcba4545da24ef4689e1dc38c43fe3b9d37582790"} May 21 10:39:07.366577 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:07.366545 2565 generic.go:358] "Generic (PLEG): container finished" podID="fc035aa4-6724-4b90-a9c3-2bf5bb0eab58" containerID="c6716d82597a6fca45bd1590334f9dc3dc0921e42c3d6f16246b949a7bae9a19" exitCode=0 May 21 10:39:07.366667 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:07.366576 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h5xbw" event={"ID":"fc035aa4-6724-4b90-a9c3-2bf5bb0eab58","Type":"ContainerDied","Data":"c6716d82597a6fca45bd1590334f9dc3dc0921e42c3d6f16246b949a7bae9a19"} May 21 10:39:07.368451 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:07.368428 2565 generic.go:358] "Generic (PLEG): container finished" podID="97ddb0d6-6040-43f0-a69c-606c977c478b" containerID="7179068f35713ec875f158e03756c3b23605fc00cd08f8c1a45ccbe5faba64f2" exitCode=0 May 21 10:39:07.368554 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:07.368482 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d59rj" event={"ID":"97ddb0d6-6040-43f0-a69c-606c977c478b","Type":"ContainerDied","Data":"7179068f35713ec875f158e03756c3b23605fc00cd08f8c1a45ccbe5faba64f2"} May 21 10:39:08.373950 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:08.373904 2565 generic.go:358] "Generic (PLEG): container finished" podID="d0be0f23-40f8-443a-93e3-e2949d565db9" containerID="5fcf2847699c005af59781a47ca028f19190105582de9ff9f8aad1c2025c9bcb" exitCode=0 May 21 10:39:08.374319 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:08.373991 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598g8rp" event={"ID":"d0be0f23-40f8-443a-93e3-e2949d565db9","Type":"ContainerDied","Data":"5fcf2847699c005af59781a47ca028f19190105582de9ff9f8aad1c2025c9bcb"} May 21 10:39:08.510857 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:08.510831 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h5xbw" May 21 10:39:08.540898 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:08.540869 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d59rj" May 21 10:39:08.625550 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:08.625461 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fc035aa4-6724-4b90-a9c3-2bf5bb0eab58-bundle\") pod \"fc035aa4-6724-4b90-a9c3-2bf5bb0eab58\" (UID: \"fc035aa4-6724-4b90-a9c3-2bf5bb0eab58\") " May 21 10:39:08.625550 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:08.625503 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kv2hj\" (UniqueName: \"kubernetes.io/projected/97ddb0d6-6040-43f0-a69c-606c977c478b-kube-api-access-kv2hj\") pod \"97ddb0d6-6040-43f0-a69c-606c977c478b\" (UID: \"97ddb0d6-6040-43f0-a69c-606c977c478b\") " May 21 10:39:08.625550 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:08.625524 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rvq86\" (UniqueName: \"kubernetes.io/projected/fc035aa4-6724-4b90-a9c3-2bf5bb0eab58-kube-api-access-rvq86\") pod \"fc035aa4-6724-4b90-a9c3-2bf5bb0eab58\" (UID: \"fc035aa4-6724-4b90-a9c3-2bf5bb0eab58\") " May 21 10:39:08.625829 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:08.625582 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/97ddb0d6-6040-43f0-a69c-606c977c478b-util\") pod \"97ddb0d6-6040-43f0-a69c-606c977c478b\" (UID: \"97ddb0d6-6040-43f0-a69c-606c977c478b\") " May 21 10:39:08.625829 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:08.625628 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fc035aa4-6724-4b90-a9c3-2bf5bb0eab58-util\") pod \"fc035aa4-6724-4b90-a9c3-2bf5bb0eab58\" (UID: \"fc035aa4-6724-4b90-a9c3-2bf5bb0eab58\") " May 21 10:39:08.625829 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:08.625665 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/97ddb0d6-6040-43f0-a69c-606c977c478b-bundle\") pod \"97ddb0d6-6040-43f0-a69c-606c977c478b\" (UID: \"97ddb0d6-6040-43f0-a69c-606c977c478b\") " May 21 10:39:08.626279 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:08.626227 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc035aa4-6724-4b90-a9c3-2bf5bb0eab58-bundle" (OuterVolumeSpecName: "bundle") pod "fc035aa4-6724-4b90-a9c3-2bf5bb0eab58" (UID: "fc035aa4-6724-4b90-a9c3-2bf5bb0eab58"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 10:39:08.626569 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:08.626540 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97ddb0d6-6040-43f0-a69c-606c977c478b-bundle" (OuterVolumeSpecName: "bundle") pod "97ddb0d6-6040-43f0-a69c-606c977c478b" (UID: "97ddb0d6-6040-43f0-a69c-606c977c478b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 10:39:08.627653 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:08.627632 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97ddb0d6-6040-43f0-a69c-606c977c478b-kube-api-access-kv2hj" (OuterVolumeSpecName: "kube-api-access-kv2hj") pod "97ddb0d6-6040-43f0-a69c-606c977c478b" (UID: "97ddb0d6-6040-43f0-a69c-606c977c478b"). InnerVolumeSpecName "kube-api-access-kv2hj". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 10:39:08.627973 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:08.627928 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc035aa4-6724-4b90-a9c3-2bf5bb0eab58-kube-api-access-rvq86" (OuterVolumeSpecName: "kube-api-access-rvq86") pod "fc035aa4-6724-4b90-a9c3-2bf5bb0eab58" (UID: "fc035aa4-6724-4b90-a9c3-2bf5bb0eab58"). InnerVolumeSpecName "kube-api-access-rvq86". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 10:39:08.632128 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:08.632095 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97ddb0d6-6040-43f0-a69c-606c977c478b-util" (OuterVolumeSpecName: "util") pod "97ddb0d6-6040-43f0-a69c-606c977c478b" (UID: "97ddb0d6-6040-43f0-a69c-606c977c478b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 10:39:08.633351 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:08.633328 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc035aa4-6724-4b90-a9c3-2bf5bb0eab58-util" (OuterVolumeSpecName: "util") pod "fc035aa4-6724-4b90-a9c3-2bf5bb0eab58" (UID: "fc035aa4-6724-4b90-a9c3-2bf5bb0eab58"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 10:39:08.727152 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:08.727112 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fc035aa4-6724-4b90-a9c3-2bf5bb0eab58-bundle\") on node \"ip-10-0-142-214.ec2.internal\" DevicePath \"\"" May 21 10:39:08.727152 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:08.727149 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kv2hj\" (UniqueName: \"kubernetes.io/projected/97ddb0d6-6040-43f0-a69c-606c977c478b-kube-api-access-kv2hj\") on node \"ip-10-0-142-214.ec2.internal\" DevicePath \"\"" May 21 10:39:08.727152 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:08.727161 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rvq86\" (UniqueName: \"kubernetes.io/projected/fc035aa4-6724-4b90-a9c3-2bf5bb0eab58-kube-api-access-rvq86\") on node \"ip-10-0-142-214.ec2.internal\" DevicePath \"\"" May 21 10:39:08.727362 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:08.727171 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/97ddb0d6-6040-43f0-a69c-606c977c478b-util\") on node \"ip-10-0-142-214.ec2.internal\" DevicePath \"\"" May 21 10:39:08.727362 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:08.727180 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fc035aa4-6724-4b90-a9c3-2bf5bb0eab58-util\") on node \"ip-10-0-142-214.ec2.internal\" DevicePath \"\"" May 21 10:39:08.727362 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:08.727188 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/97ddb0d6-6040-43f0-a69c-606c977c478b-bundle\") on node \"ip-10-0-142-214.ec2.internal\" DevicePath \"\"" May 21 10:39:09.379519 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:09.379482 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h5xbw" event={"ID":"fc035aa4-6724-4b90-a9c3-2bf5bb0eab58","Type":"ContainerDied","Data":"34e024bf41636e802ed34b997cc569118ab62c2fdf68ccd903b97fe393035b7a"} May 21 10:39:09.379519 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:09.379520 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="34e024bf41636e802ed34b997cc569118ab62c2fdf68ccd903b97fe393035b7a" May 21 10:39:09.380020 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:09.379521 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h5xbw" May 21 10:39:09.381306 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:09.381287 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d59rj" May 21 10:39:09.381403 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:09.381324 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d59rj" event={"ID":"97ddb0d6-6040-43f0-a69c-606c977c478b","Type":"ContainerDied","Data":"0e0f67a56dda9f088c6a6b77e09145dec0726cc12932020a91a4d9c62c81682b"} May 21 10:39:09.381403 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:09.381349 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0e0f67a56dda9f088c6a6b77e09145dec0726cc12932020a91a4d9c62c81682b" May 21 10:39:09.503014 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:09.502989 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598g8rp" May 21 10:39:09.633447 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:09.633353 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d0be0f23-40f8-443a-93e3-e2949d565db9-util\") pod \"d0be0f23-40f8-443a-93e3-e2949d565db9\" (UID: \"d0be0f23-40f8-443a-93e3-e2949d565db9\") " May 21 10:39:09.633447 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:09.633420 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d0be0f23-40f8-443a-93e3-e2949d565db9-bundle\") pod \"d0be0f23-40f8-443a-93e3-e2949d565db9\" (UID: \"d0be0f23-40f8-443a-93e3-e2949d565db9\") " May 21 10:39:09.633652 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:09.633452 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pbp7r\" (UniqueName: \"kubernetes.io/projected/d0be0f23-40f8-443a-93e3-e2949d565db9-kube-api-access-pbp7r\") pod \"d0be0f23-40f8-443a-93e3-e2949d565db9\" (UID: \"d0be0f23-40f8-443a-93e3-e2949d565db9\") " May 21 10:39:09.633895 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:09.633870 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0be0f23-40f8-443a-93e3-e2949d565db9-bundle" (OuterVolumeSpecName: "bundle") pod "d0be0f23-40f8-443a-93e3-e2949d565db9" (UID: "d0be0f23-40f8-443a-93e3-e2949d565db9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 10:39:09.635580 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:09.635557 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0be0f23-40f8-443a-93e3-e2949d565db9-kube-api-access-pbp7r" (OuterVolumeSpecName: "kube-api-access-pbp7r") pod "d0be0f23-40f8-443a-93e3-e2949d565db9" (UID: "d0be0f23-40f8-443a-93e3-e2949d565db9"). InnerVolumeSpecName "kube-api-access-pbp7r". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 10:39:09.639343 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:09.639322 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0be0f23-40f8-443a-93e3-e2949d565db9-util" (OuterVolumeSpecName: "util") pod "d0be0f23-40f8-443a-93e3-e2949d565db9" (UID: "d0be0f23-40f8-443a-93e3-e2949d565db9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 10:39:09.734515 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:09.734484 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d0be0f23-40f8-443a-93e3-e2949d565db9-util\") on node \"ip-10-0-142-214.ec2.internal\" DevicePath \"\"" May 21 10:39:09.734515 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:09.734511 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d0be0f23-40f8-443a-93e3-e2949d565db9-bundle\") on node \"ip-10-0-142-214.ec2.internal\" DevicePath \"\"" May 21 10:39:09.734665 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:09.734522 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pbp7r\" (UniqueName: \"kubernetes.io/projected/d0be0f23-40f8-443a-93e3-e2949d565db9-kube-api-access-pbp7r\") on node \"ip-10-0-142-214.ec2.internal\" DevicePath \"\"" May 21 10:39:10.386681 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:10.386653 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598g8rp" May 21 10:39:10.387066 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:10.386651 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598g8rp" event={"ID":"d0be0f23-40f8-443a-93e3-e2949d565db9","Type":"ContainerDied","Data":"17c6da229aceaadb61afca61dd63417b8b8f581b118408fef7fa4ebd99b5ee33"} May 21 10:39:10.387066 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:10.386756 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="17c6da229aceaadb61afca61dd63417b8b8f581b118408fef7fa4ebd99b5ee33" May 21 10:39:19.687925 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:19.687892 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-d5wlm"] May 21 10:39:19.688381 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:19.688225 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc035aa4-6724-4b90-a9c3-2bf5bb0eab58" containerName="extract" May 21 10:39:19.688381 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:19.688236 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc035aa4-6724-4b90-a9c3-2bf5bb0eab58" containerName="extract" May 21 10:39:19.688381 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:19.688250 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc035aa4-6724-4b90-a9c3-2bf5bb0eab58" containerName="util" May 21 10:39:19.688381 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:19.688256 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc035aa4-6724-4b90-a9c3-2bf5bb0eab58" containerName="util" May 21 10:39:19.688381 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:19.688263 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97ddb0d6-6040-43f0-a69c-606c977c478b" containerName="pull" May 21 10:39:19.688381 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:19.688268 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="97ddb0d6-6040-43f0-a69c-606c977c478b" containerName="pull" May 21 10:39:19.688381 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:19.688273 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0be0f23-40f8-443a-93e3-e2949d565db9" containerName="extract" May 21 10:39:19.688381 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:19.688279 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0be0f23-40f8-443a-93e3-e2949d565db9" containerName="extract" May 21 10:39:19.688381 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:19.688286 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97ddb0d6-6040-43f0-a69c-606c977c478b" containerName="util" May 21 10:39:19.688381 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:19.688291 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="97ddb0d6-6040-43f0-a69c-606c977c478b" containerName="util" May 21 10:39:19.688381 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:19.688298 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0be0f23-40f8-443a-93e3-e2949d565db9" containerName="util" May 21 10:39:19.688381 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:19.688304 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0be0f23-40f8-443a-93e3-e2949d565db9" containerName="util" May 21 10:39:19.688381 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:19.688311 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97ddb0d6-6040-43f0-a69c-606c977c478b" containerName="extract" May 21 10:39:19.688381 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:19.688315 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="97ddb0d6-6040-43f0-a69c-606c977c478b" containerName="extract" May 21 10:39:19.688381 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:19.688322 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc035aa4-6724-4b90-a9c3-2bf5bb0eab58" containerName="pull" May 21 10:39:19.688381 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:19.688327 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc035aa4-6724-4b90-a9c3-2bf5bb0eab58" containerName="pull" May 21 10:39:19.688381 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:19.688333 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0be0f23-40f8-443a-93e3-e2949d565db9" containerName="pull" May 21 10:39:19.688381 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:19.688338 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0be0f23-40f8-443a-93e3-e2949d565db9" containerName="pull" May 21 10:39:19.688381 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:19.688386 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="fc035aa4-6724-4b90-a9c3-2bf5bb0eab58" containerName="extract" May 21 10:39:19.688928 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:19.688395 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="d0be0f23-40f8-443a-93e3-e2949d565db9" containerName="extract" May 21 10:39:19.688928 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:19.688401 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="97ddb0d6-6040-43f0-a69c-606c977c478b" containerName="extract" May 21 10:39:19.694632 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:19.694607 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-d5wlm" May 21 10:39:19.697093 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:19.697073 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 21 10:39:19.697219 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:19.697110 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 21 10:39:19.697662 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:19.697646 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" May 21 10:39:19.698459 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:19.698443 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-7kmvx\"" May 21 10:39:19.705242 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:19.705220 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-d5wlm"] May 21 10:39:19.821349 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:19.821315 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncx7r\" (UniqueName: \"kubernetes.io/projected/321ad3f6-0db3-4369-8b84-2a20edc155e6-kube-api-access-ncx7r\") pod \"dns-operator-controller-manager-648d5c98bc-d5wlm\" (UID: \"321ad3f6-0db3-4369-8b84-2a20edc155e6\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-d5wlm" May 21 10:39:19.922326 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:19.922298 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ncx7r\" (UniqueName: \"kubernetes.io/projected/321ad3f6-0db3-4369-8b84-2a20edc155e6-kube-api-access-ncx7r\") pod \"dns-operator-controller-manager-648d5c98bc-d5wlm\" (UID: \"321ad3f6-0db3-4369-8b84-2a20edc155e6\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-d5wlm" May 21 10:39:19.933815 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:19.933787 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncx7r\" (UniqueName: \"kubernetes.io/projected/321ad3f6-0db3-4369-8b84-2a20edc155e6-kube-api-access-ncx7r\") pod \"dns-operator-controller-manager-648d5c98bc-d5wlm\" (UID: \"321ad3f6-0db3-4369-8b84-2a20edc155e6\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-d5wlm" May 21 10:39:20.005413 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:20.005346 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-d5wlm" May 21 10:39:20.144555 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:20.144527 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-d5wlm"] May 21 10:39:20.146858 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:39:20.146828 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod321ad3f6_0db3_4369_8b84_2a20edc155e6.slice/crio-9863b19ecc663e16c8d79588c50d57729b1d1cc10160fb7db5ddf3b8162d8eae WatchSource:0}: Error finding container 9863b19ecc663e16c8d79588c50d57729b1d1cc10160fb7db5ddf3b8162d8eae: Status 404 returned error can't find the container with id 9863b19ecc663e16c8d79588c50d57729b1d1cc10160fb7db5ddf3b8162d8eae May 21 10:39:20.425740 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:20.425699 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-d5wlm" event={"ID":"321ad3f6-0db3-4369-8b84-2a20edc155e6","Type":"ContainerStarted","Data":"9863b19ecc663e16c8d79588c50d57729b1d1cc10160fb7db5ddf3b8162d8eae"} May 21 10:39:22.434792 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:22.434692 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-d5wlm" event={"ID":"321ad3f6-0db3-4369-8b84-2a20edc155e6","Type":"ContainerStarted","Data":"dc4b29bc8f442fafff9cff32f521e992dc890323ce36e364b3646c3dd6668199"} May 21 10:39:22.435241 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:22.434862 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-d5wlm" May 21 10:39:22.454720 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:22.454672 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-d5wlm" podStartSLOduration=1.437803644 podStartE2EDuration="3.454633777s" podCreationTimestamp="2026-05-21 10:39:19 +0000 UTC" firstStartedPulling="2026-05-21 10:39:20.148847264 +0000 UTC m=+553.062226326" lastFinishedPulling="2026-05-21 10:39:22.165677398 +0000 UTC m=+555.079056459" observedRunningTime="2026-05-21 10:39:22.45282209 +0000 UTC m=+555.366201159" watchObservedRunningTime="2026-05-21 10:39:22.454633777 +0000 UTC m=+555.368012846" May 21 10:39:28.125259 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:28.125225 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-ptpt6"] May 21 10:39:28.130966 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:28.130349 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-ptpt6" May 21 10:39:28.135373 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:28.135348 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-2dvrj\"" May 21 10:39:28.162554 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:28.162530 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-ptpt6"] May 21 10:39:28.183774 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:28.183751 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtz7n\" (UniqueName: \"kubernetes.io/projected/13568c0e-a69d-4284-b64f-c2be13532ee6-kube-api-access-gtz7n\") pod \"limitador-operator-controller-manager-85c4996f8c-ptpt6\" (UID: \"13568c0e-a69d-4284-b64f-c2be13532ee6\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-ptpt6" May 21 10:39:28.284209 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:28.284180 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gtz7n\" (UniqueName: \"kubernetes.io/projected/13568c0e-a69d-4284-b64f-c2be13532ee6-kube-api-access-gtz7n\") pod \"limitador-operator-controller-manager-85c4996f8c-ptpt6\" (UID: \"13568c0e-a69d-4284-b64f-c2be13532ee6\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-ptpt6" May 21 10:39:28.309849 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:28.309816 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtz7n\" (UniqueName: \"kubernetes.io/projected/13568c0e-a69d-4284-b64f-c2be13532ee6-kube-api-access-gtz7n\") pod \"limitador-operator-controller-manager-85c4996f8c-ptpt6\" (UID: \"13568c0e-a69d-4284-b64f-c2be13532ee6\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-ptpt6" May 21 10:39:28.441167 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:28.441096 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-ptpt6" May 21 10:39:28.631202 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:28.631164 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-ptpt6"] May 21 10:39:28.634753 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:39:28.634720 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13568c0e_a69d_4284_b64f_c2be13532ee6.slice/crio-9ee4e9a9fc5e5c8d0c7b6047c9a82af726071202d55d45c030d63256ff3ccdcc WatchSource:0}: Error finding container 9ee4e9a9fc5e5c8d0c7b6047c9a82af726071202d55d45c030d63256ff3ccdcc: Status 404 returned error can't find the container with id 9ee4e9a9fc5e5c8d0c7b6047c9a82af726071202d55d45c030d63256ff3ccdcc May 21 10:39:29.461386 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:29.461344 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-ptpt6" event={"ID":"13568c0e-a69d-4284-b64f-c2be13532ee6","Type":"ContainerStarted","Data":"9ee4e9a9fc5e5c8d0c7b6047c9a82af726071202d55d45c030d63256ff3ccdcc"} May 21 10:39:31.470415 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:31.470373 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-ptpt6" event={"ID":"13568c0e-a69d-4284-b64f-c2be13532ee6","Type":"ContainerStarted","Data":"7d66edf538e1c5e6c793fa9f3e4c8809d0f09366621134bc438016fa317bd509"} May 21 10:39:31.470885 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:31.470519 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-ptpt6" May 21 10:39:31.497178 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:31.497127 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-ptpt6" podStartSLOduration=1.365521137 podStartE2EDuration="3.497113143s" podCreationTimestamp="2026-05-21 10:39:28 +0000 UTC" firstStartedPulling="2026-05-21 10:39:28.637524332 +0000 UTC m=+561.550903382" lastFinishedPulling="2026-05-21 10:39:30.769116336 +0000 UTC m=+563.682495388" observedRunningTime="2026-05-21 10:39:31.494838479 +0000 UTC m=+564.408217550" watchObservedRunningTime="2026-05-21 10:39:31.497113143 +0000 UTC m=+564.410492212" May 21 10:39:33.085062 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:33.082616 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-rwbc6"] May 21 10:39:33.087376 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:33.087347 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-rwbc6" May 21 10:39:33.089709 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:33.089681 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" May 21 10:39:33.089852 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:33.089763 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-w62hv\"" May 21 10:39:33.090117 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:33.090100 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" May 21 10:39:33.091122 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:33.091105 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-rwbc6"] May 21 10:39:33.123905 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:33.123878 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/63fa1aae-ab78-4484-9e7a-144ac0e1933d-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-rwbc6\" (UID: \"63fa1aae-ab78-4484-9e7a-144ac0e1933d\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-rwbc6" May 21 10:39:33.124044 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:33.123975 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfqgv\" (UniqueName: \"kubernetes.io/projected/63fa1aae-ab78-4484-9e7a-144ac0e1933d-kube-api-access-wfqgv\") pod \"kuadrant-console-plugin-6cb54b5c86-rwbc6\" (UID: \"63fa1aae-ab78-4484-9e7a-144ac0e1933d\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-rwbc6" May 21 10:39:33.124044 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:33.124012 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/63fa1aae-ab78-4484-9e7a-144ac0e1933d-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-rwbc6\" (UID: \"63fa1aae-ab78-4484-9e7a-144ac0e1933d\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-rwbc6" May 21 10:39:33.225402 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:33.225371 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wfqgv\" (UniqueName: \"kubernetes.io/projected/63fa1aae-ab78-4484-9e7a-144ac0e1933d-kube-api-access-wfqgv\") pod \"kuadrant-console-plugin-6cb54b5c86-rwbc6\" (UID: \"63fa1aae-ab78-4484-9e7a-144ac0e1933d\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-rwbc6" May 21 10:39:33.225402 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:33.225405 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/63fa1aae-ab78-4484-9e7a-144ac0e1933d-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-rwbc6\" (UID: \"63fa1aae-ab78-4484-9e7a-144ac0e1933d\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-rwbc6" May 21 10:39:33.225588 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:33.225476 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/63fa1aae-ab78-4484-9e7a-144ac0e1933d-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-rwbc6\" (UID: \"63fa1aae-ab78-4484-9e7a-144ac0e1933d\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-rwbc6" May 21 10:39:33.226066 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:33.226047 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/63fa1aae-ab78-4484-9e7a-144ac0e1933d-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-rwbc6\" (UID: \"63fa1aae-ab78-4484-9e7a-144ac0e1933d\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-rwbc6" May 21 10:39:33.227957 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:33.227927 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/63fa1aae-ab78-4484-9e7a-144ac0e1933d-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-rwbc6\" (UID: \"63fa1aae-ab78-4484-9e7a-144ac0e1933d\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-rwbc6" May 21 10:39:33.237840 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:33.237820 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfqgv\" (UniqueName: \"kubernetes.io/projected/63fa1aae-ab78-4484-9e7a-144ac0e1933d-kube-api-access-wfqgv\") pod \"kuadrant-console-plugin-6cb54b5c86-rwbc6\" (UID: \"63fa1aae-ab78-4484-9e7a-144ac0e1933d\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-rwbc6" May 21 10:39:33.398192 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:33.398112 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-rwbc6" May 21 10:39:33.440825 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:33.440791 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-d5wlm" May 21 10:39:33.542489 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:33.542464 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-rwbc6"] May 21 10:39:33.544600 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:39:33.544572 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod63fa1aae_ab78_4484_9e7a_144ac0e1933d.slice/crio-1fa95b065034709d47a53198082b1f7632aa87afbf24b2ac914804ae5347af98 WatchSource:0}: Error finding container 1fa95b065034709d47a53198082b1f7632aa87afbf24b2ac914804ae5347af98: Status 404 returned error can't find the container with id 1fa95b065034709d47a53198082b1f7632aa87afbf24b2ac914804ae5347af98 May 21 10:39:34.483045 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:34.483010 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-rwbc6" event={"ID":"63fa1aae-ab78-4484-9e7a-144ac0e1933d","Type":"ContainerStarted","Data":"1fa95b065034709d47a53198082b1f7632aa87afbf24b2ac914804ae5347af98"} May 21 10:39:42.476803 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:42.476767 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-ptpt6" May 21 10:39:43.438700 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:43.438310 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-ptpt6"] May 21 10:39:43.438700 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:43.438581 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-ptpt6" podUID="13568c0e-a69d-4284-b64f-c2be13532ee6" containerName="manager" containerID="cri-o://7d66edf538e1c5e6c793fa9f3e4c8809d0f09366621134bc438016fa317bd509" gracePeriod=2 May 21 10:39:43.450341 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:43.450286 2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-ptpt6"] May 21 10:39:43.466217 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:43.466189 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pg8hk"] May 21 10:39:43.466722 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:43.466706 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13568c0e-a69d-4284-b64f-c2be13532ee6" containerName="manager" May 21 10:39:43.466797 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:43.466725 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="13568c0e-a69d-4284-b64f-c2be13532ee6" containerName="manager" May 21 10:39:43.466833 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:43.466802 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="13568c0e-a69d-4284-b64f-c2be13532ee6" containerName="manager" May 21 10:39:43.470216 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:43.470192 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pg8hk" May 21 10:39:43.473604 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:43.473543 2565 status_manager.go:895] "Failed to get status for pod" podUID="13568c0e-a69d-4284-b64f-c2be13532ee6" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-ptpt6" err="pods \"limitador-operator-controller-manager-85c4996f8c-ptpt6\" is forbidden: User \"system:node:ip-10-0-142-214.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-214.ec2.internal' and this object" May 21 10:39:43.494387 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:43.494340 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pg8hk"] May 21 10:39:43.529835 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:43.529799 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cw7j\" (UniqueName: \"kubernetes.io/projected/5a3ac120-4735-48d2-9c93-b4d746ea5148-kube-api-access-9cw7j\") pod \"limitador-operator-controller-manager-85c4996f8c-pg8hk\" (UID: \"5a3ac120-4735-48d2-9c93-b4d746ea5148\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pg8hk" May 21 10:39:43.630777 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:43.630729 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9cw7j\" (UniqueName: \"kubernetes.io/projected/5a3ac120-4735-48d2-9c93-b4d746ea5148-kube-api-access-9cw7j\") pod \"limitador-operator-controller-manager-85c4996f8c-pg8hk\" (UID: \"5a3ac120-4735-48d2-9c93-b4d746ea5148\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pg8hk" May 21 10:39:43.643002 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:43.642965 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cw7j\" (UniqueName: \"kubernetes.io/projected/5a3ac120-4735-48d2-9c93-b4d746ea5148-kube-api-access-9cw7j\") pod \"limitador-operator-controller-manager-85c4996f8c-pg8hk\" (UID: \"5a3ac120-4735-48d2-9c93-b4d746ea5148\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pg8hk" May 21 10:39:43.807319 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:43.807237 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pg8hk" May 21 10:39:56.339177 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:56.339156 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-ptpt6" May 21 10:39:56.346100 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:56.346070 2565 status_manager.go:895] "Failed to get status for pod" podUID="13568c0e-a69d-4284-b64f-c2be13532ee6" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-ptpt6" err="pods \"limitador-operator-controller-manager-85c4996f8c-ptpt6\" is forbidden: User \"system:node:ip-10-0-142-214.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-214.ec2.internal' and this object" May 21 10:39:56.351484 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:56.351462 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pg8hk"] May 21 10:39:56.352928 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:39:56.352903 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a3ac120_4735_48d2_9c93_b4d746ea5148.slice/crio-282d248b47f2ec9df0c88e00a0ae8b442c6a0ab99d15871900731a1fecd323bf WatchSource:0}: Error finding container 282d248b47f2ec9df0c88e00a0ae8b442c6a0ab99d15871900731a1fecd323bf: Status 404 returned error can't find the container with id 282d248b47f2ec9df0c88e00a0ae8b442c6a0ab99d15871900731a1fecd323bf May 21 10:39:56.454063 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:56.454011 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gtz7n\" (UniqueName: \"kubernetes.io/projected/13568c0e-a69d-4284-b64f-c2be13532ee6-kube-api-access-gtz7n\") pod \"13568c0e-a69d-4284-b64f-c2be13532ee6\" (UID: \"13568c0e-a69d-4284-b64f-c2be13532ee6\") " May 21 10:39:56.455820 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:56.455794 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13568c0e-a69d-4284-b64f-c2be13532ee6-kube-api-access-gtz7n" (OuterVolumeSpecName: "kube-api-access-gtz7n") pod "13568c0e-a69d-4284-b64f-c2be13532ee6" (UID: "13568c0e-a69d-4284-b64f-c2be13532ee6"). InnerVolumeSpecName "kube-api-access-gtz7n". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 10:39:56.555077 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:56.555048 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gtz7n\" (UniqueName: \"kubernetes.io/projected/13568c0e-a69d-4284-b64f-c2be13532ee6-kube-api-access-gtz7n\") on node \"ip-10-0-142-214.ec2.internal\" DevicePath \"\"" May 21 10:39:56.569596 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:56.569566 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pg8hk" event={"ID":"5a3ac120-4735-48d2-9c93-b4d746ea5148","Type":"ContainerStarted","Data":"7204a088341ceea00cf4f7404b62aea72ec54472018bb3767f68c1c2e3a917d4"} May 21 10:39:56.569751 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:56.569602 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pg8hk" event={"ID":"5a3ac120-4735-48d2-9c93-b4d746ea5148","Type":"ContainerStarted","Data":"282d248b47f2ec9df0c88e00a0ae8b442c6a0ab99d15871900731a1fecd323bf"} May 21 10:39:56.569751 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:56.569713 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pg8hk" May 21 10:39:56.570677 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:56.570656 2565 generic.go:358] "Generic (PLEG): container finished" podID="13568c0e-a69d-4284-b64f-c2be13532ee6" containerID="7d66edf538e1c5e6c793fa9f3e4c8809d0f09366621134bc438016fa317bd509" exitCode=0 May 21 10:39:56.570773 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:56.570692 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-ptpt6" May 21 10:39:56.570773 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:56.570749 2565 scope.go:117] "RemoveContainer" containerID="7d66edf538e1c5e6c793fa9f3e4c8809d0f09366621134bc438016fa317bd509" May 21 10:39:56.571825 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:56.571796 2565 status_manager.go:895] "Failed to get status for pod" podUID="13568c0e-a69d-4284-b64f-c2be13532ee6" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-ptpt6" err="pods \"limitador-operator-controller-manager-85c4996f8c-ptpt6\" is forbidden: User \"system:node:ip-10-0-142-214.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-214.ec2.internal' and this object" May 21 10:39:56.572397 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:56.572370 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-rwbc6" event={"ID":"63fa1aae-ab78-4484-9e7a-144ac0e1933d","Type":"ContainerStarted","Data":"29512fbf91dc7b55d902dd44168b1b268b4f32f202b69498f6473481e4b34eb3"} May 21 10:39:56.579090 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:56.579067 2565 scope.go:117] "RemoveContainer" containerID="7d66edf538e1c5e6c793fa9f3e4c8809d0f09366621134bc438016fa317bd509" May 21 10:39:56.579338 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:39:56.579319 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d66edf538e1c5e6c793fa9f3e4c8809d0f09366621134bc438016fa317bd509\": container with ID starting with 7d66edf538e1c5e6c793fa9f3e4c8809d0f09366621134bc438016fa317bd509 not found: ID does not exist" containerID="7d66edf538e1c5e6c793fa9f3e4c8809d0f09366621134bc438016fa317bd509" May 21 10:39:56.579387 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:56.579345 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d66edf538e1c5e6c793fa9f3e4c8809d0f09366621134bc438016fa317bd509"} err="failed to get container status \"7d66edf538e1c5e6c793fa9f3e4c8809d0f09366621134bc438016fa317bd509\": rpc error: code = NotFound desc = could not find container \"7d66edf538e1c5e6c793fa9f3e4c8809d0f09366621134bc438016fa317bd509\": container with ID starting with 7d66edf538e1c5e6c793fa9f3e4c8809d0f09366621134bc438016fa317bd509 not found: ID does not exist" May 21 10:39:56.592414 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:56.592389 2565 status_manager.go:895] "Failed to get status for pod" podUID="13568c0e-a69d-4284-b64f-c2be13532ee6" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-ptpt6" err="pods \"limitador-operator-controller-manager-85c4996f8c-ptpt6\" is forbidden: User \"system:node:ip-10-0-142-214.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-214.ec2.internal' and this object" May 21 10:39:56.593049 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:56.593016 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pg8hk" podStartSLOduration=13.593004557 podStartE2EDuration="13.593004557s" podCreationTimestamp="2026-05-21 10:39:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 10:39:56.590477556 +0000 UTC m=+589.503856650" watchObservedRunningTime="2026-05-21 10:39:56.593004557 +0000 UTC m=+589.506383627" May 21 10:39:56.616382 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:56.616343 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-rwbc6" podStartSLOduration=0.870587413 podStartE2EDuration="23.616331423s" podCreationTimestamp="2026-05-21 10:39:33 +0000 UTC" firstStartedPulling="2026-05-21 10:39:33.54637882 +0000 UTC m=+566.459757869" lastFinishedPulling="2026-05-21 10:39:56.29212283 +0000 UTC m=+589.205501879" observedRunningTime="2026-05-21 10:39:56.614798903 +0000 UTC m=+589.528177975" watchObservedRunningTime="2026-05-21 10:39:56.616331423 +0000 UTC m=+589.529710497" May 21 10:39:57.636295 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:57.636264 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13568c0e-a69d-4284-b64f-c2be13532ee6" path="/var/lib/kubelet/pods/13568c0e-a69d-4284-b64f-c2be13532ee6/volumes" May 21 10:39:57.636649 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:57.636303 2565 status_manager.go:895] "Failed to get status for pod" podUID="13568c0e-a69d-4284-b64f-c2be13532ee6" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-ptpt6" err="pods \"limitador-operator-controller-manager-85c4996f8c-ptpt6\" is forbidden: User \"system:node:ip-10-0-142-214.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-214.ec2.internal' and this object" May 21 10:39:57.896763 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:57.896693 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f4949c944-j6vbh"] May 21 10:39:57.901717 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:57.901700 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f4949c944-j6vbh" May 21 10:39:57.925263 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:57.925241 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f4949c944-j6vbh"] May 21 10:39:58.069093 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:58.069065 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/32bfa319-a2ea-470a-8637-4a2230a772ea-oauth-serving-cert\") pod \"console-5f4949c944-j6vbh\" (UID: \"32bfa319-a2ea-470a-8637-4a2230a772ea\") " pod="openshift-console/console-5f4949c944-j6vbh" May 21 10:39:58.069254 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:58.069145 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32bfa319-a2ea-470a-8637-4a2230a772ea-trusted-ca-bundle\") pod \"console-5f4949c944-j6vbh\" (UID: \"32bfa319-a2ea-470a-8637-4a2230a772ea\") " pod="openshift-console/console-5f4949c944-j6vbh" May 21 10:39:58.069254 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:58.069168 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/32bfa319-a2ea-470a-8637-4a2230a772ea-console-config\") pod \"console-5f4949c944-j6vbh\" (UID: \"32bfa319-a2ea-470a-8637-4a2230a772ea\") " pod="openshift-console/console-5f4949c944-j6vbh" May 21 10:39:58.069254 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:58.069182 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/32bfa319-a2ea-470a-8637-4a2230a772ea-service-ca\") pod \"console-5f4949c944-j6vbh\" (UID: \"32bfa319-a2ea-470a-8637-4a2230a772ea\") " pod="openshift-console/console-5f4949c944-j6vbh" May 21 10:39:58.069254 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:58.069223 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/32bfa319-a2ea-470a-8637-4a2230a772ea-console-serving-cert\") pod \"console-5f4949c944-j6vbh\" (UID: \"32bfa319-a2ea-470a-8637-4a2230a772ea\") " pod="openshift-console/console-5f4949c944-j6vbh" May 21 10:39:58.069254 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:58.069253 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/32bfa319-a2ea-470a-8637-4a2230a772ea-console-oauth-config\") pod \"console-5f4949c944-j6vbh\" (UID: \"32bfa319-a2ea-470a-8637-4a2230a772ea\") " pod="openshift-console/console-5f4949c944-j6vbh" May 21 10:39:58.069435 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:58.069269 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55dvv\" (UniqueName: \"kubernetes.io/projected/32bfa319-a2ea-470a-8637-4a2230a772ea-kube-api-access-55dvv\") pod \"console-5f4949c944-j6vbh\" (UID: \"32bfa319-a2ea-470a-8637-4a2230a772ea\") " pod="openshift-console/console-5f4949c944-j6vbh" May 21 10:39:58.170261 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:58.170194 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32bfa319-a2ea-470a-8637-4a2230a772ea-trusted-ca-bundle\") pod \"console-5f4949c944-j6vbh\" (UID: \"32bfa319-a2ea-470a-8637-4a2230a772ea\") " pod="openshift-console/console-5f4949c944-j6vbh" May 21 10:39:58.170261 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:58.170228 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/32bfa319-a2ea-470a-8637-4a2230a772ea-console-config\") pod \"console-5f4949c944-j6vbh\" (UID: \"32bfa319-a2ea-470a-8637-4a2230a772ea\") " pod="openshift-console/console-5f4949c944-j6vbh" May 21 10:39:58.170261 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:58.170244 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/32bfa319-a2ea-470a-8637-4a2230a772ea-service-ca\") pod \"console-5f4949c944-j6vbh\" (UID: \"32bfa319-a2ea-470a-8637-4a2230a772ea\") " pod="openshift-console/console-5f4949c944-j6vbh" May 21 10:39:58.170499 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:58.170267 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/32bfa319-a2ea-470a-8637-4a2230a772ea-console-serving-cert\") pod \"console-5f4949c944-j6vbh\" (UID: \"32bfa319-a2ea-470a-8637-4a2230a772ea\") " pod="openshift-console/console-5f4949c944-j6vbh" May 21 10:39:58.170499 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:58.170292 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/32bfa319-a2ea-470a-8637-4a2230a772ea-console-oauth-config\") pod \"console-5f4949c944-j6vbh\" (UID: \"32bfa319-a2ea-470a-8637-4a2230a772ea\") " pod="openshift-console/console-5f4949c944-j6vbh" May 21 10:39:58.170499 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:58.170322 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-55dvv\" (UniqueName: \"kubernetes.io/projected/32bfa319-a2ea-470a-8637-4a2230a772ea-kube-api-access-55dvv\") pod \"console-5f4949c944-j6vbh\" (UID: \"32bfa319-a2ea-470a-8637-4a2230a772ea\") " pod="openshift-console/console-5f4949c944-j6vbh" May 21 10:39:58.170499 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:58.170366 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/32bfa319-a2ea-470a-8637-4a2230a772ea-oauth-serving-cert\") pod \"console-5f4949c944-j6vbh\" (UID: \"32bfa319-a2ea-470a-8637-4a2230a772ea\") " pod="openshift-console/console-5f4949c944-j6vbh" May 21 10:39:58.171043 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:58.171015 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/32bfa319-a2ea-470a-8637-4a2230a772ea-service-ca\") pod \"console-5f4949c944-j6vbh\" (UID: \"32bfa319-a2ea-470a-8637-4a2230a772ea\") " pod="openshift-console/console-5f4949c944-j6vbh" May 21 10:39:58.171156 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:58.171108 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/32bfa319-a2ea-470a-8637-4a2230a772ea-console-config\") pod \"console-5f4949c944-j6vbh\" (UID: \"32bfa319-a2ea-470a-8637-4a2230a772ea\") " pod="openshift-console/console-5f4949c944-j6vbh" May 21 10:39:58.171156 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:58.171108 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/32bfa319-a2ea-470a-8637-4a2230a772ea-oauth-serving-cert\") pod \"console-5f4949c944-j6vbh\" (UID: \"32bfa319-a2ea-470a-8637-4a2230a772ea\") " pod="openshift-console/console-5f4949c944-j6vbh" May 21 10:39:58.171463 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:58.171436 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32bfa319-a2ea-470a-8637-4a2230a772ea-trusted-ca-bundle\") pod \"console-5f4949c944-j6vbh\" (UID: \"32bfa319-a2ea-470a-8637-4a2230a772ea\") " pod="openshift-console/console-5f4949c944-j6vbh" May 21 10:39:58.172799 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:58.172778 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/32bfa319-a2ea-470a-8637-4a2230a772ea-console-oauth-config\") pod \"console-5f4949c944-j6vbh\" (UID: \"32bfa319-a2ea-470a-8637-4a2230a772ea\") " pod="openshift-console/console-5f4949c944-j6vbh" May 21 10:39:58.172922 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:58.172905 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/32bfa319-a2ea-470a-8637-4a2230a772ea-console-serving-cert\") pod \"console-5f4949c944-j6vbh\" (UID: \"32bfa319-a2ea-470a-8637-4a2230a772ea\") " pod="openshift-console/console-5f4949c944-j6vbh" May 21 10:39:58.183659 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:58.183637 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55dvv\" (UniqueName: \"kubernetes.io/projected/32bfa319-a2ea-470a-8637-4a2230a772ea-kube-api-access-55dvv\") pod \"console-5f4949c944-j6vbh\" (UID: \"32bfa319-a2ea-470a-8637-4a2230a772ea\") " pod="openshift-console/console-5f4949c944-j6vbh" May 21 10:39:58.211204 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:58.211174 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f4949c944-j6vbh" May 21 10:39:58.365228 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:58.365200 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f4949c944-j6vbh"] May 21 10:39:58.368358 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:39:58.368328 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32bfa319_a2ea_470a_8637_4a2230a772ea.slice/crio-427dcf4348bc1088dcbd8e0c1bd6aa7ebd00d4e293ba71222dcda7da4a0b4ee4 WatchSource:0}: Error finding container 427dcf4348bc1088dcbd8e0c1bd6aa7ebd00d4e293ba71222dcda7da4a0b4ee4: Status 404 returned error can't find the container with id 427dcf4348bc1088dcbd8e0c1bd6aa7ebd00d4e293ba71222dcda7da4a0b4ee4 May 21 10:39:58.580918 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:58.580879 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f4949c944-j6vbh" event={"ID":"32bfa319-a2ea-470a-8637-4a2230a772ea","Type":"ContainerStarted","Data":"5c4aad51415c0c2cfa4954f9bf337c499699ff7dbe9606486fccb37e64d16eb3"} May 21 10:39:58.580918 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:58.580922 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f4949c944-j6vbh" event={"ID":"32bfa319-a2ea-470a-8637-4a2230a772ea","Type":"ContainerStarted","Data":"427dcf4348bc1088dcbd8e0c1bd6aa7ebd00d4e293ba71222dcda7da4a0b4ee4"} May 21 10:39:58.660239 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:39:58.660188 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5f4949c944-j6vbh" podStartSLOduration=1.6601755310000001 podStartE2EDuration="1.660175531s" podCreationTimestamp="2026-05-21 10:39:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 10:39:58.65999198 +0000 UTC m=+591.573371050" watchObservedRunningTime="2026-05-21 10:39:58.660175531 +0000 UTC m=+591.573554600" May 21 10:40:07.579316 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:07.579291 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pg8hk" May 21 10:40:08.212130 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:08.212076 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f4949c944-j6vbh" May 21 10:40:08.212330 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:08.212170 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f4949c944-j6vbh" May 21 10:40:08.216848 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:08.216827 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f4949c944-j6vbh" May 21 10:40:08.621655 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:08.621125 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f4949c944-j6vbh" May 21 10:40:08.700106 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:08.700068 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74dbdff65c-hwrrg"] May 21 10:40:12.970590 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:12.970555 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7df95f575-v5vhc"] May 21 10:40:12.992218 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:12.986752 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-v5vhc" May 21 10:40:12.992218 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:12.986835 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7df95f575-v5vhc"] May 21 10:40:12.992218 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:12.989210 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-x9ns9\"" May 21 10:40:13.020250 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:13.015460 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb76dca8-1607-4c1b-ac5d-7611a7794b05-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7df95f575-v5vhc\" (UID: \"cb76dca8-1607-4c1b-ac5d-7611a7794b05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-v5vhc" May 21 10:40:13.020250 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:13.015564 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb76dca8-1607-4c1b-ac5d-7611a7794b05-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7df95f575-v5vhc\" (UID: \"cb76dca8-1607-4c1b-ac5d-7611a7794b05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-v5vhc" May 21 10:40:13.020250 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:13.015606 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb76dca8-1607-4c1b-ac5d-7611a7794b05-workload-certs\") pod \"maas-default-gateway-openshift-default-7df95f575-v5vhc\" (UID: \"cb76dca8-1607-4c1b-ac5d-7611a7794b05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-v5vhc" May 21 10:40:13.020250 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:13.015631 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb76dca8-1607-4c1b-ac5d-7611a7794b05-istio-data\") pod \"maas-default-gateway-openshift-default-7df95f575-v5vhc\" (UID: \"cb76dca8-1607-4c1b-ac5d-7611a7794b05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-v5vhc" May 21 10:40:13.020250 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:13.015672 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7q86q\" (UniqueName: \"kubernetes.io/projected/cb76dca8-1607-4c1b-ac5d-7611a7794b05-kube-api-access-7q86q\") pod \"maas-default-gateway-openshift-default-7df95f575-v5vhc\" (UID: \"cb76dca8-1607-4c1b-ac5d-7611a7794b05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-v5vhc" May 21 10:40:13.020250 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:13.015714 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb76dca8-1607-4c1b-ac5d-7611a7794b05-workload-socket\") pod \"maas-default-gateway-openshift-default-7df95f575-v5vhc\" (UID: \"cb76dca8-1607-4c1b-ac5d-7611a7794b05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-v5vhc" May 21 10:40:13.020250 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:13.015760 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb76dca8-1607-4c1b-ac5d-7611a7794b05-credential-socket\") pod \"maas-default-gateway-openshift-default-7df95f575-v5vhc\" (UID: \"cb76dca8-1607-4c1b-ac5d-7611a7794b05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-v5vhc" May 21 10:40:13.020250 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:13.015785 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb76dca8-1607-4c1b-ac5d-7611a7794b05-istio-envoy\") pod \"maas-default-gateway-openshift-default-7df95f575-v5vhc\" (UID: \"cb76dca8-1607-4c1b-ac5d-7611a7794b05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-v5vhc" May 21 10:40:13.020250 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:13.015841 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb76dca8-1607-4c1b-ac5d-7611a7794b05-istio-token\") pod \"maas-default-gateway-openshift-default-7df95f575-v5vhc\" (UID: \"cb76dca8-1607-4c1b-ac5d-7611a7794b05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-v5vhc" May 21 10:40:13.116839 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:13.116809 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb76dca8-1607-4c1b-ac5d-7611a7794b05-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7df95f575-v5vhc\" (UID: \"cb76dca8-1607-4c1b-ac5d-7611a7794b05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-v5vhc" May 21 10:40:13.117030 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:13.116872 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb76dca8-1607-4c1b-ac5d-7611a7794b05-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7df95f575-v5vhc\" (UID: \"cb76dca8-1607-4c1b-ac5d-7611a7794b05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-v5vhc" May 21 10:40:13.117030 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:13.116896 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb76dca8-1607-4c1b-ac5d-7611a7794b05-workload-certs\") pod \"maas-default-gateway-openshift-default-7df95f575-v5vhc\" (UID: \"cb76dca8-1607-4c1b-ac5d-7611a7794b05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-v5vhc" May 21 10:40:13.117030 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:13.116913 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb76dca8-1607-4c1b-ac5d-7611a7794b05-istio-data\") pod \"maas-default-gateway-openshift-default-7df95f575-v5vhc\" (UID: \"cb76dca8-1607-4c1b-ac5d-7611a7794b05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-v5vhc" May 21 10:40:13.117030 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:13.116931 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7q86q\" (UniqueName: \"kubernetes.io/projected/cb76dca8-1607-4c1b-ac5d-7611a7794b05-kube-api-access-7q86q\") pod \"maas-default-gateway-openshift-default-7df95f575-v5vhc\" (UID: \"cb76dca8-1607-4c1b-ac5d-7611a7794b05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-v5vhc" May 21 10:40:13.117030 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:13.117006 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb76dca8-1607-4c1b-ac5d-7611a7794b05-workload-socket\") pod \"maas-default-gateway-openshift-default-7df95f575-v5vhc\" (UID: \"cb76dca8-1607-4c1b-ac5d-7611a7794b05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-v5vhc" May 21 10:40:13.117293 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:13.117038 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb76dca8-1607-4c1b-ac5d-7611a7794b05-credential-socket\") pod \"maas-default-gateway-openshift-default-7df95f575-v5vhc\" (UID: \"cb76dca8-1607-4c1b-ac5d-7611a7794b05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-v5vhc" May 21 10:40:13.117293 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:13.117064 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb76dca8-1607-4c1b-ac5d-7611a7794b05-istio-envoy\") pod \"maas-default-gateway-openshift-default-7df95f575-v5vhc\" (UID: \"cb76dca8-1607-4c1b-ac5d-7611a7794b05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-v5vhc" May 21 10:40:13.117293 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:13.117111 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb76dca8-1607-4c1b-ac5d-7611a7794b05-istio-token\") pod \"maas-default-gateway-openshift-default-7df95f575-v5vhc\" (UID: \"cb76dca8-1607-4c1b-ac5d-7611a7794b05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-v5vhc" May 21 10:40:13.117452 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:13.117352 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb76dca8-1607-4c1b-ac5d-7611a7794b05-workload-certs\") pod \"maas-default-gateway-openshift-default-7df95f575-v5vhc\" (UID: \"cb76dca8-1607-4c1b-ac5d-7611a7794b05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-v5vhc" May 21 10:40:13.117452 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:13.117378 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb76dca8-1607-4c1b-ac5d-7611a7794b05-istio-data\") pod \"maas-default-gateway-openshift-default-7df95f575-v5vhc\" (UID: \"cb76dca8-1607-4c1b-ac5d-7611a7794b05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-v5vhc" May 21 10:40:13.117452 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:13.117437 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb76dca8-1607-4c1b-ac5d-7611a7794b05-workload-socket\") pod \"maas-default-gateway-openshift-default-7df95f575-v5vhc\" (UID: \"cb76dca8-1607-4c1b-ac5d-7611a7794b05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-v5vhc" May 21 10:40:13.117567 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:13.117493 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb76dca8-1607-4c1b-ac5d-7611a7794b05-credential-socket\") pod \"maas-default-gateway-openshift-default-7df95f575-v5vhc\" (UID: \"cb76dca8-1607-4c1b-ac5d-7611a7794b05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-v5vhc" May 21 10:40:13.117609 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:13.117579 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb76dca8-1607-4c1b-ac5d-7611a7794b05-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7df95f575-v5vhc\" (UID: \"cb76dca8-1607-4c1b-ac5d-7611a7794b05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-v5vhc" May 21 10:40:13.119427 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:13.119406 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb76dca8-1607-4c1b-ac5d-7611a7794b05-istio-envoy\") pod \"maas-default-gateway-openshift-default-7df95f575-v5vhc\" (UID: \"cb76dca8-1607-4c1b-ac5d-7611a7794b05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-v5vhc" May 21 10:40:13.119566 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:13.119548 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb76dca8-1607-4c1b-ac5d-7611a7794b05-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7df95f575-v5vhc\" (UID: \"cb76dca8-1607-4c1b-ac5d-7611a7794b05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-v5vhc" May 21 10:40:13.130398 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:13.130378 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7q86q\" (UniqueName: \"kubernetes.io/projected/cb76dca8-1607-4c1b-ac5d-7611a7794b05-kube-api-access-7q86q\") pod \"maas-default-gateway-openshift-default-7df95f575-v5vhc\" (UID: \"cb76dca8-1607-4c1b-ac5d-7611a7794b05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-v5vhc" May 21 10:40:13.147024 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:13.147004 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb76dca8-1607-4c1b-ac5d-7611a7794b05-istio-token\") pod \"maas-default-gateway-openshift-default-7df95f575-v5vhc\" (UID: \"cb76dca8-1607-4c1b-ac5d-7611a7794b05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-v5vhc" May 21 10:40:13.310287 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:13.310217 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-v5vhc" May 21 10:40:13.441716 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:13.441693 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7df95f575-v5vhc"] May 21 10:40:13.443650 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:40:13.443621 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb76dca8_1607_4c1b_ac5d_7611a7794b05.slice/crio-0051b6a98c2be9219b50df62f86a8932057203a30bbe577e2b0fa61099f005ec WatchSource:0}: Error finding container 0051b6a98c2be9219b50df62f86a8932057203a30bbe577e2b0fa61099f005ec: Status 404 returned error can't find the container with id 0051b6a98c2be9219b50df62f86a8932057203a30bbe577e2b0fa61099f005ec May 21 10:40:13.445663 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:13.445633 2565 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} May 21 10:40:13.445732 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:13.445695 2565 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} May 21 10:40:13.445732 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:13.445727 2565 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} May 21 10:40:13.637315 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:13.637281 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-v5vhc" event={"ID":"cb76dca8-1607-4c1b-ac5d-7611a7794b05","Type":"ContainerStarted","Data":"0959ead6f185fb07292b520ae00a7e49e58cf8eddaa49754cd0ae8eabe3ef115"} May 21 10:40:13.637468 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:13.637321 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-v5vhc" event={"ID":"cb76dca8-1607-4c1b-ac5d-7611a7794b05","Type":"ContainerStarted","Data":"0051b6a98c2be9219b50df62f86a8932057203a30bbe577e2b0fa61099f005ec"} May 21 10:40:13.660133 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:13.660079 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-v5vhc" podStartSLOduration=1.660066512 podStartE2EDuration="1.660066512s" podCreationTimestamp="2026-05-21 10:40:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 10:40:13.658267494 +0000 UTC m=+606.571646563" watchObservedRunningTime="2026-05-21 10:40:13.660066512 +0000 UTC m=+606.573445584" May 21 10:40:14.311045 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:14.311007 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-v5vhc" May 21 10:40:14.316361 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:14.316335 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-v5vhc" May 21 10:40:14.641284 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:14.641212 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-v5vhc" May 21 10:40:14.642163 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:14.642146 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-v5vhc" May 21 10:40:17.219129 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:17.219090 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-rgg4g"] May 21 10:40:17.293570 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:17.293530 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-rgg4g"] May 21 10:40:17.293740 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:17.293608 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-rgg4g" May 21 10:40:17.296341 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:17.296321 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" May 21 10:40:17.307603 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:17.307581 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-rgg4g"] May 21 10:40:17.356041 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:17.356007 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/72888724-2f32-408c-b149-14f6288bb941-config-file\") pod \"limitador-limitador-7d549b5b-rgg4g\" (UID: \"72888724-2f32-408c-b149-14f6288bb941\") " pod="kuadrant-system/limitador-limitador-7d549b5b-rgg4g" May 21 10:40:17.356199 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:17.356173 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btbdl\" (UniqueName: \"kubernetes.io/projected/72888724-2f32-408c-b149-14f6288bb941-kube-api-access-btbdl\") pod \"limitador-limitador-7d549b5b-rgg4g\" (UID: \"72888724-2f32-408c-b149-14f6288bb941\") " pod="kuadrant-system/limitador-limitador-7d549b5b-rgg4g" May 21 10:40:17.457226 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:17.457195 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/72888724-2f32-408c-b149-14f6288bb941-config-file\") pod \"limitador-limitador-7d549b5b-rgg4g\" (UID: \"72888724-2f32-408c-b149-14f6288bb941\") " pod="kuadrant-system/limitador-limitador-7d549b5b-rgg4g" May 21 10:40:17.457400 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:17.457300 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-btbdl\" (UniqueName: \"kubernetes.io/projected/72888724-2f32-408c-b149-14f6288bb941-kube-api-access-btbdl\") pod \"limitador-limitador-7d549b5b-rgg4g\" (UID: \"72888724-2f32-408c-b149-14f6288bb941\") " pod="kuadrant-system/limitador-limitador-7d549b5b-rgg4g" May 21 10:40:17.457847 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:17.457826 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/72888724-2f32-408c-b149-14f6288bb941-config-file\") pod \"limitador-limitador-7d549b5b-rgg4g\" (UID: \"72888724-2f32-408c-b149-14f6288bb941\") " pod="kuadrant-system/limitador-limitador-7d549b5b-rgg4g" May 21 10:40:17.465355 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:17.465322 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-btbdl\" (UniqueName: \"kubernetes.io/projected/72888724-2f32-408c-b149-14f6288bb941-kube-api-access-btbdl\") pod \"limitador-limitador-7d549b5b-rgg4g\" (UID: \"72888724-2f32-408c-b149-14f6288bb941\") " pod="kuadrant-system/limitador-limitador-7d549b5b-rgg4g" May 21 10:40:17.607661 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:17.607631 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-rgg4g" May 21 10:40:17.745359 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:17.745330 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-rgg4g"] May 21 10:40:17.748835 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:40:17.748801 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72888724_2f32_408c_b149_14f6288bb941.slice/crio-8366a5d4c6280feaaa72b97c99cd09acf9beae485d3b0aa3686af84458df4c44 WatchSource:0}: Error finding container 8366a5d4c6280feaaa72b97c99cd09acf9beae485d3b0aa3686af84458df4c44: Status 404 returned error can't find the container with id 8366a5d4c6280feaaa72b97c99cd09acf9beae485d3b0aa3686af84458df4c44 May 21 10:40:18.202188 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:18.202159 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-dnftl"] May 21 10:40:18.241778 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:18.241747 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-dnftl"] May 21 10:40:18.242191 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:18.241845 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-dnftl" May 21 10:40:18.244526 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:18.244508 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-c2pl4\"" May 21 10:40:18.368675 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:18.368633 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qbkz\" (UniqueName: \"kubernetes.io/projected/5b38137c-0cd3-41c1-abc4-b38b0c78bf44-kube-api-access-9qbkz\") pod \"authorino-7498df8756-dnftl\" (UID: \"5b38137c-0cd3-41c1-abc4-b38b0c78bf44\") " pod="kuadrant-system/authorino-7498df8756-dnftl" May 21 10:40:18.470177 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:18.470096 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9qbkz\" (UniqueName: \"kubernetes.io/projected/5b38137c-0cd3-41c1-abc4-b38b0c78bf44-kube-api-access-9qbkz\") pod \"authorino-7498df8756-dnftl\" (UID: \"5b38137c-0cd3-41c1-abc4-b38b0c78bf44\") " pod="kuadrant-system/authorino-7498df8756-dnftl" May 21 10:40:18.480147 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:18.480119 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qbkz\" (UniqueName: \"kubernetes.io/projected/5b38137c-0cd3-41c1-abc4-b38b0c78bf44-kube-api-access-9qbkz\") pod \"authorino-7498df8756-dnftl\" (UID: \"5b38137c-0cd3-41c1-abc4-b38b0c78bf44\") " pod="kuadrant-system/authorino-7498df8756-dnftl" May 21 10:40:18.551636 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:18.551608 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-dnftl" May 21 10:40:18.659070 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:18.659034 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-rgg4g" event={"ID":"72888724-2f32-408c-b149-14f6288bb941","Type":"ContainerStarted","Data":"8366a5d4c6280feaaa72b97c99cd09acf9beae485d3b0aa3686af84458df4c44"} May 21 10:40:18.696101 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:18.696076 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-dnftl"] May 21 10:40:18.697877 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:40:18.697840 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5b38137c_0cd3_41c1_abc4_b38b0c78bf44.slice/crio-878a3bafd9ef8bfbeaea80ac72ab84560404337495915f32c2b9692e738ec697 WatchSource:0}: Error finding container 878a3bafd9ef8bfbeaea80ac72ab84560404337495915f32c2b9692e738ec697: Status 404 returned error can't find the container with id 878a3bafd9ef8bfbeaea80ac72ab84560404337495915f32c2b9692e738ec697 May 21 10:40:19.668336 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:19.668296 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-dnftl" event={"ID":"5b38137c-0cd3-41c1-abc4-b38b0c78bf44","Type":"ContainerStarted","Data":"878a3bafd9ef8bfbeaea80ac72ab84560404337495915f32c2b9692e738ec697"} May 21 10:40:23.687151 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:23.687110 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-rgg4g" event={"ID":"72888724-2f32-408c-b149-14f6288bb941","Type":"ContainerStarted","Data":"83c396c12e1b7c57c0645ea4a3238084aa9d315f9ee6f596f2d8dfc5af6d7ac6"} May 21 10:40:23.687623 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:23.687237 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-rgg4g" May 21 10:40:23.688490 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:23.688465 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-dnftl" event={"ID":"5b38137c-0cd3-41c1-abc4-b38b0c78bf44","Type":"ContainerStarted","Data":"78da7c162375dc8ca47ec5644ffd1a396bcb1f68b3792983c848bf4f0a68af93"} May 21 10:40:23.704949 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:23.704891 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-rgg4g" podStartSLOduration=0.949441049 podStartE2EDuration="6.704877559s" podCreationTimestamp="2026-05-21 10:40:17 +0000 UTC" firstStartedPulling="2026-05-21 10:40:17.751055848 +0000 UTC m=+610.664434896" lastFinishedPulling="2026-05-21 10:40:23.506492359 +0000 UTC m=+616.419871406" observedRunningTime="2026-05-21 10:40:23.702708469 +0000 UTC m=+616.616087561" watchObservedRunningTime="2026-05-21 10:40:23.704877559 +0000 UTC m=+616.618256642" May 21 10:40:23.718456 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:23.718411 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-dnftl" podStartSLOduration=0.899548649 podStartE2EDuration="5.718398218s" podCreationTimestamp="2026-05-21 10:40:18 +0000 UTC" firstStartedPulling="2026-05-21 10:40:18.699414783 +0000 UTC m=+611.612793845" lastFinishedPulling="2026-05-21 10:40:23.518264353 +0000 UTC m=+616.431643414" observedRunningTime="2026-05-21 10:40:23.716003021 +0000 UTC m=+616.629382095" watchObservedRunningTime="2026-05-21 10:40:23.718398218 +0000 UTC m=+616.631777287" May 21 10:40:33.721110 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:33.721006 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-74dbdff65c-hwrrg" podUID="3d8ffe04-0c7d-4805-9d12-e321d093a44b" containerName="console" containerID="cri-o://6a9625d2bd39ac3c9a9bc9c3e8f61cba6d656302e9bb743fd7c30758fe485b4f" gracePeriod=15 May 21 10:40:33.967999 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:33.967978 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-74dbdff65c-hwrrg_3d8ffe04-0c7d-4805-9d12-e321d093a44b/console/0.log" May 21 10:40:33.968108 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:33.968041 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74dbdff65c-hwrrg" May 21 10:40:34.119729 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:34.119698 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d8ffe04-0c7d-4805-9d12-e321d093a44b-service-ca\") pod \"3d8ffe04-0c7d-4805-9d12-e321d093a44b\" (UID: \"3d8ffe04-0c7d-4805-9d12-e321d093a44b\") " May 21 10:40:34.119889 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:34.119740 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p6f8p\" (UniqueName: \"kubernetes.io/projected/3d8ffe04-0c7d-4805-9d12-e321d093a44b-kube-api-access-p6f8p\") pod \"3d8ffe04-0c7d-4805-9d12-e321d093a44b\" (UID: \"3d8ffe04-0c7d-4805-9d12-e321d093a44b\") " May 21 10:40:34.119889 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:34.119779 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d8ffe04-0c7d-4805-9d12-e321d093a44b-oauth-serving-cert\") pod \"3d8ffe04-0c7d-4805-9d12-e321d093a44b\" (UID: \"3d8ffe04-0c7d-4805-9d12-e321d093a44b\") " May 21 10:40:34.119889 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:34.119862 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d8ffe04-0c7d-4805-9d12-e321d093a44b-trusted-ca-bundle\") pod \"3d8ffe04-0c7d-4805-9d12-e321d093a44b\" (UID: \"3d8ffe04-0c7d-4805-9d12-e321d093a44b\") " May 21 10:40:34.120069 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:34.119907 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d8ffe04-0c7d-4805-9d12-e321d093a44b-console-oauth-config\") pod \"3d8ffe04-0c7d-4805-9d12-e321d093a44b\" (UID: \"3d8ffe04-0c7d-4805-9d12-e321d093a44b\") " May 21 10:40:34.120069 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:34.119979 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d8ffe04-0c7d-4805-9d12-e321d093a44b-console-serving-cert\") pod \"3d8ffe04-0c7d-4805-9d12-e321d093a44b\" (UID: \"3d8ffe04-0c7d-4805-9d12-e321d093a44b\") " May 21 10:40:34.120069 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:34.120012 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d8ffe04-0c7d-4805-9d12-e321d093a44b-console-config\") pod \"3d8ffe04-0c7d-4805-9d12-e321d093a44b\" (UID: \"3d8ffe04-0c7d-4805-9d12-e321d093a44b\") " May 21 10:40:34.120249 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:34.120139 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d8ffe04-0c7d-4805-9d12-e321d093a44b-service-ca" (OuterVolumeSpecName: "service-ca") pod "3d8ffe04-0c7d-4805-9d12-e321d093a44b" (UID: "3d8ffe04-0c7d-4805-9d12-e321d093a44b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 10:40:34.120326 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:34.120309 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d8ffe04-0c7d-4805-9d12-e321d093a44b-service-ca\") on node \"ip-10-0-142-214.ec2.internal\" DevicePath \"\"" May 21 10:40:34.120399 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:34.120297 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d8ffe04-0c7d-4805-9d12-e321d093a44b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3d8ffe04-0c7d-4805-9d12-e321d093a44b" (UID: "3d8ffe04-0c7d-4805-9d12-e321d093a44b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 10:40:34.120456 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:34.120423 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d8ffe04-0c7d-4805-9d12-e321d093a44b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3d8ffe04-0c7d-4805-9d12-e321d093a44b" (UID: "3d8ffe04-0c7d-4805-9d12-e321d093a44b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 10:40:34.120561 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:34.120535 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d8ffe04-0c7d-4805-9d12-e321d093a44b-console-config" (OuterVolumeSpecName: "console-config") pod "3d8ffe04-0c7d-4805-9d12-e321d093a44b" (UID: "3d8ffe04-0c7d-4805-9d12-e321d093a44b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 10:40:34.121965 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:34.121925 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d8ffe04-0c7d-4805-9d12-e321d093a44b-kube-api-access-p6f8p" (OuterVolumeSpecName: "kube-api-access-p6f8p") pod "3d8ffe04-0c7d-4805-9d12-e321d093a44b" (UID: "3d8ffe04-0c7d-4805-9d12-e321d093a44b"). InnerVolumeSpecName "kube-api-access-p6f8p". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 10:40:34.122090 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:34.122067 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d8ffe04-0c7d-4805-9d12-e321d093a44b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3d8ffe04-0c7d-4805-9d12-e321d093a44b" (UID: "3d8ffe04-0c7d-4805-9d12-e321d093a44b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 10:40:34.122162 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:34.122146 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d8ffe04-0c7d-4805-9d12-e321d093a44b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3d8ffe04-0c7d-4805-9d12-e321d093a44b" (UID: "3d8ffe04-0c7d-4805-9d12-e321d093a44b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 10:40:34.221775 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:34.221742 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d8ffe04-0c7d-4805-9d12-e321d093a44b-console-serving-cert\") on node \"ip-10-0-142-214.ec2.internal\" DevicePath \"\"" May 21 10:40:34.221775 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:34.221786 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d8ffe04-0c7d-4805-9d12-e321d093a44b-console-config\") on node \"ip-10-0-142-214.ec2.internal\" DevicePath \"\"" May 21 10:40:34.222019 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:34.221801 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p6f8p\" (UniqueName: \"kubernetes.io/projected/3d8ffe04-0c7d-4805-9d12-e321d093a44b-kube-api-access-p6f8p\") on node \"ip-10-0-142-214.ec2.internal\" DevicePath \"\"" May 21 10:40:34.222019 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:34.221814 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d8ffe04-0c7d-4805-9d12-e321d093a44b-oauth-serving-cert\") on node \"ip-10-0-142-214.ec2.internal\" DevicePath \"\"" May 21 10:40:34.222019 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:34.221826 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d8ffe04-0c7d-4805-9d12-e321d093a44b-trusted-ca-bundle\") on node \"ip-10-0-142-214.ec2.internal\" DevicePath \"\"" May 21 10:40:34.222019 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:34.221837 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d8ffe04-0c7d-4805-9d12-e321d093a44b-console-oauth-config\") on node \"ip-10-0-142-214.ec2.internal\" DevicePath \"\"" May 21 10:40:34.405624 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:34.405532 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-rgg4g"] May 21 10:40:34.405871 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:34.405830 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-rgg4g" podUID="72888724-2f32-408c-b149-14f6288bb941" containerName="limitador" containerID="cri-o://83c396c12e1b7c57c0645ea4a3238084aa9d315f9ee6f596f2d8dfc5af6d7ac6" gracePeriod=30 May 21 10:40:34.408231 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:34.408207 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-rgg4g" May 21 10:40:34.729627 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:34.729599 2565 generic.go:358] "Generic (PLEG): container finished" podID="72888724-2f32-408c-b149-14f6288bb941" containerID="83c396c12e1b7c57c0645ea4a3238084aa9d315f9ee6f596f2d8dfc5af6d7ac6" exitCode=0 May 21 10:40:34.729965 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:34.729679 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-rgg4g" event={"ID":"72888724-2f32-408c-b149-14f6288bb941","Type":"ContainerDied","Data":"83c396c12e1b7c57c0645ea4a3238084aa9d315f9ee6f596f2d8dfc5af6d7ac6"} May 21 10:40:34.731019 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:34.731003 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-74dbdff65c-hwrrg_3d8ffe04-0c7d-4805-9d12-e321d093a44b/console/0.log" May 21 10:40:34.731106 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:34.731035 2565 generic.go:358] "Generic (PLEG): container finished" podID="3d8ffe04-0c7d-4805-9d12-e321d093a44b" containerID="6a9625d2bd39ac3c9a9bc9c3e8f61cba6d656302e9bb743fd7c30758fe485b4f" exitCode=2 May 21 10:40:34.731106 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:34.731101 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74dbdff65c-hwrrg" May 21 10:40:34.731325 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:34.731100 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74dbdff65c-hwrrg" event={"ID":"3d8ffe04-0c7d-4805-9d12-e321d093a44b","Type":"ContainerDied","Data":"6a9625d2bd39ac3c9a9bc9c3e8f61cba6d656302e9bb743fd7c30758fe485b4f"} May 21 10:40:34.731325 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:34.731200 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74dbdff65c-hwrrg" event={"ID":"3d8ffe04-0c7d-4805-9d12-e321d093a44b","Type":"ContainerDied","Data":"438463d1bc338471ffd1c1e905edfc5c953c1d3aaad915cac6addc4fc6ae27af"} May 21 10:40:34.731325 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:34.731219 2565 scope.go:117] "RemoveContainer" containerID="6a9625d2bd39ac3c9a9bc9c3e8f61cba6d656302e9bb743fd7c30758fe485b4f" May 21 10:40:34.769777 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:34.769750 2565 scope.go:117] "RemoveContainer" containerID="6a9625d2bd39ac3c9a9bc9c3e8f61cba6d656302e9bb743fd7c30758fe485b4f" May 21 10:40:34.770149 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:40:34.770127 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a9625d2bd39ac3c9a9bc9c3e8f61cba6d656302e9bb743fd7c30758fe485b4f\": container with ID starting with 6a9625d2bd39ac3c9a9bc9c3e8f61cba6d656302e9bb743fd7c30758fe485b4f not found: ID does not exist" containerID="6a9625d2bd39ac3c9a9bc9c3e8f61cba6d656302e9bb743fd7c30758fe485b4f" May 21 10:40:34.770238 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:34.770162 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a9625d2bd39ac3c9a9bc9c3e8f61cba6d656302e9bb743fd7c30758fe485b4f"} err="failed to get container status \"6a9625d2bd39ac3c9a9bc9c3e8f61cba6d656302e9bb743fd7c30758fe485b4f\": rpc error: code = NotFound desc = could not find container \"6a9625d2bd39ac3c9a9bc9c3e8f61cba6d656302e9bb743fd7c30758fe485b4f\": container with ID starting with 6a9625d2bd39ac3c9a9bc9c3e8f61cba6d656302e9bb743fd7c30758fe485b4f not found: ID does not exist" May 21 10:40:34.782076 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:34.782045 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74dbdff65c-hwrrg"] May 21 10:40:34.785703 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:34.785677 2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-74dbdff65c-hwrrg"] May 21 10:40:34.850342 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:34.850321 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-rgg4g" May 21 10:40:34.928301 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:34.928273 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-btbdl\" (UniqueName: \"kubernetes.io/projected/72888724-2f32-408c-b149-14f6288bb941-kube-api-access-btbdl\") pod \"72888724-2f32-408c-b149-14f6288bb941\" (UID: \"72888724-2f32-408c-b149-14f6288bb941\") " May 21 10:40:34.928479 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:34.928389 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/72888724-2f32-408c-b149-14f6288bb941-config-file\") pod \"72888724-2f32-408c-b149-14f6288bb941\" (UID: \"72888724-2f32-408c-b149-14f6288bb941\") " May 21 10:40:34.928730 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:34.928710 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72888724-2f32-408c-b149-14f6288bb941-config-file" (OuterVolumeSpecName: "config-file") pod "72888724-2f32-408c-b149-14f6288bb941" (UID: "72888724-2f32-408c-b149-14f6288bb941"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 10:40:34.930285 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:34.930255 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72888724-2f32-408c-b149-14f6288bb941-kube-api-access-btbdl" (OuterVolumeSpecName: "kube-api-access-btbdl") pod "72888724-2f32-408c-b149-14f6288bb941" (UID: "72888724-2f32-408c-b149-14f6288bb941"). InnerVolumeSpecName "kube-api-access-btbdl". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 10:40:35.029540 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:35.029447 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-btbdl\" (UniqueName: \"kubernetes.io/projected/72888724-2f32-408c-b149-14f6288bb941-kube-api-access-btbdl\") on node \"ip-10-0-142-214.ec2.internal\" DevicePath \"\"" May 21 10:40:35.029540 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:35.029490 2565 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/72888724-2f32-408c-b149-14f6288bb941-config-file\") on node \"ip-10-0-142-214.ec2.internal\" DevicePath \"\"" May 21 10:40:35.636883 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:35.636847 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d8ffe04-0c7d-4805-9d12-e321d093a44b" path="/var/lib/kubelet/pods/3d8ffe04-0c7d-4805-9d12-e321d093a44b/volumes" May 21 10:40:35.736022 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:35.735994 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-rgg4g" May 21 10:40:35.736462 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:35.735982 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-rgg4g" event={"ID":"72888724-2f32-408c-b149-14f6288bb941","Type":"ContainerDied","Data":"8366a5d4c6280feaaa72b97c99cd09acf9beae485d3b0aa3686af84458df4c44"} May 21 10:40:35.736462 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:35.736123 2565 scope.go:117] "RemoveContainer" containerID="83c396c12e1b7c57c0645ea4a3238084aa9d315f9ee6f596f2d8dfc5af6d7ac6" May 21 10:40:35.753644 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:35.753612 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-rgg4g"] May 21 10:40:35.755634 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:35.755603 2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-rgg4g"] May 21 10:40:37.636167 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:37.636133 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72888724-2f32-408c-b149-14f6288bb941" path="/var/lib/kubelet/pods/72888724-2f32-408c-b149-14f6288bb941/volumes" May 21 10:40:51.471195 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:51.471154 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-5mphf"] May 21 10:40:51.471719 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:51.471702 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d8ffe04-0c7d-4805-9d12-e321d093a44b" containerName="console" May 21 10:40:51.471790 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:51.471722 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d8ffe04-0c7d-4805-9d12-e321d093a44b" containerName="console" May 21 10:40:51.471790 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:51.471746 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72888724-2f32-408c-b149-14f6288bb941" containerName="limitador" May 21 10:40:51.471790 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:51.471757 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="72888724-2f32-408c-b149-14f6288bb941" containerName="limitador" May 21 10:40:51.471935 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:51.471857 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="72888724-2f32-408c-b149-14f6288bb941" containerName="limitador" May 21 10:40:51.471935 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:51.471876 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="3d8ffe04-0c7d-4805-9d12-e321d093a44b" containerName="console" May 21 10:40:51.478234 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:51.478213 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-5mphf" May 21 10:40:51.484018 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:51.483994 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-5mphf"] May 21 10:40:51.577998 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:51.577936 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnwtg\" (UniqueName: \"kubernetes.io/projected/b31d4f0d-3eeb-482e-8385-d131d7bf7085-kube-api-access-cnwtg\") pod \"authorino-8b475cf9f-5mphf\" (UID: \"b31d4f0d-3eeb-482e-8385-d131d7bf7085\") " pod="kuadrant-system/authorino-8b475cf9f-5mphf" May 21 10:40:51.668348 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:51.668303 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-5mphf"] May 21 10:40:51.668568 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:40:51.668548 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-cnwtg], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-8b475cf9f-5mphf" podUID="b31d4f0d-3eeb-482e-8385-d131d7bf7085" May 21 10:40:51.679358 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:51.679335 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cnwtg\" (UniqueName: \"kubernetes.io/projected/b31d4f0d-3eeb-482e-8385-d131d7bf7085-kube-api-access-cnwtg\") pod \"authorino-8b475cf9f-5mphf\" (UID: \"b31d4f0d-3eeb-482e-8385-d131d7bf7085\") " pod="kuadrant-system/authorino-8b475cf9f-5mphf" May 21 10:40:51.691412 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:51.691378 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnwtg\" (UniqueName: \"kubernetes.io/projected/b31d4f0d-3eeb-482e-8385-d131d7bf7085-kube-api-access-cnwtg\") pod \"authorino-8b475cf9f-5mphf\" (UID: \"b31d4f0d-3eeb-482e-8385-d131d7bf7085\") " pod="kuadrant-system/authorino-8b475cf9f-5mphf" May 21 10:40:51.764704 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:51.764633 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5994999fb7-xjcsx"] May 21 10:40:51.768774 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:51.768757 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5994999fb7-xjcsx" May 21 10:40:51.771284 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:51.771265 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" May 21 10:40:51.774800 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:51.774777 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5994999fb7-xjcsx"] May 21 10:40:51.797623 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:51.797601 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-5mphf" May 21 10:40:51.801690 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:51.801673 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-5mphf" May 21 10:40:51.880992 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:51.880961 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cnwtg\" (UniqueName: \"kubernetes.io/projected/b31d4f0d-3eeb-482e-8385-d131d7bf7085-kube-api-access-cnwtg\") pod \"b31d4f0d-3eeb-482e-8385-d131d7bf7085\" (UID: \"b31d4f0d-3eeb-482e-8385-d131d7bf7085\") " May 21 10:40:51.881143 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:51.881102 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pddsk\" (UniqueName: \"kubernetes.io/projected/e4bfdc32-779f-42a1-87ee-d4d67afb1b39-kube-api-access-pddsk\") pod \"authorino-5994999fb7-xjcsx\" (UID: \"e4bfdc32-779f-42a1-87ee-d4d67afb1b39\") " pod="kuadrant-system/authorino-5994999fb7-xjcsx" May 21 10:40:51.881222 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:51.881204 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e4bfdc32-779f-42a1-87ee-d4d67afb1b39-tls-cert\") pod \"authorino-5994999fb7-xjcsx\" (UID: \"e4bfdc32-779f-42a1-87ee-d4d67afb1b39\") " pod="kuadrant-system/authorino-5994999fb7-xjcsx" May 21 10:40:51.882905 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:51.882878 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b31d4f0d-3eeb-482e-8385-d131d7bf7085-kube-api-access-cnwtg" (OuterVolumeSpecName: "kube-api-access-cnwtg") pod "b31d4f0d-3eeb-482e-8385-d131d7bf7085" (UID: "b31d4f0d-3eeb-482e-8385-d131d7bf7085"). InnerVolumeSpecName "kube-api-access-cnwtg". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 10:40:51.981914 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:51.981871 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pddsk\" (UniqueName: \"kubernetes.io/projected/e4bfdc32-779f-42a1-87ee-d4d67afb1b39-kube-api-access-pddsk\") pod \"authorino-5994999fb7-xjcsx\" (UID: \"e4bfdc32-779f-42a1-87ee-d4d67afb1b39\") " pod="kuadrant-system/authorino-5994999fb7-xjcsx" May 21 10:40:51.982080 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:51.981986 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e4bfdc32-779f-42a1-87ee-d4d67afb1b39-tls-cert\") pod \"authorino-5994999fb7-xjcsx\" (UID: \"e4bfdc32-779f-42a1-87ee-d4d67afb1b39\") " pod="kuadrant-system/authorino-5994999fb7-xjcsx" May 21 10:40:51.982080 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:51.982054 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cnwtg\" (UniqueName: \"kubernetes.io/projected/b31d4f0d-3eeb-482e-8385-d131d7bf7085-kube-api-access-cnwtg\") on node \"ip-10-0-142-214.ec2.internal\" DevicePath \"\"" May 21 10:40:51.984338 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:51.984316 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e4bfdc32-779f-42a1-87ee-d4d67afb1b39-tls-cert\") pod \"authorino-5994999fb7-xjcsx\" (UID: \"e4bfdc32-779f-42a1-87ee-d4d67afb1b39\") " pod="kuadrant-system/authorino-5994999fb7-xjcsx" May 21 10:40:51.990052 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:51.990032 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pddsk\" (UniqueName: \"kubernetes.io/projected/e4bfdc32-779f-42a1-87ee-d4d67afb1b39-kube-api-access-pddsk\") pod \"authorino-5994999fb7-xjcsx\" (UID: \"e4bfdc32-779f-42a1-87ee-d4d67afb1b39\") " pod="kuadrant-system/authorino-5994999fb7-xjcsx" May 21 10:40:52.079704 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:52.079676 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5994999fb7-xjcsx" May 21 10:40:52.209821 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:52.209798 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5994999fb7-xjcsx"] May 21 10:40:52.211851 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:40:52.211823 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode4bfdc32_779f_42a1_87ee_d4d67afb1b39.slice/crio-dcdd50c4fda2ded1fb52461f559ebf53162911e34a37cbb26f36f231d6d47c93 WatchSource:0}: Error finding container dcdd50c4fda2ded1fb52461f559ebf53162911e34a37cbb26f36f231d6d47c93: Status 404 returned error can't find the container with id dcdd50c4fda2ded1fb52461f559ebf53162911e34a37cbb26f36f231d6d47c93 May 21 10:40:52.802358 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:52.802332 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-5mphf" May 21 10:40:52.802813 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:52.802372 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5994999fb7-xjcsx" event={"ID":"e4bfdc32-779f-42a1-87ee-d4d67afb1b39","Type":"ContainerStarted","Data":"7b3427b88e3448584ea46dc66e1cf164e5f10e4bbd811e7a228a57dba48939a3"} May 21 10:40:52.802813 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:52.802407 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5994999fb7-xjcsx" event={"ID":"e4bfdc32-779f-42a1-87ee-d4d67afb1b39","Type":"ContainerStarted","Data":"dcdd50c4fda2ded1fb52461f559ebf53162911e34a37cbb26f36f231d6d47c93"} May 21 10:40:52.822851 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:52.822814 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-5994999fb7-xjcsx" podStartSLOduration=1.448933522 podStartE2EDuration="1.822802341s" podCreationTimestamp="2026-05-21 10:40:51 +0000 UTC" firstStartedPulling="2026-05-21 10:40:52.213227286 +0000 UTC m=+645.126606334" lastFinishedPulling="2026-05-21 10:40:52.587096103 +0000 UTC m=+645.500475153" observedRunningTime="2026-05-21 10:40:52.820866541 +0000 UTC m=+645.734245610" watchObservedRunningTime="2026-05-21 10:40:52.822802341 +0000 UTC m=+645.736181410" May 21 10:40:52.845288 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:52.845216 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-5mphf"] May 21 10:40:52.851428 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:52.851379 2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-5mphf"] May 21 10:40:52.853215 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:52.853191 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-dnftl"] May 21 10:40:52.853388 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:52.853367 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-dnftl" podUID="5b38137c-0cd3-41c1-abc4-b38b0c78bf44" containerName="authorino" containerID="cri-o://78da7c162375dc8ca47ec5644ffd1a396bcb1f68b3792983c848bf4f0a68af93" gracePeriod=30 May 21 10:40:53.113619 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:53.113593 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-dnftl" May 21 10:40:53.193537 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:53.193509 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9qbkz\" (UniqueName: \"kubernetes.io/projected/5b38137c-0cd3-41c1-abc4-b38b0c78bf44-kube-api-access-9qbkz\") pod \"5b38137c-0cd3-41c1-abc4-b38b0c78bf44\" (UID: \"5b38137c-0cd3-41c1-abc4-b38b0c78bf44\") " May 21 10:40:53.195447 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:53.195418 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b38137c-0cd3-41c1-abc4-b38b0c78bf44-kube-api-access-9qbkz" (OuterVolumeSpecName: "kube-api-access-9qbkz") pod "5b38137c-0cd3-41c1-abc4-b38b0c78bf44" (UID: "5b38137c-0cd3-41c1-abc4-b38b0c78bf44"). InnerVolumeSpecName "kube-api-access-9qbkz". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 10:40:53.294741 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:53.294711 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9qbkz\" (UniqueName: \"kubernetes.io/projected/5b38137c-0cd3-41c1-abc4-b38b0c78bf44-kube-api-access-9qbkz\") on node \"ip-10-0-142-214.ec2.internal\" DevicePath \"\"" May 21 10:40:53.636326 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:53.636293 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b31d4f0d-3eeb-482e-8385-d131d7bf7085" path="/var/lib/kubelet/pods/b31d4f0d-3eeb-482e-8385-d131d7bf7085/volumes" May 21 10:40:53.807221 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:53.807186 2565 generic.go:358] "Generic (PLEG): container finished" podID="5b38137c-0cd3-41c1-abc4-b38b0c78bf44" containerID="78da7c162375dc8ca47ec5644ffd1a396bcb1f68b3792983c848bf4f0a68af93" exitCode=0 May 21 10:40:53.807693 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:53.807235 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-dnftl" May 21 10:40:53.807693 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:53.807283 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-dnftl" event={"ID":"5b38137c-0cd3-41c1-abc4-b38b0c78bf44","Type":"ContainerDied","Data":"78da7c162375dc8ca47ec5644ffd1a396bcb1f68b3792983c848bf4f0a68af93"} May 21 10:40:53.807693 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:53.807334 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-dnftl" event={"ID":"5b38137c-0cd3-41c1-abc4-b38b0c78bf44","Type":"ContainerDied","Data":"878a3bafd9ef8bfbeaea80ac72ab84560404337495915f32c2b9692e738ec697"} May 21 10:40:53.807693 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:53.807356 2565 scope.go:117] "RemoveContainer" containerID="78da7c162375dc8ca47ec5644ffd1a396bcb1f68b3792983c848bf4f0a68af93" May 21 10:40:53.815666 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:53.815637 2565 scope.go:117] "RemoveContainer" containerID="78da7c162375dc8ca47ec5644ffd1a396bcb1f68b3792983c848bf4f0a68af93" May 21 10:40:53.815905 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:40:53.815886 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78da7c162375dc8ca47ec5644ffd1a396bcb1f68b3792983c848bf4f0a68af93\": container with ID starting with 78da7c162375dc8ca47ec5644ffd1a396bcb1f68b3792983c848bf4f0a68af93 not found: ID does not exist" containerID="78da7c162375dc8ca47ec5644ffd1a396bcb1f68b3792983c848bf4f0a68af93" May 21 10:40:53.815988 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:53.815914 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78da7c162375dc8ca47ec5644ffd1a396bcb1f68b3792983c848bf4f0a68af93"} err="failed to get container status \"78da7c162375dc8ca47ec5644ffd1a396bcb1f68b3792983c848bf4f0a68af93\": rpc error: code = NotFound desc = could not find container \"78da7c162375dc8ca47ec5644ffd1a396bcb1f68b3792983c848bf4f0a68af93\": container with ID starting with 78da7c162375dc8ca47ec5644ffd1a396bcb1f68b3792983c848bf4f0a68af93 not found: ID does not exist" May 21 10:40:53.823874 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:53.823853 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-dnftl"] May 21 10:40:53.827497 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:53.827477 2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-dnftl"] May 21 10:40:55.637052 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:55.637022 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b38137c-0cd3-41c1-abc4-b38b0c78bf44" path="/var/lib/kubelet/pods/5b38137c-0cd3-41c1-abc4-b38b0c78bf44/volumes" May 21 10:40:55.880370 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:55.880331 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-tw9p9"] May 21 10:40:55.880707 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:55.880693 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b38137c-0cd3-41c1-abc4-b38b0c78bf44" containerName="authorino" May 21 10:40:55.880794 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:55.880709 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b38137c-0cd3-41c1-abc4-b38b0c78bf44" containerName="authorino" May 21 10:40:55.880852 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:55.880816 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="5b38137c-0cd3-41c1-abc4-b38b0c78bf44" containerName="authorino" May 21 10:40:55.938810 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:55.938737 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-tw9p9"] May 21 10:40:55.938978 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:55.938821 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fb5d86bc-tw9p9" May 21 10:40:55.941281 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:55.941247 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" May 21 10:40:55.941773 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:55.941756 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-z85sc\"" May 21 10:40:56.018080 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:56.018052 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgt7v\" (UniqueName: \"kubernetes.io/projected/94d91a62-31a4-40de-ac43-b69b997efdc9-kube-api-access-dgt7v\") pod \"maas-controller-68fb5d86bc-tw9p9\" (UID: \"94d91a62-31a4-40de-ac43-b69b997efdc9\") " pod="opendatahub/maas-controller-68fb5d86bc-tw9p9" May 21 10:40:56.038887 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:56.038857 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-d4f98dd76-rwhtm"] May 21 10:40:56.059183 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:56.059160 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d4f98dd76-rwhtm"] May 21 10:40:56.059301 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:56.059276 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d4f98dd76-rwhtm" May 21 10:40:56.119278 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:56.119238 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2j88x\" (UniqueName: \"kubernetes.io/projected/4462b23f-e695-4854-ae7f-77e67d52fab6-kube-api-access-2j88x\") pod \"maas-controller-d4f98dd76-rwhtm\" (UID: \"4462b23f-e695-4854-ae7f-77e67d52fab6\") " pod="opendatahub/maas-controller-d4f98dd76-rwhtm" May 21 10:40:56.119422 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:56.119309 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dgt7v\" (UniqueName: \"kubernetes.io/projected/94d91a62-31a4-40de-ac43-b69b997efdc9-kube-api-access-dgt7v\") pod \"maas-controller-68fb5d86bc-tw9p9\" (UID: \"94d91a62-31a4-40de-ac43-b69b997efdc9\") " pod="opendatahub/maas-controller-68fb5d86bc-tw9p9" May 21 10:40:56.131442 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:56.131409 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgt7v\" (UniqueName: \"kubernetes.io/projected/94d91a62-31a4-40de-ac43-b69b997efdc9-kube-api-access-dgt7v\") pod \"maas-controller-68fb5d86bc-tw9p9\" (UID: \"94d91a62-31a4-40de-ac43-b69b997efdc9\") " pod="opendatahub/maas-controller-68fb5d86bc-tw9p9" May 21 10:40:56.166557 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:56.166528 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-tw9p9"] May 21 10:40:56.166833 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:56.166819 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fb5d86bc-tw9p9" May 21 10:40:56.220368 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:56.220325 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2j88x\" (UniqueName: \"kubernetes.io/projected/4462b23f-e695-4854-ae7f-77e67d52fab6-kube-api-access-2j88x\") pod \"maas-controller-d4f98dd76-rwhtm\" (UID: \"4462b23f-e695-4854-ae7f-77e67d52fab6\") " pod="opendatahub/maas-controller-d4f98dd76-rwhtm" May 21 10:40:56.223000 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:56.222972 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-55d7f6df7d-h6ngk"] May 21 10:40:56.235638 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:56.235606 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2j88x\" (UniqueName: \"kubernetes.io/projected/4462b23f-e695-4854-ae7f-77e67d52fab6-kube-api-access-2j88x\") pod \"maas-controller-d4f98dd76-rwhtm\" (UID: \"4462b23f-e695-4854-ae7f-77e67d52fab6\") " pod="opendatahub/maas-controller-d4f98dd76-rwhtm" May 21 10:40:56.254508 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:56.254481 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55d7f6df7d-h6ngk"] May 21 10:40:56.254635 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:56.254622 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55d7f6df7d-h6ngk" May 21 10:40:56.302039 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:56.302012 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-tw9p9"] May 21 10:40:56.303811 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:40:56.303783 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94d91a62_31a4_40de_ac43_b69b997efdc9.slice/crio-adcce20886a9a181b7522fda2217155c8c62c86b73dfbd98cb0b0f8ae5f08ab3 WatchSource:0}: Error finding container adcce20886a9a181b7522fda2217155c8c62c86b73dfbd98cb0b0f8ae5f08ab3: Status 404 returned error can't find the container with id adcce20886a9a181b7522fda2217155c8c62c86b73dfbd98cb0b0f8ae5f08ab3 May 21 10:40:56.321673 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:56.321646 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tzng\" (UniqueName: \"kubernetes.io/projected/6f5c61d5-952b-4d5b-a4cc-c223decb8ee4-kube-api-access-9tzng\") pod \"maas-controller-55d7f6df7d-h6ngk\" (UID: \"6f5c61d5-952b-4d5b-a4cc-c223decb8ee4\") " pod="opendatahub/maas-controller-55d7f6df7d-h6ngk" May 21 10:40:56.370396 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:56.370370 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d4f98dd76-rwhtm" May 21 10:40:56.422737 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:56.422707 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9tzng\" (UniqueName: \"kubernetes.io/projected/6f5c61d5-952b-4d5b-a4cc-c223decb8ee4-kube-api-access-9tzng\") pod \"maas-controller-55d7f6df7d-h6ngk\" (UID: \"6f5c61d5-952b-4d5b-a4cc-c223decb8ee4\") " pod="opendatahub/maas-controller-55d7f6df7d-h6ngk" May 21 10:40:56.433449 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:56.433426 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tzng\" (UniqueName: \"kubernetes.io/projected/6f5c61d5-952b-4d5b-a4cc-c223decb8ee4-kube-api-access-9tzng\") pod \"maas-controller-55d7f6df7d-h6ngk\" (UID: \"6f5c61d5-952b-4d5b-a4cc-c223decb8ee4\") " pod="opendatahub/maas-controller-55d7f6df7d-h6ngk" May 21 10:40:56.500570 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:56.500545 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d4f98dd76-rwhtm"] May 21 10:40:56.501884 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:40:56.501852 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4462b23f_e695_4854_ae7f_77e67d52fab6.slice/crio-352659e8231f8d4f4c26b1e76edea4c65297ed1d3e8ff719c0c1fd9e1a3d51bb WatchSource:0}: Error finding container 352659e8231f8d4f4c26b1e76edea4c65297ed1d3e8ff719c0c1fd9e1a3d51bb: Status 404 returned error can't find the container with id 352659e8231f8d4f4c26b1e76edea4c65297ed1d3e8ff719c0c1fd9e1a3d51bb May 21 10:40:56.565956 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:56.565913 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55d7f6df7d-h6ngk" May 21 10:40:56.694786 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:56.694763 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55d7f6df7d-h6ngk"] May 21 10:40:56.696247 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:40:56.696220 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f5c61d5_952b_4d5b_a4cc_c223decb8ee4.slice/crio-304a478659d6d83e10b580a54e3d6b2365ffde392ea4bf6d0b11c6d3f691c1bb WatchSource:0}: Error finding container 304a478659d6d83e10b580a54e3d6b2365ffde392ea4bf6d0b11c6d3f691c1bb: Status 404 returned error can't find the container with id 304a478659d6d83e10b580a54e3d6b2365ffde392ea4bf6d0b11c6d3f691c1bb May 21 10:40:56.820108 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:56.820074 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68fb5d86bc-tw9p9" event={"ID":"94d91a62-31a4-40de-ac43-b69b997efdc9","Type":"ContainerStarted","Data":"adcce20886a9a181b7522fda2217155c8c62c86b73dfbd98cb0b0f8ae5f08ab3"} May 21 10:40:56.821148 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:56.821115 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d4f98dd76-rwhtm" event={"ID":"4462b23f-e695-4854-ae7f-77e67d52fab6","Type":"ContainerStarted","Data":"352659e8231f8d4f4c26b1e76edea4c65297ed1d3e8ff719c0c1fd9e1a3d51bb"} May 21 10:40:56.822085 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:40:56.822063 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55d7f6df7d-h6ngk" event={"ID":"6f5c61d5-952b-4d5b-a4cc-c223decb8ee4","Type":"ContainerStarted","Data":"304a478659d6d83e10b580a54e3d6b2365ffde392ea4bf6d0b11c6d3f691c1bb"} May 21 10:41:00.845670 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:00.845632 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55d7f6df7d-h6ngk" event={"ID":"6f5c61d5-952b-4d5b-a4cc-c223decb8ee4","Type":"ContainerStarted","Data":"2f33ed5b368b9926fb15100dfe79910851ee0104c7142c1d9369ca357c71c5a3"} May 21 10:41:00.846146 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:00.845707 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-55d7f6df7d-h6ngk" May 21 10:41:00.847135 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:00.847099 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68fb5d86bc-tw9p9" event={"ID":"94d91a62-31a4-40de-ac43-b69b997efdc9","Type":"ContainerStarted","Data":"de7c5c145e331b09dbe117f4f86e20dd9cb2ef701d4b2058977155cdea925200"} May 21 10:41:00.847281 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:00.847161 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-68fb5d86bc-tw9p9" podUID="94d91a62-31a4-40de-ac43-b69b997efdc9" containerName="manager" containerID="cri-o://de7c5c145e331b09dbe117f4f86e20dd9cb2ef701d4b2058977155cdea925200" gracePeriod=30 May 21 10:41:00.847281 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:00.847173 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-68fb5d86bc-tw9p9" May 21 10:41:00.848596 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:00.848567 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d4f98dd76-rwhtm" event={"ID":"4462b23f-e695-4854-ae7f-77e67d52fab6","Type":"ContainerStarted","Data":"bef6879bcc389b66369b6491eb77d3aafcba2cd1ad10a84aa9c58f88b69b620c"} May 21 10:41:00.848707 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:00.848686 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-d4f98dd76-rwhtm" May 21 10:41:00.866107 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:00.866064 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-55d7f6df7d-h6ngk" podStartSLOduration=1.7883582740000001 podStartE2EDuration="4.866050414s" podCreationTimestamp="2026-05-21 10:40:56 +0000 UTC" firstStartedPulling="2026-05-21 10:40:56.697604477 +0000 UTC m=+649.610983525" lastFinishedPulling="2026-05-21 10:40:59.775296606 +0000 UTC m=+652.688675665" observedRunningTime="2026-05-21 10:41:00.864550486 +0000 UTC m=+653.777929557" watchObservedRunningTime="2026-05-21 10:41:00.866050414 +0000 UTC m=+653.779429483" May 21 10:41:00.882897 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:00.882853 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-d4f98dd76-rwhtm" podStartSLOduration=1.62125722 podStartE2EDuration="4.882818328s" podCreationTimestamp="2026-05-21 10:40:56 +0000 UTC" firstStartedPulling="2026-05-21 10:40:56.503281861 +0000 UTC m=+649.416660913" lastFinishedPulling="2026-05-21 10:40:59.764842961 +0000 UTC m=+652.678222021" observedRunningTime="2026-05-21 10:41:00.880405785 +0000 UTC m=+653.793784854" watchObservedRunningTime="2026-05-21 10:41:00.882818328 +0000 UTC m=+653.796197491" May 21 10:41:00.896927 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:00.896882 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-68fb5d86bc-tw9p9" podStartSLOduration=2.437243244 podStartE2EDuration="5.896868727s" podCreationTimestamp="2026-05-21 10:40:55 +0000 UTC" firstStartedPulling="2026-05-21 10:40:56.305220949 +0000 UTC m=+649.218600003" lastFinishedPulling="2026-05-21 10:40:59.764846434 +0000 UTC m=+652.678225486" observedRunningTime="2026-05-21 10:41:00.896281322 +0000 UTC m=+653.809660392" watchObservedRunningTime="2026-05-21 10:41:00.896868727 +0000 UTC m=+653.810247797" May 21 10:41:01.091223 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:01.091201 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fb5d86bc-tw9p9" May 21 10:41:01.167287 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:01.167184 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dgt7v\" (UniqueName: \"kubernetes.io/projected/94d91a62-31a4-40de-ac43-b69b997efdc9-kube-api-access-dgt7v\") pod \"94d91a62-31a4-40de-ac43-b69b997efdc9\" (UID: \"94d91a62-31a4-40de-ac43-b69b997efdc9\") " May 21 10:41:01.169383 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:01.169360 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94d91a62-31a4-40de-ac43-b69b997efdc9-kube-api-access-dgt7v" (OuterVolumeSpecName: "kube-api-access-dgt7v") pod "94d91a62-31a4-40de-ac43-b69b997efdc9" (UID: "94d91a62-31a4-40de-ac43-b69b997efdc9"). InnerVolumeSpecName "kube-api-access-dgt7v". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 10:41:01.267852 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:01.267819 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dgt7v\" (UniqueName: \"kubernetes.io/projected/94d91a62-31a4-40de-ac43-b69b997efdc9-kube-api-access-dgt7v\") on node \"ip-10-0-142-214.ec2.internal\" DevicePath \"\"" May 21 10:41:01.853900 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:01.853865 2565 generic.go:358] "Generic (PLEG): container finished" podID="94d91a62-31a4-40de-ac43-b69b997efdc9" containerID="de7c5c145e331b09dbe117f4f86e20dd9cb2ef701d4b2058977155cdea925200" exitCode=0 May 21 10:41:01.854379 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:01.853923 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fb5d86bc-tw9p9" May 21 10:41:01.854379 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:01.853967 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68fb5d86bc-tw9p9" event={"ID":"94d91a62-31a4-40de-ac43-b69b997efdc9","Type":"ContainerDied","Data":"de7c5c145e331b09dbe117f4f86e20dd9cb2ef701d4b2058977155cdea925200"} May 21 10:41:01.854379 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:01.854005 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68fb5d86bc-tw9p9" event={"ID":"94d91a62-31a4-40de-ac43-b69b997efdc9","Type":"ContainerDied","Data":"adcce20886a9a181b7522fda2217155c8c62c86b73dfbd98cb0b0f8ae5f08ab3"} May 21 10:41:01.854379 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:01.854019 2565 scope.go:117] "RemoveContainer" containerID="de7c5c145e331b09dbe117f4f86e20dd9cb2ef701d4b2058977155cdea925200" May 21 10:41:01.862845 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:01.862828 2565 scope.go:117] "RemoveContainer" containerID="de7c5c145e331b09dbe117f4f86e20dd9cb2ef701d4b2058977155cdea925200" May 21 10:41:01.863152 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:41:01.863133 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de7c5c145e331b09dbe117f4f86e20dd9cb2ef701d4b2058977155cdea925200\": container with ID starting with de7c5c145e331b09dbe117f4f86e20dd9cb2ef701d4b2058977155cdea925200 not found: ID does not exist" containerID="de7c5c145e331b09dbe117f4f86e20dd9cb2ef701d4b2058977155cdea925200" May 21 10:41:01.863231 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:01.863163 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de7c5c145e331b09dbe117f4f86e20dd9cb2ef701d4b2058977155cdea925200"} err="failed to get container status \"de7c5c145e331b09dbe117f4f86e20dd9cb2ef701d4b2058977155cdea925200\": rpc error: code = NotFound desc = could not find container \"de7c5c145e331b09dbe117f4f86e20dd9cb2ef701d4b2058977155cdea925200\": container with ID starting with de7c5c145e331b09dbe117f4f86e20dd9cb2ef701d4b2058977155cdea925200 not found: ID does not exist" May 21 10:41:01.870311 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:01.870284 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-tw9p9"] May 21 10:41:01.878546 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:01.878517 2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-tw9p9"] May 21 10:41:03.636927 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:03.636893 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94d91a62-31a4-40de-ac43-b69b997efdc9" path="/var/lib/kubelet/pods/94d91a62-31a4-40de-ac43-b69b997efdc9/volumes" May 21 10:41:11.860284 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:11.860243 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-55d7f6df7d-h6ngk" May 21 10:41:11.860681 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:11.860330 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-d4f98dd76-rwhtm" May 21 10:41:11.919892 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:11.919862 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-d4f98dd76-rwhtm"] May 21 10:41:11.920093 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:11.920068 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-d4f98dd76-rwhtm" podUID="4462b23f-e695-4854-ae7f-77e67d52fab6" containerName="manager" containerID="cri-o://bef6879bcc389b66369b6491eb77d3aafcba2cd1ad10a84aa9c58f88b69b620c" gracePeriod=30 May 21 10:41:12.100711 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:12.100684 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-86c469d6c7-7wjb8"] May 21 10:41:12.101149 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:12.101134 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94d91a62-31a4-40de-ac43-b69b997efdc9" containerName="manager" May 21 10:41:12.101202 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:12.101150 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="94d91a62-31a4-40de-ac43-b69b997efdc9" containerName="manager" May 21 10:41:12.101234 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:12.101216 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="94d91a62-31a4-40de-ac43-b69b997efdc9" containerName="manager" May 21 10:41:12.104333 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:12.104312 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86c469d6c7-7wjb8" May 21 10:41:12.116864 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:12.116832 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-86c469d6c7-7wjb8"] May 21 10:41:12.166465 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:12.166436 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d4f98dd76-rwhtm" May 21 10:41:12.179102 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:12.179072 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ql6wp\" (UniqueName: \"kubernetes.io/projected/75585b77-4e36-4987-b371-0e26f79dbbfc-kube-api-access-ql6wp\") pod \"maas-controller-86c469d6c7-7wjb8\" (UID: \"75585b77-4e36-4987-b371-0e26f79dbbfc\") " pod="opendatahub/maas-controller-86c469d6c7-7wjb8" May 21 10:41:12.279582 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:12.279545 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2j88x\" (UniqueName: \"kubernetes.io/projected/4462b23f-e695-4854-ae7f-77e67d52fab6-kube-api-access-2j88x\") pod \"4462b23f-e695-4854-ae7f-77e67d52fab6\" (UID: \"4462b23f-e695-4854-ae7f-77e67d52fab6\") " May 21 10:41:12.279752 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:12.279653 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ql6wp\" (UniqueName: \"kubernetes.io/projected/75585b77-4e36-4987-b371-0e26f79dbbfc-kube-api-access-ql6wp\") pod \"maas-controller-86c469d6c7-7wjb8\" (UID: \"75585b77-4e36-4987-b371-0e26f79dbbfc\") " pod="opendatahub/maas-controller-86c469d6c7-7wjb8" May 21 10:41:12.281561 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:12.281525 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4462b23f-e695-4854-ae7f-77e67d52fab6-kube-api-access-2j88x" (OuterVolumeSpecName: "kube-api-access-2j88x") pod "4462b23f-e695-4854-ae7f-77e67d52fab6" (UID: "4462b23f-e695-4854-ae7f-77e67d52fab6"). InnerVolumeSpecName "kube-api-access-2j88x". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 10:41:12.288030 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:12.288010 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ql6wp\" (UniqueName: \"kubernetes.io/projected/75585b77-4e36-4987-b371-0e26f79dbbfc-kube-api-access-ql6wp\") pod \"maas-controller-86c469d6c7-7wjb8\" (UID: \"75585b77-4e36-4987-b371-0e26f79dbbfc\") " pod="opendatahub/maas-controller-86c469d6c7-7wjb8" May 21 10:41:12.381214 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:12.381129 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2j88x\" (UniqueName: \"kubernetes.io/projected/4462b23f-e695-4854-ae7f-77e67d52fab6-kube-api-access-2j88x\") on node \"ip-10-0-142-214.ec2.internal\" DevicePath \"\"" May 21 10:41:12.419464 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:12.419422 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86c469d6c7-7wjb8" May 21 10:41:12.550233 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:12.550211 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-86c469d6c7-7wjb8"] May 21 10:41:12.551425 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:41:12.551399 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75585b77_4e36_4987_b371_0e26f79dbbfc.slice/crio-28c31fa5973c984299b13b730a1191fb22bc917bf06a849cb7a7b62aa8d7c5f4 WatchSource:0}: Error finding container 28c31fa5973c984299b13b730a1191fb22bc917bf06a849cb7a7b62aa8d7c5f4: Status 404 returned error can't find the container with id 28c31fa5973c984299b13b730a1191fb22bc917bf06a849cb7a7b62aa8d7c5f4 May 21 10:41:12.552747 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:12.552731 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 10:41:12.898516 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:12.898484 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86c469d6c7-7wjb8" event={"ID":"75585b77-4e36-4987-b371-0e26f79dbbfc","Type":"ContainerStarted","Data":"16a29160dcccfb747db54625ad5c67d434d2fbb9cefb441c0a203195fee82b02"} May 21 10:41:12.898969 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:12.898524 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86c469d6c7-7wjb8" event={"ID":"75585b77-4e36-4987-b371-0e26f79dbbfc","Type":"ContainerStarted","Data":"28c31fa5973c984299b13b730a1191fb22bc917bf06a849cb7a7b62aa8d7c5f4"} May 21 10:41:12.898969 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:12.898608 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-86c469d6c7-7wjb8" May 21 10:41:12.899655 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:12.899632 2565 generic.go:358] "Generic (PLEG): container finished" podID="4462b23f-e695-4854-ae7f-77e67d52fab6" containerID="bef6879bcc389b66369b6491eb77d3aafcba2cd1ad10a84aa9c58f88b69b620c" exitCode=0 May 21 10:41:12.899751 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:12.899682 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d4f98dd76-rwhtm" May 21 10:41:12.899784 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:12.899681 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d4f98dd76-rwhtm" event={"ID":"4462b23f-e695-4854-ae7f-77e67d52fab6","Type":"ContainerDied","Data":"bef6879bcc389b66369b6491eb77d3aafcba2cd1ad10a84aa9c58f88b69b620c"} May 21 10:41:12.899818 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:12.899785 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d4f98dd76-rwhtm" event={"ID":"4462b23f-e695-4854-ae7f-77e67d52fab6","Type":"ContainerDied","Data":"352659e8231f8d4f4c26b1e76edea4c65297ed1d3e8ff719c0c1fd9e1a3d51bb"} May 21 10:41:12.899818 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:12.899806 2565 scope.go:117] "RemoveContainer" containerID="bef6879bcc389b66369b6491eb77d3aafcba2cd1ad10a84aa9c58f88b69b620c" May 21 10:41:12.911214 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:12.911193 2565 scope.go:117] "RemoveContainer" containerID="bef6879bcc389b66369b6491eb77d3aafcba2cd1ad10a84aa9c58f88b69b620c" May 21 10:41:12.911706 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:41:12.911687 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bef6879bcc389b66369b6491eb77d3aafcba2cd1ad10a84aa9c58f88b69b620c\": container with ID starting with bef6879bcc389b66369b6491eb77d3aafcba2cd1ad10a84aa9c58f88b69b620c not found: ID does not exist" containerID="bef6879bcc389b66369b6491eb77d3aafcba2cd1ad10a84aa9c58f88b69b620c" May 21 10:41:12.911771 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:12.911718 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bef6879bcc389b66369b6491eb77d3aafcba2cd1ad10a84aa9c58f88b69b620c"} err="failed to get container status \"bef6879bcc389b66369b6491eb77d3aafcba2cd1ad10a84aa9c58f88b69b620c\": rpc error: code = NotFound desc = could not find container \"bef6879bcc389b66369b6491eb77d3aafcba2cd1ad10a84aa9c58f88b69b620c\": container with ID starting with bef6879bcc389b66369b6491eb77d3aafcba2cd1ad10a84aa9c58f88b69b620c not found: ID does not exist" May 21 10:41:12.914954 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:12.914900 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-86c469d6c7-7wjb8" podStartSLOduration=0.659738202 podStartE2EDuration="914.888455ms" podCreationTimestamp="2026-05-21 10:41:12 +0000 UTC" firstStartedPulling="2026-05-21 10:41:12.552852285 +0000 UTC m=+665.466231333" lastFinishedPulling="2026-05-21 10:41:12.808002522 +0000 UTC m=+665.721381586" observedRunningTime="2026-05-21 10:41:12.914435013 +0000 UTC m=+665.827814083" watchObservedRunningTime="2026-05-21 10:41:12.914888455 +0000 UTC m=+665.828267525" May 21 10:41:12.927919 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:12.927894 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-d4f98dd76-rwhtm"] May 21 10:41:12.934057 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:12.934031 2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-d4f98dd76-rwhtm"] May 21 10:41:13.637571 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:13.637536 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4462b23f-e695-4854-ae7f-77e67d52fab6" path="/var/lib/kubelet/pods/4462b23f-e695-4854-ae7f-77e67d52fab6/volumes" May 21 10:41:23.911623 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:23.911592 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-86c469d6c7-7wjb8" May 21 10:41:23.954969 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:23.954917 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-55d7f6df7d-h6ngk"] May 21 10:41:23.955170 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:23.955133 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-55d7f6df7d-h6ngk" podUID="6f5c61d5-952b-4d5b-a4cc-c223decb8ee4" containerName="manager" containerID="cri-o://2f33ed5b368b9926fb15100dfe79910851ee0104c7142c1d9369ca357c71c5a3" gracePeriod=30 May 21 10:41:24.199310 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:24.199288 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55d7f6df7d-h6ngk" May 21 10:41:24.387899 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:24.387868 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9tzng\" (UniqueName: \"kubernetes.io/projected/6f5c61d5-952b-4d5b-a4cc-c223decb8ee4-kube-api-access-9tzng\") pod \"6f5c61d5-952b-4d5b-a4cc-c223decb8ee4\" (UID: \"6f5c61d5-952b-4d5b-a4cc-c223decb8ee4\") " May 21 10:41:24.389906 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:24.389876 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f5c61d5-952b-4d5b-a4cc-c223decb8ee4-kube-api-access-9tzng" (OuterVolumeSpecName: "kube-api-access-9tzng") pod "6f5c61d5-952b-4d5b-a4cc-c223decb8ee4" (UID: "6f5c61d5-952b-4d5b-a4cc-c223decb8ee4"). InnerVolumeSpecName "kube-api-access-9tzng". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 10:41:24.489116 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:24.489020 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9tzng\" (UniqueName: \"kubernetes.io/projected/6f5c61d5-952b-4d5b-a4cc-c223decb8ee4-kube-api-access-9tzng\") on node \"ip-10-0-142-214.ec2.internal\" DevicePath \"\"" May 21 10:41:24.949202 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:24.949167 2565 generic.go:358] "Generic (PLEG): container finished" podID="6f5c61d5-952b-4d5b-a4cc-c223decb8ee4" containerID="2f33ed5b368b9926fb15100dfe79910851ee0104c7142c1d9369ca357c71c5a3" exitCode=0 May 21 10:41:24.949633 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:24.949227 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55d7f6df7d-h6ngk" May 21 10:41:24.949633 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:24.949255 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55d7f6df7d-h6ngk" event={"ID":"6f5c61d5-952b-4d5b-a4cc-c223decb8ee4","Type":"ContainerDied","Data":"2f33ed5b368b9926fb15100dfe79910851ee0104c7142c1d9369ca357c71c5a3"} May 21 10:41:24.949633 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:24.949298 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55d7f6df7d-h6ngk" event={"ID":"6f5c61d5-952b-4d5b-a4cc-c223decb8ee4","Type":"ContainerDied","Data":"304a478659d6d83e10b580a54e3d6b2365ffde392ea4bf6d0b11c6d3f691c1bb"} May 21 10:41:24.949633 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:24.949320 2565 scope.go:117] "RemoveContainer" containerID="2f33ed5b368b9926fb15100dfe79910851ee0104c7142c1d9369ca357c71c5a3" May 21 10:41:24.961610 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:24.961467 2565 scope.go:117] "RemoveContainer" containerID="2f33ed5b368b9926fb15100dfe79910851ee0104c7142c1d9369ca357c71c5a3" May 21 10:41:24.961721 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:41:24.961704 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f33ed5b368b9926fb15100dfe79910851ee0104c7142c1d9369ca357c71c5a3\": container with ID starting with 2f33ed5b368b9926fb15100dfe79910851ee0104c7142c1d9369ca357c71c5a3 not found: ID does not exist" containerID="2f33ed5b368b9926fb15100dfe79910851ee0104c7142c1d9369ca357c71c5a3" May 21 10:41:24.961764 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:24.961728 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f33ed5b368b9926fb15100dfe79910851ee0104c7142c1d9369ca357c71c5a3"} err="failed to get container status \"2f33ed5b368b9926fb15100dfe79910851ee0104c7142c1d9369ca357c71c5a3\": rpc error: code = NotFound desc = could not find container \"2f33ed5b368b9926fb15100dfe79910851ee0104c7142c1d9369ca357c71c5a3\": container with ID starting with 2f33ed5b368b9926fb15100dfe79910851ee0104c7142c1d9369ca357c71c5a3 not found: ID does not exist" May 21 10:41:24.972756 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:24.972732 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-55d7f6df7d-h6ngk"] May 21 10:41:24.976617 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:24.976584 2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-55d7f6df7d-h6ngk"] May 21 10:41:25.637062 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:25.637030 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f5c61d5-952b-4d5b-a4cc-c223decb8ee4" path="/var/lib/kubelet/pods/6f5c61d5-952b-4d5b-a4cc-c223decb8ee4/volumes" May 21 10:41:41.821106 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:41.821068 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-6bc5667487-5fsl4"] May 21 10:41:41.821638 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:41.821456 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4462b23f-e695-4854-ae7f-77e67d52fab6" containerName="manager" May 21 10:41:41.821638 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:41.821468 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4462b23f-e695-4854-ae7f-77e67d52fab6" containerName="manager" May 21 10:41:41.821638 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:41.821489 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f5c61d5-952b-4d5b-a4cc-c223decb8ee4" containerName="manager" May 21 10:41:41.821638 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:41.821495 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f5c61d5-952b-4d5b-a4cc-c223decb8ee4" containerName="manager" May 21 10:41:41.821638 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:41.821565 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="4462b23f-e695-4854-ae7f-77e67d52fab6" containerName="manager" May 21 10:41:41.821638 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:41.821577 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="6f5c61d5-952b-4d5b-a4cc-c223decb8ee4" containerName="manager" May 21 10:41:41.825185 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:41.825164 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6bc5667487-5fsl4" May 21 10:41:41.827393 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:41.827370 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" May 21 10:41:41.834921 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:41.834899 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6bc5667487-5fsl4"] May 21 10:41:41.948887 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:41.948846 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff845d71-a746-477f-b629-f2f37073e6e6-maas-api-tls\") pod \"maas-api-6bc5667487-5fsl4\" (UID: \"ff845d71-a746-477f-b629-f2f37073e6e6\") " pod="opendatahub/maas-api-6bc5667487-5fsl4" May 21 10:41:41.949122 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:41.949030 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jwnx\" (UniqueName: \"kubernetes.io/projected/ff845d71-a746-477f-b629-f2f37073e6e6-kube-api-access-4jwnx\") pod \"maas-api-6bc5667487-5fsl4\" (UID: \"ff845d71-a746-477f-b629-f2f37073e6e6\") " pod="opendatahub/maas-api-6bc5667487-5fsl4" May 21 10:41:42.049694 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:42.049662 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4jwnx\" (UniqueName: \"kubernetes.io/projected/ff845d71-a746-477f-b629-f2f37073e6e6-kube-api-access-4jwnx\") pod \"maas-api-6bc5667487-5fsl4\" (UID: \"ff845d71-a746-477f-b629-f2f37073e6e6\") " pod="opendatahub/maas-api-6bc5667487-5fsl4" May 21 10:41:42.049859 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:42.049703 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff845d71-a746-477f-b629-f2f37073e6e6-maas-api-tls\") pod \"maas-api-6bc5667487-5fsl4\" (UID: \"ff845d71-a746-477f-b629-f2f37073e6e6\") " pod="opendatahub/maas-api-6bc5667487-5fsl4" May 21 10:41:42.052326 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:42.052296 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff845d71-a746-477f-b629-f2f37073e6e6-maas-api-tls\") pod \"maas-api-6bc5667487-5fsl4\" (UID: \"ff845d71-a746-477f-b629-f2f37073e6e6\") " pod="opendatahub/maas-api-6bc5667487-5fsl4" May 21 10:41:42.057609 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:42.057575 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jwnx\" (UniqueName: \"kubernetes.io/projected/ff845d71-a746-477f-b629-f2f37073e6e6-kube-api-access-4jwnx\") pod \"maas-api-6bc5667487-5fsl4\" (UID: \"ff845d71-a746-477f-b629-f2f37073e6e6\") " pod="opendatahub/maas-api-6bc5667487-5fsl4" May 21 10:41:42.137559 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:42.137457 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6bc5667487-5fsl4" May 21 10:41:42.181500 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:42.181352 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-zcvlk"] May 21 10:41:42.184676 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:42.184646 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-zcvlk" May 21 10:41:42.188214 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:42.187762 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" May 21 10:41:42.197410 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:42.197383 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-zcvlk"] May 21 10:41:42.251495 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:42.251459 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rl9f\" (UniqueName: \"kubernetes.io/projected/5a42e9b9-f6ed-4bd7-8e32-284434a150b7-kube-api-access-9rl9f\") pod \"payload-processing-58b6c8fdc7-zcvlk\" (UID: \"5a42e9b9-f6ed-4bd7-8e32-284434a150b7\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-zcvlk" May 21 10:41:42.277269 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:42.277241 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6bc5667487-5fsl4"] May 21 10:41:42.279723 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:41:42.279688 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff845d71_a746_477f_b629_f2f37073e6e6.slice/crio-e32ae374eb265f4d31bebca90ddf006935c5bce967a423d8f3abffa46deea6d9 WatchSource:0}: Error finding container e32ae374eb265f4d31bebca90ddf006935c5bce967a423d8f3abffa46deea6d9: Status 404 returned error can't find the container with id e32ae374eb265f4d31bebca90ddf006935c5bce967a423d8f3abffa46deea6d9 May 21 10:41:42.353012 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:42.352975 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9rl9f\" (UniqueName: \"kubernetes.io/projected/5a42e9b9-f6ed-4bd7-8e32-284434a150b7-kube-api-access-9rl9f\") pod \"payload-processing-58b6c8fdc7-zcvlk\" (UID: \"5a42e9b9-f6ed-4bd7-8e32-284434a150b7\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-zcvlk" May 21 10:41:42.361147 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:42.361121 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rl9f\" (UniqueName: \"kubernetes.io/projected/5a42e9b9-f6ed-4bd7-8e32-284434a150b7-kube-api-access-9rl9f\") pod \"payload-processing-58b6c8fdc7-zcvlk\" (UID: \"5a42e9b9-f6ed-4bd7-8e32-284434a150b7\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-zcvlk" May 21 10:41:42.499359 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:42.499269 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-zcvlk" May 21 10:41:42.647819 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:42.647788 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-zcvlk"] May 21 10:41:42.649302 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:41:42.649263 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a42e9b9_f6ed_4bd7_8e32_284434a150b7.slice/crio-4b0493c42eeff0706e489c9c1594e7cabeaca20b8300b48215847f25bb3d0cb6 WatchSource:0}: Error finding container 4b0493c42eeff0706e489c9c1594e7cabeaca20b8300b48215847f25bb3d0cb6: Status 404 returned error can't find the container with id 4b0493c42eeff0706e489c9c1594e7cabeaca20b8300b48215847f25bb3d0cb6 May 21 10:41:43.034156 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:43.034090 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6bc5667487-5fsl4" event={"ID":"ff845d71-a746-477f-b629-f2f37073e6e6","Type":"ContainerStarted","Data":"e32ae374eb265f4d31bebca90ddf006935c5bce967a423d8f3abffa46deea6d9"} May 21 10:41:43.035663 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:43.035635 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-zcvlk" event={"ID":"5a42e9b9-f6ed-4bd7-8e32-284434a150b7","Type":"ContainerStarted","Data":"4b0493c42eeff0706e489c9c1594e7cabeaca20b8300b48215847f25bb3d0cb6"} May 21 10:41:46.051489 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:46.051449 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6bc5667487-5fsl4" event={"ID":"ff845d71-a746-477f-b629-f2f37073e6e6","Type":"ContainerStarted","Data":"466e263a439170910a657ba5650f8694c4d18e1bf3244ed708fd314f1adcb512"} May 21 10:41:46.051986 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:46.051511 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-6bc5667487-5fsl4" May 21 10:41:46.052729 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:46.052708 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-zcvlk" event={"ID":"5a42e9b9-f6ed-4bd7-8e32-284434a150b7","Type":"ContainerStarted","Data":"feecea75b6253853734a602d8197ff5f91316f12ff7c7e24240212f80dd19b7a"} May 21 10:41:46.052811 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:46.052788 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-zcvlk" May 21 10:41:46.069600 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:46.069551 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-6bc5667487-5fsl4" podStartSLOduration=2.014459476 podStartE2EDuration="5.069532911s" podCreationTimestamp="2026-05-21 10:41:41 +0000 UTC" firstStartedPulling="2026-05-21 10:41:42.281612802 +0000 UTC m=+695.194991851" lastFinishedPulling="2026-05-21 10:41:45.336686218 +0000 UTC m=+698.250065286" observedRunningTime="2026-05-21 10:41:46.067875551 +0000 UTC m=+698.981254622" watchObservedRunningTime="2026-05-21 10:41:46.069532911 +0000 UTC m=+698.982911981" May 21 10:41:46.084390 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:46.084339 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-zcvlk" podStartSLOduration=1.349648364 podStartE2EDuration="4.08432393s" podCreationTimestamp="2026-05-21 10:41:42 +0000 UTC" firstStartedPulling="2026-05-21 10:41:42.65135446 +0000 UTC m=+695.564733508" lastFinishedPulling="2026-05-21 10:41:45.386030026 +0000 UTC m=+698.299409074" observedRunningTime="2026-05-21 10:41:46.082991492 +0000 UTC m=+698.996370562" watchObservedRunningTime="2026-05-21 10:41:46.08432393 +0000 UTC m=+698.997703051" May 21 10:41:52.062606 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:52.062575 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-6bc5667487-5fsl4" May 21 10:41:57.059133 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:41:57.059102 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-zcvlk" May 21 10:42:05.317443 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:42:05.317408 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr7dpl"] May 21 10:42:05.321038 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:42:05.321018 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr7dpl" May 21 10:42:05.323380 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:42:05.323354 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" May 21 10:42:05.324240 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:42:05.324220 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" May 21 10:42:05.324331 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:42:05.324258 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" May 21 10:42:05.324416 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:42:05.324388 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-tnd62\"" May 21 10:42:05.331235 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:42:05.331206 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr7dpl"] May 21 10:42:05.477296 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:42:05.477253 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/677eaca9-1d9b-45eb-a4ea-758077bb5d4e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr7dpl\" (UID: \"677eaca9-1d9b-45eb-a4ea-758077bb5d4e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr7dpl" May 21 10:42:05.477454 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:42:05.477313 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mmrs\" (UniqueName: \"kubernetes.io/projected/677eaca9-1d9b-45eb-a4ea-758077bb5d4e-kube-api-access-9mmrs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr7dpl\" (UID: \"677eaca9-1d9b-45eb-a4ea-758077bb5d4e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr7dpl" May 21 10:42:05.477454 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:42:05.477390 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/677eaca9-1d9b-45eb-a4ea-758077bb5d4e-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr7dpl\" (UID: \"677eaca9-1d9b-45eb-a4ea-758077bb5d4e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr7dpl" May 21 10:42:05.477454 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:42:05.477436 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/677eaca9-1d9b-45eb-a4ea-758077bb5d4e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr7dpl\" (UID: \"677eaca9-1d9b-45eb-a4ea-758077bb5d4e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr7dpl" May 21 10:42:05.477586 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:42:05.477455 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/677eaca9-1d9b-45eb-a4ea-758077bb5d4e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr7dpl\" (UID: \"677eaca9-1d9b-45eb-a4ea-758077bb5d4e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr7dpl" May 21 10:42:05.477586 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:42:05.477483 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/677eaca9-1d9b-45eb-a4ea-758077bb5d4e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr7dpl\" (UID: \"677eaca9-1d9b-45eb-a4ea-758077bb5d4e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr7dpl" May 21 10:42:05.579171 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:42:05.579032 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/677eaca9-1d9b-45eb-a4ea-758077bb5d4e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr7dpl\" (UID: \"677eaca9-1d9b-45eb-a4ea-758077bb5d4e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr7dpl" May 21 10:42:05.579347 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:42:05.579182 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9mmrs\" (UniqueName: \"kubernetes.io/projected/677eaca9-1d9b-45eb-a4ea-758077bb5d4e-kube-api-access-9mmrs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr7dpl\" (UID: \"677eaca9-1d9b-45eb-a4ea-758077bb5d4e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr7dpl" May 21 10:42:05.579347 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:42:05.579221 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/677eaca9-1d9b-45eb-a4ea-758077bb5d4e-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr7dpl\" (UID: \"677eaca9-1d9b-45eb-a4ea-758077bb5d4e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr7dpl" May 21 10:42:05.579347 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:42:05.579268 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/677eaca9-1d9b-45eb-a4ea-758077bb5d4e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr7dpl\" (UID: \"677eaca9-1d9b-45eb-a4ea-758077bb5d4e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr7dpl" May 21 10:42:05.579347 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:42:05.579292 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/677eaca9-1d9b-45eb-a4ea-758077bb5d4e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr7dpl\" (UID: \"677eaca9-1d9b-45eb-a4ea-758077bb5d4e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr7dpl" May 21 10:42:05.579347 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:42:05.579315 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/677eaca9-1d9b-45eb-a4ea-758077bb5d4e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr7dpl\" (UID: \"677eaca9-1d9b-45eb-a4ea-758077bb5d4e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr7dpl" May 21 10:42:05.579628 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:42:05.579601 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/677eaca9-1d9b-45eb-a4ea-758077bb5d4e-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr7dpl\" (UID: \"677eaca9-1d9b-45eb-a4ea-758077bb5d4e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr7dpl" May 21 10:42:05.579677 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:42:05.579647 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/677eaca9-1d9b-45eb-a4ea-758077bb5d4e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr7dpl\" (UID: \"677eaca9-1d9b-45eb-a4ea-758077bb5d4e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr7dpl" May 21 10:42:05.579677 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:42:05.579671 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/677eaca9-1d9b-45eb-a4ea-758077bb5d4e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr7dpl\" (UID: \"677eaca9-1d9b-45eb-a4ea-758077bb5d4e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr7dpl" May 21 10:42:05.581331 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:42:05.581309 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/677eaca9-1d9b-45eb-a4ea-758077bb5d4e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr7dpl\" (UID: \"677eaca9-1d9b-45eb-a4ea-758077bb5d4e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr7dpl" May 21 10:42:05.581616 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:42:05.581599 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/677eaca9-1d9b-45eb-a4ea-758077bb5d4e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr7dpl\" (UID: \"677eaca9-1d9b-45eb-a4ea-758077bb5d4e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr7dpl" May 21 10:42:05.592836 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:42:05.592806 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mmrs\" (UniqueName: \"kubernetes.io/projected/677eaca9-1d9b-45eb-a4ea-758077bb5d4e-kube-api-access-9mmrs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr7dpl\" (UID: \"677eaca9-1d9b-45eb-a4ea-758077bb5d4e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr7dpl" May 21 10:42:05.633238 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:42:05.633131 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr7dpl" May 21 10:42:05.799876 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:42:05.799845 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr7dpl"] May 21 10:42:05.802032 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:42:05.801934 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod677eaca9_1d9b_45eb_a4ea_758077bb5d4e.slice/crio-167a7619899eb9cd7acd12920b667eccb43a3523c3d6d64a0fe542a0b3c699e5 WatchSource:0}: Error finding container 167a7619899eb9cd7acd12920b667eccb43a3523c3d6d64a0fe542a0b3c699e5: Status 404 returned error can't find the container with id 167a7619899eb9cd7acd12920b667eccb43a3523c3d6d64a0fe542a0b3c699e5 May 21 10:42:06.132917 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:42:06.132883 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr7dpl" event={"ID":"677eaca9-1d9b-45eb-a4ea-758077bb5d4e","Type":"ContainerStarted","Data":"167a7619899eb9cd7acd12920b667eccb43a3523c3d6d64a0fe542a0b3c699e5"} May 21 10:42:11.155566 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:42:11.155516 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr7dpl" event={"ID":"677eaca9-1d9b-45eb-a4ea-758077bb5d4e","Type":"ContainerStarted","Data":"6d58771ccb3bc5e9aee3f83c45e63285dd2da18247e7dcf5b2d00d6d32c88701"} May 21 10:42:17.180441 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:42:17.180404 2565 generic.go:358] "Generic (PLEG): container finished" podID="677eaca9-1d9b-45eb-a4ea-758077bb5d4e" containerID="6d58771ccb3bc5e9aee3f83c45e63285dd2da18247e7dcf5b2d00d6d32c88701" exitCode=0 May 21 10:42:17.181019 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:42:17.180485 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr7dpl" event={"ID":"677eaca9-1d9b-45eb-a4ea-758077bb5d4e","Type":"ContainerDied","Data":"6d58771ccb3bc5e9aee3f83c45e63285dd2da18247e7dcf5b2d00d6d32c88701"} May 21 10:42:19.191432 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:42:19.191342 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr7dpl" event={"ID":"677eaca9-1d9b-45eb-a4ea-758077bb5d4e","Type":"ContainerStarted","Data":"15898906fdb906beb965fb335e2fc36c5314efdef0e5f24f59e7eaa02a5505f9"} May 21 10:42:19.191827 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:42:19.191563 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr7dpl" May 21 10:42:19.216993 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:42:19.214582 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr7dpl" podStartSLOduration=1.109687407 podStartE2EDuration="14.214557376s" podCreationTimestamp="2026-05-21 10:42:05 +0000 UTC" firstStartedPulling="2026-05-21 10:42:05.803814381 +0000 UTC m=+718.717193432" lastFinishedPulling="2026-05-21 10:42:18.908684337 +0000 UTC m=+731.822063401" observedRunningTime="2026-05-21 10:42:19.209466174 +0000 UTC m=+732.122845266" watchObservedRunningTime="2026-05-21 10:42:19.214557376 +0000 UTC m=+732.127936446" May 21 10:42:30.208862 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:42:30.208825 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr7dpl" May 21 10:42:57.871063 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:42:57.871021 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5994999fb7-xjcsx"] May 21 10:42:57.871645 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:42:57.871315 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-5994999fb7-xjcsx" podUID="e4bfdc32-779f-42a1-87ee-d4d67afb1b39" containerName="authorino" containerID="cri-o://7b3427b88e3448584ea46dc66e1cf164e5f10e4bbd811e7a228a57dba48939a3" gracePeriod=30 May 21 10:42:58.130908 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:42:58.130844 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5994999fb7-xjcsx" May 21 10:42:58.155074 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:42:58.155041 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e4bfdc32-779f-42a1-87ee-d4d67afb1b39-tls-cert\") pod \"e4bfdc32-779f-42a1-87ee-d4d67afb1b39\" (UID: \"e4bfdc32-779f-42a1-87ee-d4d67afb1b39\") " May 21 10:42:58.155254 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:42:58.155087 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pddsk\" (UniqueName: \"kubernetes.io/projected/e4bfdc32-779f-42a1-87ee-d4d67afb1b39-kube-api-access-pddsk\") pod \"e4bfdc32-779f-42a1-87ee-d4d67afb1b39\" (UID: \"e4bfdc32-779f-42a1-87ee-d4d67afb1b39\") " May 21 10:42:58.157154 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:42:58.157124 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4bfdc32-779f-42a1-87ee-d4d67afb1b39-kube-api-access-pddsk" (OuterVolumeSpecName: "kube-api-access-pddsk") pod "e4bfdc32-779f-42a1-87ee-d4d67afb1b39" (UID: "e4bfdc32-779f-42a1-87ee-d4d67afb1b39"). InnerVolumeSpecName "kube-api-access-pddsk". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 10:42:58.165633 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:42:58.165608 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4bfdc32-779f-42a1-87ee-d4d67afb1b39-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "e4bfdc32-779f-42a1-87ee-d4d67afb1b39" (UID: "e4bfdc32-779f-42a1-87ee-d4d67afb1b39"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 10:42:58.255875 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:42:58.255844 2565 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e4bfdc32-779f-42a1-87ee-d4d67afb1b39-tls-cert\") on node \"ip-10-0-142-214.ec2.internal\" DevicePath \"\"" May 21 10:42:58.255875 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:42:58.255872 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pddsk\" (UniqueName: \"kubernetes.io/projected/e4bfdc32-779f-42a1-87ee-d4d67afb1b39-kube-api-access-pddsk\") on node \"ip-10-0-142-214.ec2.internal\" DevicePath \"\"" May 21 10:42:58.339290 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:42:58.339254 2565 generic.go:358] "Generic (PLEG): container finished" podID="e4bfdc32-779f-42a1-87ee-d4d67afb1b39" containerID="7b3427b88e3448584ea46dc66e1cf164e5f10e4bbd811e7a228a57dba48939a3" exitCode=0 May 21 10:42:58.339450 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:42:58.339304 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5994999fb7-xjcsx" May 21 10:42:58.339450 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:42:58.339334 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5994999fb7-xjcsx" event={"ID":"e4bfdc32-779f-42a1-87ee-d4d67afb1b39","Type":"ContainerDied","Data":"7b3427b88e3448584ea46dc66e1cf164e5f10e4bbd811e7a228a57dba48939a3"} May 21 10:42:58.339450 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:42:58.339372 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5994999fb7-xjcsx" event={"ID":"e4bfdc32-779f-42a1-87ee-d4d67afb1b39","Type":"ContainerDied","Data":"dcdd50c4fda2ded1fb52461f559ebf53162911e34a37cbb26f36f231d6d47c93"} May 21 10:42:58.339450 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:42:58.339388 2565 scope.go:117] "RemoveContainer" containerID="7b3427b88e3448584ea46dc66e1cf164e5f10e4bbd811e7a228a57dba48939a3" May 21 10:42:58.349040 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:42:58.349018 2565 scope.go:117] "RemoveContainer" containerID="7b3427b88e3448584ea46dc66e1cf164e5f10e4bbd811e7a228a57dba48939a3" May 21 10:42:58.349278 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:42:58.349257 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b3427b88e3448584ea46dc66e1cf164e5f10e4bbd811e7a228a57dba48939a3\": container with ID starting with 7b3427b88e3448584ea46dc66e1cf164e5f10e4bbd811e7a228a57dba48939a3 not found: ID does not exist" containerID="7b3427b88e3448584ea46dc66e1cf164e5f10e4bbd811e7a228a57dba48939a3" May 21 10:42:58.349347 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:42:58.349292 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b3427b88e3448584ea46dc66e1cf164e5f10e4bbd811e7a228a57dba48939a3"} err="failed to get container status \"7b3427b88e3448584ea46dc66e1cf164e5f10e4bbd811e7a228a57dba48939a3\": rpc error: code = NotFound desc = could not find container \"7b3427b88e3448584ea46dc66e1cf164e5f10e4bbd811e7a228a57dba48939a3\": container with ID starting with 7b3427b88e3448584ea46dc66e1cf164e5f10e4bbd811e7a228a57dba48939a3 not found: ID does not exist" May 21 10:42:58.368614 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:42:58.368569 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5994999fb7-xjcsx"] May 21 10:42:58.370619 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:42:58.370599 2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5994999fb7-xjcsx"] May 21 10:42:59.637158 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:42:59.637126 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4bfdc32-779f-42a1-87ee-d4d67afb1b39" path="/var/lib/kubelet/pods/e4bfdc32-779f-42a1-87ee-d4d67afb1b39/volumes" May 21 10:43:09.726979 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:43:09.726923 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-42pzh"] May 21 10:43:09.727563 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:43:09.727544 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4bfdc32-779f-42a1-87ee-d4d67afb1b39" containerName="authorino" May 21 10:43:09.727563 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:43:09.727564 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4bfdc32-779f-42a1-87ee-d4d67afb1b39" containerName="authorino" May 21 10:43:09.727709 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:43:09.727696 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="e4bfdc32-779f-42a1-87ee-d4d67afb1b39" containerName="authorino" May 21 10:43:09.732493 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:43:09.732469 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-42pzh" May 21 10:43:09.735151 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:43:09.735125 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" May 21 10:43:09.739762 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:43:09.739736 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-42pzh"] May 21 10:43:09.751056 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:43:09.751029 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/89f5d310-6441-463d-a1e9-fabee35386e4-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-42pzh\" (UID: \"89f5d310-6441-463d-a1e9-fabee35386e4\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-42pzh" May 21 10:43:09.751167 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:43:09.751067 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/89f5d310-6441-463d-a1e9-fabee35386e4-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-42pzh\" (UID: \"89f5d310-6441-463d-a1e9-fabee35386e4\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-42pzh" May 21 10:43:09.751167 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:43:09.751100 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/89f5d310-6441-463d-a1e9-fabee35386e4-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-42pzh\" (UID: \"89f5d310-6441-463d-a1e9-fabee35386e4\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-42pzh" May 21 10:43:09.751276 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:43:09.751235 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/89f5d310-6441-463d-a1e9-fabee35386e4-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-42pzh\" (UID: \"89f5d310-6441-463d-a1e9-fabee35386e4\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-42pzh" May 21 10:43:09.751320 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:43:09.751299 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5j525\" (UniqueName: \"kubernetes.io/projected/89f5d310-6441-463d-a1e9-fabee35386e4-kube-api-access-5j525\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-42pzh\" (UID: \"89f5d310-6441-463d-a1e9-fabee35386e4\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-42pzh" May 21 10:43:09.751355 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:43:09.751338 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/89f5d310-6441-463d-a1e9-fabee35386e4-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-42pzh\" (UID: \"89f5d310-6441-463d-a1e9-fabee35386e4\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-42pzh" May 21 10:43:09.852489 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:43:09.852452 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/89f5d310-6441-463d-a1e9-fabee35386e4-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-42pzh\" (UID: \"89f5d310-6441-463d-a1e9-fabee35386e4\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-42pzh" May 21 10:43:09.852489 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:43:09.852497 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/89f5d310-6441-463d-a1e9-fabee35386e4-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-42pzh\" (UID: \"89f5d310-6441-463d-a1e9-fabee35386e4\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-42pzh" May 21 10:43:09.852743 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:43:09.852526 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/89f5d310-6441-463d-a1e9-fabee35386e4-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-42pzh\" (UID: \"89f5d310-6441-463d-a1e9-fabee35386e4\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-42pzh" May 21 10:43:09.852743 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:43:09.852593 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/89f5d310-6441-463d-a1e9-fabee35386e4-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-42pzh\" (UID: \"89f5d310-6441-463d-a1e9-fabee35386e4\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-42pzh" May 21 10:43:09.852743 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:43:09.852617 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5j525\" (UniqueName: \"kubernetes.io/projected/89f5d310-6441-463d-a1e9-fabee35386e4-kube-api-access-5j525\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-42pzh\" (UID: \"89f5d310-6441-463d-a1e9-fabee35386e4\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-42pzh" May 21 10:43:09.852743 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:43:09.852648 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/89f5d310-6441-463d-a1e9-fabee35386e4-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-42pzh\" (UID: \"89f5d310-6441-463d-a1e9-fabee35386e4\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-42pzh" May 21 10:43:09.852977 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:43:09.852920 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/89f5d310-6441-463d-a1e9-fabee35386e4-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-42pzh\" (UID: \"89f5d310-6441-463d-a1e9-fabee35386e4\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-42pzh" May 21 10:43:09.853109 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:43:09.853086 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/89f5d310-6441-463d-a1e9-fabee35386e4-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-42pzh\" (UID: \"89f5d310-6441-463d-a1e9-fabee35386e4\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-42pzh" May 21 10:43:09.853210 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:43:09.853144 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/89f5d310-6441-463d-a1e9-fabee35386e4-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-42pzh\" (UID: \"89f5d310-6441-463d-a1e9-fabee35386e4\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-42pzh" May 21 10:43:09.854976 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:43:09.854921 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/89f5d310-6441-463d-a1e9-fabee35386e4-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-42pzh\" (UID: \"89f5d310-6441-463d-a1e9-fabee35386e4\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-42pzh" May 21 10:43:09.855180 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:43:09.855161 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/89f5d310-6441-463d-a1e9-fabee35386e4-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-42pzh\" (UID: \"89f5d310-6441-463d-a1e9-fabee35386e4\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-42pzh" May 21 10:43:09.860513 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:43:09.860490 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5j525\" (UniqueName: \"kubernetes.io/projected/89f5d310-6441-463d-a1e9-fabee35386e4-kube-api-access-5j525\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-42pzh\" (UID: \"89f5d310-6441-463d-a1e9-fabee35386e4\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-42pzh" May 21 10:43:10.045402 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:43:10.045293 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-42pzh" May 21 10:43:10.189065 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:43:10.189038 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-42pzh"] May 21 10:43:10.191051 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:43:10.191020 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89f5d310_6441_463d_a1e9_fabee35386e4.slice/crio-0a3b03d52ff813622a2d69f1c88a3f5530083a51c723242e034b548927e05bc9 WatchSource:0}: Error finding container 0a3b03d52ff813622a2d69f1c88a3f5530083a51c723242e034b548927e05bc9: Status 404 returned error can't find the container with id 0a3b03d52ff813622a2d69f1c88a3f5530083a51c723242e034b548927e05bc9 May 21 10:43:10.394197 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:43:10.394160 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-42pzh" event={"ID":"89f5d310-6441-463d-a1e9-fabee35386e4","Type":"ContainerStarted","Data":"64c2f76176d25b75211f34838bd194166c45a665dbb40c041af3bfcc1e39f2e9"} May 21 10:43:10.394197 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:43:10.394198 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-42pzh" event={"ID":"89f5d310-6441-463d-a1e9-fabee35386e4","Type":"ContainerStarted","Data":"0a3b03d52ff813622a2d69f1c88a3f5530083a51c723242e034b548927e05bc9"} May 21 10:43:16.418973 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:43:16.418923 2565 generic.go:358] "Generic (PLEG): container finished" podID="89f5d310-6441-463d-a1e9-fabee35386e4" containerID="64c2f76176d25b75211f34838bd194166c45a665dbb40c041af3bfcc1e39f2e9" exitCode=0 May 21 10:43:16.419380 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:43:16.418996 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-42pzh" event={"ID":"89f5d310-6441-463d-a1e9-fabee35386e4","Type":"ContainerDied","Data":"64c2f76176d25b75211f34838bd194166c45a665dbb40c041af3bfcc1e39f2e9"} May 21 10:43:20.436177 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:43:20.436142 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-42pzh" event={"ID":"89f5d310-6441-463d-a1e9-fabee35386e4","Type":"ContainerStarted","Data":"05fb135a3584cb861f68fd19880a196427e02287acaf4cb115de4c68d8e763f3"} May 21 10:43:20.436651 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:43:20.436371 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-42pzh" May 21 10:43:20.461831 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:43:20.461775 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-42pzh" podStartSLOduration=8.474481734 podStartE2EDuration="11.461760906s" podCreationTimestamp="2026-05-21 10:43:09 +0000 UTC" firstStartedPulling="2026-05-21 10:43:16.419670888 +0000 UTC m=+789.333049936" lastFinishedPulling="2026-05-21 10:43:19.406950046 +0000 UTC m=+792.320329108" observedRunningTime="2026-05-21 10:43:20.459193834 +0000 UTC m=+793.372572903" watchObservedRunningTime="2026-05-21 10:43:20.461760906 +0000 UTC m=+793.375139975" May 21 10:43:31.454336 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:43:31.454249 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-42pzh" May 21 10:44:25.638130 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:44:25.638099 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-86c469d6c7-7wjb8"] May 21 10:44:25.638644 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:44:25.638344 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-86c469d6c7-7wjb8" podUID="75585b77-4e36-4987-b371-0e26f79dbbfc" containerName="manager" containerID="cri-o://16a29160dcccfb747db54625ad5c67d434d2fbb9cefb441c0a203195fee82b02" gracePeriod=30 May 21 10:44:25.890877 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:44:25.890810 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86c469d6c7-7wjb8" May 21 10:44:26.057696 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:44:26.057655 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ql6wp\" (UniqueName: \"kubernetes.io/projected/75585b77-4e36-4987-b371-0e26f79dbbfc-kube-api-access-ql6wp\") pod \"75585b77-4e36-4987-b371-0e26f79dbbfc\" (UID: \"75585b77-4e36-4987-b371-0e26f79dbbfc\") " May 21 10:44:26.059779 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:44:26.059756 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75585b77-4e36-4987-b371-0e26f79dbbfc-kube-api-access-ql6wp" (OuterVolumeSpecName: "kube-api-access-ql6wp") pod "75585b77-4e36-4987-b371-0e26f79dbbfc" (UID: "75585b77-4e36-4987-b371-0e26f79dbbfc"). InnerVolumeSpecName "kube-api-access-ql6wp". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 10:44:26.159212 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:44:26.159125 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ql6wp\" (UniqueName: \"kubernetes.io/projected/75585b77-4e36-4987-b371-0e26f79dbbfc-kube-api-access-ql6wp\") on node \"ip-10-0-142-214.ec2.internal\" DevicePath \"\"" May 21 10:44:26.704252 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:44:26.704213 2565 generic.go:358] "Generic (PLEG): container finished" podID="75585b77-4e36-4987-b371-0e26f79dbbfc" containerID="16a29160dcccfb747db54625ad5c67d434d2fbb9cefb441c0a203195fee82b02" exitCode=0 May 21 10:44:26.704725 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:44:26.704280 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86c469d6c7-7wjb8" May 21 10:44:26.704725 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:44:26.704299 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86c469d6c7-7wjb8" event={"ID":"75585b77-4e36-4987-b371-0e26f79dbbfc","Type":"ContainerDied","Data":"16a29160dcccfb747db54625ad5c67d434d2fbb9cefb441c0a203195fee82b02"} May 21 10:44:26.704725 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:44:26.704334 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86c469d6c7-7wjb8" event={"ID":"75585b77-4e36-4987-b371-0e26f79dbbfc","Type":"ContainerDied","Data":"28c31fa5973c984299b13b730a1191fb22bc917bf06a849cb7a7b62aa8d7c5f4"} May 21 10:44:26.704725 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:44:26.704351 2565 scope.go:117] "RemoveContainer" containerID="16a29160dcccfb747db54625ad5c67d434d2fbb9cefb441c0a203195fee82b02" May 21 10:44:26.712906 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:44:26.712892 2565 scope.go:117] "RemoveContainer" containerID="16a29160dcccfb747db54625ad5c67d434d2fbb9cefb441c0a203195fee82b02" May 21 10:44:26.713172 ip-10-0-142-214 kubenswrapper[2565]: E0521 10:44:26.713152 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16a29160dcccfb747db54625ad5c67d434d2fbb9cefb441c0a203195fee82b02\": container with ID starting with 16a29160dcccfb747db54625ad5c67d434d2fbb9cefb441c0a203195fee82b02 not found: ID does not exist" containerID="16a29160dcccfb747db54625ad5c67d434d2fbb9cefb441c0a203195fee82b02" May 21 10:44:26.713231 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:44:26.713182 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16a29160dcccfb747db54625ad5c67d434d2fbb9cefb441c0a203195fee82b02"} err="failed to get container status \"16a29160dcccfb747db54625ad5c67d434d2fbb9cefb441c0a203195fee82b02\": rpc error: code = NotFound desc = could not find container \"16a29160dcccfb747db54625ad5c67d434d2fbb9cefb441c0a203195fee82b02\": container with ID starting with 16a29160dcccfb747db54625ad5c67d434d2fbb9cefb441c0a203195fee82b02 not found: ID does not exist" May 21 10:44:26.725118 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:44:26.725095 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-86c469d6c7-7wjb8"] May 21 10:44:26.728845 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:44:26.728820 2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-86c469d6c7-7wjb8"] May 21 10:44:27.441903 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:44:27.441860 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-86c469d6c7-6k7xv"] May 21 10:44:27.442365 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:44:27.442345 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75585b77-4e36-4987-b371-0e26f79dbbfc" containerName="manager" May 21 10:44:27.442468 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:44:27.442367 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="75585b77-4e36-4987-b371-0e26f79dbbfc" containerName="manager" May 21 10:44:27.442525 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:44:27.442491 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="75585b77-4e36-4987-b371-0e26f79dbbfc" containerName="manager" May 21 10:44:27.446846 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:44:27.446823 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86c469d6c7-6k7xv" May 21 10:44:27.452389 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:44:27.452368 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-z85sc\"" May 21 10:44:27.457263 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:44:27.457241 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-86c469d6c7-6k7xv"] May 21 10:44:27.573905 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:44:27.573864 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzlcv\" (UniqueName: \"kubernetes.io/projected/8d5016b0-2e65-4c0b-a0e0-a5db4e3412ce-kube-api-access-xzlcv\") pod \"maas-controller-86c469d6c7-6k7xv\" (UID: \"8d5016b0-2e65-4c0b-a0e0-a5db4e3412ce\") " pod="opendatahub/maas-controller-86c469d6c7-6k7xv" May 21 10:44:27.636417 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:44:27.636384 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75585b77-4e36-4987-b371-0e26f79dbbfc" path="/var/lib/kubelet/pods/75585b77-4e36-4987-b371-0e26f79dbbfc/volumes" May 21 10:44:27.675269 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:44:27.675229 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xzlcv\" (UniqueName: \"kubernetes.io/projected/8d5016b0-2e65-4c0b-a0e0-a5db4e3412ce-kube-api-access-xzlcv\") pod \"maas-controller-86c469d6c7-6k7xv\" (UID: \"8d5016b0-2e65-4c0b-a0e0-a5db4e3412ce\") " pod="opendatahub/maas-controller-86c469d6c7-6k7xv" May 21 10:44:27.684625 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:44:27.684595 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzlcv\" (UniqueName: \"kubernetes.io/projected/8d5016b0-2e65-4c0b-a0e0-a5db4e3412ce-kube-api-access-xzlcv\") pod \"maas-controller-86c469d6c7-6k7xv\" (UID: \"8d5016b0-2e65-4c0b-a0e0-a5db4e3412ce\") " pod="opendatahub/maas-controller-86c469d6c7-6k7xv" May 21 10:44:27.758331 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:44:27.758227 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86c469d6c7-6k7xv" May 21 10:44:27.917552 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:44:27.917522 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-86c469d6c7-6k7xv"] May 21 10:44:27.919979 ip-10-0-142-214 kubenswrapper[2565]: W0521 10:44:27.919899 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d5016b0_2e65_4c0b_a0e0_a5db4e3412ce.slice/crio-f3c747fd83b34706b667e1b61afbcdf85a3269cbad0372f7a2c4d76f8628899e WatchSource:0}: Error finding container f3c747fd83b34706b667e1b61afbcdf85a3269cbad0372f7a2c4d76f8628899e: Status 404 returned error can't find the container with id f3c747fd83b34706b667e1b61afbcdf85a3269cbad0372f7a2c4d76f8628899e May 21 10:44:28.714423 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:44:28.714311 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86c469d6c7-6k7xv" event={"ID":"8d5016b0-2e65-4c0b-a0e0-a5db4e3412ce","Type":"ContainerStarted","Data":"00dd9452f9046141f6b75cb8a0c848fc24d037bd60ffb42ce8bf03c0fa9b2f77"} May 21 10:44:28.714423 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:44:28.714359 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86c469d6c7-6k7xv" event={"ID":"8d5016b0-2e65-4c0b-a0e0-a5db4e3412ce","Type":"ContainerStarted","Data":"f3c747fd83b34706b667e1b61afbcdf85a3269cbad0372f7a2c4d76f8628899e"} May 21 10:44:28.714628 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:44:28.714430 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-86c469d6c7-6k7xv" May 21 10:44:28.731180 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:44:28.731125 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-86c469d6c7-6k7xv" podStartSLOduration=1.335126432 podStartE2EDuration="1.731110167s" podCreationTimestamp="2026-05-21 10:44:27 +0000 UTC" firstStartedPulling="2026-05-21 10:44:27.921195477 +0000 UTC m=+860.834574528" lastFinishedPulling="2026-05-21 10:44:28.317179202 +0000 UTC m=+861.230558263" observedRunningTime="2026-05-21 10:44:28.730210715 +0000 UTC m=+861.643589786" watchObservedRunningTime="2026-05-21 10:44:28.731110167 +0000 UTC m=+861.644489237" May 21 10:44:39.724679 ip-10-0-142-214 kubenswrapper[2565]: I0521 10:44:39.724642 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-86c469d6c7-6k7xv" May 21 11:05:43.408235 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:05:43.408178 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6bc5667487-5fsl4_ff845d71-a746-477f-b629-f2f37073e6e6/maas-api/0.log" May 21 11:05:43.733643 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:05:43.733561 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-86c469d6c7-6k7xv_8d5016b0-2e65-4c0b-a0e0-a5db4e3412ce/manager/0.log" May 21 11:05:43.960444 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:05:43.960408 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5fc5c76ccc-4x6p8_8792aeb4-d72b-410e-8692-02a3b7cb0f5c/manager/0.log" May 21 11:05:45.054888 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:05:45.054854 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598g8rp_d0be0f23-40f8-443a-93e3-e2949d565db9/util/0.log" May 21 11:05:45.062376 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:05:45.062346 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598g8rp_d0be0f23-40f8-443a-93e3-e2949d565db9/pull/0.log" May 21 11:05:45.072808 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:05:45.072782 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598g8rp_d0be0f23-40f8-443a-93e3-e2949d565db9/extract/0.log" May 21 11:05:45.183474 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:05:45.183445 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h5xbw_fc035aa4-6724-4b90-a9c3-2bf5bb0eab58/util/0.log" May 21 11:05:45.189891 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:05:45.189866 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h5xbw_fc035aa4-6724-4b90-a9c3-2bf5bb0eab58/pull/0.log" May 21 11:05:45.196312 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:05:45.196293 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h5xbw_fc035aa4-6724-4b90-a9c3-2bf5bb0eab58/extract/0.log" May 21 11:05:45.306124 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:05:45.306047 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d59rj_97ddb0d6-6040-43f0-a69c-606c977c478b/util/0.log" May 21 11:05:45.312780 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:05:45.312755 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d59rj_97ddb0d6-6040-43f0-a69c-606c977c478b/pull/0.log" May 21 11:05:45.319064 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:05:45.319045 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d59rj_97ddb0d6-6040-43f0-a69c-606c977c478b/extract/0.log" May 21 11:05:45.774888 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:05:45.774855 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-d5wlm_321ad3f6-0db3-4369-8b84-2a20edc155e6/manager/0.log" May 21 11:05:45.880151 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:05:45.880120 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-rwbc6_63fa1aae-ab78-4484-9e7a-144ac0e1933d/kuadrant-console-plugin/0.log" May 21 11:05:46.331900 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:05:46.331862 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-pg8hk_5a3ac120-4735-48d2-9c93-b4d746ea5148/manager/0.log" May 21 11:05:46.660851 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:05:46.660769 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-595b7776f8hst4b_d3677da8-2d2c-4577-beb7-dbc8a652094e/istio-proxy/0.log" May 21 11:05:47.104557 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:05:47.104525 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7df95f575-v5vhc_cb76dca8-1607-4c1b-ac5d-7611a7794b05/istio-proxy/0.log" May 21 11:05:47.214073 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:05:47.214043 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-zcvlk_5a42e9b9-f6ed-4bd7-8e32-284434a150b7/payload-processing/0.log" May 21 11:05:47.324821 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:05:47.324794 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5546c4f488-zdc6s_2714d3c9-b9b4-4905-88df-0ddd2e25c008/router/0.log" May 21 11:05:47.882815 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:05:47.882791 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-42pzh_89f5d310-6441-463d-a1e9-fabee35386e4/storage-initializer/0.log" May 21 11:05:47.889886 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:05:47.889865 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-42pzh_89f5d310-6441-463d-a1e9-fabee35386e4/main/0.log" May 21 11:05:47.998159 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:05:47.998131 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr7dpl_677eaca9-1d9b-45eb-a4ea-758077bb5d4e/storage-initializer/0.log" May 21 11:05:48.004821 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:05:48.004793 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr7dpl_677eaca9-1d9b-45eb-a4ea-758077bb5d4e/main/0.log" May 21 11:05:55.569118 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:05:55.569085 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8f7qb_c5972469-00d2-4517-ba14-6672a94436d7/global-pull-secret-syncer/0.log" May 21 11:05:55.700146 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:05:55.700111 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-n9txr_c9e91e4e-88b6-4364-8536-e995ba46046c/konnectivity-agent/0.log" May 21 11:05:55.790276 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:05:55.790242 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-214.ec2.internal_84135066f8c765a27568c2cb628cbfb6/haproxy/0.log" May 21 11:05:59.530988 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:05:59.530959 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598g8rp_d0be0f23-40f8-443a-93e3-e2949d565db9/extract/0.log" May 21 11:05:59.561982 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:05:59.561934 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598g8rp_d0be0f23-40f8-443a-93e3-e2949d565db9/util/0.log" May 21 11:05:59.604753 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:05:59.604726 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598g8rp_d0be0f23-40f8-443a-93e3-e2949d565db9/pull/0.log" May 21 11:05:59.636265 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:05:59.636227 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h5xbw_fc035aa4-6724-4b90-a9c3-2bf5bb0eab58/extract/0.log" May 21 11:05:59.665672 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:05:59.665643 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h5xbw_fc035aa4-6724-4b90-a9c3-2bf5bb0eab58/util/0.log" May 21 11:05:59.694804 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:05:59.694773 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h5xbw_fc035aa4-6724-4b90-a9c3-2bf5bb0eab58/pull/0.log" May 21 11:05:59.727272 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:05:59.727236 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d59rj_97ddb0d6-6040-43f0-a69c-606c977c478b/extract/0.log" May 21 11:05:59.758525 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:05:59.758497 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d59rj_97ddb0d6-6040-43f0-a69c-606c977c478b/util/0.log" May 21 11:05:59.784078 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:05:59.784051 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d59rj_97ddb0d6-6040-43f0-a69c-606c977c478b/pull/0.log" May 21 11:06:00.160888 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:00.160859 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-d5wlm_321ad3f6-0db3-4369-8b84-2a20edc155e6/manager/0.log" May 21 11:06:00.197520 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:00.197489 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-rwbc6_63fa1aae-ab78-4484-9e7a-144ac0e1933d/kuadrant-console-plugin/0.log" May 21 11:06:00.442551 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:00.442467 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-pg8hk_5a3ac120-4735-48d2-9c93-b4d746ea5148/manager/0.log" May 21 11:06:01.972637 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:01.972582 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_06722450-040f-47b8-ace4-68e8134bfa9d/alertmanager/0.log" May 21 11:06:01.995615 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:01.995585 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_06722450-040f-47b8-ace4-68e8134bfa9d/config-reloader/0.log" May 21 11:06:02.018795 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:02.018766 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_06722450-040f-47b8-ace4-68e8134bfa9d/kube-rbac-proxy-web/0.log" May 21 11:06:02.041477 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:02.041397 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_06722450-040f-47b8-ace4-68e8134bfa9d/kube-rbac-proxy/0.log" May 21 11:06:02.069357 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:02.069331 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_06722450-040f-47b8-ace4-68e8134bfa9d/kube-rbac-proxy-metric/0.log" May 21 11:06:02.093303 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:02.093272 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_06722450-040f-47b8-ace4-68e8134bfa9d/prom-label-proxy/0.log" May 21 11:06:02.116399 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:02.116371 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_06722450-040f-47b8-ace4-68e8134bfa9d/init-config-reloader/0.log" May 21 11:06:02.411631 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:02.411599 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-q44qc_4e58fb5d-ddc2-489e-ab5d-d7ee49f51750/node-exporter/0.log" May 21 11:06:02.430926 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:02.430900 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-q44qc_4e58fb5d-ddc2-489e-ab5d-d7ee49f51750/kube-rbac-proxy/0.log" May 21 11:06:02.452315 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:02.452287 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-q44qc_4e58fb5d-ddc2-489e-ab5d-d7ee49f51750/init-textfile/0.log" May 21 11:06:02.558178 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:02.558152 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-zrdzr_00a00434-c44c-4e86-9e0c-857966a8b08d/kube-rbac-proxy-main/0.log" May 21 11:06:02.579098 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:02.579073 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-zrdzr_00a00434-c44c-4e86-9e0c-857966a8b08d/kube-rbac-proxy-self/0.log" May 21 11:06:02.601999 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:02.601973 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-zrdzr_00a00434-c44c-4e86-9e0c-857966a8b08d/openshift-state-metrics/0.log" May 21 11:06:02.897632 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:02.897591 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-r8llm_28424576-00fd-4711-96a3-63a112c70ee8/prometheus-operator-admission-webhook/0.log" May 21 11:06:02.936779 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:02.936754 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5448ccd757-f4bf4_e88421ce-3e27-4298-9045-5b5634695b5e/telemeter-client/0.log" May 21 11:06:02.964034 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:02.964009 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5448ccd757-f4bf4_e88421ce-3e27-4298-9045-5b5634695b5e/reload/0.log" May 21 11:06:02.989698 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:02.989666 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5448ccd757-f4bf4_e88421ce-3e27-4298-9045-5b5634695b5e/kube-rbac-proxy/0.log" May 21 11:06:03.022276 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:03.022246 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d94ffccc-wxpld_5a6283b1-365e-4c49-bfd8-f283b1926bbd/thanos-query/0.log" May 21 11:06:03.043926 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:03.043895 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d94ffccc-wxpld_5a6283b1-365e-4c49-bfd8-f283b1926bbd/kube-rbac-proxy-web/0.log" May 21 11:06:03.066382 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:03.066356 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d94ffccc-wxpld_5a6283b1-365e-4c49-bfd8-f283b1926bbd/kube-rbac-proxy/0.log" May 21 11:06:03.094927 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:03.094898 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d94ffccc-wxpld_5a6283b1-365e-4c49-bfd8-f283b1926bbd/prom-label-proxy/0.log" May 21 11:06:03.116625 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:03.116598 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d94ffccc-wxpld_5a6283b1-365e-4c49-bfd8-f283b1926bbd/kube-rbac-proxy-rules/0.log" May 21 11:06:03.167516 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:03.167442 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d94ffccc-wxpld_5a6283b1-365e-4c49-bfd8-f283b1926bbd/kube-rbac-proxy-metrics/0.log" May 21 11:06:04.479641 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:04.479602 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-sjg6n/perf-node-gather-daemonset-4zklj"] May 21 11:06:04.484041 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:04.484015 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sjg6n/perf-node-gather-daemonset-4zklj" May 21 11:06:04.486671 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:04.486647 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-sjg6n\"/\"default-dockercfg-cs654\"" May 21 11:06:04.488130 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:04.488105 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sjg6n\"/\"kube-root-ca.crt\"" May 21 11:06:04.488468 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:04.488449 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sjg6n\"/\"openshift-service-ca.crt\"" May 21 11:06:04.494085 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:04.494040 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sjg6n/perf-node-gather-daemonset-4zklj"] May 21 11:06:04.559845 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:04.559799 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ab76c25f-d85d-4f66-9a68-06c7b9c80f3c-sys\") pod \"perf-node-gather-daemonset-4zklj\" (UID: \"ab76c25f-d85d-4f66-9a68-06c7b9c80f3c\") " pod="openshift-must-gather-sjg6n/perf-node-gather-daemonset-4zklj" May 21 11:06:04.559845 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:04.559841 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ab76c25f-d85d-4f66-9a68-06c7b9c80f3c-proc\") pod \"perf-node-gather-daemonset-4zklj\" (UID: \"ab76c25f-d85d-4f66-9a68-06c7b9c80f3c\") " pod="openshift-must-gather-sjg6n/perf-node-gather-daemonset-4zklj" May 21 11:06:04.560115 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:04.559875 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ab76c25f-d85d-4f66-9a68-06c7b9c80f3c-podres\") pod \"perf-node-gather-daemonset-4zklj\" (UID: \"ab76c25f-d85d-4f66-9a68-06c7b9c80f3c\") " pod="openshift-must-gather-sjg6n/perf-node-gather-daemonset-4zklj" May 21 11:06:04.560115 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:04.559898 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pp82\" (UniqueName: \"kubernetes.io/projected/ab76c25f-d85d-4f66-9a68-06c7b9c80f3c-kube-api-access-8pp82\") pod \"perf-node-gather-daemonset-4zklj\" (UID: \"ab76c25f-d85d-4f66-9a68-06c7b9c80f3c\") " pod="openshift-must-gather-sjg6n/perf-node-gather-daemonset-4zklj" May 21 11:06:04.560115 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:04.559931 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ab76c25f-d85d-4f66-9a68-06c7b9c80f3c-lib-modules\") pod \"perf-node-gather-daemonset-4zklj\" (UID: \"ab76c25f-d85d-4f66-9a68-06c7b9c80f3c\") " pod="openshift-must-gather-sjg6n/perf-node-gather-daemonset-4zklj" May 21 11:06:04.661222 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:04.661181 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ab76c25f-d85d-4f66-9a68-06c7b9c80f3c-sys\") pod \"perf-node-gather-daemonset-4zklj\" (UID: \"ab76c25f-d85d-4f66-9a68-06c7b9c80f3c\") " pod="openshift-must-gather-sjg6n/perf-node-gather-daemonset-4zklj" May 21 11:06:04.661222 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:04.661223 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ab76c25f-d85d-4f66-9a68-06c7b9c80f3c-proc\") pod \"perf-node-gather-daemonset-4zklj\" (UID: \"ab76c25f-d85d-4f66-9a68-06c7b9c80f3c\") " pod="openshift-must-gather-sjg6n/perf-node-gather-daemonset-4zklj" May 21 11:06:04.661415 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:04.661269 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ab76c25f-d85d-4f66-9a68-06c7b9c80f3c-podres\") pod \"perf-node-gather-daemonset-4zklj\" (UID: \"ab76c25f-d85d-4f66-9a68-06c7b9c80f3c\") " pod="openshift-must-gather-sjg6n/perf-node-gather-daemonset-4zklj" May 21 11:06:04.661415 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:04.661305 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8pp82\" (UniqueName: \"kubernetes.io/projected/ab76c25f-d85d-4f66-9a68-06c7b9c80f3c-kube-api-access-8pp82\") pod \"perf-node-gather-daemonset-4zklj\" (UID: \"ab76c25f-d85d-4f66-9a68-06c7b9c80f3c\") " pod="openshift-must-gather-sjg6n/perf-node-gather-daemonset-4zklj" May 21 11:06:04.661415 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:04.661308 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ab76c25f-d85d-4f66-9a68-06c7b9c80f3c-sys\") pod \"perf-node-gather-daemonset-4zklj\" (UID: \"ab76c25f-d85d-4f66-9a68-06c7b9c80f3c\") " pod="openshift-must-gather-sjg6n/perf-node-gather-daemonset-4zklj" May 21 11:06:04.661415 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:04.661353 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ab76c25f-d85d-4f66-9a68-06c7b9c80f3c-proc\") pod \"perf-node-gather-daemonset-4zklj\" (UID: \"ab76c25f-d85d-4f66-9a68-06c7b9c80f3c\") " pod="openshift-must-gather-sjg6n/perf-node-gather-daemonset-4zklj" May 21 11:06:04.661415 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:04.661367 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ab76c25f-d85d-4f66-9a68-06c7b9c80f3c-lib-modules\") pod \"perf-node-gather-daemonset-4zklj\" (UID: \"ab76c25f-d85d-4f66-9a68-06c7b9c80f3c\") " pod="openshift-must-gather-sjg6n/perf-node-gather-daemonset-4zklj" May 21 11:06:04.661415 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:04.661410 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ab76c25f-d85d-4f66-9a68-06c7b9c80f3c-podres\") pod \"perf-node-gather-daemonset-4zklj\" (UID: \"ab76c25f-d85d-4f66-9a68-06c7b9c80f3c\") " pod="openshift-must-gather-sjg6n/perf-node-gather-daemonset-4zklj" May 21 11:06:04.661625 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:04.661471 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ab76c25f-d85d-4f66-9a68-06c7b9c80f3c-lib-modules\") pod \"perf-node-gather-daemonset-4zklj\" (UID: \"ab76c25f-d85d-4f66-9a68-06c7b9c80f3c\") " pod="openshift-must-gather-sjg6n/perf-node-gather-daemonset-4zklj" May 21 11:06:04.670478 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:04.670451 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pp82\" (UniqueName: \"kubernetes.io/projected/ab76c25f-d85d-4f66-9a68-06c7b9c80f3c-kube-api-access-8pp82\") pod \"perf-node-gather-daemonset-4zklj\" (UID: \"ab76c25f-d85d-4f66-9a68-06c7b9c80f3c\") " pod="openshift-must-gather-sjg6n/perf-node-gather-daemonset-4zklj" May 21 11:06:04.800704 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:04.800606 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sjg6n/perf-node-gather-daemonset-4zklj" May 21 11:06:04.942750 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:04.942724 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sjg6n/perf-node-gather-daemonset-4zklj"] May 21 11:06:04.944360 ip-10-0-142-214 kubenswrapper[2565]: W0521 11:06:04.944338 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podab76c25f_d85d_4f66_9a68_06c7b9c80f3c.slice/crio-7febef616d92ed18d22e41f4b1635fdc0f2a428d3106cd99aceb51833b0364b8 WatchSource:0}: Error finding container 7febef616d92ed18d22e41f4b1635fdc0f2a428d3106cd99aceb51833b0364b8: Status 404 returned error can't find the container with id 7febef616d92ed18d22e41f4b1635fdc0f2a428d3106cd99aceb51833b0364b8 May 21 11:06:04.946006 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:04.945991 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 11:06:05.297297 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:05.297268 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5f4949c944-j6vbh_32bfa319-a2ea-470a-8637-4a2230a772ea/console/0.log" May 21 11:06:05.738688 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:05.738654 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sjg6n/perf-node-gather-daemonset-4zklj" event={"ID":"ab76c25f-d85d-4f66-9a68-06c7b9c80f3c","Type":"ContainerStarted","Data":"0e8e5e26dc2efe375c46b49f83bf1785d88ef716517ea1bc03eefc903d197442"} May 21 11:06:05.738688 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:05.738689 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sjg6n/perf-node-gather-daemonset-4zklj" event={"ID":"ab76c25f-d85d-4f66-9a68-06c7b9c80f3c","Type":"ContainerStarted","Data":"7febef616d92ed18d22e41f4b1635fdc0f2a428d3106cd99aceb51833b0364b8"} May 21 11:06:05.739152 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:05.738778 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-sjg6n/perf-node-gather-daemonset-4zklj" May 21 11:06:05.755947 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:05.755877 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-sjg6n/perf-node-gather-daemonset-4zklj" podStartSLOduration=1.755861913 podStartE2EDuration="1.755861913s" podCreationTimestamp="2026-05-21 11:06:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 11:06:05.753056798 +0000 UTC m=+2158.666435870" watchObservedRunningTime="2026-05-21 11:06:05.755861913 +0000 UTC m=+2158.669240983" May 21 11:06:05.889534 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:05.889508 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-kfvw2_8e73c6a9-cff0-4599-ada0-33846ca2a332/volume-data-source-validator/0.log" May 21 11:06:06.672863 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:06.672829 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2z5ml_136577a1-cdb0-4499-8f87-5c04dbd94f14/dns/0.log" May 21 11:06:06.692166 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:06.692142 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2z5ml_136577a1-cdb0-4499-8f87-5c04dbd94f14/kube-rbac-proxy/0.log" May 21 11:06:06.831831 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:06.831802 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ml6nr_f4a6b193-47ea-4a0e-b63a-3dd25c6aab85/dns-node-resolver/0.log" May 21 11:06:07.392579 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:07.392551 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xgzdb_8d7bae5e-e157-4bde-8a8c-e82e63427b92/node-ca/0.log" May 21 11:06:08.234301 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:08.234267 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-595b7776f8hst4b_d3677da8-2d2c-4577-beb7-dbc8a652094e/istio-proxy/0.log" May 21 11:06:08.513990 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:08.513880 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7df95f575-v5vhc_cb76dca8-1607-4c1b-ac5d-7611a7794b05/istio-proxy/0.log" May 21 11:06:08.580994 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:08.580957 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-zcvlk_5a42e9b9-f6ed-4bd7-8e32-284434a150b7/payload-processing/0.log" May 21 11:06:08.607139 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:08.607105 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5546c4f488-zdc6s_2714d3c9-b9b4-4905-88df-0ddd2e25c008/router/0.log" May 21 11:06:09.149356 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:09.149325 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7zn72_22843d5b-6950-4f00-bffa-8a509e8009a0/serve-healthcheck-canary/0.log" May 21 11:06:09.743581 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:09.743545 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gfz5s_6ade753c-243c-4077-9f45-12bb257db737/kube-rbac-proxy/0.log" May 21 11:06:09.767213 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:09.767189 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gfz5s_6ade753c-243c-4077-9f45-12bb257db737/exporter/0.log" May 21 11:06:09.789762 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:09.789727 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gfz5s_6ade753c-243c-4077-9f45-12bb257db737/extractor/0.log" May 21 11:06:11.753666 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:11.753639 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-sjg6n/perf-node-gather-daemonset-4zklj" May 21 11:06:11.918312 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:11.918283 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6bc5667487-5fsl4_ff845d71-a746-477f-b629-f2f37073e6e6/maas-api/0.log" May 21 11:06:12.035422 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:12.035337 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-86c469d6c7-6k7xv_8d5016b0-2e65-4c0b-a0e0-a5db4e3412ce/manager/0.log" May 21 11:06:12.101377 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:12.101353 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5fc5c76ccc-4x6p8_8792aeb4-d72b-410e-8692-02a3b7cb0f5c/manager/0.log" May 21 11:06:13.498829 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:13.498798 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-9b6f47d4-b9bnk_d156b60e-5ed5-4b84-9f88-7de088a6d886/manager/0.log" May 21 11:06:20.101829 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:20.101797 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mk4n7_762ee6cc-7e36-4827-9350-d26f6580b8db/kube-multus-additional-cni-plugins/0.log" May 21 11:06:20.123205 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:20.123175 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mk4n7_762ee6cc-7e36-4827-9350-d26f6580b8db/egress-router-binary-copy/0.log" May 21 11:06:20.145129 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:20.145103 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mk4n7_762ee6cc-7e36-4827-9350-d26f6580b8db/cni-plugins/0.log" May 21 11:06:20.169886 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:20.169859 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mk4n7_762ee6cc-7e36-4827-9350-d26f6580b8db/bond-cni-plugin/0.log" May 21 11:06:20.195251 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:20.195206 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mk4n7_762ee6cc-7e36-4827-9350-d26f6580b8db/routeoverride-cni/0.log" May 21 11:06:20.218704 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:20.218678 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mk4n7_762ee6cc-7e36-4827-9350-d26f6580b8db/whereabouts-cni-bincopy/0.log" May 21 11:06:20.243228 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:20.243200 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mk4n7_762ee6cc-7e36-4827-9350-d26f6580b8db/whereabouts-cni/0.log" May 21 11:06:20.307301 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:20.307272 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-g4lt2_a41a87f2-f6ab-4cb1-9b97-906ce5eece4d/kube-multus/0.log" May 21 11:06:20.411592 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:20.411511 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-flzlz_35d22f25-59d6-48b0-a885-ddbcfcdf5cb0/network-metrics-daemon/0.log" May 21 11:06:20.437625 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:20.437599 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-flzlz_35d22f25-59d6-48b0-a885-ddbcfcdf5cb0/kube-rbac-proxy/0.log" May 21 11:06:21.329919 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:21.329883 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fhjht_24a7e4d2-b048-41e9-8bc4-9993aed09fd4/ovn-controller/0.log" May 21 11:06:21.357379 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:21.357349 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fhjht_24a7e4d2-b048-41e9-8bc4-9993aed09fd4/ovn-acl-logging/0.log" May 21 11:06:21.377407 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:21.377380 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fhjht_24a7e4d2-b048-41e9-8bc4-9993aed09fd4/kube-rbac-proxy-node/0.log" May 21 11:06:21.404867 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:21.404836 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fhjht_24a7e4d2-b048-41e9-8bc4-9993aed09fd4/kube-rbac-proxy-ovn-metrics/0.log" May 21 11:06:21.428017 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:21.427985 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fhjht_24a7e4d2-b048-41e9-8bc4-9993aed09fd4/northd/0.log" May 21 11:06:21.451158 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:21.451133 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fhjht_24a7e4d2-b048-41e9-8bc4-9993aed09fd4/nbdb/0.log" May 21 11:06:21.475114 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:21.475089 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fhjht_24a7e4d2-b048-41e9-8bc4-9993aed09fd4/sbdb/0.log" May 21 11:06:21.591255 ip-10-0-142-214 kubenswrapper[2565]: I0521 11:06:21.591162 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fhjht_24a7e4d2-b048-41e9-8bc4-9993aed09fd4/ovnkube-controller/0.log"