May 25 23:32:35.519468 ip-10-0-134-170 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory May 25 23:32:35.519480 ip-10-0-134-170 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory May 25 23:32:35.519487 ip-10-0-134-170 systemd[1]: kubelet.service: Failed with result 'resources'. May 25 23:32:35.519750 ip-10-0-134-170 systemd[1]: Failed to start Kubernetes Kubelet. May 25 23:32:45.762087 ip-10-0-134-170 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. May 25 23:32:45.762103 ip-10-0-134-170 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 61677ae0fea9445cac4ec836d7ee4aba -- May 25 23:35:01.782471 ip-10-0-134-170 systemd[1]: Starting Kubernetes Kubelet... May 25 23:35:02.292757 ip-10-0-134-170 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 25 23:35:02.292757 ip-10-0-134-170 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 25 23:35:02.292757 ip-10-0-134-170 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 25 23:35:02.293401 ip-10-0-134-170 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 25 23:35:02.293401 ip-10-0-134-170 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 25 23:35:02.294416 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.294325 2560 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 25 23:35:02.297489 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297468 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages May 25 23:35:02.297489 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297489 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 25 23:35:02.297564 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297493 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 25 23:35:02.297564 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297498 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 25 23:35:02.297564 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297501 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 25 23:35:02.297564 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297504 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 25 23:35:02.297564 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297507 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 25 23:35:02.297564 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297509 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 25 23:35:02.297564 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297512 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 25 23:35:02.297564 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297515 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 25 23:35:02.297564 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297517 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 25 23:35:02.297564 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297520 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 25 23:35:02.297564 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297523 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability May 25 23:35:02.297564 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297525 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 25 23:35:02.297564 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297529 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 25 23:35:02.297564 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297533 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 25 23:35:02.297564 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297536 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 25 23:35:02.297564 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297538 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 25 23:35:02.297564 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297541 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 25 23:35:02.297564 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297543 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 25 23:35:02.297564 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297546 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 25 23:35:02.297564 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297549 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 25 23:35:02.298102 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297552 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 25 23:35:02.298102 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297555 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 25 23:35:02.298102 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297557 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores May 25 23:35:02.298102 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297560 2560 feature_gate.go:328] unrecognized feature gate: Example May 25 23:35:02.298102 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297562 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 25 23:35:02.298102 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297565 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 25 23:35:02.298102 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297567 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 25 23:35:02.298102 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297570 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 25 23:35:02.298102 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297573 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 25 23:35:02.298102 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297577 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 25 23:35:02.298102 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297579 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 25 23:35:02.298102 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297582 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 25 23:35:02.298102 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297584 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 25 23:35:02.298102 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297588 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 25 23:35:02.298102 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297590 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 25 23:35:02.298102 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297593 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 25 23:35:02.298102 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297595 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 25 23:35:02.298102 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297598 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 25 23:35:02.298102 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297600 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 25 23:35:02.298102 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297603 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 25 23:35:02.298603 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297605 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 25 23:35:02.298603 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297608 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 25 23:35:02.298603 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297610 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 25 23:35:02.298603 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297612 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 25 23:35:02.298603 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297615 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 25 23:35:02.298603 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297617 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 25 23:35:02.298603 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297620 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 25 23:35:02.298603 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297622 2560 feature_gate.go:328] unrecognized feature gate: NewOLM May 25 23:35:02.298603 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297625 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 25 23:35:02.298603 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297627 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 25 23:35:02.298603 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297629 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 25 23:35:02.298603 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297632 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 25 23:35:02.298603 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297635 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 25 23:35:02.298603 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297638 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 25 23:35:02.298603 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297644 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 25 23:35:02.298603 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297648 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 25 23:35:02.298603 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297651 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 25 23:35:02.298603 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297654 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 25 23:35:02.298603 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297656 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 25 23:35:02.299090 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297659 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 25 23:35:02.299090 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297661 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 25 23:35:02.299090 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297664 2560 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 25 23:35:02.299090 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297666 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 25 23:35:02.299090 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297669 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 25 23:35:02.299090 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297671 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 25 23:35:02.299090 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297673 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 25 23:35:02.299090 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297676 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 25 23:35:02.299090 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297678 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 25 23:35:02.299090 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297681 2560 feature_gate.go:328] unrecognized feature gate: DualReplica May 25 23:35:02.299090 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297684 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 25 23:35:02.299090 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297686 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 25 23:35:02.299090 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297688 2560 feature_gate.go:328] unrecognized feature gate: Example2 May 25 23:35:02.299090 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297691 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 25 23:35:02.299090 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297693 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 25 23:35:02.299090 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297696 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 25 23:35:02.299090 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297698 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 25 23:35:02.299090 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297700 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 25 23:35:02.299090 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297703 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 25 23:35:02.299090 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297705 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 25 23:35:02.299557 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297708 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 25 23:35:02.299557 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297710 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 25 23:35:02.299557 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297713 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 25 23:35:02.299557 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297715 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 25 23:35:02.299557 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.297717 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 25 23:35:02.301481 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301457 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 25 23:35:02.301481 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301479 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 25 23:35:02.301481 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301484 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores May 25 23:35:02.301633 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301489 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 25 23:35:02.301633 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301493 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 25 23:35:02.301633 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301497 2560 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 25 23:35:02.301633 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301502 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 25 23:35:02.301633 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301506 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 25 23:35:02.301633 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301510 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 25 23:35:02.301633 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301514 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 25 23:35:02.301633 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301519 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 25 23:35:02.301633 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301524 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 25 23:35:02.301633 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301528 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 25 23:35:02.301633 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301531 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 25 23:35:02.301633 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301536 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 25 23:35:02.301633 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301539 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 25 23:35:02.301633 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301544 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 25 23:35:02.301633 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301548 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 25 23:35:02.301633 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301552 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 25 23:35:02.301633 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301556 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 25 23:35:02.301633 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301561 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 25 23:35:02.301633 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301565 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 25 23:35:02.301633 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301569 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 25 23:35:02.302136 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301573 2560 feature_gate.go:328] unrecognized feature gate: DualReplica May 25 23:35:02.302136 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301577 2560 feature_gate.go:328] unrecognized feature gate: Example May 25 23:35:02.302136 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301581 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 25 23:35:02.302136 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301589 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 25 23:35:02.302136 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301594 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 25 23:35:02.302136 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301598 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 25 23:35:02.302136 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301601 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 25 23:35:02.302136 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301605 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 25 23:35:02.302136 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301609 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 25 23:35:02.302136 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301614 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 25 23:35:02.302136 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301618 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 25 23:35:02.302136 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301621 2560 feature_gate.go:328] unrecognized feature gate: Example2 May 25 23:35:02.302136 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301625 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 25 23:35:02.302136 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301631 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 25 23:35:02.302136 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301636 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 25 23:35:02.302136 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301643 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 25 23:35:02.302136 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301646 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 25 23:35:02.302136 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301649 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 25 23:35:02.302136 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301652 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 25 23:35:02.302136 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301654 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 25 23:35:02.302668 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301657 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 25 23:35:02.302668 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301660 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 25 23:35:02.302668 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301662 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 25 23:35:02.302668 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301664 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 25 23:35:02.302668 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301667 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 25 23:35:02.302668 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301669 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 25 23:35:02.302668 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301672 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 25 23:35:02.302668 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301675 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 25 23:35:02.302668 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301677 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 25 23:35:02.302668 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301680 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 25 23:35:02.302668 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301683 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 25 23:35:02.302668 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301685 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 25 23:35:02.302668 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301688 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 25 23:35:02.302668 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301690 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 25 23:35:02.302668 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301693 2560 feature_gate.go:328] unrecognized feature gate: NewOLM May 25 23:35:02.302668 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301696 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 25 23:35:02.302668 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301698 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 25 23:35:02.302668 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301700 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 25 23:35:02.302668 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301703 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 25 23:35:02.302668 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301705 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability May 25 23:35:02.303180 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301708 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 25 23:35:02.303180 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301710 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 25 23:35:02.303180 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301713 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 25 23:35:02.303180 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301716 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 25 23:35:02.303180 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301718 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 25 23:35:02.303180 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301721 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 25 23:35:02.303180 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301723 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 25 23:35:02.303180 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301726 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 25 23:35:02.303180 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301729 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 25 23:35:02.303180 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301732 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 25 23:35:02.303180 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301734 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 25 23:35:02.303180 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301736 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 25 23:35:02.303180 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301739 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 25 23:35:02.303180 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301742 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 25 23:35:02.303180 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301745 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 25 23:35:02.303180 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301750 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 25 23:35:02.303180 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301755 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 25 23:35:02.303180 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301759 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 25 23:35:02.303180 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301764 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 25 23:35:02.303637 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301767 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 25 23:35:02.303637 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301770 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 25 23:35:02.303637 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301773 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages May 25 23:35:02.303637 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.301776 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 25 23:35:02.303637 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.301862 2560 flags.go:64] FLAG: --address="0.0.0.0" May 25 23:35:02.303637 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.301873 2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 25 23:35:02.303637 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.301883 2560 flags.go:64] FLAG: --anonymous-auth="true" May 25 23:35:02.303637 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.301889 2560 flags.go:64] FLAG: --application-metrics-count-limit="100" May 25 23:35:02.303637 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.301896 2560 flags.go:64] FLAG: --authentication-token-webhook="false" May 25 23:35:02.303637 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.301899 2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 25 23:35:02.303637 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.301904 2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 25 23:35:02.303637 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.301908 2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 25 23:35:02.303637 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.301911 2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 25 23:35:02.303637 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.301914 2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 25 23:35:02.303637 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.301918 2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 25 23:35:02.303637 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.301922 2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 25 23:35:02.303637 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.301925 2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 25 23:35:02.303637 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.301928 2560 flags.go:64] FLAG: --cgroup-root="" May 25 23:35:02.303637 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.301931 2560 flags.go:64] FLAG: --cgroups-per-qos="true" May 25 23:35:02.303637 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.301934 2560 flags.go:64] FLAG: --client-ca-file="" May 25 23:35:02.303637 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.301937 2560 flags.go:64] FLAG: --cloud-config="" May 25 23:35:02.303637 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.301940 2560 flags.go:64] FLAG: --cloud-provider="external" May 25 23:35:02.303637 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.301943 2560 flags.go:64] FLAG: --cluster-dns="[]" May 25 23:35:02.303637 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.301948 2560 flags.go:64] FLAG: --cluster-domain="" May 25 23:35:02.304235 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.301950 2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 25 23:35:02.304235 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.301953 2560 flags.go:64] FLAG: --config-dir="" May 25 23:35:02.304235 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.301956 2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 25 23:35:02.304235 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.301959 2560 flags.go:64] FLAG: --container-log-max-files="5" May 25 23:35:02.304235 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.301969 2560 flags.go:64] FLAG: --container-log-max-size="10Mi" May 25 23:35:02.304235 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.301973 2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 25 23:35:02.304235 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.301976 2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 25 23:35:02.304235 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.301979 2560 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 25 23:35:02.304235 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.301982 2560 flags.go:64] FLAG: --contention-profiling="false" May 25 23:35:02.304235 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.301985 2560 flags.go:64] FLAG: --cpu-cfs-quota="true" May 25 23:35:02.304235 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302006 2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 25 23:35:02.304235 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302009 2560 flags.go:64] FLAG: --cpu-manager-policy="none" May 25 23:35:02.304235 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302013 2560 flags.go:64] FLAG: --cpu-manager-policy-options="" May 25 23:35:02.304235 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302017 2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 25 23:35:02.304235 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302020 2560 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 25 23:35:02.304235 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302023 2560 flags.go:64] FLAG: --enable-debugging-handlers="true" May 25 23:35:02.304235 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302026 2560 flags.go:64] FLAG: --enable-load-reader="false" May 25 23:35:02.304235 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302029 2560 flags.go:64] FLAG: --enable-server="true" May 25 23:35:02.304235 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302032 2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 25 23:35:02.304235 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302037 2560 flags.go:64] FLAG: --event-burst="100" May 25 23:35:02.304235 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302040 2560 flags.go:64] FLAG: --event-qps="50" May 25 23:35:02.304235 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302043 2560 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 25 23:35:02.304235 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302046 2560 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 25 23:35:02.304235 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302050 2560 flags.go:64] FLAG: --eviction-hard="" May 25 23:35:02.304235 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302056 2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 25 23:35:02.304834 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302059 2560 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 25 23:35:02.304834 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302062 2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 25 23:35:02.304834 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302065 2560 flags.go:64] FLAG: --eviction-soft="" May 25 23:35:02.304834 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302068 2560 flags.go:64] FLAG: --eviction-soft-grace-period="" May 25 23:35:02.304834 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302071 2560 flags.go:64] FLAG: --exit-on-lock-contention="false" May 25 23:35:02.304834 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302074 2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 25 23:35:02.304834 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302077 2560 flags.go:64] FLAG: --experimental-mounter-path="" May 25 23:35:02.304834 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302080 2560 flags.go:64] FLAG: --fail-cgroupv1="false" May 25 23:35:02.304834 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302082 2560 flags.go:64] FLAG: --fail-swap-on="true" May 25 23:35:02.304834 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302085 2560 flags.go:64] FLAG: --feature-gates="" May 25 23:35:02.304834 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302089 2560 flags.go:64] FLAG: --file-check-frequency="20s" May 25 23:35:02.304834 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302092 2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 25 23:35:02.304834 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302095 2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 25 23:35:02.304834 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302099 2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 25 23:35:02.304834 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302102 2560 flags.go:64] FLAG: --healthz-port="10248" May 25 23:35:02.304834 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302105 2560 flags.go:64] FLAG: --help="false" May 25 23:35:02.304834 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302108 2560 flags.go:64] FLAG: --hostname-override="ip-10-0-134-170.ec2.internal" May 25 23:35:02.304834 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302111 2560 flags.go:64] FLAG: --housekeeping-interval="10s" May 25 23:35:02.304834 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302114 2560 flags.go:64] FLAG: --http-check-frequency="20s" May 25 23:35:02.304834 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302116 2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 25 23:35:02.304834 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302119 2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 25 23:35:02.304834 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302122 2560 flags.go:64] FLAG: --image-gc-high-threshold="85" May 25 23:35:02.304834 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302125 2560 flags.go:64] FLAG: --image-gc-low-threshold="80" May 25 23:35:02.304834 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302128 2560 flags.go:64] FLAG: --image-service-endpoint="" May 25 23:35:02.305774 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302131 2560 flags.go:64] FLAG: --kernel-memcg-notification="false" May 25 23:35:02.305774 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302133 2560 flags.go:64] FLAG: --kube-api-burst="100" May 25 23:35:02.305774 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302136 2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 25 23:35:02.305774 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302139 2560 flags.go:64] FLAG: --kube-api-qps="50" May 25 23:35:02.305774 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302142 2560 flags.go:64] FLAG: --kube-reserved="" May 25 23:35:02.305774 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302146 2560 flags.go:64] FLAG: --kube-reserved-cgroup="" May 25 23:35:02.305774 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302149 2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 25 23:35:02.305774 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302152 2560 flags.go:64] FLAG: --kubelet-cgroups="" May 25 23:35:02.305774 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302155 2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 25 23:35:02.305774 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302158 2560 flags.go:64] FLAG: --lock-file="" May 25 23:35:02.305774 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302161 2560 flags.go:64] FLAG: --log-cadvisor-usage="false" May 25 23:35:02.305774 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302164 2560 flags.go:64] FLAG: --log-flush-frequency="5s" May 25 23:35:02.305774 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302167 2560 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 25 23:35:02.305774 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302173 2560 flags.go:64] FLAG: --log-json-split-stream="false" May 25 23:35:02.305774 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302176 2560 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 25 23:35:02.305774 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302178 2560 flags.go:64] FLAG: --log-text-split-stream="false" May 25 23:35:02.305774 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302181 2560 flags.go:64] FLAG: --logging-format="text" May 25 23:35:02.305774 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302184 2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 25 23:35:02.305774 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302187 2560 flags.go:64] FLAG: --make-iptables-util-chains="true" May 25 23:35:02.305774 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302190 2560 flags.go:64] FLAG: --manifest-url="" May 25 23:35:02.305774 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302193 2560 flags.go:64] FLAG: --manifest-url-header="" May 25 23:35:02.305774 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302203 2560 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 25 23:35:02.305774 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302206 2560 flags.go:64] FLAG: --max-open-files="1000000" May 25 23:35:02.305774 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302211 2560 flags.go:64] FLAG: --max-pods="110" May 25 23:35:02.305774 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302214 2560 flags.go:64] FLAG: --maximum-dead-containers="-1" May 25 23:35:02.306869 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302217 2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 25 23:35:02.306869 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302220 2560 flags.go:64] FLAG: --memory-manager-policy="None" May 25 23:35:02.306869 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302223 2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 25 23:35:02.306869 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302226 2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 25 23:35:02.306869 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302229 2560 flags.go:64] FLAG: --node-ip="0.0.0.0" May 25 23:35:02.306869 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302232 2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 25 23:35:02.306869 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302240 2560 flags.go:64] FLAG: --node-status-max-images="50" May 25 23:35:02.306869 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302243 2560 flags.go:64] FLAG: --node-status-update-frequency="10s" May 25 23:35:02.306869 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302246 2560 flags.go:64] FLAG: --oom-score-adj="-999" May 25 23:35:02.306869 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302249 2560 flags.go:64] FLAG: --pod-cidr="" May 25 23:35:02.306869 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302252 2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 25 23:35:02.306869 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302257 2560 flags.go:64] FLAG: --pod-manifest-path="" May 25 23:35:02.306869 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302260 2560 flags.go:64] FLAG: --pod-max-pids="-1" May 25 23:35:02.306869 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302264 2560 flags.go:64] FLAG: --pods-per-core="0" May 25 23:35:02.306869 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302266 2560 flags.go:64] FLAG: --port="10250" May 25 23:35:02.306869 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302269 2560 flags.go:64] FLAG: --protect-kernel-defaults="false" May 25 23:35:02.306869 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302272 2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a848ecb5f7f9197e" May 25 23:35:02.306869 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302275 2560 flags.go:64] FLAG: --qos-reserved="" May 25 23:35:02.306869 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302278 2560 flags.go:64] FLAG: --read-only-port="10255" May 25 23:35:02.306869 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302281 2560 flags.go:64] FLAG: --register-node="true" May 25 23:35:02.306869 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302284 2560 flags.go:64] FLAG: --register-schedulable="true" May 25 23:35:02.306869 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302287 2560 flags.go:64] FLAG: --register-with-taints="" May 25 23:35:02.306869 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302290 2560 flags.go:64] FLAG: --registry-burst="10" May 25 23:35:02.306869 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302293 2560 flags.go:64] FLAG: --registry-qps="5" May 25 23:35:02.307779 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302296 2560 flags.go:64] FLAG: --reserved-cpus="" May 25 23:35:02.307779 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302299 2560 flags.go:64] FLAG: --reserved-memory="" May 25 23:35:02.307779 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302302 2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 25 23:35:02.307779 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302305 2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 25 23:35:02.307779 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302308 2560 flags.go:64] FLAG: --rotate-certificates="false" May 25 23:35:02.307779 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302312 2560 flags.go:64] FLAG: --rotate-server-certificates="false" May 25 23:35:02.307779 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302315 2560 flags.go:64] FLAG: --runonce="false" May 25 23:35:02.307779 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302318 2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 25 23:35:02.307779 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302321 2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 25 23:35:02.307779 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302324 2560 flags.go:64] FLAG: --seccomp-default="false" May 25 23:35:02.307779 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302326 2560 flags.go:64] FLAG: --serialize-image-pulls="true" May 25 23:35:02.307779 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302329 2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 25 23:35:02.307779 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302332 2560 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 25 23:35:02.307779 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302335 2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 25 23:35:02.307779 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302338 2560 flags.go:64] FLAG: --storage-driver-password="root" May 25 23:35:02.307779 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302341 2560 flags.go:64] FLAG: --storage-driver-secure="false" May 25 23:35:02.307779 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302344 2560 flags.go:64] FLAG: --storage-driver-table="stats" May 25 23:35:02.307779 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302347 2560 flags.go:64] FLAG: --storage-driver-user="root" May 25 23:35:02.307779 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302350 2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 25 23:35:02.307779 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302353 2560 flags.go:64] FLAG: --sync-frequency="1m0s" May 25 23:35:02.307779 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302355 2560 flags.go:64] FLAG: --system-cgroups="" May 25 23:35:02.307779 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302358 2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 25 23:35:02.307779 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302364 2560 flags.go:64] FLAG: --system-reserved-cgroup="" May 25 23:35:02.307779 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302367 2560 flags.go:64] FLAG: --tls-cert-file="" May 25 23:35:02.307779 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302370 2560 flags.go:64] FLAG: --tls-cipher-suites="[]" May 25 23:35:02.308745 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302375 2560 flags.go:64] FLAG: --tls-min-version="" May 25 23:35:02.308745 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302378 2560 flags.go:64] FLAG: --tls-private-key-file="" May 25 23:35:02.308745 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302380 2560 flags.go:64] FLAG: --topology-manager-policy="none" May 25 23:35:02.308745 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302383 2560 flags.go:64] FLAG: --topology-manager-policy-options="" May 25 23:35:02.308745 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302386 2560 flags.go:64] FLAG: --topology-manager-scope="container" May 25 23:35:02.308745 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302389 2560 flags.go:64] FLAG: --v="2" May 25 23:35:02.308745 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302393 2560 flags.go:64] FLAG: --version="false" May 25 23:35:02.308745 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302397 2560 flags.go:64] FLAG: --vmodule="" May 25 23:35:02.308745 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302401 2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 25 23:35:02.308745 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.302404 2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 25 23:35:02.308745 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302498 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 25 23:35:02.308745 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302502 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 25 23:35:02.308745 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302505 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 25 23:35:02.308745 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302508 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 25 23:35:02.308745 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302512 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 25 23:35:02.308745 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302516 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores May 25 23:35:02.308745 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302518 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 25 23:35:02.308745 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302521 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 25 23:35:02.308745 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302524 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 25 23:35:02.308745 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302526 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 25 23:35:02.308745 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302529 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 25 23:35:02.308745 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302531 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 25 23:35:02.309339 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302534 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 25 23:35:02.309339 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302536 2560 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 25 23:35:02.309339 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302539 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 25 23:35:02.309339 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302541 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 25 23:35:02.309339 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302543 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 25 23:35:02.309339 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302546 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 25 23:35:02.309339 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302549 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 25 23:35:02.309339 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302551 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 25 23:35:02.309339 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302554 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 25 23:35:02.309339 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302556 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 25 23:35:02.309339 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302559 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 25 23:35:02.309339 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302562 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 25 23:35:02.309339 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302564 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 25 23:35:02.309339 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302568 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 25 23:35:02.309339 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302571 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 25 23:35:02.309339 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302574 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 25 23:35:02.309339 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302576 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 25 23:35:02.309339 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302579 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 25 23:35:02.309339 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302582 2560 feature_gate.go:328] unrecognized feature gate: DualReplica May 25 23:35:02.309339 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302584 2560 feature_gate.go:328] unrecognized feature gate: NewOLM May 25 23:35:02.309883 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302586 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 25 23:35:02.309883 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302589 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 25 23:35:02.309883 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302591 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 25 23:35:02.309883 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302594 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 25 23:35:02.309883 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302596 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 25 23:35:02.309883 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302599 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 25 23:35:02.309883 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302602 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 25 23:35:02.309883 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302604 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 25 23:35:02.309883 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302607 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 25 23:35:02.309883 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302609 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 25 23:35:02.309883 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302611 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 25 23:35:02.309883 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302614 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 25 23:35:02.309883 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302617 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability May 25 23:35:02.309883 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302619 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 25 23:35:02.309883 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302622 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 25 23:35:02.309883 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302624 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 25 23:35:02.309883 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302627 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 25 23:35:02.309883 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302629 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 25 23:35:02.309883 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302632 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 25 23:35:02.309883 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302634 2560 feature_gate.go:328] unrecognized feature gate: Example May 25 23:35:02.310403 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302636 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 25 23:35:02.310403 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302639 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 25 23:35:02.310403 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302641 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 25 23:35:02.310403 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302644 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 25 23:35:02.310403 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302648 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 25 23:35:02.310403 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302651 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 25 23:35:02.310403 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302654 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 25 23:35:02.310403 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302657 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages May 25 23:35:02.310403 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302660 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 25 23:35:02.310403 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302663 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 25 23:35:02.310403 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302665 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 25 23:35:02.310403 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302668 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 25 23:35:02.310403 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302671 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 25 23:35:02.310403 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302673 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 25 23:35:02.310403 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302676 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 25 23:35:02.310403 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302679 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 25 23:35:02.310403 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302681 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 25 23:35:02.310403 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302684 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 25 23:35:02.310403 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302687 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 25 23:35:02.310878 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302689 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 25 23:35:02.310878 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302691 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 25 23:35:02.310878 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302694 2560 feature_gate.go:328] unrecognized feature gate: Example2 May 25 23:35:02.310878 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302696 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 25 23:35:02.310878 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302699 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 25 23:35:02.310878 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302701 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 25 23:35:02.310878 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302706 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 25 23:35:02.310878 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302709 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 25 23:35:02.310878 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302711 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 25 23:35:02.310878 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302714 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 25 23:35:02.310878 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302716 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 25 23:35:02.310878 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302722 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 25 23:35:02.310878 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302725 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 25 23:35:02.310878 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302727 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 25 23:35:02.310878 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.302730 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 25 23:35:02.310878 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.303673 2560 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 25 23:35:02.311329 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.310980 2560 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 25 23:35:02.311329 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.311123 2560 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 25 23:35:02.311329 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311175 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 25 23:35:02.311329 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311180 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 25 23:35:02.311329 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311183 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 25 23:35:02.311329 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311186 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 25 23:35:02.311329 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311189 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 25 23:35:02.311329 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311192 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 25 23:35:02.311329 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311195 2560 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 25 23:35:02.311329 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311198 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 25 23:35:02.311329 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311201 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 25 23:35:02.311329 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311203 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 25 23:35:02.311329 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311206 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 25 23:35:02.311329 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311208 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 25 23:35:02.311329 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311211 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 25 23:35:02.311329 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311215 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 25 23:35:02.311329 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311218 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 25 23:35:02.311329 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311220 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 25 23:35:02.311329 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311222 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 25 23:35:02.311329 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311225 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 25 23:35:02.311824 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311228 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 25 23:35:02.311824 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311230 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 25 23:35:02.311824 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311233 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 25 23:35:02.311824 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311236 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 25 23:35:02.311824 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311238 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 25 23:35:02.311824 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311241 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 25 23:35:02.311824 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311244 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 25 23:35:02.311824 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311246 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 25 23:35:02.311824 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311249 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability May 25 23:35:02.311824 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311251 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 25 23:35:02.311824 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311254 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 25 23:35:02.311824 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311257 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 25 23:35:02.311824 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311260 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 25 23:35:02.311824 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311263 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 25 23:35:02.311824 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311266 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 25 23:35:02.311824 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311269 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 25 23:35:02.311824 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311272 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 25 23:35:02.311824 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311275 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 25 23:35:02.311824 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311277 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 25 23:35:02.312385 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311280 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 25 23:35:02.312385 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311283 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 25 23:35:02.312385 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311285 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 25 23:35:02.312385 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311289 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 25 23:35:02.312385 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311294 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 25 23:35:02.312385 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311298 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 25 23:35:02.312385 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311301 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 25 23:35:02.312385 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311304 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 25 23:35:02.312385 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311307 2560 feature_gate.go:328] unrecognized feature gate: DualReplica May 25 23:35:02.312385 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311310 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores May 25 23:35:02.312385 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311313 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 25 23:35:02.312385 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311315 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 25 23:35:02.312385 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311318 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 25 23:35:02.312385 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311321 2560 feature_gate.go:328] unrecognized feature gate: Example May 25 23:35:02.312385 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311323 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 25 23:35:02.312385 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311326 2560 feature_gate.go:328] unrecognized feature gate: Example2 May 25 23:35:02.312385 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311328 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 25 23:35:02.312385 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311331 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 25 23:35:02.312385 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311334 2560 feature_gate.go:328] unrecognized feature gate: NewOLM May 25 23:35:02.312385 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311336 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 25 23:35:02.312872 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311339 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 25 23:35:02.312872 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311342 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 25 23:35:02.312872 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311345 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 25 23:35:02.312872 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311347 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 25 23:35:02.312872 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311350 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 25 23:35:02.312872 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311354 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 25 23:35:02.312872 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311357 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages May 25 23:35:02.312872 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311359 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 25 23:35:02.312872 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311362 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 25 23:35:02.312872 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311365 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 25 23:35:02.312872 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311368 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 25 23:35:02.312872 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311370 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 25 23:35:02.312872 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311372 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 25 23:35:02.312872 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311375 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 25 23:35:02.312872 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311377 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 25 23:35:02.312872 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311380 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 25 23:35:02.312872 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311382 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 25 23:35:02.312872 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311385 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 25 23:35:02.312872 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311387 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 25 23:35:02.312872 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311390 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 25 23:35:02.313389 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311392 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 25 23:35:02.313389 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311395 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 25 23:35:02.313389 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311399 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 25 23:35:02.313389 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311402 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 25 23:35:02.313389 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311405 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 25 23:35:02.313389 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311407 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 25 23:35:02.313389 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311410 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 25 23:35:02.313389 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311412 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 25 23:35:02.313389 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311414 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 25 23:35:02.313389 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.311419 2560 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 25 23:35:02.313389 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311519 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 25 23:35:02.313389 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311523 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 25 23:35:02.313389 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311526 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 25 23:35:02.313389 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311528 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 25 23:35:02.313389 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311531 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 25 23:35:02.313762 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311533 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 25 23:35:02.313762 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311536 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 25 23:35:02.313762 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311538 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 25 23:35:02.313762 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311542 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 25 23:35:02.313762 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311545 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 25 23:35:02.313762 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311547 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 25 23:35:02.313762 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311550 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 25 23:35:02.313762 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311552 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 25 23:35:02.313762 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311555 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 25 23:35:02.313762 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311557 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 25 23:35:02.313762 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311560 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 25 23:35:02.313762 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311564 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 25 23:35:02.313762 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311567 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 25 23:35:02.313762 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311570 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 25 23:35:02.313762 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311573 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 25 23:35:02.313762 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311575 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 25 23:35:02.313762 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311578 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 25 23:35:02.313762 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311581 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 25 23:35:02.313762 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311584 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 25 23:35:02.314236 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311586 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 25 23:35:02.314236 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311589 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 25 23:35:02.314236 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311592 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 25 23:35:02.314236 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311594 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 25 23:35:02.314236 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311596 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 25 23:35:02.314236 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311599 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 25 23:35:02.314236 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311601 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 25 23:35:02.314236 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311604 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 25 23:35:02.314236 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311606 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 25 23:35:02.314236 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311609 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 25 23:35:02.314236 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311611 2560 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 25 23:35:02.314236 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311614 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 25 23:35:02.314236 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311616 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 25 23:35:02.314236 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311619 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 25 23:35:02.314236 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311621 2560 feature_gate.go:328] unrecognized feature gate: Example2 May 25 23:35:02.314236 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311624 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 25 23:35:02.314236 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311627 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 25 23:35:02.314236 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311629 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 25 23:35:02.314236 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311632 2560 feature_gate.go:328] unrecognized feature gate: DualReplica May 25 23:35:02.314236 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311634 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 25 23:35:02.314721 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311637 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 25 23:35:02.314721 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311639 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 25 23:35:02.314721 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311641 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 25 23:35:02.314721 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311644 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 25 23:35:02.314721 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311646 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 25 23:35:02.314721 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311649 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 25 23:35:02.314721 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311651 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 25 23:35:02.314721 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311653 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 25 23:35:02.314721 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311656 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 25 23:35:02.314721 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311658 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 25 23:35:02.314721 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311661 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 25 23:35:02.314721 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311664 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 25 23:35:02.314721 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311666 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 25 23:35:02.314721 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311668 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores May 25 23:35:02.314721 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311671 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 25 23:35:02.314721 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311674 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 25 23:35:02.314721 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311676 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 25 23:35:02.314721 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311679 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 25 23:35:02.314721 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311681 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability May 25 23:35:02.314721 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311684 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 25 23:35:02.315245 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311686 2560 feature_gate.go:328] unrecognized feature gate: NewOLM May 25 23:35:02.315245 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311689 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 25 23:35:02.315245 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311691 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 25 23:35:02.315245 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311694 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 25 23:35:02.315245 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311696 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 25 23:35:02.315245 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311699 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 25 23:35:02.315245 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311701 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 25 23:35:02.315245 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311704 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages May 25 23:35:02.315245 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311707 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 25 23:35:02.315245 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311709 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 25 23:35:02.315245 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311711 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 25 23:35:02.315245 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311714 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 25 23:35:02.315245 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311716 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 25 23:35:02.315245 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311719 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 25 23:35:02.315245 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311722 2560 feature_gate.go:328] unrecognized feature gate: Example May 25 23:35:02.315245 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311726 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 25 23:35:02.315245 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311729 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 25 23:35:02.315245 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311731 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 25 23:35:02.315245 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311734 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 25 23:35:02.315245 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311736 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 25 23:35:02.315729 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311739 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 25 23:35:02.315729 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:02.311742 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 25 23:35:02.315729 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.311747 2560 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 25 23:35:02.315729 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.312637 2560 server.go:962] "Client rotation is on, will bootstrap in background" May 25 23:35:02.316618 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.316600 2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 25 23:35:02.317754 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.317741 2560 server.go:1019] "Starting client certificate rotation" May 25 23:35:02.317867 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.317847 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 25 23:35:02.317932 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.317882 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 25 23:35:02.346962 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.346931 2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 25 23:35:02.348903 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.348875 2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 25 23:35:02.378416 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.378382 2560 log.go:25] "Validated CRI v1 runtime API" May 25 23:35:02.385730 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.385707 2560 log.go:25] "Validated CRI v1 image API" May 25 23:35:02.387259 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.387241 2560 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 25 23:35:02.390549 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.390527 2560 fs.go:135] Filesystem UUIDs: map[6f3adb6d-be0d-4d08-972f-1da97bd75646:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 f5872fd5-250c-42f5-86b8-6ebc38eae836:/dev/nvme0n1p3] May 25 23:35:02.390636 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.390548 2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 25 23:35:02.395252 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.395137 2560 manager.go:217] Machine: {Timestamp:2026-05-25 23:35:02.394615708 +0000 UTC m=+0.473511349 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3053908 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2fef3bee8748b918e4e367295fad75 SystemUUID:ec2fef3b-ee87-48b9-18e4-e367295fad75 BootID:61677ae0-fea9-445c-ac4e-c836d7ee4aba Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:6a:c7:5a:fe:43 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:6a:c7:5a:fe:43 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:be:4a:7b:59:28:0c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 25 23:35:02.396212 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.396200 2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 25 23:35:02.396364 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.396351 2560 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 25 23:35:02.400785 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.400753 2560 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 25 23:35:02.400960 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.400789 2560 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-170.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 25 23:35:02.401071 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.400977 2560 topology_manager.go:138] "Creating topology manager with none policy" May 25 23:35:02.401071 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.401010 2560 container_manager_linux.go:306] "Creating device plugin manager" May 25 23:35:02.401071 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.401022 2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 25 23:35:02.402763 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.402749 2560 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 25 23:35:02.405172 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.405157 2560 state_mem.go:36] "Initialized new in-memory state store" May 25 23:35:02.405317 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.405306 2560 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 25 23:35:02.408978 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.408961 2560 kubelet.go:491] "Attempting to sync node with API server" May 25 23:35:02.409070 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.409009 2560 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 25 23:35:02.409070 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.409027 2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 25 23:35:02.409070 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.409040 2560 kubelet.go:397] "Adding apiserver pod source" May 25 23:35:02.409070 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.409055 2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 25 23:35:02.410471 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.410458 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 25 23:35:02.410547 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.410482 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 25 23:35:02.413242 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.413222 2560 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 25 23:35:02.414122 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.414106 2560 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 25 23:35:02.421137 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.421120 2560 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 25 23:35:02.422069 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.422055 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 25 23:35:02.422114 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.422074 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 25 23:35:02.422114 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.422081 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 25 23:35:02.422114 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.422086 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 25 23:35:02.422114 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.422095 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 25 23:35:02.422114 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.422101 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 25 23:35:02.422114 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.422107 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 25 23:35:02.422267 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.422120 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 25 23:35:02.422267 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.422128 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 25 23:35:02.422267 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.422134 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 25 23:35:02.422267 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.422146 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 25 23:35:02.422495 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.422486 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 25 23:35:02.424495 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.424482 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 25 23:35:02.424532 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.424499 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 25 23:35:02.427942 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.427928 2560 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 25 23:35:02.428020 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.427976 2560 server.go:1295] "Started kubelet" May 25 23:35:02.428142 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.428074 2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 25 23:35:02.428246 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.428130 2560 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 25 23:35:02.428246 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.428206 2560 server_v1.go:47] "podresources" method="list" useActivePods=true May 25 23:35:02.428873 ip-10-0-134-170 systemd[1]: Started Kubernetes Kubelet. May 25 23:35:02.429265 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.429247 2560 server.go:317] "Adding debug handlers to kubelet server" May 25 23:35:02.429695 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:02.429670 2560 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-170.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 25 23:35:02.429746 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.429710 2560 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-170.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 25 23:35:02.429746 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.429718 2560 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 25 23:35:02.429746 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:02.429717 2560 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 25 23:35:02.437535 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:02.437506 2560 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 25 23:35:02.437732 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.437711 2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 25 23:35:02.437732 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.437721 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 25 23:35:02.437906 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.437788 2560 volume_manager.go:295] "The desired_state_of_world populator starts" May 25 23:35:02.437906 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.437796 2560 volume_manager.go:297] "Starting Kubelet Volume Manager" May 25 23:35:02.437906 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.437820 2560 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 25 23:35:02.438081 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.437938 2560 reconstruct.go:97] "Volume reconstruction finished" May 25 23:35:02.438081 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.437946 2560 reconciler.go:26] "Reconciler: start to sync state" May 25 23:35:02.438447 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.438429 2560 factory.go:55] Registering systemd factory May 25 23:35:02.438522 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.438452 2560 factory.go:223] Registration of the systemd container factory successfully May 25 23:35:02.438673 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:02.438653 2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-170.ec2.internal\" not found" May 25 23:35:02.438739 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.438681 2560 factory.go:153] Registering CRI-O factory May 25 23:35:02.438739 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.438693 2560 factory.go:223] Registration of the crio container factory successfully May 25 23:35:02.438800 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.438742 2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 25 23:35:02.438800 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.438771 2560 factory.go:103] Registering Raw factory May 25 23:35:02.439271 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.439255 2560 manager.go:1196] Started watching for new ooms in manager May 25 23:35:02.440734 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.440713 2560 manager.go:319] Starting recovery of all containers May 25 23:35:02.448656 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.448612 2560 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 25 23:35:02.449586 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:02.449554 2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-170.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" May 25 23:35:02.449697 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:02.449648 2560 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" May 25 23:35:02.451570 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.451549 2560 manager.go:324] Recovery completed May 25 23:35:02.452837 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:02.451438 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-170.ec2.internal.18b2f31b8d78db0b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-170.ec2.internal,UID:ip-10-0-134-170.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-170.ec2.internal,},FirstTimestamp:2026-05-25 23:35:02.427941643 +0000 UTC m=+0.506837285,LastTimestamp:2026-05-25 23:35:02.427941643 +0000 UTC m=+0.506837285,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-170.ec2.internal,}" May 25 23:35:02.457106 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.457092 2560 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 25 23:35:02.459132 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.459108 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-170.ec2.internal" event="NodeHasSufficientMemory" May 25 23:35:02.459194 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.459146 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-170.ec2.internal" event="NodeHasNoDiskPressure" May 25 23:35:02.459552 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.459537 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-170.ec2.internal" event="NodeHasSufficientPID" May 25 23:35:02.460080 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.460064 2560 cpu_manager.go:222] "Starting CPU manager" policy="none" May 25 23:35:02.460080 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.460080 2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 25 23:35:02.460187 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.460098 2560 state_mem.go:36] "Initialized new in-memory state store" May 25 23:35:02.464010 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.463978 2560 policy_none.go:49] "None policy: Start" May 25 23:35:02.464077 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.464018 2560 memory_manager.go:186] "Starting memorymanager" policy="None" May 25 23:35:02.464077 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.464030 2560 state_mem.go:35] "Initializing new in-memory state store" May 25 23:35:02.469248 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:02.466972 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-170.ec2.internal.18b2f31b8f54c898 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-170.ec2.internal,UID:ip-10-0-134-170.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-170.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-170.ec2.internal,},FirstTimestamp:2026-05-25 23:35:02.459132056 +0000 UTC m=+0.538027697,LastTimestamp:2026-05-25 23:35:02.459132056 +0000 UTC m=+0.538027697,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-170.ec2.internal,}" May 25 23:35:02.482745 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:02.482654 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-170.ec2.internal.18b2f31b8f5abd83 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-170.ec2.internal,UID:ip-10-0-134-170.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-170.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-170.ec2.internal,},FirstTimestamp:2026-05-25 23:35:02.459522435 +0000 UTC m=+0.538418077,LastTimestamp:2026-05-25 23:35:02.459522435 +0000 UTC m=+0.538418077,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-170.ec2.internal,}" May 25 23:35:02.492229 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.492001 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zls7f" May 25 23:35:02.520903 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:02.492502 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-170.ec2.internal.18b2f31b8f5b1bbe default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-170.ec2.internal,UID:ip-10-0-134-170.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-134-170.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-134-170.ec2.internal,},FirstTimestamp:2026-05-25 23:35:02.459546558 +0000 UTC m=+0.538442199,LastTimestamp:2026-05-25 23:35:02.459546558 +0000 UTC m=+0.538442199,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-170.ec2.internal,}" May 25 23:35:02.520903 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.496894 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zls7f" May 25 23:35:02.520903 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.500656 2560 manager.go:341] "Starting Device Plugin manager" May 25 23:35:02.520903 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:02.500691 2560 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 25 23:35:02.520903 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.500702 2560 server.go:85] "Starting device plugin registration server" May 25 23:35:02.520903 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.501368 2560 eviction_manager.go:189] "Eviction manager: starting control loop" May 25 23:35:02.520903 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.501379 2560 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 25 23:35:02.520903 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.501479 2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 25 23:35:02.520903 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.501564 2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 25 23:35:02.520903 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.501573 2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 25 23:35:02.520903 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:02.502402 2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 25 23:35:02.520903 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:02.502446 2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-170.ec2.internal\" not found" May 25 23:35:02.539797 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.539761 2560 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 25 23:35:02.539797 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.539801 2560 status_manager.go:230] "Starting to sync pod status with apiserver" May 25 23:35:02.539980 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.539825 2560 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 25 23:35:02.539980 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.539833 2560 kubelet.go:2451] "Starting kubelet main sync loop" May 25 23:35:02.539980 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:02.539949 2560 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 25 23:35:02.548210 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.548129 2560 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 25 23:35:02.602166 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.602130 2560 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 25 23:35:02.603181 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.603152 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-170.ec2.internal" event="NodeHasSufficientMemory" May 25 23:35:02.603286 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.603194 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-170.ec2.internal" event="NodeHasNoDiskPressure" May 25 23:35:02.603286 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.603207 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-170.ec2.internal" event="NodeHasSufficientPID" May 25 23:35:02.603286 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.603237 2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-170.ec2.internal" May 25 23:35:02.613360 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.613332 2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-170.ec2.internal" May 25 23:35:02.613360 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:02.613362 2560 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-170.ec2.internal\": node \"ip-10-0-134-170.ec2.internal\" not found" May 25 23:35:02.640090 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.640053 2560 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-170.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-170.ec2.internal"] May 25 23:35:02.640244 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.640146 2560 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 25 23:35:02.641034 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.641018 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-170.ec2.internal" event="NodeHasSufficientMemory" May 25 23:35:02.641130 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.641051 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-170.ec2.internal" event="NodeHasNoDiskPressure" May 25 23:35:02.641130 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.641065 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-170.ec2.internal" event="NodeHasSufficientPID" May 25 23:35:02.642368 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.642352 2560 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 25 23:35:02.642514 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.642500 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-170.ec2.internal" May 25 23:35:02.642581 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.642539 2560 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 25 23:35:02.643062 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.643044 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-170.ec2.internal" event="NodeHasSufficientMemory" May 25 23:35:02.643130 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.643078 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-170.ec2.internal" event="NodeHasNoDiskPressure" May 25 23:35:02.643130 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.643088 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-170.ec2.internal" event="NodeHasSufficientPID" May 25 23:35:02.643227 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.643046 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-170.ec2.internal" event="NodeHasSufficientMemory" May 25 23:35:02.643227 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.643161 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-170.ec2.internal" event="NodeHasNoDiskPressure" May 25 23:35:02.643227 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.643177 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-170.ec2.internal" event="NodeHasSufficientPID" May 25 23:35:02.644399 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.644384 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-170.ec2.internal" May 25 23:35:02.644452 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.644411 2560 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 25 23:35:02.645091 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.645077 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-170.ec2.internal" event="NodeHasSufficientMemory" May 25 23:35:02.645179 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.645106 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-170.ec2.internal" event="NodeHasNoDiskPressure" May 25 23:35:02.645179 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.645121 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-170.ec2.internal" event="NodeHasSufficientPID" May 25 23:35:02.671348 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:02.671317 2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-170.ec2.internal\" not found" May 25 23:35:02.677863 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:02.677840 2560 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-170.ec2.internal\" not found" node="ip-10-0-134-170.ec2.internal" May 25 23:35:02.681300 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:02.681281 2560 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-170.ec2.internal\" not found" node="ip-10-0-134-170.ec2.internal" May 25 23:35:02.739357 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.739299 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/616b33d91d8da23cb5532266feb58b09-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-170.ec2.internal\" (UID: \"616b33d91d8da23cb5532266feb58b09\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-170.ec2.internal" May 25 23:35:02.739357 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.739347 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/616b33d91d8da23cb5532266feb58b09-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-170.ec2.internal\" (UID: \"616b33d91d8da23cb5532266feb58b09\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-170.ec2.internal" May 25 23:35:02.739357 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.739367 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e7a923675e9bf9e023936dfbefc39d5a-config\") pod \"kube-apiserver-proxy-ip-10-0-134-170.ec2.internal\" (UID: \"e7a923675e9bf9e023936dfbefc39d5a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-170.ec2.internal" May 25 23:35:02.771891 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:02.771852 2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-170.ec2.internal\" not found" May 25 23:35:02.840437 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.840336 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/616b33d91d8da23cb5532266feb58b09-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-170.ec2.internal\" (UID: \"616b33d91d8da23cb5532266feb58b09\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-170.ec2.internal" May 25 23:35:02.840437 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.840384 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/616b33d91d8da23cb5532266feb58b09-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-170.ec2.internal\" (UID: \"616b33d91d8da23cb5532266feb58b09\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-170.ec2.internal" May 25 23:35:02.840437 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.840405 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e7a923675e9bf9e023936dfbefc39d5a-config\") pod \"kube-apiserver-proxy-ip-10-0-134-170.ec2.internal\" (UID: \"e7a923675e9bf9e023936dfbefc39d5a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-170.ec2.internal" May 25 23:35:02.840639 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.840449 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/616b33d91d8da23cb5532266feb58b09-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-170.ec2.internal\" (UID: \"616b33d91d8da23cb5532266feb58b09\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-170.ec2.internal" May 25 23:35:02.840639 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.840462 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e7a923675e9bf9e023936dfbefc39d5a-config\") pod \"kube-apiserver-proxy-ip-10-0-134-170.ec2.internal\" (UID: \"e7a923675e9bf9e023936dfbefc39d5a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-170.ec2.internal" May 25 23:35:02.840639 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.840464 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/616b33d91d8da23cb5532266feb58b09-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-170.ec2.internal\" (UID: \"616b33d91d8da23cb5532266feb58b09\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-170.ec2.internal" May 25 23:35:02.872455 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:02.872414 2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-170.ec2.internal\" not found" May 25 23:35:02.973239 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:02.973188 2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-170.ec2.internal\" not found" May 25 23:35:02.980384 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.980354 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-170.ec2.internal" May 25 23:35:02.984247 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:02.984229 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-170.ec2.internal" May 25 23:35:03.073508 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:03.073467 2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-170.ec2.internal\" not found" May 25 23:35:03.174044 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:03.173930 2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-170.ec2.internal\" not found" May 25 23:35:03.274488 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:03.274448 2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-170.ec2.internal\" not found" May 25 23:35:03.317668 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:03.317622 2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 25 23:35:03.318347 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:03.317785 2560 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 25 23:35:03.375305 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:03.375282 2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-170.ec2.internal\" not found" May 25 23:35:03.438548 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:03.438481 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 25 23:35:03.456804 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:03.456769 2560 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 25 23:35:03.476395 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:03.476366 2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-170.ec2.internal\" not found" May 25 23:35:03.497572 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:03.497532 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-gvqgk" May 25 23:35:03.499605 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:03.499575 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-24 23:30:02 +0000 UTC" deadline="2028-03-05 19:07:31.188903272 +0000 UTC" May 25 23:35:03.499605 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:03.499603 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15595h32m27.689303487s" May 25 23:35:03.508812 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:03.508641 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-gvqgk" May 25 23:35:03.512102 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:03.512064 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod616b33d91d8da23cb5532266feb58b09.slice/crio-3d808701c18082bcf0471069d2a8fc1e86096de3f2e5de34ac5839cab4ad8874 WatchSource:0}: Error finding container 3d808701c18082bcf0471069d2a8fc1e86096de3f2e5de34ac5839cab4ad8874: Status 404 returned error can't find the container with id 3d808701c18082bcf0471069d2a8fc1e86096de3f2e5de34ac5839cab4ad8874 May 25 23:35:03.512360 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:03.512345 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7a923675e9bf9e023936dfbefc39d5a.slice/crio-a6ddc381c772bdda8931a7a5f049bf835979499533d8999bbd5c302de9fb409b WatchSource:0}: Error finding container a6ddc381c772bdda8931a7a5f049bf835979499533d8999bbd5c302de9fb409b: Status 404 returned error can't find the container with id a6ddc381c772bdda8931a7a5f049bf835979499533d8999bbd5c302de9fb409b May 25 23:35:03.515596 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:03.515580 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 25 23:35:03.536028 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:03.536001 2560 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 25 23:35:03.538531 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:03.538513 2560 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-170.ec2.internal" May 25 23:35:03.542483 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:03.542442 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-170.ec2.internal" event={"ID":"e7a923675e9bf9e023936dfbefc39d5a","Type":"ContainerStarted","Data":"a6ddc381c772bdda8931a7a5f049bf835979499533d8999bbd5c302de9fb409b"} May 25 23:35:03.543331 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:03.543311 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-170.ec2.internal" event={"ID":"616b33d91d8da23cb5532266feb58b09","Type":"ContainerStarted","Data":"3d808701c18082bcf0471069d2a8fc1e86096de3f2e5de34ac5839cab4ad8874"} May 25 23:35:03.556313 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:03.556287 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 25 23:35:03.558469 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:03.558452 2560 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-170.ec2.internal" May 25 23:35:03.572107 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:03.572084 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 25 23:35:03.646426 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:03.646389 2560 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 25 23:35:03.821453 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:03.821371 2560 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 25 23:35:04.409521 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.409487 2560 apiserver.go:52] "Watching apiserver" May 25 23:35:04.419764 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.419727 2560 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 25 23:35:04.422067 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.422037 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-twhc6","kube-system/konnectivity-agent-2qd5w","kube-system/kube-apiserver-proxy-ip-10-0-134-170.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8xmd","openshift-multus/network-metrics-daemon-7ws64","openshift-network-operator/iptables-alerter-5hmf8","openshift-ovn-kubernetes/ovnkube-node-czsc7","openshift-cluster-node-tuning-operator/tuned-xxcq5","openshift-image-registry/node-ca-k2fns","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-170.ec2.internal","openshift-multus/multus-additional-cni-plugins-7tm79","openshift-multus/multus-njpdd"] May 25 23:35:04.427437 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.427414 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-twhc6" May 25 23:35:04.427537 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:04.427489 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-twhc6" podUID="053dd95b-4d61-480d-8a80-645cf902780e" May 25 23:35:04.429510 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.429449 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2qd5w" May 25 23:35:04.433816 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.431405 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8xmd" May 25 23:35:04.433816 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.431485 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ws64" May 25 23:35:04.433816 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:04.431588 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ws64" podUID="694e83a1-a7ed-4246-a57b-6ba3e80ae3ba" May 25 23:35:04.433816 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.432079 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 25 23:35:04.433816 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.432116 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-2xfn6\"" May 25 23:35:04.433816 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.432342 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 25 23:35:04.433816 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.433550 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5hmf8" May 25 23:35:04.433816 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.433719 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 25 23:35:04.434216 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.434124 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 25 23:35:04.434285 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.434271 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 25 23:35:04.434408 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.434397 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-x95qz\"" May 25 23:35:04.438942 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.436773 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" May 25 23:35:04.439665 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.439645 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 25 23:35:04.439665 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.439654 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 25 23:35:04.439817 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.439653 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 25 23:35:04.439817 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.439810 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-r4qwk\"" May 25 23:35:04.439981 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.439961 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 25 23:35:04.440095 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.440075 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 25 23:35:04.440239 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.440222 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 25 23:35:04.440818 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.440798 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 25 23:35:04.441180 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.440867 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 25 23:35:04.441180 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.441087 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 25 23:35:04.441180 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.441090 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-qhwpb\"" May 25 23:35:04.442032 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.442016 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xxcq5" May 25 23:35:04.444279 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.444226 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 25 23:35:04.444384 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.444290 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-k2fns" May 25 23:35:04.444519 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.444503 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6rqxl\"" May 25 23:35:04.444655 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.444634 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 25 23:35:04.446539 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.446520 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7tm79" May 25 23:35:04.447345 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.447327 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/254029cd-e52b-4d4a-904a-e30af2b6c681-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l8xmd\" (UID: \"254029cd-e52b-4d4a-904a-e30af2b6c681\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8xmd" May 25 23:35:04.447429 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.447354 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/254029cd-e52b-4d4a-904a-e30af2b6c681-registration-dir\") pod \"aws-ebs-csi-driver-node-l8xmd\" (UID: \"254029cd-e52b-4d4a-904a-e30af2b6c681\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8xmd" May 25 23:35:04.447429 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.447372 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c028769b-0a8b-4a6e-8572-91c89c7879de-run-systemd\") pod \"ovnkube-node-czsc7\" (UID: \"c028769b-0a8b-4a6e-8572-91c89c7879de\") " pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" May 25 23:35:04.447429 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.447397 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c028769b-0a8b-4a6e-8572-91c89c7879de-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-czsc7\" (UID: \"c028769b-0a8b-4a6e-8572-91c89c7879de\") " pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" May 25 23:35:04.447564 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.447434 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c028769b-0a8b-4a6e-8572-91c89c7879de-ovnkube-script-lib\") pod \"ovnkube-node-czsc7\" (UID: \"c028769b-0a8b-4a6e-8572-91c89c7879de\") " pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" May 25 23:35:04.447564 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.447457 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f8e8195-2832-443e-bf4d-3ffaf3ebc923-etc-kubernetes\") pod \"tuned-xxcq5\" (UID: \"7f8e8195-2832-443e-bf4d-3ffaf3ebc923\") " pod="openshift-cluster-node-tuning-operator/tuned-xxcq5" May 25 23:35:04.447564 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.447482 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7f8e8195-2832-443e-bf4d-3ffaf3ebc923-etc-systemd\") pod \"tuned-xxcq5\" (UID: \"7f8e8195-2832-443e-bf4d-3ffaf3ebc923\") " pod="openshift-cluster-node-tuning-operator/tuned-xxcq5" May 25 23:35:04.447564 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.447504 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e44b2c4f-59b8-4b76-80a5-1b3baa90a6db-konnectivity-ca\") pod \"konnectivity-agent-2qd5w\" (UID: \"e44b2c4f-59b8-4b76-80a5-1b3baa90a6db\") " pod="kube-system/konnectivity-agent-2qd5w" May 25 23:35:04.447564 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.447511 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 25 23:35:04.447564 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.447530 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/254029cd-e52b-4d4a-904a-e30af2b6c681-etc-selinux\") pod \"aws-ebs-csi-driver-node-l8xmd\" (UID: \"254029cd-e52b-4d4a-904a-e30af2b6c681\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8xmd" May 25 23:35:04.447564 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.447552 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dj9md\" (UniqueName: \"kubernetes.io/projected/254029cd-e52b-4d4a-904a-e30af2b6c681-kube-api-access-dj9md\") pod \"aws-ebs-csi-driver-node-l8xmd\" (UID: \"254029cd-e52b-4d4a-904a-e30af2b6c681\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8xmd" May 25 23:35:04.447818 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.447566 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8b33ef50-e2af-46ac-879b-c7fe139c78d0-host-slash\") pod \"iptables-alerter-5hmf8\" (UID: \"8b33ef50-e2af-46ac-879b-c7fe139c78d0\") " pod="openshift-network-operator/iptables-alerter-5hmf8" May 25 23:35:04.447818 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.447589 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgxtf\" (UniqueName: \"kubernetes.io/projected/8b33ef50-e2af-46ac-879b-c7fe139c78d0-kube-api-access-cgxtf\") pod \"iptables-alerter-5hmf8\" (UID: \"8b33ef50-e2af-46ac-879b-c7fe139c78d0\") " pod="openshift-network-operator/iptables-alerter-5hmf8" May 25 23:35:04.447818 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.447612 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c028769b-0a8b-4a6e-8572-91c89c7879de-systemd-units\") pod \"ovnkube-node-czsc7\" (UID: \"c028769b-0a8b-4a6e-8572-91c89c7879de\") " pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" May 25 23:35:04.447818 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.447639 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c028769b-0a8b-4a6e-8572-91c89c7879de-var-lib-openvswitch\") pod \"ovnkube-node-czsc7\" (UID: \"c028769b-0a8b-4a6e-8572-91c89c7879de\") " pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" May 25 23:35:04.447818 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.447662 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c028769b-0a8b-4a6e-8572-91c89c7879de-host-run-ovn-kubernetes\") pod \"ovnkube-node-czsc7\" (UID: \"c028769b-0a8b-4a6e-8572-91c89c7879de\") " pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" May 25 23:35:04.447818 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.447679 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c028769b-0a8b-4a6e-8572-91c89c7879de-etc-openvswitch\") pod \"ovnkube-node-czsc7\" (UID: \"c028769b-0a8b-4a6e-8572-91c89c7879de\") " pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" May 25 23:35:04.447818 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.447695 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jj4n4\" (UniqueName: \"kubernetes.io/projected/c028769b-0a8b-4a6e-8572-91c89c7879de-kube-api-access-jj4n4\") pod \"ovnkube-node-czsc7\" (UID: \"c028769b-0a8b-4a6e-8572-91c89c7879de\") " pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" May 25 23:35:04.447818 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.447732 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7f8e8195-2832-443e-bf4d-3ffaf3ebc923-etc-sysctl-d\") pod \"tuned-xxcq5\" (UID: \"7f8e8195-2832-443e-bf4d-3ffaf3ebc923\") " pod="openshift-cluster-node-tuning-operator/tuned-xxcq5" May 25 23:35:04.447818 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.447755 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7f8e8195-2832-443e-bf4d-3ffaf3ebc923-etc-sysctl-conf\") pod \"tuned-xxcq5\" (UID: \"7f8e8195-2832-443e-bf4d-3ffaf3ebc923\") " pod="openshift-cluster-node-tuning-operator/tuned-xxcq5" May 25 23:35:04.447818 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.447782 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/254029cd-e52b-4d4a-904a-e30af2b6c681-sys-fs\") pod \"aws-ebs-csi-driver-node-l8xmd\" (UID: \"254029cd-e52b-4d4a-904a-e30af2b6c681\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8xmd" May 25 23:35:04.447818 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.447818 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 25 23:35:04.448296 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.447827 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c028769b-0a8b-4a6e-8572-91c89c7879de-host-run-netns\") pod \"ovnkube-node-czsc7\" (UID: \"c028769b-0a8b-4a6e-8572-91c89c7879de\") " pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" May 25 23:35:04.448296 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.447854 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7f8e8195-2832-443e-bf4d-3ffaf3ebc923-etc-modprobe-d\") pod \"tuned-xxcq5\" (UID: \"7f8e8195-2832-443e-bf4d-3ffaf3ebc923\") " pod="openshift-cluster-node-tuning-operator/tuned-xxcq5" May 25 23:35:04.448296 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.447886 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7f8e8195-2832-443e-bf4d-3ffaf3ebc923-lib-modules\") pod \"tuned-xxcq5\" (UID: \"7f8e8195-2832-443e-bf4d-3ffaf3ebc923\") " pod="openshift-cluster-node-tuning-operator/tuned-xxcq5" May 25 23:35:04.448296 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.447908 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7f8e8195-2832-443e-bf4d-3ffaf3ebc923-etc-tuned\") pod \"tuned-xxcq5\" (UID: \"7f8e8195-2832-443e-bf4d-3ffaf3ebc923\") " pod="openshift-cluster-node-tuning-operator/tuned-xxcq5" May 25 23:35:04.448296 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.447937 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sxdv\" (UniqueName: \"kubernetes.io/projected/053dd95b-4d61-480d-8a80-645cf902780e-kube-api-access-7sxdv\") pod \"network-check-target-twhc6\" (UID: \"053dd95b-4d61-480d-8a80-645cf902780e\") " pod="openshift-network-diagnostics/network-check-target-twhc6" May 25 23:35:04.448296 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.447961 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/694e83a1-a7ed-4246-a57b-6ba3e80ae3ba-metrics-certs\") pod \"network-metrics-daemon-7ws64\" (UID: \"694e83a1-a7ed-4246-a57b-6ba3e80ae3ba\") " pod="openshift-multus/network-metrics-daemon-7ws64" May 25 23:35:04.448296 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.447977 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-pdgqq\"" May 25 23:35:04.448296 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.448005 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pc29b\" (UniqueName: \"kubernetes.io/projected/694e83a1-a7ed-4246-a57b-6ba3e80ae3ba-kube-api-access-pc29b\") pod \"network-metrics-daemon-7ws64\" (UID: \"694e83a1-a7ed-4246-a57b-6ba3e80ae3ba\") " pod="openshift-multus/network-metrics-daemon-7ws64" May 25 23:35:04.448296 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.448037 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c028769b-0a8b-4a6e-8572-91c89c7879de-log-socket\") pod \"ovnkube-node-czsc7\" (UID: \"c028769b-0a8b-4a6e-8572-91c89c7879de\") " pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" May 25 23:35:04.448296 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.448053 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c028769b-0a8b-4a6e-8572-91c89c7879de-ovn-node-metrics-cert\") pod \"ovnkube-node-czsc7\" (UID: \"c028769b-0a8b-4a6e-8572-91c89c7879de\") " pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" May 25 23:35:04.448296 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.448077 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f8e8195-2832-443e-bf4d-3ffaf3ebc923-tmp\") pod \"tuned-xxcq5\" (UID: \"7f8e8195-2832-443e-bf4d-3ffaf3ebc923\") " pod="openshift-cluster-node-tuning-operator/tuned-xxcq5" May 25 23:35:04.448296 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.448099 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e44b2c4f-59b8-4b76-80a5-1b3baa90a6db-agent-certs\") pod \"konnectivity-agent-2qd5w\" (UID: \"e44b2c4f-59b8-4b76-80a5-1b3baa90a6db\") " pod="kube-system/konnectivity-agent-2qd5w" May 25 23:35:04.448296 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.448114 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/254029cd-e52b-4d4a-904a-e30af2b6c681-socket-dir\") pod \"aws-ebs-csi-driver-node-l8xmd\" (UID: \"254029cd-e52b-4d4a-904a-e30af2b6c681\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8xmd" May 25 23:35:04.448296 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.448131 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c028769b-0a8b-4a6e-8572-91c89c7879de-run-ovn\") pod \"ovnkube-node-czsc7\" (UID: \"c028769b-0a8b-4a6e-8572-91c89c7879de\") " pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" May 25 23:35:04.448296 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.448154 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c028769b-0a8b-4a6e-8572-91c89c7879de-ovnkube-config\") pod \"ovnkube-node-czsc7\" (UID: \"c028769b-0a8b-4a6e-8572-91c89c7879de\") " pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" May 25 23:35:04.448296 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.448180 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7f8e8195-2832-443e-bf4d-3ffaf3ebc923-run\") pod \"tuned-xxcq5\" (UID: \"7f8e8195-2832-443e-bf4d-3ffaf3ebc923\") " pod="openshift-cluster-node-tuning-operator/tuned-xxcq5" May 25 23:35:04.448296 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.448189 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 25 23:35:04.448968 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.448203 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c028769b-0a8b-4a6e-8572-91c89c7879de-run-openvswitch\") pod \"ovnkube-node-czsc7\" (UID: \"c028769b-0a8b-4a6e-8572-91c89c7879de\") " pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" May 25 23:35:04.448968 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.448225 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c028769b-0a8b-4a6e-8572-91c89c7879de-node-log\") pod \"ovnkube-node-czsc7\" (UID: \"c028769b-0a8b-4a6e-8572-91c89c7879de\") " pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" May 25 23:35:04.448968 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.448240 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c028769b-0a8b-4a6e-8572-91c89c7879de-host-cni-bin\") pod \"ovnkube-node-czsc7\" (UID: \"c028769b-0a8b-4a6e-8572-91c89c7879de\") " pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" May 25 23:35:04.448968 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.448268 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c028769b-0a8b-4a6e-8572-91c89c7879de-host-cni-netd\") pod \"ovnkube-node-czsc7\" (UID: \"c028769b-0a8b-4a6e-8572-91c89c7879de\") " pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" May 25 23:35:04.448968 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.448287 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c028769b-0a8b-4a6e-8572-91c89c7879de-env-overrides\") pod \"ovnkube-node-czsc7\" (UID: \"c028769b-0a8b-4a6e-8572-91c89c7879de\") " pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" May 25 23:35:04.448968 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.448303 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7f8e8195-2832-443e-bf4d-3ffaf3ebc923-etc-sysconfig\") pod \"tuned-xxcq5\" (UID: \"7f8e8195-2832-443e-bf4d-3ffaf3ebc923\") " pod="openshift-cluster-node-tuning-operator/tuned-xxcq5" May 25 23:35:04.448968 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.448318 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7f8e8195-2832-443e-bf4d-3ffaf3ebc923-host\") pod \"tuned-xxcq5\" (UID: \"7f8e8195-2832-443e-bf4d-3ffaf3ebc923\") " pod="openshift-cluster-node-tuning-operator/tuned-xxcq5" May 25 23:35:04.448968 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.448353 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/254029cd-e52b-4d4a-904a-e30af2b6c681-device-dir\") pod \"aws-ebs-csi-driver-node-l8xmd\" (UID: \"254029cd-e52b-4d4a-904a-e30af2b6c681\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8xmd" May 25 23:35:04.448968 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.448441 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8b33ef50-e2af-46ac-879b-c7fe139c78d0-iptables-alerter-script\") pod \"iptables-alerter-5hmf8\" (UID: \"8b33ef50-e2af-46ac-879b-c7fe139c78d0\") " pod="openshift-network-operator/iptables-alerter-5hmf8" May 25 23:35:04.448968 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.448487 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c028769b-0a8b-4a6e-8572-91c89c7879de-host-kubelet\") pod \"ovnkube-node-czsc7\" (UID: \"c028769b-0a8b-4a6e-8572-91c89c7879de\") " pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" May 25 23:35:04.448968 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.448503 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c028769b-0a8b-4a6e-8572-91c89c7879de-host-slash\") pod \"ovnkube-node-czsc7\" (UID: \"c028769b-0a8b-4a6e-8572-91c89c7879de\") " pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" May 25 23:35:04.448968 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.448518 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7f8e8195-2832-443e-bf4d-3ffaf3ebc923-sys\") pod \"tuned-xxcq5\" (UID: \"7f8e8195-2832-443e-bf4d-3ffaf3ebc923\") " pod="openshift-cluster-node-tuning-operator/tuned-xxcq5" May 25 23:35:04.448968 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.448537 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f8e8195-2832-443e-bf4d-3ffaf3ebc923-var-lib-kubelet\") pod \"tuned-xxcq5\" (UID: \"7f8e8195-2832-443e-bf4d-3ffaf3ebc923\") " pod="openshift-cluster-node-tuning-operator/tuned-xxcq5" May 25 23:35:04.448968 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.448558 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mslqv\" (UniqueName: \"kubernetes.io/projected/7f8e8195-2832-443e-bf4d-3ffaf3ebc923-kube-api-access-mslqv\") pod \"tuned-xxcq5\" (UID: \"7f8e8195-2832-443e-bf4d-3ffaf3ebc923\") " pod="openshift-cluster-node-tuning-operator/tuned-xxcq5" May 25 23:35:04.448968 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.448883 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-njpdd" May 25 23:35:04.450216 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.450094 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 25 23:35:04.450216 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.450162 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 25 23:35:04.450412 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.450392 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 25 23:35:04.450851 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.450833 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-b74tl\"" May 25 23:35:04.450939 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.450841 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 25 23:35:04.451084 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.451067 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 25 23:35:04.451322 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.451305 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 25 23:35:04.451406 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.451307 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jqsdf\"" May 25 23:35:04.509681 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.509634 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-24 23:30:03 +0000 UTC" deadline="2028-03-01 13:27:10.191769682 +0000 UTC" May 25 23:35:04.509681 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.509671 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15493h52m5.682102647s" May 25 23:35:04.539320 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.539292 2560 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 25 23:35:04.548801 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.548770 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab4b6ed7-9908-40ab-821d-59fb80e9d23f-host-var-lib-kubelet\") pod \"multus-njpdd\" (UID: \"ab4b6ed7-9908-40ab-821d-59fb80e9d23f\") " pod="openshift-multus/multus-njpdd" May 25 23:35:04.548961 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.548812 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c028769b-0a8b-4a6e-8572-91c89c7879de-run-ovn\") pod \"ovnkube-node-czsc7\" (UID: \"c028769b-0a8b-4a6e-8572-91c89c7879de\") " pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" May 25 23:35:04.548961 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.548843 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c028769b-0a8b-4a6e-8572-91c89c7879de-ovnkube-config\") pod \"ovnkube-node-czsc7\" (UID: \"c028769b-0a8b-4a6e-8572-91c89c7879de\") " pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" May 25 23:35:04.548961 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.548864 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7f8e8195-2832-443e-bf4d-3ffaf3ebc923-run\") pod \"tuned-xxcq5\" (UID: \"7f8e8195-2832-443e-bf4d-3ffaf3ebc923\") " pod="openshift-cluster-node-tuning-operator/tuned-xxcq5" May 25 23:35:04.548961 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.548880 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fe7ac5fe-b41b-41e5-b935-9c562ade089b-serviceca\") pod \"node-ca-k2fns\" (UID: \"fe7ac5fe-b41b-41e5-b935-9c562ade089b\") " pod="openshift-image-registry/node-ca-k2fns" May 25 23:35:04.548961 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.548894 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rq4x\" (UniqueName: \"kubernetes.io/projected/fe7ac5fe-b41b-41e5-b935-9c562ade089b-kube-api-access-4rq4x\") pod \"node-ca-k2fns\" (UID: \"fe7ac5fe-b41b-41e5-b935-9c562ade089b\") " pod="openshift-image-registry/node-ca-k2fns" May 25 23:35:04.548961 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.548909 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ab4b6ed7-9908-40ab-821d-59fb80e9d23f-host-var-lib-cni-bin\") pod \"multus-njpdd\" (UID: \"ab4b6ed7-9908-40ab-821d-59fb80e9d23f\") " pod="openshift-multus/multus-njpdd" May 25 23:35:04.548961 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.548924 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c028769b-0a8b-4a6e-8572-91c89c7879de-run-openvswitch\") pod \"ovnkube-node-czsc7\" (UID: \"c028769b-0a8b-4a6e-8572-91c89c7879de\") " pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" May 25 23:35:04.548961 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.548924 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c028769b-0a8b-4a6e-8572-91c89c7879de-run-ovn\") pod \"ovnkube-node-czsc7\" (UID: \"c028769b-0a8b-4a6e-8572-91c89c7879de\") " pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" May 25 23:35:04.548961 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.548945 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c028769b-0a8b-4a6e-8572-91c89c7879de-node-log\") pod \"ovnkube-node-czsc7\" (UID: \"c028769b-0a8b-4a6e-8572-91c89c7879de\") " pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" May 25 23:35:04.548961 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.548957 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7f8e8195-2832-443e-bf4d-3ffaf3ebc923-run\") pod \"tuned-xxcq5\" (UID: \"7f8e8195-2832-443e-bf4d-3ffaf3ebc923\") " pod="openshift-cluster-node-tuning-operator/tuned-xxcq5" May 25 23:35:04.549403 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.549004 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c028769b-0a8b-4a6e-8572-91c89c7879de-run-openvswitch\") pod \"ovnkube-node-czsc7\" (UID: \"c028769b-0a8b-4a6e-8572-91c89c7879de\") " pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" May 25 23:35:04.549403 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.549008 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c028769b-0a8b-4a6e-8572-91c89c7879de-node-log\") pod \"ovnkube-node-czsc7\" (UID: \"c028769b-0a8b-4a6e-8572-91c89c7879de\") " pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" May 25 23:35:04.549403 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.549027 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c028769b-0a8b-4a6e-8572-91c89c7879de-host-cni-bin\") pod \"ovnkube-node-czsc7\" (UID: \"c028769b-0a8b-4a6e-8572-91c89c7879de\") " pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" May 25 23:35:04.549403 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.549056 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c028769b-0a8b-4a6e-8572-91c89c7879de-env-overrides\") pod \"ovnkube-node-czsc7\" (UID: \"c028769b-0a8b-4a6e-8572-91c89c7879de\") " pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" May 25 23:35:04.549403 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.549079 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7f8e8195-2832-443e-bf4d-3ffaf3ebc923-etc-sysconfig\") pod \"tuned-xxcq5\" (UID: \"7f8e8195-2832-443e-bf4d-3ffaf3ebc923\") " pod="openshift-cluster-node-tuning-operator/tuned-xxcq5" May 25 23:35:04.549403 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.549104 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7f8e8195-2832-443e-bf4d-3ffaf3ebc923-host\") pod \"tuned-xxcq5\" (UID: \"7f8e8195-2832-443e-bf4d-3ffaf3ebc923\") " pod="openshift-cluster-node-tuning-operator/tuned-xxcq5" May 25 23:35:04.549403 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.549129 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7tm79\" (UID: \"08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60\") " pod="openshift-multus/multus-additional-cni-plugins-7tm79" May 25 23:35:04.549403 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.549153 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8b33ef50-e2af-46ac-879b-c7fe139c78d0-iptables-alerter-script\") pod \"iptables-alerter-5hmf8\" (UID: \"8b33ef50-e2af-46ac-879b-c7fe139c78d0\") " pod="openshift-network-operator/iptables-alerter-5hmf8" May 25 23:35:04.549403 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.549178 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c028769b-0a8b-4a6e-8572-91c89c7879de-host-kubelet\") pod \"ovnkube-node-czsc7\" (UID: \"c028769b-0a8b-4a6e-8572-91c89c7879de\") " pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" May 25 23:35:04.549403 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.549204 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mslqv\" (UniqueName: \"kubernetes.io/projected/7f8e8195-2832-443e-bf4d-3ffaf3ebc923-kube-api-access-mslqv\") pod \"tuned-xxcq5\" (UID: \"7f8e8195-2832-443e-bf4d-3ffaf3ebc923\") " pod="openshift-cluster-node-tuning-operator/tuned-xxcq5" May 25 23:35:04.549403 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.549231 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab4b6ed7-9908-40ab-821d-59fb80e9d23f-etc-kubernetes\") pod \"multus-njpdd\" (UID: \"ab4b6ed7-9908-40ab-821d-59fb80e9d23f\") " pod="openshift-multus/multus-njpdd" May 25 23:35:04.549403 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.549242 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7f8e8195-2832-443e-bf4d-3ffaf3ebc923-host\") pod \"tuned-xxcq5\" (UID: \"7f8e8195-2832-443e-bf4d-3ffaf3ebc923\") " pod="openshift-cluster-node-tuning-operator/tuned-xxcq5" May 25 23:35:04.549403 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.549257 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c028769b-0a8b-4a6e-8572-91c89c7879de-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-czsc7\" (UID: \"c028769b-0a8b-4a6e-8572-91c89c7879de\") " pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" May 25 23:35:04.549403 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.549172 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7f8e8195-2832-443e-bf4d-3ffaf3ebc923-etc-sysconfig\") pod \"tuned-xxcq5\" (UID: \"7f8e8195-2832-443e-bf4d-3ffaf3ebc923\") " pod="openshift-cluster-node-tuning-operator/tuned-xxcq5" May 25 23:35:04.549403 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.549294 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c028769b-0a8b-4a6e-8572-91c89c7879de-ovnkube-script-lib\") pod \"ovnkube-node-czsc7\" (UID: \"c028769b-0a8b-4a6e-8572-91c89c7879de\") " pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" May 25 23:35:04.549403 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.549320 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f8e8195-2832-443e-bf4d-3ffaf3ebc923-etc-kubernetes\") pod \"tuned-xxcq5\" (UID: \"7f8e8195-2832-443e-bf4d-3ffaf3ebc923\") " pod="openshift-cluster-node-tuning-operator/tuned-xxcq5" May 25 23:35:04.549403 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.549367 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c028769b-0a8b-4a6e-8572-91c89c7879de-host-kubelet\") pod \"ovnkube-node-czsc7\" (UID: \"c028769b-0a8b-4a6e-8572-91c89c7879de\") " pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" May 25 23:35:04.549871 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.549379 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f8e8195-2832-443e-bf4d-3ffaf3ebc923-etc-kubernetes\") pod \"tuned-xxcq5\" (UID: \"7f8e8195-2832-443e-bf4d-3ffaf3ebc923\") " pod="openshift-cluster-node-tuning-operator/tuned-xxcq5" May 25 23:35:04.549871 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.549418 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7f8e8195-2832-443e-bf4d-3ffaf3ebc923-etc-tuned\") pod \"tuned-xxcq5\" (UID: \"7f8e8195-2832-443e-bf4d-3ffaf3ebc923\") " pod="openshift-cluster-node-tuning-operator/tuned-xxcq5" May 25 23:35:04.549871 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.549448 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fe7ac5fe-b41b-41e5-b935-9c562ade089b-host\") pod \"node-ca-k2fns\" (UID: \"fe7ac5fe-b41b-41e5-b935-9c562ade089b\") " pod="openshift-image-registry/node-ca-k2fns" May 25 23:35:04.549871 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.549452 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c028769b-0a8b-4a6e-8572-91c89c7879de-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-czsc7\" (UID: \"c028769b-0a8b-4a6e-8572-91c89c7879de\") " pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" May 25 23:35:04.549871 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.549472 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab4b6ed7-9908-40ab-821d-59fb80e9d23f-multus-cni-dir\") pod \"multus-njpdd\" (UID: \"ab4b6ed7-9908-40ab-821d-59fb80e9d23f\") " pod="openshift-multus/multus-njpdd" May 25 23:35:04.549871 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.549497 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ab4b6ed7-9908-40ab-821d-59fb80e9d23f-host-run-k8s-cni-cncf-io\") pod \"multus-njpdd\" (UID: \"ab4b6ed7-9908-40ab-821d-59fb80e9d23f\") " pod="openshift-multus/multus-njpdd" May 25 23:35:04.549871 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.549527 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c028769b-0a8b-4a6e-8572-91c89c7879de-systemd-units\") pod \"ovnkube-node-czsc7\" (UID: \"c028769b-0a8b-4a6e-8572-91c89c7879de\") " pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" May 25 23:35:04.549871 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.549552 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c028769b-0a8b-4a6e-8572-91c89c7879de-var-lib-openvswitch\") pod \"ovnkube-node-czsc7\" (UID: \"c028769b-0a8b-4a6e-8572-91c89c7879de\") " pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" May 25 23:35:04.549871 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.549556 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c028769b-0a8b-4a6e-8572-91c89c7879de-env-overrides\") pod \"ovnkube-node-czsc7\" (UID: \"c028769b-0a8b-4a6e-8572-91c89c7879de\") " pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" May 25 23:35:04.549871 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.549575 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7f8e8195-2832-443e-bf4d-3ffaf3ebc923-etc-sysctl-d\") pod \"tuned-xxcq5\" (UID: \"7f8e8195-2832-443e-bf4d-3ffaf3ebc923\") " pod="openshift-cluster-node-tuning-operator/tuned-xxcq5" May 25 23:35:04.549871 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.549612 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c028769b-0a8b-4a6e-8572-91c89c7879de-ovnkube-config\") pod \"ovnkube-node-czsc7\" (UID: \"c028769b-0a8b-4a6e-8572-91c89c7879de\") " pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" May 25 23:35:04.549871 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.549622 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ab4b6ed7-9908-40ab-821d-59fb80e9d23f-cni-binary-copy\") pod \"multus-njpdd\" (UID: \"ab4b6ed7-9908-40ab-821d-59fb80e9d23f\") " pod="openshift-multus/multus-njpdd" May 25 23:35:04.549871 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.549296 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c028769b-0a8b-4a6e-8572-91c89c7879de-host-cni-bin\") pod \"ovnkube-node-czsc7\" (UID: \"c028769b-0a8b-4a6e-8572-91c89c7879de\") " pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" May 25 23:35:04.549871 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.549647 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ab4b6ed7-9908-40ab-821d-59fb80e9d23f-multus-conf-dir\") pod \"multus-njpdd\" (UID: \"ab4b6ed7-9908-40ab-821d-59fb80e9d23f\") " pod="openshift-multus/multus-njpdd" May 25 23:35:04.549871 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.549670 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ab4b6ed7-9908-40ab-821d-59fb80e9d23f-multus-daemon-config\") pod \"multus-njpdd\" (UID: \"ab4b6ed7-9908-40ab-821d-59fb80e9d23f\") " pod="openshift-multus/multus-njpdd" May 25 23:35:04.549871 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.549681 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c028769b-0a8b-4a6e-8572-91c89c7879de-systemd-units\") pod \"ovnkube-node-czsc7\" (UID: \"c028769b-0a8b-4a6e-8572-91c89c7879de\") " pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" May 25 23:35:04.549871 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.549696 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7f8e8195-2832-443e-bf4d-3ffaf3ebc923-etc-sysctl-conf\") pod \"tuned-xxcq5\" (UID: \"7f8e8195-2832-443e-bf4d-3ffaf3ebc923\") " pod="openshift-cluster-node-tuning-operator/tuned-xxcq5" May 25 23:35:04.550721 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.549723 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c028769b-0a8b-4a6e-8572-91c89c7879de-host-run-netns\") pod \"ovnkube-node-czsc7\" (UID: \"c028769b-0a8b-4a6e-8572-91c89c7879de\") " pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" May 25 23:35:04.550721 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.549729 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c028769b-0a8b-4a6e-8572-91c89c7879de-var-lib-openvswitch\") pod \"ovnkube-node-czsc7\" (UID: \"c028769b-0a8b-4a6e-8572-91c89c7879de\") " pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" May 25 23:35:04.550721 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.549740 2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 25 23:35:04.550721 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.549784 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7f8e8195-2832-443e-bf4d-3ffaf3ebc923-etc-sysctl-d\") pod \"tuned-xxcq5\" (UID: \"7f8e8195-2832-443e-bf4d-3ffaf3ebc923\") " pod="openshift-cluster-node-tuning-operator/tuned-xxcq5" May 25 23:35:04.550721 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.549789 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c028769b-0a8b-4a6e-8572-91c89c7879de-host-run-netns\") pod \"ovnkube-node-czsc7\" (UID: \"c028769b-0a8b-4a6e-8572-91c89c7879de\") " pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" May 25 23:35:04.550721 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.549747 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7f8e8195-2832-443e-bf4d-3ffaf3ebc923-etc-modprobe-d\") pod \"tuned-xxcq5\" (UID: \"7f8e8195-2832-443e-bf4d-3ffaf3ebc923\") " pod="openshift-cluster-node-tuning-operator/tuned-xxcq5" May 25 23:35:04.550721 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.549789 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8b33ef50-e2af-46ac-879b-c7fe139c78d0-iptables-alerter-script\") pod \"iptables-alerter-5hmf8\" (UID: \"8b33ef50-e2af-46ac-879b-c7fe139c78d0\") " pod="openshift-network-operator/iptables-alerter-5hmf8" May 25 23:35:04.550721 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.549828 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60-cnibin\") pod \"multus-additional-cni-plugins-7tm79\" (UID: \"08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60\") " pod="openshift-multus/multus-additional-cni-plugins-7tm79" May 25 23:35:04.550721 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.549851 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7tm79\" (UID: \"08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60\") " pod="openshift-multus/multus-additional-cni-plugins-7tm79" May 25 23:35:04.550721 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.549858 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7f8e8195-2832-443e-bf4d-3ffaf3ebc923-etc-sysctl-conf\") pod \"tuned-xxcq5\" (UID: \"7f8e8195-2832-443e-bf4d-3ffaf3ebc923\") " pod="openshift-cluster-node-tuning-operator/tuned-xxcq5" May 25 23:35:04.550721 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.549871 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ab4b6ed7-9908-40ab-821d-59fb80e9d23f-host-run-multus-certs\") pod \"multus-njpdd\" (UID: \"ab4b6ed7-9908-40ab-821d-59fb80e9d23f\") " pod="openshift-multus/multus-njpdd" May 25 23:35:04.550721 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.549884 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7f8e8195-2832-443e-bf4d-3ffaf3ebc923-etc-modprobe-d\") pod \"tuned-xxcq5\" (UID: \"7f8e8195-2832-443e-bf4d-3ffaf3ebc923\") " pod="openshift-cluster-node-tuning-operator/tuned-xxcq5" May 25 23:35:04.550721 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.549893 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lq4pn\" (UniqueName: \"kubernetes.io/projected/ab4b6ed7-9908-40ab-821d-59fb80e9d23f-kube-api-access-lq4pn\") pod \"multus-njpdd\" (UID: \"ab4b6ed7-9908-40ab-821d-59fb80e9d23f\") " pod="openshift-multus/multus-njpdd" May 25 23:35:04.550721 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.549951 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/694e83a1-a7ed-4246-a57b-6ba3e80ae3ba-metrics-certs\") pod \"network-metrics-daemon-7ws64\" (UID: \"694e83a1-a7ed-4246-a57b-6ba3e80ae3ba\") " pod="openshift-multus/network-metrics-daemon-7ws64" May 25 23:35:04.550721 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.549980 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f8e8195-2832-443e-bf4d-3ffaf3ebc923-tmp\") pod \"tuned-xxcq5\" (UID: \"7f8e8195-2832-443e-bf4d-3ffaf3ebc923\") " pod="openshift-cluster-node-tuning-operator/tuned-xxcq5" May 25 23:35:04.550721 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.550030 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bl66j\" (UniqueName: \"kubernetes.io/projected/08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60-kube-api-access-bl66j\") pod \"multus-additional-cni-plugins-7tm79\" (UID: \"08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60\") " pod="openshift-multus/multus-additional-cni-plugins-7tm79" May 25 23:35:04.550721 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.550047 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c028769b-0a8b-4a6e-8572-91c89c7879de-ovnkube-script-lib\") pod \"ovnkube-node-czsc7\" (UID: \"c028769b-0a8b-4a6e-8572-91c89c7879de\") " pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" May 25 23:35:04.550721 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:04.550063 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 25 23:35:04.551478 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.550052 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e44b2c4f-59b8-4b76-80a5-1b3baa90a6db-agent-certs\") pod \"konnectivity-agent-2qd5w\" (UID: \"e44b2c4f-59b8-4b76-80a5-1b3baa90a6db\") " pod="kube-system/konnectivity-agent-2qd5w" May 25 23:35:04.551478 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.550096 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/254029cd-e52b-4d4a-904a-e30af2b6c681-socket-dir\") pod \"aws-ebs-csi-driver-node-l8xmd\" (UID: \"254029cd-e52b-4d4a-904a-e30af2b6c681\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8xmd" May 25 23:35:04.551478 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:04.550145 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/694e83a1-a7ed-4246-a57b-6ba3e80ae3ba-metrics-certs podName:694e83a1-a7ed-4246-a57b-6ba3e80ae3ba nodeName:}" failed. No retries permitted until 2026-05-25 23:35:05.05011267 +0000 UTC m=+3.129008323 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/694e83a1-a7ed-4246-a57b-6ba3e80ae3ba-metrics-certs") pod "network-metrics-daemon-7ws64" (UID: "694e83a1-a7ed-4246-a57b-6ba3e80ae3ba") : object "openshift-multus"/"metrics-daemon-secret" not registered May 25 23:35:04.551478 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.550164 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ab4b6ed7-9908-40ab-821d-59fb80e9d23f-cnibin\") pod \"multus-njpdd\" (UID: \"ab4b6ed7-9908-40ab-821d-59fb80e9d23f\") " pod="openshift-multus/multus-njpdd" May 25 23:35:04.551478 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.550188 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c028769b-0a8b-4a6e-8572-91c89c7879de-host-cni-netd\") pod \"ovnkube-node-czsc7\" (UID: \"c028769b-0a8b-4a6e-8572-91c89c7879de\") " pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" May 25 23:35:04.551478 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.550195 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/254029cd-e52b-4d4a-904a-e30af2b6c681-socket-dir\") pod \"aws-ebs-csi-driver-node-l8xmd\" (UID: \"254029cd-e52b-4d4a-904a-e30af2b6c681\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8xmd" May 25 23:35:04.551478 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.550205 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ab4b6ed7-9908-40ab-821d-59fb80e9d23f-os-release\") pod \"multus-njpdd\" (UID: \"ab4b6ed7-9908-40ab-821d-59fb80e9d23f\") " pod="openshift-multus/multus-njpdd" May 25 23:35:04.551478 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.550266 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c028769b-0a8b-4a6e-8572-91c89c7879de-host-cni-netd\") pod \"ovnkube-node-czsc7\" (UID: \"c028769b-0a8b-4a6e-8572-91c89c7879de\") " pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" May 25 23:35:04.551478 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.550305 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ab4b6ed7-9908-40ab-821d-59fb80e9d23f-host-var-lib-cni-multus\") pod \"multus-njpdd\" (UID: \"ab4b6ed7-9908-40ab-821d-59fb80e9d23f\") " pod="openshift-multus/multus-njpdd" May 25 23:35:04.551478 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.550334 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/254029cd-e52b-4d4a-904a-e30af2b6c681-device-dir\") pod \"aws-ebs-csi-driver-node-l8xmd\" (UID: \"254029cd-e52b-4d4a-904a-e30af2b6c681\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8xmd" May 25 23:35:04.551478 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.550351 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c028769b-0a8b-4a6e-8572-91c89c7879de-host-slash\") pod \"ovnkube-node-czsc7\" (UID: \"c028769b-0a8b-4a6e-8572-91c89c7879de\") " pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" May 25 23:35:04.551478 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.550369 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7f8e8195-2832-443e-bf4d-3ffaf3ebc923-sys\") pod \"tuned-xxcq5\" (UID: \"7f8e8195-2832-443e-bf4d-3ffaf3ebc923\") " pod="openshift-cluster-node-tuning-operator/tuned-xxcq5" May 25 23:35:04.551478 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.550393 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f8e8195-2832-443e-bf4d-3ffaf3ebc923-var-lib-kubelet\") pod \"tuned-xxcq5\" (UID: \"7f8e8195-2832-443e-bf4d-3ffaf3ebc923\") " pod="openshift-cluster-node-tuning-operator/tuned-xxcq5" May 25 23:35:04.551478 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.550408 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/254029cd-e52b-4d4a-904a-e30af2b6c681-device-dir\") pod \"aws-ebs-csi-driver-node-l8xmd\" (UID: \"254029cd-e52b-4d4a-904a-e30af2b6c681\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8xmd" May 25 23:35:04.551478 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.550414 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c028769b-0a8b-4a6e-8572-91c89c7879de-host-slash\") pod \"ovnkube-node-czsc7\" (UID: \"c028769b-0a8b-4a6e-8572-91c89c7879de\") " pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" May 25 23:35:04.551478 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.550414 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7f8e8195-2832-443e-bf4d-3ffaf3ebc923-sys\") pod \"tuned-xxcq5\" (UID: \"7f8e8195-2832-443e-bf4d-3ffaf3ebc923\") " pod="openshift-cluster-node-tuning-operator/tuned-xxcq5" May 25 23:35:04.551478 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.550419 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60-system-cni-dir\") pod \"multus-additional-cni-plugins-7tm79\" (UID: \"08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60\") " pod="openshift-multus/multus-additional-cni-plugins-7tm79" May 25 23:35:04.552282 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.550460 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f8e8195-2832-443e-bf4d-3ffaf3ebc923-var-lib-kubelet\") pod \"tuned-xxcq5\" (UID: \"7f8e8195-2832-443e-bf4d-3ffaf3ebc923\") " pod="openshift-cluster-node-tuning-operator/tuned-xxcq5" May 25 23:35:04.552282 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.550467 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60-os-release\") pod \"multus-additional-cni-plugins-7tm79\" (UID: \"08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60\") " pod="openshift-multus/multus-additional-cni-plugins-7tm79" May 25 23:35:04.552282 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.550500 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ab4b6ed7-9908-40ab-821d-59fb80e9d23f-multus-socket-dir-parent\") pod \"multus-njpdd\" (UID: \"ab4b6ed7-9908-40ab-821d-59fb80e9d23f\") " pod="openshift-multus/multus-njpdd" May 25 23:35:04.552282 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.550530 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/254029cd-e52b-4d4a-904a-e30af2b6c681-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l8xmd\" (UID: \"254029cd-e52b-4d4a-904a-e30af2b6c681\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8xmd" May 25 23:35:04.552282 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.550555 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/254029cd-e52b-4d4a-904a-e30af2b6c681-registration-dir\") pod \"aws-ebs-csi-driver-node-l8xmd\" (UID: \"254029cd-e52b-4d4a-904a-e30af2b6c681\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8xmd" May 25 23:35:04.552282 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.550580 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c028769b-0a8b-4a6e-8572-91c89c7879de-run-systemd\") pod \"ovnkube-node-czsc7\" (UID: \"c028769b-0a8b-4a6e-8572-91c89c7879de\") " pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" May 25 23:35:04.552282 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.550604 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7f8e8195-2832-443e-bf4d-3ffaf3ebc923-etc-systemd\") pod \"tuned-xxcq5\" (UID: \"7f8e8195-2832-443e-bf4d-3ffaf3ebc923\") " pod="openshift-cluster-node-tuning-operator/tuned-xxcq5" May 25 23:35:04.552282 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.550621 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/254029cd-e52b-4d4a-904a-e30af2b6c681-registration-dir\") pod \"aws-ebs-csi-driver-node-l8xmd\" (UID: \"254029cd-e52b-4d4a-904a-e30af2b6c681\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8xmd" May 25 23:35:04.552282 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.550630 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7sxdv\" (UniqueName: \"kubernetes.io/projected/053dd95b-4d61-480d-8a80-645cf902780e-kube-api-access-7sxdv\") pod \"network-check-target-twhc6\" (UID: \"053dd95b-4d61-480d-8a80-645cf902780e\") " pod="openshift-network-diagnostics/network-check-target-twhc6" May 25 23:35:04.552282 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.550636 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c028769b-0a8b-4a6e-8572-91c89c7879de-run-systemd\") pod \"ovnkube-node-czsc7\" (UID: \"c028769b-0a8b-4a6e-8572-91c89c7879de\") " pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" May 25 23:35:04.552282 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.550606 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/254029cd-e52b-4d4a-904a-e30af2b6c681-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l8xmd\" (UID: \"254029cd-e52b-4d4a-904a-e30af2b6c681\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8xmd" May 25 23:35:04.552282 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.550658 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7tm79\" (UID: \"08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60\") " pod="openshift-multus/multus-additional-cni-plugins-7tm79" May 25 23:35:04.552282 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.550672 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7f8e8195-2832-443e-bf4d-3ffaf3ebc923-etc-systemd\") pod \"tuned-xxcq5\" (UID: \"7f8e8195-2832-443e-bf4d-3ffaf3ebc923\") " pod="openshift-cluster-node-tuning-operator/tuned-xxcq5" May 25 23:35:04.552282 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.550685 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ab4b6ed7-9908-40ab-821d-59fb80e9d23f-hostroot\") pod \"multus-njpdd\" (UID: \"ab4b6ed7-9908-40ab-821d-59fb80e9d23f\") " pod="openshift-multus/multus-njpdd" May 25 23:35:04.552282 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.550709 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e44b2c4f-59b8-4b76-80a5-1b3baa90a6db-konnectivity-ca\") pod \"konnectivity-agent-2qd5w\" (UID: \"e44b2c4f-59b8-4b76-80a5-1b3baa90a6db\") " pod="kube-system/konnectivity-agent-2qd5w" May 25 23:35:04.552282 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.550731 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/254029cd-e52b-4d4a-904a-e30af2b6c681-etc-selinux\") pod \"aws-ebs-csi-driver-node-l8xmd\" (UID: \"254029cd-e52b-4d4a-904a-e30af2b6c681\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8xmd" May 25 23:35:04.552282 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.550755 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dj9md\" (UniqueName: \"kubernetes.io/projected/254029cd-e52b-4d4a-904a-e30af2b6c681-kube-api-access-dj9md\") pod \"aws-ebs-csi-driver-node-l8xmd\" (UID: \"254029cd-e52b-4d4a-904a-e30af2b6c681\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8xmd" May 25 23:35:04.552966 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.550777 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8b33ef50-e2af-46ac-879b-c7fe139c78d0-host-slash\") pod \"iptables-alerter-5hmf8\" (UID: \"8b33ef50-e2af-46ac-879b-c7fe139c78d0\") " pod="openshift-network-operator/iptables-alerter-5hmf8" May 25 23:35:04.552966 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.550802 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cgxtf\" (UniqueName: \"kubernetes.io/projected/8b33ef50-e2af-46ac-879b-c7fe139c78d0-kube-api-access-cgxtf\") pod \"iptables-alerter-5hmf8\" (UID: \"8b33ef50-e2af-46ac-879b-c7fe139c78d0\") " pod="openshift-network-operator/iptables-alerter-5hmf8" May 25 23:35:04.552966 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.550825 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c028769b-0a8b-4a6e-8572-91c89c7879de-host-run-ovn-kubernetes\") pod \"ovnkube-node-czsc7\" (UID: \"c028769b-0a8b-4a6e-8572-91c89c7879de\") " pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" May 25 23:35:04.552966 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.550830 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/254029cd-e52b-4d4a-904a-e30af2b6c681-etc-selinux\") pod \"aws-ebs-csi-driver-node-l8xmd\" (UID: \"254029cd-e52b-4d4a-904a-e30af2b6c681\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8xmd" May 25 23:35:04.552966 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.550880 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c028769b-0a8b-4a6e-8572-91c89c7879de-etc-openvswitch\") pod \"ovnkube-node-czsc7\" (UID: \"c028769b-0a8b-4a6e-8572-91c89c7879de\") " pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" May 25 23:35:04.552966 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.550849 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c028769b-0a8b-4a6e-8572-91c89c7879de-etc-openvswitch\") pod \"ovnkube-node-czsc7\" (UID: \"c028769b-0a8b-4a6e-8572-91c89c7879de\") " pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" May 25 23:35:04.552966 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.550960 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jj4n4\" (UniqueName: \"kubernetes.io/projected/c028769b-0a8b-4a6e-8572-91c89c7879de-kube-api-access-jj4n4\") pod \"ovnkube-node-czsc7\" (UID: \"c028769b-0a8b-4a6e-8572-91c89c7879de\") " pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" May 25 23:35:04.552966 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.551007 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60-cni-binary-copy\") pod \"multus-additional-cni-plugins-7tm79\" (UID: \"08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60\") " pod="openshift-multus/multus-additional-cni-plugins-7tm79" May 25 23:35:04.552966 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.551038 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/254029cd-e52b-4d4a-904a-e30af2b6c681-sys-fs\") pod \"aws-ebs-csi-driver-node-l8xmd\" (UID: \"254029cd-e52b-4d4a-904a-e30af2b6c681\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8xmd" May 25 23:35:04.552966 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.551091 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7f8e8195-2832-443e-bf4d-3ffaf3ebc923-lib-modules\") pod \"tuned-xxcq5\" (UID: \"7f8e8195-2832-443e-bf4d-3ffaf3ebc923\") " pod="openshift-cluster-node-tuning-operator/tuned-xxcq5" May 25 23:35:04.552966 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.551118 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab4b6ed7-9908-40ab-821d-59fb80e9d23f-system-cni-dir\") pod \"multus-njpdd\" (UID: \"ab4b6ed7-9908-40ab-821d-59fb80e9d23f\") " pod="openshift-multus/multus-njpdd" May 25 23:35:04.552966 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.551145 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pc29b\" (UniqueName: \"kubernetes.io/projected/694e83a1-a7ed-4246-a57b-6ba3e80ae3ba-kube-api-access-pc29b\") pod \"network-metrics-daemon-7ws64\" (UID: \"694e83a1-a7ed-4246-a57b-6ba3e80ae3ba\") " pod="openshift-multus/network-metrics-daemon-7ws64" May 25 23:35:04.552966 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.551169 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c028769b-0a8b-4a6e-8572-91c89c7879de-log-socket\") pod \"ovnkube-node-czsc7\" (UID: \"c028769b-0a8b-4a6e-8572-91c89c7879de\") " pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" May 25 23:35:04.552966 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.551195 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c028769b-0a8b-4a6e-8572-91c89c7879de-ovn-node-metrics-cert\") pod \"ovnkube-node-czsc7\" (UID: \"c028769b-0a8b-4a6e-8572-91c89c7879de\") " pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" May 25 23:35:04.552966 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.551221 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ab4b6ed7-9908-40ab-821d-59fb80e9d23f-host-run-netns\") pod \"multus-njpdd\" (UID: \"ab4b6ed7-9908-40ab-821d-59fb80e9d23f\") " pod="openshift-multus/multus-njpdd" May 25 23:35:04.552966 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.551249 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7f8e8195-2832-443e-bf4d-3ffaf3ebc923-lib-modules\") pod \"tuned-xxcq5\" (UID: \"7f8e8195-2832-443e-bf4d-3ffaf3ebc923\") " pod="openshift-cluster-node-tuning-operator/tuned-xxcq5" May 25 23:35:04.552966 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.551316 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c028769b-0a8b-4a6e-8572-91c89c7879de-log-socket\") pod \"ovnkube-node-czsc7\" (UID: \"c028769b-0a8b-4a6e-8572-91c89c7879de\") " pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" May 25 23:35:04.553758 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.551322 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/254029cd-e52b-4d4a-904a-e30af2b6c681-sys-fs\") pod \"aws-ebs-csi-driver-node-l8xmd\" (UID: \"254029cd-e52b-4d4a-904a-e30af2b6c681\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8xmd" May 25 23:35:04.553758 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.551380 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e44b2c4f-59b8-4b76-80a5-1b3baa90a6db-konnectivity-ca\") pod \"konnectivity-agent-2qd5w\" (UID: \"e44b2c4f-59b8-4b76-80a5-1b3baa90a6db\") " pod="kube-system/konnectivity-agent-2qd5w" May 25 23:35:04.553758 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.551431 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c028769b-0a8b-4a6e-8572-91c89c7879de-host-run-ovn-kubernetes\") pod \"ovnkube-node-czsc7\" (UID: \"c028769b-0a8b-4a6e-8572-91c89c7879de\") " pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" May 25 23:35:04.553758 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.551596 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8b33ef50-e2af-46ac-879b-c7fe139c78d0-host-slash\") pod \"iptables-alerter-5hmf8\" (UID: \"8b33ef50-e2af-46ac-879b-c7fe139c78d0\") " pod="openshift-network-operator/iptables-alerter-5hmf8" May 25 23:35:04.553758 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.553165 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7f8e8195-2832-443e-bf4d-3ffaf3ebc923-etc-tuned\") pod \"tuned-xxcq5\" (UID: \"7f8e8195-2832-443e-bf4d-3ffaf3ebc923\") " pod="openshift-cluster-node-tuning-operator/tuned-xxcq5" May 25 23:35:04.553758 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.553278 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f8e8195-2832-443e-bf4d-3ffaf3ebc923-tmp\") pod \"tuned-xxcq5\" (UID: \"7f8e8195-2832-443e-bf4d-3ffaf3ebc923\") " pod="openshift-cluster-node-tuning-operator/tuned-xxcq5" May 25 23:35:04.553758 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.553412 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e44b2c4f-59b8-4b76-80a5-1b3baa90a6db-agent-certs\") pod \"konnectivity-agent-2qd5w\" (UID: \"e44b2c4f-59b8-4b76-80a5-1b3baa90a6db\") " pod="kube-system/konnectivity-agent-2qd5w" May 25 23:35:04.553758 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.553715 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c028769b-0a8b-4a6e-8572-91c89c7879de-ovn-node-metrics-cert\") pod \"ovnkube-node-czsc7\" (UID: \"c028769b-0a8b-4a6e-8572-91c89c7879de\") " pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" May 25 23:35:04.558500 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.558475 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mslqv\" (UniqueName: \"kubernetes.io/projected/7f8e8195-2832-443e-bf4d-3ffaf3ebc923-kube-api-access-mslqv\") pod \"tuned-xxcq5\" (UID: \"7f8e8195-2832-443e-bf4d-3ffaf3ebc923\") " pod="openshift-cluster-node-tuning-operator/tuned-xxcq5" May 25 23:35:04.561795 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:04.561771 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 25 23:35:04.561795 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:04.561796 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 25 23:35:04.561971 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:04.561810 2560 projected.go:194] Error preparing data for projected volume kube-api-access-7sxdv for pod openshift-network-diagnostics/network-check-target-twhc6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 23:35:04.561971 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:04.561876 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/053dd95b-4d61-480d-8a80-645cf902780e-kube-api-access-7sxdv podName:053dd95b-4d61-480d-8a80-645cf902780e nodeName:}" failed. No retries permitted until 2026-05-25 23:35:05.061857666 +0000 UTC m=+3.140753309 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7sxdv" (UniqueName: "kubernetes.io/projected/053dd95b-4d61-480d-8a80-645cf902780e-kube-api-access-7sxdv") pod "network-check-target-twhc6" (UID: "053dd95b-4d61-480d-8a80-645cf902780e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 23:35:04.564467 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.564441 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dj9md\" (UniqueName: \"kubernetes.io/projected/254029cd-e52b-4d4a-904a-e30af2b6c681-kube-api-access-dj9md\") pod \"aws-ebs-csi-driver-node-l8xmd\" (UID: \"254029cd-e52b-4d4a-904a-e30af2b6c681\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8xmd" May 25 23:35:04.564734 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.564708 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pc29b\" (UniqueName: \"kubernetes.io/projected/694e83a1-a7ed-4246-a57b-6ba3e80ae3ba-kube-api-access-pc29b\") pod \"network-metrics-daemon-7ws64\" (UID: \"694e83a1-a7ed-4246-a57b-6ba3e80ae3ba\") " pod="openshift-multus/network-metrics-daemon-7ws64" May 25 23:35:04.564814 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.564738 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jj4n4\" (UniqueName: \"kubernetes.io/projected/c028769b-0a8b-4a6e-8572-91c89c7879de-kube-api-access-jj4n4\") pod \"ovnkube-node-czsc7\" (UID: \"c028769b-0a8b-4a6e-8572-91c89c7879de\") " pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" May 25 23:35:04.565563 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.565541 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgxtf\" (UniqueName: \"kubernetes.io/projected/8b33ef50-e2af-46ac-879b-c7fe139c78d0-kube-api-access-cgxtf\") pod \"iptables-alerter-5hmf8\" (UID: \"8b33ef50-e2af-46ac-879b-c7fe139c78d0\") " pod="openshift-network-operator/iptables-alerter-5hmf8" May 25 23:35:04.651785 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.651736 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60-system-cni-dir\") pod \"multus-additional-cni-plugins-7tm79\" (UID: \"08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60\") " pod="openshift-multus/multus-additional-cni-plugins-7tm79" May 25 23:35:04.651785 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.651776 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60-os-release\") pod \"multus-additional-cni-plugins-7tm79\" (UID: \"08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60\") " pod="openshift-multus/multus-additional-cni-plugins-7tm79" May 25 23:35:04.652041 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.651801 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ab4b6ed7-9908-40ab-821d-59fb80e9d23f-multus-socket-dir-parent\") pod \"multus-njpdd\" (UID: \"ab4b6ed7-9908-40ab-821d-59fb80e9d23f\") " pod="openshift-multus/multus-njpdd" May 25 23:35:04.652041 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.651844 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7tm79\" (UID: \"08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60\") " pod="openshift-multus/multus-additional-cni-plugins-7tm79" May 25 23:35:04.652041 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.651851 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60-system-cni-dir\") pod \"multus-additional-cni-plugins-7tm79\" (UID: \"08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60\") " pod="openshift-multus/multus-additional-cni-plugins-7tm79" May 25 23:35:04.652041 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.651871 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ab4b6ed7-9908-40ab-821d-59fb80e9d23f-hostroot\") pod \"multus-njpdd\" (UID: \"ab4b6ed7-9908-40ab-821d-59fb80e9d23f\") " pod="openshift-multus/multus-njpdd" May 25 23:35:04.652041 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.651878 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60-os-release\") pod \"multus-additional-cni-plugins-7tm79\" (UID: \"08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60\") " pod="openshift-multus/multus-additional-cni-plugins-7tm79" May 25 23:35:04.652041 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.651898 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60-cni-binary-copy\") pod \"multus-additional-cni-plugins-7tm79\" (UID: \"08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60\") " pod="openshift-multus/multus-additional-cni-plugins-7tm79" May 25 23:35:04.652041 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.651943 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ab4b6ed7-9908-40ab-821d-59fb80e9d23f-multus-socket-dir-parent\") pod \"multus-njpdd\" (UID: \"ab4b6ed7-9908-40ab-821d-59fb80e9d23f\") " pod="openshift-multus/multus-njpdd" May 25 23:35:04.652041 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.651945 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ab4b6ed7-9908-40ab-821d-59fb80e9d23f-hostroot\") pod \"multus-njpdd\" (UID: \"ab4b6ed7-9908-40ab-821d-59fb80e9d23f\") " pod="openshift-multus/multus-njpdd" May 25 23:35:04.652041 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.652007 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab4b6ed7-9908-40ab-821d-59fb80e9d23f-system-cni-dir\") pod \"multus-njpdd\" (UID: \"ab4b6ed7-9908-40ab-821d-59fb80e9d23f\") " pod="openshift-multus/multus-njpdd" May 25 23:35:04.652041 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.652046 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ab4b6ed7-9908-40ab-821d-59fb80e9d23f-host-run-netns\") pod \"multus-njpdd\" (UID: \"ab4b6ed7-9908-40ab-821d-59fb80e9d23f\") " pod="openshift-multus/multus-njpdd" May 25 23:35:04.652514 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.652068 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab4b6ed7-9908-40ab-821d-59fb80e9d23f-host-var-lib-kubelet\") pod \"multus-njpdd\" (UID: \"ab4b6ed7-9908-40ab-821d-59fb80e9d23f\") " pod="openshift-multus/multus-njpdd" May 25 23:35:04.652514 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.652085 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab4b6ed7-9908-40ab-821d-59fb80e9d23f-system-cni-dir\") pod \"multus-njpdd\" (UID: \"ab4b6ed7-9908-40ab-821d-59fb80e9d23f\") " pod="openshift-multus/multus-njpdd" May 25 23:35:04.652514 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.652096 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fe7ac5fe-b41b-41e5-b935-9c562ade089b-serviceca\") pod \"node-ca-k2fns\" (UID: \"fe7ac5fe-b41b-41e5-b935-9c562ade089b\") " pod="openshift-image-registry/node-ca-k2fns" May 25 23:35:04.652514 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.652129 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab4b6ed7-9908-40ab-821d-59fb80e9d23f-host-var-lib-kubelet\") pod \"multus-njpdd\" (UID: \"ab4b6ed7-9908-40ab-821d-59fb80e9d23f\") " pod="openshift-multus/multus-njpdd" May 25 23:35:04.652514 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.652140 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ab4b6ed7-9908-40ab-821d-59fb80e9d23f-host-run-netns\") pod \"multus-njpdd\" (UID: \"ab4b6ed7-9908-40ab-821d-59fb80e9d23f\") " pod="openshift-multus/multus-njpdd" May 25 23:35:04.652514 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.652163 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4rq4x\" (UniqueName: \"kubernetes.io/projected/fe7ac5fe-b41b-41e5-b935-9c562ade089b-kube-api-access-4rq4x\") pod \"node-ca-k2fns\" (UID: \"fe7ac5fe-b41b-41e5-b935-9c562ade089b\") " pod="openshift-image-registry/node-ca-k2fns" May 25 23:35:04.652514 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.652191 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ab4b6ed7-9908-40ab-821d-59fb80e9d23f-host-var-lib-cni-bin\") pod \"multus-njpdd\" (UID: \"ab4b6ed7-9908-40ab-821d-59fb80e9d23f\") " pod="openshift-multus/multus-njpdd" May 25 23:35:04.652514 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.652222 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7tm79\" (UID: \"08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60\") " pod="openshift-multus/multus-additional-cni-plugins-7tm79" May 25 23:35:04.652514 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.652249 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab4b6ed7-9908-40ab-821d-59fb80e9d23f-etc-kubernetes\") pod \"multus-njpdd\" (UID: \"ab4b6ed7-9908-40ab-821d-59fb80e9d23f\") " pod="openshift-multus/multus-njpdd" May 25 23:35:04.652514 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.652275 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fe7ac5fe-b41b-41e5-b935-9c562ade089b-host\") pod \"node-ca-k2fns\" (UID: \"fe7ac5fe-b41b-41e5-b935-9c562ade089b\") " pod="openshift-image-registry/node-ca-k2fns" May 25 23:35:04.652514 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.652289 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ab4b6ed7-9908-40ab-821d-59fb80e9d23f-host-var-lib-cni-bin\") pod \"multus-njpdd\" (UID: \"ab4b6ed7-9908-40ab-821d-59fb80e9d23f\") " pod="openshift-multus/multus-njpdd" May 25 23:35:04.652514 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.652303 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab4b6ed7-9908-40ab-821d-59fb80e9d23f-multus-cni-dir\") pod \"multus-njpdd\" (UID: \"ab4b6ed7-9908-40ab-821d-59fb80e9d23f\") " pod="openshift-multus/multus-njpdd" May 25 23:35:04.652514 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.652330 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ab4b6ed7-9908-40ab-821d-59fb80e9d23f-host-run-k8s-cni-cncf-io\") pod \"multus-njpdd\" (UID: \"ab4b6ed7-9908-40ab-821d-59fb80e9d23f\") " pod="openshift-multus/multus-njpdd" May 25 23:35:04.652514 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.652357 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ab4b6ed7-9908-40ab-821d-59fb80e9d23f-cni-binary-copy\") pod \"multus-njpdd\" (UID: \"ab4b6ed7-9908-40ab-821d-59fb80e9d23f\") " pod="openshift-multus/multus-njpdd" May 25 23:35:04.652514 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.652383 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ab4b6ed7-9908-40ab-821d-59fb80e9d23f-multus-conf-dir\") pod \"multus-njpdd\" (UID: \"ab4b6ed7-9908-40ab-821d-59fb80e9d23f\") " pod="openshift-multus/multus-njpdd" May 25 23:35:04.652514 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.652406 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ab4b6ed7-9908-40ab-821d-59fb80e9d23f-multus-daemon-config\") pod \"multus-njpdd\" (UID: \"ab4b6ed7-9908-40ab-821d-59fb80e9d23f\") " pod="openshift-multus/multus-njpdd" May 25 23:35:04.652514 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.652433 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60-cnibin\") pod \"multus-additional-cni-plugins-7tm79\" (UID: \"08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60\") " pod="openshift-multus/multus-additional-cni-plugins-7tm79" May 25 23:35:04.652514 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.652458 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7tm79\" (UID: \"08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60\") " pod="openshift-multus/multus-additional-cni-plugins-7tm79" May 25 23:35:04.653217 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.652472 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab4b6ed7-9908-40ab-821d-59fb80e9d23f-multus-cni-dir\") pod \"multus-njpdd\" (UID: \"ab4b6ed7-9908-40ab-821d-59fb80e9d23f\") " pod="openshift-multus/multus-njpdd" May 25 23:35:04.653217 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.652473 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60-cni-binary-copy\") pod \"multus-additional-cni-plugins-7tm79\" (UID: \"08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60\") " pod="openshift-multus/multus-additional-cni-plugins-7tm79" May 25 23:35:04.653217 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.652483 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ab4b6ed7-9908-40ab-821d-59fb80e9d23f-host-run-multus-certs\") pod \"multus-njpdd\" (UID: \"ab4b6ed7-9908-40ab-821d-59fb80e9d23f\") " pod="openshift-multus/multus-njpdd" May 25 23:35:04.653217 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.652506 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab4b6ed7-9908-40ab-821d-59fb80e9d23f-etc-kubernetes\") pod \"multus-njpdd\" (UID: \"ab4b6ed7-9908-40ab-821d-59fb80e9d23f\") " pod="openshift-multus/multus-njpdd" May 25 23:35:04.653217 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.652486 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fe7ac5fe-b41b-41e5-b935-9c562ade089b-serviceca\") pod \"node-ca-k2fns\" (UID: \"fe7ac5fe-b41b-41e5-b935-9c562ade089b\") " pod="openshift-image-registry/node-ca-k2fns" May 25 23:35:04.653217 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.652528 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fe7ac5fe-b41b-41e5-b935-9c562ade089b-host\") pod \"node-ca-k2fns\" (UID: \"fe7ac5fe-b41b-41e5-b935-9c562ade089b\") " pod="openshift-image-registry/node-ca-k2fns" May 25 23:35:04.653217 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.652510 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lq4pn\" (UniqueName: \"kubernetes.io/projected/ab4b6ed7-9908-40ab-821d-59fb80e9d23f-kube-api-access-lq4pn\") pod \"multus-njpdd\" (UID: \"ab4b6ed7-9908-40ab-821d-59fb80e9d23f\") " pod="openshift-multus/multus-njpdd" May 25 23:35:04.653217 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.652554 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ab4b6ed7-9908-40ab-821d-59fb80e9d23f-host-run-k8s-cni-cncf-io\") pod \"multus-njpdd\" (UID: \"ab4b6ed7-9908-40ab-821d-59fb80e9d23f\") " pod="openshift-multus/multus-njpdd" May 25 23:35:04.653217 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.652588 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ab4b6ed7-9908-40ab-821d-59fb80e9d23f-multus-conf-dir\") pod \"multus-njpdd\" (UID: \"ab4b6ed7-9908-40ab-821d-59fb80e9d23f\") " pod="openshift-multus/multus-njpdd" May 25 23:35:04.653217 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.652593 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7tm79\" (UID: \"08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60\") " pod="openshift-multus/multus-additional-cni-plugins-7tm79" May 25 23:35:04.653217 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.652598 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bl66j\" (UniqueName: \"kubernetes.io/projected/08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60-kube-api-access-bl66j\") pod \"multus-additional-cni-plugins-7tm79\" (UID: \"08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60\") " pod="openshift-multus/multus-additional-cni-plugins-7tm79" May 25 23:35:04.653217 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.652608 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ab4b6ed7-9908-40ab-821d-59fb80e9d23f-host-run-multus-certs\") pod \"multus-njpdd\" (UID: \"ab4b6ed7-9908-40ab-821d-59fb80e9d23f\") " pod="openshift-multus/multus-njpdd" May 25 23:35:04.653217 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.652638 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ab4b6ed7-9908-40ab-821d-59fb80e9d23f-cnibin\") pod \"multus-njpdd\" (UID: \"ab4b6ed7-9908-40ab-821d-59fb80e9d23f\") " pod="openshift-multus/multus-njpdd" May 25 23:35:04.653217 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.652663 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ab4b6ed7-9908-40ab-821d-59fb80e9d23f-os-release\") pod \"multus-njpdd\" (UID: \"ab4b6ed7-9908-40ab-821d-59fb80e9d23f\") " pod="openshift-multus/multus-njpdd" May 25 23:35:04.653217 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.652686 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ab4b6ed7-9908-40ab-821d-59fb80e9d23f-host-var-lib-cni-multus\") pod \"multus-njpdd\" (UID: \"ab4b6ed7-9908-40ab-821d-59fb80e9d23f\") " pod="openshift-multus/multus-njpdd" May 25 23:35:04.653217 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.652733 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60-cnibin\") pod \"multus-additional-cni-plugins-7tm79\" (UID: \"08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60\") " pod="openshift-multus/multus-additional-cni-plugins-7tm79" May 25 23:35:04.653217 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.652751 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ab4b6ed7-9908-40ab-821d-59fb80e9d23f-host-var-lib-cni-multus\") pod \"multus-njpdd\" (UID: \"ab4b6ed7-9908-40ab-821d-59fb80e9d23f\") " pod="openshift-multus/multus-njpdd" May 25 23:35:04.653217 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.652780 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ab4b6ed7-9908-40ab-821d-59fb80e9d23f-cnibin\") pod \"multus-njpdd\" (UID: \"ab4b6ed7-9908-40ab-821d-59fb80e9d23f\") " pod="openshift-multus/multus-njpdd" May 25 23:35:04.653785 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.652836 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ab4b6ed7-9908-40ab-821d-59fb80e9d23f-os-release\") pod \"multus-njpdd\" (UID: \"ab4b6ed7-9908-40ab-821d-59fb80e9d23f\") " pod="openshift-multus/multus-njpdd" May 25 23:35:04.653785 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.653014 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7tm79\" (UID: \"08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60\") " pod="openshift-multus/multus-additional-cni-plugins-7tm79" May 25 23:35:04.653785 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.653098 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ab4b6ed7-9908-40ab-821d-59fb80e9d23f-multus-daemon-config\") pod \"multus-njpdd\" (UID: \"ab4b6ed7-9908-40ab-821d-59fb80e9d23f\") " pod="openshift-multus/multus-njpdd" May 25 23:35:04.653785 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.653100 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ab4b6ed7-9908-40ab-821d-59fb80e9d23f-cni-binary-copy\") pod \"multus-njpdd\" (UID: \"ab4b6ed7-9908-40ab-821d-59fb80e9d23f\") " pod="openshift-multus/multus-njpdd" May 25 23:35:04.653785 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.653291 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7tm79\" (UID: \"08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60\") " pod="openshift-multus/multus-additional-cni-plugins-7tm79" May 25 23:35:04.661242 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.661150 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rq4x\" (UniqueName: \"kubernetes.io/projected/fe7ac5fe-b41b-41e5-b935-9c562ade089b-kube-api-access-4rq4x\") pod \"node-ca-k2fns\" (UID: \"fe7ac5fe-b41b-41e5-b935-9c562ade089b\") " pod="openshift-image-registry/node-ca-k2fns" May 25 23:35:04.661242 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.661156 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bl66j\" (UniqueName: \"kubernetes.io/projected/08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60-kube-api-access-bl66j\") pod \"multus-additional-cni-plugins-7tm79\" (UID: \"08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60\") " pod="openshift-multus/multus-additional-cni-plugins-7tm79" May 25 23:35:04.661496 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.661473 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lq4pn\" (UniqueName: \"kubernetes.io/projected/ab4b6ed7-9908-40ab-821d-59fb80e9d23f-kube-api-access-lq4pn\") pod \"multus-njpdd\" (UID: \"ab4b6ed7-9908-40ab-821d-59fb80e9d23f\") " pod="openshift-multus/multus-njpdd" May 25 23:35:04.681661 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.681626 2560 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 25 23:35:04.743917 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.743883 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2qd5w" May 25 23:35:04.751741 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.751713 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8xmd" May 25 23:35:04.760565 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.760542 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5hmf8" May 25 23:35:04.764292 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.764267 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" May 25 23:35:04.770926 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.770906 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xxcq5" May 25 23:35:04.777447 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.777428 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-k2fns" May 25 23:35:04.785060 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.785032 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7tm79" May 25 23:35:04.790105 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:04.790084 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-njpdd" May 25 23:35:05.055238 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:05.055151 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/694e83a1-a7ed-4246-a57b-6ba3e80ae3ba-metrics-certs\") pod \"network-metrics-daemon-7ws64\" (UID: \"694e83a1-a7ed-4246-a57b-6ba3e80ae3ba\") " pod="openshift-multus/network-metrics-daemon-7ws64" May 25 23:35:05.055403 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:05.055281 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 25 23:35:05.055403 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:05.055338 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/694e83a1-a7ed-4246-a57b-6ba3e80ae3ba-metrics-certs podName:694e83a1-a7ed-4246-a57b-6ba3e80ae3ba nodeName:}" failed. No retries permitted until 2026-05-25 23:35:06.055323039 +0000 UTC m=+4.134218670 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/694e83a1-a7ed-4246-a57b-6ba3e80ae3ba-metrics-certs") pod "network-metrics-daemon-7ws64" (UID: "694e83a1-a7ed-4246-a57b-6ba3e80ae3ba") : object "openshift-multus"/"metrics-daemon-secret" not registered May 25 23:35:05.156374 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:05.156021 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7sxdv\" (UniqueName: \"kubernetes.io/projected/053dd95b-4d61-480d-8a80-645cf902780e-kube-api-access-7sxdv\") pod \"network-check-target-twhc6\" (UID: \"053dd95b-4d61-480d-8a80-645cf902780e\") " pod="openshift-network-diagnostics/network-check-target-twhc6" May 25 23:35:05.156374 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:05.156263 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 25 23:35:05.156374 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:05.156286 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 25 23:35:05.156374 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:05.156309 2560 projected.go:194] Error preparing data for projected volume kube-api-access-7sxdv for pod openshift-network-diagnostics/network-check-target-twhc6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 23:35:05.156679 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:05.156383 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/053dd95b-4d61-480d-8a80-645cf902780e-kube-api-access-7sxdv podName:053dd95b-4d61-480d-8a80-645cf902780e nodeName:}" failed. No retries permitted until 2026-05-25 23:35:06.156356344 +0000 UTC m=+4.235251983 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7sxdv" (UniqueName: "kubernetes.io/projected/053dd95b-4d61-480d-8a80-645cf902780e-kube-api-access-7sxdv") pod "network-check-target-twhc6" (UID: "053dd95b-4d61-480d-8a80-645cf902780e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 23:35:05.160101 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:05.160003 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc028769b_0a8b_4a6e_8572_91c89c7879de.slice/crio-3f43c510e73a1f09c27437bca341b826c20b640944fafcc3ed0628a400d36269 WatchSource:0}: Error finding container 3f43c510e73a1f09c27437bca341b826c20b640944fafcc3ed0628a400d36269: Status 404 returned error can't find the container with id 3f43c510e73a1f09c27437bca341b826c20b640944fafcc3ed0628a400d36269 May 25 23:35:05.160272 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:05.160249 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b33ef50_e2af_46ac_879b_c7fe139c78d0.slice/crio-6b2273b0ce44c54375a72fa412aae08b50c54bc7cf90d88548f76ee7674f3733 WatchSource:0}: Error finding container 6b2273b0ce44c54375a72fa412aae08b50c54bc7cf90d88548f76ee7674f3733: Status 404 returned error can't find the container with id 6b2273b0ce44c54375a72fa412aae08b50c54bc7cf90d88548f76ee7674f3733 May 25 23:35:05.162647 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:05.162625 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe7ac5fe_b41b_41e5_b935_9c562ade089b.slice/crio-71056e738f26efa4fbd2df22d8fbab933b46808d49d09da7b163b8024b04949f WatchSource:0}: Error finding container 71056e738f26efa4fbd2df22d8fbab933b46808d49d09da7b163b8024b04949f: Status 404 returned error can't find the container with id 71056e738f26efa4fbd2df22d8fbab933b46808d49d09da7b163b8024b04949f May 25 23:35:05.163355 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:05.163328 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08c094dc_ad87_41cf_b0f5_8ac7eb5f1c60.slice/crio-36c9abe937163572517bac27f9c0c9a727b0016e9aafe681d4c30411add1fc64 WatchSource:0}: Error finding container 36c9abe937163572517bac27f9c0c9a727b0016e9aafe681d4c30411add1fc64: Status 404 returned error can't find the container with id 36c9abe937163572517bac27f9c0c9a727b0016e9aafe681d4c30411add1fc64 May 25 23:35:05.164188 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:05.164147 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f8e8195_2832_443e_bf4d_3ffaf3ebc923.slice/crio-248d0e2558d76cba2d2048cb1bae891cf2b55821f50dba81979871deefeb3c0a WatchSource:0}: Error finding container 248d0e2558d76cba2d2048cb1bae891cf2b55821f50dba81979871deefeb3c0a: Status 404 returned error can't find the container with id 248d0e2558d76cba2d2048cb1bae891cf2b55821f50dba81979871deefeb3c0a May 25 23:35:05.165676 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:05.165652 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab4b6ed7_9908_40ab_821d_59fb80e9d23f.slice/crio-457790bbc32f15a7a6e53daba24147586738eb87eb8ec36463fe0c4c2720263a WatchSource:0}: Error finding container 457790bbc32f15a7a6e53daba24147586738eb87eb8ec36463fe0c4c2720263a: Status 404 returned error can't find the container with id 457790bbc32f15a7a6e53daba24147586738eb87eb8ec36463fe0c4c2720263a May 25 23:35:05.166698 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:05.166679 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod254029cd_e52b_4d4a_904a_e30af2b6c681.slice/crio-1a131b1030032a26137d700bb90d307fd649a04db48c032630e1240cd14440c3 WatchSource:0}: Error finding container 1a131b1030032a26137d700bb90d307fd649a04db48c032630e1240cd14440c3: Status 404 returned error can't find the container with id 1a131b1030032a26137d700bb90d307fd649a04db48c032630e1240cd14440c3 May 25 23:35:05.510386 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:05.510346 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-24 23:30:03 +0000 UTC" deadline="2027-11-23 19:56:39.388938507 +0000 UTC" May 25 23:35:05.510386 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:05.510382 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13124h21m33.878560457s" May 25 23:35:05.554379 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:05.554331 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2qd5w" event={"ID":"e44b2c4f-59b8-4b76-80a5-1b3baa90a6db","Type":"ContainerStarted","Data":"2aaae1a9b0306489ff2488755b2c1dcccdc694144915b96bf18a38079a0a8e4d"} May 25 23:35:05.556118 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:05.556080 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7tm79" event={"ID":"08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60","Type":"ContainerStarted","Data":"36c9abe937163572517bac27f9c0c9a727b0016e9aafe681d4c30411add1fc64"} May 25 23:35:05.559063 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:05.559033 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" event={"ID":"c028769b-0a8b-4a6e-8572-91c89c7879de","Type":"ContainerStarted","Data":"3f43c510e73a1f09c27437bca341b826c20b640944fafcc3ed0628a400d36269"} May 25 23:35:05.566486 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:05.566432 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-170.ec2.internal" event={"ID":"e7a923675e9bf9e023936dfbefc39d5a","Type":"ContainerStarted","Data":"4c7a74adea0b63c4a014d198e66fc7e982513f7f88aa07768014d574c5316231"} May 25 23:35:05.571820 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:05.571790 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8xmd" event={"ID":"254029cd-e52b-4d4a-904a-e30af2b6c681","Type":"ContainerStarted","Data":"1a131b1030032a26137d700bb90d307fd649a04db48c032630e1240cd14440c3"} May 25 23:35:05.574200 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:05.574172 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-njpdd" event={"ID":"ab4b6ed7-9908-40ab-821d-59fb80e9d23f","Type":"ContainerStarted","Data":"457790bbc32f15a7a6e53daba24147586738eb87eb8ec36463fe0c4c2720263a"} May 25 23:35:05.577492 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:05.577464 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xxcq5" event={"ID":"7f8e8195-2832-443e-bf4d-3ffaf3ebc923","Type":"ContainerStarted","Data":"248d0e2558d76cba2d2048cb1bae891cf2b55821f50dba81979871deefeb3c0a"} May 25 23:35:05.579710 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:05.579676 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-k2fns" event={"ID":"fe7ac5fe-b41b-41e5-b935-9c562ade089b","Type":"ContainerStarted","Data":"71056e738f26efa4fbd2df22d8fbab933b46808d49d09da7b163b8024b04949f"} May 25 23:35:05.582075 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:05.582053 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5hmf8" event={"ID":"8b33ef50-e2af-46ac-879b-c7fe139c78d0","Type":"ContainerStarted","Data":"6b2273b0ce44c54375a72fa412aae08b50c54bc7cf90d88548f76ee7674f3733"} May 25 23:35:05.586004 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:05.585951 2560 generic.go:358] "Generic (PLEG): container finished" podID="616b33d91d8da23cb5532266feb58b09" containerID="51bc4d480c84516ab16faf1bf8dfe1be6bcc2e79508aea7f79c0f9ba68e19753" exitCode=0 May 25 23:35:05.586212 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:05.586164 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-170.ec2.internal" event={"ID":"616b33d91d8da23cb5532266feb58b09","Type":"ContainerDied","Data":"51bc4d480c84516ab16faf1bf8dfe1be6bcc2e79508aea7f79c0f9ba68e19753"} May 25 23:35:05.602349 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:05.602300 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-170.ec2.internal" podStartSLOduration=2.6022822530000003 podStartE2EDuration="2.602282253s" podCreationTimestamp="2026-05-25 23:35:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 23:35:05.586078155 +0000 UTC m=+3.664973815" watchObservedRunningTime="2026-05-25 23:35:05.602282253 +0000 UTC m=+3.681177903" May 25 23:35:06.064163 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:06.063452 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/694e83a1-a7ed-4246-a57b-6ba3e80ae3ba-metrics-certs\") pod \"network-metrics-daemon-7ws64\" (UID: \"694e83a1-a7ed-4246-a57b-6ba3e80ae3ba\") " pod="openshift-multus/network-metrics-daemon-7ws64" May 25 23:35:06.064163 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:06.063658 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 25 23:35:06.064163 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:06.063727 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/694e83a1-a7ed-4246-a57b-6ba3e80ae3ba-metrics-certs podName:694e83a1-a7ed-4246-a57b-6ba3e80ae3ba nodeName:}" failed. No retries permitted until 2026-05-25 23:35:08.063705036 +0000 UTC m=+6.142600693 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/694e83a1-a7ed-4246-a57b-6ba3e80ae3ba-metrics-certs") pod "network-metrics-daemon-7ws64" (UID: "694e83a1-a7ed-4246-a57b-6ba3e80ae3ba") : object "openshift-multus"/"metrics-daemon-secret" not registered May 25 23:35:06.164823 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:06.164772 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7sxdv\" (UniqueName: \"kubernetes.io/projected/053dd95b-4d61-480d-8a80-645cf902780e-kube-api-access-7sxdv\") pod \"network-check-target-twhc6\" (UID: \"053dd95b-4d61-480d-8a80-645cf902780e\") " pod="openshift-network-diagnostics/network-check-target-twhc6" May 25 23:35:06.165037 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:06.165008 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 25 23:35:06.165037 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:06.165032 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 25 23:35:06.165166 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:06.165044 2560 projected.go:194] Error preparing data for projected volume kube-api-access-7sxdv for pod openshift-network-diagnostics/network-check-target-twhc6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 23:35:06.165166 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:06.165103 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/053dd95b-4d61-480d-8a80-645cf902780e-kube-api-access-7sxdv podName:053dd95b-4d61-480d-8a80-645cf902780e nodeName:}" failed. No retries permitted until 2026-05-25 23:35:08.16508413 +0000 UTC m=+6.243979772 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7sxdv" (UniqueName: "kubernetes.io/projected/053dd95b-4d61-480d-8a80-645cf902780e-kube-api-access-7sxdv") pod "network-check-target-twhc6" (UID: "053dd95b-4d61-480d-8a80-645cf902780e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 23:35:06.543958 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:06.543345 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ws64" May 25 23:35:06.543958 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:06.543482 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ws64" podUID="694e83a1-a7ed-4246-a57b-6ba3e80ae3ba" May 25 23:35:06.543958 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:06.543581 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-twhc6" May 25 23:35:06.543958 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:06.543640 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-twhc6" podUID="053dd95b-4d61-480d-8a80-645cf902780e" May 25 23:35:06.594402 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:06.594363 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-170.ec2.internal" event={"ID":"616b33d91d8da23cb5532266feb58b09","Type":"ContainerStarted","Data":"fc4391733b2471425026246327b199348f51a1c7741c90218ec396a40806664a"} May 25 23:35:06.626055 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:06.625543 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-170.ec2.internal" podStartSLOduration=3.625524128 podStartE2EDuration="3.625524128s" podCreationTimestamp="2026-05-25 23:35:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 23:35:06.62470942 +0000 UTC m=+4.703605071" watchObservedRunningTime="2026-05-25 23:35:06.625524128 +0000 UTC m=+4.704419779" May 25 23:35:08.080953 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:08.080911 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/694e83a1-a7ed-4246-a57b-6ba3e80ae3ba-metrics-certs\") pod \"network-metrics-daemon-7ws64\" (UID: \"694e83a1-a7ed-4246-a57b-6ba3e80ae3ba\") " pod="openshift-multus/network-metrics-daemon-7ws64" May 25 23:35:08.081438 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:08.081108 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 25 23:35:08.081438 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:08.081174 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/694e83a1-a7ed-4246-a57b-6ba3e80ae3ba-metrics-certs podName:694e83a1-a7ed-4246-a57b-6ba3e80ae3ba nodeName:}" failed. No retries permitted until 2026-05-25 23:35:12.081154225 +0000 UTC m=+10.160049857 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/694e83a1-a7ed-4246-a57b-6ba3e80ae3ba-metrics-certs") pod "network-metrics-daemon-7ws64" (UID: "694e83a1-a7ed-4246-a57b-6ba3e80ae3ba") : object "openshift-multus"/"metrics-daemon-secret" not registered May 25 23:35:08.182232 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:08.182192 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7sxdv\" (UniqueName: \"kubernetes.io/projected/053dd95b-4d61-480d-8a80-645cf902780e-kube-api-access-7sxdv\") pod \"network-check-target-twhc6\" (UID: \"053dd95b-4d61-480d-8a80-645cf902780e\") " pod="openshift-network-diagnostics/network-check-target-twhc6" May 25 23:35:08.182415 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:08.182372 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 25 23:35:08.182415 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:08.182391 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 25 23:35:08.182415 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:08.182405 2560 projected.go:194] Error preparing data for projected volume kube-api-access-7sxdv for pod openshift-network-diagnostics/network-check-target-twhc6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 23:35:08.182577 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:08.182463 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/053dd95b-4d61-480d-8a80-645cf902780e-kube-api-access-7sxdv podName:053dd95b-4d61-480d-8a80-645cf902780e nodeName:}" failed. No retries permitted until 2026-05-25 23:35:12.18244436 +0000 UTC m=+10.261340005 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7sxdv" (UniqueName: "kubernetes.io/projected/053dd95b-4d61-480d-8a80-645cf902780e-kube-api-access-7sxdv") pod "network-check-target-twhc6" (UID: "053dd95b-4d61-480d-8a80-645cf902780e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 23:35:08.542458 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:08.542387 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ws64" May 25 23:35:08.542582 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:08.542505 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ws64" podUID="694e83a1-a7ed-4246-a57b-6ba3e80ae3ba" May 25 23:35:08.542839 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:08.542822 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-twhc6" May 25 23:35:08.542908 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:08.542887 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-twhc6" podUID="053dd95b-4d61-480d-8a80-645cf902780e" May 25 23:35:10.541163 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:10.541126 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ws64" May 25 23:35:10.541744 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:10.541274 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ws64" podUID="694e83a1-a7ed-4246-a57b-6ba3e80ae3ba" May 25 23:35:10.541744 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:10.541701 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-twhc6" May 25 23:35:10.541852 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:10.541803 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-twhc6" podUID="053dd95b-4d61-480d-8a80-645cf902780e" May 25 23:35:12.116789 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:12.116739 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/694e83a1-a7ed-4246-a57b-6ba3e80ae3ba-metrics-certs\") pod \"network-metrics-daemon-7ws64\" (UID: \"694e83a1-a7ed-4246-a57b-6ba3e80ae3ba\") " pod="openshift-multus/network-metrics-daemon-7ws64" May 25 23:35:12.117287 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:12.116882 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 25 23:35:12.117287 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:12.116950 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/694e83a1-a7ed-4246-a57b-6ba3e80ae3ba-metrics-certs podName:694e83a1-a7ed-4246-a57b-6ba3e80ae3ba nodeName:}" failed. No retries permitted until 2026-05-25 23:35:20.116929938 +0000 UTC m=+18.195825581 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/694e83a1-a7ed-4246-a57b-6ba3e80ae3ba-metrics-certs") pod "network-metrics-daemon-7ws64" (UID: "694e83a1-a7ed-4246-a57b-6ba3e80ae3ba") : object "openshift-multus"/"metrics-daemon-secret" not registered May 25 23:35:12.218038 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:12.217952 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7sxdv\" (UniqueName: \"kubernetes.io/projected/053dd95b-4d61-480d-8a80-645cf902780e-kube-api-access-7sxdv\") pod \"network-check-target-twhc6\" (UID: \"053dd95b-4d61-480d-8a80-645cf902780e\") " pod="openshift-network-diagnostics/network-check-target-twhc6" May 25 23:35:12.218236 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:12.218140 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 25 23:35:12.218236 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:12.218165 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 25 23:35:12.218236 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:12.218178 2560 projected.go:194] Error preparing data for projected volume kube-api-access-7sxdv for pod openshift-network-diagnostics/network-check-target-twhc6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 23:35:12.218390 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:12.218237 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/053dd95b-4d61-480d-8a80-645cf902780e-kube-api-access-7sxdv podName:053dd95b-4d61-480d-8a80-645cf902780e nodeName:}" failed. No retries permitted until 2026-05-25 23:35:20.218219218 +0000 UTC m=+18.297114849 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7sxdv" (UniqueName: "kubernetes.io/projected/053dd95b-4d61-480d-8a80-645cf902780e-kube-api-access-7sxdv") pod "network-check-target-twhc6" (UID: "053dd95b-4d61-480d-8a80-645cf902780e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 23:35:12.541303 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:12.541271 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-twhc6" May 25 23:35:12.541495 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:12.541373 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-twhc6" podUID="053dd95b-4d61-480d-8a80-645cf902780e" May 25 23:35:12.541836 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:12.541816 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ws64" May 25 23:35:12.541933 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:12.541917 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ws64" podUID="694e83a1-a7ed-4246-a57b-6ba3e80ae3ba" May 25 23:35:14.540781 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:14.540749 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-twhc6" May 25 23:35:14.540781 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:14.540771 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ws64" May 25 23:35:14.541217 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:14.540864 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-twhc6" podUID="053dd95b-4d61-480d-8a80-645cf902780e" May 25 23:35:14.541217 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:14.541039 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ws64" podUID="694e83a1-a7ed-4246-a57b-6ba3e80ae3ba" May 25 23:35:14.994938 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:14.994904 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-m6fz8"] May 25 23:35:14.997711 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:14.997690 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-m6fz8" May 25 23:35:15.001393 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:15.001059 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 25 23:35:15.001393 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:15.001066 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-s5hv5\"" May 25 23:35:15.001932 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:15.001914 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 25 23:35:15.040284 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:15.040244 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/44b28b26-a51c-45ae-b6ff-4511af730e83-hosts-file\") pod \"node-resolver-m6fz8\" (UID: \"44b28b26-a51c-45ae-b6ff-4511af730e83\") " pod="openshift-dns/node-resolver-m6fz8" May 25 23:35:15.040284 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:15.040290 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpxw4\" (UniqueName: \"kubernetes.io/projected/44b28b26-a51c-45ae-b6ff-4511af730e83-kube-api-access-jpxw4\") pod \"node-resolver-m6fz8\" (UID: \"44b28b26-a51c-45ae-b6ff-4511af730e83\") " pod="openshift-dns/node-resolver-m6fz8" May 25 23:35:15.040508 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:15.040310 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44b28b26-a51c-45ae-b6ff-4511af730e83-tmp-dir\") pod \"node-resolver-m6fz8\" (UID: \"44b28b26-a51c-45ae-b6ff-4511af730e83\") " pod="openshift-dns/node-resolver-m6fz8" May 25 23:35:15.141365 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:15.141321 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/44b28b26-a51c-45ae-b6ff-4511af730e83-hosts-file\") pod \"node-resolver-m6fz8\" (UID: \"44b28b26-a51c-45ae-b6ff-4511af730e83\") " pod="openshift-dns/node-resolver-m6fz8" May 25 23:35:15.141553 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:15.141381 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jpxw4\" (UniqueName: \"kubernetes.io/projected/44b28b26-a51c-45ae-b6ff-4511af730e83-kube-api-access-jpxw4\") pod \"node-resolver-m6fz8\" (UID: \"44b28b26-a51c-45ae-b6ff-4511af730e83\") " pod="openshift-dns/node-resolver-m6fz8" May 25 23:35:15.141553 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:15.141407 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44b28b26-a51c-45ae-b6ff-4511af730e83-tmp-dir\") pod \"node-resolver-m6fz8\" (UID: \"44b28b26-a51c-45ae-b6ff-4511af730e83\") " pod="openshift-dns/node-resolver-m6fz8" May 25 23:35:15.141553 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:15.141461 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/44b28b26-a51c-45ae-b6ff-4511af730e83-hosts-file\") pod \"node-resolver-m6fz8\" (UID: \"44b28b26-a51c-45ae-b6ff-4511af730e83\") " pod="openshift-dns/node-resolver-m6fz8" May 25 23:35:15.141777 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:15.141759 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44b28b26-a51c-45ae-b6ff-4511af730e83-tmp-dir\") pod \"node-resolver-m6fz8\" (UID: \"44b28b26-a51c-45ae-b6ff-4511af730e83\") " pod="openshift-dns/node-resolver-m6fz8" May 25 23:35:15.155038 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:15.155008 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpxw4\" (UniqueName: \"kubernetes.io/projected/44b28b26-a51c-45ae-b6ff-4511af730e83-kube-api-access-jpxw4\") pod \"node-resolver-m6fz8\" (UID: \"44b28b26-a51c-45ae-b6ff-4511af730e83\") " pod="openshift-dns/node-resolver-m6fz8" May 25 23:35:15.308807 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:15.308727 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-m6fz8" May 25 23:35:16.540334 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:16.540300 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-twhc6" May 25 23:35:16.540702 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:16.540419 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-twhc6" podUID="053dd95b-4d61-480d-8a80-645cf902780e" May 25 23:35:16.540702 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:16.540475 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ws64" May 25 23:35:16.540702 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:16.540567 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ws64" podUID="694e83a1-a7ed-4246-a57b-6ba3e80ae3ba" May 25 23:35:18.540482 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:18.540445 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-twhc6" May 25 23:35:18.540933 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:18.540489 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ws64" May 25 23:35:18.540933 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:18.540581 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-twhc6" podUID="053dd95b-4d61-480d-8a80-645cf902780e" May 25 23:35:18.540933 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:18.540663 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ws64" podUID="694e83a1-a7ed-4246-a57b-6ba3e80ae3ba" May 25 23:35:20.177116 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:20.177079 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/694e83a1-a7ed-4246-a57b-6ba3e80ae3ba-metrics-certs\") pod \"network-metrics-daemon-7ws64\" (UID: \"694e83a1-a7ed-4246-a57b-6ba3e80ae3ba\") " pod="openshift-multus/network-metrics-daemon-7ws64" May 25 23:35:20.177517 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:20.177212 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 25 23:35:20.177517 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:20.177266 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/694e83a1-a7ed-4246-a57b-6ba3e80ae3ba-metrics-certs podName:694e83a1-a7ed-4246-a57b-6ba3e80ae3ba nodeName:}" failed. No retries permitted until 2026-05-25 23:35:36.177251625 +0000 UTC m=+34.256147252 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/694e83a1-a7ed-4246-a57b-6ba3e80ae3ba-metrics-certs") pod "network-metrics-daemon-7ws64" (UID: "694e83a1-a7ed-4246-a57b-6ba3e80ae3ba") : object "openshift-multus"/"metrics-daemon-secret" not registered May 25 23:35:20.278072 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:20.278032 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7sxdv\" (UniqueName: \"kubernetes.io/projected/053dd95b-4d61-480d-8a80-645cf902780e-kube-api-access-7sxdv\") pod \"network-check-target-twhc6\" (UID: \"053dd95b-4d61-480d-8a80-645cf902780e\") " pod="openshift-network-diagnostics/network-check-target-twhc6" May 25 23:35:20.278213 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:20.278182 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 25 23:35:20.278213 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:20.278202 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 25 23:35:20.278213 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:20.278212 2560 projected.go:194] Error preparing data for projected volume kube-api-access-7sxdv for pod openshift-network-diagnostics/network-check-target-twhc6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 23:35:20.278323 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:20.278263 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/053dd95b-4d61-480d-8a80-645cf902780e-kube-api-access-7sxdv podName:053dd95b-4d61-480d-8a80-645cf902780e nodeName:}" failed. No retries permitted until 2026-05-25 23:35:36.278248685 +0000 UTC m=+34.357144313 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7sxdv" (UniqueName: "kubernetes.io/projected/053dd95b-4d61-480d-8a80-645cf902780e-kube-api-access-7sxdv") pod "network-check-target-twhc6" (UID: "053dd95b-4d61-480d-8a80-645cf902780e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 23:35:20.540548 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:20.540451 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ws64" May 25 23:35:20.540548 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:20.540490 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-twhc6" May 25 23:35:20.540749 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:20.540600 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ws64" podUID="694e83a1-a7ed-4246-a57b-6ba3e80ae3ba" May 25 23:35:20.540749 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:20.540731 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-twhc6" podUID="053dd95b-4d61-480d-8a80-645cf902780e" May 25 23:35:22.541133 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:22.541084 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ws64" May 25 23:35:22.541623 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:22.541153 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-twhc6" May 25 23:35:22.541623 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:22.541223 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ws64" podUID="694e83a1-a7ed-4246-a57b-6ba3e80ae3ba" May 25 23:35:22.541623 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:22.541338 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-twhc6" podUID="053dd95b-4d61-480d-8a80-645cf902780e" May 25 23:35:23.141047 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:23.141015 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44b28b26_a51c_45ae_b6ff_4511af730e83.slice/crio-808fec9f94a8ff317dc329d8c4d7b6210ab31f8b0050dca247128e970d4e1cfa WatchSource:0}: Error finding container 808fec9f94a8ff317dc329d8c4d7b6210ab31f8b0050dca247128e970d4e1cfa: Status 404 returned error can't find the container with id 808fec9f94a8ff317dc329d8c4d7b6210ab31f8b0050dca247128e970d4e1cfa May 25 23:35:23.628867 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:23.628631 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8xmd" event={"ID":"254029cd-e52b-4d4a-904a-e30af2b6c681","Type":"ContainerStarted","Data":"dcf60561955bdc81afb9d9e5a255a073fa1a0980bdce7afd805278f4b3994060"} May 25 23:35:23.630048 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:23.629974 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-njpdd" event={"ID":"ab4b6ed7-9908-40ab-821d-59fb80e9d23f","Type":"ContainerStarted","Data":"08872ef78d6104e4df35e351c4af48b3825669245b197301c67d3588eee6de31"} May 25 23:35:23.631305 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:23.631282 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xxcq5" event={"ID":"7f8e8195-2832-443e-bf4d-3ffaf3ebc923","Type":"ContainerStarted","Data":"ecb9e083c04383c571a52737bcbe67ad4e40460967d28e64f29dab988c7dfd4f"} May 25 23:35:23.632441 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:23.632411 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-k2fns" event={"ID":"fe7ac5fe-b41b-41e5-b935-9c562ade089b","Type":"ContainerStarted","Data":"da45c53ce2cf6a3acdbddf6091a00604468549c2e4e4acb300a94f472b91321e"} May 25 23:35:23.633775 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:23.633746 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2qd5w" event={"ID":"e44b2c4f-59b8-4b76-80a5-1b3baa90a6db","Type":"ContainerStarted","Data":"1f74e20a9d3425187aa2b88a7af0c12b0a58288260fd30bacca40afdf6e615ed"} May 25 23:35:23.638617 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:23.638587 2560 generic.go:358] "Generic (PLEG): container finished" podID="08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60" containerID="011e576b52f276654cddb12fc6c6263e0144bc531276ac6069dced368c893db7" exitCode=0 May 25 23:35:23.638693 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:23.638670 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7tm79" event={"ID":"08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60","Type":"ContainerDied","Data":"011e576b52f276654cddb12fc6c6263e0144bc531276ac6069dced368c893db7"} May 25 23:35:23.644198 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:23.640857 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-czsc7_c028769b-0a8b-4a6e-8572-91c89c7879de/ovn-acl-logging/0.log" May 25 23:35:23.644198 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:23.641305 2560 generic.go:358] "Generic (PLEG): container finished" podID="c028769b-0a8b-4a6e-8572-91c89c7879de" containerID="c270c2adac78c2e2e2d3ab1e71eee97ba5f81ef16b88396a450b3a5dcbc5a17b" exitCode=1 May 25 23:35:23.644198 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:23.641371 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" event={"ID":"c028769b-0a8b-4a6e-8572-91c89c7879de","Type":"ContainerStarted","Data":"0cc0f2da133f9a831988e1c9a66b66a13bcac35cba440cf3a996f9c650098143"} May 25 23:35:23.644198 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:23.641394 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" event={"ID":"c028769b-0a8b-4a6e-8572-91c89c7879de","Type":"ContainerDied","Data":"c270c2adac78c2e2e2d3ab1e71eee97ba5f81ef16b88396a450b3a5dcbc5a17b"} May 25 23:35:23.644198 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:23.641409 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" event={"ID":"c028769b-0a8b-4a6e-8572-91c89c7879de","Type":"ContainerStarted","Data":"f071660089d42677c4ad7303866c079507345909e44e60629ae7fb73dfb2c51f"} May 25 23:35:23.644198 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:23.643321 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-m6fz8" event={"ID":"44b28b26-a51c-45ae-b6ff-4511af730e83","Type":"ContainerStarted","Data":"a6427c4de61de4d6872701aaab97dd2307c3308c0ff735edb70ca78de8102a65"} May 25 23:35:23.644198 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:23.643351 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-m6fz8" event={"ID":"44b28b26-a51c-45ae-b6ff-4511af730e83","Type":"ContainerStarted","Data":"808fec9f94a8ff317dc329d8c4d7b6210ab31f8b0050dca247128e970d4e1cfa"} May 25 23:35:23.651815 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:23.651775 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-njpdd" podStartSLOduration=3.681933274 podStartE2EDuration="21.651764504s" podCreationTimestamp="2026-05-25 23:35:02 +0000 UTC" firstStartedPulling="2026-05-25 23:35:05.167628675 +0000 UTC m=+3.246524303" lastFinishedPulling="2026-05-25 23:35:23.137459891 +0000 UTC m=+21.216355533" observedRunningTime="2026-05-25 23:35:23.651350524 +0000 UTC m=+21.730246175" watchObservedRunningTime="2026-05-25 23:35:23.651764504 +0000 UTC m=+21.730660153" May 25 23:35:23.687850 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:23.687802 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-2qd5w" podStartSLOduration=8.494094705 podStartE2EDuration="21.687785816s" podCreationTimestamp="2026-05-25 23:35:02 +0000 UTC" firstStartedPulling="2026-05-25 23:35:05.170952865 +0000 UTC m=+3.249848493" lastFinishedPulling="2026-05-25 23:35:18.364643962 +0000 UTC m=+16.443539604" observedRunningTime="2026-05-25 23:35:23.668028925 +0000 UTC m=+21.746924567" watchObservedRunningTime="2026-05-25 23:35:23.687785816 +0000 UTC m=+21.766681483" May 25 23:35:23.734095 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:23.734052 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-xxcq5" podStartSLOduration=3.762888981 podStartE2EDuration="21.734038757s" podCreationTimestamp="2026-05-25 23:35:02 +0000 UTC" firstStartedPulling="2026-05-25 23:35:05.166313951 +0000 UTC m=+3.245209581" lastFinishedPulling="2026-05-25 23:35:23.137463723 +0000 UTC m=+21.216359357" observedRunningTime="2026-05-25 23:35:23.687322543 +0000 UTC m=+21.766218270" watchObservedRunningTime="2026-05-25 23:35:23.734038757 +0000 UTC m=+21.812934407" May 25 23:35:23.734176 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:23.734160 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-k2fns" podStartSLOduration=3.7980155079999998 podStartE2EDuration="21.734155416s" podCreationTimestamp="2026-05-25 23:35:02 +0000 UTC" firstStartedPulling="2026-05-25 23:35:05.164548846 +0000 UTC m=+3.243444475" lastFinishedPulling="2026-05-25 23:35:23.100688741 +0000 UTC m=+21.179584383" observedRunningTime="2026-05-25 23:35:23.733683371 +0000 UTC m=+21.812579023" watchObservedRunningTime="2026-05-25 23:35:23.734155416 +0000 UTC m=+21.813051065" May 25 23:35:23.802505 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:23.802321 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-m6fz8" podStartSLOduration=9.802306097 podStartE2EDuration="9.802306097s" podCreationTimestamp="2026-05-25 23:35:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 23:35:23.801804933 +0000 UTC m=+21.880700582" watchObservedRunningTime="2026-05-25 23:35:23.802306097 +0000 UTC m=+21.881201747" May 25 23:35:24.350767 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:24.350731 2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 25 23:35:24.513459 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:24.513299 2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-25T23:35:24.350749124Z","UUID":"31eff6a6-e356-42ae-b322-6667a0571212","Handler":null,"Name":"","Endpoint":""} May 25 23:35:24.515555 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:24.515528 2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 25 23:35:24.515555 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:24.515563 2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 25 23:35:24.540794 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:24.540762 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-twhc6" May 25 23:35:24.540984 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:24.540773 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ws64" May 25 23:35:24.540984 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:24.540908 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-twhc6" podUID="053dd95b-4d61-480d-8a80-645cf902780e" May 25 23:35:24.541135 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:24.540981 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ws64" podUID="694e83a1-a7ed-4246-a57b-6ba3e80ae3ba" May 25 23:35:24.651003 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:24.648158 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-czsc7_c028769b-0a8b-4a6e-8572-91c89c7879de/ovn-acl-logging/0.log" May 25 23:35:24.651560 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:24.651516 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" event={"ID":"c028769b-0a8b-4a6e-8572-91c89c7879de","Type":"ContainerStarted","Data":"d9a3b37edde1bd59993ddf8ab9e61d222dbcf586ef2840d1259ab688f66ff81e"} May 25 23:35:24.651560 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:24.651550 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" event={"ID":"c028769b-0a8b-4a6e-8572-91c89c7879de","Type":"ContainerStarted","Data":"265f0236ba76e649700dd4fdb74a4ad9976e190090d5a1b032f6dd4a69a3f9f5"} May 25 23:35:24.651560 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:24.651560 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" event={"ID":"c028769b-0a8b-4a6e-8572-91c89c7879de","Type":"ContainerStarted","Data":"ac18e61fd00317d06303542682c6f43ed022bdbf68556cf8ad82e7bac8456918"} May 25 23:35:24.653288 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:24.653264 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8xmd" event={"ID":"254029cd-e52b-4d4a-904a-e30af2b6c681","Type":"ContainerStarted","Data":"b6f5b596c0b802d4c697fb42ab726c5da860dd01b74730ecd1b24ada1091366a"} May 25 23:35:24.654768 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:24.654742 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5hmf8" event={"ID":"8b33ef50-e2af-46ac-879b-c7fe139c78d0","Type":"ContainerStarted","Data":"965b36d5bcb2e8fc5859deebbd4a8517f55f13c6164a129246d4d4652b73bd6a"} May 25 23:35:24.671765 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:24.671696 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-5hmf8" podStartSLOduration=4.733127683 podStartE2EDuration="22.671681322s" podCreationTimestamp="2026-05-25 23:35:02 +0000 UTC" firstStartedPulling="2026-05-25 23:35:05.162102746 +0000 UTC m=+3.240998390" lastFinishedPulling="2026-05-25 23:35:23.100656394 +0000 UTC m=+21.179552029" observedRunningTime="2026-05-25 23:35:24.671387998 +0000 UTC m=+22.750283642" watchObservedRunningTime="2026-05-25 23:35:24.671681322 +0000 UTC m=+22.750576974" May 25 23:35:25.280472 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:25.280436 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-2qd5w" May 25 23:35:25.281214 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:25.281192 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-2qd5w" May 25 23:35:25.659221 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:25.659134 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8xmd" event={"ID":"254029cd-e52b-4d4a-904a-e30af2b6c681","Type":"ContainerStarted","Data":"59c2624352a81144b38c3a4ea0ed68df100160e37ae7ec0770ad71fac1203775"} May 25 23:35:25.659822 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:25.659562 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-2qd5w" May 25 23:35:25.659822 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:25.659787 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-2qd5w" May 25 23:35:25.680801 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:25.680745 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8xmd" podStartSLOduration=3.490707497 podStartE2EDuration="23.68073303s" podCreationTimestamp="2026-05-25 23:35:02 +0000 UTC" firstStartedPulling="2026-05-25 23:35:05.168514579 +0000 UTC m=+3.247410219" lastFinishedPulling="2026-05-25 23:35:25.358540116 +0000 UTC m=+23.437435752" observedRunningTime="2026-05-25 23:35:25.680556391 +0000 UTC m=+23.759452040" watchObservedRunningTime="2026-05-25 23:35:25.68073303 +0000 UTC m=+23.759628680" May 25 23:35:26.540276 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:26.540240 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-twhc6" May 25 23:35:26.540475 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:26.540257 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ws64" May 25 23:35:26.540475 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:26.540374 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-twhc6" podUID="053dd95b-4d61-480d-8a80-645cf902780e" May 25 23:35:26.540475 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:26.540451 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ws64" podUID="694e83a1-a7ed-4246-a57b-6ba3e80ae3ba" May 25 23:35:26.664075 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:26.664043 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-czsc7_c028769b-0a8b-4a6e-8572-91c89c7879de/ovn-acl-logging/0.log" May 25 23:35:26.664978 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:26.664952 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" event={"ID":"c028769b-0a8b-4a6e-8572-91c89c7879de","Type":"ContainerStarted","Data":"0776a0bdb5dd697354b4106a9718cc1b03d62c0bef1f2ba1962915623c06dc61"} May 25 23:35:28.540367 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:28.540179 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ws64" May 25 23:35:28.540940 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:28.540179 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-twhc6" May 25 23:35:28.540940 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:28.540479 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ws64" podUID="694e83a1-a7ed-4246-a57b-6ba3e80ae3ba" May 25 23:35:28.540940 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:28.540541 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-twhc6" podUID="053dd95b-4d61-480d-8a80-645cf902780e" May 25 23:35:28.668522 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:28.668491 2560 generic.go:358] "Generic (PLEG): container finished" podID="08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60" containerID="d8e0bf1ebd5a143b6cc063a9c0de57d564cebbc757b2bb5674d463da01b224b1" exitCode=0 May 25 23:35:28.668680 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:28.668559 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7tm79" event={"ID":"08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60","Type":"ContainerDied","Data":"d8e0bf1ebd5a143b6cc063a9c0de57d564cebbc757b2bb5674d463da01b224b1"} May 25 23:35:28.671580 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:28.671562 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-czsc7_c028769b-0a8b-4a6e-8572-91c89c7879de/ovn-acl-logging/0.log" May 25 23:35:28.671908 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:28.671885 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" event={"ID":"c028769b-0a8b-4a6e-8572-91c89c7879de","Type":"ContainerStarted","Data":"50892bd26d08430b134a5fd7b4e3d9e011d6a5558b9f43461af5d595973d2c96"} May 25 23:35:28.672209 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:28.672191 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" May 25 23:35:28.672281 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:28.672214 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" May 25 23:35:28.672354 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:28.672327 2560 scope.go:117] "RemoveContainer" containerID="c270c2adac78c2e2e2d3ab1e71eee97ba5f81ef16b88396a450b3a5dcbc5a17b" May 25 23:35:28.689959 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:28.689938 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" May 25 23:35:29.299060 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:29.299044 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-m6fz8_44b28b26-a51c-45ae-b6ff-4511af730e83/dns-node-resolver/0.log" May 25 23:35:29.677494 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:29.677259 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-czsc7_c028769b-0a8b-4a6e-8572-91c89c7879de/ovn-acl-logging/0.log" May 25 23:35:29.677940 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:29.677908 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" event={"ID":"c028769b-0a8b-4a6e-8572-91c89c7879de","Type":"ContainerStarted","Data":"4244fbbfa61f2f8c7a856e23e774da06fa6e8a105cb537c4769c9e68a1e2ce7f"} May 25 23:35:29.678414 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:29.678378 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" May 25 23:35:29.680165 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:29.680139 2560 generic.go:358] "Generic (PLEG): container finished" podID="08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60" containerID="f16732c34420cbb03dd2b5601072634b3e7a4d67cdeb990786ccb935e6db8fa7" exitCode=0 May 25 23:35:29.680294 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:29.680176 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7tm79" event={"ID":"08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60","Type":"ContainerDied","Data":"f16732c34420cbb03dd2b5601072634b3e7a4d67cdeb990786ccb935e6db8fa7"} May 25 23:35:29.695944 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:29.695922 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" May 25 23:35:29.716864 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:29.716814 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" podStartSLOduration=9.67792764 podStartE2EDuration="27.716801486s" podCreationTimestamp="2026-05-25 23:35:02 +0000 UTC" firstStartedPulling="2026-05-25 23:35:05.161869778 +0000 UTC m=+3.240765423" lastFinishedPulling="2026-05-25 23:35:23.200743626 +0000 UTC m=+21.279639269" observedRunningTime="2026-05-25 23:35:29.715251611 +0000 UTC m=+27.794147274" watchObservedRunningTime="2026-05-25 23:35:29.716801486 +0000 UTC m=+27.795697136" May 25 23:35:30.081185 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:30.081161 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k2fns_fe7ac5fe-b41b-41e5-b935-9c562ade089b/node-ca/0.log" May 25 23:35:30.144205 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:30.144172 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-twhc6"] May 25 23:35:30.144420 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:30.144320 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-twhc6" May 25 23:35:30.144542 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:30.144516 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-twhc6" podUID="053dd95b-4d61-480d-8a80-645cf902780e" May 25 23:35:30.145007 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:30.144957 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7ws64"] May 25 23:35:30.145110 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:30.145099 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ws64" May 25 23:35:30.145236 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:30.145207 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ws64" podUID="694e83a1-a7ed-4246-a57b-6ba3e80ae3ba" May 25 23:35:30.684095 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:30.684061 2560 generic.go:358] "Generic (PLEG): container finished" podID="08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60" containerID="37f8aed8f76bda1ea6879626356b55e55dc07bbb1c82c6d0da51a24224b021fb" exitCode=0 May 25 23:35:30.684797 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:30.684151 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7tm79" event={"ID":"08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60","Type":"ContainerDied","Data":"37f8aed8f76bda1ea6879626356b55e55dc07bbb1c82c6d0da51a24224b021fb"} May 25 23:35:32.541347 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:32.541267 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-twhc6" May 25 23:35:32.541763 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:32.541382 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-twhc6" podUID="053dd95b-4d61-480d-8a80-645cf902780e" May 25 23:35:32.541763 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:32.541436 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ws64" May 25 23:35:32.541763 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:32.541576 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ws64" podUID="694e83a1-a7ed-4246-a57b-6ba3e80ae3ba" May 25 23:35:34.540973 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:34.540933 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-twhc6" May 25 23:35:34.541503 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:34.540942 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ws64" May 25 23:35:34.541503 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:34.541091 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-twhc6" podUID="053dd95b-4d61-480d-8a80-645cf902780e" May 25 23:35:34.541503 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:34.541160 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ws64" podUID="694e83a1-a7ed-4246-a57b-6ba3e80ae3ba" May 25 23:35:36.191913 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:36.191721 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/694e83a1-a7ed-4246-a57b-6ba3e80ae3ba-metrics-certs\") pod \"network-metrics-daemon-7ws64\" (UID: \"694e83a1-a7ed-4246-a57b-6ba3e80ae3ba\") " pod="openshift-multus/network-metrics-daemon-7ws64" May 25 23:35:36.192409 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:36.191868 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 25 23:35:36.192409 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:36.192020 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/694e83a1-a7ed-4246-a57b-6ba3e80ae3ba-metrics-certs podName:694e83a1-a7ed-4246-a57b-6ba3e80ae3ba nodeName:}" failed. No retries permitted until 2026-05-25 23:36:08.192004873 +0000 UTC m=+66.270900513 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/694e83a1-a7ed-4246-a57b-6ba3e80ae3ba-metrics-certs") pod "network-metrics-daemon-7ws64" (UID: "694e83a1-a7ed-4246-a57b-6ba3e80ae3ba") : object "openshift-multus"/"metrics-daemon-secret" not registered May 25 23:35:36.292230 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:36.292193 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7sxdv\" (UniqueName: \"kubernetes.io/projected/053dd95b-4d61-480d-8a80-645cf902780e-kube-api-access-7sxdv\") pod \"network-check-target-twhc6\" (UID: \"053dd95b-4d61-480d-8a80-645cf902780e\") " pod="openshift-network-diagnostics/network-check-target-twhc6" May 25 23:35:36.292385 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:36.292364 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 25 23:35:36.292429 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:36.292386 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 25 23:35:36.292429 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:36.292396 2560 projected.go:194] Error preparing data for projected volume kube-api-access-7sxdv for pod openshift-network-diagnostics/network-check-target-twhc6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 23:35:36.292495 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:36.292452 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/053dd95b-4d61-480d-8a80-645cf902780e-kube-api-access-7sxdv podName:053dd95b-4d61-480d-8a80-645cf902780e nodeName:}" failed. No retries permitted until 2026-05-25 23:36:08.292438352 +0000 UTC m=+66.371333983 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7sxdv" (UniqueName: "kubernetes.io/projected/053dd95b-4d61-480d-8a80-645cf902780e-kube-api-access-7sxdv") pod "network-check-target-twhc6" (UID: "053dd95b-4d61-480d-8a80-645cf902780e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 23:35:36.540606 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:36.540574 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-twhc6" May 25 23:35:36.540784 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:36.540693 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-twhc6" podUID="053dd95b-4d61-480d-8a80-645cf902780e" May 25 23:35:36.540784 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:36.540759 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ws64" May 25 23:35:36.540959 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:36.540880 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ws64" podUID="694e83a1-a7ed-4246-a57b-6ba3e80ae3ba" May 25 23:35:36.698064 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:36.698019 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7tm79" event={"ID":"08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60","Type":"ContainerStarted","Data":"fffe3eae17892456c8683b0f1dae9d590c00cd532cc23532bed3ccf89ea0c45b"} May 25 23:35:37.703662 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:37.703626 2560 generic.go:358] "Generic (PLEG): container finished" podID="08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60" containerID="fffe3eae17892456c8683b0f1dae9d590c00cd532cc23532bed3ccf89ea0c45b" exitCode=0 May 25 23:35:37.704082 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:37.703688 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7tm79" event={"ID":"08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60","Type":"ContainerDied","Data":"fffe3eae17892456c8683b0f1dae9d590c00cd532cc23532bed3ccf89ea0c45b"} May 25 23:35:38.540772 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:38.540723 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-twhc6" May 25 23:35:38.540964 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:38.540831 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-twhc6" podUID="053dd95b-4d61-480d-8a80-645cf902780e" May 25 23:35:38.540964 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:38.540918 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ws64" May 25 23:35:38.541108 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:38.541054 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ws64" podUID="694e83a1-a7ed-4246-a57b-6ba3e80ae3ba" May 25 23:35:38.708684 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:38.708652 2560 generic.go:358] "Generic (PLEG): container finished" podID="08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60" containerID="fe37335da042f867b798884485364710b2946fe664d2e04c663c7a5277a9f36f" exitCode=0 May 25 23:35:38.709070 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:38.708694 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7tm79" event={"ID":"08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60","Type":"ContainerDied","Data":"fe37335da042f867b798884485364710b2946fe664d2e04c663c7a5277a9f36f"} May 25 23:35:39.713579 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:39.713549 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7tm79" event={"ID":"08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60","Type":"ContainerStarted","Data":"22c66a0d63fad23846e0e581b73ebca35dae5dea371536974e00d01ac348f160"} May 25 23:35:39.741635 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:39.741594 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7tm79" podStartSLOduration=6.41638757 podStartE2EDuration="37.741579846s" podCreationTimestamp="2026-05-25 23:35:02 +0000 UTC" firstStartedPulling="2026-05-25 23:35:05.165400827 +0000 UTC m=+3.244296458" lastFinishedPulling="2026-05-25 23:35:36.490593093 +0000 UTC m=+34.569488734" observedRunningTime="2026-05-25 23:35:39.741313135 +0000 UTC m=+37.820208782" watchObservedRunningTime="2026-05-25 23:35:39.741579846 +0000 UTC m=+37.820475495" May 25 23:35:40.540306 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:40.540273 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ws64" May 25 23:35:40.540489 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:40.540321 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-twhc6" May 25 23:35:40.540489 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:40.540434 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ws64" podUID="694e83a1-a7ed-4246-a57b-6ba3e80ae3ba" May 25 23:35:40.540561 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:40.540539 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-twhc6" podUID="053dd95b-4d61-480d-8a80-645cf902780e" May 25 23:35:42.541800 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:42.541766 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ws64" May 25 23:35:42.542253 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:42.541896 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ws64" podUID="694e83a1-a7ed-4246-a57b-6ba3e80ae3ba" May 25 23:35:42.542253 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:42.541949 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-twhc6" May 25 23:35:42.542253 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:42.542054 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-twhc6" podUID="053dd95b-4d61-480d-8a80-645cf902780e" May 25 23:35:44.540417 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:44.540377 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ws64" May 25 23:35:44.540794 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:44.540377 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-twhc6" May 25 23:35:44.540794 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:44.540490 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ws64" podUID="694e83a1-a7ed-4246-a57b-6ba3e80ae3ba" May 25 23:35:44.540794 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:44.540560 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-twhc6" podUID="053dd95b-4d61-480d-8a80-645cf902780e" May 25 23:35:46.540837 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:46.540799 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-twhc6" May 25 23:35:46.541243 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:46.540799 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ws64" May 25 23:35:46.541243 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:46.540914 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-twhc6" podUID="053dd95b-4d61-480d-8a80-645cf902780e" May 25 23:35:46.541243 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:46.541002 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ws64" podUID="694e83a1-a7ed-4246-a57b-6ba3e80ae3ba" May 25 23:35:48.540266 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:48.540231 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-twhc6" May 25 23:35:48.540266 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:48.540257 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ws64" May 25 23:35:48.540699 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:48.540328 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-twhc6" podUID="053dd95b-4d61-480d-8a80-645cf902780e" May 25 23:35:48.540699 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:35:48.540441 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ws64" podUID="694e83a1-a7ed-4246-a57b-6ba3e80ae3ba" May 25 23:35:50.244955 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:50.244928 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-170.ec2.internal" event="NodeReady" May 25 23:35:50.245345 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:50.245067 2560 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 25 23:35:50.297084 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:50.297054 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-jd6l5"] May 25 23:35:50.329438 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:50.329405 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-v5mf6"] May 25 23:35:50.329589 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:50.329568 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jd6l5" May 25 23:35:50.333227 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:50.333207 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 25 23:35:50.333776 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:50.333762 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 25 23:35:50.333834 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:50.333786 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4pndb\"" May 25 23:35:50.343207 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:50.343184 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jd6l5"] May 25 23:35:50.343207 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:50.343206 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-v5mf6"] May 25 23:35:50.343386 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:50.343217 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-mzfdm"] May 25 23:35:50.343386 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:50.343312 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-v5mf6" May 25 23:35:50.346234 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:50.346212 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 25 23:35:50.346358 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:50.346250 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 25 23:35:50.346358 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:50.346250 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-d4kmw\"" May 25 23:35:50.346358 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:50.346212 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 25 23:35:50.365353 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:50.365327 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mzfdm"] May 25 23:35:50.365458 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:50.365430 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mzfdm" May 25 23:35:50.368361 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:50.368336 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 25 23:35:50.368731 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:50.368707 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 25 23:35:50.368839 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:50.368709 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lktvb\"" May 25 23:35:50.368839 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:50.368734 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 25 23:35:50.368839 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:50.368742 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 25 23:35:50.493071 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:50.493034 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmrng\" (UniqueName: \"kubernetes.io/projected/fcb22698-3864-4a79-8464-4c29e38c694c-kube-api-access-fmrng\") pod \"ingress-canary-v5mf6\" (UID: \"fcb22698-3864-4a79-8464-4c29e38c694c\") " pod="openshift-ingress-canary/ingress-canary-v5mf6" May 25 23:35:50.493071 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:50.493071 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b99a20d-9af5-4ef1-b9f7-8e617d24226b-tmp-dir\") pod \"dns-default-jd6l5\" (UID: \"6b99a20d-9af5-4ef1-b9f7-8e617d24226b\") " pod="openshift-dns/dns-default-jd6l5" May 25 23:35:50.493310 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:50.493092 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e4be6a30-ee1f-4486-a0d7-8ed296775159-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mzfdm\" (UID: \"e4be6a30-ee1f-4486-a0d7-8ed296775159\") " pod="openshift-insights/insights-runtime-extractor-mzfdm" May 25 23:35:50.493310 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:50.493123 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e4be6a30-ee1f-4486-a0d7-8ed296775159-crio-socket\") pod \"insights-runtime-extractor-mzfdm\" (UID: \"e4be6a30-ee1f-4486-a0d7-8ed296775159\") " pod="openshift-insights/insights-runtime-extractor-mzfdm" May 25 23:35:50.493310 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:50.493145 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fcb22698-3864-4a79-8464-4c29e38c694c-cert\") pod \"ingress-canary-v5mf6\" (UID: \"fcb22698-3864-4a79-8464-4c29e38c694c\") " pod="openshift-ingress-canary/ingress-canary-v5mf6" May 25 23:35:50.493310 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:50.493173 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b99a20d-9af5-4ef1-b9f7-8e617d24226b-metrics-tls\") pod \"dns-default-jd6l5\" (UID: \"6b99a20d-9af5-4ef1-b9f7-8e617d24226b\") " pod="openshift-dns/dns-default-jd6l5" May 25 23:35:50.493310 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:50.493190 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsm5j\" (UniqueName: \"kubernetes.io/projected/e4be6a30-ee1f-4486-a0d7-8ed296775159-kube-api-access-dsm5j\") pod \"insights-runtime-extractor-mzfdm\" (UID: \"e4be6a30-ee1f-4486-a0d7-8ed296775159\") " pod="openshift-insights/insights-runtime-extractor-mzfdm" May 25 23:35:50.493310 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:50.493215 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e4be6a30-ee1f-4486-a0d7-8ed296775159-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mzfdm\" (UID: \"e4be6a30-ee1f-4486-a0d7-8ed296775159\") " pod="openshift-insights/insights-runtime-extractor-mzfdm" May 25 23:35:50.493310 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:50.493283 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6b99a20d-9af5-4ef1-b9f7-8e617d24226b-config-volume\") pod \"dns-default-jd6l5\" (UID: \"6b99a20d-9af5-4ef1-b9f7-8e617d24226b\") " pod="openshift-dns/dns-default-jd6l5" May 25 23:35:50.493532 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:50.493312 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5j94\" (UniqueName: \"kubernetes.io/projected/6b99a20d-9af5-4ef1-b9f7-8e617d24226b-kube-api-access-f5j94\") pod \"dns-default-jd6l5\" (UID: \"6b99a20d-9af5-4ef1-b9f7-8e617d24226b\") " pod="openshift-dns/dns-default-jd6l5" May 25 23:35:50.493532 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:50.493347 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4be6a30-ee1f-4486-a0d7-8ed296775159-data-volume\") pod \"insights-runtime-extractor-mzfdm\" (UID: \"e4be6a30-ee1f-4486-a0d7-8ed296775159\") " pod="openshift-insights/insights-runtime-extractor-mzfdm" May 25 23:35:50.540584 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:50.540515 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ws64" May 25 23:35:50.540584 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:50.540563 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-twhc6" May 25 23:35:50.543453 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:50.543424 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 25 23:35:50.543594 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:50.543426 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 25 23:35:50.543594 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:50.543569 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 25 23:35:50.543826 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:50.543810 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vfv7v\"" May 25 23:35:50.543875 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:50.543835 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hz8ds\"" May 25 23:35:50.593895 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:50.593851 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b99a20d-9af5-4ef1-b9f7-8e617d24226b-metrics-tls\") pod \"dns-default-jd6l5\" (UID: \"6b99a20d-9af5-4ef1-b9f7-8e617d24226b\") " pod="openshift-dns/dns-default-jd6l5" May 25 23:35:50.593895 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:50.593893 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dsm5j\" (UniqueName: \"kubernetes.io/projected/e4be6a30-ee1f-4486-a0d7-8ed296775159-kube-api-access-dsm5j\") pod \"insights-runtime-extractor-mzfdm\" (UID: \"e4be6a30-ee1f-4486-a0d7-8ed296775159\") " pod="openshift-insights/insights-runtime-extractor-mzfdm" May 25 23:35:50.594126 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:50.593931 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e4be6a30-ee1f-4486-a0d7-8ed296775159-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mzfdm\" (UID: \"e4be6a30-ee1f-4486-a0d7-8ed296775159\") " pod="openshift-insights/insights-runtime-extractor-mzfdm" May 25 23:35:50.594126 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:50.593959 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6b99a20d-9af5-4ef1-b9f7-8e617d24226b-config-volume\") pod \"dns-default-jd6l5\" (UID: \"6b99a20d-9af5-4ef1-b9f7-8e617d24226b\") " pod="openshift-dns/dns-default-jd6l5" May 25 23:35:50.594126 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:50.593984 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f5j94\" (UniqueName: \"kubernetes.io/projected/6b99a20d-9af5-4ef1-b9f7-8e617d24226b-kube-api-access-f5j94\") pod \"dns-default-jd6l5\" (UID: \"6b99a20d-9af5-4ef1-b9f7-8e617d24226b\") " pod="openshift-dns/dns-default-jd6l5" May 25 23:35:50.594126 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:50.594031 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4be6a30-ee1f-4486-a0d7-8ed296775159-data-volume\") pod \"insights-runtime-extractor-mzfdm\" (UID: \"e4be6a30-ee1f-4486-a0d7-8ed296775159\") " pod="openshift-insights/insights-runtime-extractor-mzfdm" May 25 23:35:50.594356 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:50.594237 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fmrng\" (UniqueName: \"kubernetes.io/projected/fcb22698-3864-4a79-8464-4c29e38c694c-kube-api-access-fmrng\") pod \"ingress-canary-v5mf6\" (UID: \"fcb22698-3864-4a79-8464-4c29e38c694c\") " pod="openshift-ingress-canary/ingress-canary-v5mf6" May 25 23:35:50.594356 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:50.594272 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b99a20d-9af5-4ef1-b9f7-8e617d24226b-tmp-dir\") pod \"dns-default-jd6l5\" (UID: \"6b99a20d-9af5-4ef1-b9f7-8e617d24226b\") " pod="openshift-dns/dns-default-jd6l5" May 25 23:35:50.594460 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:50.594404 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e4be6a30-ee1f-4486-a0d7-8ed296775159-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mzfdm\" (UID: \"e4be6a30-ee1f-4486-a0d7-8ed296775159\") " pod="openshift-insights/insights-runtime-extractor-mzfdm" May 25 23:35:50.594460 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:50.594419 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4be6a30-ee1f-4486-a0d7-8ed296775159-data-volume\") pod \"insights-runtime-extractor-mzfdm\" (UID: \"e4be6a30-ee1f-4486-a0d7-8ed296775159\") " pod="openshift-insights/insights-runtime-extractor-mzfdm" May 25 23:35:50.594460 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:50.594445 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e4be6a30-ee1f-4486-a0d7-8ed296775159-crio-socket\") pod \"insights-runtime-extractor-mzfdm\" (UID: \"e4be6a30-ee1f-4486-a0d7-8ed296775159\") " pod="openshift-insights/insights-runtime-extractor-mzfdm" May 25 23:35:50.594605 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:50.594476 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fcb22698-3864-4a79-8464-4c29e38c694c-cert\") pod \"ingress-canary-v5mf6\" (UID: \"fcb22698-3864-4a79-8464-4c29e38c694c\") " pod="openshift-ingress-canary/ingress-canary-v5mf6" May 25 23:35:50.594605 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:50.594589 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b99a20d-9af5-4ef1-b9f7-8e617d24226b-tmp-dir\") pod \"dns-default-jd6l5\" (UID: \"6b99a20d-9af5-4ef1-b9f7-8e617d24226b\") " pod="openshift-dns/dns-default-jd6l5" May 25 23:35:50.594706 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:50.594629 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6b99a20d-9af5-4ef1-b9f7-8e617d24226b-config-volume\") pod \"dns-default-jd6l5\" (UID: \"6b99a20d-9af5-4ef1-b9f7-8e617d24226b\") " pod="openshift-dns/dns-default-jd6l5" May 25 23:35:50.594706 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:50.594675 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e4be6a30-ee1f-4486-a0d7-8ed296775159-crio-socket\") pod \"insights-runtime-extractor-mzfdm\" (UID: \"e4be6a30-ee1f-4486-a0d7-8ed296775159\") " pod="openshift-insights/insights-runtime-extractor-mzfdm" May 25 23:35:50.594706 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:50.594682 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e4be6a30-ee1f-4486-a0d7-8ed296775159-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mzfdm\" (UID: \"e4be6a30-ee1f-4486-a0d7-8ed296775159\") " pod="openshift-insights/insights-runtime-extractor-mzfdm" May 25 23:35:50.598263 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:50.598239 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e4be6a30-ee1f-4486-a0d7-8ed296775159-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mzfdm\" (UID: \"e4be6a30-ee1f-4486-a0d7-8ed296775159\") " pod="openshift-insights/insights-runtime-extractor-mzfdm" May 25 23:35:50.598376 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:50.598248 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b99a20d-9af5-4ef1-b9f7-8e617d24226b-metrics-tls\") pod \"dns-default-jd6l5\" (UID: \"6b99a20d-9af5-4ef1-b9f7-8e617d24226b\") " pod="openshift-dns/dns-default-jd6l5" May 25 23:35:50.598486 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:50.598466 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fcb22698-3864-4a79-8464-4c29e38c694c-cert\") pod \"ingress-canary-v5mf6\" (UID: \"fcb22698-3864-4a79-8464-4c29e38c694c\") " pod="openshift-ingress-canary/ingress-canary-v5mf6" May 25 23:35:50.602614 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:50.602584 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsm5j\" (UniqueName: \"kubernetes.io/projected/e4be6a30-ee1f-4486-a0d7-8ed296775159-kube-api-access-dsm5j\") pod \"insights-runtime-extractor-mzfdm\" (UID: \"e4be6a30-ee1f-4486-a0d7-8ed296775159\") " pod="openshift-insights/insights-runtime-extractor-mzfdm" May 25 23:35:50.602614 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:50.602598 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5j94\" (UniqueName: \"kubernetes.io/projected/6b99a20d-9af5-4ef1-b9f7-8e617d24226b-kube-api-access-f5j94\") pod \"dns-default-jd6l5\" (UID: \"6b99a20d-9af5-4ef1-b9f7-8e617d24226b\") " pod="openshift-dns/dns-default-jd6l5" May 25 23:35:50.602878 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:50.602860 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmrng\" (UniqueName: \"kubernetes.io/projected/fcb22698-3864-4a79-8464-4c29e38c694c-kube-api-access-fmrng\") pod \"ingress-canary-v5mf6\" (UID: \"fcb22698-3864-4a79-8464-4c29e38c694c\") " pod="openshift-ingress-canary/ingress-canary-v5mf6" May 25 23:35:50.638754 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:50.638714 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jd6l5" May 25 23:35:50.651536 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:50.651509 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-v5mf6" May 25 23:35:50.673937 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:50.673898 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mzfdm" May 25 23:35:50.844577 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:50.844546 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jd6l5"] May 25 23:35:50.848226 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:50.848190 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b99a20d_9af5_4ef1_b9f7_8e617d24226b.slice/crio-5a26278de03f9d16c6cf6f70ea88e0cad66af8645756564d3f58d9bc7e2c6729 WatchSource:0}: Error finding container 5a26278de03f9d16c6cf6f70ea88e0cad66af8645756564d3f58d9bc7e2c6729: Status 404 returned error can't find the container with id 5a26278de03f9d16c6cf6f70ea88e0cad66af8645756564d3f58d9bc7e2c6729 May 25 23:35:51.053671 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:51.053599 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-v5mf6"] May 25 23:35:51.056349 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:51.056324 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mzfdm"] May 25 23:35:51.056949 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:51.056926 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcb22698_3864_4a79_8464_4c29e38c694c.slice/crio-e7dc84ada21565bb316dbddbb1e8a412f8eedcd7243e529c14a5cbe95b371dd0 WatchSource:0}: Error finding container e7dc84ada21565bb316dbddbb1e8a412f8eedcd7243e529c14a5cbe95b371dd0: Status 404 returned error can't find the container with id e7dc84ada21565bb316dbddbb1e8a412f8eedcd7243e529c14a5cbe95b371dd0 May 25 23:35:51.059608 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:51.059583 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4be6a30_ee1f_4486_a0d7_8ed296775159.slice/crio-d0d03a5e91670cc1a9d523cc128fe0c499c2883ff544d34e93d374de212a88b5 WatchSource:0}: Error finding container d0d03a5e91670cc1a9d523cc128fe0c499c2883ff544d34e93d374de212a88b5: Status 404 returned error can't find the container with id d0d03a5e91670cc1a9d523cc128fe0c499c2883ff544d34e93d374de212a88b5 May 25 23:35:51.738846 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:51.738772 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mzfdm" event={"ID":"e4be6a30-ee1f-4486-a0d7-8ed296775159","Type":"ContainerStarted","Data":"c428c61ffe447734dae325d8ecef0592eaf396a2e145ff4951840a9203e11738"} May 25 23:35:51.739421 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:51.738819 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mzfdm" event={"ID":"e4be6a30-ee1f-4486-a0d7-8ed296775159","Type":"ContainerStarted","Data":"d0d03a5e91670cc1a9d523cc128fe0c499c2883ff544d34e93d374de212a88b5"} May 25 23:35:51.740629 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:51.740589 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-v5mf6" event={"ID":"fcb22698-3864-4a79-8464-4c29e38c694c","Type":"ContainerStarted","Data":"e7dc84ada21565bb316dbddbb1e8a412f8eedcd7243e529c14a5cbe95b371dd0"} May 25 23:35:51.741902 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:51.741881 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jd6l5" event={"ID":"6b99a20d-9af5-4ef1-b9f7-8e617d24226b","Type":"ContainerStarted","Data":"5a26278de03f9d16c6cf6f70ea88e0cad66af8645756564d3f58d9bc7e2c6729"} May 25 23:35:52.978419 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:52.978376 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-57bd96b888-42gd6"] May 25 23:35:52.997081 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:52.997053 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-42gd6"] May 25 23:35:52.997244 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:52.997190 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-42gd6" May 25 23:35:53.000111 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:53.000084 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" May 25 23:35:53.000692 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:53.000677 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-nvmxb\"" May 25 23:35:53.001172 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:53.001158 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" May 25 23:35:53.116205 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:53.116165 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9n2s9\" (UniqueName: \"kubernetes.io/projected/7e545f97-36d2-4fe6-b869-f6246bb28ee8-kube-api-access-9n2s9\") pod \"downloads-57bd96b888-42gd6\" (UID: \"7e545f97-36d2-4fe6-b869-f6246bb28ee8\") " pod="openshift-console/downloads-57bd96b888-42gd6" May 25 23:35:53.217334 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:53.217304 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9n2s9\" (UniqueName: \"kubernetes.io/projected/7e545f97-36d2-4fe6-b869-f6246bb28ee8-kube-api-access-9n2s9\") pod \"downloads-57bd96b888-42gd6\" (UID: \"7e545f97-36d2-4fe6-b869-f6246bb28ee8\") " pod="openshift-console/downloads-57bd96b888-42gd6" May 25 23:35:53.226197 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:53.226165 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9n2s9\" (UniqueName: \"kubernetes.io/projected/7e545f97-36d2-4fe6-b869-f6246bb28ee8-kube-api-access-9n2s9\") pod \"downloads-57bd96b888-42gd6\" (UID: \"7e545f97-36d2-4fe6-b869-f6246bb28ee8\") " pod="openshift-console/downloads-57bd96b888-42gd6" May 25 23:35:53.306224 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:53.306144 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-42gd6" May 25 23:35:53.584900 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:53.584803 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-42gd6"] May 25 23:35:53.590182 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:53.590136 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e545f97_36d2_4fe6_b869_f6246bb28ee8.slice/crio-676557026f9baf015f26a03b750cc883fe353a09145e7918e73109a0c84185e8 WatchSource:0}: Error finding container 676557026f9baf015f26a03b750cc883fe353a09145e7918e73109a0c84185e8: Status 404 returned error can't find the container with id 676557026f9baf015f26a03b750cc883fe353a09145e7918e73109a0c84185e8 May 25 23:35:53.747442 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:53.747411 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jd6l5" event={"ID":"6b99a20d-9af5-4ef1-b9f7-8e617d24226b","Type":"ContainerStarted","Data":"e2e2e026314818557d4a617dbf93a5f757157ce99fa0fe0732060741aaaa47b0"} May 25 23:35:53.747442 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:53.747447 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jd6l5" event={"ID":"6b99a20d-9af5-4ef1-b9f7-8e617d24226b","Type":"ContainerStarted","Data":"907383775a8a25b2c3b6d761aded6451e4fb2c5bbcea4a8bc022d0cc349fe82c"} May 25 23:35:53.747676 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:53.747558 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-jd6l5" May 25 23:35:53.749002 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:53.748959 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-v5mf6" event={"ID":"fcb22698-3864-4a79-8464-4c29e38c694c","Type":"ContainerStarted","Data":"2395f1275ee784c1f111736129684749f6b2a43bba46d59df57e4318176eefd5"} May 25 23:35:53.750044 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:53.750024 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-42gd6" event={"ID":"7e545f97-36d2-4fe6-b869-f6246bb28ee8","Type":"ContainerStarted","Data":"676557026f9baf015f26a03b750cc883fe353a09145e7918e73109a0c84185e8"} May 25 23:35:53.751645 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:53.751622 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mzfdm" event={"ID":"e4be6a30-ee1f-4486-a0d7-8ed296775159","Type":"ContainerStarted","Data":"1a3b1b7fcb9225240e451564b8d1481a5b5981594457a1a1fa352d71c942c5ae"} May 25 23:35:53.766699 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:53.766656 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-jd6l5" podStartSLOduration=1.180915004 podStartE2EDuration="3.766644118s" podCreationTimestamp="2026-05-25 23:35:50 +0000 UTC" firstStartedPulling="2026-05-25 23:35:50.849512188 +0000 UTC m=+48.928407820" lastFinishedPulling="2026-05-25 23:35:53.435241298 +0000 UTC m=+51.514136934" observedRunningTime="2026-05-25 23:35:53.76625811 +0000 UTC m=+51.845153760" watchObservedRunningTime="2026-05-25 23:35:53.766644118 +0000 UTC m=+51.845539764" May 25 23:35:53.784547 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:53.784507 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-v5mf6" podStartSLOduration=1.40395857 podStartE2EDuration="3.784493804s" podCreationTimestamp="2026-05-25 23:35:50 +0000 UTC" firstStartedPulling="2026-05-25 23:35:51.058858525 +0000 UTC m=+49.137754153" lastFinishedPulling="2026-05-25 23:35:53.439393746 +0000 UTC m=+51.518289387" observedRunningTime="2026-05-25 23:35:53.783734972 +0000 UTC m=+51.862630622" watchObservedRunningTime="2026-05-25 23:35:53.784493804 +0000 UTC m=+51.863389454" May 25 23:35:55.761134 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:55.761089 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mzfdm" event={"ID":"e4be6a30-ee1f-4486-a0d7-8ed296775159","Type":"ContainerStarted","Data":"cc6bbf8a888c46ba58c1214d1027b69045155e01ebd405c58094ca74aafc9dfe"} May 25 23:35:55.782478 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:55.782415 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-mzfdm" podStartSLOduration=1.667849457 podStartE2EDuration="5.78239759s" podCreationTimestamp="2026-05-25 23:35:50 +0000 UTC" firstStartedPulling="2026-05-25 23:35:51.204340329 +0000 UTC m=+49.283235957" lastFinishedPulling="2026-05-25 23:35:55.318888457 +0000 UTC m=+53.397784090" observedRunningTime="2026-05-25 23:35:55.781600642 +0000 UTC m=+53.860496294" watchObservedRunningTime="2026-05-25 23:35:55.78239759 +0000 UTC m=+53.861293240" May 25 23:35:56.767720 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:56.767680 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-cvbr7"] May 25 23:35:56.789789 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:56.789761 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-cvbr7"] May 25 23:35:56.789952 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:56.789898 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-cvbr7" May 25 23:35:56.792566 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:56.792540 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 25 23:35:56.792764 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:56.792743 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" May 25 23:35:56.792866 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:56.792836 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" May 25 23:35:56.792866 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:56.792846 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 25 23:35:56.793645 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:56.793624 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 25 23:35:56.793760 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:56.793627 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-7lc2p\"" May 25 23:35:56.949094 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:56.949058 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/33a5da7c-175d-47e9-a1ba-164343f317a8-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-cvbr7\" (UID: \"33a5da7c-175d-47e9-a1ba-164343f317a8\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-cvbr7" May 25 23:35:56.949278 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:56.949132 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qmtz\" (UniqueName: \"kubernetes.io/projected/33a5da7c-175d-47e9-a1ba-164343f317a8-kube-api-access-5qmtz\") pod \"prometheus-operator-7779bbdd78-cvbr7\" (UID: \"33a5da7c-175d-47e9-a1ba-164343f317a8\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-cvbr7" May 25 23:35:56.949278 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:56.949260 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/33a5da7c-175d-47e9-a1ba-164343f317a8-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-cvbr7\" (UID: \"33a5da7c-175d-47e9-a1ba-164343f317a8\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-cvbr7" May 25 23:35:56.949365 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:56.949291 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/33a5da7c-175d-47e9-a1ba-164343f317a8-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-cvbr7\" (UID: \"33a5da7c-175d-47e9-a1ba-164343f317a8\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-cvbr7" May 25 23:35:57.049981 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:57.049887 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/33a5da7c-175d-47e9-a1ba-164343f317a8-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-cvbr7\" (UID: \"33a5da7c-175d-47e9-a1ba-164343f317a8\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-cvbr7" May 25 23:35:57.049981 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:57.049938 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5qmtz\" (UniqueName: \"kubernetes.io/projected/33a5da7c-175d-47e9-a1ba-164343f317a8-kube-api-access-5qmtz\") pod \"prometheus-operator-7779bbdd78-cvbr7\" (UID: \"33a5da7c-175d-47e9-a1ba-164343f317a8\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-cvbr7" May 25 23:35:57.049981 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:57.049970 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/33a5da7c-175d-47e9-a1ba-164343f317a8-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-cvbr7\" (UID: \"33a5da7c-175d-47e9-a1ba-164343f317a8\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-cvbr7" May 25 23:35:57.050272 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:57.050012 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/33a5da7c-175d-47e9-a1ba-164343f317a8-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-cvbr7\" (UID: \"33a5da7c-175d-47e9-a1ba-164343f317a8\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-cvbr7" May 25 23:35:57.051032 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:57.050979 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/33a5da7c-175d-47e9-a1ba-164343f317a8-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-cvbr7\" (UID: \"33a5da7c-175d-47e9-a1ba-164343f317a8\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-cvbr7" May 25 23:35:57.052719 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:57.052691 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/33a5da7c-175d-47e9-a1ba-164343f317a8-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-cvbr7\" (UID: \"33a5da7c-175d-47e9-a1ba-164343f317a8\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-cvbr7" May 25 23:35:57.052853 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:57.052828 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/33a5da7c-175d-47e9-a1ba-164343f317a8-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-cvbr7\" (UID: \"33a5da7c-175d-47e9-a1ba-164343f317a8\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-cvbr7" May 25 23:35:57.059681 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:57.059660 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qmtz\" (UniqueName: \"kubernetes.io/projected/33a5da7c-175d-47e9-a1ba-164343f317a8-kube-api-access-5qmtz\") pod \"prometheus-operator-7779bbdd78-cvbr7\" (UID: \"33a5da7c-175d-47e9-a1ba-164343f317a8\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-cvbr7" May 25 23:35:57.100547 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:57.100506 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-cvbr7" May 25 23:35:57.245125 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:57.245088 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-cvbr7"] May 25 23:35:57.248384 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:57.248351 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33a5da7c_175d_47e9_a1ba_164343f317a8.slice/crio-84d77297330de402b303150fef87e2494de2244a514ffed41181e1c1d5af3430 WatchSource:0}: Error finding container 84d77297330de402b303150fef87e2494de2244a514ffed41181e1c1d5af3430: Status 404 returned error can't find the container with id 84d77297330de402b303150fef87e2494de2244a514ffed41181e1c1d5af3430 May 25 23:35:57.485846 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:57.485809 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-865b57546d-pjvlq"] May 25 23:35:57.511488 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:57.511441 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-865b57546d-pjvlq"] May 25 23:35:57.511638 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:57.511585 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-865b57546d-pjvlq" May 25 23:35:57.515549 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:57.515524 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" May 25 23:35:57.516087 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:57.515921 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" May 25 23:35:57.516087 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:57.515955 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-6q9j9\"" May 25 23:35:57.516455 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:57.516434 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" May 25 23:35:57.517719 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:57.516735 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" May 25 23:35:57.517719 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:57.516780 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" May 25 23:35:57.655234 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:57.655188 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e-console-config\") pod \"console-865b57546d-pjvlq\" (UID: \"ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e\") " pod="openshift-console/console-865b57546d-pjvlq" May 25 23:35:57.655234 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:57.655237 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdxfv\" (UniqueName: \"kubernetes.io/projected/ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e-kube-api-access-cdxfv\") pod \"console-865b57546d-pjvlq\" (UID: \"ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e\") " pod="openshift-console/console-865b57546d-pjvlq" May 25 23:35:57.655450 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:57.655269 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e-oauth-serving-cert\") pod \"console-865b57546d-pjvlq\" (UID: \"ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e\") " pod="openshift-console/console-865b57546d-pjvlq" May 25 23:35:57.655450 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:57.655344 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e-console-serving-cert\") pod \"console-865b57546d-pjvlq\" (UID: \"ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e\") " pod="openshift-console/console-865b57546d-pjvlq" May 25 23:35:57.655450 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:57.655373 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e-console-oauth-config\") pod \"console-865b57546d-pjvlq\" (UID: \"ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e\") " pod="openshift-console/console-865b57546d-pjvlq" May 25 23:35:57.655450 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:57.655396 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e-service-ca\") pod \"console-865b57546d-pjvlq\" (UID: \"ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e\") " pod="openshift-console/console-865b57546d-pjvlq" May 25 23:35:57.755776 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:57.755678 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e-console-config\") pod \"console-865b57546d-pjvlq\" (UID: \"ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e\") " pod="openshift-console/console-865b57546d-pjvlq" May 25 23:35:57.755776 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:57.755727 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cdxfv\" (UniqueName: \"kubernetes.io/projected/ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e-kube-api-access-cdxfv\") pod \"console-865b57546d-pjvlq\" (UID: \"ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e\") " pod="openshift-console/console-865b57546d-pjvlq" May 25 23:35:57.755776 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:57.755756 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e-oauth-serving-cert\") pod \"console-865b57546d-pjvlq\" (UID: \"ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e\") " pod="openshift-console/console-865b57546d-pjvlq" May 25 23:35:57.756041 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:57.755797 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e-console-serving-cert\") pod \"console-865b57546d-pjvlq\" (UID: \"ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e\") " pod="openshift-console/console-865b57546d-pjvlq" May 25 23:35:57.756041 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:57.755822 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e-console-oauth-config\") pod \"console-865b57546d-pjvlq\" (UID: \"ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e\") " pod="openshift-console/console-865b57546d-pjvlq" May 25 23:35:57.756041 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:57.755844 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e-service-ca\") pod \"console-865b57546d-pjvlq\" (UID: \"ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e\") " pod="openshift-console/console-865b57546d-pjvlq" May 25 23:35:57.756537 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:57.756485 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e-console-config\") pod \"console-865b57546d-pjvlq\" (UID: \"ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e\") " pod="openshift-console/console-865b57546d-pjvlq" May 25 23:35:57.756537 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:57.756529 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e-service-ca\") pod \"console-865b57546d-pjvlq\" (UID: \"ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e\") " pod="openshift-console/console-865b57546d-pjvlq" May 25 23:35:57.757082 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:57.757055 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e-oauth-serving-cert\") pod \"console-865b57546d-pjvlq\" (UID: \"ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e\") " pod="openshift-console/console-865b57546d-pjvlq" May 25 23:35:57.759117 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:57.759098 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e-console-oauth-config\") pod \"console-865b57546d-pjvlq\" (UID: \"ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e\") " pod="openshift-console/console-865b57546d-pjvlq" May 25 23:35:57.759207 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:57.759131 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e-console-serving-cert\") pod \"console-865b57546d-pjvlq\" (UID: \"ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e\") " pod="openshift-console/console-865b57546d-pjvlq" May 25 23:35:57.764892 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:57.764867 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdxfv\" (UniqueName: \"kubernetes.io/projected/ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e-kube-api-access-cdxfv\") pod \"console-865b57546d-pjvlq\" (UID: \"ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e\") " pod="openshift-console/console-865b57546d-pjvlq" May 25 23:35:57.767510 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:57.767474 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-cvbr7" event={"ID":"33a5da7c-175d-47e9-a1ba-164343f317a8","Type":"ContainerStarted","Data":"84d77297330de402b303150fef87e2494de2244a514ffed41181e1c1d5af3430"} May 25 23:35:57.822754 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:57.822715 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-865b57546d-pjvlq" May 25 23:35:57.977637 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:57.977605 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-865b57546d-pjvlq"] May 25 23:35:57.981731 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:35:57.981684 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad0c51f6_8b03_4f1a_9744_b99f2a5cf33e.slice/crio-cc73b48bb9da95aba8987b1d72590f7876813880d3ed983359c7b2bb86599980 WatchSource:0}: Error finding container cc73b48bb9da95aba8987b1d72590f7876813880d3ed983359c7b2bb86599980: Status 404 returned error can't find the container with id cc73b48bb9da95aba8987b1d72590f7876813880d3ed983359c7b2bb86599980 May 25 23:35:58.771389 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:58.771356 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-865b57546d-pjvlq" event={"ID":"ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e","Type":"ContainerStarted","Data":"cc73b48bb9da95aba8987b1d72590f7876813880d3ed983359c7b2bb86599980"} May 25 23:35:59.775199 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:59.775158 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-cvbr7" event={"ID":"33a5da7c-175d-47e9-a1ba-164343f317a8","Type":"ContainerStarted","Data":"8b15caf4ca88a7a930c0c00946ee00254cfe703c99a4f2441af4e1a90131cdac"} May 25 23:35:59.775199 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:59.775199 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-cvbr7" event={"ID":"33a5da7c-175d-47e9-a1ba-164343f317a8","Type":"ContainerStarted","Data":"49690b4f0020c976d36e488e9e02e1543146bad230227e68b1aaef891ec932e1"} May 25 23:35:59.795669 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:35:59.795617 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-cvbr7" podStartSLOduration=2.019346866 podStartE2EDuration="3.795602193s" podCreationTimestamp="2026-05-25 23:35:56 +0000 UTC" firstStartedPulling="2026-05-25 23:35:57.250536223 +0000 UTC m=+55.329431852" lastFinishedPulling="2026-05-25 23:35:59.026791542 +0000 UTC m=+57.105687179" observedRunningTime="2026-05-25 23:35:59.794190139 +0000 UTC m=+57.873085790" watchObservedRunningTime="2026-05-25 23:35:59.795602193 +0000 UTC m=+57.874497842" May 25 23:36:01.699142 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:01.699113 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-czsc7" May 25 23:36:01.782358 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:01.782318 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-865b57546d-pjvlq" event={"ID":"ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e","Type":"ContainerStarted","Data":"1c3905bc6384bb44698c0e6b5fbeb431c093f1aa8011b400b19369db6615e58e"} May 25 23:36:01.803183 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:01.803132 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-865b57546d-pjvlq" podStartSLOduration=1.097309058 podStartE2EDuration="4.803116243s" podCreationTimestamp="2026-05-25 23:35:57 +0000 UTC" firstStartedPulling="2026-05-25 23:35:57.984083859 +0000 UTC m=+56.062979488" lastFinishedPulling="2026-05-25 23:36:01.689891042 +0000 UTC m=+59.768786673" observedRunningTime="2026-05-25 23:36:01.802251941 +0000 UTC m=+59.881147622" watchObservedRunningTime="2026-05-25 23:36:01.803116243 +0000 UTC m=+59.882011894" May 25 23:36:02.175137 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.175042 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-mkzjd"] May 25 23:36:02.177789 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.177757 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-mkzjd" May 25 23:36:02.181644 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.181411 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" May 25 23:36:02.181644 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.181505 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" May 25 23:36:02.181822 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.181745 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-ljggx\"" May 25 23:36:02.188754 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.188731 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rggrk\" (UniqueName: \"kubernetes.io/projected/5563295b-45f9-45e1-9811-41f36c1edcac-kube-api-access-rggrk\") pod \"openshift-state-metrics-9c959559f-mkzjd\" (UID: \"5563295b-45f9-45e1-9811-41f36c1edcac\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-mkzjd" May 25 23:36:02.188877 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.188769 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5563295b-45f9-45e1-9811-41f36c1edcac-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-mkzjd\" (UID: \"5563295b-45f9-45e1-9811-41f36c1edcac\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-mkzjd" May 25 23:36:02.188945 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.188924 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5563295b-45f9-45e1-9811-41f36c1edcac-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-mkzjd\" (UID: \"5563295b-45f9-45e1-9811-41f36c1edcac\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-mkzjd" May 25 23:36:02.189030 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.188976 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5563295b-45f9-45e1-9811-41f36c1edcac-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-mkzjd\" (UID: \"5563295b-45f9-45e1-9811-41f36c1edcac\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-mkzjd" May 25 23:36:02.189123 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.189102 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-mkzjd"] May 25 23:36:02.200529 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.200506 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-6lpv9"] May 25 23:36:02.202580 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.202563 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6lpv9" May 25 23:36:02.205287 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.205268 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-7b6zz\"" May 25 23:36:02.205850 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.205823 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" May 25 23:36:02.205964 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.205948 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" May 25 23:36:02.206240 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.206223 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" May 25 23:36:02.218164 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.218140 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-6lpv9"] May 25 23:36:02.227604 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.227478 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-js7jj"] May 25 23:36:02.229686 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.229667 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-js7jj" May 25 23:36:02.232522 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.232504 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 25 23:36:02.232638 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.232610 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 25 23:36:02.232743 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.232530 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 25 23:36:02.232743 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.232735 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qnf7k\"" May 25 23:36:02.289648 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.289612 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5563295b-45f9-45e1-9811-41f36c1edcac-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-mkzjd\" (UID: \"5563295b-45f9-45e1-9811-41f36c1edcac\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-mkzjd" May 25 23:36:02.289832 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.289661 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rggrk\" (UniqueName: \"kubernetes.io/projected/5563295b-45f9-45e1-9811-41f36c1edcac-kube-api-access-rggrk\") pod \"openshift-state-metrics-9c959559f-mkzjd\" (UID: \"5563295b-45f9-45e1-9811-41f36c1edcac\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-mkzjd" May 25 23:36:02.289901 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.289823 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0e6458a2-3845-4a30-91fd-294be02aca29-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-6lpv9\" (UID: \"0e6458a2-3845-4a30-91fd-294be02aca29\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6lpv9" May 25 23:36:02.289901 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.289871 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/87c8c237-457a-4573-adf8-c8729124bb9c-node-exporter-tls\") pod \"node-exporter-js7jj\" (UID: \"87c8c237-457a-4573-adf8-c8729124bb9c\") " pod="openshift-monitoring/node-exporter-js7jj" May 25 23:36:02.290026 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.289971 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/87c8c237-457a-4573-adf8-c8729124bb9c-node-exporter-accelerators-collector-config\") pod \"node-exporter-js7jj\" (UID: \"87c8c237-457a-4573-adf8-c8729124bb9c\") " pod="openshift-monitoring/node-exporter-js7jj" May 25 23:36:02.290096 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.290058 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/87c8c237-457a-4573-adf8-c8729124bb9c-metrics-client-ca\") pod \"node-exporter-js7jj\" (UID: \"87c8c237-457a-4573-adf8-c8729124bb9c\") " pod="openshift-monitoring/node-exporter-js7jj" May 25 23:36:02.290149 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.290097 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5563295b-45f9-45e1-9811-41f36c1edcac-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-mkzjd\" (UID: \"5563295b-45f9-45e1-9811-41f36c1edcac\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-mkzjd" May 25 23:36:02.290197 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.290167 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/87c8c237-457a-4573-adf8-c8729124bb9c-node-exporter-textfile\") pod \"node-exporter-js7jj\" (UID: \"87c8c237-457a-4573-adf8-c8729124bb9c\") " pod="openshift-monitoring/node-exporter-js7jj" May 25 23:36:02.290240 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:36:02.290193 2560 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found May 25 23:36:02.290240 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.290197 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e6458a2-3845-4a30-91fd-294be02aca29-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-6lpv9\" (UID: \"0e6458a2-3845-4a30-91fd-294be02aca29\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6lpv9" May 25 23:36:02.290240 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.290220 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8bt7\" (UniqueName: \"kubernetes.io/projected/0e6458a2-3845-4a30-91fd-294be02aca29-kube-api-access-g8bt7\") pod \"kube-state-metrics-54fd6bc5c4-6lpv9\" (UID: \"0e6458a2-3845-4a30-91fd-294be02aca29\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6lpv9" May 25 23:36:02.290409 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:36:02.290252 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5563295b-45f9-45e1-9811-41f36c1edcac-openshift-state-metrics-tls podName:5563295b-45f9-45e1-9811-41f36c1edcac nodeName:}" failed. No retries permitted until 2026-05-25 23:36:02.790231379 +0000 UTC m=+60.869127050 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/5563295b-45f9-45e1-9811-41f36c1edcac-openshift-state-metrics-tls") pod "openshift-state-metrics-9c959559f-mkzjd" (UID: "5563295b-45f9-45e1-9811-41f36c1edcac") : secret "openshift-state-metrics-tls" not found May 25 23:36:02.290409 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.290312 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0e6458a2-3845-4a30-91fd-294be02aca29-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-6lpv9\" (UID: \"0e6458a2-3845-4a30-91fd-294be02aca29\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6lpv9" May 25 23:36:02.290409 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.290350 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/87c8c237-457a-4573-adf8-c8729124bb9c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-js7jj\" (UID: \"87c8c237-457a-4573-adf8-c8729124bb9c\") " pod="openshift-monitoring/node-exporter-js7jj" May 25 23:36:02.290559 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.290543 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/87c8c237-457a-4573-adf8-c8729124bb9c-sys\") pod \"node-exporter-js7jj\" (UID: \"87c8c237-457a-4573-adf8-c8729124bb9c\") " pod="openshift-monitoring/node-exporter-js7jj" May 25 23:36:02.290595 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.290582 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdpcc\" (UniqueName: \"kubernetes.io/projected/87c8c237-457a-4573-adf8-c8729124bb9c-kube-api-access-fdpcc\") pod \"node-exporter-js7jj\" (UID: \"87c8c237-457a-4573-adf8-c8729124bb9c\") " pod="openshift-monitoring/node-exporter-js7jj" May 25 23:36:02.290640 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.290608 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0e6458a2-3845-4a30-91fd-294be02aca29-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-6lpv9\" (UID: \"0e6458a2-3845-4a30-91fd-294be02aca29\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6lpv9" May 25 23:36:02.290678 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.290658 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0e6458a2-3845-4a30-91fd-294be02aca29-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-6lpv9\" (UID: \"0e6458a2-3845-4a30-91fd-294be02aca29\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6lpv9" May 25 23:36:02.290707 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.290689 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5563295b-45f9-45e1-9811-41f36c1edcac-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-mkzjd\" (UID: \"5563295b-45f9-45e1-9811-41f36c1edcac\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-mkzjd" May 25 23:36:02.290747 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.290721 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/87c8c237-457a-4573-adf8-c8729124bb9c-root\") pod \"node-exporter-js7jj\" (UID: \"87c8c237-457a-4573-adf8-c8729124bb9c\") " pod="openshift-monitoring/node-exporter-js7jj" May 25 23:36:02.290790 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.290750 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/87c8c237-457a-4573-adf8-c8729124bb9c-node-exporter-wtmp\") pod \"node-exporter-js7jj\" (UID: \"87c8c237-457a-4573-adf8-c8729124bb9c\") " pod="openshift-monitoring/node-exporter-js7jj" May 25 23:36:02.291479 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.291458 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5563295b-45f9-45e1-9811-41f36c1edcac-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-mkzjd\" (UID: \"5563295b-45f9-45e1-9811-41f36c1edcac\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-mkzjd" May 25 23:36:02.292568 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.292544 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5563295b-45f9-45e1-9811-41f36c1edcac-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-mkzjd\" (UID: \"5563295b-45f9-45e1-9811-41f36c1edcac\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-mkzjd" May 25 23:36:02.300428 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.300383 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rggrk\" (UniqueName: \"kubernetes.io/projected/5563295b-45f9-45e1-9811-41f36c1edcac-kube-api-access-rggrk\") pod \"openshift-state-metrics-9c959559f-mkzjd\" (UID: \"5563295b-45f9-45e1-9811-41f36c1edcac\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-mkzjd" May 25 23:36:02.391996 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.391944 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/87c8c237-457a-4573-adf8-c8729124bb9c-node-exporter-accelerators-collector-config\") pod \"node-exporter-js7jj\" (UID: \"87c8c237-457a-4573-adf8-c8729124bb9c\") " pod="openshift-monitoring/node-exporter-js7jj" May 25 23:36:02.392173 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.392014 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/87c8c237-457a-4573-adf8-c8729124bb9c-metrics-client-ca\") pod \"node-exporter-js7jj\" (UID: \"87c8c237-457a-4573-adf8-c8729124bb9c\") " pod="openshift-monitoring/node-exporter-js7jj" May 25 23:36:02.392173 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.392061 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/87c8c237-457a-4573-adf8-c8729124bb9c-node-exporter-textfile\") pod \"node-exporter-js7jj\" (UID: \"87c8c237-457a-4573-adf8-c8729124bb9c\") " pod="openshift-monitoring/node-exporter-js7jj" May 25 23:36:02.392173 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.392088 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e6458a2-3845-4a30-91fd-294be02aca29-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-6lpv9\" (UID: \"0e6458a2-3845-4a30-91fd-294be02aca29\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6lpv9" May 25 23:36:02.392173 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.392114 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g8bt7\" (UniqueName: \"kubernetes.io/projected/0e6458a2-3845-4a30-91fd-294be02aca29-kube-api-access-g8bt7\") pod \"kube-state-metrics-54fd6bc5c4-6lpv9\" (UID: \"0e6458a2-3845-4a30-91fd-294be02aca29\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6lpv9" May 25 23:36:02.392173 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.392143 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0e6458a2-3845-4a30-91fd-294be02aca29-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-6lpv9\" (UID: \"0e6458a2-3845-4a30-91fd-294be02aca29\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6lpv9" May 25 23:36:02.392409 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.392174 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/87c8c237-457a-4573-adf8-c8729124bb9c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-js7jj\" (UID: \"87c8c237-457a-4573-adf8-c8729124bb9c\") " pod="openshift-monitoring/node-exporter-js7jj" May 25 23:36:02.392409 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.392202 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/87c8c237-457a-4573-adf8-c8729124bb9c-sys\") pod \"node-exporter-js7jj\" (UID: \"87c8c237-457a-4573-adf8-c8729124bb9c\") " pod="openshift-monitoring/node-exporter-js7jj" May 25 23:36:02.392409 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.392236 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fdpcc\" (UniqueName: \"kubernetes.io/projected/87c8c237-457a-4573-adf8-c8729124bb9c-kube-api-access-fdpcc\") pod \"node-exporter-js7jj\" (UID: \"87c8c237-457a-4573-adf8-c8729124bb9c\") " pod="openshift-monitoring/node-exporter-js7jj" May 25 23:36:02.392409 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.392263 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0e6458a2-3845-4a30-91fd-294be02aca29-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-6lpv9\" (UID: \"0e6458a2-3845-4a30-91fd-294be02aca29\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6lpv9" May 25 23:36:02.392409 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.392312 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0e6458a2-3845-4a30-91fd-294be02aca29-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-6lpv9\" (UID: \"0e6458a2-3845-4a30-91fd-294be02aca29\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6lpv9" May 25 23:36:02.392409 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.392338 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/87c8c237-457a-4573-adf8-c8729124bb9c-root\") pod \"node-exporter-js7jj\" (UID: \"87c8c237-457a-4573-adf8-c8729124bb9c\") " pod="openshift-monitoring/node-exporter-js7jj" May 25 23:36:02.392409 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.392357 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/87c8c237-457a-4573-adf8-c8729124bb9c-node-exporter-wtmp\") pod \"node-exporter-js7jj\" (UID: \"87c8c237-457a-4573-adf8-c8729124bb9c\") " pod="openshift-monitoring/node-exporter-js7jj" May 25 23:36:02.392409 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.392395 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0e6458a2-3845-4a30-91fd-294be02aca29-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-6lpv9\" (UID: \"0e6458a2-3845-4a30-91fd-294be02aca29\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6lpv9" May 25 23:36:02.392772 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.392420 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/87c8c237-457a-4573-adf8-c8729124bb9c-node-exporter-tls\") pod \"node-exporter-js7jj\" (UID: \"87c8c237-457a-4573-adf8-c8729124bb9c\") " pod="openshift-monitoring/node-exporter-js7jj" May 25 23:36:02.392772 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.392445 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/87c8c237-457a-4573-adf8-c8729124bb9c-node-exporter-textfile\") pod \"node-exporter-js7jj\" (UID: \"87c8c237-457a-4573-adf8-c8729124bb9c\") " pod="openshift-monitoring/node-exporter-js7jj" May 25 23:36:02.392772 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.392613 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/87c8c237-457a-4573-adf8-c8729124bb9c-metrics-client-ca\") pod \"node-exporter-js7jj\" (UID: \"87c8c237-457a-4573-adf8-c8729124bb9c\") " pod="openshift-monitoring/node-exporter-js7jj" May 25 23:36:02.392919 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.392777 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/87c8c237-457a-4573-adf8-c8729124bb9c-sys\") pod \"node-exporter-js7jj\" (UID: \"87c8c237-457a-4573-adf8-c8729124bb9c\") " pod="openshift-monitoring/node-exporter-js7jj" May 25 23:36:02.393429 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.392613 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/87c8c237-457a-4573-adf8-c8729124bb9c-node-exporter-accelerators-collector-config\") pod \"node-exporter-js7jj\" (UID: \"87c8c237-457a-4573-adf8-c8729124bb9c\") " pod="openshift-monitoring/node-exporter-js7jj" May 25 23:36:02.393429 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.393096 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/87c8c237-457a-4573-adf8-c8729124bb9c-root\") pod \"node-exporter-js7jj\" (UID: \"87c8c237-457a-4573-adf8-c8729124bb9c\") " pod="openshift-monitoring/node-exporter-js7jj" May 25 23:36:02.393429 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.393192 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/87c8c237-457a-4573-adf8-c8729124bb9c-node-exporter-wtmp\") pod \"node-exporter-js7jj\" (UID: \"87c8c237-457a-4573-adf8-c8729124bb9c\") " pod="openshift-monitoring/node-exporter-js7jj" May 25 23:36:02.393429 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:36:02.393275 2560 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found May 25 23:36:02.393429 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.393274 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e6458a2-3845-4a30-91fd-294be02aca29-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-6lpv9\" (UID: \"0e6458a2-3845-4a30-91fd-294be02aca29\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6lpv9" May 25 23:36:02.393429 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:36:02.393327 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e6458a2-3845-4a30-91fd-294be02aca29-kube-state-metrics-tls podName:0e6458a2-3845-4a30-91fd-294be02aca29 nodeName:}" failed. No retries permitted until 2026-05-25 23:36:02.893314033 +0000 UTC m=+60.972209661 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/0e6458a2-3845-4a30-91fd-294be02aca29-kube-state-metrics-tls") pod "kube-state-metrics-54fd6bc5c4-6lpv9" (UID: "0e6458a2-3845-4a30-91fd-294be02aca29") : secret "kube-state-metrics-tls" not found May 25 23:36:02.393429 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.393394 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0e6458a2-3845-4a30-91fd-294be02aca29-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-6lpv9\" (UID: \"0e6458a2-3845-4a30-91fd-294be02aca29\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6lpv9" May 25 23:36:02.393794 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.393449 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0e6458a2-3845-4a30-91fd-294be02aca29-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-6lpv9\" (UID: \"0e6458a2-3845-4a30-91fd-294be02aca29\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6lpv9" May 25 23:36:02.395382 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.395341 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/87c8c237-457a-4573-adf8-c8729124bb9c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-js7jj\" (UID: \"87c8c237-457a-4573-adf8-c8729124bb9c\") " pod="openshift-monitoring/node-exporter-js7jj" May 25 23:36:02.395546 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.395527 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/87c8c237-457a-4573-adf8-c8729124bb9c-node-exporter-tls\") pod \"node-exporter-js7jj\" (UID: \"87c8c237-457a-4573-adf8-c8729124bb9c\") " pod="openshift-monitoring/node-exporter-js7jj" May 25 23:36:02.395612 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.395530 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0e6458a2-3845-4a30-91fd-294be02aca29-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-6lpv9\" (UID: \"0e6458a2-3845-4a30-91fd-294be02aca29\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6lpv9" May 25 23:36:02.404738 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.404717 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdpcc\" (UniqueName: \"kubernetes.io/projected/87c8c237-457a-4573-adf8-c8729124bb9c-kube-api-access-fdpcc\") pod \"node-exporter-js7jj\" (UID: \"87c8c237-457a-4573-adf8-c8729124bb9c\") " pod="openshift-monitoring/node-exporter-js7jj" May 25 23:36:02.405187 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.405162 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8bt7\" (UniqueName: \"kubernetes.io/projected/0e6458a2-3845-4a30-91fd-294be02aca29-kube-api-access-g8bt7\") pod \"kube-state-metrics-54fd6bc5c4-6lpv9\" (UID: \"0e6458a2-3845-4a30-91fd-294be02aca29\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6lpv9" May 25 23:36:02.543471 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.543444 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qnf7k\"" May 25 23:36:02.550680 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.550655 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-js7jj" May 25 23:36:02.559379 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:36:02.559345 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87c8c237_457a_4573_adf8_c8729124bb9c.slice/crio-61a13486a080f71cc2e2b571e174f1866f659fadbbaab34f23816baef0608435 WatchSource:0}: Error finding container 61a13486a080f71cc2e2b571e174f1866f659fadbbaab34f23816baef0608435: Status 404 returned error can't find the container with id 61a13486a080f71cc2e2b571e174f1866f659fadbbaab34f23816baef0608435 May 25 23:36:02.786333 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.786289 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-js7jj" event={"ID":"87c8c237-457a-4573-adf8-c8729124bb9c","Type":"ContainerStarted","Data":"61a13486a080f71cc2e2b571e174f1866f659fadbbaab34f23816baef0608435"} May 25 23:36:02.796283 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.796204 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5563295b-45f9-45e1-9811-41f36c1edcac-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-mkzjd\" (UID: \"5563295b-45f9-45e1-9811-41f36c1edcac\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-mkzjd" May 25 23:36:02.796597 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:36:02.796575 2560 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found May 25 23:36:02.796669 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:36:02.796647 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5563295b-45f9-45e1-9811-41f36c1edcac-openshift-state-metrics-tls podName:5563295b-45f9-45e1-9811-41f36c1edcac nodeName:}" failed. No retries permitted until 2026-05-25 23:36:03.796626716 +0000 UTC m=+61.875522345 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/5563295b-45f9-45e1-9811-41f36c1edcac-openshift-state-metrics-tls") pod "openshift-state-metrics-9c959559f-mkzjd" (UID: "5563295b-45f9-45e1-9811-41f36c1edcac") : secret "openshift-state-metrics-tls" not found May 25 23:36:02.897294 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.897259 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0e6458a2-3845-4a30-91fd-294be02aca29-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-6lpv9\" (UID: \"0e6458a2-3845-4a30-91fd-294be02aca29\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6lpv9" May 25 23:36:02.899799 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:02.899773 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0e6458a2-3845-4a30-91fd-294be02aca29-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-6lpv9\" (UID: \"0e6458a2-3845-4a30-91fd-294be02aca29\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6lpv9" May 25 23:36:03.115501 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:03.115419 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-7b6zz\"" May 25 23:36:03.123815 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:03.123776 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6lpv9" May 25 23:36:03.284235 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:03.284185 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-6lpv9"] May 25 23:36:03.290777 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:36:03.290723 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e6458a2_3845_4a30_91fd_294be02aca29.slice/crio-be8ea0fac5175ee1e5aa5dd060e95158ea91f52fb7b3bfce4fcf219294daff1d WatchSource:0}: Error finding container be8ea0fac5175ee1e5aa5dd060e95158ea91f52fb7b3bfce4fcf219294daff1d: Status 404 returned error can't find the container with id be8ea0fac5175ee1e5aa5dd060e95158ea91f52fb7b3bfce4fcf219294daff1d May 25 23:36:03.757846 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:03.757817 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-jd6l5" May 25 23:36:03.790664 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:03.790627 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6lpv9" event={"ID":"0e6458a2-3845-4a30-91fd-294be02aca29","Type":"ContainerStarted","Data":"be8ea0fac5175ee1e5aa5dd060e95158ea91f52fb7b3bfce4fcf219294daff1d"} May 25 23:36:03.805577 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:03.805534 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5563295b-45f9-45e1-9811-41f36c1edcac-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-mkzjd\" (UID: \"5563295b-45f9-45e1-9811-41f36c1edcac\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-mkzjd" May 25 23:36:03.817018 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:03.808442 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5563295b-45f9-45e1-9811-41f36c1edcac-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-mkzjd\" (UID: \"5563295b-45f9-45e1-9811-41f36c1edcac\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-mkzjd" May 25 23:36:03.991365 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:03.991331 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-ljggx\"" May 25 23:36:03.999407 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:03.999380 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-mkzjd" May 25 23:36:04.080318 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:04.080242 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-74bf574f55-dhpxl"] May 25 23:36:04.083911 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:04.083888 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74bf574f55-dhpxl" May 25 23:36:04.093111 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:04.092636 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74bf574f55-dhpxl"] May 25 23:36:04.093111 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:04.092945 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" May 25 23:36:04.108073 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:04.108039 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b64ba0b8-1a4c-4933-bbb2-68765be0efe8-trusted-ca-bundle\") pod \"console-74bf574f55-dhpxl\" (UID: \"b64ba0b8-1a4c-4933-bbb2-68765be0efe8\") " pod="openshift-console/console-74bf574f55-dhpxl" May 25 23:36:04.108213 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:04.108095 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b64ba0b8-1a4c-4933-bbb2-68765be0efe8-oauth-serving-cert\") pod \"console-74bf574f55-dhpxl\" (UID: \"b64ba0b8-1a4c-4933-bbb2-68765be0efe8\") " pod="openshift-console/console-74bf574f55-dhpxl" May 25 23:36:04.108213 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:04.108191 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b64ba0b8-1a4c-4933-bbb2-68765be0efe8-console-oauth-config\") pod \"console-74bf574f55-dhpxl\" (UID: \"b64ba0b8-1a4c-4933-bbb2-68765be0efe8\") " pod="openshift-console/console-74bf574f55-dhpxl" May 25 23:36:04.108309 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:04.108242 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b64ba0b8-1a4c-4933-bbb2-68765be0efe8-console-config\") pod \"console-74bf574f55-dhpxl\" (UID: \"b64ba0b8-1a4c-4933-bbb2-68765be0efe8\") " pod="openshift-console/console-74bf574f55-dhpxl" May 25 23:36:04.108356 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:04.108322 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b64ba0b8-1a4c-4933-bbb2-68765be0efe8-console-serving-cert\") pod \"console-74bf574f55-dhpxl\" (UID: \"b64ba0b8-1a4c-4933-bbb2-68765be0efe8\") " pod="openshift-console/console-74bf574f55-dhpxl" May 25 23:36:04.108401 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:04.108355 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b64ba0b8-1a4c-4933-bbb2-68765be0efe8-service-ca\") pod \"console-74bf574f55-dhpxl\" (UID: \"b64ba0b8-1a4c-4933-bbb2-68765be0efe8\") " pod="openshift-console/console-74bf574f55-dhpxl" May 25 23:36:04.108401 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:04.108382 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jq8rx\" (UniqueName: \"kubernetes.io/projected/b64ba0b8-1a4c-4933-bbb2-68765be0efe8-kube-api-access-jq8rx\") pod \"console-74bf574f55-dhpxl\" (UID: \"b64ba0b8-1a4c-4933-bbb2-68765be0efe8\") " pod="openshift-console/console-74bf574f55-dhpxl" May 25 23:36:04.208942 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:04.208900 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b64ba0b8-1a4c-4933-bbb2-68765be0efe8-oauth-serving-cert\") pod \"console-74bf574f55-dhpxl\" (UID: \"b64ba0b8-1a4c-4933-bbb2-68765be0efe8\") " pod="openshift-console/console-74bf574f55-dhpxl" May 25 23:36:04.209139 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:04.208973 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b64ba0b8-1a4c-4933-bbb2-68765be0efe8-console-oauth-config\") pod \"console-74bf574f55-dhpxl\" (UID: \"b64ba0b8-1a4c-4933-bbb2-68765be0efe8\") " pod="openshift-console/console-74bf574f55-dhpxl" May 25 23:36:04.209139 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:04.209030 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b64ba0b8-1a4c-4933-bbb2-68765be0efe8-console-config\") pod \"console-74bf574f55-dhpxl\" (UID: \"b64ba0b8-1a4c-4933-bbb2-68765be0efe8\") " pod="openshift-console/console-74bf574f55-dhpxl" May 25 23:36:04.209139 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:04.209063 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b64ba0b8-1a4c-4933-bbb2-68765be0efe8-console-serving-cert\") pod \"console-74bf574f55-dhpxl\" (UID: \"b64ba0b8-1a4c-4933-bbb2-68765be0efe8\") " pod="openshift-console/console-74bf574f55-dhpxl" May 25 23:36:04.209139 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:04.209079 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b64ba0b8-1a4c-4933-bbb2-68765be0efe8-service-ca\") pod \"console-74bf574f55-dhpxl\" (UID: \"b64ba0b8-1a4c-4933-bbb2-68765be0efe8\") " pod="openshift-console/console-74bf574f55-dhpxl" May 25 23:36:04.209139 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:04.209097 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jq8rx\" (UniqueName: \"kubernetes.io/projected/b64ba0b8-1a4c-4933-bbb2-68765be0efe8-kube-api-access-jq8rx\") pod \"console-74bf574f55-dhpxl\" (UID: \"b64ba0b8-1a4c-4933-bbb2-68765be0efe8\") " pod="openshift-console/console-74bf574f55-dhpxl" May 25 23:36:04.209139 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:04.209138 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b64ba0b8-1a4c-4933-bbb2-68765be0efe8-trusted-ca-bundle\") pod \"console-74bf574f55-dhpxl\" (UID: \"b64ba0b8-1a4c-4933-bbb2-68765be0efe8\") " pod="openshift-console/console-74bf574f55-dhpxl" May 25 23:36:04.209729 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:04.209703 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b64ba0b8-1a4c-4933-bbb2-68765be0efe8-oauth-serving-cert\") pod \"console-74bf574f55-dhpxl\" (UID: \"b64ba0b8-1a4c-4933-bbb2-68765be0efe8\") " pod="openshift-console/console-74bf574f55-dhpxl" May 25 23:36:04.209852 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:04.209824 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b64ba0b8-1a4c-4933-bbb2-68765be0efe8-service-ca\") pod \"console-74bf574f55-dhpxl\" (UID: \"b64ba0b8-1a4c-4933-bbb2-68765be0efe8\") " pod="openshift-console/console-74bf574f55-dhpxl" May 25 23:36:04.209977 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:04.209875 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b64ba0b8-1a4c-4933-bbb2-68765be0efe8-console-config\") pod \"console-74bf574f55-dhpxl\" (UID: \"b64ba0b8-1a4c-4933-bbb2-68765be0efe8\") " pod="openshift-console/console-74bf574f55-dhpxl" May 25 23:36:04.210231 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:04.210083 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b64ba0b8-1a4c-4933-bbb2-68765be0efe8-trusted-ca-bundle\") pod \"console-74bf574f55-dhpxl\" (UID: \"b64ba0b8-1a4c-4933-bbb2-68765be0efe8\") " pod="openshift-console/console-74bf574f55-dhpxl" May 25 23:36:04.212175 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:04.212154 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b64ba0b8-1a4c-4933-bbb2-68765be0efe8-console-serving-cert\") pod \"console-74bf574f55-dhpxl\" (UID: \"b64ba0b8-1a4c-4933-bbb2-68765be0efe8\") " pod="openshift-console/console-74bf574f55-dhpxl" May 25 23:36:04.212568 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:04.212549 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b64ba0b8-1a4c-4933-bbb2-68765be0efe8-console-oauth-config\") pod \"console-74bf574f55-dhpxl\" (UID: \"b64ba0b8-1a4c-4933-bbb2-68765be0efe8\") " pod="openshift-console/console-74bf574f55-dhpxl" May 25 23:36:04.229217 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:04.229192 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jq8rx\" (UniqueName: \"kubernetes.io/projected/b64ba0b8-1a4c-4933-bbb2-68765be0efe8-kube-api-access-jq8rx\") pod \"console-74bf574f55-dhpxl\" (UID: \"b64ba0b8-1a4c-4933-bbb2-68765be0efe8\") " pod="openshift-console/console-74bf574f55-dhpxl" May 25 23:36:04.396840 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:04.396751 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74bf574f55-dhpxl" May 25 23:36:06.933948 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:06.933905 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-x67zk"] May 25 23:36:06.967857 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:06.967812 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-x67zk"] May 25 23:36:06.968043 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:06.967963 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-x67zk" May 25 23:36:06.970716 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:06.970690 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" May 25 23:36:06.970851 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:06.970821 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-pjd6m\"" May 25 23:36:07.035210 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:07.035177 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4b94d60b-988f-4438-83f1-d0565943b3c1-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-x67zk\" (UID: \"4b94d60b-988f-4438-83f1-d0565943b3c1\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-x67zk" May 25 23:36:07.136574 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:07.136528 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4b94d60b-988f-4438-83f1-d0565943b3c1-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-x67zk\" (UID: \"4b94d60b-988f-4438-83f1-d0565943b3c1\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-x67zk" May 25 23:36:07.139545 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:07.139518 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4b94d60b-988f-4438-83f1-d0565943b3c1-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-x67zk\" (UID: \"4b94d60b-988f-4438-83f1-d0565943b3c1\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-x67zk" May 25 23:36:07.279713 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:07.279613 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-x67zk" May 25 23:36:07.823550 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:07.823514 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-865b57546d-pjvlq" May 25 23:36:07.823550 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:07.823556 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-865b57546d-pjvlq" May 25 23:36:07.829082 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:07.829056 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-865b57546d-pjvlq" May 25 23:36:08.245902 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.245860 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/694e83a1-a7ed-4246-a57b-6ba3e80ae3ba-metrics-certs\") pod \"network-metrics-daemon-7ws64\" (UID: \"694e83a1-a7ed-4246-a57b-6ba3e80ae3ba\") " pod="openshift-multus/network-metrics-daemon-7ws64" May 25 23:36:08.248890 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.248863 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 25 23:36:08.259749 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.259716 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/694e83a1-a7ed-4246-a57b-6ba3e80ae3ba-metrics-certs\") pod \"network-metrics-daemon-7ws64\" (UID: \"694e83a1-a7ed-4246-a57b-6ba3e80ae3ba\") " pod="openshift-multus/network-metrics-daemon-7ws64" May 25 23:36:08.347344 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.347300 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7sxdv\" (UniqueName: \"kubernetes.io/projected/053dd95b-4d61-480d-8a80-645cf902780e-kube-api-access-7sxdv\") pod \"network-check-target-twhc6\" (UID: \"053dd95b-4d61-480d-8a80-645cf902780e\") " pod="openshift-network-diagnostics/network-check-target-twhc6" May 25 23:36:08.349956 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.349934 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 25 23:36:08.360714 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.360687 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 25 23:36:08.372105 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.372073 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sxdv\" (UniqueName: \"kubernetes.io/projected/053dd95b-4d61-480d-8a80-645cf902780e-kube-api-access-7sxdv\") pod \"network-check-target-twhc6\" (UID: \"053dd95b-4d61-480d-8a80-645cf902780e\") " pod="openshift-network-diagnostics/network-check-target-twhc6" May 25 23:36:08.417289 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.417254 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 25 23:36:08.432018 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.431609 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 25 23:36:08.434765 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.434733 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 25 23:36:08.436863 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.435272 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 25 23:36:08.436863 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.435510 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 25 23:36:08.436863 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.435739 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 25 23:36:08.436863 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.435751 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 25 23:36:08.436863 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.435767 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-kq2k8\"" May 25 23:36:08.436863 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.436026 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 25 23:36:08.436863 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.436187 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 25 23:36:08.436863 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.436349 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 25 23:36:08.436863 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.436610 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 25 23:36:08.436863 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.436837 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 25 23:36:08.437406 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.436945 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 25 23:36:08.437406 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.437079 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 25 23:36:08.437406 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.437219 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 25 23:36:08.437853 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.437404 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-6613d0ro0rj9k\"" May 25 23:36:08.440451 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.440430 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 25 23:36:08.448249 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.448227 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/42e4a0f8-9f66-42e2-857c-36edcf42416a-config-out\") pod \"prometheus-k8s-0\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:36:08.448362 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.448271 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/42e4a0f8-9f66-42e2-857c-36edcf42416a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:36:08.448362 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.448302 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42e4a0f8-9f66-42e2-857c-36edcf42416a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:36:08.448362 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.448348 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42e4a0f8-9f66-42e2-857c-36edcf42416a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:36:08.448545 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.448374 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/42e4a0f8-9f66-42e2-857c-36edcf42416a-web-config\") pod \"prometheus-k8s-0\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:36:08.448545 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.448405 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/42e4a0f8-9f66-42e2-857c-36edcf42416a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:36:08.448545 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.448434 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/42e4a0f8-9f66-42e2-857c-36edcf42416a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:36:08.448545 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.448468 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/42e4a0f8-9f66-42e2-857c-36edcf42416a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:36:08.448545 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.448491 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/42e4a0f8-9f66-42e2-857c-36edcf42416a-config\") pod \"prometheus-k8s-0\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:36:08.448545 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.448515 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/42e4a0f8-9f66-42e2-857c-36edcf42416a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:36:08.448545 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.448539 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ns42\" (UniqueName: \"kubernetes.io/projected/42e4a0f8-9f66-42e2-857c-36edcf42416a-kube-api-access-9ns42\") pod \"prometheus-k8s-0\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:36:08.448852 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.448569 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42e4a0f8-9f66-42e2-857c-36edcf42416a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:36:08.448852 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.448604 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/42e4a0f8-9f66-42e2-857c-36edcf42416a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:36:08.448852 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.448630 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42e4a0f8-9f66-42e2-857c-36edcf42416a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:36:08.448852 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.448660 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/42e4a0f8-9f66-42e2-857c-36edcf42416a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:36:08.448852 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.448683 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/42e4a0f8-9f66-42e2-857c-36edcf42416a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:36:08.448852 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.448728 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/42e4a0f8-9f66-42e2-857c-36edcf42416a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:36:08.448852 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.448766 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/42e4a0f8-9f66-42e2-857c-36edcf42416a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:36:08.549783 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.549691 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/42e4a0f8-9f66-42e2-857c-36edcf42416a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:36:08.549783 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.549733 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/42e4a0f8-9f66-42e2-857c-36edcf42416a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:36:08.549783 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.549766 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/42e4a0f8-9f66-42e2-857c-36edcf42416a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:36:08.550091 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.549792 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/42e4a0f8-9f66-42e2-857c-36edcf42416a-config\") pod \"prometheus-k8s-0\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:36:08.550091 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.549814 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/42e4a0f8-9f66-42e2-857c-36edcf42416a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:36:08.550091 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.549834 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9ns42\" (UniqueName: \"kubernetes.io/projected/42e4a0f8-9f66-42e2-857c-36edcf42416a-kube-api-access-9ns42\") pod \"prometheus-k8s-0\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:36:08.550091 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.549860 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42e4a0f8-9f66-42e2-857c-36edcf42416a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:36:08.550091 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.549892 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/42e4a0f8-9f66-42e2-857c-36edcf42416a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:36:08.550091 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.549918 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42e4a0f8-9f66-42e2-857c-36edcf42416a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:36:08.550091 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.549945 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/42e4a0f8-9f66-42e2-857c-36edcf42416a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:36:08.550091 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.549972 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/42e4a0f8-9f66-42e2-857c-36edcf42416a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:36:08.550091 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.550034 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/42e4a0f8-9f66-42e2-857c-36edcf42416a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:36:08.550091 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.550065 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/42e4a0f8-9f66-42e2-857c-36edcf42416a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:36:08.550530 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.550106 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/42e4a0f8-9f66-42e2-857c-36edcf42416a-config-out\") pod \"prometheus-k8s-0\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:36:08.550530 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.550147 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/42e4a0f8-9f66-42e2-857c-36edcf42416a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:36:08.550530 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.550175 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42e4a0f8-9f66-42e2-857c-36edcf42416a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:36:08.550530 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.550211 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42e4a0f8-9f66-42e2-857c-36edcf42416a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:36:08.550530 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.550239 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/42e4a0f8-9f66-42e2-857c-36edcf42416a-web-config\") pod \"prometheus-k8s-0\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:36:08.551514 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.551488 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42e4a0f8-9f66-42e2-857c-36edcf42416a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:36:08.551648 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.551561 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42e4a0f8-9f66-42e2-857c-36edcf42416a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:36:08.554362 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.554322 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/42e4a0f8-9f66-42e2-857c-36edcf42416a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:36:08.556839 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.556810 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/42e4a0f8-9f66-42e2-857c-36edcf42416a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:36:08.557241 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.557214 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42e4a0f8-9f66-42e2-857c-36edcf42416a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:36:08.557599 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.557579 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/42e4a0f8-9f66-42e2-857c-36edcf42416a-web-config\") pod \"prometheus-k8s-0\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:36:08.557671 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.557649 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/42e4a0f8-9f66-42e2-857c-36edcf42416a-config\") pod \"prometheus-k8s-0\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:36:08.559534 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.557830 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/42e4a0f8-9f66-42e2-857c-36edcf42416a-config-out\") pod \"prometheus-k8s-0\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:36:08.559534 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.558200 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/42e4a0f8-9f66-42e2-857c-36edcf42416a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:36:08.559534 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.559153 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/42e4a0f8-9f66-42e2-857c-36edcf42416a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:36:08.559534 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.559207 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/42e4a0f8-9f66-42e2-857c-36edcf42416a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:36:08.560216 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.559808 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42e4a0f8-9f66-42e2-857c-36edcf42416a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:36:08.560216 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.560168 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/42e4a0f8-9f66-42e2-857c-36edcf42416a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:36:08.560460 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.560427 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vfv7v\"" May 25 23:36:08.560910 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.560820 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/42e4a0f8-9f66-42e2-857c-36edcf42416a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:36:08.561015 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.560772 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/42e4a0f8-9f66-42e2-857c-36edcf42416a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:36:08.561088 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.561069 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-twhc6" May 25 23:36:08.561180 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.561142 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/42e4a0f8-9f66-42e2-857c-36edcf42416a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:36:08.563467 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.561913 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/42e4a0f8-9f66-42e2-857c-36edcf42416a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:36:08.563955 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.563887 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hz8ds\"" May 25 23:36:08.566407 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.566381 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ns42\" (UniqueName: \"kubernetes.io/projected/42e4a0f8-9f66-42e2-857c-36edcf42416a-kube-api-access-9ns42\") pod \"prometheus-k8s-0\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:36:08.570193 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.570173 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ws64" May 25 23:36:08.747913 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.747855 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 25 23:36:08.808597 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:08.808512 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-865b57546d-pjvlq" May 25 23:36:10.812539 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:10.812497 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-js7jj" event={"ID":"87c8c237-457a-4573-adf8-c8729124bb9c","Type":"ContainerStarted","Data":"69f7f0253ef67dfe4366c808540e3cfa9407aab77d647b40a5fa5a254feb9600"} May 25 23:36:10.885849 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:10.885797 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-x67zk"] May 25 23:36:10.894372 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:36:10.894330 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b94d60b_988f_4438_83f1_d0565943b3c1.slice/crio-141570e4800dee57f26a8f191bfb1497e7e1485717ff48077dda09d50450bb7e WatchSource:0}: Error finding container 141570e4800dee57f26a8f191bfb1497e7e1485717ff48077dda09d50450bb7e: Status 404 returned error can't find the container with id 141570e4800dee57f26a8f191bfb1497e7e1485717ff48077dda09d50450bb7e May 25 23:36:10.970305 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:10.970276 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-twhc6"] May 25 23:36:10.979026 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:36:10.978972 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod053dd95b_4d61_480d_8a80_645cf902780e.slice/crio-9cdb49cfd5fce1f657d756cf48a3eaae8d9e396825c77d2365c1546d31342689 WatchSource:0}: Error finding container 9cdb49cfd5fce1f657d756cf48a3eaae8d9e396825c77d2365c1546d31342689: Status 404 returned error can't find the container with id 9cdb49cfd5fce1f657d756cf48a3eaae8d9e396825c77d2365c1546d31342689 May 25 23:36:11.122311 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:11.122248 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7ws64"] May 25 23:36:11.128919 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:36:11.128881 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod694e83a1_a7ed_4246_a57b_6ba3e80ae3ba.slice/crio-09c16d18d9c38034ced5ee47a37f5fad14499d713f159b7aad6494738956051e WatchSource:0}: Error finding container 09c16d18d9c38034ced5ee47a37f5fad14499d713f159b7aad6494738956051e: Status 404 returned error can't find the container with id 09c16d18d9c38034ced5ee47a37f5fad14499d713f159b7aad6494738956051e May 25 23:36:11.131487 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:11.131321 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74bf574f55-dhpxl"] May 25 23:36:11.136093 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:36:11.135653 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb64ba0b8_1a4c_4933_bbb2_68765be0efe8.slice/crio-b63b2a8f5d01f085747c159e39de055716377d91f7c6cffbc06a022cd2658f8f WatchSource:0}: Error finding container b63b2a8f5d01f085747c159e39de055716377d91f7c6cffbc06a022cd2658f8f: Status 404 returned error can't find the container with id b63b2a8f5d01f085747c159e39de055716377d91f7c6cffbc06a022cd2658f8f May 25 23:36:11.136093 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:11.136041 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 25 23:36:11.180863 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:11.180799 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-mkzjd"] May 25 23:36:11.185613 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:36:11.185576 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5563295b_45f9_45e1_9811_41f36c1edcac.slice/crio-c69cd95974b3d6855395aaaac9dff060b79a4e0eac44896d3f49cfcae89365d2 WatchSource:0}: Error finding container c69cd95974b3d6855395aaaac9dff060b79a4e0eac44896d3f49cfcae89365d2: Status 404 returned error can't find the container with id c69cd95974b3d6855395aaaac9dff060b79a4e0eac44896d3f49cfcae89365d2 May 25 23:36:11.824744 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:11.823544 2560 generic.go:358] "Generic (PLEG): container finished" podID="87c8c237-457a-4573-adf8-c8729124bb9c" containerID="69f7f0253ef67dfe4366c808540e3cfa9407aab77d647b40a5fa5a254feb9600" exitCode=0 May 25 23:36:11.824744 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:11.823653 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-js7jj" event={"ID":"87c8c237-457a-4573-adf8-c8729124bb9c","Type":"ContainerDied","Data":"69f7f0253ef67dfe4366c808540e3cfa9407aab77d647b40a5fa5a254feb9600"} May 25 23:36:11.826512 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:11.826440 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"42e4a0f8-9f66-42e2-857c-36edcf42416a","Type":"ContainerStarted","Data":"6fb87e411bd8ccef616e7e22523757a581bdcaf20ae5cf0979f4d036841d5949"} May 25 23:36:11.828593 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:11.828543 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74bf574f55-dhpxl" event={"ID":"b64ba0b8-1a4c-4933-bbb2-68765be0efe8","Type":"ContainerStarted","Data":"58c64fef73320573834bc05ab951808b370e0e70f09ffa28133639d1c147c514"} May 25 23:36:11.828593 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:11.828577 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74bf574f55-dhpxl" event={"ID":"b64ba0b8-1a4c-4933-bbb2-68765be0efe8","Type":"ContainerStarted","Data":"b63b2a8f5d01f085747c159e39de055716377d91f7c6cffbc06a022cd2658f8f"} May 25 23:36:11.834655 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:11.832086 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-42gd6" event={"ID":"7e545f97-36d2-4fe6-b869-f6246bb28ee8","Type":"ContainerStarted","Data":"7a6adcad85f31d82bb3e472800e3ed88e8c70fb47cdaafed74518be73a698606"} May 25 23:36:11.834655 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:11.832897 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-57bd96b888-42gd6" May 25 23:36:11.834655 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:11.834030 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-x67zk" event={"ID":"4b94d60b-988f-4438-83f1-d0565943b3c1","Type":"ContainerStarted","Data":"141570e4800dee57f26a8f191bfb1497e7e1485717ff48077dda09d50450bb7e"} May 25 23:36:11.836584 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:11.836559 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-mkzjd" event={"ID":"5563295b-45f9-45e1-9811-41f36c1edcac","Type":"ContainerStarted","Data":"b757c0c42130221e1980a89e1d3aa417ff2035bc358b01ffc908d1a033739c0a"} May 25 23:36:11.836691 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:11.836586 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-mkzjd" event={"ID":"5563295b-45f9-45e1-9811-41f36c1edcac","Type":"ContainerStarted","Data":"61ad82c28412560db459c82e8060ea95fabbd707aae34c2b536478a453695edd"} May 25 23:36:11.836691 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:11.836601 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-mkzjd" event={"ID":"5563295b-45f9-45e1-9811-41f36c1edcac","Type":"ContainerStarted","Data":"c69cd95974b3d6855395aaaac9dff060b79a4e0eac44896d3f49cfcae89365d2"} May 25 23:36:11.837832 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:11.837805 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7ws64" event={"ID":"694e83a1-a7ed-4246-a57b-6ba3e80ae3ba","Type":"ContainerStarted","Data":"09c16d18d9c38034ced5ee47a37f5fad14499d713f159b7aad6494738956051e"} May 25 23:36:11.839407 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:11.839382 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-twhc6" event={"ID":"053dd95b-4d61-480d-8a80-645cf902780e","Type":"ContainerStarted","Data":"9cdb49cfd5fce1f657d756cf48a3eaae8d9e396825c77d2365c1546d31342689"} May 25 23:36:11.850406 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:11.850382 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-57bd96b888-42gd6" May 25 23:36:11.885655 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:11.885597 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-57bd96b888-42gd6" podStartSLOduration=2.710858009 podStartE2EDuration="19.885579643s" podCreationTimestamp="2026-05-25 23:35:52 +0000 UTC" firstStartedPulling="2026-05-25 23:35:53.592228212 +0000 UTC m=+51.671123840" lastFinishedPulling="2026-05-25 23:36:10.76694984 +0000 UTC m=+68.845845474" observedRunningTime="2026-05-25 23:36:11.885295775 +0000 UTC m=+69.964191425" watchObservedRunningTime="2026-05-25 23:36:11.885579643 +0000 UTC m=+69.964475311" May 25 23:36:11.886036 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:11.885867 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-74bf574f55-dhpxl" podStartSLOduration=7.885859162 podStartE2EDuration="7.885859162s" podCreationTimestamp="2026-05-25 23:36:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 23:36:11.867504183 +0000 UTC m=+69.946399838" watchObservedRunningTime="2026-05-25 23:36:11.885859162 +0000 UTC m=+69.964754792" May 25 23:36:12.851265 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:12.850500 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-js7jj" event={"ID":"87c8c237-457a-4573-adf8-c8729124bb9c","Type":"ContainerStarted","Data":"9a3ff260f7d8535018855b21d915b30ebf502bdd3da6d719f50078e292d06d50"} May 25 23:36:12.851265 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:12.850550 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-js7jj" event={"ID":"87c8c237-457a-4573-adf8-c8729124bb9c","Type":"ContainerStarted","Data":"7dabe35aa88e62afe77810cd46c7bdf3a78bd36368db87a12653091148a72f09"} May 25 23:36:12.869866 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:12.869828 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6lpv9" event={"ID":"0e6458a2-3845-4a30-91fd-294be02aca29","Type":"ContainerStarted","Data":"e2d4756553ed5c532d55b84cd5099150bc5724c8031ad337145534de0054658f"} May 25 23:36:12.870063 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:12.869875 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6lpv9" event={"ID":"0e6458a2-3845-4a30-91fd-294be02aca29","Type":"ContainerStarted","Data":"8a1e0df8926ce3aa7fa2b0ae319c075b598e43454b81fcabcd8b887c6ecdd662"} May 25 23:36:12.870063 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:12.869891 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6lpv9" event={"ID":"0e6458a2-3845-4a30-91fd-294be02aca29","Type":"ContainerStarted","Data":"d16f486504143e6fa88938ba4802d2968f4ab4788e3c7498a3faf592405d8edd"} May 25 23:36:12.898621 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:12.898547 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-js7jj" podStartSLOduration=2.806685572 podStartE2EDuration="10.898518236s" podCreationTimestamp="2026-05-25 23:36:02 +0000 UTC" firstStartedPulling="2026-05-25 23:36:02.561181201 +0000 UTC m=+60.640076832" lastFinishedPulling="2026-05-25 23:36:10.653013854 +0000 UTC m=+68.731909496" observedRunningTime="2026-05-25 23:36:12.875334481 +0000 UTC m=+70.954230132" watchObservedRunningTime="2026-05-25 23:36:12.898518236 +0000 UTC m=+70.977413888" May 25 23:36:13.735313 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:13.734486 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6lpv9" podStartSLOduration=3.028465534 podStartE2EDuration="11.734463852s" podCreationTimestamp="2026-05-25 23:36:02 +0000 UTC" firstStartedPulling="2026-05-25 23:36:03.292864204 +0000 UTC m=+61.371759833" lastFinishedPulling="2026-05-25 23:36:11.998862508 +0000 UTC m=+70.077758151" observedRunningTime="2026-05-25 23:36:12.898231224 +0000 UTC m=+70.977126876" watchObservedRunningTime="2026-05-25 23:36:13.734463852 +0000 UTC m=+71.813359502" May 25 23:36:13.735313 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:13.734901 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74bf574f55-dhpxl"] May 25 23:36:13.777463 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:13.776362 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-84f576b667-x92lk"] May 25 23:36:13.791280 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:13.791250 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84f576b667-x92lk"] May 25 23:36:13.791430 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:13.791394 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84f576b667-x92lk" May 25 23:36:13.917020 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:13.914433 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fd7c4c46-15c9-4a89-a673-151be34e332d-oauth-serving-cert\") pod \"console-84f576b667-x92lk\" (UID: \"fd7c4c46-15c9-4a89-a673-151be34e332d\") " pod="openshift-console/console-84f576b667-x92lk" May 25 23:36:13.917020 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:13.914498 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd7c4c46-15c9-4a89-a673-151be34e332d-trusted-ca-bundle\") pod \"console-84f576b667-x92lk\" (UID: \"fd7c4c46-15c9-4a89-a673-151be34e332d\") " pod="openshift-console/console-84f576b667-x92lk" May 25 23:36:13.917020 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:13.914540 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fd7c4c46-15c9-4a89-a673-151be34e332d-console-serving-cert\") pod \"console-84f576b667-x92lk\" (UID: \"fd7c4c46-15c9-4a89-a673-151be34e332d\") " pod="openshift-console/console-84f576b667-x92lk" May 25 23:36:13.917020 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:13.914588 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dhw7\" (UniqueName: \"kubernetes.io/projected/fd7c4c46-15c9-4a89-a673-151be34e332d-kube-api-access-6dhw7\") pod \"console-84f576b667-x92lk\" (UID: \"fd7c4c46-15c9-4a89-a673-151be34e332d\") " pod="openshift-console/console-84f576b667-x92lk" May 25 23:36:13.917020 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:13.914752 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fd7c4c46-15c9-4a89-a673-151be34e332d-console-oauth-config\") pod \"console-84f576b667-x92lk\" (UID: \"fd7c4c46-15c9-4a89-a673-151be34e332d\") " pod="openshift-console/console-84f576b667-x92lk" May 25 23:36:13.917020 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:13.914801 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fd7c4c46-15c9-4a89-a673-151be34e332d-console-config\") pod \"console-84f576b667-x92lk\" (UID: \"fd7c4c46-15c9-4a89-a673-151be34e332d\") " pod="openshift-console/console-84f576b667-x92lk" May 25 23:36:13.917020 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:13.914829 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fd7c4c46-15c9-4a89-a673-151be34e332d-service-ca\") pod \"console-84f576b667-x92lk\" (UID: \"fd7c4c46-15c9-4a89-a673-151be34e332d\") " pod="openshift-console/console-84f576b667-x92lk" May 25 23:36:14.015811 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:14.015633 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fd7c4c46-15c9-4a89-a673-151be34e332d-oauth-serving-cert\") pod \"console-84f576b667-x92lk\" (UID: \"fd7c4c46-15c9-4a89-a673-151be34e332d\") " pod="openshift-console/console-84f576b667-x92lk" May 25 23:36:14.015811 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:14.015728 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd7c4c46-15c9-4a89-a673-151be34e332d-trusted-ca-bundle\") pod \"console-84f576b667-x92lk\" (UID: \"fd7c4c46-15c9-4a89-a673-151be34e332d\") " pod="openshift-console/console-84f576b667-x92lk" May 25 23:36:14.015811 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:14.015777 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fd7c4c46-15c9-4a89-a673-151be34e332d-console-serving-cert\") pod \"console-84f576b667-x92lk\" (UID: \"fd7c4c46-15c9-4a89-a673-151be34e332d\") " pod="openshift-console/console-84f576b667-x92lk" May 25 23:36:14.017402 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:14.015838 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6dhw7\" (UniqueName: \"kubernetes.io/projected/fd7c4c46-15c9-4a89-a673-151be34e332d-kube-api-access-6dhw7\") pod \"console-84f576b667-x92lk\" (UID: \"fd7c4c46-15c9-4a89-a673-151be34e332d\") " pod="openshift-console/console-84f576b667-x92lk" May 25 23:36:14.017402 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:14.015891 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fd7c4c46-15c9-4a89-a673-151be34e332d-console-oauth-config\") pod \"console-84f576b667-x92lk\" (UID: \"fd7c4c46-15c9-4a89-a673-151be34e332d\") " pod="openshift-console/console-84f576b667-x92lk" May 25 23:36:14.017402 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:14.015917 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fd7c4c46-15c9-4a89-a673-151be34e332d-console-config\") pod \"console-84f576b667-x92lk\" (UID: \"fd7c4c46-15c9-4a89-a673-151be34e332d\") " pod="openshift-console/console-84f576b667-x92lk" May 25 23:36:14.017402 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:14.015947 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fd7c4c46-15c9-4a89-a673-151be34e332d-service-ca\") pod \"console-84f576b667-x92lk\" (UID: \"fd7c4c46-15c9-4a89-a673-151be34e332d\") " pod="openshift-console/console-84f576b667-x92lk" May 25 23:36:14.017402 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:14.016826 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fd7c4c46-15c9-4a89-a673-151be34e332d-service-ca\") pod \"console-84f576b667-x92lk\" (UID: \"fd7c4c46-15c9-4a89-a673-151be34e332d\") " pod="openshift-console/console-84f576b667-x92lk" May 25 23:36:14.017402 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:14.017044 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fd7c4c46-15c9-4a89-a673-151be34e332d-oauth-serving-cert\") pod \"console-84f576b667-x92lk\" (UID: \"fd7c4c46-15c9-4a89-a673-151be34e332d\") " pod="openshift-console/console-84f576b667-x92lk" May 25 23:36:14.017402 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:14.017216 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd7c4c46-15c9-4a89-a673-151be34e332d-trusted-ca-bundle\") pod \"console-84f576b667-x92lk\" (UID: \"fd7c4c46-15c9-4a89-a673-151be34e332d\") " pod="openshift-console/console-84f576b667-x92lk" May 25 23:36:14.017831 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:14.017781 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fd7c4c46-15c9-4a89-a673-151be34e332d-console-config\") pod \"console-84f576b667-x92lk\" (UID: \"fd7c4c46-15c9-4a89-a673-151be34e332d\") " pod="openshift-console/console-84f576b667-x92lk" May 25 23:36:14.019602 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:14.019538 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fd7c4c46-15c9-4a89-a673-151be34e332d-console-serving-cert\") pod \"console-84f576b667-x92lk\" (UID: \"fd7c4c46-15c9-4a89-a673-151be34e332d\") " pod="openshift-console/console-84f576b667-x92lk" May 25 23:36:14.026801 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:14.026753 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dhw7\" (UniqueName: \"kubernetes.io/projected/fd7c4c46-15c9-4a89-a673-151be34e332d-kube-api-access-6dhw7\") pod \"console-84f576b667-x92lk\" (UID: \"fd7c4c46-15c9-4a89-a673-151be34e332d\") " pod="openshift-console/console-84f576b667-x92lk" May 25 23:36:14.029296 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:14.029271 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fd7c4c46-15c9-4a89-a673-151be34e332d-console-oauth-config\") pod \"console-84f576b667-x92lk\" (UID: \"fd7c4c46-15c9-4a89-a673-151be34e332d\") " pod="openshift-console/console-84f576b667-x92lk" May 25 23:36:14.107649 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:14.107610 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84f576b667-x92lk" May 25 23:36:14.397288 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:14.397197 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-74bf574f55-dhpxl" May 25 23:36:17.840542 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:17.839505 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84f576b667-x92lk"] May 25 23:36:17.896608 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:17.896568 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-x67zk" event={"ID":"4b94d60b-988f-4438-83f1-d0565943b3c1","Type":"ContainerStarted","Data":"c217b659e6ccfa23fd3145e19eb95ef890ff649a585899a24ef68dd5a4e05e60"} May 25 23:36:17.905668 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:17.905641 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7ws64" event={"ID":"694e83a1-a7ed-4246-a57b-6ba3e80ae3ba","Type":"ContainerStarted","Data":"1b4c252da32e5afe39456552c45cac6eafc89e9d8d5b251bd32249cddaf85a5a"} May 25 23:36:17.908382 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:17.908356 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84f576b667-x92lk" event={"ID":"fd7c4c46-15c9-4a89-a673-151be34e332d","Type":"ContainerStarted","Data":"4bf1780385dd65996337b04da53f9efb571c8e42176ca3a0d526fcf72f7c3df0"} May 25 23:36:17.914102 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:17.914076 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"42e4a0f8-9f66-42e2-857c-36edcf42416a","Type":"ContainerStarted","Data":"3a92f49ff57c15093dbc7ab0b8aa714ed9987fd22c39fa1e0bed8cb9187c2b6c"} May 25 23:36:18.926299 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:18.926257 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-mkzjd" event={"ID":"5563295b-45f9-45e1-9811-41f36c1edcac","Type":"ContainerStarted","Data":"f06eb13dee0694d7dba8a4f5466f8b2ea0e85786c6a0f8933ed1572957ba4e0b"} May 25 23:36:18.929006 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:18.928965 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7ws64" event={"ID":"694e83a1-a7ed-4246-a57b-6ba3e80ae3ba","Type":"ContainerStarted","Data":"d325eaa2870c15b5e2d24e410e85e7fb69c983e8eb0ea9e7a5a9170e57f383e9"} May 25 23:36:18.930491 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:18.930454 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-twhc6" event={"ID":"053dd95b-4d61-480d-8a80-645cf902780e","Type":"ContainerStarted","Data":"a8657ae967f778977a8e89b36f87e3233be3dc49e96e917af023bed7e593fc3d"} May 25 23:36:18.930638 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:18.930623 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-twhc6" May 25 23:36:18.932210 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:18.932187 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84f576b667-x92lk" event={"ID":"fd7c4c46-15c9-4a89-a673-151be34e332d","Type":"ContainerStarted","Data":"bdf75ff99253fe6c1e4b6913d63d2e796c384f5adf1b279afa35ef8e645636cd"} May 25 23:36:18.933928 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:18.933838 2560 generic.go:358] "Generic (PLEG): container finished" podID="42e4a0f8-9f66-42e2-857c-36edcf42416a" containerID="3a92f49ff57c15093dbc7ab0b8aa714ed9987fd22c39fa1e0bed8cb9187c2b6c" exitCode=0 May 25 23:36:18.933928 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:18.933873 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"42e4a0f8-9f66-42e2-857c-36edcf42416a","Type":"ContainerDied","Data":"3a92f49ff57c15093dbc7ab0b8aa714ed9987fd22c39fa1e0bed8cb9187c2b6c"} May 25 23:36:18.946078 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:18.946032 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-mkzjd" podStartSLOduration=10.672596019 podStartE2EDuration="16.946018875s" podCreationTimestamp="2026-05-25 23:36:02 +0000 UTC" firstStartedPulling="2026-05-25 23:36:11.378767528 +0000 UTC m=+69.457663174" lastFinishedPulling="2026-05-25 23:36:17.652190398 +0000 UTC m=+75.731086030" observedRunningTime="2026-05-25 23:36:18.94461831 +0000 UTC m=+77.023513961" watchObservedRunningTime="2026-05-25 23:36:18.946018875 +0000 UTC m=+77.024914528" May 25 23:36:18.964193 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:18.964142 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-twhc6" podStartSLOduration=70.28070441 podStartE2EDuration="1m16.964127145s" podCreationTimestamp="2026-05-25 23:35:02 +0000 UTC" firstStartedPulling="2026-05-25 23:36:10.981338358 +0000 UTC m=+69.060233991" lastFinishedPulling="2026-05-25 23:36:17.664761091 +0000 UTC m=+75.743656726" observedRunningTime="2026-05-25 23:36:18.962770471 +0000 UTC m=+77.041666138" watchObservedRunningTime="2026-05-25 23:36:18.964127145 +0000 UTC m=+77.043022798" May 25 23:36:18.992395 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:18.992348 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-84f576b667-x92lk" podStartSLOduration=5.992317762 podStartE2EDuration="5.992317762s" podCreationTimestamp="2026-05-25 23:36:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 23:36:18.990258462 +0000 UTC m=+77.069154109" watchObservedRunningTime="2026-05-25 23:36:18.992317762 +0000 UTC m=+77.071213413" May 25 23:36:19.016897 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:19.016853 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-7ws64" podStartSLOduration=70.501822836 podStartE2EDuration="1m17.016841887s" podCreationTimestamp="2026-05-25 23:35:02 +0000 UTC" firstStartedPulling="2026-05-25 23:36:11.13753677 +0000 UTC m=+69.216432399" lastFinishedPulling="2026-05-25 23:36:17.652555805 +0000 UTC m=+75.731451450" observedRunningTime="2026-05-25 23:36:19.015918088 +0000 UTC m=+77.094813753" watchObservedRunningTime="2026-05-25 23:36:19.016841887 +0000 UTC m=+77.095737537" May 25 23:36:19.044938 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:19.044891 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-665c9c8584-x67zk" podStartSLOduration=6.289248139 podStartE2EDuration="13.044875737s" podCreationTimestamp="2026-05-25 23:36:06 +0000 UTC" firstStartedPulling="2026-05-25 23:36:10.897015123 +0000 UTC m=+68.975910765" lastFinishedPulling="2026-05-25 23:36:17.65264272 +0000 UTC m=+75.731538363" observedRunningTime="2026-05-25 23:36:19.043854471 +0000 UTC m=+77.122750127" watchObservedRunningTime="2026-05-25 23:36:19.044875737 +0000 UTC m=+77.123771388" May 25 23:36:19.845503 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:19.845470 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84f576b667-x92lk"] May 25 23:36:19.883855 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:19.883797 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b6d5dc5bb-m8vrh"] May 25 23:36:19.907732 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:19.907678 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b6d5dc5bb-m8vrh"] May 25 23:36:19.907732 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:19.907711 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b6d5dc5bb-m8vrh" May 25 23:36:19.975924 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:19.975897 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6eff508d-7f75-4036-b13e-8d327128e0bf-console-serving-cert\") pod \"console-6b6d5dc5bb-m8vrh\" (UID: \"6eff508d-7f75-4036-b13e-8d327128e0bf\") " pod="openshift-console/console-6b6d5dc5bb-m8vrh" May 25 23:36:19.976307 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:19.975928 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psjsj\" (UniqueName: \"kubernetes.io/projected/6eff508d-7f75-4036-b13e-8d327128e0bf-kube-api-access-psjsj\") pod \"console-6b6d5dc5bb-m8vrh\" (UID: \"6eff508d-7f75-4036-b13e-8d327128e0bf\") " pod="openshift-console/console-6b6d5dc5bb-m8vrh" May 25 23:36:19.976307 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:19.976041 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6eff508d-7f75-4036-b13e-8d327128e0bf-console-oauth-config\") pod \"console-6b6d5dc5bb-m8vrh\" (UID: \"6eff508d-7f75-4036-b13e-8d327128e0bf\") " pod="openshift-console/console-6b6d5dc5bb-m8vrh" May 25 23:36:19.976307 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:19.976072 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6eff508d-7f75-4036-b13e-8d327128e0bf-service-ca\") pod \"console-6b6d5dc5bb-m8vrh\" (UID: \"6eff508d-7f75-4036-b13e-8d327128e0bf\") " pod="openshift-console/console-6b6d5dc5bb-m8vrh" May 25 23:36:19.976307 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:19.976092 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6eff508d-7f75-4036-b13e-8d327128e0bf-trusted-ca-bundle\") pod \"console-6b6d5dc5bb-m8vrh\" (UID: \"6eff508d-7f75-4036-b13e-8d327128e0bf\") " pod="openshift-console/console-6b6d5dc5bb-m8vrh" May 25 23:36:19.976307 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:19.976154 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6eff508d-7f75-4036-b13e-8d327128e0bf-console-config\") pod \"console-6b6d5dc5bb-m8vrh\" (UID: \"6eff508d-7f75-4036-b13e-8d327128e0bf\") " pod="openshift-console/console-6b6d5dc5bb-m8vrh" May 25 23:36:19.976307 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:19.976179 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6eff508d-7f75-4036-b13e-8d327128e0bf-oauth-serving-cert\") pod \"console-6b6d5dc5bb-m8vrh\" (UID: \"6eff508d-7f75-4036-b13e-8d327128e0bf\") " pod="openshift-console/console-6b6d5dc5bb-m8vrh" May 25 23:36:20.077331 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:20.077293 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6eff508d-7f75-4036-b13e-8d327128e0bf-console-oauth-config\") pod \"console-6b6d5dc5bb-m8vrh\" (UID: \"6eff508d-7f75-4036-b13e-8d327128e0bf\") " pod="openshift-console/console-6b6d5dc5bb-m8vrh" May 25 23:36:20.077487 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:20.077389 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6eff508d-7f75-4036-b13e-8d327128e0bf-service-ca\") pod \"console-6b6d5dc5bb-m8vrh\" (UID: \"6eff508d-7f75-4036-b13e-8d327128e0bf\") " pod="openshift-console/console-6b6d5dc5bb-m8vrh" May 25 23:36:20.077487 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:20.077422 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6eff508d-7f75-4036-b13e-8d327128e0bf-trusted-ca-bundle\") pod \"console-6b6d5dc5bb-m8vrh\" (UID: \"6eff508d-7f75-4036-b13e-8d327128e0bf\") " pod="openshift-console/console-6b6d5dc5bb-m8vrh" May 25 23:36:20.077858 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:20.077598 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6eff508d-7f75-4036-b13e-8d327128e0bf-console-config\") pod \"console-6b6d5dc5bb-m8vrh\" (UID: \"6eff508d-7f75-4036-b13e-8d327128e0bf\") " pod="openshift-console/console-6b6d5dc5bb-m8vrh" May 25 23:36:20.078013 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:20.077931 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6eff508d-7f75-4036-b13e-8d327128e0bf-oauth-serving-cert\") pod \"console-6b6d5dc5bb-m8vrh\" (UID: \"6eff508d-7f75-4036-b13e-8d327128e0bf\") " pod="openshift-console/console-6b6d5dc5bb-m8vrh" May 25 23:36:20.078013 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:20.077981 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6eff508d-7f75-4036-b13e-8d327128e0bf-console-serving-cert\") pod \"console-6b6d5dc5bb-m8vrh\" (UID: \"6eff508d-7f75-4036-b13e-8d327128e0bf\") " pod="openshift-console/console-6b6d5dc5bb-m8vrh" May 25 23:36:20.078163 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:20.078051 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-psjsj\" (UniqueName: \"kubernetes.io/projected/6eff508d-7f75-4036-b13e-8d327128e0bf-kube-api-access-psjsj\") pod \"console-6b6d5dc5bb-m8vrh\" (UID: \"6eff508d-7f75-4036-b13e-8d327128e0bf\") " pod="openshift-console/console-6b6d5dc5bb-m8vrh" May 25 23:36:20.078584 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:20.078369 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6eff508d-7f75-4036-b13e-8d327128e0bf-service-ca\") pod \"console-6b6d5dc5bb-m8vrh\" (UID: \"6eff508d-7f75-4036-b13e-8d327128e0bf\") " pod="openshift-console/console-6b6d5dc5bb-m8vrh" May 25 23:36:20.078584 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:20.078409 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6eff508d-7f75-4036-b13e-8d327128e0bf-console-config\") pod \"console-6b6d5dc5bb-m8vrh\" (UID: \"6eff508d-7f75-4036-b13e-8d327128e0bf\") " pod="openshift-console/console-6b6d5dc5bb-m8vrh" May 25 23:36:20.078584 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:20.078536 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6eff508d-7f75-4036-b13e-8d327128e0bf-oauth-serving-cert\") pod \"console-6b6d5dc5bb-m8vrh\" (UID: \"6eff508d-7f75-4036-b13e-8d327128e0bf\") " pod="openshift-console/console-6b6d5dc5bb-m8vrh" May 25 23:36:20.078776 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:20.078640 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6eff508d-7f75-4036-b13e-8d327128e0bf-trusted-ca-bundle\") pod \"console-6b6d5dc5bb-m8vrh\" (UID: \"6eff508d-7f75-4036-b13e-8d327128e0bf\") " pod="openshift-console/console-6b6d5dc5bb-m8vrh" May 25 23:36:20.080863 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:20.080838 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6eff508d-7f75-4036-b13e-8d327128e0bf-console-oauth-config\") pod \"console-6b6d5dc5bb-m8vrh\" (UID: \"6eff508d-7f75-4036-b13e-8d327128e0bf\") " pod="openshift-console/console-6b6d5dc5bb-m8vrh" May 25 23:36:20.080975 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:20.080940 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6eff508d-7f75-4036-b13e-8d327128e0bf-console-serving-cert\") pod \"console-6b6d5dc5bb-m8vrh\" (UID: \"6eff508d-7f75-4036-b13e-8d327128e0bf\") " pod="openshift-console/console-6b6d5dc5bb-m8vrh" May 25 23:36:20.087334 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:20.087307 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-psjsj\" (UniqueName: \"kubernetes.io/projected/6eff508d-7f75-4036-b13e-8d327128e0bf-kube-api-access-psjsj\") pod \"console-6b6d5dc5bb-m8vrh\" (UID: \"6eff508d-7f75-4036-b13e-8d327128e0bf\") " pod="openshift-console/console-6b6d5dc5bb-m8vrh" May 25 23:36:20.218919 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:20.218891 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b6d5dc5bb-m8vrh" May 25 23:36:20.367015 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:20.366814 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b6d5dc5bb-m8vrh"] May 25 23:36:20.370071 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:36:20.370035 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6eff508d_7f75_4036_b13e_8d327128e0bf.slice/crio-349dda8c62d3dc3b5584d63ac012e13231840fcd506d99fe2889bbb2b84d45c1 WatchSource:0}: Error finding container 349dda8c62d3dc3b5584d63ac012e13231840fcd506d99fe2889bbb2b84d45c1: Status 404 returned error can't find the container with id 349dda8c62d3dc3b5584d63ac012e13231840fcd506d99fe2889bbb2b84d45c1 May 25 23:36:20.941624 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:20.941583 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b6d5dc5bb-m8vrh" event={"ID":"6eff508d-7f75-4036-b13e-8d327128e0bf","Type":"ContainerStarted","Data":"2adc2666b7db922a91cb5aea084c1bd0606cb7a3faf71c74fe12fb0517d77bfc"} May 25 23:36:20.941805 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:20.941634 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b6d5dc5bb-m8vrh" event={"ID":"6eff508d-7f75-4036-b13e-8d327128e0bf","Type":"ContainerStarted","Data":"349dda8c62d3dc3b5584d63ac012e13231840fcd506d99fe2889bbb2b84d45c1"} May 25 23:36:20.964304 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:20.964250 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6b6d5dc5bb-m8vrh" podStartSLOduration=1.964234448 podStartE2EDuration="1.964234448s" podCreationTimestamp="2026-05-25 23:36:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 23:36:20.961588423 +0000 UTC m=+79.040484075" watchObservedRunningTime="2026-05-25 23:36:20.964234448 +0000 UTC m=+79.043130098" May 25 23:36:22.953727 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:22.953679 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"42e4a0f8-9f66-42e2-857c-36edcf42416a","Type":"ContainerStarted","Data":"5df7583c9d3c8a8711de4e5598f9f5a328f0d214fff16cbef544d945484a3bcf"} May 25 23:36:22.953727 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:22.953727 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"42e4a0f8-9f66-42e2-857c-36edcf42416a","Type":"ContainerStarted","Data":"83bf0ee6d632dd6f0e8edd920a142b12ed13e21095ff983349e797d799f6182b"} May 25 23:36:24.109100 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:24.109067 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-84f576b667-x92lk" May 25 23:36:24.963397 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:24.963360 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"42e4a0f8-9f66-42e2-857c-36edcf42416a","Type":"ContainerStarted","Data":"de30336e826dcf6d6faf78b515fa1dd507941053067b86756a38783f8927053b"} May 25 23:36:24.963545 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:24.963406 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"42e4a0f8-9f66-42e2-857c-36edcf42416a","Type":"ContainerStarted","Data":"52f3d2abda872a57000347fb32d58d8cb6fc3a07481c881fbcd838ef3ec18760"} May 25 23:36:24.963545 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:24.963420 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"42e4a0f8-9f66-42e2-857c-36edcf42416a","Type":"ContainerStarted","Data":"56e5848b21905ca6eeef5bb692ff1f4da8a95cde83000740594d28b0142d29ce"} May 25 23:36:25.969315 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:25.969280 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"42e4a0f8-9f66-42e2-857c-36edcf42416a","Type":"ContainerStarted","Data":"82bc389849fd3085e37649701824cf45aed15b56437e3076d9fe200f4879b8e6"} May 25 23:36:26.012801 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:26.012730 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=4.623644851 podStartE2EDuration="18.012706059s" podCreationTimestamp="2026-05-25 23:36:08 +0000 UTC" firstStartedPulling="2026-05-25 23:36:11.142069205 +0000 UTC m=+69.220964833" lastFinishedPulling="2026-05-25 23:36:24.53113041 +0000 UTC m=+82.610026041" observedRunningTime="2026-05-25 23:36:26.009899909 +0000 UTC m=+84.088795561" watchObservedRunningTime="2026-05-25 23:36:26.012706059 +0000 UTC m=+84.091601718" May 25 23:36:28.748126 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:28.748085 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 25 23:36:28.934963 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:28.934916 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-x67zk" May 25 23:36:28.940339 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:28.940314 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-x67zk" May 25 23:36:30.219722 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:30.219680 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b6d5dc5bb-m8vrh" May 25 23:36:30.220157 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:30.219738 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b6d5dc5bb-m8vrh" May 25 23:36:30.224720 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:30.224694 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6b6d5dc5bb-m8vrh" May 25 23:36:30.989874 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:30.989843 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6b6d5dc5bb-m8vrh" May 25 23:36:31.042267 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:31.042236 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-865b57546d-pjvlq"] May 25 23:36:38.899751 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:38.899684 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-74bf574f55-dhpxl" podUID="b64ba0b8-1a4c-4933-bbb2-68765be0efe8" containerName="console" containerID="cri-o://58c64fef73320573834bc05ab951808b370e0e70f09ffa28133639d1c147c514" gracePeriod=15 May 25 23:36:39.140721 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:39.140699 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-74bf574f55-dhpxl_b64ba0b8-1a4c-4933-bbb2-68765be0efe8/console/0.log" May 25 23:36:39.140829 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:39.140773 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74bf574f55-dhpxl" May 25 23:36:39.247286 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:39.247246 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b64ba0b8-1a4c-4933-bbb2-68765be0efe8-console-serving-cert\") pod \"b64ba0b8-1a4c-4933-bbb2-68765be0efe8\" (UID: \"b64ba0b8-1a4c-4933-bbb2-68765be0efe8\") " May 25 23:36:39.247286 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:39.247292 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b64ba0b8-1a4c-4933-bbb2-68765be0efe8-service-ca\") pod \"b64ba0b8-1a4c-4933-bbb2-68765be0efe8\" (UID: \"b64ba0b8-1a4c-4933-bbb2-68765be0efe8\") " May 25 23:36:39.247517 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:39.247330 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jq8rx\" (UniqueName: \"kubernetes.io/projected/b64ba0b8-1a4c-4933-bbb2-68765be0efe8-kube-api-access-jq8rx\") pod \"b64ba0b8-1a4c-4933-bbb2-68765be0efe8\" (UID: \"b64ba0b8-1a4c-4933-bbb2-68765be0efe8\") " May 25 23:36:39.247517 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:39.247449 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b64ba0b8-1a4c-4933-bbb2-68765be0efe8-console-config\") pod \"b64ba0b8-1a4c-4933-bbb2-68765be0efe8\" (UID: \"b64ba0b8-1a4c-4933-bbb2-68765be0efe8\") " May 25 23:36:39.247517 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:39.247497 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b64ba0b8-1a4c-4933-bbb2-68765be0efe8-console-oauth-config\") pod \"b64ba0b8-1a4c-4933-bbb2-68765be0efe8\" (UID: \"b64ba0b8-1a4c-4933-bbb2-68765be0efe8\") " May 25 23:36:39.247674 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:39.247545 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b64ba0b8-1a4c-4933-bbb2-68765be0efe8-oauth-serving-cert\") pod \"b64ba0b8-1a4c-4933-bbb2-68765be0efe8\" (UID: \"b64ba0b8-1a4c-4933-bbb2-68765be0efe8\") " May 25 23:36:39.247674 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:39.247594 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b64ba0b8-1a4c-4933-bbb2-68765be0efe8-trusted-ca-bundle\") pod \"b64ba0b8-1a4c-4933-bbb2-68765be0efe8\" (UID: \"b64ba0b8-1a4c-4933-bbb2-68765be0efe8\") " May 25 23:36:39.247778 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:39.247736 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b64ba0b8-1a4c-4933-bbb2-68765be0efe8-service-ca" (OuterVolumeSpecName: "service-ca") pod "b64ba0b8-1a4c-4933-bbb2-68765be0efe8" (UID: "b64ba0b8-1a4c-4933-bbb2-68765be0efe8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 23:36:39.247897 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:39.247857 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b64ba0b8-1a4c-4933-bbb2-68765be0efe8-console-config" (OuterVolumeSpecName: "console-config") pod "b64ba0b8-1a4c-4933-bbb2-68765be0efe8" (UID: "b64ba0b8-1a4c-4933-bbb2-68765be0efe8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 23:36:39.248014 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:39.247957 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b64ba0b8-1a4c-4933-bbb2-68765be0efe8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b64ba0b8-1a4c-4933-bbb2-68765be0efe8" (UID: "b64ba0b8-1a4c-4933-bbb2-68765be0efe8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 23:36:39.248099 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:39.248067 2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b64ba0b8-1a4c-4933-bbb2-68765be0efe8-service-ca\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:36:39.248099 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:39.248103 2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b64ba0b8-1a4c-4933-bbb2-68765be0efe8-console-config\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:36:39.248444 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:39.248079 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b64ba0b8-1a4c-4933-bbb2-68765be0efe8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b64ba0b8-1a4c-4933-bbb2-68765be0efe8" (UID: "b64ba0b8-1a4c-4933-bbb2-68765be0efe8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 23:36:39.249840 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:39.249811 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b64ba0b8-1a4c-4933-bbb2-68765be0efe8-kube-api-access-jq8rx" (OuterVolumeSpecName: "kube-api-access-jq8rx") pod "b64ba0b8-1a4c-4933-bbb2-68765be0efe8" (UID: "b64ba0b8-1a4c-4933-bbb2-68765be0efe8"). InnerVolumeSpecName "kube-api-access-jq8rx". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 25 23:36:39.249923 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:39.249806 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b64ba0b8-1a4c-4933-bbb2-68765be0efe8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b64ba0b8-1a4c-4933-bbb2-68765be0efe8" (UID: "b64ba0b8-1a4c-4933-bbb2-68765be0efe8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 23:36:39.249923 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:39.249845 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b64ba0b8-1a4c-4933-bbb2-68765be0efe8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b64ba0b8-1a4c-4933-bbb2-68765be0efe8" (UID: "b64ba0b8-1a4c-4933-bbb2-68765be0efe8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 23:36:39.348538 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:39.348499 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b64ba0b8-1a4c-4933-bbb2-68765be0efe8-trusted-ca-bundle\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:36:39.348538 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:39.348531 2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b64ba0b8-1a4c-4933-bbb2-68765be0efe8-console-serving-cert\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:36:39.348538 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:39.348541 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jq8rx\" (UniqueName: \"kubernetes.io/projected/b64ba0b8-1a4c-4933-bbb2-68765be0efe8-kube-api-access-jq8rx\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:36:39.348758 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:39.348551 2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b64ba0b8-1a4c-4933-bbb2-68765be0efe8-console-oauth-config\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:36:39.348758 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:39.348560 2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b64ba0b8-1a4c-4933-bbb2-68765be0efe8-oauth-serving-cert\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:36:40.015325 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:40.015234 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-74bf574f55-dhpxl_b64ba0b8-1a4c-4933-bbb2-68765be0efe8/console/0.log" May 25 23:36:40.015325 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:40.015281 2560 generic.go:358] "Generic (PLEG): container finished" podID="b64ba0b8-1a4c-4933-bbb2-68765be0efe8" containerID="58c64fef73320573834bc05ab951808b370e0e70f09ffa28133639d1c147c514" exitCode=2 May 25 23:36:40.015759 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:40.015369 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74bf574f55-dhpxl" event={"ID":"b64ba0b8-1a4c-4933-bbb2-68765be0efe8","Type":"ContainerDied","Data":"58c64fef73320573834bc05ab951808b370e0e70f09ffa28133639d1c147c514"} May 25 23:36:40.015759 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:40.015389 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74bf574f55-dhpxl" May 25 23:36:40.015759 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:40.015423 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74bf574f55-dhpxl" event={"ID":"b64ba0b8-1a4c-4933-bbb2-68765be0efe8","Type":"ContainerDied","Data":"b63b2a8f5d01f085747c159e39de055716377d91f7c6cffbc06a022cd2658f8f"} May 25 23:36:40.015759 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:40.015440 2560 scope.go:117] "RemoveContainer" containerID="58c64fef73320573834bc05ab951808b370e0e70f09ffa28133639d1c147c514" May 25 23:36:40.023979 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:40.023959 2560 scope.go:117] "RemoveContainer" containerID="58c64fef73320573834bc05ab951808b370e0e70f09ffa28133639d1c147c514" May 25 23:36:40.024247 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:36:40.024229 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58c64fef73320573834bc05ab951808b370e0e70f09ffa28133639d1c147c514\": container with ID starting with 58c64fef73320573834bc05ab951808b370e0e70f09ffa28133639d1c147c514 not found: ID does not exist" containerID="58c64fef73320573834bc05ab951808b370e0e70f09ffa28133639d1c147c514" May 25 23:36:40.024300 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:40.024255 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58c64fef73320573834bc05ab951808b370e0e70f09ffa28133639d1c147c514"} err="failed to get container status \"58c64fef73320573834bc05ab951808b370e0e70f09ffa28133639d1c147c514\": rpc error: code = NotFound desc = could not find container \"58c64fef73320573834bc05ab951808b370e0e70f09ffa28133639d1c147c514\": container with ID starting with 58c64fef73320573834bc05ab951808b370e0e70f09ffa28133639d1c147c514 not found: ID does not exist" May 25 23:36:40.041599 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:40.041570 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74bf574f55-dhpxl"] May 25 23:36:40.050291 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:40.050267 2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-74bf574f55-dhpxl"] May 25 23:36:40.544313 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:40.544283 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b64ba0b8-1a4c-4933-bbb2-68765be0efe8" path="/var/lib/kubelet/pods/b64ba0b8-1a4c-4933-bbb2-68765be0efe8/volumes" May 25 23:36:45.962078 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:45.962023 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-84f576b667-x92lk" podUID="fd7c4c46-15c9-4a89-a673-151be34e332d" containerName="console" containerID="cri-o://bdf75ff99253fe6c1e4b6913d63d2e796c384f5adf1b279afa35ef8e645636cd" gracePeriod=15 May 25 23:36:46.238416 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:46.238394 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-84f576b667-x92lk_fd7c4c46-15c9-4a89-a673-151be34e332d/console/0.log" May 25 23:36:46.238540 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:46.238457 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84f576b667-x92lk" May 25 23:36:46.302914 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:46.302881 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fd7c4c46-15c9-4a89-a673-151be34e332d-console-serving-cert\") pod \"fd7c4c46-15c9-4a89-a673-151be34e332d\" (UID: \"fd7c4c46-15c9-4a89-a673-151be34e332d\") " May 25 23:36:46.302914 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:46.302916 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fd7c4c46-15c9-4a89-a673-151be34e332d-oauth-serving-cert\") pod \"fd7c4c46-15c9-4a89-a673-151be34e332d\" (UID: \"fd7c4c46-15c9-4a89-a673-151be34e332d\") " May 25 23:36:46.303168 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:46.302946 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fd7c4c46-15c9-4a89-a673-151be34e332d-console-oauth-config\") pod \"fd7c4c46-15c9-4a89-a673-151be34e332d\" (UID: \"fd7c4c46-15c9-4a89-a673-151be34e332d\") " May 25 23:36:46.303168 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:46.302964 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6dhw7\" (UniqueName: \"kubernetes.io/projected/fd7c4c46-15c9-4a89-a673-151be34e332d-kube-api-access-6dhw7\") pod \"fd7c4c46-15c9-4a89-a673-151be34e332d\" (UID: \"fd7c4c46-15c9-4a89-a673-151be34e332d\") " May 25 23:36:46.303168 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:46.302980 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fd7c4c46-15c9-4a89-a673-151be34e332d-service-ca\") pod \"fd7c4c46-15c9-4a89-a673-151be34e332d\" (UID: \"fd7c4c46-15c9-4a89-a673-151be34e332d\") " May 25 23:36:46.303168 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:46.303053 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fd7c4c46-15c9-4a89-a673-151be34e332d-console-config\") pod \"fd7c4c46-15c9-4a89-a673-151be34e332d\" (UID: \"fd7c4c46-15c9-4a89-a673-151be34e332d\") " May 25 23:36:46.303367 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:46.303189 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd7c4c46-15c9-4a89-a673-151be34e332d-trusted-ca-bundle\") pod \"fd7c4c46-15c9-4a89-a673-151be34e332d\" (UID: \"fd7c4c46-15c9-4a89-a673-151be34e332d\") " May 25 23:36:46.303428 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:46.303391 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd7c4c46-15c9-4a89-a673-151be34e332d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "fd7c4c46-15c9-4a89-a673-151be34e332d" (UID: "fd7c4c46-15c9-4a89-a673-151be34e332d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 23:36:46.303488 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:46.303429 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd7c4c46-15c9-4a89-a673-151be34e332d-console-config" (OuterVolumeSpecName: "console-config") pod "fd7c4c46-15c9-4a89-a673-151be34e332d" (UID: "fd7c4c46-15c9-4a89-a673-151be34e332d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 23:36:46.303488 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:46.303457 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd7c4c46-15c9-4a89-a673-151be34e332d-service-ca" (OuterVolumeSpecName: "service-ca") pod "fd7c4c46-15c9-4a89-a673-151be34e332d" (UID: "fd7c4c46-15c9-4a89-a673-151be34e332d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 23:36:46.303965 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:46.303937 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd7c4c46-15c9-4a89-a673-151be34e332d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "fd7c4c46-15c9-4a89-a673-151be34e332d" (UID: "fd7c4c46-15c9-4a89-a673-151be34e332d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 23:36:46.305320 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:46.305281 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd7c4c46-15c9-4a89-a673-151be34e332d-kube-api-access-6dhw7" (OuterVolumeSpecName: "kube-api-access-6dhw7") pod "fd7c4c46-15c9-4a89-a673-151be34e332d" (UID: "fd7c4c46-15c9-4a89-a673-151be34e332d"). InnerVolumeSpecName "kube-api-access-6dhw7". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 25 23:36:46.305421 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:46.305355 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd7c4c46-15c9-4a89-a673-151be34e332d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "fd7c4c46-15c9-4a89-a673-151be34e332d" (UID: "fd7c4c46-15c9-4a89-a673-151be34e332d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 23:36:46.305421 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:46.305378 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd7c4c46-15c9-4a89-a673-151be34e332d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "fd7c4c46-15c9-4a89-a673-151be34e332d" (UID: "fd7c4c46-15c9-4a89-a673-151be34e332d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 23:36:46.404009 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:46.403948 2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fd7c4c46-15c9-4a89-a673-151be34e332d-console-serving-cert\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:36:46.404009 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:46.404014 2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fd7c4c46-15c9-4a89-a673-151be34e332d-oauth-serving-cert\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:36:46.404222 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:46.404030 2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fd7c4c46-15c9-4a89-a673-151be34e332d-console-oauth-config\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:36:46.404222 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:46.404042 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6dhw7\" (UniqueName: \"kubernetes.io/projected/fd7c4c46-15c9-4a89-a673-151be34e332d-kube-api-access-6dhw7\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:36:46.404222 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:46.404056 2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fd7c4c46-15c9-4a89-a673-151be34e332d-service-ca\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:36:46.404222 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:46.404066 2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fd7c4c46-15c9-4a89-a673-151be34e332d-console-config\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:36:46.404222 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:46.404076 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd7c4c46-15c9-4a89-a673-151be34e332d-trusted-ca-bundle\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:36:47.037084 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:47.037057 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-84f576b667-x92lk_fd7c4c46-15c9-4a89-a673-151be34e332d/console/0.log" May 25 23:36:47.037483 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:47.037096 2560 generic.go:358] "Generic (PLEG): container finished" podID="fd7c4c46-15c9-4a89-a673-151be34e332d" containerID="bdf75ff99253fe6c1e4b6913d63d2e796c384f5adf1b279afa35ef8e645636cd" exitCode=2 May 25 23:36:47.037483 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:47.037126 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84f576b667-x92lk" event={"ID":"fd7c4c46-15c9-4a89-a673-151be34e332d","Type":"ContainerDied","Data":"bdf75ff99253fe6c1e4b6913d63d2e796c384f5adf1b279afa35ef8e645636cd"} May 25 23:36:47.037483 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:47.037148 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84f576b667-x92lk" event={"ID":"fd7c4c46-15c9-4a89-a673-151be34e332d","Type":"ContainerDied","Data":"4bf1780385dd65996337b04da53f9efb571c8e42176ca3a0d526fcf72f7c3df0"} May 25 23:36:47.037483 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:47.037162 2560 scope.go:117] "RemoveContainer" containerID="bdf75ff99253fe6c1e4b6913d63d2e796c384f5adf1b279afa35ef8e645636cd" May 25 23:36:47.037483 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:47.037161 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84f576b667-x92lk" May 25 23:36:47.045061 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:47.045042 2560 scope.go:117] "RemoveContainer" containerID="bdf75ff99253fe6c1e4b6913d63d2e796c384f5adf1b279afa35ef8e645636cd" May 25 23:36:47.045291 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:36:47.045274 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bdf75ff99253fe6c1e4b6913d63d2e796c384f5adf1b279afa35ef8e645636cd\": container with ID starting with bdf75ff99253fe6c1e4b6913d63d2e796c384f5adf1b279afa35ef8e645636cd not found: ID does not exist" containerID="bdf75ff99253fe6c1e4b6913d63d2e796c384f5adf1b279afa35ef8e645636cd" May 25 23:36:47.045341 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:47.045298 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdf75ff99253fe6c1e4b6913d63d2e796c384f5adf1b279afa35ef8e645636cd"} err="failed to get container status \"bdf75ff99253fe6c1e4b6913d63d2e796c384f5adf1b279afa35ef8e645636cd\": rpc error: code = NotFound desc = could not find container \"bdf75ff99253fe6c1e4b6913d63d2e796c384f5adf1b279afa35ef8e645636cd\": container with ID starting with bdf75ff99253fe6c1e4b6913d63d2e796c384f5adf1b279afa35ef8e645636cd not found: ID does not exist" May 25 23:36:47.059428 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:47.059404 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84f576b667-x92lk"] May 25 23:36:47.071984 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:47.071956 2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-84f576b667-x92lk"] May 25 23:36:48.544805 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:48.544765 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd7c4c46-15c9-4a89-a673-151be34e332d" path="/var/lib/kubelet/pods/fd7c4c46-15c9-4a89-a673-151be34e332d/volumes" May 25 23:36:49.939947 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:49.939918 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-twhc6" May 25 23:36:56.062417 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:56.062346 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-865b57546d-pjvlq" podUID="ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e" containerName="console" containerID="cri-o://1c3905bc6384bb44698c0e6b5fbeb431c093f1aa8011b400b19369db6615e58e" gracePeriod=15 May 25 23:36:56.339663 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:56.339643 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-865b57546d-pjvlq_ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e/console/0.log" May 25 23:36:56.339770 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:56.339706 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-865b57546d-pjvlq" May 25 23:36:56.378906 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:56.378879 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e-console-config\") pod \"ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e\" (UID: \"ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e\") " May 25 23:36:56.379052 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:56.378921 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e-console-oauth-config\") pod \"ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e\" (UID: \"ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e\") " May 25 23:36:56.379052 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:56.378951 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e-oauth-serving-cert\") pod \"ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e\" (UID: \"ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e\") " May 25 23:36:56.379052 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:56.378975 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e-service-ca\") pod \"ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e\" (UID: \"ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e\") " May 25 23:36:56.379180 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:56.379068 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e-console-serving-cert\") pod \"ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e\" (UID: \"ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e\") " May 25 23:36:56.379180 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:56.379152 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cdxfv\" (UniqueName: \"kubernetes.io/projected/ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e-kube-api-access-cdxfv\") pod \"ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e\" (UID: \"ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e\") " May 25 23:36:56.379325 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:56.379304 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e-console-config" (OuterVolumeSpecName: "console-config") pod "ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e" (UID: "ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 23:36:56.379405 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:56.379361 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e" (UID: "ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 23:36:56.379405 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:56.379367 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e-service-ca" (OuterVolumeSpecName: "service-ca") pod "ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e" (UID: "ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 23:36:56.379405 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:56.379390 2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e-console-config\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:36:56.381135 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:56.381107 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e" (UID: "ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 23:36:56.381227 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:56.381216 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e" (UID: "ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 23:36:56.381326 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:56.381307 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e-kube-api-access-cdxfv" (OuterVolumeSpecName: "kube-api-access-cdxfv") pod "ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e" (UID: "ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e"). InnerVolumeSpecName "kube-api-access-cdxfv". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 25 23:36:56.480510 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:56.480487 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cdxfv\" (UniqueName: \"kubernetes.io/projected/ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e-kube-api-access-cdxfv\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:36:56.480510 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:56.480511 2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e-console-oauth-config\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:36:56.480644 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:56.480522 2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e-oauth-serving-cert\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:36:56.480644 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:56.480531 2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e-service-ca\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:36:56.480644 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:56.480540 2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e-console-serving-cert\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:36:57.067889 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:57.067858 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-865b57546d-pjvlq_ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e/console/0.log" May 25 23:36:57.068282 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:57.067904 2560 generic.go:358] "Generic (PLEG): container finished" podID="ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e" containerID="1c3905bc6384bb44698c0e6b5fbeb431c093f1aa8011b400b19369db6615e58e" exitCode=2 May 25 23:36:57.068282 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:57.067953 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-865b57546d-pjvlq" event={"ID":"ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e","Type":"ContainerDied","Data":"1c3905bc6384bb44698c0e6b5fbeb431c093f1aa8011b400b19369db6615e58e"} May 25 23:36:57.068282 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:57.067976 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-865b57546d-pjvlq" event={"ID":"ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e","Type":"ContainerDied","Data":"cc73b48bb9da95aba8987b1d72590f7876813880d3ed983359c7b2bb86599980"} May 25 23:36:57.068282 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:57.067981 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-865b57546d-pjvlq" May 25 23:36:57.068282 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:57.068011 2560 scope.go:117] "RemoveContainer" containerID="1c3905bc6384bb44698c0e6b5fbeb431c093f1aa8011b400b19369db6615e58e" May 25 23:36:57.075768 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:57.075755 2560 scope.go:117] "RemoveContainer" containerID="1c3905bc6384bb44698c0e6b5fbeb431c093f1aa8011b400b19369db6615e58e" May 25 23:36:57.076039 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:36:57.076021 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c3905bc6384bb44698c0e6b5fbeb431c093f1aa8011b400b19369db6615e58e\": container with ID starting with 1c3905bc6384bb44698c0e6b5fbeb431c093f1aa8011b400b19369db6615e58e not found: ID does not exist" containerID="1c3905bc6384bb44698c0e6b5fbeb431c093f1aa8011b400b19369db6615e58e" May 25 23:36:57.076095 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:57.076046 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c3905bc6384bb44698c0e6b5fbeb431c093f1aa8011b400b19369db6615e58e"} err="failed to get container status \"1c3905bc6384bb44698c0e6b5fbeb431c093f1aa8011b400b19369db6615e58e\": rpc error: code = NotFound desc = could not find container \"1c3905bc6384bb44698c0e6b5fbeb431c093f1aa8011b400b19369db6615e58e\": container with ID starting with 1c3905bc6384bb44698c0e6b5fbeb431c093f1aa8011b400b19369db6615e58e not found: ID does not exist" May 25 23:36:57.084600 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:57.084580 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-865b57546d-pjvlq"] May 25 23:36:57.092372 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:57.092348 2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-865b57546d-pjvlq"] May 25 23:36:58.543648 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:36:58.543614 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e" path="/var/lib/kubelet/pods/ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e/volumes" May 25 23:37:08.748750 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:08.748703 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 25 23:37:08.768919 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:08.768885 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 25 23:37:09.118774 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:09.118694 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 25 23:37:25.022657 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:25.022622 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-65b89955-xslzb"] May 25 23:37:25.023071 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:25.022918 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b64ba0b8-1a4c-4933-bbb2-68765be0efe8" containerName="console" May 25 23:37:25.023071 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:25.022930 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b64ba0b8-1a4c-4933-bbb2-68765be0efe8" containerName="console" May 25 23:37:25.023071 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:25.022940 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e" containerName="console" May 25 23:37:25.023071 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:25.022946 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e" containerName="console" May 25 23:37:25.023071 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:25.022951 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd7c4c46-15c9-4a89-a673-151be34e332d" containerName="console" May 25 23:37:25.023071 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:25.022957 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd7c4c46-15c9-4a89-a673-151be34e332d" containerName="console" May 25 23:37:25.023071 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:25.023029 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="fd7c4c46-15c9-4a89-a673-151be34e332d" containerName="console" May 25 23:37:25.023071 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:25.023038 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="ad0c51f6-8b03-4f1a-9744-b99f2a5cf33e" containerName="console" May 25 23:37:25.023071 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:25.023046 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="b64ba0b8-1a4c-4933-bbb2-68765be0efe8" containerName="console" May 25 23:37:25.025793 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:25.025771 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65b89955-xslzb" May 25 23:37:25.042540 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:25.042510 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65b89955-xslzb"] May 25 23:37:25.111533 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:25.111490 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/716bec8b-680f-4799-a185-8c7c41cb89e8-oauth-serving-cert\") pod \"console-65b89955-xslzb\" (UID: \"716bec8b-680f-4799-a185-8c7c41cb89e8\") " pod="openshift-console/console-65b89955-xslzb" May 25 23:37:25.111533 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:25.111535 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/716bec8b-680f-4799-a185-8c7c41cb89e8-console-serving-cert\") pod \"console-65b89955-xslzb\" (UID: \"716bec8b-680f-4799-a185-8c7c41cb89e8\") " pod="openshift-console/console-65b89955-xslzb" May 25 23:37:25.111815 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:25.111602 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/716bec8b-680f-4799-a185-8c7c41cb89e8-console-oauth-config\") pod \"console-65b89955-xslzb\" (UID: \"716bec8b-680f-4799-a185-8c7c41cb89e8\") " pod="openshift-console/console-65b89955-xslzb" May 25 23:37:25.111815 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:25.111618 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/716bec8b-680f-4799-a185-8c7c41cb89e8-service-ca\") pod \"console-65b89955-xslzb\" (UID: \"716bec8b-680f-4799-a185-8c7c41cb89e8\") " pod="openshift-console/console-65b89955-xslzb" May 25 23:37:25.111815 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:25.111639 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/716bec8b-680f-4799-a185-8c7c41cb89e8-console-config\") pod \"console-65b89955-xslzb\" (UID: \"716bec8b-680f-4799-a185-8c7c41cb89e8\") " pod="openshift-console/console-65b89955-xslzb" May 25 23:37:25.111815 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:25.111663 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrjb5\" (UniqueName: \"kubernetes.io/projected/716bec8b-680f-4799-a185-8c7c41cb89e8-kube-api-access-xrjb5\") pod \"console-65b89955-xslzb\" (UID: \"716bec8b-680f-4799-a185-8c7c41cb89e8\") " pod="openshift-console/console-65b89955-xslzb" May 25 23:37:25.111815 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:25.111726 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/716bec8b-680f-4799-a185-8c7c41cb89e8-trusted-ca-bundle\") pod \"console-65b89955-xslzb\" (UID: \"716bec8b-680f-4799-a185-8c7c41cb89e8\") " pod="openshift-console/console-65b89955-xslzb" May 25 23:37:25.212876 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:25.212829 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/716bec8b-680f-4799-a185-8c7c41cb89e8-oauth-serving-cert\") pod \"console-65b89955-xslzb\" (UID: \"716bec8b-680f-4799-a185-8c7c41cb89e8\") " pod="openshift-console/console-65b89955-xslzb" May 25 23:37:25.212876 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:25.212872 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/716bec8b-680f-4799-a185-8c7c41cb89e8-console-serving-cert\") pod \"console-65b89955-xslzb\" (UID: \"716bec8b-680f-4799-a185-8c7c41cb89e8\") " pod="openshift-console/console-65b89955-xslzb" May 25 23:37:25.213169 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:25.212922 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/716bec8b-680f-4799-a185-8c7c41cb89e8-console-oauth-config\") pod \"console-65b89955-xslzb\" (UID: \"716bec8b-680f-4799-a185-8c7c41cb89e8\") " pod="openshift-console/console-65b89955-xslzb" May 25 23:37:25.213169 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:25.212942 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/716bec8b-680f-4799-a185-8c7c41cb89e8-service-ca\") pod \"console-65b89955-xslzb\" (UID: \"716bec8b-680f-4799-a185-8c7c41cb89e8\") " pod="openshift-console/console-65b89955-xslzb" May 25 23:37:25.213169 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:25.212965 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/716bec8b-680f-4799-a185-8c7c41cb89e8-console-config\") pod \"console-65b89955-xslzb\" (UID: \"716bec8b-680f-4799-a185-8c7c41cb89e8\") " pod="openshift-console/console-65b89955-xslzb" May 25 23:37:25.213169 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:25.213032 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xrjb5\" (UniqueName: \"kubernetes.io/projected/716bec8b-680f-4799-a185-8c7c41cb89e8-kube-api-access-xrjb5\") pod \"console-65b89955-xslzb\" (UID: \"716bec8b-680f-4799-a185-8c7c41cb89e8\") " pod="openshift-console/console-65b89955-xslzb" May 25 23:37:25.213169 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:25.213061 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/716bec8b-680f-4799-a185-8c7c41cb89e8-trusted-ca-bundle\") pod \"console-65b89955-xslzb\" (UID: \"716bec8b-680f-4799-a185-8c7c41cb89e8\") " pod="openshift-console/console-65b89955-xslzb" May 25 23:37:25.213673 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:25.213648 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/716bec8b-680f-4799-a185-8c7c41cb89e8-oauth-serving-cert\") pod \"console-65b89955-xslzb\" (UID: \"716bec8b-680f-4799-a185-8c7c41cb89e8\") " pod="openshift-console/console-65b89955-xslzb" May 25 23:37:25.213801 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:25.213710 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/716bec8b-680f-4799-a185-8c7c41cb89e8-service-ca\") pod \"console-65b89955-xslzb\" (UID: \"716bec8b-680f-4799-a185-8c7c41cb89e8\") " pod="openshift-console/console-65b89955-xslzb" May 25 23:37:25.214014 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:25.213971 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/716bec8b-680f-4799-a185-8c7c41cb89e8-console-config\") pod \"console-65b89955-xslzb\" (UID: \"716bec8b-680f-4799-a185-8c7c41cb89e8\") " pod="openshift-console/console-65b89955-xslzb" May 25 23:37:25.214159 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:25.214137 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/716bec8b-680f-4799-a185-8c7c41cb89e8-trusted-ca-bundle\") pod \"console-65b89955-xslzb\" (UID: \"716bec8b-680f-4799-a185-8c7c41cb89e8\") " pod="openshift-console/console-65b89955-xslzb" May 25 23:37:25.215704 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:25.215682 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/716bec8b-680f-4799-a185-8c7c41cb89e8-console-oauth-config\") pod \"console-65b89955-xslzb\" (UID: \"716bec8b-680f-4799-a185-8c7c41cb89e8\") " pod="openshift-console/console-65b89955-xslzb" May 25 23:37:25.215758 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:25.215719 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/716bec8b-680f-4799-a185-8c7c41cb89e8-console-serving-cert\") pod \"console-65b89955-xslzb\" (UID: \"716bec8b-680f-4799-a185-8c7c41cb89e8\") " pod="openshift-console/console-65b89955-xslzb" May 25 23:37:25.222123 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:25.222103 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrjb5\" (UniqueName: \"kubernetes.io/projected/716bec8b-680f-4799-a185-8c7c41cb89e8-kube-api-access-xrjb5\") pod \"console-65b89955-xslzb\" (UID: \"716bec8b-680f-4799-a185-8c7c41cb89e8\") " pod="openshift-console/console-65b89955-xslzb" May 25 23:37:25.335116 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:25.335020 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65b89955-xslzb" May 25 23:37:25.464800 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:25.464767 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65b89955-xslzb"] May 25 23:37:25.468673 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:37:25.468642 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod716bec8b_680f_4799_a185_8c7c41cb89e8.slice/crio-51aff2749074293e52422d80a0920c481f401bef8e6ab9d3065bb8d0216a2c33 WatchSource:0}: Error finding container 51aff2749074293e52422d80a0920c481f401bef8e6ab9d3065bb8d0216a2c33: Status 404 returned error can't find the container with id 51aff2749074293e52422d80a0920c481f401bef8e6ab9d3065bb8d0216a2c33 May 25 23:37:26.156531 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:26.156488 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65b89955-xslzb" event={"ID":"716bec8b-680f-4799-a185-8c7c41cb89e8","Type":"ContainerStarted","Data":"f66f0e929de337d1fc67c79db5c9cf6b47223fca55cdbf406f6001e318221742"} May 25 23:37:26.156531 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:26.156529 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65b89955-xslzb" event={"ID":"716bec8b-680f-4799-a185-8c7c41cb89e8","Type":"ContainerStarted","Data":"51aff2749074293e52422d80a0920c481f401bef8e6ab9d3065bb8d0216a2c33"} May 25 23:37:26.173969 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:26.173910 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-65b89955-xslzb" podStartSLOduration=2.173888957 podStartE2EDuration="2.173888957s" podCreationTimestamp="2026-05-25 23:37:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 23:37:26.17344538 +0000 UTC m=+144.252341042" watchObservedRunningTime="2026-05-25 23:37:26.173888957 +0000 UTC m=+144.252784627" May 25 23:37:26.809405 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:26.809365 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 25 23:37:26.809866 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:26.809835 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="42e4a0f8-9f66-42e2-857c-36edcf42416a" containerName="prometheus" containerID="cri-o://83bf0ee6d632dd6f0e8edd920a142b12ed13e21095ff983349e797d799f6182b" gracePeriod=600 May 25 23:37:26.809948 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:26.809878 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="42e4a0f8-9f66-42e2-857c-36edcf42416a" containerName="thanos-sidecar" containerID="cri-o://56e5848b21905ca6eeef5bb692ff1f4da8a95cde83000740594d28b0142d29ce" gracePeriod=600 May 25 23:37:26.810023 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:26.809918 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="42e4a0f8-9f66-42e2-857c-36edcf42416a" containerName="kube-rbac-proxy-thanos" containerID="cri-o://82bc389849fd3085e37649701824cf45aed15b56437e3076d9fe200f4879b8e6" gracePeriod=600 May 25 23:37:26.810023 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:26.810012 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="42e4a0f8-9f66-42e2-857c-36edcf42416a" containerName="config-reloader" containerID="cri-o://5df7583c9d3c8a8711de4e5598f9f5a328f0d214fff16cbef544d945484a3bcf" gracePeriod=600 May 25 23:37:26.810023 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:26.809978 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="42e4a0f8-9f66-42e2-857c-36edcf42416a" containerName="kube-rbac-proxy-web" containerID="cri-o://52f3d2abda872a57000347fb32d58d8cb6fc3a07481c881fbcd838ef3ec18760" gracePeriod=600 May 25 23:37:26.810182 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:26.809960 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="42e4a0f8-9f66-42e2-857c-36edcf42416a" containerName="kube-rbac-proxy" containerID="cri-o://de30336e826dcf6d6faf78b515fa1dd507941053067b86756a38783f8927053b" gracePeriod=600 May 25 23:37:27.162729 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:27.162634 2560 generic.go:358] "Generic (PLEG): container finished" podID="42e4a0f8-9f66-42e2-857c-36edcf42416a" containerID="82bc389849fd3085e37649701824cf45aed15b56437e3076d9fe200f4879b8e6" exitCode=0 May 25 23:37:27.162729 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:27.162662 2560 generic.go:358] "Generic (PLEG): container finished" podID="42e4a0f8-9f66-42e2-857c-36edcf42416a" containerID="de30336e826dcf6d6faf78b515fa1dd507941053067b86756a38783f8927053b" exitCode=0 May 25 23:37:27.162729 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:27.162670 2560 generic.go:358] "Generic (PLEG): container finished" podID="42e4a0f8-9f66-42e2-857c-36edcf42416a" containerID="56e5848b21905ca6eeef5bb692ff1f4da8a95cde83000740594d28b0142d29ce" exitCode=0 May 25 23:37:27.162729 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:27.162675 2560 generic.go:358] "Generic (PLEG): container finished" podID="42e4a0f8-9f66-42e2-857c-36edcf42416a" containerID="5df7583c9d3c8a8711de4e5598f9f5a328f0d214fff16cbef544d945484a3bcf" exitCode=0 May 25 23:37:27.162729 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:27.162681 2560 generic.go:358] "Generic (PLEG): container finished" podID="42e4a0f8-9f66-42e2-857c-36edcf42416a" containerID="83bf0ee6d632dd6f0e8edd920a142b12ed13e21095ff983349e797d799f6182b" exitCode=0 May 25 23:37:27.162729 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:27.162715 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"42e4a0f8-9f66-42e2-857c-36edcf42416a","Type":"ContainerDied","Data":"82bc389849fd3085e37649701824cf45aed15b56437e3076d9fe200f4879b8e6"} May 25 23:37:27.163232 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:27.162754 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"42e4a0f8-9f66-42e2-857c-36edcf42416a","Type":"ContainerDied","Data":"de30336e826dcf6d6faf78b515fa1dd507941053067b86756a38783f8927053b"} May 25 23:37:27.163232 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:27.162764 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"42e4a0f8-9f66-42e2-857c-36edcf42416a","Type":"ContainerDied","Data":"56e5848b21905ca6eeef5bb692ff1f4da8a95cde83000740594d28b0142d29ce"} May 25 23:37:27.163232 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:27.162772 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"42e4a0f8-9f66-42e2-857c-36edcf42416a","Type":"ContainerDied","Data":"5df7583c9d3c8a8711de4e5598f9f5a328f0d214fff16cbef544d945484a3bcf"} May 25 23:37:27.163232 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:27.162781 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"42e4a0f8-9f66-42e2-857c-36edcf42416a","Type":"ContainerDied","Data":"83bf0ee6d632dd6f0e8edd920a142b12ed13e21095ff983349e797d799f6182b"} May 25 23:37:28.059692 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.059666 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 25 23:37:28.141428 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.141390 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/42e4a0f8-9f66-42e2-857c-36edcf42416a-secret-kube-rbac-proxy\") pod \"42e4a0f8-9f66-42e2-857c-36edcf42416a\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " May 25 23:37:28.141428 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.141430 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/42e4a0f8-9f66-42e2-857c-36edcf42416a-secret-grpc-tls\") pod \"42e4a0f8-9f66-42e2-857c-36edcf42416a\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " May 25 23:37:28.141633 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.141453 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42e4a0f8-9f66-42e2-857c-36edcf42416a-configmap-metrics-client-ca\") pod \"42e4a0f8-9f66-42e2-857c-36edcf42416a\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " May 25 23:37:28.141633 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.141479 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42e4a0f8-9f66-42e2-857c-36edcf42416a-prometheus-trusted-ca-bundle\") pod \"42e4a0f8-9f66-42e2-857c-36edcf42416a\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " May 25 23:37:28.141742 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.141639 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/42e4a0f8-9f66-42e2-857c-36edcf42416a-secret-prometheus-k8s-tls\") pod \"42e4a0f8-9f66-42e2-857c-36edcf42416a\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " May 25 23:37:28.141742 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.141706 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/42e4a0f8-9f66-42e2-857c-36edcf42416a-config-out\") pod \"42e4a0f8-9f66-42e2-857c-36edcf42416a\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " May 25 23:37:28.141742 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.141734 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/42e4a0f8-9f66-42e2-857c-36edcf42416a-web-config\") pod \"42e4a0f8-9f66-42e2-857c-36edcf42416a\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " May 25 23:37:28.141892 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.141763 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/42e4a0f8-9f66-42e2-857c-36edcf42416a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"42e4a0f8-9f66-42e2-857c-36edcf42416a\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " May 25 23:37:28.141892 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.141793 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/42e4a0f8-9f66-42e2-857c-36edcf42416a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"42e4a0f8-9f66-42e2-857c-36edcf42416a\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " May 25 23:37:28.141892 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.141823 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42e4a0f8-9f66-42e2-857c-36edcf42416a-configmap-kubelet-serving-ca-bundle\") pod \"42e4a0f8-9f66-42e2-857c-36edcf42416a\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " May 25 23:37:28.141892 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.141845 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9ns42\" (UniqueName: \"kubernetes.io/projected/42e4a0f8-9f66-42e2-857c-36edcf42416a-kube-api-access-9ns42\") pod \"42e4a0f8-9f66-42e2-857c-36edcf42416a\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " May 25 23:37:28.141892 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.141877 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/42e4a0f8-9f66-42e2-857c-36edcf42416a-secret-metrics-client-certs\") pod \"42e4a0f8-9f66-42e2-857c-36edcf42416a\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " May 25 23:37:28.142226 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.141912 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/42e4a0f8-9f66-42e2-857c-36edcf42416a-prometheus-k8s-rulefiles-0\") pod \"42e4a0f8-9f66-42e2-857c-36edcf42416a\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " May 25 23:37:28.142226 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.141952 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/42e4a0f8-9f66-42e2-857c-36edcf42416a-tls-assets\") pod \"42e4a0f8-9f66-42e2-857c-36edcf42416a\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " May 25 23:37:28.142226 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.141984 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/42e4a0f8-9f66-42e2-857c-36edcf42416a-prometheus-k8s-db\") pod \"42e4a0f8-9f66-42e2-857c-36edcf42416a\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " May 25 23:37:28.142226 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.141982 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42e4a0f8-9f66-42e2-857c-36edcf42416a-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "42e4a0f8-9f66-42e2-857c-36edcf42416a" (UID: "42e4a0f8-9f66-42e2-857c-36edcf42416a"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 23:37:28.142226 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.142048 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/42e4a0f8-9f66-42e2-857c-36edcf42416a-thanos-prometheus-http-client-file\") pod \"42e4a0f8-9f66-42e2-857c-36edcf42416a\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " May 25 23:37:28.142226 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.142101 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/42e4a0f8-9f66-42e2-857c-36edcf42416a-config\") pod \"42e4a0f8-9f66-42e2-857c-36edcf42416a\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " May 25 23:37:28.142226 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.142124 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42e4a0f8-9f66-42e2-857c-36edcf42416a-configmap-serving-certs-ca-bundle\") pod \"42e4a0f8-9f66-42e2-857c-36edcf42416a\" (UID: \"42e4a0f8-9f66-42e2-857c-36edcf42416a\") " May 25 23:37:28.142703 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.142372 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42e4a0f8-9f66-42e2-857c-36edcf42416a-prometheus-trusted-ca-bundle\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:37:28.142703 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.142564 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42e4a0f8-9f66-42e2-857c-36edcf42416a-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "42e4a0f8-9f66-42e2-857c-36edcf42416a" (UID: "42e4a0f8-9f66-42e2-857c-36edcf42416a"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 23:37:28.143133 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.142891 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42e4a0f8-9f66-42e2-857c-36edcf42416a-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "42e4a0f8-9f66-42e2-857c-36edcf42416a" (UID: "42e4a0f8-9f66-42e2-857c-36edcf42416a"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 23:37:28.144372 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.144340 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42e4a0f8-9f66-42e2-857c-36edcf42416a-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "42e4a0f8-9f66-42e2-857c-36edcf42416a" (UID: "42e4a0f8-9f66-42e2-857c-36edcf42416a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 23:37:28.145880 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.145707 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42e4a0f8-9f66-42e2-857c-36edcf42416a-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "42e4a0f8-9f66-42e2-857c-36edcf42416a" (UID: "42e4a0f8-9f66-42e2-857c-36edcf42416a"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 23:37:28.145880 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.145798 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42e4a0f8-9f66-42e2-857c-36edcf42416a-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "42e4a0f8-9f66-42e2-857c-36edcf42416a" (UID: "42e4a0f8-9f66-42e2-857c-36edcf42416a"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 23:37:28.145880 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.145831 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42e4a0f8-9f66-42e2-857c-36edcf42416a-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "42e4a0f8-9f66-42e2-857c-36edcf42416a" (UID: "42e4a0f8-9f66-42e2-857c-36edcf42416a"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 23:37:28.146662 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.146628 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42e4a0f8-9f66-42e2-857c-36edcf42416a-kube-api-access-9ns42" (OuterVolumeSpecName: "kube-api-access-9ns42") pod "42e4a0f8-9f66-42e2-857c-36edcf42416a" (UID: "42e4a0f8-9f66-42e2-857c-36edcf42416a"). InnerVolumeSpecName "kube-api-access-9ns42". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 25 23:37:28.146803 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.146770 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42e4a0f8-9f66-42e2-857c-36edcf42416a-config" (OuterVolumeSpecName: "config") pod "42e4a0f8-9f66-42e2-857c-36edcf42416a" (UID: "42e4a0f8-9f66-42e2-857c-36edcf42416a"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 23:37:28.146950 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.146915 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42e4a0f8-9f66-42e2-857c-36edcf42416a-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "42e4a0f8-9f66-42e2-857c-36edcf42416a" (UID: "42e4a0f8-9f66-42e2-857c-36edcf42416a"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 23:37:28.146950 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.146937 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42e4a0f8-9f66-42e2-857c-36edcf42416a-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "42e4a0f8-9f66-42e2-857c-36edcf42416a" (UID: "42e4a0f8-9f66-42e2-857c-36edcf42416a"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 23:37:28.147211 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.147175 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42e4a0f8-9f66-42e2-857c-36edcf42416a-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "42e4a0f8-9f66-42e2-857c-36edcf42416a" (UID: "42e4a0f8-9f66-42e2-857c-36edcf42416a"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 23:37:28.147211 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.147179 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42e4a0f8-9f66-42e2-857c-36edcf42416a-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "42e4a0f8-9f66-42e2-857c-36edcf42416a" (UID: "42e4a0f8-9f66-42e2-857c-36edcf42416a"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 25 23:37:28.147339 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.147298 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42e4a0f8-9f66-42e2-857c-36edcf42416a-config-out" (OuterVolumeSpecName: "config-out") pod "42e4a0f8-9f66-42e2-857c-36edcf42416a" (UID: "42e4a0f8-9f66-42e2-857c-36edcf42416a"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 25 23:37:28.147339 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.147305 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42e4a0f8-9f66-42e2-857c-36edcf42416a-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "42e4a0f8-9f66-42e2-857c-36edcf42416a" (UID: "42e4a0f8-9f66-42e2-857c-36edcf42416a"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 25 23:37:28.147703 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.147678 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42e4a0f8-9f66-42e2-857c-36edcf42416a-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "42e4a0f8-9f66-42e2-857c-36edcf42416a" (UID: "42e4a0f8-9f66-42e2-857c-36edcf42416a"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 23:37:28.147886 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.147868 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42e4a0f8-9f66-42e2-857c-36edcf42416a-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "42e4a0f8-9f66-42e2-857c-36edcf42416a" (UID: "42e4a0f8-9f66-42e2-857c-36edcf42416a"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 23:37:28.157247 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.157213 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42e4a0f8-9f66-42e2-857c-36edcf42416a-web-config" (OuterVolumeSpecName: "web-config") pod "42e4a0f8-9f66-42e2-857c-36edcf42416a" (UID: "42e4a0f8-9f66-42e2-857c-36edcf42416a"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 23:37:28.168079 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.168039 2560 generic.go:358] "Generic (PLEG): container finished" podID="42e4a0f8-9f66-42e2-857c-36edcf42416a" containerID="52f3d2abda872a57000347fb32d58d8cb6fc3a07481c881fbcd838ef3ec18760" exitCode=0 May 25 23:37:28.168454 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.168091 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"42e4a0f8-9f66-42e2-857c-36edcf42416a","Type":"ContainerDied","Data":"52f3d2abda872a57000347fb32d58d8cb6fc3a07481c881fbcd838ef3ec18760"} May 25 23:37:28.168454 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.168120 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"42e4a0f8-9f66-42e2-857c-36edcf42416a","Type":"ContainerDied","Data":"6fb87e411bd8ccef616e7e22523757a581bdcaf20ae5cf0979f4d036841d5949"} May 25 23:37:28.168454 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.168136 2560 scope.go:117] "RemoveContainer" containerID="82bc389849fd3085e37649701824cf45aed15b56437e3076d9fe200f4879b8e6" May 25 23:37:28.168454 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.168224 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 25 23:37:28.176193 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.176045 2560 scope.go:117] "RemoveContainer" containerID="de30336e826dcf6d6faf78b515fa1dd507941053067b86756a38783f8927053b" May 25 23:37:28.183432 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.183409 2560 scope.go:117] "RemoveContainer" containerID="52f3d2abda872a57000347fb32d58d8cb6fc3a07481c881fbcd838ef3ec18760" May 25 23:37:28.190592 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.190568 2560 scope.go:117] "RemoveContainer" containerID="56e5848b21905ca6eeef5bb692ff1f4da8a95cde83000740594d28b0142d29ce" May 25 23:37:28.192336 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.192147 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 25 23:37:28.197110 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.197082 2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 25 23:37:28.199255 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.199230 2560 scope.go:117] "RemoveContainer" containerID="5df7583c9d3c8a8711de4e5598f9f5a328f0d214fff16cbef544d945484a3bcf" May 25 23:37:28.206208 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.206190 2560 scope.go:117] "RemoveContainer" containerID="83bf0ee6d632dd6f0e8edd920a142b12ed13e21095ff983349e797d799f6182b" May 25 23:37:28.213783 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.213765 2560 scope.go:117] "RemoveContainer" containerID="3a92f49ff57c15093dbc7ab0b8aa714ed9987fd22c39fa1e0bed8cb9187c2b6c" May 25 23:37:28.223750 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.223717 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 25 23:37:28.224125 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.224106 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42e4a0f8-9f66-42e2-857c-36edcf42416a" containerName="prometheus" May 25 23:37:28.224221 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.224126 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="42e4a0f8-9f66-42e2-857c-36edcf42416a" containerName="prometheus" May 25 23:37:28.224221 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.224144 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42e4a0f8-9f66-42e2-857c-36edcf42416a" containerName="kube-rbac-proxy-thanos" May 25 23:37:28.224221 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.224151 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="42e4a0f8-9f66-42e2-857c-36edcf42416a" containerName="kube-rbac-proxy-thanos" May 25 23:37:28.224221 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.224164 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42e4a0f8-9f66-42e2-857c-36edcf42416a" containerName="init-config-reloader" May 25 23:37:28.224221 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.224173 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="42e4a0f8-9f66-42e2-857c-36edcf42416a" containerName="init-config-reloader" May 25 23:37:28.224221 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.224188 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42e4a0f8-9f66-42e2-857c-36edcf42416a" containerName="config-reloader" May 25 23:37:28.224221 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.224196 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="42e4a0f8-9f66-42e2-857c-36edcf42416a" containerName="config-reloader" May 25 23:37:28.224221 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.224210 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42e4a0f8-9f66-42e2-857c-36edcf42416a" containerName="kube-rbac-proxy-web" May 25 23:37:28.224221 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.224218 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="42e4a0f8-9f66-42e2-857c-36edcf42416a" containerName="kube-rbac-proxy-web" May 25 23:37:28.224631 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.224228 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42e4a0f8-9f66-42e2-857c-36edcf42416a" containerName="kube-rbac-proxy" May 25 23:37:28.224631 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.224237 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="42e4a0f8-9f66-42e2-857c-36edcf42416a" containerName="kube-rbac-proxy" May 25 23:37:28.224631 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.224248 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42e4a0f8-9f66-42e2-857c-36edcf42416a" containerName="thanos-sidecar" May 25 23:37:28.224631 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.224256 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="42e4a0f8-9f66-42e2-857c-36edcf42416a" containerName="thanos-sidecar" May 25 23:37:28.224631 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.224322 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="42e4a0f8-9f66-42e2-857c-36edcf42416a" containerName="prometheus" May 25 23:37:28.224631 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.224335 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="42e4a0f8-9f66-42e2-857c-36edcf42416a" containerName="config-reloader" May 25 23:37:28.224631 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.224346 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="42e4a0f8-9f66-42e2-857c-36edcf42416a" containerName="kube-rbac-proxy-web" May 25 23:37:28.224631 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.224356 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="42e4a0f8-9f66-42e2-857c-36edcf42416a" containerName="kube-rbac-proxy-thanos" May 25 23:37:28.224631 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.224366 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="42e4a0f8-9f66-42e2-857c-36edcf42416a" containerName="thanos-sidecar" May 25 23:37:28.224631 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.224376 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="42e4a0f8-9f66-42e2-857c-36edcf42416a" containerName="kube-rbac-proxy" May 25 23:37:28.225112 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.225052 2560 scope.go:117] "RemoveContainer" containerID="82bc389849fd3085e37649701824cf45aed15b56437e3076d9fe200f4879b8e6" May 25 23:37:28.225429 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:37:28.225409 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82bc389849fd3085e37649701824cf45aed15b56437e3076d9fe200f4879b8e6\": container with ID starting with 82bc389849fd3085e37649701824cf45aed15b56437e3076d9fe200f4879b8e6 not found: ID does not exist" containerID="82bc389849fd3085e37649701824cf45aed15b56437e3076d9fe200f4879b8e6" May 25 23:37:28.225515 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.225439 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82bc389849fd3085e37649701824cf45aed15b56437e3076d9fe200f4879b8e6"} err="failed to get container status \"82bc389849fd3085e37649701824cf45aed15b56437e3076d9fe200f4879b8e6\": rpc error: code = NotFound desc = could not find container \"82bc389849fd3085e37649701824cf45aed15b56437e3076d9fe200f4879b8e6\": container with ID starting with 82bc389849fd3085e37649701824cf45aed15b56437e3076d9fe200f4879b8e6 not found: ID does not exist" May 25 23:37:28.225515 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.225460 2560 scope.go:117] "RemoveContainer" containerID="de30336e826dcf6d6faf78b515fa1dd507941053067b86756a38783f8927053b" May 25 23:37:28.225741 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:37:28.225721 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de30336e826dcf6d6faf78b515fa1dd507941053067b86756a38783f8927053b\": container with ID starting with de30336e826dcf6d6faf78b515fa1dd507941053067b86756a38783f8927053b not found: ID does not exist" containerID="de30336e826dcf6d6faf78b515fa1dd507941053067b86756a38783f8927053b" May 25 23:37:28.225787 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.225746 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de30336e826dcf6d6faf78b515fa1dd507941053067b86756a38783f8927053b"} err="failed to get container status \"de30336e826dcf6d6faf78b515fa1dd507941053067b86756a38783f8927053b\": rpc error: code = NotFound desc = could not find container \"de30336e826dcf6d6faf78b515fa1dd507941053067b86756a38783f8927053b\": container with ID starting with de30336e826dcf6d6faf78b515fa1dd507941053067b86756a38783f8927053b not found: ID does not exist" May 25 23:37:28.225787 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.225765 2560 scope.go:117] "RemoveContainer" containerID="52f3d2abda872a57000347fb32d58d8cb6fc3a07481c881fbcd838ef3ec18760" May 25 23:37:28.226041 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:37:28.226024 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52f3d2abda872a57000347fb32d58d8cb6fc3a07481c881fbcd838ef3ec18760\": container with ID starting with 52f3d2abda872a57000347fb32d58d8cb6fc3a07481c881fbcd838ef3ec18760 not found: ID does not exist" containerID="52f3d2abda872a57000347fb32d58d8cb6fc3a07481c881fbcd838ef3ec18760" May 25 23:37:28.226076 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.226046 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52f3d2abda872a57000347fb32d58d8cb6fc3a07481c881fbcd838ef3ec18760"} err="failed to get container status \"52f3d2abda872a57000347fb32d58d8cb6fc3a07481c881fbcd838ef3ec18760\": rpc error: code = NotFound desc = could not find container \"52f3d2abda872a57000347fb32d58d8cb6fc3a07481c881fbcd838ef3ec18760\": container with ID starting with 52f3d2abda872a57000347fb32d58d8cb6fc3a07481c881fbcd838ef3ec18760 not found: ID does not exist" May 25 23:37:28.226076 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.226061 2560 scope.go:117] "RemoveContainer" containerID="56e5848b21905ca6eeef5bb692ff1f4da8a95cde83000740594d28b0142d29ce" May 25 23:37:28.226335 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:37:28.226315 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56e5848b21905ca6eeef5bb692ff1f4da8a95cde83000740594d28b0142d29ce\": container with ID starting with 56e5848b21905ca6eeef5bb692ff1f4da8a95cde83000740594d28b0142d29ce not found: ID does not exist" containerID="56e5848b21905ca6eeef5bb692ff1f4da8a95cde83000740594d28b0142d29ce" May 25 23:37:28.226377 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.226344 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56e5848b21905ca6eeef5bb692ff1f4da8a95cde83000740594d28b0142d29ce"} err="failed to get container status \"56e5848b21905ca6eeef5bb692ff1f4da8a95cde83000740594d28b0142d29ce\": rpc error: code = NotFound desc = could not find container \"56e5848b21905ca6eeef5bb692ff1f4da8a95cde83000740594d28b0142d29ce\": container with ID starting with 56e5848b21905ca6eeef5bb692ff1f4da8a95cde83000740594d28b0142d29ce not found: ID does not exist" May 25 23:37:28.226377 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.226360 2560 scope.go:117] "RemoveContainer" containerID="5df7583c9d3c8a8711de4e5598f9f5a328f0d214fff16cbef544d945484a3bcf" May 25 23:37:28.226574 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:37:28.226558 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5df7583c9d3c8a8711de4e5598f9f5a328f0d214fff16cbef544d945484a3bcf\": container with ID starting with 5df7583c9d3c8a8711de4e5598f9f5a328f0d214fff16cbef544d945484a3bcf not found: ID does not exist" containerID="5df7583c9d3c8a8711de4e5598f9f5a328f0d214fff16cbef544d945484a3bcf" May 25 23:37:28.226617 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.226579 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5df7583c9d3c8a8711de4e5598f9f5a328f0d214fff16cbef544d945484a3bcf"} err="failed to get container status \"5df7583c9d3c8a8711de4e5598f9f5a328f0d214fff16cbef544d945484a3bcf\": rpc error: code = NotFound desc = could not find container \"5df7583c9d3c8a8711de4e5598f9f5a328f0d214fff16cbef544d945484a3bcf\": container with ID starting with 5df7583c9d3c8a8711de4e5598f9f5a328f0d214fff16cbef544d945484a3bcf not found: ID does not exist" May 25 23:37:28.226617 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.226592 2560 scope.go:117] "RemoveContainer" containerID="83bf0ee6d632dd6f0e8edd920a142b12ed13e21095ff983349e797d799f6182b" May 25 23:37:28.226798 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:37:28.226782 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83bf0ee6d632dd6f0e8edd920a142b12ed13e21095ff983349e797d799f6182b\": container with ID starting with 83bf0ee6d632dd6f0e8edd920a142b12ed13e21095ff983349e797d799f6182b not found: ID does not exist" containerID="83bf0ee6d632dd6f0e8edd920a142b12ed13e21095ff983349e797d799f6182b" May 25 23:37:28.226833 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.226802 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83bf0ee6d632dd6f0e8edd920a142b12ed13e21095ff983349e797d799f6182b"} err="failed to get container status \"83bf0ee6d632dd6f0e8edd920a142b12ed13e21095ff983349e797d799f6182b\": rpc error: code = NotFound desc = could not find container \"83bf0ee6d632dd6f0e8edd920a142b12ed13e21095ff983349e797d799f6182b\": container with ID starting with 83bf0ee6d632dd6f0e8edd920a142b12ed13e21095ff983349e797d799f6182b not found: ID does not exist" May 25 23:37:28.226833 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.226814 2560 scope.go:117] "RemoveContainer" containerID="3a92f49ff57c15093dbc7ab0b8aa714ed9987fd22c39fa1e0bed8cb9187c2b6c" May 25 23:37:28.227064 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:37:28.227050 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a92f49ff57c15093dbc7ab0b8aa714ed9987fd22c39fa1e0bed8cb9187c2b6c\": container with ID starting with 3a92f49ff57c15093dbc7ab0b8aa714ed9987fd22c39fa1e0bed8cb9187c2b6c not found: ID does not exist" containerID="3a92f49ff57c15093dbc7ab0b8aa714ed9987fd22c39fa1e0bed8cb9187c2b6c" May 25 23:37:28.227108 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.227066 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a92f49ff57c15093dbc7ab0b8aa714ed9987fd22c39fa1e0bed8cb9187c2b6c"} err="failed to get container status \"3a92f49ff57c15093dbc7ab0b8aa714ed9987fd22c39fa1e0bed8cb9187c2b6c\": rpc error: code = NotFound desc = could not find container \"3a92f49ff57c15093dbc7ab0b8aa714ed9987fd22c39fa1e0bed8cb9187c2b6c\": container with ID starting with 3a92f49ff57c15093dbc7ab0b8aa714ed9987fd22c39fa1e0bed8cb9187c2b6c not found: ID does not exist" May 25 23:37:28.228176 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.228158 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 25 23:37:28.230772 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.230745 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 25 23:37:28.230874 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.230759 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 25 23:37:28.231192 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.231149 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 25 23:37:28.231192 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.231156 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 25 23:37:28.231390 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.231270 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 25 23:37:28.231390 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.231280 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 25 23:37:28.231390 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.231296 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-6613d0ro0rj9k\"" May 25 23:37:28.231550 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.231535 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-kq2k8\"" May 25 23:37:28.231605 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.231565 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 25 23:37:28.231825 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.231743 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 25 23:37:28.232503 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.232479 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 25 23:37:28.232612 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.232488 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 25 23:37:28.232612 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.232528 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 25 23:37:28.235984 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.235226 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 25 23:37:28.239315 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.239238 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 25 23:37:28.240521 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.240498 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 25 23:37:28.243002 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.242968 2560 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/42e4a0f8-9f66-42e2-857c-36edcf42416a-secret-metrics-client-certs\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:37:28.243079 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.243007 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/42e4a0f8-9f66-42e2-857c-36edcf42416a-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:37:28.243079 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.243020 2560 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/42e4a0f8-9f66-42e2-857c-36edcf42416a-tls-assets\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:37:28.243079 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.243031 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/42e4a0f8-9f66-42e2-857c-36edcf42416a-prometheus-k8s-db\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:37:28.243079 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.243041 2560 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/42e4a0f8-9f66-42e2-857c-36edcf42416a-thanos-prometheus-http-client-file\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:37:28.243079 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.243050 2560 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/42e4a0f8-9f66-42e2-857c-36edcf42416a-config\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:37:28.243079 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.243058 2560 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42e4a0f8-9f66-42e2-857c-36edcf42416a-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:37:28.243079 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.243068 2560 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/42e4a0f8-9f66-42e2-857c-36edcf42416a-secret-kube-rbac-proxy\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:37:28.243079 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.243077 2560 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/42e4a0f8-9f66-42e2-857c-36edcf42416a-secret-grpc-tls\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:37:28.243327 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.243086 2560 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42e4a0f8-9f66-42e2-857c-36edcf42416a-configmap-metrics-client-ca\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:37:28.243327 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.243094 2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/42e4a0f8-9f66-42e2-857c-36edcf42416a-secret-prometheus-k8s-tls\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:37:28.243327 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.243102 2560 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/42e4a0f8-9f66-42e2-857c-36edcf42416a-config-out\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:37:28.243327 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.243110 2560 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/42e4a0f8-9f66-42e2-857c-36edcf42416a-web-config\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:37:28.243327 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.243118 2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/42e4a0f8-9f66-42e2-857c-36edcf42416a-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:37:28.243327 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.243131 2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/42e4a0f8-9f66-42e2-857c-36edcf42416a-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:37:28.243327 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.243145 2560 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42e4a0f8-9f66-42e2-857c-36edcf42416a-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:37:28.243327 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.243159 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9ns42\" (UniqueName: \"kubernetes.io/projected/42e4a0f8-9f66-42e2-857c-36edcf42416a-kube-api-access-9ns42\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:37:28.344317 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.344268 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/116a99c3-ad86-4115-8e0e-df7d17d2094d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"116a99c3-ad86-4115-8e0e-df7d17d2094d\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:37:28.344317 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.344319 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/116a99c3-ad86-4115-8e0e-df7d17d2094d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"116a99c3-ad86-4115-8e0e-df7d17d2094d\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:37:28.344575 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.344342 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/116a99c3-ad86-4115-8e0e-df7d17d2094d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"116a99c3-ad86-4115-8e0e-df7d17d2094d\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:37:28.344575 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.344376 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/116a99c3-ad86-4115-8e0e-df7d17d2094d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"116a99c3-ad86-4115-8e0e-df7d17d2094d\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:37:28.344575 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.344437 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/116a99c3-ad86-4115-8e0e-df7d17d2094d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"116a99c3-ad86-4115-8e0e-df7d17d2094d\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:37:28.344575 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.344460 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/116a99c3-ad86-4115-8e0e-df7d17d2094d-web-config\") pod \"prometheus-k8s-0\" (UID: \"116a99c3-ad86-4115-8e0e-df7d17d2094d\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:37:28.344575 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.344484 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/116a99c3-ad86-4115-8e0e-df7d17d2094d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"116a99c3-ad86-4115-8e0e-df7d17d2094d\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:37:28.344575 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.344517 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hbfs\" (UniqueName: \"kubernetes.io/projected/116a99c3-ad86-4115-8e0e-df7d17d2094d-kube-api-access-5hbfs\") pod \"prometheus-k8s-0\" (UID: \"116a99c3-ad86-4115-8e0e-df7d17d2094d\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:37:28.344575 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.344547 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/116a99c3-ad86-4115-8e0e-df7d17d2094d-config\") pod \"prometheus-k8s-0\" (UID: \"116a99c3-ad86-4115-8e0e-df7d17d2094d\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:37:28.344833 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.344575 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/116a99c3-ad86-4115-8e0e-df7d17d2094d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"116a99c3-ad86-4115-8e0e-df7d17d2094d\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:37:28.344833 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.344599 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/116a99c3-ad86-4115-8e0e-df7d17d2094d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"116a99c3-ad86-4115-8e0e-df7d17d2094d\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:37:28.344833 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.344624 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/116a99c3-ad86-4115-8e0e-df7d17d2094d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"116a99c3-ad86-4115-8e0e-df7d17d2094d\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:37:28.344833 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.344651 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/116a99c3-ad86-4115-8e0e-df7d17d2094d-config-out\") pod \"prometheus-k8s-0\" (UID: \"116a99c3-ad86-4115-8e0e-df7d17d2094d\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:37:28.344833 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.344710 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/116a99c3-ad86-4115-8e0e-df7d17d2094d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"116a99c3-ad86-4115-8e0e-df7d17d2094d\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:37:28.344833 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.344767 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/116a99c3-ad86-4115-8e0e-df7d17d2094d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"116a99c3-ad86-4115-8e0e-df7d17d2094d\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:37:28.344833 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.344795 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/116a99c3-ad86-4115-8e0e-df7d17d2094d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"116a99c3-ad86-4115-8e0e-df7d17d2094d\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:37:28.344833 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.344828 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/116a99c3-ad86-4115-8e0e-df7d17d2094d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"116a99c3-ad86-4115-8e0e-df7d17d2094d\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:37:28.345125 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.344864 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/116a99c3-ad86-4115-8e0e-df7d17d2094d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"116a99c3-ad86-4115-8e0e-df7d17d2094d\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:37:28.445728 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.445679 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/116a99c3-ad86-4115-8e0e-df7d17d2094d-config\") pod \"prometheus-k8s-0\" (UID: \"116a99c3-ad86-4115-8e0e-df7d17d2094d\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:37:28.445728 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.445737 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/116a99c3-ad86-4115-8e0e-df7d17d2094d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"116a99c3-ad86-4115-8e0e-df7d17d2094d\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:37:28.445968 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.445769 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/116a99c3-ad86-4115-8e0e-df7d17d2094d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"116a99c3-ad86-4115-8e0e-df7d17d2094d\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:37:28.445968 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.445793 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/116a99c3-ad86-4115-8e0e-df7d17d2094d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"116a99c3-ad86-4115-8e0e-df7d17d2094d\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:37:28.445968 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.445818 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/116a99c3-ad86-4115-8e0e-df7d17d2094d-config-out\") pod \"prometheus-k8s-0\" (UID: \"116a99c3-ad86-4115-8e0e-df7d17d2094d\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:37:28.445968 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.445845 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/116a99c3-ad86-4115-8e0e-df7d17d2094d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"116a99c3-ad86-4115-8e0e-df7d17d2094d\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:37:28.445968 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.445869 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/116a99c3-ad86-4115-8e0e-df7d17d2094d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"116a99c3-ad86-4115-8e0e-df7d17d2094d\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:37:28.445968 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.445895 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/116a99c3-ad86-4115-8e0e-df7d17d2094d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"116a99c3-ad86-4115-8e0e-df7d17d2094d\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:37:28.447213 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.446919 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/116a99c3-ad86-4115-8e0e-df7d17d2094d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"116a99c3-ad86-4115-8e0e-df7d17d2094d\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:37:28.447213 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.447008 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/116a99c3-ad86-4115-8e0e-df7d17d2094d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"116a99c3-ad86-4115-8e0e-df7d17d2094d\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:37:28.447213 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.447081 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/116a99c3-ad86-4115-8e0e-df7d17d2094d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"116a99c3-ad86-4115-8e0e-df7d17d2094d\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:37:28.447213 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.447124 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/116a99c3-ad86-4115-8e0e-df7d17d2094d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"116a99c3-ad86-4115-8e0e-df7d17d2094d\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:37:28.447213 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.447155 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/116a99c3-ad86-4115-8e0e-df7d17d2094d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"116a99c3-ad86-4115-8e0e-df7d17d2094d\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:37:28.447213 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.447179 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/116a99c3-ad86-4115-8e0e-df7d17d2094d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"116a99c3-ad86-4115-8e0e-df7d17d2094d\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:37:28.447213 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.447210 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/116a99c3-ad86-4115-8e0e-df7d17d2094d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"116a99c3-ad86-4115-8e0e-df7d17d2094d\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:37:28.447595 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.447255 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/116a99c3-ad86-4115-8e0e-df7d17d2094d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"116a99c3-ad86-4115-8e0e-df7d17d2094d\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:37:28.447595 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.447280 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/116a99c3-ad86-4115-8e0e-df7d17d2094d-web-config\") pod \"prometheus-k8s-0\" (UID: \"116a99c3-ad86-4115-8e0e-df7d17d2094d\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:37:28.447595 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.447314 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/116a99c3-ad86-4115-8e0e-df7d17d2094d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"116a99c3-ad86-4115-8e0e-df7d17d2094d\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:37:28.447595 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.447354 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5hbfs\" (UniqueName: \"kubernetes.io/projected/116a99c3-ad86-4115-8e0e-df7d17d2094d-kube-api-access-5hbfs\") pod \"prometheus-k8s-0\" (UID: \"116a99c3-ad86-4115-8e0e-df7d17d2094d\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:37:28.449081 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.448934 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/116a99c3-ad86-4115-8e0e-df7d17d2094d-config-out\") pod \"prometheus-k8s-0\" (UID: \"116a99c3-ad86-4115-8e0e-df7d17d2094d\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:37:28.449361 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.449251 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/116a99c3-ad86-4115-8e0e-df7d17d2094d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"116a99c3-ad86-4115-8e0e-df7d17d2094d\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:37:28.449717 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.449599 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/116a99c3-ad86-4115-8e0e-df7d17d2094d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"116a99c3-ad86-4115-8e0e-df7d17d2094d\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:37:28.449717 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.449703 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/116a99c3-ad86-4115-8e0e-df7d17d2094d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"116a99c3-ad86-4115-8e0e-df7d17d2094d\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:37:28.449863 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.449810 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/116a99c3-ad86-4115-8e0e-df7d17d2094d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"116a99c3-ad86-4115-8e0e-df7d17d2094d\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:37:28.450017 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.449974 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/116a99c3-ad86-4115-8e0e-df7d17d2094d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"116a99c3-ad86-4115-8e0e-df7d17d2094d\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:37:28.450168 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.450147 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/116a99c3-ad86-4115-8e0e-df7d17d2094d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"116a99c3-ad86-4115-8e0e-df7d17d2094d\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:37:28.450259 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.450238 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/116a99c3-ad86-4115-8e0e-df7d17d2094d-config\") pod \"prometheus-k8s-0\" (UID: \"116a99c3-ad86-4115-8e0e-df7d17d2094d\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:37:28.450760 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.450686 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/116a99c3-ad86-4115-8e0e-df7d17d2094d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"116a99c3-ad86-4115-8e0e-df7d17d2094d\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:37:28.450760 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.450734 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/116a99c3-ad86-4115-8e0e-df7d17d2094d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"116a99c3-ad86-4115-8e0e-df7d17d2094d\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:37:28.450912 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.450890 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/116a99c3-ad86-4115-8e0e-df7d17d2094d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"116a99c3-ad86-4115-8e0e-df7d17d2094d\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:37:28.451120 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.451095 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/116a99c3-ad86-4115-8e0e-df7d17d2094d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"116a99c3-ad86-4115-8e0e-df7d17d2094d\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:37:28.452092 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.452069 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/116a99c3-ad86-4115-8e0e-df7d17d2094d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"116a99c3-ad86-4115-8e0e-df7d17d2094d\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:37:28.452384 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.452363 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/116a99c3-ad86-4115-8e0e-df7d17d2094d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"116a99c3-ad86-4115-8e0e-df7d17d2094d\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:37:28.452455 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.452401 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/116a99c3-ad86-4115-8e0e-df7d17d2094d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"116a99c3-ad86-4115-8e0e-df7d17d2094d\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:37:28.452931 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.452909 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/116a99c3-ad86-4115-8e0e-df7d17d2094d-web-config\") pod \"prometheus-k8s-0\" (UID: \"116a99c3-ad86-4115-8e0e-df7d17d2094d\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:37:28.456441 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.456415 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hbfs\" (UniqueName: \"kubernetes.io/projected/116a99c3-ad86-4115-8e0e-df7d17d2094d-kube-api-access-5hbfs\") pod \"prometheus-k8s-0\" (UID: \"116a99c3-ad86-4115-8e0e-df7d17d2094d\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 23:37:28.540829 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.540787 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 25 23:37:28.544291 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.544260 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42e4a0f8-9f66-42e2-857c-36edcf42416a" path="/var/lib/kubelet/pods/42e4a0f8-9f66-42e2-857c-36edcf42416a/volumes" May 25 23:37:28.680641 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:28.680605 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 25 23:37:28.684042 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:37:28.684015 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod116a99c3_ad86_4115_8e0e_df7d17d2094d.slice/crio-5aeee25439992cbab57f21d507e3e4c2116890e5ec464a17b0b92aabc6d378d2 WatchSource:0}: Error finding container 5aeee25439992cbab57f21d507e3e4c2116890e5ec464a17b0b92aabc6d378d2: Status 404 returned error can't find the container with id 5aeee25439992cbab57f21d507e3e4c2116890e5ec464a17b0b92aabc6d378d2 May 25 23:37:29.172574 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:29.172472 2560 generic.go:358] "Generic (PLEG): container finished" podID="116a99c3-ad86-4115-8e0e-df7d17d2094d" containerID="f8549b5a9b8b5683e9904574747675956a4dcf8fdd1b097081ecd1106da81c30" exitCode=0 May 25 23:37:29.172574 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:29.172543 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"116a99c3-ad86-4115-8e0e-df7d17d2094d","Type":"ContainerDied","Data":"f8549b5a9b8b5683e9904574747675956a4dcf8fdd1b097081ecd1106da81c30"} May 25 23:37:29.172574 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:29.172570 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"116a99c3-ad86-4115-8e0e-df7d17d2094d","Type":"ContainerStarted","Data":"5aeee25439992cbab57f21d507e3e4c2116890e5ec464a17b0b92aabc6d378d2"} May 25 23:37:30.179305 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:30.179263 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"116a99c3-ad86-4115-8e0e-df7d17d2094d","Type":"ContainerStarted","Data":"40326d5f7b50e582ced040fe9313d1baec77dbeec61778ff591b75345706da84"} May 25 23:37:30.179305 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:30.179309 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"116a99c3-ad86-4115-8e0e-df7d17d2094d","Type":"ContainerStarted","Data":"3223bcd3df8119a9f511bc6d689dcee1d31700eb1a5d8681423f72a14d20ed9c"} May 25 23:37:30.179717 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:30.179323 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"116a99c3-ad86-4115-8e0e-df7d17d2094d","Type":"ContainerStarted","Data":"20686aabcdc88b19057eb929d4dc1da68d58c8329542166adbabead236906295"} May 25 23:37:30.179717 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:30.179336 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"116a99c3-ad86-4115-8e0e-df7d17d2094d","Type":"ContainerStarted","Data":"386231a2bee58e8419cf4e9fe8da6e6c6f1184b48ef25138805207fef0464417"} May 25 23:37:30.179717 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:30.179347 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"116a99c3-ad86-4115-8e0e-df7d17d2094d","Type":"ContainerStarted","Data":"47bce0b78c68582d39f649f93a4bc1752287ec523f6ec0b781e2473218da6980"} May 25 23:37:30.179717 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:30.179360 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"116a99c3-ad86-4115-8e0e-df7d17d2094d","Type":"ContainerStarted","Data":"de12ea41a26e3454adafe08a0b91f4ed373a57812c2bc20c65eb8884f7a4f2ab"} May 25 23:37:30.211007 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:30.210944 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.210928147 podStartE2EDuration="2.210928147s" podCreationTimestamp="2026-05-25 23:37:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 23:37:30.209520283 +0000 UTC m=+148.288415933" watchObservedRunningTime="2026-05-25 23:37:30.210928147 +0000 UTC m=+148.289823796" May 25 23:37:33.541505 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:33.541453 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 25 23:37:35.335959 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:35.335906 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-65b89955-xslzb" May 25 23:37:35.335959 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:35.335967 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-65b89955-xslzb" May 25 23:37:35.340850 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:35.340823 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-65b89955-xslzb" May 25 23:37:36.201937 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:36.201902 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-65b89955-xslzb" May 25 23:37:36.251592 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:36.251558 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b6d5dc5bb-m8vrh"] May 25 23:37:59.475964 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:59.475923 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-dr7pq"] May 25 23:37:59.478500 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:59.478478 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dr7pq" May 25 23:37:59.481101 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:59.481076 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 25 23:37:59.486233 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:59.486068 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dr7pq"] May 25 23:37:59.597714 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:59.597675 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d8801da9-38b0-4cfc-bc00-fbc7cce6ae1a-kubelet-config\") pod \"global-pull-secret-syncer-dr7pq\" (UID: \"d8801da9-38b0-4cfc-bc00-fbc7cce6ae1a\") " pod="kube-system/global-pull-secret-syncer-dr7pq" May 25 23:37:59.597892 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:59.597732 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d8801da9-38b0-4cfc-bc00-fbc7cce6ae1a-original-pull-secret\") pod \"global-pull-secret-syncer-dr7pq\" (UID: \"d8801da9-38b0-4cfc-bc00-fbc7cce6ae1a\") " pod="kube-system/global-pull-secret-syncer-dr7pq" May 25 23:37:59.597892 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:59.597753 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d8801da9-38b0-4cfc-bc00-fbc7cce6ae1a-dbus\") pod \"global-pull-secret-syncer-dr7pq\" (UID: \"d8801da9-38b0-4cfc-bc00-fbc7cce6ae1a\") " pod="kube-system/global-pull-secret-syncer-dr7pq" May 25 23:37:59.698327 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:59.698293 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d8801da9-38b0-4cfc-bc00-fbc7cce6ae1a-kubelet-config\") pod \"global-pull-secret-syncer-dr7pq\" (UID: \"d8801da9-38b0-4cfc-bc00-fbc7cce6ae1a\") " pod="kube-system/global-pull-secret-syncer-dr7pq" May 25 23:37:59.698506 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:59.698356 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d8801da9-38b0-4cfc-bc00-fbc7cce6ae1a-original-pull-secret\") pod \"global-pull-secret-syncer-dr7pq\" (UID: \"d8801da9-38b0-4cfc-bc00-fbc7cce6ae1a\") " pod="kube-system/global-pull-secret-syncer-dr7pq" May 25 23:37:59.698506 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:59.698374 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d8801da9-38b0-4cfc-bc00-fbc7cce6ae1a-dbus\") pod \"global-pull-secret-syncer-dr7pq\" (UID: \"d8801da9-38b0-4cfc-bc00-fbc7cce6ae1a\") " pod="kube-system/global-pull-secret-syncer-dr7pq" May 25 23:37:59.698506 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:59.698398 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d8801da9-38b0-4cfc-bc00-fbc7cce6ae1a-kubelet-config\") pod \"global-pull-secret-syncer-dr7pq\" (UID: \"d8801da9-38b0-4cfc-bc00-fbc7cce6ae1a\") " pod="kube-system/global-pull-secret-syncer-dr7pq" May 25 23:37:59.698611 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:59.698509 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d8801da9-38b0-4cfc-bc00-fbc7cce6ae1a-dbus\") pod \"global-pull-secret-syncer-dr7pq\" (UID: \"d8801da9-38b0-4cfc-bc00-fbc7cce6ae1a\") " pod="kube-system/global-pull-secret-syncer-dr7pq" May 25 23:37:59.700802 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:59.700782 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d8801da9-38b0-4cfc-bc00-fbc7cce6ae1a-original-pull-secret\") pod \"global-pull-secret-syncer-dr7pq\" (UID: \"d8801da9-38b0-4cfc-bc00-fbc7cce6ae1a\") " pod="kube-system/global-pull-secret-syncer-dr7pq" May 25 23:37:59.789768 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:59.789663 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dr7pq" May 25 23:37:59.947846 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:37:59.947810 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dr7pq"] May 25 23:37:59.951851 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:37:59.951819 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8801da9_38b0_4cfc_bc00_fbc7cce6ae1a.slice/crio-f5b40fefb7ac257e1ad0b14fc7723df264157c029c4187244aeeb5fc1d1afdc7 WatchSource:0}: Error finding container f5b40fefb7ac257e1ad0b14fc7723df264157c029c4187244aeeb5fc1d1afdc7: Status 404 returned error can't find the container with id f5b40fefb7ac257e1ad0b14fc7723df264157c029c4187244aeeb5fc1d1afdc7 May 25 23:38:00.266032 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:38:00.265978 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dr7pq" event={"ID":"d8801da9-38b0-4cfc-bc00-fbc7cce6ae1a","Type":"ContainerStarted","Data":"f5b40fefb7ac257e1ad0b14fc7723df264157c029c4187244aeeb5fc1d1afdc7"} May 25 23:38:01.271671 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:38:01.271575 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-6b6d5dc5bb-m8vrh" podUID="6eff508d-7f75-4036-b13e-8d327128e0bf" containerName="console" containerID="cri-o://2adc2666b7db922a91cb5aea084c1bd0606cb7a3faf71c74fe12fb0517d77bfc" gracePeriod=15 May 25 23:38:01.543050 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:38:01.543025 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6b6d5dc5bb-m8vrh_6eff508d-7f75-4036-b13e-8d327128e0bf/console/0.log" May 25 23:38:01.543187 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:38:01.543091 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b6d5dc5bb-m8vrh" May 25 23:38:01.617481 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:38:01.617424 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6eff508d-7f75-4036-b13e-8d327128e0bf-console-serving-cert\") pod \"6eff508d-7f75-4036-b13e-8d327128e0bf\" (UID: \"6eff508d-7f75-4036-b13e-8d327128e0bf\") " May 25 23:38:01.617666 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:38:01.617514 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-psjsj\" (UniqueName: \"kubernetes.io/projected/6eff508d-7f75-4036-b13e-8d327128e0bf-kube-api-access-psjsj\") pod \"6eff508d-7f75-4036-b13e-8d327128e0bf\" (UID: \"6eff508d-7f75-4036-b13e-8d327128e0bf\") " May 25 23:38:01.617666 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:38:01.617618 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6eff508d-7f75-4036-b13e-8d327128e0bf-trusted-ca-bundle\") pod \"6eff508d-7f75-4036-b13e-8d327128e0bf\" (UID: \"6eff508d-7f75-4036-b13e-8d327128e0bf\") " May 25 23:38:01.617741 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:38:01.617693 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6eff508d-7f75-4036-b13e-8d327128e0bf-service-ca\") pod \"6eff508d-7f75-4036-b13e-8d327128e0bf\" (UID: \"6eff508d-7f75-4036-b13e-8d327128e0bf\") " May 25 23:38:01.617741 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:38:01.617722 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6eff508d-7f75-4036-b13e-8d327128e0bf-console-oauth-config\") pod \"6eff508d-7f75-4036-b13e-8d327128e0bf\" (UID: \"6eff508d-7f75-4036-b13e-8d327128e0bf\") " May 25 23:38:01.617826 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:38:01.617752 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6eff508d-7f75-4036-b13e-8d327128e0bf-oauth-serving-cert\") pod \"6eff508d-7f75-4036-b13e-8d327128e0bf\" (UID: \"6eff508d-7f75-4036-b13e-8d327128e0bf\") " May 25 23:38:01.617826 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:38:01.617778 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6eff508d-7f75-4036-b13e-8d327128e0bf-console-config\") pod \"6eff508d-7f75-4036-b13e-8d327128e0bf\" (UID: \"6eff508d-7f75-4036-b13e-8d327128e0bf\") " May 25 23:38:01.618102 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:38:01.618061 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6eff508d-7f75-4036-b13e-8d327128e0bf-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6eff508d-7f75-4036-b13e-8d327128e0bf" (UID: "6eff508d-7f75-4036-b13e-8d327128e0bf"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 23:38:01.618218 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:38:01.618112 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6eff508d-7f75-4036-b13e-8d327128e0bf-service-ca" (OuterVolumeSpecName: "service-ca") pod "6eff508d-7f75-4036-b13e-8d327128e0bf" (UID: "6eff508d-7f75-4036-b13e-8d327128e0bf"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 23:38:01.618218 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:38:01.618154 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6eff508d-7f75-4036-b13e-8d327128e0bf-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6eff508d-7f75-4036-b13e-8d327128e0bf" (UID: "6eff508d-7f75-4036-b13e-8d327128e0bf"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 23:38:01.618559 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:38:01.618516 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6eff508d-7f75-4036-b13e-8d327128e0bf-console-config" (OuterVolumeSpecName: "console-config") pod "6eff508d-7f75-4036-b13e-8d327128e0bf" (UID: "6eff508d-7f75-4036-b13e-8d327128e0bf"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 23:38:01.619863 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:38:01.619837 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6eff508d-7f75-4036-b13e-8d327128e0bf-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6eff508d-7f75-4036-b13e-8d327128e0bf" (UID: "6eff508d-7f75-4036-b13e-8d327128e0bf"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 23:38:01.619955 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:38:01.619888 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6eff508d-7f75-4036-b13e-8d327128e0bf-kube-api-access-psjsj" (OuterVolumeSpecName: "kube-api-access-psjsj") pod "6eff508d-7f75-4036-b13e-8d327128e0bf" (UID: "6eff508d-7f75-4036-b13e-8d327128e0bf"). InnerVolumeSpecName "kube-api-access-psjsj". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 25 23:38:01.619955 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:38:01.619930 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6eff508d-7f75-4036-b13e-8d327128e0bf-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6eff508d-7f75-4036-b13e-8d327128e0bf" (UID: "6eff508d-7f75-4036-b13e-8d327128e0bf"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 23:38:01.719203 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:38:01.719166 2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6eff508d-7f75-4036-b13e-8d327128e0bf-console-serving-cert\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:38:01.719203 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:38:01.719202 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-psjsj\" (UniqueName: \"kubernetes.io/projected/6eff508d-7f75-4036-b13e-8d327128e0bf-kube-api-access-psjsj\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:38:01.719403 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:38:01.719217 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6eff508d-7f75-4036-b13e-8d327128e0bf-trusted-ca-bundle\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:38:01.719403 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:38:01.719232 2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6eff508d-7f75-4036-b13e-8d327128e0bf-service-ca\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:38:01.719403 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:38:01.719240 2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6eff508d-7f75-4036-b13e-8d327128e0bf-console-oauth-config\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:38:01.719403 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:38:01.719249 2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6eff508d-7f75-4036-b13e-8d327128e0bf-oauth-serving-cert\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:38:01.719403 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:38:01.719258 2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6eff508d-7f75-4036-b13e-8d327128e0bf-console-config\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:38:02.273877 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:38:02.273846 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6b6d5dc5bb-m8vrh_6eff508d-7f75-4036-b13e-8d327128e0bf/console/0.log" May 25 23:38:02.274343 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:38:02.273897 2560 generic.go:358] "Generic (PLEG): container finished" podID="6eff508d-7f75-4036-b13e-8d327128e0bf" containerID="2adc2666b7db922a91cb5aea084c1bd0606cb7a3faf71c74fe12fb0517d77bfc" exitCode=2 May 25 23:38:02.274343 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:38:02.273976 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b6d5dc5bb-m8vrh" event={"ID":"6eff508d-7f75-4036-b13e-8d327128e0bf","Type":"ContainerDied","Data":"2adc2666b7db922a91cb5aea084c1bd0606cb7a3faf71c74fe12fb0517d77bfc"} May 25 23:38:02.274343 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:38:02.274026 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b6d5dc5bb-m8vrh" May 25 23:38:02.274343 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:38:02.274046 2560 scope.go:117] "RemoveContainer" containerID="2adc2666b7db922a91cb5aea084c1bd0606cb7a3faf71c74fe12fb0517d77bfc" May 25 23:38:02.274343 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:38:02.274032 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b6d5dc5bb-m8vrh" event={"ID":"6eff508d-7f75-4036-b13e-8d327128e0bf","Type":"ContainerDied","Data":"349dda8c62d3dc3b5584d63ac012e13231840fcd506d99fe2889bbb2b84d45c1"} May 25 23:38:02.297565 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:38:02.297521 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b6d5dc5bb-m8vrh"] May 25 23:38:02.301387 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:38:02.301355 2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6b6d5dc5bb-m8vrh"] May 25 23:38:02.545827 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:38:02.545732 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6eff508d-7f75-4036-b13e-8d327128e0bf" path="/var/lib/kubelet/pods/6eff508d-7f75-4036-b13e-8d327128e0bf/volumes" May 25 23:38:03.596024 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:38:03.595838 2560 scope.go:117] "RemoveContainer" containerID="2adc2666b7db922a91cb5aea084c1bd0606cb7a3faf71c74fe12fb0517d77bfc" May 25 23:38:03.596505 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:38:03.596472 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2adc2666b7db922a91cb5aea084c1bd0606cb7a3faf71c74fe12fb0517d77bfc\": container with ID starting with 2adc2666b7db922a91cb5aea084c1bd0606cb7a3faf71c74fe12fb0517d77bfc not found: ID does not exist" containerID="2adc2666b7db922a91cb5aea084c1bd0606cb7a3faf71c74fe12fb0517d77bfc" May 25 23:38:03.596644 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:38:03.596517 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2adc2666b7db922a91cb5aea084c1bd0606cb7a3faf71c74fe12fb0517d77bfc"} err="failed to get container status \"2adc2666b7db922a91cb5aea084c1bd0606cb7a3faf71c74fe12fb0517d77bfc\": rpc error: code = NotFound desc = could not find container \"2adc2666b7db922a91cb5aea084c1bd0606cb7a3faf71c74fe12fb0517d77bfc\": container with ID starting with 2adc2666b7db922a91cb5aea084c1bd0606cb7a3faf71c74fe12fb0517d77bfc not found: ID does not exist" May 25 23:38:04.281636 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:38:04.281593 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dr7pq" event={"ID":"d8801da9-38b0-4cfc-bc00-fbc7cce6ae1a","Type":"ContainerStarted","Data":"ccce8324f9f9f5ec71c6d78b03c54922ef462eba2e2b4eb682de472d7be0622c"} May 25 23:38:04.297670 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:38:04.297579 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-dr7pq" podStartSLOduration=1.622814085 podStartE2EDuration="5.297558569s" podCreationTimestamp="2026-05-25 23:37:59 +0000 UTC" firstStartedPulling="2026-05-25 23:37:59.953377875 +0000 UTC m=+178.032273506" lastFinishedPulling="2026-05-25 23:38:03.628122359 +0000 UTC m=+181.707017990" observedRunningTime="2026-05-25 23:38:04.297126752 +0000 UTC m=+182.376022402" watchObservedRunningTime="2026-05-25 23:38:04.297558569 +0000 UTC m=+182.376454224" May 25 23:38:28.544260 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:38:28.544228 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 25 23:38:28.558023 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:38:28.557979 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 25 23:38:29.367739 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:38:29.367714 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 25 23:40:02.455186 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:40:02.455153 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-czsc7_c028769b-0a8b-4a6e-8572-91c89c7879de/ovn-acl-logging/0.log" May 25 23:40:02.457573 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:40:02.457553 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-czsc7_c028769b-0a8b-4a6e-8572-91c89c7879de/ovn-acl-logging/0.log" May 25 23:40:02.458512 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:40:02.458483 2560 kubelet.go:1628] "Image garbage collection succeeded" May 25 23:41:20.892273 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:20.892240 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b644f4669-f8h28"] May 25 23:41:20.892661 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:20.892502 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6eff508d-7f75-4036-b13e-8d327128e0bf" containerName="console" May 25 23:41:20.892661 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:20.892513 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="6eff508d-7f75-4036-b13e-8d327128e0bf" containerName="console" May 25 23:41:20.892661 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:20.892558 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="6eff508d-7f75-4036-b13e-8d327128e0bf" containerName="console" May 25 23:41:20.895177 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:20.895157 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b644f4669-f8h28" May 25 23:41:20.895702 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:20.895683 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5f3392c6-a3b7-4cc5-8fd2-1c426806baaf-oauth-serving-cert\") pod \"console-7b644f4669-f8h28\" (UID: \"5f3392c6-a3b7-4cc5-8fd2-1c426806baaf\") " pod="openshift-console/console-7b644f4669-f8h28" May 25 23:41:20.895823 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:20.895713 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5f3392c6-a3b7-4cc5-8fd2-1c426806baaf-console-config\") pod \"console-7b644f4669-f8h28\" (UID: \"5f3392c6-a3b7-4cc5-8fd2-1c426806baaf\") " pod="openshift-console/console-7b644f4669-f8h28" May 25 23:41:20.895823 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:20.895743 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5f3392c6-a3b7-4cc5-8fd2-1c426806baaf-console-serving-cert\") pod \"console-7b644f4669-f8h28\" (UID: \"5f3392c6-a3b7-4cc5-8fd2-1c426806baaf\") " pod="openshift-console/console-7b644f4669-f8h28" May 25 23:41:20.895823 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:20.895808 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxn8z\" (UniqueName: \"kubernetes.io/projected/5f3392c6-a3b7-4cc5-8fd2-1c426806baaf-kube-api-access-zxn8z\") pod \"console-7b644f4669-f8h28\" (UID: \"5f3392c6-a3b7-4cc5-8fd2-1c426806baaf\") " pod="openshift-console/console-7b644f4669-f8h28" May 25 23:41:20.895946 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:20.895858 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f3392c6-a3b7-4cc5-8fd2-1c426806baaf-trusted-ca-bundle\") pod \"console-7b644f4669-f8h28\" (UID: \"5f3392c6-a3b7-4cc5-8fd2-1c426806baaf\") " pod="openshift-console/console-7b644f4669-f8h28" May 25 23:41:20.895946 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:20.895900 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5f3392c6-a3b7-4cc5-8fd2-1c426806baaf-console-oauth-config\") pod \"console-7b644f4669-f8h28\" (UID: \"5f3392c6-a3b7-4cc5-8fd2-1c426806baaf\") " pod="openshift-console/console-7b644f4669-f8h28" May 25 23:41:20.895946 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:20.895930 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5f3392c6-a3b7-4cc5-8fd2-1c426806baaf-service-ca\") pod \"console-7b644f4669-f8h28\" (UID: \"5f3392c6-a3b7-4cc5-8fd2-1c426806baaf\") " pod="openshift-console/console-7b644f4669-f8h28" May 25 23:41:20.916669 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:20.916645 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b644f4669-f8h28"] May 25 23:41:20.996848 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:20.996821 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f3392c6-a3b7-4cc5-8fd2-1c426806baaf-trusted-ca-bundle\") pod \"console-7b644f4669-f8h28\" (UID: \"5f3392c6-a3b7-4cc5-8fd2-1c426806baaf\") " pod="openshift-console/console-7b644f4669-f8h28" May 25 23:41:20.996945 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:20.996864 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5f3392c6-a3b7-4cc5-8fd2-1c426806baaf-console-oauth-config\") pod \"console-7b644f4669-f8h28\" (UID: \"5f3392c6-a3b7-4cc5-8fd2-1c426806baaf\") " pod="openshift-console/console-7b644f4669-f8h28" May 25 23:41:20.996945 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:20.996885 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5f3392c6-a3b7-4cc5-8fd2-1c426806baaf-service-ca\") pod \"console-7b644f4669-f8h28\" (UID: \"5f3392c6-a3b7-4cc5-8fd2-1c426806baaf\") " pod="openshift-console/console-7b644f4669-f8h28" May 25 23:41:20.996945 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:20.996902 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5f3392c6-a3b7-4cc5-8fd2-1c426806baaf-oauth-serving-cert\") pod \"console-7b644f4669-f8h28\" (UID: \"5f3392c6-a3b7-4cc5-8fd2-1c426806baaf\") " pod="openshift-console/console-7b644f4669-f8h28" May 25 23:41:20.997138 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:20.997034 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5f3392c6-a3b7-4cc5-8fd2-1c426806baaf-console-config\") pod \"console-7b644f4669-f8h28\" (UID: \"5f3392c6-a3b7-4cc5-8fd2-1c426806baaf\") " pod="openshift-console/console-7b644f4669-f8h28" May 25 23:41:20.997138 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:20.997083 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5f3392c6-a3b7-4cc5-8fd2-1c426806baaf-console-serving-cert\") pod \"console-7b644f4669-f8h28\" (UID: \"5f3392c6-a3b7-4cc5-8fd2-1c426806baaf\") " pod="openshift-console/console-7b644f4669-f8h28" May 25 23:41:20.997138 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:20.997109 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zxn8z\" (UniqueName: \"kubernetes.io/projected/5f3392c6-a3b7-4cc5-8fd2-1c426806baaf-kube-api-access-zxn8z\") pod \"console-7b644f4669-f8h28\" (UID: \"5f3392c6-a3b7-4cc5-8fd2-1c426806baaf\") " pod="openshift-console/console-7b644f4669-f8h28" May 25 23:41:20.997589 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:20.997569 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5f3392c6-a3b7-4cc5-8fd2-1c426806baaf-oauth-serving-cert\") pod \"console-7b644f4669-f8h28\" (UID: \"5f3392c6-a3b7-4cc5-8fd2-1c426806baaf\") " pod="openshift-console/console-7b644f4669-f8h28" May 25 23:41:20.997676 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:20.997602 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5f3392c6-a3b7-4cc5-8fd2-1c426806baaf-service-ca\") pod \"console-7b644f4669-f8h28\" (UID: \"5f3392c6-a3b7-4cc5-8fd2-1c426806baaf\") " pod="openshift-console/console-7b644f4669-f8h28" May 25 23:41:20.997722 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:20.997677 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5f3392c6-a3b7-4cc5-8fd2-1c426806baaf-console-config\") pod \"console-7b644f4669-f8h28\" (UID: \"5f3392c6-a3b7-4cc5-8fd2-1c426806baaf\") " pod="openshift-console/console-7b644f4669-f8h28" May 25 23:41:20.998268 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:20.998247 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f3392c6-a3b7-4cc5-8fd2-1c426806baaf-trusted-ca-bundle\") pod \"console-7b644f4669-f8h28\" (UID: \"5f3392c6-a3b7-4cc5-8fd2-1c426806baaf\") " pod="openshift-console/console-7b644f4669-f8h28" May 25 23:41:20.999267 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:20.999251 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5f3392c6-a3b7-4cc5-8fd2-1c426806baaf-console-oauth-config\") pod \"console-7b644f4669-f8h28\" (UID: \"5f3392c6-a3b7-4cc5-8fd2-1c426806baaf\") " pod="openshift-console/console-7b644f4669-f8h28" May 25 23:41:20.999600 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:20.999584 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5f3392c6-a3b7-4cc5-8fd2-1c426806baaf-console-serving-cert\") pod \"console-7b644f4669-f8h28\" (UID: \"5f3392c6-a3b7-4cc5-8fd2-1c426806baaf\") " pod="openshift-console/console-7b644f4669-f8h28" May 25 23:41:21.005656 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:21.005638 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxn8z\" (UniqueName: \"kubernetes.io/projected/5f3392c6-a3b7-4cc5-8fd2-1c426806baaf-kube-api-access-zxn8z\") pod \"console-7b644f4669-f8h28\" (UID: \"5f3392c6-a3b7-4cc5-8fd2-1c426806baaf\") " pod="openshift-console/console-7b644f4669-f8h28" May 25 23:41:21.203436 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:21.203414 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b644f4669-f8h28" May 25 23:41:21.326712 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:21.326684 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b644f4669-f8h28"] May 25 23:41:21.329759 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:41:21.329730 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f3392c6_a3b7_4cc5_8fd2_1c426806baaf.slice/crio-b60d75769ac3d9456d33f87ef42d6f95c36ade1e2402757c9aafc6036231409c WatchSource:0}: Error finding container b60d75769ac3d9456d33f87ef42d6f95c36ade1e2402757c9aafc6036231409c: Status 404 returned error can't find the container with id b60d75769ac3d9456d33f87ef42d6f95c36ade1e2402757c9aafc6036231409c May 25 23:41:21.331492 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:21.331475 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 25 23:41:21.814063 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:21.814022 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b644f4669-f8h28" event={"ID":"5f3392c6-a3b7-4cc5-8fd2-1c426806baaf","Type":"ContainerStarted","Data":"5e500ae43720912d99f5f38146bc913feac26b5d4541257b53dd7a4d191f6268"} May 25 23:41:21.814063 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:21.814060 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b644f4669-f8h28" event={"ID":"5f3392c6-a3b7-4cc5-8fd2-1c426806baaf","Type":"ContainerStarted","Data":"b60d75769ac3d9456d33f87ef42d6f95c36ade1e2402757c9aafc6036231409c"} May 25 23:41:21.832230 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:21.832180 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7b644f4669-f8h28" podStartSLOduration=1.832162648 podStartE2EDuration="1.832162648s" podCreationTimestamp="2026-05-25 23:41:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 23:41:21.831407414 +0000 UTC m=+379.910303100" watchObservedRunningTime="2026-05-25 23:41:21.832162648 +0000 UTC m=+379.911058300" May 25 23:41:31.203520 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:31.203487 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b644f4669-f8h28" May 25 23:41:31.203870 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:31.203535 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7b644f4669-f8h28" May 25 23:41:31.208008 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:31.207972 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7b644f4669-f8h28" May 25 23:41:31.843822 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:31.843789 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7b644f4669-f8h28" May 25 23:41:31.891125 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:31.891097 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65b89955-xslzb"] May 25 23:41:56.909848 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:56.909792 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-65b89955-xslzb" podUID="716bec8b-680f-4799-a185-8c7c41cb89e8" containerName="console" containerID="cri-o://f66f0e929de337d1fc67c79db5c9cf6b47223fca55cdbf406f6001e318221742" gracePeriod=15 May 25 23:41:57.156612 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:57.156591 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-65b89955-xslzb_716bec8b-680f-4799-a185-8c7c41cb89e8/console/0.log" May 25 23:41:57.156708 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:57.156650 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65b89955-xslzb" May 25 23:41:57.241636 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:57.241614 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/716bec8b-680f-4799-a185-8c7c41cb89e8-console-oauth-config\") pod \"716bec8b-680f-4799-a185-8c7c41cb89e8\" (UID: \"716bec8b-680f-4799-a185-8c7c41cb89e8\") " May 25 23:41:57.241773 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:57.241663 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/716bec8b-680f-4799-a185-8c7c41cb89e8-console-serving-cert\") pod \"716bec8b-680f-4799-a185-8c7c41cb89e8\" (UID: \"716bec8b-680f-4799-a185-8c7c41cb89e8\") " May 25 23:41:57.241773 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:57.241695 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xrjb5\" (UniqueName: \"kubernetes.io/projected/716bec8b-680f-4799-a185-8c7c41cb89e8-kube-api-access-xrjb5\") pod \"716bec8b-680f-4799-a185-8c7c41cb89e8\" (UID: \"716bec8b-680f-4799-a185-8c7c41cb89e8\") " May 25 23:41:57.241773 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:57.241752 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/716bec8b-680f-4799-a185-8c7c41cb89e8-service-ca\") pod \"716bec8b-680f-4799-a185-8c7c41cb89e8\" (UID: \"716bec8b-680f-4799-a185-8c7c41cb89e8\") " May 25 23:41:57.241932 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:57.241796 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/716bec8b-680f-4799-a185-8c7c41cb89e8-oauth-serving-cert\") pod \"716bec8b-680f-4799-a185-8c7c41cb89e8\" (UID: \"716bec8b-680f-4799-a185-8c7c41cb89e8\") " May 25 23:41:57.241932 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:57.241835 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/716bec8b-680f-4799-a185-8c7c41cb89e8-console-config\") pod \"716bec8b-680f-4799-a185-8c7c41cb89e8\" (UID: \"716bec8b-680f-4799-a185-8c7c41cb89e8\") " May 25 23:41:57.242046 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:57.241972 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/716bec8b-680f-4799-a185-8c7c41cb89e8-trusted-ca-bundle\") pod \"716bec8b-680f-4799-a185-8c7c41cb89e8\" (UID: \"716bec8b-680f-4799-a185-8c7c41cb89e8\") " May 25 23:41:57.242252 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:57.242205 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/716bec8b-680f-4799-a185-8c7c41cb89e8-service-ca" (OuterVolumeSpecName: "service-ca") pod "716bec8b-680f-4799-a185-8c7c41cb89e8" (UID: "716bec8b-680f-4799-a185-8c7c41cb89e8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 23:41:57.242252 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:57.242226 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/716bec8b-680f-4799-a185-8c7c41cb89e8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "716bec8b-680f-4799-a185-8c7c41cb89e8" (UID: "716bec8b-680f-4799-a185-8c7c41cb89e8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 23:41:57.242252 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:57.242245 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/716bec8b-680f-4799-a185-8c7c41cb89e8-console-config" (OuterVolumeSpecName: "console-config") pod "716bec8b-680f-4799-a185-8c7c41cb89e8" (UID: "716bec8b-680f-4799-a185-8c7c41cb89e8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 23:41:57.242545 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:57.242527 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/716bec8b-680f-4799-a185-8c7c41cb89e8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "716bec8b-680f-4799-a185-8c7c41cb89e8" (UID: "716bec8b-680f-4799-a185-8c7c41cb89e8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 23:41:57.243969 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:57.243941 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/716bec8b-680f-4799-a185-8c7c41cb89e8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "716bec8b-680f-4799-a185-8c7c41cb89e8" (UID: "716bec8b-680f-4799-a185-8c7c41cb89e8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 23:41:57.244411 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:57.244395 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/716bec8b-680f-4799-a185-8c7c41cb89e8-kube-api-access-xrjb5" (OuterVolumeSpecName: "kube-api-access-xrjb5") pod "716bec8b-680f-4799-a185-8c7c41cb89e8" (UID: "716bec8b-680f-4799-a185-8c7c41cb89e8"). InnerVolumeSpecName "kube-api-access-xrjb5". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 25 23:41:57.244481 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:57.244408 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/716bec8b-680f-4799-a185-8c7c41cb89e8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "716bec8b-680f-4799-a185-8c7c41cb89e8" (UID: "716bec8b-680f-4799-a185-8c7c41cb89e8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 23:41:57.343307 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:57.343283 2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/716bec8b-680f-4799-a185-8c7c41cb89e8-oauth-serving-cert\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:41:57.343307 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:57.343306 2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/716bec8b-680f-4799-a185-8c7c41cb89e8-console-config\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:41:57.343425 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:57.343315 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/716bec8b-680f-4799-a185-8c7c41cb89e8-trusted-ca-bundle\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:41:57.343425 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:57.343323 2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/716bec8b-680f-4799-a185-8c7c41cb89e8-console-oauth-config\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:41:57.343425 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:57.343332 2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/716bec8b-680f-4799-a185-8c7c41cb89e8-console-serving-cert\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:41:57.343425 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:57.343340 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xrjb5\" (UniqueName: \"kubernetes.io/projected/716bec8b-680f-4799-a185-8c7c41cb89e8-kube-api-access-xrjb5\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:41:57.343425 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:57.343348 2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/716bec8b-680f-4799-a185-8c7c41cb89e8-service-ca\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:41:57.910471 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:57.910445 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-65b89955-xslzb_716bec8b-680f-4799-a185-8c7c41cb89e8/console/0.log" May 25 23:41:57.910853 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:57.910488 2560 generic.go:358] "Generic (PLEG): container finished" podID="716bec8b-680f-4799-a185-8c7c41cb89e8" containerID="f66f0e929de337d1fc67c79db5c9cf6b47223fca55cdbf406f6001e318221742" exitCode=2 May 25 23:41:57.910853 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:57.910517 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65b89955-xslzb" event={"ID":"716bec8b-680f-4799-a185-8c7c41cb89e8","Type":"ContainerDied","Data":"f66f0e929de337d1fc67c79db5c9cf6b47223fca55cdbf406f6001e318221742"} May 25 23:41:57.910853 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:57.910546 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65b89955-xslzb" event={"ID":"716bec8b-680f-4799-a185-8c7c41cb89e8","Type":"ContainerDied","Data":"51aff2749074293e52422d80a0920c481f401bef8e6ab9d3065bb8d0216a2c33"} May 25 23:41:57.910853 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:57.910558 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65b89955-xslzb" May 25 23:41:57.910853 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:57.910567 2560 scope.go:117] "RemoveContainer" containerID="f66f0e929de337d1fc67c79db5c9cf6b47223fca55cdbf406f6001e318221742" May 25 23:41:57.918574 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:57.918556 2560 scope.go:117] "RemoveContainer" containerID="f66f0e929de337d1fc67c79db5c9cf6b47223fca55cdbf406f6001e318221742" May 25 23:41:57.918826 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:41:57.918809 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f66f0e929de337d1fc67c79db5c9cf6b47223fca55cdbf406f6001e318221742\": container with ID starting with f66f0e929de337d1fc67c79db5c9cf6b47223fca55cdbf406f6001e318221742 not found: ID does not exist" containerID="f66f0e929de337d1fc67c79db5c9cf6b47223fca55cdbf406f6001e318221742" May 25 23:41:57.918881 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:57.918834 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f66f0e929de337d1fc67c79db5c9cf6b47223fca55cdbf406f6001e318221742"} err="failed to get container status \"f66f0e929de337d1fc67c79db5c9cf6b47223fca55cdbf406f6001e318221742\": rpc error: code = NotFound desc = could not find container \"f66f0e929de337d1fc67c79db5c9cf6b47223fca55cdbf406f6001e318221742\": container with ID starting with f66f0e929de337d1fc67c79db5c9cf6b47223fca55cdbf406f6001e318221742 not found: ID does not exist" May 25 23:41:57.931423 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:57.931401 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65b89955-xslzb"] May 25 23:41:57.935135 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:57.935117 2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-65b89955-xslzb"] May 25 23:41:58.543793 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:41:58.543752 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="716bec8b-680f-4799-a185-8c7c41cb89e8" path="/var/lib/kubelet/pods/716bec8b-680f-4799-a185-8c7c41cb89e8/volumes" May 25 23:45:02.474714 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:45:02.474683 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-czsc7_c028769b-0a8b-4a6e-8572-91c89c7879de/ovn-acl-logging/0.log" May 25 23:45:02.475275 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:45:02.474867 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-czsc7_c028769b-0a8b-4a6e-8572-91c89c7879de/ovn-acl-logging/0.log" May 25 23:48:03.191909 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:48:03.191878 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-test-apply-gpqg9"] May 25 23:48:03.192351 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:48:03.192157 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="716bec8b-680f-4799-a185-8c7c41cb89e8" containerName="console" May 25 23:48:03.192351 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:48:03.192169 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="716bec8b-680f-4799-a185-8c7c41cb89e8" containerName="console" May 25 23:48:03.192351 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:48:03.192225 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="716bec8b-680f-4799-a185-8c7c41cb89e8" containerName="console" May 25 23:48:03.194916 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:48:03.194897 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-gpqg9" May 25 23:48:03.197496 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:48:03.197471 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" May 25 23:48:03.197607 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:48:03.197494 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\"" May 25 23:48:03.197607 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:48:03.197580 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" May 25 23:48:03.198563 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:48:03.198549 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-qlnf6\"" May 25 23:48:03.202358 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:48:03.202340 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-gpqg9"] May 25 23:48:03.286925 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:48:03.286902 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6n5bb\" (UniqueName: \"kubernetes.io/projected/dc9a819e-6bb3-4f77-95f7-4ccf0e392e47-kube-api-access-6n5bb\") pod \"feast-test-apply-gpqg9\" (UID: \"dc9a819e-6bb3-4f77-95f7-4ccf0e392e47\") " pod="test-ns-feast/feast-test-apply-gpqg9" May 25 23:48:03.387197 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:48:03.387170 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6n5bb\" (UniqueName: \"kubernetes.io/projected/dc9a819e-6bb3-4f77-95f7-4ccf0e392e47-kube-api-access-6n5bb\") pod \"feast-test-apply-gpqg9\" (UID: \"dc9a819e-6bb3-4f77-95f7-4ccf0e392e47\") " pod="test-ns-feast/feast-test-apply-gpqg9" May 25 23:48:03.395536 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:48:03.395516 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6n5bb\" (UniqueName: \"kubernetes.io/projected/dc9a819e-6bb3-4f77-95f7-4ccf0e392e47-kube-api-access-6n5bb\") pod \"feast-test-apply-gpqg9\" (UID: \"dc9a819e-6bb3-4f77-95f7-4ccf0e392e47\") " pod="test-ns-feast/feast-test-apply-gpqg9" May 25 23:48:03.517787 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:48:03.517731 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-gpqg9" May 25 23:48:03.639454 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:48:03.639423 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-gpqg9"] May 25 23:48:03.642682 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:48:03.642650 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddc9a819e_6bb3_4f77_95f7_4ccf0e392e47.slice/crio-664e1871522401e6b07b392497b2b32e04ceeacda4b3cb9a6fe616f8f00749e2 WatchSource:0}: Error finding container 664e1871522401e6b07b392497b2b32e04ceeacda4b3cb9a6fe616f8f00749e2: Status 404 returned error can't find the container with id 664e1871522401e6b07b392497b2b32e04ceeacda4b3cb9a6fe616f8f00749e2 May 25 23:48:03.644384 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:48:03.644365 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 25 23:48:03.868030 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:48:03.867967 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-gpqg9" event={"ID":"dc9a819e-6bb3-4f77-95f7-4ccf0e392e47","Type":"ContainerStarted","Data":"664e1871522401e6b07b392497b2b32e04ceeacda4b3cb9a6fe616f8f00749e2"} May 25 23:48:08.884014 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:48:08.883954 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-gpqg9" event={"ID":"dc9a819e-6bb3-4f77-95f7-4ccf0e392e47","Type":"ContainerStarted","Data":"7034dc7085e1a9761ea887f5d9bc45d9e48c2719c04ecefbbf881db3906e6248"} May 25 23:48:15.901894 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:48:15.901860 2560 generic.go:358] "Generic (PLEG): container finished" podID="dc9a819e-6bb3-4f77-95f7-4ccf0e392e47" containerID="7034dc7085e1a9761ea887f5d9bc45d9e48c2719c04ecefbbf881db3906e6248" exitCode=0 May 25 23:48:15.902263 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:48:15.901934 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-gpqg9" event={"ID":"dc9a819e-6bb3-4f77-95f7-4ccf0e392e47","Type":"ContainerDied","Data":"7034dc7085e1a9761ea887f5d9bc45d9e48c2719c04ecefbbf881db3906e6248"} May 25 23:48:16.906353 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:48:16.906321 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-gpqg9" event={"ID":"dc9a819e-6bb3-4f77-95f7-4ccf0e392e47","Type":"ContainerStarted","Data":"f0e7ab91104021226e18f280cac2b63bceadaed5f89a8eeb4354393faba0b5d8"} May 25 23:48:16.924162 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:48:16.924121 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-test-apply-gpqg9" podStartSLOduration=8.9094187 podStartE2EDuration="13.924107239s" podCreationTimestamp="2026-05-25 23:48:03 +0000 UTC" firstStartedPulling="2026-05-25 23:48:03.644493859 +0000 UTC m=+781.723389487" lastFinishedPulling="2026-05-25 23:48:08.659182395 +0000 UTC m=+786.738078026" observedRunningTime="2026-05-25 23:48:16.922796947 +0000 UTC m=+795.001692595" watchObservedRunningTime="2026-05-25 23:48:16.924107239 +0000 UTC m=+795.003002888" May 25 23:48:25.928844 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:48:25.928813 2560 generic.go:358] "Generic (PLEG): container finished" podID="dc9a819e-6bb3-4f77-95f7-4ccf0e392e47" containerID="f0e7ab91104021226e18f280cac2b63bceadaed5f89a8eeb4354393faba0b5d8" exitCode=0 May 25 23:48:25.929254 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:48:25.928888 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-gpqg9" event={"ID":"dc9a819e-6bb3-4f77-95f7-4ccf0e392e47","Type":"ContainerDied","Data":"f0e7ab91104021226e18f280cac2b63bceadaed5f89a8eeb4354393faba0b5d8"} May 25 23:48:27.056614 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:48:27.056593 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-gpqg9" May 25 23:48:27.154915 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:48:27.154887 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6n5bb\" (UniqueName: \"kubernetes.io/projected/dc9a819e-6bb3-4f77-95f7-4ccf0e392e47-kube-api-access-6n5bb\") pod \"dc9a819e-6bb3-4f77-95f7-4ccf0e392e47\" (UID: \"dc9a819e-6bb3-4f77-95f7-4ccf0e392e47\") " May 25 23:48:27.157042 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:48:27.157012 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc9a819e-6bb3-4f77-95f7-4ccf0e392e47-kube-api-access-6n5bb" (OuterVolumeSpecName: "kube-api-access-6n5bb") pod "dc9a819e-6bb3-4f77-95f7-4ccf0e392e47" (UID: "dc9a819e-6bb3-4f77-95f7-4ccf0e392e47"). InnerVolumeSpecName "kube-api-access-6n5bb". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 25 23:48:27.255982 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:48:27.255930 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6n5bb\" (UniqueName: \"kubernetes.io/projected/dc9a819e-6bb3-4f77-95f7-4ccf0e392e47-kube-api-access-6n5bb\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:48:27.935908 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:48:27.935874 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-gpqg9" event={"ID":"dc9a819e-6bb3-4f77-95f7-4ccf0e392e47","Type":"ContainerDied","Data":"664e1871522401e6b07b392497b2b32e04ceeacda4b3cb9a6fe616f8f00749e2"} May 25 23:48:27.935908 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:48:27.935907 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="664e1871522401e6b07b392497b2b32e04ceeacda4b3cb9a6fe616f8f00749e2" May 25 23:48:27.935908 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:48:27.935880 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-gpqg9" May 25 23:48:28.123192 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:48:28.123165 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-gpqg9_dc9a819e-6bb3-4f77-95f7-4ccf0e392e47/feast-0/0.log" May 25 23:48:28.128866 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:48:28.128848 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-gpqg9_dc9a819e-6bb3-4f77-95f7-4ccf0e392e47/feast-1/0.log" May 25 23:49:04.804942 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:49:04.804908 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-test-apply-gpqg9"] May 25 23:49:04.812115 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:49:04.812087 2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-test-apply-gpqg9"] May 25 23:49:06.543589 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:49:06.543552 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc9a819e-6bb3-4f77-95f7-4ccf0e392e47" path="/var/lib/kubelet/pods/dc9a819e-6bb3-4f77-95f7-4ccf0e392e47/volumes" May 25 23:50:02.493468 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:50:02.493392 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-czsc7_c028769b-0a8b-4a6e-8572-91c89c7879de/ovn-acl-logging/0.log" May 25 23:50:02.495176 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:50:02.495156 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-czsc7_c028769b-0a8b-4a6e-8572-91c89c7879de/ovn-acl-logging/0.log" May 25 23:54:20.703739 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:54:20.703712 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr"] May 25 23:54:20.704200 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:54:20.703974 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc9a819e-6bb3-4f77-95f7-4ccf0e392e47" containerName="feast-0" May 25 23:54:20.704200 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:54:20.703984 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc9a819e-6bb3-4f77-95f7-4ccf0e392e47" containerName="feast-0" May 25 23:54:20.704200 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:54:20.704017 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc9a819e-6bb3-4f77-95f7-4ccf0e392e47" containerName="feast-1" May 25 23:54:20.704200 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:54:20.704022 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc9a819e-6bb3-4f77-95f7-4ccf0e392e47" containerName="feast-1" May 25 23:54:20.704200 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:54:20.704068 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="dc9a819e-6bb3-4f77-95f7-4ccf0e392e47" containerName="feast-1" May 25 23:54:20.707971 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:54:20.707953 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" May 25 23:54:20.710433 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:54:20.710407 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\"" May 25 23:54:20.710538 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:54:20.710467 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" May 25 23:54:20.710538 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:54:20.710483 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\"" May 25 23:54:20.710538 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:54:20.710494 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-fpv24\"" May 25 23:54:20.710786 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:54:20.710771 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\"" May 25 23:54:20.710850 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:54:20.710820 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\"" May 25 23:54:20.711481 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:54:20.711465 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" May 25 23:54:20.718212 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:54:20.718193 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr"] May 25 23:54:20.854703 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:54:20.854675 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c9a435fe-819d-420d-a55b-2b0c4856a6b3-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-c2tlr\" (UID: \"c9a435fe-819d-420d-a55b-2b0c4856a6b3\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" May 25 23:54:20.854831 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:54:20.854710 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c9a435fe-819d-420d-a55b-2b0c4856a6b3-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-c2tlr\" (UID: \"c9a435fe-819d-420d-a55b-2b0c4856a6b3\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" May 25 23:54:20.854831 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:54:20.854733 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nq8np\" (UniqueName: \"kubernetes.io/projected/c9a435fe-819d-420d-a55b-2b0c4856a6b3-kube-api-access-nq8np\") pod \"feast-simple-feast-setup-664fcfcc58-c2tlr\" (UID: \"c9a435fe-819d-420d-a55b-2b0c4856a6b3\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" May 25 23:54:20.854916 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:54:20.854826 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c9a435fe-819d-420d-a55b-2b0c4856a6b3-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-c2tlr\" (UID: \"c9a435fe-819d-420d-a55b-2b0c4856a6b3\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" May 25 23:54:20.854916 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:54:20.854862 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c9a435fe-819d-420d-a55b-2b0c4856a6b3-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-c2tlr\" (UID: \"c9a435fe-819d-420d-a55b-2b0c4856a6b3\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" May 25 23:54:20.854916 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:54:20.854888 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c9a435fe-819d-420d-a55b-2b0c4856a6b3-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-c2tlr\" (UID: \"c9a435fe-819d-420d-a55b-2b0c4856a6b3\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" May 25 23:54:20.955341 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:54:20.955271 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c9a435fe-819d-420d-a55b-2b0c4856a6b3-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-c2tlr\" (UID: \"c9a435fe-819d-420d-a55b-2b0c4856a6b3\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" May 25 23:54:20.955341 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:54:20.955300 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nq8np\" (UniqueName: \"kubernetes.io/projected/c9a435fe-819d-420d-a55b-2b0c4856a6b3-kube-api-access-nq8np\") pod \"feast-simple-feast-setup-664fcfcc58-c2tlr\" (UID: \"c9a435fe-819d-420d-a55b-2b0c4856a6b3\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" May 25 23:54:20.955341 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:54:20.955336 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c9a435fe-819d-420d-a55b-2b0c4856a6b3-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-c2tlr\" (UID: \"c9a435fe-819d-420d-a55b-2b0c4856a6b3\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" May 25 23:54:20.955564 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:54:20.955356 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c9a435fe-819d-420d-a55b-2b0c4856a6b3-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-c2tlr\" (UID: \"c9a435fe-819d-420d-a55b-2b0c4856a6b3\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" May 25 23:54:20.955564 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:54:20.955378 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c9a435fe-819d-420d-a55b-2b0c4856a6b3-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-c2tlr\" (UID: \"c9a435fe-819d-420d-a55b-2b0c4856a6b3\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" May 25 23:54:20.955564 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:54:20.955405 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c9a435fe-819d-420d-a55b-2b0c4856a6b3-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-c2tlr\" (UID: \"c9a435fe-819d-420d-a55b-2b0c4856a6b3\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" May 25 23:54:20.955564 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:54:20.955494 2560 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found May 25 23:54:20.955722 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:54:20.955569 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9a435fe-819d-420d-a55b-2b0c4856a6b3-online-tls podName:c9a435fe-819d-420d-a55b-2b0c4856a6b3 nodeName:}" failed. No retries permitted until 2026-05-25 23:54:21.455549136 +0000 UTC m=+1159.534444766 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/c9a435fe-819d-420d-a55b-2b0c4856a6b3-online-tls") pod "feast-simple-feast-setup-664fcfcc58-c2tlr" (UID: "c9a435fe-819d-420d-a55b-2b0c4856a6b3") : secret "feast-simple-feast-setup-online-tls" not found May 25 23:54:20.955833 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:54:20.955814 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c9a435fe-819d-420d-a55b-2b0c4856a6b3-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-c2tlr\" (UID: \"c9a435fe-819d-420d-a55b-2b0c4856a6b3\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" May 25 23:54:20.957858 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:54:20.957832 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c9a435fe-819d-420d-a55b-2b0c4856a6b3-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-c2tlr\" (UID: \"c9a435fe-819d-420d-a55b-2b0c4856a6b3\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" May 25 23:54:20.958004 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:54:20.957968 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c9a435fe-819d-420d-a55b-2b0c4856a6b3-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-c2tlr\" (UID: \"c9a435fe-819d-420d-a55b-2b0c4856a6b3\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" May 25 23:54:20.958053 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:54:20.957968 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c9a435fe-819d-420d-a55b-2b0c4856a6b3-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-c2tlr\" (UID: \"c9a435fe-819d-420d-a55b-2b0c4856a6b3\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" May 25 23:54:20.963552 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:54:20.963532 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nq8np\" (UniqueName: \"kubernetes.io/projected/c9a435fe-819d-420d-a55b-2b0c4856a6b3-kube-api-access-nq8np\") pod \"feast-simple-feast-setup-664fcfcc58-c2tlr\" (UID: \"c9a435fe-819d-420d-a55b-2b0c4856a6b3\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" May 25 23:54:21.458971 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:54:21.458945 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c9a435fe-819d-420d-a55b-2b0c4856a6b3-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-c2tlr\" (UID: \"c9a435fe-819d-420d-a55b-2b0c4856a6b3\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" May 25 23:54:21.461164 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:54:21.461139 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c9a435fe-819d-420d-a55b-2b0c4856a6b3-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-c2tlr\" (UID: \"c9a435fe-819d-420d-a55b-2b0c4856a6b3\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" May 25 23:54:21.625910 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:54:21.625871 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" May 25 23:54:21.757048 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:54:21.757018 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr"] May 25 23:54:21.758197 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:54:21.758173 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc9a435fe_819d_420d_a55b_2b0c4856a6b3.slice/crio-0515c3c153608333034b588cda18117ad6f3b60a6d299a89466527c9e98d9901 WatchSource:0}: Error finding container 0515c3c153608333034b588cda18117ad6f3b60a6d299a89466527c9e98d9901: Status 404 returned error can't find the container with id 0515c3c153608333034b588cda18117ad6f3b60a6d299a89466527c9e98d9901 May 25 23:54:21.759929 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:54:21.759914 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 25 23:54:21.845757 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:54:21.845719 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" event={"ID":"c9a435fe-819d-420d-a55b-2b0c4856a6b3","Type":"ContainerStarted","Data":"0515c3c153608333034b588cda18117ad6f3b60a6d299a89466527c9e98d9901"} May 25 23:54:35.889784 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:54:35.889748 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" event={"ID":"c9a435fe-819d-420d-a55b-2b0c4856a6b3","Type":"ContainerStarted","Data":"91a2968b06cea417611fa1b74cfd9380003ab6295c8cc34224927aa2dde757dd"} May 25 23:54:39.901754 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:54:39.901723 2560 generic.go:358] "Generic (PLEG): container finished" podID="c9a435fe-819d-420d-a55b-2b0c4856a6b3" containerID="91a2968b06cea417611fa1b74cfd9380003ab6295c8cc34224927aa2dde757dd" exitCode=0 May 25 23:54:39.902220 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:54:39.901806 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" event={"ID":"c9a435fe-819d-420d-a55b-2b0c4856a6b3","Type":"ContainerDied","Data":"91a2968b06cea417611fa1b74cfd9380003ab6295c8cc34224927aa2dde757dd"} May 25 23:54:40.906270 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:54:40.906236 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" event={"ID":"c9a435fe-819d-420d-a55b-2b0c4856a6b3","Type":"ContainerStarted","Data":"b63d1e7c7ab515c05cc9fa50d2f8b21b235ea677dd78fd440bb5f148acb03b1d"} May 25 23:54:45.921817 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:54:45.921783 2560 generic.go:358] "Generic (PLEG): container finished" podID="c9a435fe-819d-420d-a55b-2b0c4856a6b3" containerID="b63d1e7c7ab515c05cc9fa50d2f8b21b235ea677dd78fd440bb5f148acb03b1d" exitCode=0 May 25 23:54:45.922201 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:54:45.921847 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" event={"ID":"c9a435fe-819d-420d-a55b-2b0c4856a6b3","Type":"ContainerDied","Data":"b63d1e7c7ab515c05cc9fa50d2f8b21b235ea677dd78fd440bb5f148acb03b1d"} May 25 23:54:46.929358 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:54:46.929309 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" event={"ID":"c9a435fe-819d-420d-a55b-2b0c4856a6b3","Type":"ContainerStarted","Data":"80a8f8bab9cad68a1565ab33bdf3c345b8e073b13dfba0a141a3ce29fd24c7ce"} May 25 23:54:46.929827 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:54:46.929365 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" event={"ID":"c9a435fe-819d-420d-a55b-2b0c4856a6b3","Type":"ContainerStarted","Data":"deb0bbda3b03efcc6f5f7da31edf74aa27827ab1fa05f18b39eb1aaa3aec68b3"} May 25 23:54:46.929827 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:54:46.929381 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" event={"ID":"c9a435fe-819d-420d-a55b-2b0c4856a6b3","Type":"ContainerStarted","Data":"bce23bf7a361ebb10bb15eeaebf67d159c1e151d384780aa39ad5b9ed4676fed"} May 25 23:54:46.929827 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:54:46.929394 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" event={"ID":"c9a435fe-819d-420d-a55b-2b0c4856a6b3","Type":"ContainerStarted","Data":"1bcc767747fd586e2a8a2d718e4db43d479c64a01b8ed8c5fe2b73f8599cd138"} May 25 23:54:46.954787 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:54:46.954726 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" podStartSLOduration=13.811347551 podStartE2EDuration="26.95470628s" podCreationTimestamp="2026-05-25 23:54:20 +0000 UTC" firstStartedPulling="2026-05-25 23:54:21.760054179 +0000 UTC m=+1159.838949807" lastFinishedPulling="2026-05-25 23:54:34.903412907 +0000 UTC m=+1172.982308536" observedRunningTime="2026-05-25 23:54:46.951779323 +0000 UTC m=+1185.030674972" watchObservedRunningTime="2026-05-25 23:54:46.95470628 +0000 UTC m=+1185.033601952" May 25 23:54:48.626354 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:54:48.626119 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" May 25 23:54:48.626354 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:54:48.626167 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" May 25 23:54:48.626354 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:54:48.626181 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" May 25 23:54:48.626922 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:54:48.626637 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" May 25 23:54:48.628475 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:54:48.628380 2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" podUID="c9a435fe-819d-420d-a55b-2b0c4856a6b3" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.23:8816: connect: connection refused" May 25 23:54:48.628475 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:54:48.628410 2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" podUID="c9a435fe-819d-420d-a55b-2b0c4856a6b3" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.23:8443: connect: connection refused" May 25 23:54:48.628475 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:54:48.628421 2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" podUID="c9a435fe-819d-420d-a55b-2b0c4856a6b3" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.23:6571: connect: connection refused" May 25 23:54:48.628706 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:54:48.628494 2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" podUID="c9a435fe-819d-420d-a55b-2b0c4856a6b3" containerName="online" probeResult="failure" output="Get \"https://10.134.0.23:6567/health\": dial tcp 10.134.0.23:6567: connect: connection refused" May 25 23:54:51.626436 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:54:51.626395 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" May 25 23:54:51.626436 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:54:51.626438 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" May 25 23:54:51.626941 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:54:51.626451 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" May 25 23:54:51.626941 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:54:51.626462 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" May 25 23:54:51.627185 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:54:51.627164 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" May 25 23:54:51.627335 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:54:51.627312 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" May 25 23:54:51.627528 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:54:51.627509 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" May 25 23:54:51.631282 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:54:51.631266 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" May 25 23:54:51.949467 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:54:51.949442 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" May 25 23:54:51.949636 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:54:51.949619 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" May 25 23:54:51.950121 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:54:51.950098 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" May 25 23:54:51.951651 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:54:51.951636 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" May 25 23:55:02.515265 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:55:02.515237 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-czsc7_c028769b-0a8b-4a6e-8572-91c89c7879de/ovn-acl-logging/0.log" May 25 23:55:02.516092 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:55:02.516073 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-czsc7_c028769b-0a8b-4a6e-8572-91c89c7879de/ovn-acl-logging/0.log" May 25 23:55:03.670344 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:55:03.670315 2560 scope.go:117] "RemoveContainer" containerID="f0e7ab91104021226e18f280cac2b63bceadaed5f89a8eeb4354393faba0b5d8" May 25 23:55:03.677195 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:55:03.677177 2560 scope.go:117] "RemoveContainer" containerID="7034dc7085e1a9761ea887f5d9bc45d9e48c2719c04ecefbbf881db3906e6248" May 25 23:55:54.061250 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:55:54.061146 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr"] May 25 23:55:54.061863 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:55:54.061809 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" podUID="c9a435fe-819d-420d-a55b-2b0c4856a6b3" containerName="registry" containerID="cri-o://1bcc767747fd586e2a8a2d718e4db43d479c64a01b8ed8c5fe2b73f8599cd138" gracePeriod=30 May 25 23:55:54.062169 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:55:54.061870 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" podUID="c9a435fe-819d-420d-a55b-2b0c4856a6b3" containerName="online" containerID="cri-o://bce23bf7a361ebb10bb15eeaebf67d159c1e151d384780aa39ad5b9ed4676fed" gracePeriod=30 May 25 23:55:54.062169 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:55:54.061869 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" podUID="c9a435fe-819d-420d-a55b-2b0c4856a6b3" containerName="offline" containerID="cri-o://deb0bbda3b03efcc6f5f7da31edf74aa27827ab1fa05f18b39eb1aaa3aec68b3" gracePeriod=30 May 25 23:55:54.062339 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:55:54.061870 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" podUID="c9a435fe-819d-420d-a55b-2b0c4856a6b3" containerName="ui" containerID="cri-o://80a8f8bab9cad68a1565ab33bdf3c345b8e073b13dfba0a141a3ce29fd24c7ce" gracePeriod=30 May 25 23:55:54.457110 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:55:54.457070 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx"] May 25 23:55:54.461595 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:55:54.461574 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" May 25 23:55:54.464140 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:55:54.464119 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-5d422\"" May 25 23:55:54.474900 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:55:54.474872 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx"] May 25 23:55:54.559712 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:55:54.559679 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-jjzsx\" (UID: \"f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" May 25 23:55:54.559887 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:55:54.559719 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-jjzsx\" (UID: \"f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" May 25 23:55:54.559887 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:55:54.559739 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-jjzsx\" (UID: \"f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" May 25 23:55:54.559887 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:55:54.559759 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-jjzsx\" (UID: \"f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" May 25 23:55:54.559887 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:55:54.559823 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fgxr\" (UniqueName: \"kubernetes.io/projected/f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9-kube-api-access-5fgxr\") pod \"feast-simple-feast-setup-664fcfcc58-jjzsx\" (UID: \"f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" May 25 23:55:54.559887 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:55:54.559877 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-jjzsx\" (UID: \"f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" May 25 23:55:54.661044 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:55:54.661010 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-jjzsx\" (UID: \"f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" May 25 23:55:54.661147 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:55:54.661066 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-jjzsx\" (UID: \"f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" May 25 23:55:54.661147 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:55:54.661094 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-jjzsx\" (UID: \"f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" May 25 23:55:54.661147 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:55:54.661136 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5fgxr\" (UniqueName: \"kubernetes.io/projected/f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9-kube-api-access-5fgxr\") pod \"feast-simple-feast-setup-664fcfcc58-jjzsx\" (UID: \"f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" May 25 23:55:54.661325 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:55:54.661208 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-jjzsx\" (UID: \"f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" May 25 23:55:54.661325 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:55:54.661251 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-jjzsx\" (UID: \"f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" May 25 23:55:54.661325 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:55:54.661268 2560 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found May 25 23:55:54.661478 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:55:54.661383 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9-online-tls podName:f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9 nodeName:}" failed. No retries permitted until 2026-05-25 23:55:55.161359322 +0000 UTC m=+1253.240254957 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9-online-tls") pod "feast-simple-feast-setup-664fcfcc58-jjzsx" (UID: "f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9") : secret "feast-simple-feast-setup-online-tls" not found May 25 23:55:54.661965 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:55:54.661848 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-jjzsx\" (UID: \"f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" May 25 23:55:54.664061 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:55:54.664036 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-jjzsx\" (UID: \"f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" May 25 23:55:54.664173 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:55:54.664113 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-jjzsx\" (UID: \"f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" May 25 23:55:54.664226 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:55:54.664174 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-jjzsx\" (UID: \"f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" May 25 23:55:54.673822 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:55:54.673805 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fgxr\" (UniqueName: \"kubernetes.io/projected/f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9-kube-api-access-5fgxr\") pod \"feast-simple-feast-setup-664fcfcc58-jjzsx\" (UID: \"f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" May 25 23:55:55.120076 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:55:55.120048 2560 generic.go:358] "Generic (PLEG): container finished" podID="c9a435fe-819d-420d-a55b-2b0c4856a6b3" containerID="80a8f8bab9cad68a1565ab33bdf3c345b8e073b13dfba0a141a3ce29fd24c7ce" exitCode=0 May 25 23:55:55.120076 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:55:55.120071 2560 generic.go:358] "Generic (PLEG): container finished" podID="c9a435fe-819d-420d-a55b-2b0c4856a6b3" containerID="bce23bf7a361ebb10bb15eeaebf67d159c1e151d384780aa39ad5b9ed4676fed" exitCode=0 May 25 23:55:55.120441 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:55:55.120089 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" event={"ID":"c9a435fe-819d-420d-a55b-2b0c4856a6b3","Type":"ContainerDied","Data":"80a8f8bab9cad68a1565ab33bdf3c345b8e073b13dfba0a141a3ce29fd24c7ce"} May 25 23:55:55.120441 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:55:55.120109 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" event={"ID":"c9a435fe-819d-420d-a55b-2b0c4856a6b3","Type":"ContainerDied","Data":"bce23bf7a361ebb10bb15eeaebf67d159c1e151d384780aa39ad5b9ed4676fed"} May 25 23:55:55.165185 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:55:55.165156 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-jjzsx\" (UID: \"f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" May 25 23:55:55.167493 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:55:55.167476 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-jjzsx\" (UID: \"f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" May 25 23:55:55.377597 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:55:55.377536 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" May 25 23:55:55.507647 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:55:55.507607 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx"] May 25 23:55:55.509794 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:55:55.509759 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf1bd7e1e_b92c_41f0_840e_b0fe1b3d4fe9.slice/crio-28ab429a0273530bd9bca86306c517337668cff5fb48343f9772eeb7be71c3de WatchSource:0}: Error finding container 28ab429a0273530bd9bca86306c517337668cff5fb48343f9772eeb7be71c3de: Status 404 returned error can't find the container with id 28ab429a0273530bd9bca86306c517337668cff5fb48343f9772eeb7be71c3de May 25 23:55:56.124218 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:55:56.124183 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" event={"ID":"f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9","Type":"ContainerStarted","Data":"0ac4db333114f63f9be5fdfdf1c41043a20c8907eee1040e0ae92c3bfdb7ffd4"} May 25 23:55:56.124218 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:55:56.124221 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" event={"ID":"f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9","Type":"ContainerStarted","Data":"28ab429a0273530bd9bca86306c517337668cff5fb48343f9772eeb7be71c3de"} May 25 23:56:00.136104 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:00.136064 2560 generic.go:358] "Generic (PLEG): container finished" podID="f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9" containerID="0ac4db333114f63f9be5fdfdf1c41043a20c8907eee1040e0ae92c3bfdb7ffd4" exitCode=0 May 25 23:56:00.136546 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:00.136135 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" event={"ID":"f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9","Type":"ContainerDied","Data":"0ac4db333114f63f9be5fdfdf1c41043a20c8907eee1040e0ae92c3bfdb7ffd4"} May 25 23:56:01.141224 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:01.141190 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" event={"ID":"f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9","Type":"ContainerStarted","Data":"e4f11c9726120d1b0c5552241f205955f9a56433ef565d086986b81f1c3d89b8"} May 25 23:56:01.950125 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:01.950079 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" podUID="c9a435fe-819d-420d-a55b-2b0c4856a6b3" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.23:8443: connect: connection refused" May 25 23:56:01.950125 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:01.950100 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" podUID="c9a435fe-819d-420d-a55b-2b0c4856a6b3" containerName="online" probeResult="failure" output="Get \"https://10.134.0.23:6567/health\": dial tcp 10.134.0.23:6567: connect: connection refused" May 25 23:56:06.155584 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:06.155546 2560 generic.go:358] "Generic (PLEG): container finished" podID="f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9" containerID="e4f11c9726120d1b0c5552241f205955f9a56433ef565d086986b81f1c3d89b8" exitCode=0 May 25 23:56:06.155970 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:06.155607 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" event={"ID":"f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9","Type":"ContainerDied","Data":"e4f11c9726120d1b0c5552241f205955f9a56433ef565d086986b81f1c3d89b8"} May 25 23:56:07.163331 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:07.163287 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" event={"ID":"f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9","Type":"ContainerStarted","Data":"6bf3efbd6893f4b86c0cedfd14cb8cbe37102a29aac409d60095df78c1287b0b"} May 25 23:56:07.163816 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:07.163340 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" event={"ID":"f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9","Type":"ContainerStarted","Data":"274f845be5465946799cf42012ed8d8d6d349f3fbfc32aa3e55e333e3781293b"} May 25 23:56:07.163816 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:07.163356 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" event={"ID":"f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9","Type":"ContainerStarted","Data":"d968e018c9dbd512840b5036f4ccef410c04ec9ae5fc5b506f053cb2ebe54d2e"} May 25 23:56:07.163816 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:07.163368 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" event={"ID":"f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9","Type":"ContainerStarted","Data":"bd11d66579794b01b63520f20d94d8f9b70d95c65872e65d12fbb769f8fc3874"} May 25 23:56:07.190412 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:07.190354 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" podStartSLOduration=13.190333031 podStartE2EDuration="13.190333031s" podCreationTimestamp="2026-05-25 23:55:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 23:56:07.189255613 +0000 UTC m=+1265.268151299" watchObservedRunningTime="2026-05-25 23:56:07.190333031 +0000 UTC m=+1265.269228682" May 25 23:56:07.378031 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:07.377944 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" May 25 23:56:07.378031 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:07.378015 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" May 25 23:56:07.378031 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:07.378033 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" May 25 23:56:07.378342 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:07.378046 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" May 25 23:56:07.380215 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:07.380175 2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" podUID="f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.24:8816: connect: connection refused" May 25 23:56:07.380348 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:07.380208 2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" podUID="f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.24:8443: connect: connection refused" May 25 23:56:07.380348 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:07.380224 2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" podUID="f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9" containerName="online" probeResult="failure" output="Get \"https://10.134.0.24:6567/health\": dial tcp 10.134.0.24:6567: connect: connection refused" May 25 23:56:07.380348 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:07.380307 2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" podUID="f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.24:6571: connect: connection refused" May 25 23:56:10.378693 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:10.378635 2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" podUID="f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9" containerName="online" probeResult="failure" output="Get \"https://10.134.0.24:6567/health\": dial tcp 10.134.0.24:6567: connect: connection refused" May 25 23:56:10.378693 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:10.378656 2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" podUID="f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.24:8816: connect: connection refused" May 25 23:56:10.379264 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:10.378635 2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" podUID="f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.24:8443: connect: connection refused" May 25 23:56:10.379264 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:10.378658 2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" podUID="f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.24:6571: connect: connection refused" May 25 23:56:11.950115 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:11.950072 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" podUID="c9a435fe-819d-420d-a55b-2b0c4856a6b3" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.23:8443: connect: connection refused" May 25 23:56:11.950533 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:11.950147 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" podUID="c9a435fe-819d-420d-a55b-2b0c4856a6b3" containerName="online" probeResult="failure" output="Get \"https://10.134.0.23:6567/health\": dial tcp 10.134.0.23:6567: connect: connection refused" May 25 23:56:13.378976 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:13.378934 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" May 25 23:56:13.379540 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:13.379519 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" May 25 23:56:13.379619 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:13.379549 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" May 25 23:56:13.379700 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:13.379688 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" May 25 23:56:13.379740 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:13.379726 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" May 25 23:56:13.383388 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:13.383371 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" May 25 23:56:14.185400 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:14.185374 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" May 25 23:56:14.185574 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:14.185437 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" May 25 23:56:14.185574 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:14.185453 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" May 25 23:56:14.185779 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:14.185757 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" May 25 23:56:14.186072 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:14.186055 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" May 25 23:56:14.188179 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:14.188159 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" May 25 23:56:21.949177 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:21.949133 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" podUID="c9a435fe-819d-420d-a55b-2b0c4856a6b3" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.23:8443: connect: connection refused" May 25 23:56:21.949609 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:21.949147 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" podUID="c9a435fe-819d-420d-a55b-2b0c4856a6b3" containerName="online" probeResult="failure" output="Get \"https://10.134.0.23:6567/health\": dial tcp 10.134.0.23:6567: connect: connection refused" May 25 23:56:21.949609 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:21.949277 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" May 25 23:56:21.949609 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:21.949332 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" May 25 23:56:24.215809 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:24.215774 2560 generic.go:358] "Generic (PLEG): container finished" podID="c9a435fe-819d-420d-a55b-2b0c4856a6b3" containerID="deb0bbda3b03efcc6f5f7da31edf74aa27827ab1fa05f18b39eb1aaa3aec68b3" exitCode=137 May 25 23:56:24.215809 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:24.215796 2560 generic.go:358] "Generic (PLEG): container finished" podID="c9a435fe-819d-420d-a55b-2b0c4856a6b3" containerID="1bcc767747fd586e2a8a2d718e4db43d479c64a01b8ed8c5fe2b73f8599cd138" exitCode=137 May 25 23:56:24.216146 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:24.215837 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" event={"ID":"c9a435fe-819d-420d-a55b-2b0c4856a6b3","Type":"ContainerDied","Data":"deb0bbda3b03efcc6f5f7da31edf74aa27827ab1fa05f18b39eb1aaa3aec68b3"} May 25 23:56:24.216146 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:24.215869 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" event={"ID":"c9a435fe-819d-420d-a55b-2b0c4856a6b3","Type":"ContainerDied","Data":"1bcc767747fd586e2a8a2d718e4db43d479c64a01b8ed8c5fe2b73f8599cd138"} May 25 23:56:24.694666 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:24.694645 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" May 25 23:56:24.798439 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:24.798412 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c9a435fe-819d-420d-a55b-2b0c4856a6b3-ui-tls\") pod \"c9a435fe-819d-420d-a55b-2b0c4856a6b3\" (UID: \"c9a435fe-819d-420d-a55b-2b0c4856a6b3\") " May 25 23:56:24.798558 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:24.798447 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c9a435fe-819d-420d-a55b-2b0c4856a6b3-feast-data\") pod \"c9a435fe-819d-420d-a55b-2b0c4856a6b3\" (UID: \"c9a435fe-819d-420d-a55b-2b0c4856a6b3\") " May 25 23:56:24.798558 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:24.798485 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c9a435fe-819d-420d-a55b-2b0c4856a6b3-registry-tls\") pod \"c9a435fe-819d-420d-a55b-2b0c4856a6b3\" (UID: \"c9a435fe-819d-420d-a55b-2b0c4856a6b3\") " May 25 23:56:24.798682 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:24.798656 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c9a435fe-819d-420d-a55b-2b0c4856a6b3-offline-tls\") pod \"c9a435fe-819d-420d-a55b-2b0c4856a6b3\" (UID: \"c9a435fe-819d-420d-a55b-2b0c4856a6b3\") " May 25 23:56:24.798770 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:24.798754 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nq8np\" (UniqueName: \"kubernetes.io/projected/c9a435fe-819d-420d-a55b-2b0c4856a6b3-kube-api-access-nq8np\") pod \"c9a435fe-819d-420d-a55b-2b0c4856a6b3\" (UID: \"c9a435fe-819d-420d-a55b-2b0c4856a6b3\") " May 25 23:56:24.798827 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:24.798799 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c9a435fe-819d-420d-a55b-2b0c4856a6b3-online-tls\") pod \"c9a435fe-819d-420d-a55b-2b0c4856a6b3\" (UID: \"c9a435fe-819d-420d-a55b-2b0c4856a6b3\") " May 25 23:56:24.798965 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:24.798929 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9a435fe-819d-420d-a55b-2b0c4856a6b3-feast-data" (OuterVolumeSpecName: "feast-data") pod "c9a435fe-819d-420d-a55b-2b0c4856a6b3" (UID: "c9a435fe-819d-420d-a55b-2b0c4856a6b3"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 25 23:56:24.799099 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:24.799077 2560 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c9a435fe-819d-420d-a55b-2b0c4856a6b3-feast-data\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:56:24.800894 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:24.800863 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9a435fe-819d-420d-a55b-2b0c4856a6b3-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "c9a435fe-819d-420d-a55b-2b0c4856a6b3" (UID: "c9a435fe-819d-420d-a55b-2b0c4856a6b3"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 23:56:24.800894 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:24.800878 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9a435fe-819d-420d-a55b-2b0c4856a6b3-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c9a435fe-819d-420d-a55b-2b0c4856a6b3" (UID: "c9a435fe-819d-420d-a55b-2b0c4856a6b3"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 23:56:24.801068 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:24.800975 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9a435fe-819d-420d-a55b-2b0c4856a6b3-kube-api-access-nq8np" (OuterVolumeSpecName: "kube-api-access-nq8np") pod "c9a435fe-819d-420d-a55b-2b0c4856a6b3" (UID: "c9a435fe-819d-420d-a55b-2b0c4856a6b3"). InnerVolumeSpecName "kube-api-access-nq8np". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 25 23:56:24.801241 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:24.801222 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9a435fe-819d-420d-a55b-2b0c4856a6b3-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "c9a435fe-819d-420d-a55b-2b0c4856a6b3" (UID: "c9a435fe-819d-420d-a55b-2b0c4856a6b3"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 23:56:24.801354 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:24.801340 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9a435fe-819d-420d-a55b-2b0c4856a6b3-online-tls" (OuterVolumeSpecName: "online-tls") pod "c9a435fe-819d-420d-a55b-2b0c4856a6b3" (UID: "c9a435fe-819d-420d-a55b-2b0c4856a6b3"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 23:56:24.899407 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:24.899355 2560 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c9a435fe-819d-420d-a55b-2b0c4856a6b3-offline-tls\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:56:24.899407 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:24.899377 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nq8np\" (UniqueName: \"kubernetes.io/projected/c9a435fe-819d-420d-a55b-2b0c4856a6b3-kube-api-access-nq8np\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:56:24.899407 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:24.899386 2560 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c9a435fe-819d-420d-a55b-2b0c4856a6b3-online-tls\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:56:24.899407 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:24.899396 2560 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c9a435fe-819d-420d-a55b-2b0c4856a6b3-ui-tls\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:56:24.899407 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:24.899405 2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c9a435fe-819d-420d-a55b-2b0c4856a6b3-registry-tls\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:56:25.221183 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:25.221153 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" event={"ID":"c9a435fe-819d-420d-a55b-2b0c4856a6b3","Type":"ContainerDied","Data":"0515c3c153608333034b588cda18117ad6f3b60a6d299a89466527c9e98d9901"} May 25 23:56:25.221565 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:25.221186 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr" May 25 23:56:25.221565 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:25.221192 2560 scope.go:117] "RemoveContainer" containerID="80a8f8bab9cad68a1565ab33bdf3c345b8e073b13dfba0a141a3ce29fd24c7ce" May 25 23:56:25.229492 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:25.229475 2560 scope.go:117] "RemoveContainer" containerID="deb0bbda3b03efcc6f5f7da31edf74aa27827ab1fa05f18b39eb1aaa3aec68b3" May 25 23:56:25.236456 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:25.236429 2560 scope.go:117] "RemoveContainer" containerID="bce23bf7a361ebb10bb15eeaebf67d159c1e151d384780aa39ad5b9ed4676fed" May 25 23:56:25.243254 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:25.243235 2560 scope.go:117] "RemoveContainer" containerID="1bcc767747fd586e2a8a2d718e4db43d479c64a01b8ed8c5fe2b73f8599cd138" May 25 23:56:25.244511 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:25.244484 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr"] May 25 23:56:25.251541 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:25.251515 2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-c2tlr"] May 25 23:56:25.253050 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:25.253032 2560 scope.go:117] "RemoveContainer" containerID="b63d1e7c7ab515c05cc9fa50d2f8b21b235ea677dd78fd440bb5f148acb03b1d" May 25 23:56:25.259798 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:25.259782 2560 scope.go:117] "RemoveContainer" containerID="91a2968b06cea417611fa1b74cfd9380003ab6295c8cc34224927aa2dde757dd" May 25 23:56:26.544421 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:56:26.544377 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9a435fe-819d-420d-a55b-2b0c4856a6b3" path="/var/lib/kubelet/pods/c9a435fe-819d-420d-a55b-2b0c4856a6b3/volumes" May 25 23:57:16.084178 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:16.084148 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rtxsw"] May 25 23:57:16.084636 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:16.084429 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9a435fe-819d-420d-a55b-2b0c4856a6b3" containerName="ui" May 25 23:57:16.084636 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:16.084440 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9a435fe-819d-420d-a55b-2b0c4856a6b3" containerName="ui" May 25 23:57:16.084636 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:16.084460 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9a435fe-819d-420d-a55b-2b0c4856a6b3" containerName="feast-init" May 25 23:57:16.084636 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:16.084466 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9a435fe-819d-420d-a55b-2b0c4856a6b3" containerName="feast-init" May 25 23:57:16.084636 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:16.084478 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9a435fe-819d-420d-a55b-2b0c4856a6b3" containerName="registry" May 25 23:57:16.084636 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:16.084486 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9a435fe-819d-420d-a55b-2b0c4856a6b3" containerName="registry" May 25 23:57:16.084636 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:16.084494 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9a435fe-819d-420d-a55b-2b0c4856a6b3" containerName="feast-apply" May 25 23:57:16.084636 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:16.084499 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9a435fe-819d-420d-a55b-2b0c4856a6b3" containerName="feast-apply" May 25 23:57:16.084636 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:16.084505 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9a435fe-819d-420d-a55b-2b0c4856a6b3" containerName="online" May 25 23:57:16.084636 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:16.084509 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9a435fe-819d-420d-a55b-2b0c4856a6b3" containerName="online" May 25 23:57:16.084636 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:16.084518 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9a435fe-819d-420d-a55b-2b0c4856a6b3" containerName="offline" May 25 23:57:16.084636 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:16.084523 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9a435fe-819d-420d-a55b-2b0c4856a6b3" containerName="offline" May 25 23:57:16.084636 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:16.084563 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="c9a435fe-819d-420d-a55b-2b0c4856a6b3" containerName="offline" May 25 23:57:16.084636 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:16.084570 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="c9a435fe-819d-420d-a55b-2b0c4856a6b3" containerName="online" May 25 23:57:16.084636 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:16.084577 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="c9a435fe-819d-420d-a55b-2b0c4856a6b3" containerName="ui" May 25 23:57:16.084636 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:16.084586 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="c9a435fe-819d-420d-a55b-2b0c4856a6b3" containerName="registry" May 25 23:57:16.088924 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:16.088910 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rtxsw" May 25 23:57:16.091451 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:16.091428 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\"" May 25 23:57:16.091451 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:16.091428 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\"" May 25 23:57:16.091796 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:16.091771 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-nwvbg\"" May 25 23:57:16.091796 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:16.091791 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\"" May 25 23:57:16.091918 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:16.091810 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\"" May 25 23:57:16.091918 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:16.091826 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\"" May 25 23:57:16.091918 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:16.091832 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\"" May 25 23:57:16.097551 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:16.097530 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rtxsw"] May 25 23:57:16.152374 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:16.152345 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-rtxsw\" (UID: \"9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rtxsw" May 25 23:57:16.152483 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:16.152387 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-rtxsw\" (UID: \"9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rtxsw" May 25 23:57:16.152483 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:16.152418 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrqch\" (UniqueName: \"kubernetes.io/projected/9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35-kube-api-access-qrqch\") pod \"feast-simple-feast-remote-setup-5cff94746b-rtxsw\" (UID: \"9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rtxsw" May 25 23:57:16.152483 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:16.152477 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-rtxsw\" (UID: \"9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rtxsw" May 25 23:57:16.152597 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:16.152524 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-rtxsw\" (UID: \"9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rtxsw" May 25 23:57:16.152597 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:16.152561 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-rtxsw\" (UID: \"9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rtxsw" May 25 23:57:16.253645 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:16.253626 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-rtxsw\" (UID: \"9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rtxsw" May 25 23:57:16.253754 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:16.253655 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-rtxsw\" (UID: \"9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rtxsw" May 25 23:57:16.253754 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:16.253676 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qrqch\" (UniqueName: \"kubernetes.io/projected/9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35-kube-api-access-qrqch\") pod \"feast-simple-feast-remote-setup-5cff94746b-rtxsw\" (UID: \"9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rtxsw" May 25 23:57:16.253754 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:16.253695 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-rtxsw\" (UID: \"9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rtxsw" May 25 23:57:16.253754 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:16.253721 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-rtxsw\" (UID: \"9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rtxsw" May 25 23:57:16.253754 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:16.253750 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-rtxsw\" (UID: \"9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rtxsw" May 25 23:57:16.254024 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:57:16.253818 2560 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-online-tls: secret "feast-simple-feast-remote-setup-online-tls" not found May 25 23:57:16.254024 ip-10-0-134-170 kubenswrapper[2560]: E0525 23:57:16.253896 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35-online-tls podName:9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35 nodeName:}" failed. No retries permitted until 2026-05-25 23:57:16.753875984 +0000 UTC m=+1334.832771632 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35-online-tls") pod "feast-simple-feast-remote-setup-5cff94746b-rtxsw" (UID: "9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35") : secret "feast-simple-feast-remote-setup-online-tls" not found May 25 23:57:16.254130 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:16.254076 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-rtxsw\" (UID: \"9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rtxsw" May 25 23:57:16.254317 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:16.254299 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-rtxsw\" (UID: \"9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rtxsw" May 25 23:57:16.256190 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:16.256174 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-rtxsw\" (UID: \"9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rtxsw" May 25 23:57:16.256257 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:16.256224 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-rtxsw\" (UID: \"9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rtxsw" May 25 23:57:16.262357 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:16.262339 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrqch\" (UniqueName: \"kubernetes.io/projected/9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35-kube-api-access-qrqch\") pod \"feast-simple-feast-remote-setup-5cff94746b-rtxsw\" (UID: \"9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rtxsw" May 25 23:57:16.756779 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:16.756753 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-rtxsw\" (UID: \"9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rtxsw" May 25 23:57:16.759134 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:16.759116 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-rtxsw\" (UID: \"9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rtxsw" May 25 23:57:16.998749 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:16.998714 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rtxsw" May 25 23:57:17.153051 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:17.153024 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rtxsw"] May 25 23:57:17.155577 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:57:17.155554 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9a9621b3_cda7_42eb_9b6d_b9d8a8db2d35.slice/crio-4ed9ce199ab806573437cacdbbfc42ab7076a615d2530ffd70431d452160d469 WatchSource:0}: Error finding container 4ed9ce199ab806573437cacdbbfc42ab7076a615d2530ffd70431d452160d469: Status 404 returned error can't find the container with id 4ed9ce199ab806573437cacdbbfc42ab7076a615d2530ffd70431d452160d469 May 25 23:57:17.374483 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:17.373743 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rtxsw" event={"ID":"9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35","Type":"ContainerStarted","Data":"e400d555ff2e0cf3c2d296ec4871c85dad16400572df68481ef6f43f8df1fb2c"} May 25 23:57:17.374483 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:17.373784 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rtxsw" event={"ID":"9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35","Type":"ContainerStarted","Data":"4ed9ce199ab806573437cacdbbfc42ab7076a615d2530ffd70431d452160d469"} May 25 23:57:22.390287 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:22.390253 2560 generic.go:358] "Generic (PLEG): container finished" podID="9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35" containerID="e400d555ff2e0cf3c2d296ec4871c85dad16400572df68481ef6f43f8df1fb2c" exitCode=0 May 25 23:57:22.390638 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:22.390300 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rtxsw" event={"ID":"9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35","Type":"ContainerDied","Data":"e400d555ff2e0cf3c2d296ec4871c85dad16400572df68481ef6f43f8df1fb2c"} May 25 23:57:23.395098 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:23.395064 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rtxsw" event={"ID":"9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35","Type":"ContainerStarted","Data":"873510ffe1552773792e7b23a5d387f0f77bf08eeb72dd67eb3a7f62af354588"} May 25 23:57:28.416833 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:28.416802 2560 generic.go:358] "Generic (PLEG): container finished" podID="9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35" containerID="873510ffe1552773792e7b23a5d387f0f77bf08eeb72dd67eb3a7f62af354588" exitCode=0 May 25 23:57:28.417205 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:28.416853 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rtxsw" event={"ID":"9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35","Type":"ContainerDied","Data":"873510ffe1552773792e7b23a5d387f0f77bf08eeb72dd67eb3a7f62af354588"} May 25 23:57:29.424011 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:29.423958 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rtxsw" event={"ID":"9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35","Type":"ContainerStarted","Data":"21c68d6ada371500d68016e98c0c95b74df69506b3b7f558030073686b3ccea4"} May 25 23:57:29.424395 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:29.424023 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rtxsw" event={"ID":"9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35","Type":"ContainerStarted","Data":"913697c94fdcb4948f20cf51587ddf0e0bc164ae75cf93507ff6bd4ce867fbb3"} May 25 23:57:29.424395 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:29.424038 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rtxsw" event={"ID":"9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35","Type":"ContainerStarted","Data":"773f9eaf38f6c8f44eb55bef08f3817344fe11227f04dc042515774e204de9ba"} May 25 23:57:29.452300 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:29.452253 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rtxsw" podStartSLOduration=13.452239222 podStartE2EDuration="13.452239222s" podCreationTimestamp="2026-05-25 23:57:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 23:57:29.451282672 +0000 UTC m=+1347.530178372" watchObservedRunningTime="2026-05-25 23:57:29.452239222 +0000 UTC m=+1347.531134853" May 25 23:57:31.999517 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:31.999477 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rtxsw" May 25 23:57:32.000017 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:31.999530 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rtxsw" May 25 23:57:32.000017 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:31.999544 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rtxsw" May 25 23:57:32.001191 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:32.001156 2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rtxsw" podUID="9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.25:8443: connect: connection refused" May 25 23:57:32.001301 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:32.001202 2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rtxsw" podUID="9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.25:8816: connect: connection refused" May 25 23:57:32.001301 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:32.001237 2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rtxsw" podUID="9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35" containerName="online" probeResult="failure" output="Get \"https://10.134.0.25:6567/health\": dial tcp 10.134.0.25:6567: connect: connection refused" May 25 23:57:35.000215 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:35.000187 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rtxsw" May 25 23:57:35.000641 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:35.000301 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rtxsw" May 25 23:57:35.000714 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:35.000688 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rtxsw" May 25 23:57:35.000771 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:35.000722 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rtxsw" May 25 23:57:35.000982 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:35.000959 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rtxsw" May 25 23:57:35.001093 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:35.001084 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rtxsw" May 25 23:57:35.004042 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:35.004028 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rtxsw" May 25 23:57:35.445515 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:35.445486 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rtxsw" May 25 23:57:35.448230 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:57:35.448209 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rtxsw" May 25 23:58:37.399977 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:58:37.399941 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rtxsw"] May 25 23:58:37.400499 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:58:37.400375 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rtxsw" podUID="9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35" containerName="online" containerID="cri-o://773f9eaf38f6c8f44eb55bef08f3817344fe11227f04dc042515774e204de9ba" gracePeriod=30 May 25 23:58:37.400499 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:58:37.400435 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rtxsw" podUID="9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35" containerName="offline" containerID="cri-o://913697c94fdcb4948f20cf51587ddf0e0bc164ae75cf93507ff6bd4ce867fbb3" gracePeriod=30 May 25 23:58:37.400499 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:58:37.400465 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rtxsw" podUID="9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35" containerName="ui" containerID="cri-o://21c68d6ada371500d68016e98c0c95b74df69506b3b7f558030073686b3ccea4" gracePeriod=30 May 25 23:58:37.540845 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:58:37.540813 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx"] May 25 23:58:37.541347 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:58:37.541290 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" podUID="f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9" containerName="registry" containerID="cri-o://bd11d66579794b01b63520f20d94d8f9b70d95c65872e65d12fbb769f8fc3874" gracePeriod=30 May 25 23:58:37.541468 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:58:37.541379 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" podUID="f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9" containerName="offline" containerID="cri-o://274f845be5465946799cf42012ed8d8d6d349f3fbfc32aa3e55e333e3781293b" gracePeriod=30 May 25 23:58:37.541468 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:58:37.541398 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" podUID="f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9" containerName="online" containerID="cri-o://d968e018c9dbd512840b5036f4ccef410c04ec9ae5fc5b506f053cb2ebe54d2e" gracePeriod=30 May 25 23:58:37.541606 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:58:37.541483 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" podUID="f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9" containerName="ui" containerID="cri-o://6bf3efbd6893f4b86c0cedfd14cb8cbe37102a29aac409d60095df78c1287b0b" gracePeriod=30 May 25 23:58:38.616910 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:58:38.616877 2560 generic.go:358] "Generic (PLEG): container finished" podID="9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35" containerID="21c68d6ada371500d68016e98c0c95b74df69506b3b7f558030073686b3ccea4" exitCode=0 May 25 23:58:38.616910 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:58:38.616905 2560 generic.go:358] "Generic (PLEG): container finished" podID="9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35" containerID="773f9eaf38f6c8f44eb55bef08f3817344fe11227f04dc042515774e204de9ba" exitCode=0 May 25 23:58:38.617337 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:58:38.616959 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rtxsw" event={"ID":"9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35","Type":"ContainerDied","Data":"21c68d6ada371500d68016e98c0c95b74df69506b3b7f558030073686b3ccea4"} May 25 23:58:38.617337 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:58:38.617016 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rtxsw" event={"ID":"9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35","Type":"ContainerDied","Data":"773f9eaf38f6c8f44eb55bef08f3817344fe11227f04dc042515774e204de9ba"} May 25 23:58:38.619156 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:58:38.619136 2560 generic.go:358] "Generic (PLEG): container finished" podID="f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9" containerID="6bf3efbd6893f4b86c0cedfd14cb8cbe37102a29aac409d60095df78c1287b0b" exitCode=0 May 25 23:58:38.619156 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:58:38.619155 2560 generic.go:358] "Generic (PLEG): container finished" podID="f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9" containerID="d968e018c9dbd512840b5036f4ccef410c04ec9ae5fc5b506f053cb2ebe54d2e" exitCode=0 May 25 23:58:38.619274 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:58:38.619179 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" event={"ID":"f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9","Type":"ContainerDied","Data":"6bf3efbd6893f4b86c0cedfd14cb8cbe37102a29aac409d60095df78c1287b0b"} May 25 23:58:38.619274 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:58:38.619200 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" event={"ID":"f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9","Type":"ContainerDied","Data":"d968e018c9dbd512840b5036f4ccef410c04ec9ae5fc5b506f053cb2ebe54d2e"} May 25 23:58:44.186427 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:58:44.186338 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" podUID="f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.24:8443: connect: connection refused" May 25 23:58:44.186427 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:58:44.186384 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" podUID="f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9" containerName="online" probeResult="failure" output="Get \"https://10.134.0.24:6567/health\": dial tcp 10.134.0.24:6567: connect: connection refused" May 25 23:58:45.000757 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:58:45.000714 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rtxsw" podUID="9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.25:8443: connect: connection refused" May 25 23:58:45.445741 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:58:45.445710 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rtxsw" podUID="9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35" containerName="online" probeResult="failure" output="Get \"https://10.134.0.25:6567/health\": dial tcp 10.134.0.25:6567: connect: connection refused" May 25 23:58:54.185874 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:58:54.185832 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" podUID="f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.24:8443: connect: connection refused" May 25 23:58:54.186372 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:58:54.185839 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" podUID="f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9" containerName="online" probeResult="failure" output="Get \"https://10.134.0.24:6567/health\": dial tcp 10.134.0.24:6567: connect: connection refused" May 25 23:58:55.001358 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:58:55.001310 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rtxsw" podUID="9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.25:8443: connect: connection refused" May 25 23:58:55.446440 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:58:55.446409 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rtxsw" podUID="9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35" containerName="online" probeResult="failure" output="Get \"https://10.134.0.25:6567/health\": dial tcp 10.134.0.25:6567: connect: connection refused" May 25 23:59:04.185580 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:04.185540 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" podUID="f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9" containerName="online" probeResult="failure" output="Get \"https://10.134.0.24:6567/health\": dial tcp 10.134.0.24:6567: connect: connection refused" May 25 23:59:04.186097 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:04.185538 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" podUID="f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.24:8443: connect: connection refused" May 25 23:59:04.186097 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:04.185660 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" May 25 23:59:04.186097 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:04.185848 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" May 25 23:59:05.001091 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:05.001044 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rtxsw" podUID="9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.25:8443: connect: connection refused" May 25 23:59:05.001274 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:05.001163 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rtxsw" May 25 23:59:05.446582 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:05.446550 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rtxsw" podUID="9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35" containerName="online" probeResult="failure" output="Get \"https://10.134.0.25:6567/health\": dial tcp 10.134.0.25:6567: connect: connection refused" May 25 23:59:05.446937 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:05.446655 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rtxsw" May 25 23:59:07.697283 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:07.697254 2560 generic.go:358] "Generic (PLEG): container finished" podID="f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9" containerID="274f845be5465946799cf42012ed8d8d6d349f3fbfc32aa3e55e333e3781293b" exitCode=137 May 25 23:59:07.697283 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:07.697276 2560 generic.go:358] "Generic (PLEG): container finished" podID="f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9" containerID="bd11d66579794b01b63520f20d94d8f9b70d95c65872e65d12fbb769f8fc3874" exitCode=137 May 25 23:59:07.697705 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:07.697327 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" event={"ID":"f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9","Type":"ContainerDied","Data":"274f845be5465946799cf42012ed8d8d6d349f3fbfc32aa3e55e333e3781293b"} May 25 23:59:07.697705 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:07.697361 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" event={"ID":"f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9","Type":"ContainerDied","Data":"bd11d66579794b01b63520f20d94d8f9b70d95c65872e65d12fbb769f8fc3874"} May 25 23:59:07.699696 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:07.699674 2560 generic.go:358] "Generic (PLEG): container finished" podID="9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35" containerID="913697c94fdcb4948f20cf51587ddf0e0bc164ae75cf93507ff6bd4ce867fbb3" exitCode=137 May 25 23:59:07.699800 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:07.699717 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rtxsw" event={"ID":"9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35","Type":"ContainerDied","Data":"913697c94fdcb4948f20cf51587ddf0e0bc164ae75cf93507ff6bd4ce867fbb3"} May 25 23:59:08.041927 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:08.041905 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rtxsw" May 25 23:59:08.141515 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:08.141487 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35-offline-tls\") pod \"9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35\" (UID: \"9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35\") " May 25 23:59:08.141637 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:08.141558 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35-online-tls\") pod \"9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35\" (UID: \"9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35\") " May 25 23:59:08.141637 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:08.141604 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35-feast-data\") pod \"9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35\" (UID: \"9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35\") " May 25 23:59:08.141724 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:08.141643 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35-registry-tls\") pod \"9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35\" (UID: \"9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35\") " May 25 23:59:08.141724 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:08.141676 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qrqch\" (UniqueName: \"kubernetes.io/projected/9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35-kube-api-access-qrqch\") pod \"9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35\" (UID: \"9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35\") " May 25 23:59:08.141724 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:08.141701 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35-ui-tls\") pod \"9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35\" (UID: \"9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35\") " May 25 23:59:08.142170 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:08.142089 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35" (UID: "9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 23:59:08.142170 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:08.142221 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35-feast-data" (OuterVolumeSpecName: "feast-data") pod "9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35" (UID: "9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 25 23:59:08.144026 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:08.143980 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35" (UID: "9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 23:59:08.144106 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:08.144016 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35-kube-api-access-qrqch" (OuterVolumeSpecName: "kube-api-access-qrqch") pod "9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35" (UID: "9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35"). InnerVolumeSpecName "kube-api-access-qrqch". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 25 23:59:08.144466 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:08.144442 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35-online-tls" (OuterVolumeSpecName: "online-tls") pod "9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35" (UID: "9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 23:59:08.144554 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:08.144459 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35" (UID: "9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 23:59:08.182750 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:08.182728 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" May 25 23:59:08.242735 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:08.242663 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9-online-tls\") pod \"f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9\" (UID: \"f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9\") " May 25 23:59:08.242735 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:08.242729 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9-registry-tls\") pod \"f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9\" (UID: \"f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9\") " May 25 23:59:08.242918 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:08.242758 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9-offline-tls\") pod \"f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9\" (UID: \"f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9\") " May 25 23:59:08.242918 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:08.242777 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5fgxr\" (UniqueName: \"kubernetes.io/projected/f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9-kube-api-access-5fgxr\") pod \"f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9\" (UID: \"f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9\") " May 25 23:59:08.242918 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:08.242815 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9-ui-tls\") pod \"f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9\" (UID: \"f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9\") " May 25 23:59:08.242918 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:08.242851 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9-feast-data\") pod \"f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9\" (UID: \"f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9\") " May 25 23:59:08.243161 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:08.243016 2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35-registry-tls\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:59:08.243161 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:08.243033 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qrqch\" (UniqueName: \"kubernetes.io/projected/9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35-kube-api-access-qrqch\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:59:08.243161 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:08.243043 2560 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35-ui-tls\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:59:08.243161 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:08.243052 2560 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35-offline-tls\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:59:08.243161 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:08.243061 2560 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35-online-tls\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:59:08.243161 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:08.243075 2560 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35-feast-data\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:59:08.243762 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:08.243734 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9-feast-data" (OuterVolumeSpecName: "feast-data") pod "f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9" (UID: "f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 25 23:59:08.245060 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:08.245036 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9-kube-api-access-5fgxr" (OuterVolumeSpecName: "kube-api-access-5fgxr") pod "f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9" (UID: "f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9"). InnerVolumeSpecName "kube-api-access-5fgxr". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 25 23:59:08.245188 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:08.245066 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9" (UID: "f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 23:59:08.245188 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:08.245088 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9-online-tls" (OuterVolumeSpecName: "online-tls") pod "f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9" (UID: "f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 23:59:08.245447 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:08.245431 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9" (UID: "f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 23:59:08.245513 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:08.245452 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9" (UID: "f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 23:59:08.344121 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:08.344083 2560 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9-online-tls\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:59:08.344121 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:08.344120 2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9-registry-tls\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:59:08.344121 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:08.344129 2560 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9-offline-tls\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:59:08.344332 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:08.344139 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5fgxr\" (UniqueName: \"kubernetes.io/projected/f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9-kube-api-access-5fgxr\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:59:08.344332 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:08.344150 2560 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9-ui-tls\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:59:08.344332 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:08.344159 2560 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9-feast-data\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 25 23:59:08.705358 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:08.705326 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rtxsw" event={"ID":"9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35","Type":"ContainerDied","Data":"4ed9ce199ab806573437cacdbbfc42ab7076a615d2530ffd70431d452160d469"} May 25 23:59:08.705791 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:08.705369 2560 scope.go:117] "RemoveContainer" containerID="21c68d6ada371500d68016e98c0c95b74df69506b3b7f558030073686b3ccea4" May 25 23:59:08.705791 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:08.705371 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rtxsw" May 25 23:59:08.708233 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:08.708209 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" event={"ID":"f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9","Type":"ContainerDied","Data":"28ab429a0273530bd9bca86306c517337668cff5fb48343f9772eeb7be71c3de"} May 25 23:59:08.708323 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:08.708260 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx" May 25 23:59:08.716184 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:08.716162 2560 scope.go:117] "RemoveContainer" containerID="913697c94fdcb4948f20cf51587ddf0e0bc164ae75cf93507ff6bd4ce867fbb3" May 25 23:59:08.723531 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:08.723512 2560 scope.go:117] "RemoveContainer" containerID="773f9eaf38f6c8f44eb55bef08f3817344fe11227f04dc042515774e204de9ba" May 25 23:59:08.727866 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:08.727844 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rtxsw"] May 25 23:59:08.731013 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:08.730979 2560 scope.go:117] "RemoveContainer" containerID="873510ffe1552773792e7b23a5d387f0f77bf08eeb72dd67eb3a7f62af354588" May 25 23:59:08.734527 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:08.734507 2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-rtxsw"] May 25 23:59:08.738531 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:08.738517 2560 scope.go:117] "RemoveContainer" containerID="e400d555ff2e0cf3c2d296ec4871c85dad16400572df68481ef6f43f8df1fb2c" May 25 23:59:08.744876 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:08.744861 2560 scope.go:117] "RemoveContainer" containerID="6bf3efbd6893f4b86c0cedfd14cb8cbe37102a29aac409d60095df78c1287b0b" May 25 23:59:08.747957 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:08.747935 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx"] May 25 23:59:08.751656 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:08.751634 2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-jjzsx"] May 25 23:59:08.752731 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:08.752718 2560 scope.go:117] "RemoveContainer" containerID="274f845be5465946799cf42012ed8d8d6d349f3fbfc32aa3e55e333e3781293b" May 25 23:59:08.758974 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:08.758958 2560 scope.go:117] "RemoveContainer" containerID="d968e018c9dbd512840b5036f4ccef410c04ec9ae5fc5b506f053cb2ebe54d2e" May 25 23:59:08.765284 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:08.765271 2560 scope.go:117] "RemoveContainer" containerID="bd11d66579794b01b63520f20d94d8f9b70d95c65872e65d12fbb769f8fc3874" May 25 23:59:08.771419 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:08.771401 2560 scope.go:117] "RemoveContainer" containerID="e4f11c9726120d1b0c5552241f205955f9a56433ef565d086986b81f1c3d89b8" May 25 23:59:08.777753 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:08.777738 2560 scope.go:117] "RemoveContainer" containerID="0ac4db333114f63f9be5fdfdf1c41043a20c8907eee1040e0ae92c3bfdb7ffd4" May 25 23:59:10.544749 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:10.544703 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35" path="/var/lib/kubelet/pods/9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35/volumes" May 25 23:59:10.545469 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:10.545446 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9" path="/var/lib/kubelet/pods/f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9/volumes" May 25 23:59:49.282845 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:49.282808 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc"] May 25 23:59:49.283462 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:49.283228 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9" containerName="feast-init" May 25 23:59:49.283462 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:49.283246 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9" containerName="feast-init" May 25 23:59:49.283462 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:49.283258 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9" containerName="online" May 25 23:59:49.283462 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:49.283266 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9" containerName="online" May 25 23:59:49.283462 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:49.283278 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9" containerName="ui" May 25 23:59:49.283462 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:49.283286 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9" containerName="ui" May 25 23:59:49.283462 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:49.283297 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35" containerName="feast-init" May 25 23:59:49.283462 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:49.283305 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35" containerName="feast-init" May 25 23:59:49.283462 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:49.283315 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35" containerName="ui" May 25 23:59:49.283462 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:49.283322 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35" containerName="ui" May 25 23:59:49.283462 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:49.283333 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9" containerName="offline" May 25 23:59:49.283462 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:49.283341 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9" containerName="offline" May 25 23:59:49.283462 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:49.283359 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35" containerName="offline" May 25 23:59:49.283462 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:49.283367 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35" containerName="offline" May 25 23:59:49.283462 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:49.283380 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9" containerName="feast-apply" May 25 23:59:49.283462 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:49.283387 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9" containerName="feast-apply" May 25 23:59:49.283462 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:49.283396 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35" containerName="online" May 25 23:59:49.283462 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:49.283406 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35" containerName="online" May 25 23:59:49.283462 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:49.283416 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9" containerName="registry" May 25 23:59:49.283462 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:49.283423 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9" containerName="registry" May 25 23:59:49.283462 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:49.283435 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35" containerName="feast-apply" May 25 23:59:49.283462 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:49.283443 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35" containerName="feast-apply" May 25 23:59:49.284549 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:49.283512 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35" containerName="online" May 25 23:59:49.284549 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:49.283526 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35" containerName="offline" May 25 23:59:49.284549 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:49.283537 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="9a9621b3-cda7-42eb-9b6d-b9d8a8db2d35" containerName="ui" May 25 23:59:49.284549 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:49.283549 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9" containerName="online" May 25 23:59:49.284549 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:49.283560 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9" containerName="registry" May 25 23:59:49.284549 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:49.283570 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9" containerName="offline" May 25 23:59:49.284549 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:49.283578 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="f1bd7e1e-b92c-41f0-840e-b0fe1b3d4fe9" containerName="ui" May 25 23:59:49.287102 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:49.287083 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc" May 25 23:59:49.290383 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:49.290357 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\"" May 25 23:59:49.290832 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:49.290805 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\"" May 25 23:59:49.291099 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:49.290414 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\"" May 25 23:59:49.291531 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:49.291511 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" May 25 23:59:49.291781 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:49.290403 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\"" May 25 23:59:49.294726 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:49.291847 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" May 25 23:59:49.294726 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:49.292321 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-5wnrl\"" May 25 23:59:49.299878 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:49.299857 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc"] May 25 23:59:49.451364 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:49.451332 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/11f120b1-2589-4d68-83cc-98e2b355589e-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-cz2dc\" (UID: \"11f120b1-2589-4d68-83cc-98e2b355589e\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc" May 25 23:59:49.451364 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:49.451368 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/11f120b1-2589-4d68-83cc-98e2b355589e-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-cz2dc\" (UID: \"11f120b1-2589-4d68-83cc-98e2b355589e\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc" May 25 23:59:49.451646 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:49.451384 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/11f120b1-2589-4d68-83cc-98e2b355589e-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-cz2dc\" (UID: \"11f120b1-2589-4d68-83cc-98e2b355589e\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc" May 25 23:59:49.451646 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:49.451415 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/11f120b1-2589-4d68-83cc-98e2b355589e-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-cz2dc\" (UID: \"11f120b1-2589-4d68-83cc-98e2b355589e\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc" May 25 23:59:49.451646 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:49.451443 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/11f120b1-2589-4d68-83cc-98e2b355589e-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-cz2dc\" (UID: \"11f120b1-2589-4d68-83cc-98e2b355589e\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc" May 25 23:59:49.451646 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:49.451490 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzcch\" (UniqueName: \"kubernetes.io/projected/11f120b1-2589-4d68-83cc-98e2b355589e-kube-api-access-dzcch\") pod \"feast-simple-feast-setup-664fcfcc58-cz2dc\" (UID: \"11f120b1-2589-4d68-83cc-98e2b355589e\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc" May 25 23:59:49.552348 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:49.552258 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/11f120b1-2589-4d68-83cc-98e2b355589e-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-cz2dc\" (UID: \"11f120b1-2589-4d68-83cc-98e2b355589e\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc" May 25 23:59:49.552348 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:49.552295 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/11f120b1-2589-4d68-83cc-98e2b355589e-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-cz2dc\" (UID: \"11f120b1-2589-4d68-83cc-98e2b355589e\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc" May 25 23:59:49.552348 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:49.552314 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/11f120b1-2589-4d68-83cc-98e2b355589e-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-cz2dc\" (UID: \"11f120b1-2589-4d68-83cc-98e2b355589e\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc" May 25 23:59:49.552584 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:49.552449 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/11f120b1-2589-4d68-83cc-98e2b355589e-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-cz2dc\" (UID: \"11f120b1-2589-4d68-83cc-98e2b355589e\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc" May 25 23:59:49.552584 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:49.552492 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/11f120b1-2589-4d68-83cc-98e2b355589e-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-cz2dc\" (UID: \"11f120b1-2589-4d68-83cc-98e2b355589e\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc" May 25 23:59:49.552584 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:49.552558 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dzcch\" (UniqueName: \"kubernetes.io/projected/11f120b1-2589-4d68-83cc-98e2b355589e-kube-api-access-dzcch\") pod \"feast-simple-feast-setup-664fcfcc58-cz2dc\" (UID: \"11f120b1-2589-4d68-83cc-98e2b355589e\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc" May 25 23:59:49.552967 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:49.552934 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/11f120b1-2589-4d68-83cc-98e2b355589e-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-cz2dc\" (UID: \"11f120b1-2589-4d68-83cc-98e2b355589e\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc" May 25 23:59:49.555004 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:49.554959 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/11f120b1-2589-4d68-83cc-98e2b355589e-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-cz2dc\" (UID: \"11f120b1-2589-4d68-83cc-98e2b355589e\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc" May 25 23:59:49.555136 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:49.555023 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/11f120b1-2589-4d68-83cc-98e2b355589e-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-cz2dc\" (UID: \"11f120b1-2589-4d68-83cc-98e2b355589e\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc" May 25 23:59:49.555136 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:49.555097 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/11f120b1-2589-4d68-83cc-98e2b355589e-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-cz2dc\" (UID: \"11f120b1-2589-4d68-83cc-98e2b355589e\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc" May 25 23:59:49.555257 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:49.555198 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/11f120b1-2589-4d68-83cc-98e2b355589e-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-cz2dc\" (UID: \"11f120b1-2589-4d68-83cc-98e2b355589e\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc" May 25 23:59:49.560748 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:49.560725 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzcch\" (UniqueName: \"kubernetes.io/projected/11f120b1-2589-4d68-83cc-98e2b355589e-kube-api-access-dzcch\") pod \"feast-simple-feast-setup-664fcfcc58-cz2dc\" (UID: \"11f120b1-2589-4d68-83cc-98e2b355589e\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc" May 25 23:59:49.607822 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:49.607798 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc" May 25 23:59:49.743350 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:49.743325 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc"] May 25 23:59:49.745204 ip-10-0-134-170 kubenswrapper[2560]: W0525 23:59:49.745173 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod11f120b1_2589_4d68_83cc_98e2b355589e.slice/crio-7f3210a4bc3d0fb6cce422d61d0a0080d649762a4086eb228d479924dc508ac4 WatchSource:0}: Error finding container 7f3210a4bc3d0fb6cce422d61d0a0080d649762a4086eb228d479924dc508ac4: Status 404 returned error can't find the container with id 7f3210a4bc3d0fb6cce422d61d0a0080d649762a4086eb228d479924dc508ac4 May 25 23:59:49.746787 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:49.746770 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 25 23:59:49.820349 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:49.820291 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc" event={"ID":"11f120b1-2589-4d68-83cc-98e2b355589e","Type":"ContainerStarted","Data":"b3f49a779f014e31735fb461d85671c9f30d281dd512fae8c5827096ee06f97e"} May 25 23:59:49.820349 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:49.820321 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc" event={"ID":"11f120b1-2589-4d68-83cc-98e2b355589e","Type":"ContainerStarted","Data":"7f3210a4bc3d0fb6cce422d61d0a0080d649762a4086eb228d479924dc508ac4"} May 25 23:59:54.834847 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:54.834813 2560 generic.go:358] "Generic (PLEG): container finished" podID="11f120b1-2589-4d68-83cc-98e2b355589e" containerID="b3f49a779f014e31735fb461d85671c9f30d281dd512fae8c5827096ee06f97e" exitCode=0 May 25 23:59:54.835305 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:54.834889 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc" event={"ID":"11f120b1-2589-4d68-83cc-98e2b355589e","Type":"ContainerDied","Data":"b3f49a779f014e31735fb461d85671c9f30d281dd512fae8c5827096ee06f97e"} May 25 23:59:55.839367 ip-10-0-134-170 kubenswrapper[2560]: I0525 23:59:55.839331 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc" event={"ID":"11f120b1-2589-4d68-83cc-98e2b355589e","Type":"ContainerStarted","Data":"7269e952d9a7d283965fa05293ec93632584551b1beb249c294cb372d7beb0a1"} May 26 00:00:00.854269 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:00:00.854183 2560 generic.go:358] "Generic (PLEG): container finished" podID="11f120b1-2589-4d68-83cc-98e2b355589e" containerID="7269e952d9a7d283965fa05293ec93632584551b1beb249c294cb372d7beb0a1" exitCode=0 May 26 00:00:00.854269 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:00:00.854247 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc" event={"ID":"11f120b1-2589-4d68-83cc-98e2b355589e","Type":"ContainerDied","Data":"7269e952d9a7d283965fa05293ec93632584551b1beb249c294cb372d7beb0a1"} May 26 00:00:01.861532 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:00:01.861478 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc" event={"ID":"11f120b1-2589-4d68-83cc-98e2b355589e","Type":"ContainerStarted","Data":"55bc411fa8139c0453350e54599114be0e472e5341f513cc573226aab6a6692b"} May 26 00:00:01.862056 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:00:01.861538 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc" event={"ID":"11f120b1-2589-4d68-83cc-98e2b355589e","Type":"ContainerStarted","Data":"fb9ae83316679f38191701aa767d4d88eb559ab4c124736b54750591e1629d48"} May 26 00:00:01.862056 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:00:01.861556 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc" event={"ID":"11f120b1-2589-4d68-83cc-98e2b355589e","Type":"ContainerStarted","Data":"a9d6680f2f929347ed8aab1c9ab8dedb96cf1afe806cfa5e02cbfdc8d365107c"} May 26 00:00:01.862056 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:00:01.861569 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc" event={"ID":"11f120b1-2589-4d68-83cc-98e2b355589e","Type":"ContainerStarted","Data":"10dbb8fd74ea37d4e59d9a25258e6c8999e12c10efc24ad07590e5035afbd2c6"} May 26 00:00:01.886658 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:00:01.886584 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc" podStartSLOduration=12.886566661 podStartE2EDuration="12.886566661s" podCreationTimestamp="2026-05-25 23:59:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 00:00:01.885201995 +0000 UTC m=+1499.964097646" watchObservedRunningTime="2026-05-26 00:00:01.886566661 +0000 UTC m=+1499.965462320" May 26 00:00:02.548462 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:00:02.548435 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-czsc7_c028769b-0a8b-4a6e-8572-91c89c7879de/ovn-acl-logging/0.log" May 26 00:00:02.549834 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:00:02.549809 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-czsc7_c028769b-0a8b-4a6e-8572-91c89c7879de/ovn-acl-logging/0.log" May 26 00:00:04.608626 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:00:04.608530 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc" May 26 00:00:04.608626 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:00:04.608579 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc" May 26 00:00:04.608626 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:00:04.608594 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc" May 26 00:00:04.608626 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:00:04.608623 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc" May 26 00:00:04.610650 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:00:04.610608 2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc" podUID="11f120b1-2589-4d68-83cc-98e2b355589e" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.26:8816: connect: connection refused" May 26 00:00:04.610787 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:00:04.610645 2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc" podUID="11f120b1-2589-4d68-83cc-98e2b355589e" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.26:6571: connect: connection refused" May 26 00:00:04.610787 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:00:04.610724 2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc" podUID="11f120b1-2589-4d68-83cc-98e2b355589e" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.26:8443: connect: connection refused" May 26 00:00:04.610922 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:00:04.610820 2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc" podUID="11f120b1-2589-4d68-83cc-98e2b355589e" containerName="online" probeResult="failure" output="Get \"https://10.134.0.26:6567/health\": dial tcp 10.134.0.26:6567: connect: connection refused" May 26 00:00:07.609418 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:00:07.609379 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc" May 26 00:00:07.609875 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:00:07.609832 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc" May 26 00:00:07.609875 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:00:07.609865 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc" May 26 00:00:07.610043 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:00:07.610023 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc" May 26 00:00:07.610043 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:00:07.610045 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc" May 26 00:00:07.610230 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:00:07.610056 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc" May 26 00:00:07.610321 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:00:07.610295 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc" May 26 00:00:07.610430 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:00:07.610419 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc" May 26 00:00:07.614206 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:00:07.614187 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc" May 26 00:00:07.880689 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:00:07.880601 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc" May 26 00:00:07.881208 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:00:07.881190 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc" May 26 00:00:07.883479 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:00:07.883460 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc" May 26 00:01:08.723710 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:08.723673 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc"] May 26 00:01:08.724238 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:08.724084 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc" podUID="11f120b1-2589-4d68-83cc-98e2b355589e" containerName="registry" containerID="cri-o://10dbb8fd74ea37d4e59d9a25258e6c8999e12c10efc24ad07590e5035afbd2c6" gracePeriod=30 May 26 00:01:08.724238 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:08.724176 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc" podUID="11f120b1-2589-4d68-83cc-98e2b355589e" containerName="offline" containerID="cri-o://fb9ae83316679f38191701aa767d4d88eb559ab4c124736b54750591e1629d48" gracePeriod=30 May 26 00:01:08.724238 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:08.724199 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc" podUID="11f120b1-2589-4d68-83cc-98e2b355589e" containerName="online" containerID="cri-o://a9d6680f2f929347ed8aab1c9ab8dedb96cf1afe806cfa5e02cbfdc8d365107c" gracePeriod=30 May 26 00:01:08.724416 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:08.724199 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc" podUID="11f120b1-2589-4d68-83cc-98e2b355589e" containerName="ui" containerID="cri-o://55bc411fa8139c0453350e54599114be0e472e5341f513cc573226aab6a6692b" gracePeriod=30 May 26 00:01:09.071349 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:09.071254 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5"] May 26 00:01:09.076045 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:09.075979 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" May 26 00:01:09.079492 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:09.079469 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-z9z4s\"" May 26 00:01:09.090148 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:09.090119 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5"] May 26 00:01:09.165896 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:09.165861 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0b619ef4-9cc5-4104-8e97-d474843a567f-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-xzkx5\" (UID: \"0b619ef4-9cc5-4104-8e97-d474843a567f\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" May 26 00:01:09.166093 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:09.165913 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0b619ef4-9cc5-4104-8e97-d474843a567f-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-xzkx5\" (UID: \"0b619ef4-9cc5-4104-8e97-d474843a567f\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" May 26 00:01:09.166093 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:09.165940 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0b619ef4-9cc5-4104-8e97-d474843a567f-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-xzkx5\" (UID: \"0b619ef4-9cc5-4104-8e97-d474843a567f\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" May 26 00:01:09.166093 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:09.165964 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0b619ef4-9cc5-4104-8e97-d474843a567f-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-xzkx5\" (UID: \"0b619ef4-9cc5-4104-8e97-d474843a567f\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" May 26 00:01:09.166093 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:09.166023 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0b619ef4-9cc5-4104-8e97-d474843a567f-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-xzkx5\" (UID: \"0b619ef4-9cc5-4104-8e97-d474843a567f\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" May 26 00:01:09.166093 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:09.166048 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bkbk\" (UniqueName: \"kubernetes.io/projected/0b619ef4-9cc5-4104-8e97-d474843a567f-kube-api-access-5bkbk\") pod \"feast-simple-feast-setup-664fcfcc58-xzkx5\" (UID: \"0b619ef4-9cc5-4104-8e97-d474843a567f\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" May 26 00:01:09.266443 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:09.266406 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0b619ef4-9cc5-4104-8e97-d474843a567f-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-xzkx5\" (UID: \"0b619ef4-9cc5-4104-8e97-d474843a567f\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" May 26 00:01:09.266443 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:09.266454 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0b619ef4-9cc5-4104-8e97-d474843a567f-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-xzkx5\" (UID: \"0b619ef4-9cc5-4104-8e97-d474843a567f\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" May 26 00:01:09.266720 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:09.266490 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0b619ef4-9cc5-4104-8e97-d474843a567f-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-xzkx5\" (UID: \"0b619ef4-9cc5-4104-8e97-d474843a567f\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" May 26 00:01:09.266720 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:09.266522 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0b619ef4-9cc5-4104-8e97-d474843a567f-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-xzkx5\" (UID: \"0b619ef4-9cc5-4104-8e97-d474843a567f\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" May 26 00:01:09.266720 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:09.266557 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5bkbk\" (UniqueName: \"kubernetes.io/projected/0b619ef4-9cc5-4104-8e97-d474843a567f-kube-api-access-5bkbk\") pod \"feast-simple-feast-setup-664fcfcc58-xzkx5\" (UID: \"0b619ef4-9cc5-4104-8e97-d474843a567f\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" May 26 00:01:09.266720 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:09.266615 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0b619ef4-9cc5-4104-8e97-d474843a567f-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-xzkx5\" (UID: \"0b619ef4-9cc5-4104-8e97-d474843a567f\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" May 26 00:01:09.266720 ip-10-0-134-170 kubenswrapper[2560]: E0526 00:01:09.266639 2560 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found May 26 00:01:09.266720 ip-10-0-134-170 kubenswrapper[2560]: E0526 00:01:09.266697 2560 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found May 26 00:01:09.266720 ip-10-0-134-170 kubenswrapper[2560]: E0526 00:01:09.266708 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b619ef4-9cc5-4104-8e97-d474843a567f-offline-tls podName:0b619ef4-9cc5-4104-8e97-d474843a567f nodeName:}" failed. No retries permitted until 2026-05-26 00:01:09.766688642 +0000 UTC m=+1567.845584275 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/0b619ef4-9cc5-4104-8e97-d474843a567f-offline-tls") pod "feast-simple-feast-setup-664fcfcc58-xzkx5" (UID: "0b619ef4-9cc5-4104-8e97-d474843a567f") : secret "feast-simple-feast-setup-offline-tls" not found May 26 00:01:09.267091 ip-10-0-134-170 kubenswrapper[2560]: E0526 00:01:09.266759 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b619ef4-9cc5-4104-8e97-d474843a567f-ui-tls podName:0b619ef4-9cc5-4104-8e97-d474843a567f nodeName:}" failed. No retries permitted until 2026-05-26 00:01:09.766741845 +0000 UTC m=+1567.845637503 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/0b619ef4-9cc5-4104-8e97-d474843a567f-ui-tls") pod "feast-simple-feast-setup-664fcfcc58-xzkx5" (UID: "0b619ef4-9cc5-4104-8e97-d474843a567f") : secret "feast-simple-feast-setup-ui-tls" not found May 26 00:01:09.267091 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:09.266946 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0b619ef4-9cc5-4104-8e97-d474843a567f-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-xzkx5\" (UID: \"0b619ef4-9cc5-4104-8e97-d474843a567f\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" May 26 00:01:09.269323 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:09.269296 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0b619ef4-9cc5-4104-8e97-d474843a567f-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-xzkx5\" (UID: \"0b619ef4-9cc5-4104-8e97-d474843a567f\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" May 26 00:01:09.269436 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:09.269296 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0b619ef4-9cc5-4104-8e97-d474843a567f-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-xzkx5\" (UID: \"0b619ef4-9cc5-4104-8e97-d474843a567f\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" May 26 00:01:09.280619 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:09.280598 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bkbk\" (UniqueName: \"kubernetes.io/projected/0b619ef4-9cc5-4104-8e97-d474843a567f-kube-api-access-5bkbk\") pod \"feast-simple-feast-setup-664fcfcc58-xzkx5\" (UID: \"0b619ef4-9cc5-4104-8e97-d474843a567f\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" May 26 00:01:09.770518 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:09.770483 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0b619ef4-9cc5-4104-8e97-d474843a567f-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-xzkx5\" (UID: \"0b619ef4-9cc5-4104-8e97-d474843a567f\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" May 26 00:01:09.770865 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:09.770543 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0b619ef4-9cc5-4104-8e97-d474843a567f-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-xzkx5\" (UID: \"0b619ef4-9cc5-4104-8e97-d474843a567f\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" May 26 00:01:09.772949 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:09.772929 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0b619ef4-9cc5-4104-8e97-d474843a567f-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-xzkx5\" (UID: \"0b619ef4-9cc5-4104-8e97-d474843a567f\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" May 26 00:01:09.773038 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:09.772959 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0b619ef4-9cc5-4104-8e97-d474843a567f-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-xzkx5\" (UID: \"0b619ef4-9cc5-4104-8e97-d474843a567f\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" May 26 00:01:09.985499 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:09.985469 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" May 26 00:01:10.055685 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:10.055653 2560 generic.go:358] "Generic (PLEG): container finished" podID="11f120b1-2589-4d68-83cc-98e2b355589e" containerID="55bc411fa8139c0453350e54599114be0e472e5341f513cc573226aab6a6692b" exitCode=0 May 26 00:01:10.055685 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:10.055682 2560 generic.go:358] "Generic (PLEG): container finished" podID="11f120b1-2589-4d68-83cc-98e2b355589e" containerID="a9d6680f2f929347ed8aab1c9ab8dedb96cf1afe806cfa5e02cbfdc8d365107c" exitCode=0 May 26 00:01:10.055890 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:10.055712 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc" event={"ID":"11f120b1-2589-4d68-83cc-98e2b355589e","Type":"ContainerDied","Data":"55bc411fa8139c0453350e54599114be0e472e5341f513cc573226aab6a6692b"} May 26 00:01:10.055890 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:10.055744 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc" event={"ID":"11f120b1-2589-4d68-83cc-98e2b355589e","Type":"ContainerDied","Data":"a9d6680f2f929347ed8aab1c9ab8dedb96cf1afe806cfa5e02cbfdc8d365107c"} May 26 00:01:10.121039 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:10.121010 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5"] May 26 00:01:10.122665 ip-10-0-134-170 kubenswrapper[2560]: W0526 00:01:10.122637 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0b619ef4_9cc5_4104_8e97_d474843a567f.slice/crio-4e7472ea15c23bc60df36dbe54d7b80a06a59c109ecb050503bbfebc51ad7325 WatchSource:0}: Error finding container 4e7472ea15c23bc60df36dbe54d7b80a06a59c109ecb050503bbfebc51ad7325: Status 404 returned error can't find the container with id 4e7472ea15c23bc60df36dbe54d7b80a06a59c109ecb050503bbfebc51ad7325 May 26 00:01:11.059875 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:11.059833 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" event={"ID":"0b619ef4-9cc5-4104-8e97-d474843a567f","Type":"ContainerStarted","Data":"27bf626cf7aded72c96a8318f2fc9397f50b3c2694a47250db5e2fd40e3a88ac"} May 26 00:01:11.059875 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:11.059872 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" event={"ID":"0b619ef4-9cc5-4104-8e97-d474843a567f","Type":"ContainerStarted","Data":"4e7472ea15c23bc60df36dbe54d7b80a06a59c109ecb050503bbfebc51ad7325"} May 26 00:01:15.072073 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:15.072037 2560 generic.go:358] "Generic (PLEG): container finished" podID="0b619ef4-9cc5-4104-8e97-d474843a567f" containerID="27bf626cf7aded72c96a8318f2fc9397f50b3c2694a47250db5e2fd40e3a88ac" exitCode=0 May 26 00:01:15.072433 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:15.072111 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" event={"ID":"0b619ef4-9cc5-4104-8e97-d474843a567f","Type":"ContainerDied","Data":"27bf626cf7aded72c96a8318f2fc9397f50b3c2694a47250db5e2fd40e3a88ac"} May 26 00:01:16.076496 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:16.076463 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" event={"ID":"0b619ef4-9cc5-4104-8e97-d474843a567f","Type":"ContainerStarted","Data":"49f5f3718ad933c6cb899a7987f668991e4e4acbb51f3e4a1289a1901eeb0f03"} May 26 00:01:17.880954 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:17.880912 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc" podUID="11f120b1-2589-4d68-83cc-98e2b355589e" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.26:8443: connect: connection refused" May 26 00:01:17.881406 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:17.881021 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc" podUID="11f120b1-2589-4d68-83cc-98e2b355589e" containerName="online" probeResult="failure" output="Get \"https://10.134.0.26:6567/health\": dial tcp 10.134.0.26:6567: connect: connection refused" May 26 00:01:21.092939 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:21.092900 2560 generic.go:358] "Generic (PLEG): container finished" podID="0b619ef4-9cc5-4104-8e97-d474843a567f" containerID="49f5f3718ad933c6cb899a7987f668991e4e4acbb51f3e4a1289a1901eeb0f03" exitCode=0 May 26 00:01:21.093349 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:21.092944 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" event={"ID":"0b619ef4-9cc5-4104-8e97-d474843a567f","Type":"ContainerDied","Data":"49f5f3718ad933c6cb899a7987f668991e4e4acbb51f3e4a1289a1901eeb0f03"} May 26 00:01:22.100601 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:22.100558 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" event={"ID":"0b619ef4-9cc5-4104-8e97-d474843a567f","Type":"ContainerStarted","Data":"7d9940043ccd26761580bd4a321185c2b12ca585442de56fef58621eb944de99"} May 26 00:01:22.101110 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:22.100616 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" event={"ID":"0b619ef4-9cc5-4104-8e97-d474843a567f","Type":"ContainerStarted","Data":"ea9d24298e665e7aed5e2c6f891f9604a0b7385ddbf4ec2d11ca555093e69866"} May 26 00:01:22.101110 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:22.100632 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" event={"ID":"0b619ef4-9cc5-4104-8e97-d474843a567f","Type":"ContainerStarted","Data":"f32b425048bec270732154665e015d5640e8ecfa21c75bb931400eeabae5624d"} May 26 00:01:22.101110 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:22.100646 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" event={"ID":"0b619ef4-9cc5-4104-8e97-d474843a567f","Type":"ContainerStarted","Data":"d70d932e1838ff225ae367251d3f67ecc40aa2889b98f1149b8c30e5b0211681"} May 26 00:01:22.129518 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:22.129454 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" podStartSLOduration=13.129433595 podStartE2EDuration="13.129433595s" podCreationTimestamp="2026-05-26 00:01:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 00:01:22.125895643 +0000 UTC m=+1580.204791296" watchObservedRunningTime="2026-05-26 00:01:22.129433595 +0000 UTC m=+1580.208329250" May 26 00:01:24.986948 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:24.986589 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" May 26 00:01:24.986948 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:24.986639 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" May 26 00:01:24.986948 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:24.986653 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" May 26 00:01:24.986948 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:24.986664 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" May 26 00:01:24.988465 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:24.988427 2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" podUID="0b619ef4-9cc5-4104-8e97-d474843a567f" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.27:6571: connect: connection refused" May 26 00:01:24.988465 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:24.988446 2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" podUID="0b619ef4-9cc5-4104-8e97-d474843a567f" containerName="online" probeResult="failure" output="Get \"https://10.134.0.27:6567/health\": dial tcp 10.134.0.27:6567: connect: connection refused" May 26 00:01:24.988651 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:24.988525 2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" podUID="0b619ef4-9cc5-4104-8e97-d474843a567f" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.27:8443: connect: connection refused" May 26 00:01:24.988651 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:24.988582 2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" podUID="0b619ef4-9cc5-4104-8e97-d474843a567f" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.27:8816: connect: connection refused" May 26 00:01:27.881565 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:27.881524 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc" podUID="11f120b1-2589-4d68-83cc-98e2b355589e" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.26:8443: connect: connection refused" May 26 00:01:27.881954 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:27.881595 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc" podUID="11f120b1-2589-4d68-83cc-98e2b355589e" containerName="online" probeResult="failure" output="Get \"https://10.134.0.26:6567/health\": dial tcp 10.134.0.26:6567: connect: connection refused" May 26 00:01:27.987090 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:27.987065 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" May 26 00:01:27.987211 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:27.987157 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" May 26 00:01:27.987400 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:27.987383 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" May 26 00:01:27.987813 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:27.987777 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" May 26 00:01:27.987813 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:27.987814 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" May 26 00:01:27.988013 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:27.987830 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" May 26 00:01:27.988127 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:27.988111 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" May 26 00:01:27.988193 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:27.988161 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" May 26 00:01:27.988193 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:27.988192 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" May 26 00:01:27.991792 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:27.991775 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" May 26 00:01:28.122850 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:28.122825 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" May 26 00:01:28.125803 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:28.125783 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" May 26 00:01:37.881493 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:37.881444 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc" podUID="11f120b1-2589-4d68-83cc-98e2b355589e" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.26:8443: connect: connection refused" May 26 00:01:37.881910 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:37.881518 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc" podUID="11f120b1-2589-4d68-83cc-98e2b355589e" containerName="online" probeResult="failure" output="Get \"https://10.134.0.26:6567/health\": dial tcp 10.134.0.26:6567: connect: connection refused" May 26 00:01:37.881910 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:37.881578 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc" May 26 00:01:37.881910 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:37.881748 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc" May 26 00:01:39.155615 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:39.155530 2560 generic.go:358] "Generic (PLEG): container finished" podID="11f120b1-2589-4d68-83cc-98e2b355589e" containerID="fb9ae83316679f38191701aa767d4d88eb559ab4c124736b54750591e1629d48" exitCode=137 May 26 00:01:39.155615 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:39.155554 2560 generic.go:358] "Generic (PLEG): container finished" podID="11f120b1-2589-4d68-83cc-98e2b355589e" containerID="10dbb8fd74ea37d4e59d9a25258e6c8999e12c10efc24ad07590e5035afbd2c6" exitCode=137 May 26 00:01:39.155615 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:39.155598 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc" event={"ID":"11f120b1-2589-4d68-83cc-98e2b355589e","Type":"ContainerDied","Data":"fb9ae83316679f38191701aa767d4d88eb559ab4c124736b54750591e1629d48"} May 26 00:01:39.156096 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:39.155631 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc" event={"ID":"11f120b1-2589-4d68-83cc-98e2b355589e","Type":"ContainerDied","Data":"10dbb8fd74ea37d4e59d9a25258e6c8999e12c10efc24ad07590e5035afbd2c6"} May 26 00:01:39.374477 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:39.374456 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc" May 26 00:01:39.502803 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:39.502769 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/11f120b1-2589-4d68-83cc-98e2b355589e-feast-data\") pod \"11f120b1-2589-4d68-83cc-98e2b355589e\" (UID: \"11f120b1-2589-4d68-83cc-98e2b355589e\") " May 26 00:01:39.503019 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:39.502815 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dzcch\" (UniqueName: \"kubernetes.io/projected/11f120b1-2589-4d68-83cc-98e2b355589e-kube-api-access-dzcch\") pod \"11f120b1-2589-4d68-83cc-98e2b355589e\" (UID: \"11f120b1-2589-4d68-83cc-98e2b355589e\") " May 26 00:01:39.503019 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:39.502839 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/11f120b1-2589-4d68-83cc-98e2b355589e-offline-tls\") pod \"11f120b1-2589-4d68-83cc-98e2b355589e\" (UID: \"11f120b1-2589-4d68-83cc-98e2b355589e\") " May 26 00:01:39.503019 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:39.502865 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/11f120b1-2589-4d68-83cc-98e2b355589e-ui-tls\") pod \"11f120b1-2589-4d68-83cc-98e2b355589e\" (UID: \"11f120b1-2589-4d68-83cc-98e2b355589e\") " May 26 00:01:39.503019 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:39.502949 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/11f120b1-2589-4d68-83cc-98e2b355589e-online-tls\") pod \"11f120b1-2589-4d68-83cc-98e2b355589e\" (UID: \"11f120b1-2589-4d68-83cc-98e2b355589e\") " May 26 00:01:39.503230 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:39.503055 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/11f120b1-2589-4d68-83cc-98e2b355589e-registry-tls\") pod \"11f120b1-2589-4d68-83cc-98e2b355589e\" (UID: \"11f120b1-2589-4d68-83cc-98e2b355589e\") " May 26 00:01:39.503386 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:39.503344 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11f120b1-2589-4d68-83cc-98e2b355589e-feast-data" (OuterVolumeSpecName: "feast-data") pod "11f120b1-2589-4d68-83cc-98e2b355589e" (UID: "11f120b1-2589-4d68-83cc-98e2b355589e"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 26 00:01:39.505426 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:39.505398 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11f120b1-2589-4d68-83cc-98e2b355589e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "11f120b1-2589-4d68-83cc-98e2b355589e" (UID: "11f120b1-2589-4d68-83cc-98e2b355589e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 00:01:39.505549 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:39.505527 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11f120b1-2589-4d68-83cc-98e2b355589e-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "11f120b1-2589-4d68-83cc-98e2b355589e" (UID: "11f120b1-2589-4d68-83cc-98e2b355589e"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 00:01:39.505615 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:39.505537 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11f120b1-2589-4d68-83cc-98e2b355589e-kube-api-access-dzcch" (OuterVolumeSpecName: "kube-api-access-dzcch") pod "11f120b1-2589-4d68-83cc-98e2b355589e" (UID: "11f120b1-2589-4d68-83cc-98e2b355589e"). InnerVolumeSpecName "kube-api-access-dzcch". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 00:01:39.505677 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:39.505662 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11f120b1-2589-4d68-83cc-98e2b355589e-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "11f120b1-2589-4d68-83cc-98e2b355589e" (UID: "11f120b1-2589-4d68-83cc-98e2b355589e"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 00:01:39.505757 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:39.505736 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11f120b1-2589-4d68-83cc-98e2b355589e-online-tls" (OuterVolumeSpecName: "online-tls") pod "11f120b1-2589-4d68-83cc-98e2b355589e" (UID: "11f120b1-2589-4d68-83cc-98e2b355589e"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 00:01:39.603910 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:39.603866 2560 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/11f120b1-2589-4d68-83cc-98e2b355589e-ui-tls\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 26 00:01:39.603910 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:39.603905 2560 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/11f120b1-2589-4d68-83cc-98e2b355589e-online-tls\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 26 00:01:39.603910 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:39.603920 2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/11f120b1-2589-4d68-83cc-98e2b355589e-registry-tls\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 26 00:01:39.604174 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:39.603932 2560 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/11f120b1-2589-4d68-83cc-98e2b355589e-feast-data\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 26 00:01:39.604174 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:39.603946 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dzcch\" (UniqueName: \"kubernetes.io/projected/11f120b1-2589-4d68-83cc-98e2b355589e-kube-api-access-dzcch\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 26 00:01:39.604174 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:39.603959 2560 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/11f120b1-2589-4d68-83cc-98e2b355589e-offline-tls\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 26 00:01:40.161499 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:40.161463 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc" event={"ID":"11f120b1-2589-4d68-83cc-98e2b355589e","Type":"ContainerDied","Data":"7f3210a4bc3d0fb6cce422d61d0a0080d649762a4086eb228d479924dc508ac4"} May 26 00:01:40.161958 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:40.161510 2560 scope.go:117] "RemoveContainer" containerID="55bc411fa8139c0453350e54599114be0e472e5341f513cc573226aab6a6692b" May 26 00:01:40.161958 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:40.161546 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc" May 26 00:01:40.175344 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:40.175321 2560 scope.go:117] "RemoveContainer" containerID="fb9ae83316679f38191701aa767d4d88eb559ab4c124736b54750591e1629d48" May 26 00:01:40.182524 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:40.182505 2560 scope.go:117] "RemoveContainer" containerID="a9d6680f2f929347ed8aab1c9ab8dedb96cf1afe806cfa5e02cbfdc8d365107c" May 26 00:01:40.187159 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:40.187134 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc"] May 26 00:01:40.190732 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:40.190712 2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-cz2dc"] May 26 00:01:40.190804 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:40.190748 2560 scope.go:117] "RemoveContainer" containerID="10dbb8fd74ea37d4e59d9a25258e6c8999e12c10efc24ad07590e5035afbd2c6" May 26 00:01:40.197800 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:40.197784 2560 scope.go:117] "RemoveContainer" containerID="7269e952d9a7d283965fa05293ec93632584551b1beb249c294cb372d7beb0a1" May 26 00:01:40.204657 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:40.204639 2560 scope.go:117] "RemoveContainer" containerID="b3f49a779f014e31735fb461d85671c9f30d281dd512fae8c5827096ee06f97e" May 26 00:01:40.544663 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:01:40.544629 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11f120b1-2589-4d68-83cc-98e2b355589e" path="/var/lib/kubelet/pods/11f120b1-2589-4d68-83cc-98e2b355589e/volumes" May 26 00:02:30.530682 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:30.530643 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh"] May 26 00:02:30.531233 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:30.530939 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11f120b1-2589-4d68-83cc-98e2b355589e" containerName="online" May 26 00:02:30.531233 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:30.530951 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="11f120b1-2589-4d68-83cc-98e2b355589e" containerName="online" May 26 00:02:30.531233 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:30.530961 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11f120b1-2589-4d68-83cc-98e2b355589e" containerName="feast-apply" May 26 00:02:30.531233 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:30.530967 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="11f120b1-2589-4d68-83cc-98e2b355589e" containerName="feast-apply" May 26 00:02:30.531233 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:30.530981 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11f120b1-2589-4d68-83cc-98e2b355589e" containerName="feast-init" May 26 00:02:30.531233 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:30.531002 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="11f120b1-2589-4d68-83cc-98e2b355589e" containerName="feast-init" May 26 00:02:30.531233 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:30.531014 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11f120b1-2589-4d68-83cc-98e2b355589e" containerName="ui" May 26 00:02:30.531233 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:30.531022 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="11f120b1-2589-4d68-83cc-98e2b355589e" containerName="ui" May 26 00:02:30.531233 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:30.531034 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11f120b1-2589-4d68-83cc-98e2b355589e" containerName="offline" May 26 00:02:30.531233 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:30.531041 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="11f120b1-2589-4d68-83cc-98e2b355589e" containerName="offline" May 26 00:02:30.531233 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:30.531056 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11f120b1-2589-4d68-83cc-98e2b355589e" containerName="registry" May 26 00:02:30.531233 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:30.531064 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="11f120b1-2589-4d68-83cc-98e2b355589e" containerName="registry" May 26 00:02:30.531233 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:30.531137 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="11f120b1-2589-4d68-83cc-98e2b355589e" containerName="ui" May 26 00:02:30.531233 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:30.531148 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="11f120b1-2589-4d68-83cc-98e2b355589e" containerName="registry" May 26 00:02:30.531233 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:30.531154 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="11f120b1-2589-4d68-83cc-98e2b355589e" containerName="offline" May 26 00:02:30.531233 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:30.531163 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="11f120b1-2589-4d68-83cc-98e2b355589e" containerName="online" May 26 00:02:30.534329 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:30.534312 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh" May 26 00:02:30.536981 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:30.536961 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\"" May 26 00:02:30.537162 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:30.537141 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\"" May 26 00:02:30.537228 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:30.537211 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\"" May 26 00:02:30.537290 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:30.537271 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\"" May 26 00:02:30.537344 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:30.537314 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-lxvz2\"" May 26 00:02:30.537398 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:30.537355 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\"" May 26 00:02:30.537578 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:30.537562 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\"" May 26 00:02:30.545255 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:30.545231 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh"] May 26 00:02:30.595942 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:30.595907 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kkdl\" (UniqueName: \"kubernetes.io/projected/4ac197df-6d93-4e2a-961c-83ed002df248-kube-api-access-2kkdl\") pod \"feast-simple-feast-remote-setup-5cff94746b-2wbqh\" (UID: \"4ac197df-6d93-4e2a-961c-83ed002df248\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh" May 26 00:02:30.596125 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:30.595956 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4ac197df-6d93-4e2a-961c-83ed002df248-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-2wbqh\" (UID: \"4ac197df-6d93-4e2a-961c-83ed002df248\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh" May 26 00:02:30.596125 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:30.595981 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/4ac197df-6d93-4e2a-961c-83ed002df248-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-2wbqh\" (UID: \"4ac197df-6d93-4e2a-961c-83ed002df248\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh" May 26 00:02:30.596125 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:30.596064 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4ac197df-6d93-4e2a-961c-83ed002df248-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-2wbqh\" (UID: \"4ac197df-6d93-4e2a-961c-83ed002df248\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh" May 26 00:02:30.596125 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:30.596118 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/4ac197df-6d93-4e2a-961c-83ed002df248-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-2wbqh\" (UID: \"4ac197df-6d93-4e2a-961c-83ed002df248\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh" May 26 00:02:30.596269 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:30.596134 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/4ac197df-6d93-4e2a-961c-83ed002df248-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-2wbqh\" (UID: \"4ac197df-6d93-4e2a-961c-83ed002df248\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh" May 26 00:02:30.696625 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:30.696586 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4ac197df-6d93-4e2a-961c-83ed002df248-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-2wbqh\" (UID: \"4ac197df-6d93-4e2a-961c-83ed002df248\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh" May 26 00:02:30.696625 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:30.696632 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/4ac197df-6d93-4e2a-961c-83ed002df248-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-2wbqh\" (UID: \"4ac197df-6d93-4e2a-961c-83ed002df248\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh" May 26 00:02:30.696887 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:30.696657 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4ac197df-6d93-4e2a-961c-83ed002df248-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-2wbqh\" (UID: \"4ac197df-6d93-4e2a-961c-83ed002df248\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh" May 26 00:02:30.696887 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:30.696696 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/4ac197df-6d93-4e2a-961c-83ed002df248-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-2wbqh\" (UID: \"4ac197df-6d93-4e2a-961c-83ed002df248\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh" May 26 00:02:30.696887 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:30.696721 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/4ac197df-6d93-4e2a-961c-83ed002df248-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-2wbqh\" (UID: \"4ac197df-6d93-4e2a-961c-83ed002df248\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh" May 26 00:02:30.696887 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:30.696750 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2kkdl\" (UniqueName: \"kubernetes.io/projected/4ac197df-6d93-4e2a-961c-83ed002df248-kube-api-access-2kkdl\") pod \"feast-simple-feast-remote-setup-5cff94746b-2wbqh\" (UID: \"4ac197df-6d93-4e2a-961c-83ed002df248\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh" May 26 00:02:30.696887 ip-10-0-134-170 kubenswrapper[2560]: E0526 00:02:30.696842 2560 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-ui-tls: secret "feast-simple-feast-remote-setup-ui-tls" not found May 26 00:02:30.696887 ip-10-0-134-170 kubenswrapper[2560]: E0526 00:02:30.696845 2560 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-online-tls: secret "feast-simple-feast-remote-setup-online-tls" not found May 26 00:02:30.697234 ip-10-0-134-170 kubenswrapper[2560]: E0526 00:02:30.696937 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ac197df-6d93-4e2a-961c-83ed002df248-online-tls podName:4ac197df-6d93-4e2a-961c-83ed002df248 nodeName:}" failed. No retries permitted until 2026-05-26 00:02:31.196912267 +0000 UTC m=+1649.275807895 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/4ac197df-6d93-4e2a-961c-83ed002df248-online-tls") pod "feast-simple-feast-remote-setup-5cff94746b-2wbqh" (UID: "4ac197df-6d93-4e2a-961c-83ed002df248") : secret "feast-simple-feast-remote-setup-online-tls" not found May 26 00:02:30.697234 ip-10-0-134-170 kubenswrapper[2560]: E0526 00:02:30.696959 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ac197df-6d93-4e2a-961c-83ed002df248-ui-tls podName:4ac197df-6d93-4e2a-961c-83ed002df248 nodeName:}" failed. No retries permitted until 2026-05-26 00:02:31.196948661 +0000 UTC m=+1649.275844295 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/4ac197df-6d93-4e2a-961c-83ed002df248-ui-tls") pod "feast-simple-feast-remote-setup-5cff94746b-2wbqh" (UID: "4ac197df-6d93-4e2a-961c-83ed002df248") : secret "feast-simple-feast-remote-setup-ui-tls" not found May 26 00:02:30.697234 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:30.697076 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4ac197df-6d93-4e2a-961c-83ed002df248-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-2wbqh\" (UID: \"4ac197df-6d93-4e2a-961c-83ed002df248\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh" May 26 00:02:30.697484 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:30.697462 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/4ac197df-6d93-4e2a-961c-83ed002df248-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-2wbqh\" (UID: \"4ac197df-6d93-4e2a-961c-83ed002df248\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh" May 26 00:02:30.699729 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:30.699708 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/4ac197df-6d93-4e2a-961c-83ed002df248-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-2wbqh\" (UID: \"4ac197df-6d93-4e2a-961c-83ed002df248\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh" May 26 00:02:30.705804 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:30.705781 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kkdl\" (UniqueName: \"kubernetes.io/projected/4ac197df-6d93-4e2a-961c-83ed002df248-kube-api-access-2kkdl\") pod \"feast-simple-feast-remote-setup-5cff94746b-2wbqh\" (UID: \"4ac197df-6d93-4e2a-961c-83ed002df248\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh" May 26 00:02:31.201751 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:31.201716 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4ac197df-6d93-4e2a-961c-83ed002df248-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-2wbqh\" (UID: \"4ac197df-6d93-4e2a-961c-83ed002df248\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh" May 26 00:02:31.201976 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:31.201772 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/4ac197df-6d93-4e2a-961c-83ed002df248-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-2wbqh\" (UID: \"4ac197df-6d93-4e2a-961c-83ed002df248\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh" May 26 00:02:31.204448 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:31.204422 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/4ac197df-6d93-4e2a-961c-83ed002df248-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-2wbqh\" (UID: \"4ac197df-6d93-4e2a-961c-83ed002df248\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh" May 26 00:02:31.204590 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:31.204469 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4ac197df-6d93-4e2a-961c-83ed002df248-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-2wbqh\" (UID: \"4ac197df-6d93-4e2a-961c-83ed002df248\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh" May 26 00:02:31.442640 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:31.442602 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh" May 26 00:02:31.578583 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:31.578555 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh"] May 26 00:02:31.580698 ip-10-0-134-170 kubenswrapper[2560]: W0526 00:02:31.580664 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4ac197df_6d93_4e2a_961c_83ed002df248.slice/crio-8f4912039aa4bd2ff2dac94348cd2574de46aef8d8e00f230551d698a3def02b WatchSource:0}: Error finding container 8f4912039aa4bd2ff2dac94348cd2574de46aef8d8e00f230551d698a3def02b: Status 404 returned error can't find the container with id 8f4912039aa4bd2ff2dac94348cd2574de46aef8d8e00f230551d698a3def02b May 26 00:02:32.302198 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:32.302156 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh" event={"ID":"4ac197df-6d93-4e2a-961c-83ed002df248","Type":"ContainerStarted","Data":"305fa7bd43f53475b3ce5f3aae17034ac0b07780095fae94d4ae84c24bd5d654"} May 26 00:02:32.302198 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:32.302202 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh" event={"ID":"4ac197df-6d93-4e2a-961c-83ed002df248","Type":"ContainerStarted","Data":"8f4912039aa4bd2ff2dac94348cd2574de46aef8d8e00f230551d698a3def02b"} May 26 00:02:36.316124 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:36.316088 2560 generic.go:358] "Generic (PLEG): container finished" podID="4ac197df-6d93-4e2a-961c-83ed002df248" containerID="305fa7bd43f53475b3ce5f3aae17034ac0b07780095fae94d4ae84c24bd5d654" exitCode=0 May 26 00:02:36.316552 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:36.316170 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh" event={"ID":"4ac197df-6d93-4e2a-961c-83ed002df248","Type":"ContainerDied","Data":"305fa7bd43f53475b3ce5f3aae17034ac0b07780095fae94d4ae84c24bd5d654"} May 26 00:02:37.323392 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:37.323358 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh" event={"ID":"4ac197df-6d93-4e2a-961c-83ed002df248","Type":"ContainerStarted","Data":"af326335eb8a32350688b29c042c99dd0ce3969c666c5b1a509b58da396e0c0e"} May 26 00:02:42.343120 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:42.343028 2560 generic.go:358] "Generic (PLEG): container finished" podID="4ac197df-6d93-4e2a-961c-83ed002df248" containerID="af326335eb8a32350688b29c042c99dd0ce3969c666c5b1a509b58da396e0c0e" exitCode=0 May 26 00:02:42.343478 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:42.343109 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh" event={"ID":"4ac197df-6d93-4e2a-961c-83ed002df248","Type":"ContainerDied","Data":"af326335eb8a32350688b29c042c99dd0ce3969c666c5b1a509b58da396e0c0e"} May 26 00:02:43.349747 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:43.349703 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh" event={"ID":"4ac197df-6d93-4e2a-961c-83ed002df248","Type":"ContainerStarted","Data":"2e90d920cd78b4de2a4a019d58f8ccb7799632e8f42cc929c38bc8e5726fc4b6"} May 26 00:02:43.349747 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:43.349751 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh" event={"ID":"4ac197df-6d93-4e2a-961c-83ed002df248","Type":"ContainerStarted","Data":"17982394d579247f4a09169b1127df4538efc071f769553b2c027ef775bb270c"} May 26 00:02:43.350186 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:43.349767 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh" event={"ID":"4ac197df-6d93-4e2a-961c-83ed002df248","Type":"ContainerStarted","Data":"e70dddaf85924308a6db8faa6f3532b61e90e439a1bbd0a26ee879d5cbd496a5"} May 26 00:02:43.375243 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:43.375187 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh" podStartSLOduration=13.375168327 podStartE2EDuration="13.375168327s" podCreationTimestamp="2026-05-26 00:02:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 00:02:43.373238295 +0000 UTC m=+1661.452133980" watchObservedRunningTime="2026-05-26 00:02:43.375168327 +0000 UTC m=+1661.454063979" May 26 00:02:43.443055 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:43.443024 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh" May 26 00:02:43.443293 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:43.443270 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh" May 26 00:02:43.443293 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:43.443293 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh" May 26 00:02:43.444465 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:43.444421 2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh" podUID="4ac197df-6d93-4e2a-961c-83ed002df248" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.28:8816: connect: connection refused" May 26 00:02:43.444552 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:43.444454 2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh" podUID="4ac197df-6d93-4e2a-961c-83ed002df248" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.28:8443: connect: connection refused" May 26 00:02:43.444552 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:43.444473 2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh" podUID="4ac197df-6d93-4e2a-961c-83ed002df248" containerName="online" probeResult="failure" output="Get \"https://10.134.0.28:6567/health\": dial tcp 10.134.0.28:6567: connect: connection refused" May 26 00:02:46.443539 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:46.443497 2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh" podUID="4ac197df-6d93-4e2a-961c-83ed002df248" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.28:8816: connect: connection refused" May 26 00:02:46.443539 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:46.443531 2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh" podUID="4ac197df-6d93-4e2a-961c-83ed002df248" containerName="online" probeResult="failure" output="Get \"https://10.134.0.28:6567/health\": dial tcp 10.134.0.28:6567: connect: connection refused" May 26 00:02:46.444050 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:46.443498 2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh" podUID="4ac197df-6d93-4e2a-961c-83ed002df248" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.28:8443: connect: connection refused" May 26 00:02:49.443915 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:49.443878 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh" May 26 00:02:49.444452 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:49.444288 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh" May 26 00:02:49.444678 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:49.444636 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh" May 26 00:02:49.444678 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:49.444670 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh" May 26 00:02:49.444862 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:49.444774 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh" May 26 00:02:49.444862 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:49.444855 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh" May 26 00:02:49.448183 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:49.448159 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh" May 26 00:02:50.373245 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:50.373217 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh" May 26 00:02:50.376260 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:02:50.376237 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh" May 26 00:03:51.451925 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:03:51.451895 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh"] May 26 00:03:51.452497 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:03:51.452235 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh" podUID="4ac197df-6d93-4e2a-961c-83ed002df248" containerName="online" containerID="cri-o://e70dddaf85924308a6db8faa6f3532b61e90e439a1bbd0a26ee879d5cbd496a5" gracePeriod=30 May 26 00:03:51.452497 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:03:51.452313 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh" podUID="4ac197df-6d93-4e2a-961c-83ed002df248" containerName="offline" containerID="cri-o://17982394d579247f4a09169b1127df4538efc071f769553b2c027ef775bb270c" gracePeriod=30 May 26 00:03:51.452497 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:03:51.452312 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh" podUID="4ac197df-6d93-4e2a-961c-83ed002df248" containerName="ui" containerID="cri-o://2e90d920cd78b4de2a4a019d58f8ccb7799632e8f42cc929c38bc8e5726fc4b6" gracePeriod=30 May 26 00:03:51.614426 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:03:51.614390 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5"] May 26 00:03:51.614964 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:03:51.614767 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" podUID="0b619ef4-9cc5-4104-8e97-d474843a567f" containerName="registry" containerID="cri-o://d70d932e1838ff225ae367251d3f67ecc40aa2889b98f1149b8c30e5b0211681" gracePeriod=30 May 26 00:03:51.614964 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:03:51.614832 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" podUID="0b619ef4-9cc5-4104-8e97-d474843a567f" containerName="online" containerID="cri-o://f32b425048bec270732154665e015d5640e8ecfa21c75bb931400eeabae5624d" gracePeriod=30 May 26 00:03:51.614964 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:03:51.614780 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" podUID="0b619ef4-9cc5-4104-8e97-d474843a567f" containerName="ui" containerID="cri-o://7d9940043ccd26761580bd4a321185c2b12ca585442de56fef58621eb944de99" gracePeriod=30 May 26 00:03:51.614964 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:03:51.614880 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" podUID="0b619ef4-9cc5-4104-8e97-d474843a567f" containerName="offline" containerID="cri-o://ea9d24298e665e7aed5e2c6f891f9604a0b7385ddbf4ec2d11ca555093e69866" gracePeriod=30 May 26 00:03:52.556187 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:03:52.556092 2560 generic.go:358] "Generic (PLEG): container finished" podID="4ac197df-6d93-4e2a-961c-83ed002df248" containerID="2e90d920cd78b4de2a4a019d58f8ccb7799632e8f42cc929c38bc8e5726fc4b6" exitCode=0 May 26 00:03:52.556187 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:03:52.556121 2560 generic.go:358] "Generic (PLEG): container finished" podID="4ac197df-6d93-4e2a-961c-83ed002df248" containerID="e70dddaf85924308a6db8faa6f3532b61e90e439a1bbd0a26ee879d5cbd496a5" exitCode=0 May 26 00:03:52.556187 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:03:52.556160 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh" event={"ID":"4ac197df-6d93-4e2a-961c-83ed002df248","Type":"ContainerDied","Data":"2e90d920cd78b4de2a4a019d58f8ccb7799632e8f42cc929c38bc8e5726fc4b6"} May 26 00:03:52.556676 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:03:52.556195 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh" event={"ID":"4ac197df-6d93-4e2a-961c-83ed002df248","Type":"ContainerDied","Data":"e70dddaf85924308a6db8faa6f3532b61e90e439a1bbd0a26ee879d5cbd496a5"} May 26 00:03:52.558362 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:03:52.558340 2560 generic.go:358] "Generic (PLEG): container finished" podID="0b619ef4-9cc5-4104-8e97-d474843a567f" containerID="7d9940043ccd26761580bd4a321185c2b12ca585442de56fef58621eb944de99" exitCode=0 May 26 00:03:52.558362 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:03:52.558359 2560 generic.go:358] "Generic (PLEG): container finished" podID="0b619ef4-9cc5-4104-8e97-d474843a567f" containerID="f32b425048bec270732154665e015d5640e8ecfa21c75bb931400eeabae5624d" exitCode=0 May 26 00:03:52.558540 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:03:52.558388 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" event={"ID":"0b619ef4-9cc5-4104-8e97-d474843a567f","Type":"ContainerDied","Data":"7d9940043ccd26761580bd4a321185c2b12ca585442de56fef58621eb944de99"} May 26 00:03:52.558540 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:03:52.558404 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" event={"ID":"0b619ef4-9cc5-4104-8e97-d474843a567f","Type":"ContainerDied","Data":"f32b425048bec270732154665e015d5640e8ecfa21c75bb931400eeabae5624d"} May 26 00:03:57.988496 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:03:57.988447 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" podUID="0b619ef4-9cc5-4104-8e97-d474843a567f" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.27:8443: connect: connection refused" May 26 00:03:58.123814 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:03:58.123775 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" podUID="0b619ef4-9cc5-4104-8e97-d474843a567f" containerName="online" probeResult="failure" output="Get \"https://10.134.0.27:6567/health\": dial tcp 10.134.0.27:6567: connect: connection refused" May 26 00:03:59.445282 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:03:59.445228 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh" podUID="4ac197df-6d93-4e2a-961c-83ed002df248" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.28:8443: connect: connection refused" May 26 00:04:00.373668 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:00.373622 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh" podUID="4ac197df-6d93-4e2a-961c-83ed002df248" containerName="online" probeResult="failure" output="Get \"https://10.134.0.28:6567/health\": dial tcp 10.134.0.28:6567: connect: connection refused" May 26 00:04:07.988464 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:07.988397 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" podUID="0b619ef4-9cc5-4104-8e97-d474843a567f" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.27:8443: connect: connection refused" May 26 00:04:08.123508 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:08.123463 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" podUID="0b619ef4-9cc5-4104-8e97-d474843a567f" containerName="online" probeResult="failure" output="Get \"https://10.134.0.27:6567/health\": dial tcp 10.134.0.27:6567: connect: connection refused" May 26 00:04:09.445070 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:09.445021 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh" podUID="4ac197df-6d93-4e2a-961c-83ed002df248" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.28:8443: connect: connection refused" May 26 00:04:10.373613 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:10.373563 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh" podUID="4ac197df-6d93-4e2a-961c-83ed002df248" containerName="online" probeResult="failure" output="Get \"https://10.134.0.28:6567/health\": dial tcp 10.134.0.28:6567: connect: connection refused" May 26 00:04:17.988029 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:17.987958 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" podUID="0b619ef4-9cc5-4104-8e97-d474843a567f" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.27:8443: connect: connection refused" May 26 00:04:17.988472 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:17.988150 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" May 26 00:04:18.123318 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:18.123281 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" podUID="0b619ef4-9cc5-4104-8e97-d474843a567f" containerName="online" probeResult="failure" output="Get \"https://10.134.0.27:6567/health\": dial tcp 10.134.0.27:6567: connect: connection refused" May 26 00:04:18.123477 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:18.123390 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" May 26 00:04:19.445215 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:19.445168 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh" podUID="4ac197df-6d93-4e2a-961c-83ed002df248" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.28:8443: connect: connection refused" May 26 00:04:19.445653 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:19.445293 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh" May 26 00:04:20.374094 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:20.374054 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh" podUID="4ac197df-6d93-4e2a-961c-83ed002df248" containerName="online" probeResult="failure" output="Get \"https://10.134.0.28:6567/health\": dial tcp 10.134.0.28:6567: connect: connection refused" May 26 00:04:20.374265 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:20.374177 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh" May 26 00:04:21.641636 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:21.641416 2560 generic.go:358] "Generic (PLEG): container finished" podID="4ac197df-6d93-4e2a-961c-83ed002df248" containerID="17982394d579247f4a09169b1127df4538efc071f769553b2c027ef775bb270c" exitCode=137 May 26 00:04:21.641636 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:21.641496 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh" event={"ID":"4ac197df-6d93-4e2a-961c-83ed002df248","Type":"ContainerDied","Data":"17982394d579247f4a09169b1127df4538efc071f769553b2c027ef775bb270c"} May 26 00:04:21.641636 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:21.641538 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh" event={"ID":"4ac197df-6d93-4e2a-961c-83ed002df248","Type":"ContainerDied","Data":"8f4912039aa4bd2ff2dac94348cd2574de46aef8d8e00f230551d698a3def02b"} May 26 00:04:21.641636 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:21.641555 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8f4912039aa4bd2ff2dac94348cd2574de46aef8d8e00f230551d698a3def02b" May 26 00:04:21.724896 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:21.724834 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh" May 26 00:04:21.833009 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:21.832971 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4ac197df-6d93-4e2a-961c-83ed002df248-online-tls\") pod \"4ac197df-6d93-4e2a-961c-83ed002df248\" (UID: \"4ac197df-6d93-4e2a-961c-83ed002df248\") " May 26 00:04:21.833172 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:21.833056 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/4ac197df-6d93-4e2a-961c-83ed002df248-offline-tls\") pod \"4ac197df-6d93-4e2a-961c-83ed002df248\" (UID: \"4ac197df-6d93-4e2a-961c-83ed002df248\") " May 26 00:04:21.833172 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:21.833105 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4ac197df-6d93-4e2a-961c-83ed002df248-feast-data\") pod \"4ac197df-6d93-4e2a-961c-83ed002df248\" (UID: \"4ac197df-6d93-4e2a-961c-83ed002df248\") " May 26 00:04:21.833172 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:21.833135 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/4ac197df-6d93-4e2a-961c-83ed002df248-ui-tls\") pod \"4ac197df-6d93-4e2a-961c-83ed002df248\" (UID: \"4ac197df-6d93-4e2a-961c-83ed002df248\") " May 26 00:04:21.833172 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:21.833160 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2kkdl\" (UniqueName: \"kubernetes.io/projected/4ac197df-6d93-4e2a-961c-83ed002df248-kube-api-access-2kkdl\") pod \"4ac197df-6d93-4e2a-961c-83ed002df248\" (UID: \"4ac197df-6d93-4e2a-961c-83ed002df248\") " May 26 00:04:21.833386 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:21.833186 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/4ac197df-6d93-4e2a-961c-83ed002df248-registry-tls\") pod \"4ac197df-6d93-4e2a-961c-83ed002df248\" (UID: \"4ac197df-6d93-4e2a-961c-83ed002df248\") " May 26 00:04:21.833700 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:21.833673 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ac197df-6d93-4e2a-961c-83ed002df248-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "4ac197df-6d93-4e2a-961c-83ed002df248" (UID: "4ac197df-6d93-4e2a-961c-83ed002df248"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 00:04:21.833983 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:21.833957 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ac197df-6d93-4e2a-961c-83ed002df248-feast-data" (OuterVolumeSpecName: "feast-data") pod "4ac197df-6d93-4e2a-961c-83ed002df248" (UID: "4ac197df-6d93-4e2a-961c-83ed002df248"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 26 00:04:21.835449 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:21.835419 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ac197df-6d93-4e2a-961c-83ed002df248-online-tls" (OuterVolumeSpecName: "online-tls") pod "4ac197df-6d93-4e2a-961c-83ed002df248" (UID: "4ac197df-6d93-4e2a-961c-83ed002df248"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 00:04:21.835543 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:21.835468 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ac197df-6d93-4e2a-961c-83ed002df248-kube-api-access-2kkdl" (OuterVolumeSpecName: "kube-api-access-2kkdl") pod "4ac197df-6d93-4e2a-961c-83ed002df248" (UID: "4ac197df-6d93-4e2a-961c-83ed002df248"). InnerVolumeSpecName "kube-api-access-2kkdl". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 00:04:21.835802 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:21.835784 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ac197df-6d93-4e2a-961c-83ed002df248-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "4ac197df-6d93-4e2a-961c-83ed002df248" (UID: "4ac197df-6d93-4e2a-961c-83ed002df248"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 00:04:21.835802 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:21.835794 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ac197df-6d93-4e2a-961c-83ed002df248-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "4ac197df-6d93-4e2a-961c-83ed002df248" (UID: "4ac197df-6d93-4e2a-961c-83ed002df248"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 00:04:21.933911 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:21.933886 2560 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/4ac197df-6d93-4e2a-961c-83ed002df248-offline-tls\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 26 00:04:21.933911 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:21.933906 2560 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4ac197df-6d93-4e2a-961c-83ed002df248-feast-data\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 26 00:04:21.933911 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:21.933915 2560 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/4ac197df-6d93-4e2a-961c-83ed002df248-ui-tls\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 26 00:04:21.934105 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:21.933925 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2kkdl\" (UniqueName: \"kubernetes.io/projected/4ac197df-6d93-4e2a-961c-83ed002df248-kube-api-access-2kkdl\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 26 00:04:21.934105 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:21.933934 2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/4ac197df-6d93-4e2a-961c-83ed002df248-registry-tls\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 26 00:04:21.934105 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:21.933943 2560 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4ac197df-6d93-4e2a-961c-83ed002df248-online-tls\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 26 00:04:22.253219 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:22.253197 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" May 26 00:04:22.336842 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:22.336810 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0b619ef4-9cc5-4104-8e97-d474843a567f-registry-tls\") pod \"0b619ef4-9cc5-4104-8e97-d474843a567f\" (UID: \"0b619ef4-9cc5-4104-8e97-d474843a567f\") " May 26 00:04:22.337054 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:22.336863 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0b619ef4-9cc5-4104-8e97-d474843a567f-feast-data\") pod \"0b619ef4-9cc5-4104-8e97-d474843a567f\" (UID: \"0b619ef4-9cc5-4104-8e97-d474843a567f\") " May 26 00:04:22.337054 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:22.336899 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0b619ef4-9cc5-4104-8e97-d474843a567f-offline-tls\") pod \"0b619ef4-9cc5-4104-8e97-d474843a567f\" (UID: \"0b619ef4-9cc5-4104-8e97-d474843a567f\") " May 26 00:04:22.337162 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:22.337072 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5bkbk\" (UniqueName: \"kubernetes.io/projected/0b619ef4-9cc5-4104-8e97-d474843a567f-kube-api-access-5bkbk\") pod \"0b619ef4-9cc5-4104-8e97-d474843a567f\" (UID: \"0b619ef4-9cc5-4104-8e97-d474843a567f\") " May 26 00:04:22.337162 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:22.337133 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0b619ef4-9cc5-4104-8e97-d474843a567f-ui-tls\") pod \"0b619ef4-9cc5-4104-8e97-d474843a567f\" (UID: \"0b619ef4-9cc5-4104-8e97-d474843a567f\") " May 26 00:04:22.337162 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:22.337150 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0b619ef4-9cc5-4104-8e97-d474843a567f-online-tls\") pod \"0b619ef4-9cc5-4104-8e97-d474843a567f\" (UID: \"0b619ef4-9cc5-4104-8e97-d474843a567f\") " May 26 00:04:22.337552 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:22.337511 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b619ef4-9cc5-4104-8e97-d474843a567f-feast-data" (OuterVolumeSpecName: "feast-data") pod "0b619ef4-9cc5-4104-8e97-d474843a567f" (UID: "0b619ef4-9cc5-4104-8e97-d474843a567f"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 26 00:04:22.339189 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:22.339166 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b619ef4-9cc5-4104-8e97-d474843a567f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "0b619ef4-9cc5-4104-8e97-d474843a567f" (UID: "0b619ef4-9cc5-4104-8e97-d474843a567f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 00:04:22.339296 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:22.339186 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b619ef4-9cc5-4104-8e97-d474843a567f-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "0b619ef4-9cc5-4104-8e97-d474843a567f" (UID: "0b619ef4-9cc5-4104-8e97-d474843a567f"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 00:04:22.339353 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:22.339336 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b619ef4-9cc5-4104-8e97-d474843a567f-online-tls" (OuterVolumeSpecName: "online-tls") pod "0b619ef4-9cc5-4104-8e97-d474843a567f" (UID: "0b619ef4-9cc5-4104-8e97-d474843a567f"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 00:04:22.339752 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:22.339723 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b619ef4-9cc5-4104-8e97-d474843a567f-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "0b619ef4-9cc5-4104-8e97-d474843a567f" (UID: "0b619ef4-9cc5-4104-8e97-d474843a567f"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 00:04:22.339752 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:22.339727 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b619ef4-9cc5-4104-8e97-d474843a567f-kube-api-access-5bkbk" (OuterVolumeSpecName: "kube-api-access-5bkbk") pod "0b619ef4-9cc5-4104-8e97-d474843a567f" (UID: "0b619ef4-9cc5-4104-8e97-d474843a567f"). InnerVolumeSpecName "kube-api-access-5bkbk". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 00:04:22.437842 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:22.437817 2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0b619ef4-9cc5-4104-8e97-d474843a567f-registry-tls\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 26 00:04:22.437842 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:22.437843 2560 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0b619ef4-9cc5-4104-8e97-d474843a567f-feast-data\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 26 00:04:22.438121 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:22.437852 2560 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0b619ef4-9cc5-4104-8e97-d474843a567f-offline-tls\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 26 00:04:22.438121 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:22.437861 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5bkbk\" (UniqueName: \"kubernetes.io/projected/0b619ef4-9cc5-4104-8e97-d474843a567f-kube-api-access-5bkbk\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 26 00:04:22.438121 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:22.437872 2560 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0b619ef4-9cc5-4104-8e97-d474843a567f-ui-tls\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 26 00:04:22.438121 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:22.437881 2560 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0b619ef4-9cc5-4104-8e97-d474843a567f-online-tls\") on node \"ip-10-0-134-170.ec2.internal\" DevicePath \"\"" May 26 00:04:22.647379 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:22.647345 2560 generic.go:358] "Generic (PLEG): container finished" podID="0b619ef4-9cc5-4104-8e97-d474843a567f" containerID="ea9d24298e665e7aed5e2c6f891f9604a0b7385ddbf4ec2d11ca555093e69866" exitCode=137 May 26 00:04:22.647379 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:22.647373 2560 generic.go:358] "Generic (PLEG): container finished" podID="0b619ef4-9cc5-4104-8e97-d474843a567f" containerID="d70d932e1838ff225ae367251d3f67ecc40aa2889b98f1149b8c30e5b0211681" exitCode=137 May 26 00:04:22.647846 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:22.647416 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" May 26 00:04:22.647846 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:22.647431 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" event={"ID":"0b619ef4-9cc5-4104-8e97-d474843a567f","Type":"ContainerDied","Data":"ea9d24298e665e7aed5e2c6f891f9604a0b7385ddbf4ec2d11ca555093e69866"} May 26 00:04:22.647846 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:22.647473 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" event={"ID":"0b619ef4-9cc5-4104-8e97-d474843a567f","Type":"ContainerDied","Data":"d70d932e1838ff225ae367251d3f67ecc40aa2889b98f1149b8c30e5b0211681"} May 26 00:04:22.647846 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:22.647489 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5" event={"ID":"0b619ef4-9cc5-4104-8e97-d474843a567f","Type":"ContainerDied","Data":"4e7472ea15c23bc60df36dbe54d7b80a06a59c109ecb050503bbfebc51ad7325"} May 26 00:04:22.647846 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:22.647500 2560 scope.go:117] "RemoveContainer" containerID="7d9940043ccd26761580bd4a321185c2b12ca585442de56fef58621eb944de99" May 26 00:04:22.647846 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:22.647760 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh" May 26 00:04:22.658004 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:22.657961 2560 scope.go:117] "RemoveContainer" containerID="ea9d24298e665e7aed5e2c6f891f9604a0b7385ddbf4ec2d11ca555093e69866" May 26 00:04:22.665415 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:22.665377 2560 scope.go:117] "RemoveContainer" containerID="f32b425048bec270732154665e015d5640e8ecfa21c75bb931400eeabae5624d" May 26 00:04:22.667667 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:22.667643 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5"] May 26 00:04:22.670558 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:22.670535 2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-xzkx5"] May 26 00:04:22.673615 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:22.673596 2560 scope.go:117] "RemoveContainer" containerID="d70d932e1838ff225ae367251d3f67ecc40aa2889b98f1149b8c30e5b0211681" May 26 00:04:22.680880 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:22.680849 2560 scope.go:117] "RemoveContainer" containerID="49f5f3718ad933c6cb899a7987f668991e4e4acbb51f3e4a1289a1901eeb0f03" May 26 00:04:22.681497 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:22.681477 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh"] May 26 00:04:22.684422 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:22.684399 2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-2wbqh"] May 26 00:04:22.688209 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:22.688180 2560 scope.go:117] "RemoveContainer" containerID="27bf626cf7aded72c96a8318f2fc9397f50b3c2694a47250db5e2fd40e3a88ac" May 26 00:04:22.694887 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:22.694873 2560 scope.go:117] "RemoveContainer" containerID="7d9940043ccd26761580bd4a321185c2b12ca585442de56fef58621eb944de99" May 26 00:04:22.695164 ip-10-0-134-170 kubenswrapper[2560]: E0526 00:04:22.695143 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d9940043ccd26761580bd4a321185c2b12ca585442de56fef58621eb944de99\": container with ID starting with 7d9940043ccd26761580bd4a321185c2b12ca585442de56fef58621eb944de99 not found: ID does not exist" containerID="7d9940043ccd26761580bd4a321185c2b12ca585442de56fef58621eb944de99" May 26 00:04:22.695231 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:22.695174 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d9940043ccd26761580bd4a321185c2b12ca585442de56fef58621eb944de99"} err="failed to get container status \"7d9940043ccd26761580bd4a321185c2b12ca585442de56fef58621eb944de99\": rpc error: code = NotFound desc = could not find container \"7d9940043ccd26761580bd4a321185c2b12ca585442de56fef58621eb944de99\": container with ID starting with 7d9940043ccd26761580bd4a321185c2b12ca585442de56fef58621eb944de99 not found: ID does not exist" May 26 00:04:22.695231 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:22.695192 2560 scope.go:117] "RemoveContainer" containerID="ea9d24298e665e7aed5e2c6f891f9604a0b7385ddbf4ec2d11ca555093e69866" May 26 00:04:22.695448 ip-10-0-134-170 kubenswrapper[2560]: E0526 00:04:22.695429 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea9d24298e665e7aed5e2c6f891f9604a0b7385ddbf4ec2d11ca555093e69866\": container with ID starting with ea9d24298e665e7aed5e2c6f891f9604a0b7385ddbf4ec2d11ca555093e69866 not found: ID does not exist" containerID="ea9d24298e665e7aed5e2c6f891f9604a0b7385ddbf4ec2d11ca555093e69866" May 26 00:04:22.695505 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:22.695456 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea9d24298e665e7aed5e2c6f891f9604a0b7385ddbf4ec2d11ca555093e69866"} err="failed to get container status \"ea9d24298e665e7aed5e2c6f891f9604a0b7385ddbf4ec2d11ca555093e69866\": rpc error: code = NotFound desc = could not find container \"ea9d24298e665e7aed5e2c6f891f9604a0b7385ddbf4ec2d11ca555093e69866\": container with ID starting with ea9d24298e665e7aed5e2c6f891f9604a0b7385ddbf4ec2d11ca555093e69866 not found: ID does not exist" May 26 00:04:22.695505 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:22.695473 2560 scope.go:117] "RemoveContainer" containerID="f32b425048bec270732154665e015d5640e8ecfa21c75bb931400eeabae5624d" May 26 00:04:22.695691 ip-10-0-134-170 kubenswrapper[2560]: E0526 00:04:22.695672 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f32b425048bec270732154665e015d5640e8ecfa21c75bb931400eeabae5624d\": container with ID starting with f32b425048bec270732154665e015d5640e8ecfa21c75bb931400eeabae5624d not found: ID does not exist" containerID="f32b425048bec270732154665e015d5640e8ecfa21c75bb931400eeabae5624d" May 26 00:04:22.695754 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:22.695702 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f32b425048bec270732154665e015d5640e8ecfa21c75bb931400eeabae5624d"} err="failed to get container status \"f32b425048bec270732154665e015d5640e8ecfa21c75bb931400eeabae5624d\": rpc error: code = NotFound desc = could not find container \"f32b425048bec270732154665e015d5640e8ecfa21c75bb931400eeabae5624d\": container with ID starting with f32b425048bec270732154665e015d5640e8ecfa21c75bb931400eeabae5624d not found: ID does not exist" May 26 00:04:22.695754 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:22.695742 2560 scope.go:117] "RemoveContainer" containerID="d70d932e1838ff225ae367251d3f67ecc40aa2889b98f1149b8c30e5b0211681" May 26 00:04:22.696027 ip-10-0-134-170 kubenswrapper[2560]: E0526 00:04:22.696011 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d70d932e1838ff225ae367251d3f67ecc40aa2889b98f1149b8c30e5b0211681\": container with ID starting with d70d932e1838ff225ae367251d3f67ecc40aa2889b98f1149b8c30e5b0211681 not found: ID does not exist" containerID="d70d932e1838ff225ae367251d3f67ecc40aa2889b98f1149b8c30e5b0211681" May 26 00:04:22.696079 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:22.696031 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d70d932e1838ff225ae367251d3f67ecc40aa2889b98f1149b8c30e5b0211681"} err="failed to get container status \"d70d932e1838ff225ae367251d3f67ecc40aa2889b98f1149b8c30e5b0211681\": rpc error: code = NotFound desc = could not find container \"d70d932e1838ff225ae367251d3f67ecc40aa2889b98f1149b8c30e5b0211681\": container with ID starting with d70d932e1838ff225ae367251d3f67ecc40aa2889b98f1149b8c30e5b0211681 not found: ID does not exist" May 26 00:04:22.696079 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:22.696045 2560 scope.go:117] "RemoveContainer" containerID="49f5f3718ad933c6cb899a7987f668991e4e4acbb51f3e4a1289a1901eeb0f03" May 26 00:04:22.696260 ip-10-0-134-170 kubenswrapper[2560]: E0526 00:04:22.696245 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49f5f3718ad933c6cb899a7987f668991e4e4acbb51f3e4a1289a1901eeb0f03\": container with ID starting with 49f5f3718ad933c6cb899a7987f668991e4e4acbb51f3e4a1289a1901eeb0f03 not found: ID does not exist" containerID="49f5f3718ad933c6cb899a7987f668991e4e4acbb51f3e4a1289a1901eeb0f03" May 26 00:04:22.696309 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:22.696264 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49f5f3718ad933c6cb899a7987f668991e4e4acbb51f3e4a1289a1901eeb0f03"} err="failed to get container status \"49f5f3718ad933c6cb899a7987f668991e4e4acbb51f3e4a1289a1901eeb0f03\": rpc error: code = NotFound desc = could not find container \"49f5f3718ad933c6cb899a7987f668991e4e4acbb51f3e4a1289a1901eeb0f03\": container with ID starting with 49f5f3718ad933c6cb899a7987f668991e4e4acbb51f3e4a1289a1901eeb0f03 not found: ID does not exist" May 26 00:04:22.696309 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:22.696277 2560 scope.go:117] "RemoveContainer" containerID="27bf626cf7aded72c96a8318f2fc9397f50b3c2694a47250db5e2fd40e3a88ac" May 26 00:04:22.696481 ip-10-0-134-170 kubenswrapper[2560]: E0526 00:04:22.696465 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27bf626cf7aded72c96a8318f2fc9397f50b3c2694a47250db5e2fd40e3a88ac\": container with ID starting with 27bf626cf7aded72c96a8318f2fc9397f50b3c2694a47250db5e2fd40e3a88ac not found: ID does not exist" containerID="27bf626cf7aded72c96a8318f2fc9397f50b3c2694a47250db5e2fd40e3a88ac" May 26 00:04:22.696523 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:22.696484 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27bf626cf7aded72c96a8318f2fc9397f50b3c2694a47250db5e2fd40e3a88ac"} err="failed to get container status \"27bf626cf7aded72c96a8318f2fc9397f50b3c2694a47250db5e2fd40e3a88ac\": rpc error: code = NotFound desc = could not find container \"27bf626cf7aded72c96a8318f2fc9397f50b3c2694a47250db5e2fd40e3a88ac\": container with ID starting with 27bf626cf7aded72c96a8318f2fc9397f50b3c2694a47250db5e2fd40e3a88ac not found: ID does not exist" May 26 00:04:22.696523 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:22.696497 2560 scope.go:117] "RemoveContainer" containerID="7d9940043ccd26761580bd4a321185c2b12ca585442de56fef58621eb944de99" May 26 00:04:22.696729 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:22.696706 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d9940043ccd26761580bd4a321185c2b12ca585442de56fef58621eb944de99"} err="failed to get container status \"7d9940043ccd26761580bd4a321185c2b12ca585442de56fef58621eb944de99\": rpc error: code = NotFound desc = could not find container \"7d9940043ccd26761580bd4a321185c2b12ca585442de56fef58621eb944de99\": container with ID starting with 7d9940043ccd26761580bd4a321185c2b12ca585442de56fef58621eb944de99 not found: ID does not exist" May 26 00:04:22.696729 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:22.696727 2560 scope.go:117] "RemoveContainer" containerID="ea9d24298e665e7aed5e2c6f891f9604a0b7385ddbf4ec2d11ca555093e69866" May 26 00:04:22.696911 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:22.696895 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea9d24298e665e7aed5e2c6f891f9604a0b7385ddbf4ec2d11ca555093e69866"} err="failed to get container status \"ea9d24298e665e7aed5e2c6f891f9604a0b7385ddbf4ec2d11ca555093e69866\": rpc error: code = NotFound desc = could not find container \"ea9d24298e665e7aed5e2c6f891f9604a0b7385ddbf4ec2d11ca555093e69866\": container with ID starting with ea9d24298e665e7aed5e2c6f891f9604a0b7385ddbf4ec2d11ca555093e69866 not found: ID does not exist" May 26 00:04:22.696954 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:22.696911 2560 scope.go:117] "RemoveContainer" containerID="f32b425048bec270732154665e015d5640e8ecfa21c75bb931400eeabae5624d" May 26 00:04:22.697107 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:22.697091 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f32b425048bec270732154665e015d5640e8ecfa21c75bb931400eeabae5624d"} err="failed to get container status \"f32b425048bec270732154665e015d5640e8ecfa21c75bb931400eeabae5624d\": rpc error: code = NotFound desc = could not find container \"f32b425048bec270732154665e015d5640e8ecfa21c75bb931400eeabae5624d\": container with ID starting with f32b425048bec270732154665e015d5640e8ecfa21c75bb931400eeabae5624d not found: ID does not exist" May 26 00:04:22.697168 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:22.697107 2560 scope.go:117] "RemoveContainer" containerID="d70d932e1838ff225ae367251d3f67ecc40aa2889b98f1149b8c30e5b0211681" May 26 00:04:22.697296 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:22.697275 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d70d932e1838ff225ae367251d3f67ecc40aa2889b98f1149b8c30e5b0211681"} err="failed to get container status \"d70d932e1838ff225ae367251d3f67ecc40aa2889b98f1149b8c30e5b0211681\": rpc error: code = NotFound desc = could not find container \"d70d932e1838ff225ae367251d3f67ecc40aa2889b98f1149b8c30e5b0211681\": container with ID starting with d70d932e1838ff225ae367251d3f67ecc40aa2889b98f1149b8c30e5b0211681 not found: ID does not exist" May 26 00:04:22.697296 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:22.697291 2560 scope.go:117] "RemoveContainer" containerID="49f5f3718ad933c6cb899a7987f668991e4e4acbb51f3e4a1289a1901eeb0f03" May 26 00:04:22.697499 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:22.697482 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49f5f3718ad933c6cb899a7987f668991e4e4acbb51f3e4a1289a1901eeb0f03"} err="failed to get container status \"49f5f3718ad933c6cb899a7987f668991e4e4acbb51f3e4a1289a1901eeb0f03\": rpc error: code = NotFound desc = could not find container \"49f5f3718ad933c6cb899a7987f668991e4e4acbb51f3e4a1289a1901eeb0f03\": container with ID starting with 49f5f3718ad933c6cb899a7987f668991e4e4acbb51f3e4a1289a1901eeb0f03 not found: ID does not exist" May 26 00:04:22.697546 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:22.697499 2560 scope.go:117] "RemoveContainer" containerID="27bf626cf7aded72c96a8318f2fc9397f50b3c2694a47250db5e2fd40e3a88ac" May 26 00:04:22.697679 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:22.697657 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27bf626cf7aded72c96a8318f2fc9397f50b3c2694a47250db5e2fd40e3a88ac"} err="failed to get container status \"27bf626cf7aded72c96a8318f2fc9397f50b3c2694a47250db5e2fd40e3a88ac\": rpc error: code = NotFound desc = could not find container \"27bf626cf7aded72c96a8318f2fc9397f50b3c2694a47250db5e2fd40e3a88ac\": container with ID starting with 27bf626cf7aded72c96a8318f2fc9397f50b3c2694a47250db5e2fd40e3a88ac not found: ID does not exist" May 26 00:04:24.545079 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:24.545044 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b619ef4-9cc5-4104-8e97-d474843a567f" path="/var/lib/kubelet/pods/0b619ef4-9cc5-4104-8e97-d474843a567f/volumes" May 26 00:04:24.545833 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:04:24.545809 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ac197df-6d93-4e2a-961c-83ed002df248" path="/var/lib/kubelet/pods/4ac197df-6d93-4e2a-961c-83ed002df248/volumes" May 26 00:05:01.201003 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:01.200963 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-dr7pq_d8801da9-38b0-4cfc-bc00-fbc7cce6ae1a/global-pull-secret-syncer/0.log" May 26 00:05:01.294880 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:01.294853 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-2qd5w_e44b2c4f-59b8-4b76-80a5-1b3baa90a6db/konnectivity-agent/0.log" May 26 00:05:01.415570 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:01.415542 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-170.ec2.internal_e7a923675e9bf9e023936dfbefc39d5a/haproxy/0.log" May 26 00:05:02.568037 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:02.568004 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-czsc7_c028769b-0a8b-4a6e-8572-91c89c7879de/ovn-acl-logging/0.log" May 26 00:05:02.570254 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:02.570234 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-czsc7_c028769b-0a8b-4a6e-8572-91c89c7879de/ovn-acl-logging/0.log" May 26 00:05:04.722088 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:04.722051 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-6lpv9_0e6458a2-3845-4a30-91fd-294be02aca29/kube-state-metrics/0.log" May 26 00:05:04.742125 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:04.742093 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-6lpv9_0e6458a2-3845-4a30-91fd-294be02aca29/kube-rbac-proxy-main/0.log" May 26 00:05:04.762588 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:04.762561 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-6lpv9_0e6458a2-3845-4a30-91fd-294be02aca29/kube-rbac-proxy-self/0.log" May 26 00:05:04.815048 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:04.815024 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-x67zk_4b94d60b-988f-4438-83f1-d0565943b3c1/monitoring-plugin/0.log" May 26 00:05:04.913556 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:04.913527 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-js7jj_87c8c237-457a-4573-adf8-c8729124bb9c/node-exporter/0.log" May 26 00:05:04.936256 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:04.936239 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-js7jj_87c8c237-457a-4573-adf8-c8729124bb9c/kube-rbac-proxy/0.log" May 26 00:05:04.959711 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:04.959693 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-js7jj_87c8c237-457a-4573-adf8-c8729124bb9c/init-textfile/0.log" May 26 00:05:05.066703 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:05.066634 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-mkzjd_5563295b-45f9-45e1-9811-41f36c1edcac/kube-rbac-proxy-main/0.log" May 26 00:05:05.086706 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:05.086666 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-mkzjd_5563295b-45f9-45e1-9811-41f36c1edcac/kube-rbac-proxy-self/0.log" May 26 00:05:05.107548 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:05.107528 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-mkzjd_5563295b-45f9-45e1-9811-41f36c1edcac/openshift-state-metrics/0.log" May 26 00:05:05.143388 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:05.143368 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_116a99c3-ad86-4115-8e0e-df7d17d2094d/prometheus/0.log" May 26 00:05:05.163958 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:05.163939 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_116a99c3-ad86-4115-8e0e-df7d17d2094d/config-reloader/0.log" May 26 00:05:05.184157 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:05.184136 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_116a99c3-ad86-4115-8e0e-df7d17d2094d/thanos-sidecar/0.log" May 26 00:05:05.207311 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:05.207296 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_116a99c3-ad86-4115-8e0e-df7d17d2094d/kube-rbac-proxy-web/0.log" May 26 00:05:05.227213 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:05.227197 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_116a99c3-ad86-4115-8e0e-df7d17d2094d/kube-rbac-proxy/0.log" May 26 00:05:05.247433 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:05.247418 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_116a99c3-ad86-4115-8e0e-df7d17d2094d/kube-rbac-proxy-thanos/0.log" May 26 00:05:05.267547 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:05.267523 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_116a99c3-ad86-4115-8e0e-df7d17d2094d/init-config-reloader/0.log" May 26 00:05:05.313208 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:05.313179 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-cvbr7_33a5da7c-175d-47e9-a1ba-164343f317a8/prometheus-operator/0.log" May 26 00:05:05.332664 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:05.332599 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-cvbr7_33a5da7c-175d-47e9-a1ba-164343f317a8/kube-rbac-proxy/0.log" May 26 00:05:07.439742 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:07.439715 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7b644f4669-f8h28_5f3392c6-a3b7-4cc5-8fd2-1c426806baaf/console/0.log" May 26 00:05:07.466270 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:07.466247 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-57bd96b888-42gd6_7e545f97-36d2-4fe6-b869-f6246bb28ee8/download-server/0.log" May 26 00:05:08.171126 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:08.171090 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-j8rpn/perf-node-gather-daemonset-hzgrn"] May 26 00:05:08.171370 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:08.171358 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b619ef4-9cc5-4104-8e97-d474843a567f" containerName="online" May 26 00:05:08.171420 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:08.171371 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b619ef4-9cc5-4104-8e97-d474843a567f" containerName="online" May 26 00:05:08.171420 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:08.171381 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ac197df-6d93-4e2a-961c-83ed002df248" containerName="feast-apply" May 26 00:05:08.171420 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:08.171386 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ac197df-6d93-4e2a-961c-83ed002df248" containerName="feast-apply" May 26 00:05:08.171420 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:08.171393 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ac197df-6d93-4e2a-961c-83ed002df248" containerName="ui" May 26 00:05:08.171420 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:08.171398 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ac197df-6d93-4e2a-961c-83ed002df248" containerName="ui" May 26 00:05:08.171420 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:08.171408 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b619ef4-9cc5-4104-8e97-d474843a567f" containerName="ui" May 26 00:05:08.171420 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:08.171413 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b619ef4-9cc5-4104-8e97-d474843a567f" containerName="ui" May 26 00:05:08.171420 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:08.171419 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ac197df-6d93-4e2a-961c-83ed002df248" containerName="online" May 26 00:05:08.171652 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:08.171424 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ac197df-6d93-4e2a-961c-83ed002df248" containerName="online" May 26 00:05:08.171652 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:08.171431 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ac197df-6d93-4e2a-961c-83ed002df248" containerName="offline" May 26 00:05:08.171652 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:08.171437 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ac197df-6d93-4e2a-961c-83ed002df248" containerName="offline" May 26 00:05:08.171652 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:08.171443 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b619ef4-9cc5-4104-8e97-d474843a567f" containerName="feast-init" May 26 00:05:08.171652 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:08.171448 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b619ef4-9cc5-4104-8e97-d474843a567f" containerName="feast-init" May 26 00:05:08.171652 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:08.171454 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b619ef4-9cc5-4104-8e97-d474843a567f" containerName="registry" May 26 00:05:08.171652 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:08.171458 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b619ef4-9cc5-4104-8e97-d474843a567f" containerName="registry" May 26 00:05:08.171652 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:08.171465 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b619ef4-9cc5-4104-8e97-d474843a567f" containerName="offline" May 26 00:05:08.171652 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:08.171470 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b619ef4-9cc5-4104-8e97-d474843a567f" containerName="offline" May 26 00:05:08.171652 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:08.171478 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ac197df-6d93-4e2a-961c-83ed002df248" containerName="feast-init" May 26 00:05:08.171652 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:08.171483 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ac197df-6d93-4e2a-961c-83ed002df248" containerName="feast-init" May 26 00:05:08.171652 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:08.171490 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b619ef4-9cc5-4104-8e97-d474843a567f" containerName="feast-apply" May 26 00:05:08.171652 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:08.171495 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b619ef4-9cc5-4104-8e97-d474843a567f" containerName="feast-apply" May 26 00:05:08.171652 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:08.171533 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="0b619ef4-9cc5-4104-8e97-d474843a567f" containerName="online" May 26 00:05:08.171652 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:08.171541 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="4ac197df-6d93-4e2a-961c-83ed002df248" containerName="ui" May 26 00:05:08.171652 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:08.171548 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="0b619ef4-9cc5-4104-8e97-d474843a567f" containerName="ui" May 26 00:05:08.171652 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:08.171554 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="4ac197df-6d93-4e2a-961c-83ed002df248" containerName="offline" May 26 00:05:08.171652 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:08.171560 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="4ac197df-6d93-4e2a-961c-83ed002df248" containerName="online" May 26 00:05:08.171652 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:08.171566 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="0b619ef4-9cc5-4104-8e97-d474843a567f" containerName="registry" May 26 00:05:08.171652 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:08.171571 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="0b619ef4-9cc5-4104-8e97-d474843a567f" containerName="offline" May 26 00:05:08.176313 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:08.176289 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-j8rpn/perf-node-gather-daemonset-hzgrn" May 26 00:05:08.178775 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:08.178756 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-j8rpn\"/\"kube-root-ca.crt\"" May 26 00:05:08.180109 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:08.180085 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-j8rpn\"/\"openshift-service-ca.crt\"" May 26 00:05:08.180638 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:08.180612 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-j8rpn\"/\"default-dockercfg-wrltz\"" May 26 00:05:08.181788 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:08.181677 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-j8rpn/perf-node-gather-daemonset-hzgrn"] May 26 00:05:08.264687 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:08.264667 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9f17da61-13a3-4b57-9575-ba29055e62c3-podres\") pod \"perf-node-gather-daemonset-hzgrn\" (UID: \"9f17da61-13a3-4b57-9575-ba29055e62c3\") " pod="openshift-must-gather-j8rpn/perf-node-gather-daemonset-hzgrn" May 26 00:05:08.264795 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:08.264698 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9f17da61-13a3-4b57-9575-ba29055e62c3-sys\") pod \"perf-node-gather-daemonset-hzgrn\" (UID: \"9f17da61-13a3-4b57-9575-ba29055e62c3\") " pod="openshift-must-gather-j8rpn/perf-node-gather-daemonset-hzgrn" May 26 00:05:08.264795 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:08.264715 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9f17da61-13a3-4b57-9575-ba29055e62c3-proc\") pod \"perf-node-gather-daemonset-hzgrn\" (UID: \"9f17da61-13a3-4b57-9575-ba29055e62c3\") " pod="openshift-must-gather-j8rpn/perf-node-gather-daemonset-hzgrn" May 26 00:05:08.264795 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:08.264748 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9f17da61-13a3-4b57-9575-ba29055e62c3-lib-modules\") pod \"perf-node-gather-daemonset-hzgrn\" (UID: \"9f17da61-13a3-4b57-9575-ba29055e62c3\") " pod="openshift-must-gather-j8rpn/perf-node-gather-daemonset-hzgrn" May 26 00:05:08.264795 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:08.264772 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lwwv\" (UniqueName: \"kubernetes.io/projected/9f17da61-13a3-4b57-9575-ba29055e62c3-kube-api-access-9lwwv\") pod \"perf-node-gather-daemonset-hzgrn\" (UID: \"9f17da61-13a3-4b57-9575-ba29055e62c3\") " pod="openshift-must-gather-j8rpn/perf-node-gather-daemonset-hzgrn" May 26 00:05:08.366056 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:08.366031 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9f17da61-13a3-4b57-9575-ba29055e62c3-podres\") pod \"perf-node-gather-daemonset-hzgrn\" (UID: \"9f17da61-13a3-4b57-9575-ba29055e62c3\") " pod="openshift-must-gather-j8rpn/perf-node-gather-daemonset-hzgrn" May 26 00:05:08.366153 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:08.366070 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9f17da61-13a3-4b57-9575-ba29055e62c3-sys\") pod \"perf-node-gather-daemonset-hzgrn\" (UID: \"9f17da61-13a3-4b57-9575-ba29055e62c3\") " pod="openshift-must-gather-j8rpn/perf-node-gather-daemonset-hzgrn" May 26 00:05:08.366153 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:08.366086 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9f17da61-13a3-4b57-9575-ba29055e62c3-proc\") pod \"perf-node-gather-daemonset-hzgrn\" (UID: \"9f17da61-13a3-4b57-9575-ba29055e62c3\") " pod="openshift-must-gather-j8rpn/perf-node-gather-daemonset-hzgrn" May 26 00:05:08.366153 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:08.366133 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9f17da61-13a3-4b57-9575-ba29055e62c3-lib-modules\") pod \"perf-node-gather-daemonset-hzgrn\" (UID: \"9f17da61-13a3-4b57-9575-ba29055e62c3\") " pod="openshift-must-gather-j8rpn/perf-node-gather-daemonset-hzgrn" May 26 00:05:08.366153 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:08.366151 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9f17da61-13a3-4b57-9575-ba29055e62c3-proc\") pod \"perf-node-gather-daemonset-hzgrn\" (UID: \"9f17da61-13a3-4b57-9575-ba29055e62c3\") " pod="openshift-must-gather-j8rpn/perf-node-gather-daemonset-hzgrn" May 26 00:05:08.366313 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:08.366178 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9lwwv\" (UniqueName: \"kubernetes.io/projected/9f17da61-13a3-4b57-9575-ba29055e62c3-kube-api-access-9lwwv\") pod \"perf-node-gather-daemonset-hzgrn\" (UID: \"9f17da61-13a3-4b57-9575-ba29055e62c3\") " pod="openshift-must-gather-j8rpn/perf-node-gather-daemonset-hzgrn" May 26 00:05:08.366313 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:08.366187 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9f17da61-13a3-4b57-9575-ba29055e62c3-podres\") pod \"perf-node-gather-daemonset-hzgrn\" (UID: \"9f17da61-13a3-4b57-9575-ba29055e62c3\") " pod="openshift-must-gather-j8rpn/perf-node-gather-daemonset-hzgrn" May 26 00:05:08.366313 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:08.366220 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9f17da61-13a3-4b57-9575-ba29055e62c3-sys\") pod \"perf-node-gather-daemonset-hzgrn\" (UID: \"9f17da61-13a3-4b57-9575-ba29055e62c3\") " pod="openshift-must-gather-j8rpn/perf-node-gather-daemonset-hzgrn" May 26 00:05:08.366313 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:08.366234 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9f17da61-13a3-4b57-9575-ba29055e62c3-lib-modules\") pod \"perf-node-gather-daemonset-hzgrn\" (UID: \"9f17da61-13a3-4b57-9575-ba29055e62c3\") " pod="openshift-must-gather-j8rpn/perf-node-gather-daemonset-hzgrn" May 26 00:05:08.373541 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:08.373524 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lwwv\" (UniqueName: \"kubernetes.io/projected/9f17da61-13a3-4b57-9575-ba29055e62c3-kube-api-access-9lwwv\") pod \"perf-node-gather-daemonset-hzgrn\" (UID: \"9f17da61-13a3-4b57-9575-ba29055e62c3\") " pod="openshift-must-gather-j8rpn/perf-node-gather-daemonset-hzgrn" May 26 00:05:08.486760 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:08.486730 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-j8rpn/perf-node-gather-daemonset-hzgrn" May 26 00:05:08.504601 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:08.504582 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jd6l5_6b99a20d-9af5-4ef1-b9f7-8e617d24226b/dns/0.log" May 26 00:05:08.523802 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:08.523771 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jd6l5_6b99a20d-9af5-4ef1-b9f7-8e617d24226b/kube-rbac-proxy/0.log" May 26 00:05:08.612708 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:08.612668 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-j8rpn/perf-node-gather-daemonset-hzgrn"] May 26 00:05:08.616085 ip-10-0-134-170 kubenswrapper[2560]: W0526 00:05:08.616058 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9f17da61_13a3_4b57_9575_ba29055e62c3.slice/crio-e5146f574b59f54fdc5a1e8757a98ed69f4656ca03c3438791753278ccec62f6 WatchSource:0}: Error finding container e5146f574b59f54fdc5a1e8757a98ed69f4656ca03c3438791753278ccec62f6: Status 404 returned error can't find the container with id e5146f574b59f54fdc5a1e8757a98ed69f4656ca03c3438791753278ccec62f6 May 26 00:05:08.617853 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:08.617832 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 26 00:05:08.619868 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:08.619847 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-m6fz8_44b28b26-a51c-45ae-b6ff-4511af730e83/dns-node-resolver/0.log" May 26 00:05:08.779825 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:08.779734 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-j8rpn/perf-node-gather-daemonset-hzgrn" event={"ID":"9f17da61-13a3-4b57-9575-ba29055e62c3","Type":"ContainerStarted","Data":"cdedda257980ca782af8d9f734abbf94db8646190a49d45d024ae4f2e86aa4b4"} May 26 00:05:08.779825 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:08.779793 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-j8rpn/perf-node-gather-daemonset-hzgrn" event={"ID":"9f17da61-13a3-4b57-9575-ba29055e62c3","Type":"ContainerStarted","Data":"e5146f574b59f54fdc5a1e8757a98ed69f4656ca03c3438791753278ccec62f6"} May 26 00:05:08.780015 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:08.779860 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-j8rpn/perf-node-gather-daemonset-hzgrn" May 26 00:05:08.793520 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:08.793473 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-j8rpn/perf-node-gather-daemonset-hzgrn" podStartSLOduration=0.793458261 podStartE2EDuration="793.458261ms" podCreationTimestamp="2026-05-26 00:05:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 00:05:08.793240825 +0000 UTC m=+1806.872136476" watchObservedRunningTime="2026-05-26 00:05:08.793458261 +0000 UTC m=+1806.872353914" May 26 00:05:09.065454 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:09.065381 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k2fns_fe7ac5fe-b41b-41e5-b935-9c562ade089b/node-ca/0.log" May 26 00:05:10.197829 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:10.197793 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-v5mf6_fcb22698-3864-4a79-8464-4c29e38c694c/serve-healthcheck-canary/0.log" May 26 00:05:10.683921 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:10.683896 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mzfdm_e4be6a30-ee1f-4486-a0d7-8ed296775159/kube-rbac-proxy/0.log" May 26 00:05:10.702615 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:10.702592 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mzfdm_e4be6a30-ee1f-4486-a0d7-8ed296775159/exporter/0.log" May 26 00:05:10.720955 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:10.720936 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mzfdm_e4be6a30-ee1f-4486-a0d7-8ed296775159/extractor/0.log" May 26 00:05:14.792099 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:14.792074 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-j8rpn/perf-node-gather-daemonset-hzgrn" May 26 00:05:15.585189 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:15.585158 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7tm79_08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60/kube-multus-additional-cni-plugins/0.log" May 26 00:05:15.604456 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:15.604435 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7tm79_08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60/egress-router-binary-copy/0.log" May 26 00:05:15.629561 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:15.629533 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7tm79_08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60/cni-plugins/0.log" May 26 00:05:15.648236 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:15.648211 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7tm79_08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60/bond-cni-plugin/0.log" May 26 00:05:15.666931 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:15.666911 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7tm79_08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60/routeoverride-cni/0.log" May 26 00:05:15.685472 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:15.685456 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7tm79_08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60/whereabouts-cni-bincopy/0.log" May 26 00:05:15.704585 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:15.704561 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7tm79_08c094dc-ad87-41cf-b0f5-8ac7eb5f1c60/whereabouts-cni/0.log" May 26 00:05:16.038499 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:16.038466 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-njpdd_ab4b6ed7-9908-40ab-821d-59fb80e9d23f/kube-multus/0.log" May 26 00:05:16.090571 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:16.090546 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7ws64_694e83a1-a7ed-4246-a57b-6ba3e80ae3ba/network-metrics-daemon/0.log" May 26 00:05:16.108607 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:16.108583 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7ws64_694e83a1-a7ed-4246-a57b-6ba3e80ae3ba/kube-rbac-proxy/0.log" May 26 00:05:17.220082 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:17.220052 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-czsc7_c028769b-0a8b-4a6e-8572-91c89c7879de/ovn-controller/0.log" May 26 00:05:17.238599 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:17.238575 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-czsc7_c028769b-0a8b-4a6e-8572-91c89c7879de/ovn-acl-logging/0.log" May 26 00:05:17.246334 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:17.246311 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-czsc7_c028769b-0a8b-4a6e-8572-91c89c7879de/ovn-acl-logging/1.log" May 26 00:05:17.263022 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:17.262983 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-czsc7_c028769b-0a8b-4a6e-8572-91c89c7879de/kube-rbac-proxy-node/0.log" May 26 00:05:17.281888 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:17.281868 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-czsc7_c028769b-0a8b-4a6e-8572-91c89c7879de/kube-rbac-proxy-ovn-metrics/0.log" May 26 00:05:17.300729 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:17.300706 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-czsc7_c028769b-0a8b-4a6e-8572-91c89c7879de/northd/0.log" May 26 00:05:17.319811 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:17.319782 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-czsc7_c028769b-0a8b-4a6e-8572-91c89c7879de/nbdb/0.log" May 26 00:05:17.340384 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:17.340362 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-czsc7_c028769b-0a8b-4a6e-8572-91c89c7879de/sbdb/0.log" May 26 00:05:17.446430 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:17.446395 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-czsc7_c028769b-0a8b-4a6e-8572-91c89c7879de/ovnkube-controller/0.log" May 26 00:05:18.869854 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:18.869826 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-twhc6_053dd95b-4d61-480d-8a80-645cf902780e/network-check-target-container/0.log" May 26 00:05:20.009476 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:20.009450 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-5hmf8_8b33ef50-e2af-46ac-879b-c7fe139c78d0/iptables-alerter/0.log" May 26 00:05:20.679610 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:20.679576 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-xxcq5_7f8e8195-2832-443e-bf4d-3ffaf3ebc923/tuned/0.log" May 26 00:05:23.809935 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:23.809908 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-l8xmd_254029cd-e52b-4d4a-904a-e30af2b6c681/csi-driver/0.log" May 26 00:05:23.832811 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:23.832782 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-l8xmd_254029cd-e52b-4d4a-904a-e30af2b6c681/csi-node-driver-registrar/0.log" May 26 00:05:23.856056 ip-10-0-134-170 kubenswrapper[2560]: I0526 00:05:23.854273 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-l8xmd_254029cd-e52b-4d4a-904a-e30af2b6c681/csi-liveness-probe/0.log"