May 28 09:28:41.477899 ip-10-0-139-204 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
May 28 09:28:41.477911 ip-10-0-139-204 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
May 28 09:28:41.477918 ip-10-0-139-204 systemd[1]: kubelet.service: Failed with result 'resources'.
May 28 09:28:41.478121 ip-10-0-139-204 systemd[1]: Failed to start Kubernetes Kubelet.
May 28 09:28:52.712868 ip-10-0-139-204 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
May 28 09:28:52.712884 ip-10-0-139-204 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot dfd186a672c54426afd85e5ceddcb751 --
May 28 09:31:11.182311 ip-10-0-139-204 systemd[1]: Starting Kubernetes Kubelet...
May 28 09:31:11.680622 ip-10-0-139-204 kubenswrapper[2572]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 09:31:11.680622 ip-10-0-139-204 kubenswrapper[2572]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 28 09:31:11.680622 ip-10-0-139-204 kubenswrapper[2572]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 09:31:11.680622 ip-10-0-139-204 kubenswrapper[2572]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 28 09:31:11.680622 ip-10-0-139-204 kubenswrapper[2572]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 09:31:11.681482 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.681391    2572 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 28 09:31:11.685048 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685030    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 09:31:11.685048 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685048    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 09:31:11.685123 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685052    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 09:31:11.685123 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685055    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 09:31:11.685123 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685058    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 09:31:11.685123 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685061    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 09:31:11.685123 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685064    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 09:31:11.685123 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685067    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 09:31:11.685123 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685069    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 09:31:11.685123 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685072    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 09:31:11.685123 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685075    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 09:31:11.685123 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685078    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 09:31:11.685123 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685080    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 09:31:11.685123 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685083    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 09:31:11.685123 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685085    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 09:31:11.685123 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685088    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 09:31:11.685123 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685092    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 09:31:11.685123 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685094    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 09:31:11.685123 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685097    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 09:31:11.685123 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685101    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 09:31:11.685123 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685105    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 09:31:11.685587 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685109    2572 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 09:31:11.685587 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685112    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 09:31:11.685587 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685114    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 09:31:11.685587 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685117    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 09:31:11.685587 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685122    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 09:31:11.685587 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685126    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 09:31:11.685587 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685129    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 09:31:11.685587 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685133    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 09:31:11.685587 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685136    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 09:31:11.685587 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685139    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 09:31:11.685587 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685142    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 09:31:11.685587 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685145    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 09:31:11.685587 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685147    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 09:31:11.685587 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685150    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 09:31:11.685587 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685152    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 09:31:11.685587 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685155    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 09:31:11.685587 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685157    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 09:31:11.685587 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685160    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 09:31:11.685587 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685162    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 09:31:11.685587 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685165    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 09:31:11.686103 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685169    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 09:31:11.686103 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685173    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 09:31:11.686103 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685175    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 09:31:11.686103 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685178    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 09:31:11.686103 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685180    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 09:31:11.686103 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685183    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 09:31:11.686103 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685185    2572 feature_gate.go:328] unrecognized feature gate: Example2
May 28 09:31:11.686103 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685187    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 09:31:11.686103 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685190    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 09:31:11.686103 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685192    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 09:31:11.686103 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685195    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 09:31:11.686103 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685197    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 09:31:11.686103 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685200    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 09:31:11.686103 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685204    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 09:31:11.686103 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685206    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 09:31:11.686103 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685209    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 09:31:11.686103 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685212    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 09:31:11.686103 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685214    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 09:31:11.686103 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685217    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 09:31:11.686103 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685220    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 09:31:11.686588 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685222    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 09:31:11.686588 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685225    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 09:31:11.686588 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685227    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 09:31:11.686588 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685229    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 09:31:11.686588 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685232    2572 feature_gate.go:328] unrecognized feature gate: Example
May 28 09:31:11.686588 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685235    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 09:31:11.686588 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685239    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 09:31:11.686588 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685242    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 09:31:11.686588 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685244    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 09:31:11.686588 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685247    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 09:31:11.686588 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685249    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 09:31:11.686588 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685252    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 09:31:11.686588 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685254    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 09:31:11.686588 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685257    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 09:31:11.686588 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685259    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 09:31:11.686588 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685262    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 09:31:11.686588 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685264    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 09:31:11.686588 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685267    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 09:31:11.686588 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685270    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 09:31:11.686588 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685272    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 09:31:11.687096 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685274    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 09:31:11.687096 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685277    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 09:31:11.687096 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685279    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 09:31:11.687096 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685282    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 09:31:11.687096 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685284    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 09:31:11.687096 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685692    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 09:31:11.687096 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685697    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 09:31:11.687096 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685700    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 09:31:11.687096 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685703    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 09:31:11.687096 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685706    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 09:31:11.687096 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685708    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 09:31:11.687096 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685711    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 09:31:11.687096 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685714    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 09:31:11.687096 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685717    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 09:31:11.687096 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685719    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 09:31:11.687096 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685722    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 09:31:11.687096 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685724    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 09:31:11.687096 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685730    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 09:31:11.687096 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685733    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 09:31:11.687096 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685736    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 09:31:11.687581 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685738    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 09:31:11.687581 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685741    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 09:31:11.687581 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685743    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 09:31:11.687581 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685746    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 09:31:11.687581 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685748    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 09:31:11.687581 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685753    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 09:31:11.687581 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685756    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 09:31:11.687581 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685760    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 09:31:11.687581 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685763    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 09:31:11.687581 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685767    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 09:31:11.687581 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685770    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 09:31:11.687581 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685773    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 09:31:11.687581 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685775    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 09:31:11.687581 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685778    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 09:31:11.687581 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685781    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 09:31:11.687581 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685783    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 09:31:11.687581 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685786    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 09:31:11.687581 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685791    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 09:31:11.687581 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685794    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 09:31:11.688101 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685796    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 09:31:11.688101 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685798    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 09:31:11.688101 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685801    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 09:31:11.688101 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685803    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 09:31:11.688101 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685806    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 09:31:11.688101 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685808    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 09:31:11.688101 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685811    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 09:31:11.688101 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685813    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 09:31:11.688101 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685816    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 09:31:11.688101 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685818    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 09:31:11.688101 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685820    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 09:31:11.688101 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685823    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 09:31:11.688101 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685826    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 09:31:11.688101 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685828    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 09:31:11.688101 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685830    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 09:31:11.688101 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685833    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 09:31:11.688101 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685835    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 09:31:11.688101 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685838    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 09:31:11.688101 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685840    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 09:31:11.688101 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685843    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 09:31:11.688602 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685845    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 09:31:11.688602 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685848    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 09:31:11.688602 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685851    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 09:31:11.688602 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685854    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 09:31:11.688602 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685856    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 09:31:11.688602 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685859    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 09:31:11.688602 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685861    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 09:31:11.688602 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685864    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 09:31:11.688602 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685866    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 09:31:11.688602 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685869    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 09:31:11.688602 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685873    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 09:31:11.688602 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685876    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 09:31:11.688602 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685879    2572 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 09:31:11.688602 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685881    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 09:31:11.688602 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685884    2572 feature_gate.go:328] unrecognized feature gate: Example
May 28 09:31:11.688602 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685886    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 09:31:11.688602 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685889    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 09:31:11.688602 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685891    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 09:31:11.688602 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685893    2572 feature_gate.go:328] unrecognized feature gate: Example2
May 28 09:31:11.689087 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685897    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 09:31:11.689087 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685899    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 09:31:11.689087 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685902    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 09:31:11.689087 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685904    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 09:31:11.689087 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685907    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 09:31:11.689087 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685910    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 09:31:11.689087 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685912    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 09:31:11.689087 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685915    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 09:31:11.689087 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685917    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 09:31:11.689087 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685920    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 09:31:11.689087 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685922    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 09:31:11.689087 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685925    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 09:31:11.689087 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.685927    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 09:31:11.689087 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687243    2572 flags.go:64] FLAG: --address="0.0.0.0"
May 28 09:31:11.689087 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687254    2572 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 28 09:31:11.689087 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687263    2572 flags.go:64] FLAG: --anonymous-auth="true"
May 28 09:31:11.689087 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687268    2572 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 28 09:31:11.689087 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687273    2572 flags.go:64] FLAG: --authentication-token-webhook="false"
May 28 09:31:11.689087 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687277    2572 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 28 09:31:11.689087 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687282    2572 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 28 09:31:11.689087 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687287    2572 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 28 09:31:11.689614 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687290    2572 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 28 09:31:11.689614 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687293    2572 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 28 09:31:11.689614 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687297    2572 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 28 09:31:11.689614 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687301    2572 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 28 09:31:11.689614 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687305    2572 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 28 09:31:11.689614 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687308    2572 flags.go:64] FLAG: --cgroup-root=""
May 28 09:31:11.689614 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687311    2572 flags.go:64] FLAG: --cgroups-per-qos="true"
May 28 09:31:11.689614 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687314    2572 flags.go:64] FLAG: --client-ca-file=""
May 28 09:31:11.689614 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687317    2572 flags.go:64] FLAG: --cloud-config=""
May 28 09:31:11.689614 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687320    2572 flags.go:64] FLAG: --cloud-provider="external"
May 28 09:31:11.689614 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687323    2572 flags.go:64] FLAG: --cluster-dns="[]"
May 28 09:31:11.689614 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687328    2572 flags.go:64] FLAG: --cluster-domain=""
May 28 09:31:11.689614 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687331    2572 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 28 09:31:11.689614 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687334    2572 flags.go:64] FLAG: --config-dir=""
May 28 09:31:11.689614 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687337    2572 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 28 09:31:11.689614 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687340    2572 flags.go:64] FLAG: --container-log-max-files="5"
May 28 09:31:11.689614 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687345    2572 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 28 09:31:11.689614 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687351    2572 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 28 09:31:11.689614 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687355    2572 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 28 09:31:11.689614 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687359    2572 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 28 09:31:11.689614 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687362    2572 flags.go:64] FLAG: --contention-profiling="false"
May 28 09:31:11.689614 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687365    2572 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 28 09:31:11.689614 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687368    2572 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 28 09:31:11.689614 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687371    2572 flags.go:64] FLAG: --cpu-manager-policy="none"
May 28 09:31:11.689614 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687375    2572 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 28 09:31:11.690248 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687379    2572 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 28 09:31:11.690248 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687382    2572 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 28 09:31:11.690248 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687385    2572 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 28 09:31:11.690248 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687388    2572 flags.go:64] FLAG: --enable-load-reader="false"
May 28 09:31:11.690248 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687391    2572 flags.go:64] FLAG: --enable-server="true"
May 28 09:31:11.690248 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687394    2572 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 28 09:31:11.690248 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687402    2572 flags.go:64] FLAG: --event-burst="100"
May 28 09:31:11.690248 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687405    2572 flags.go:64] FLAG: --event-qps="50"
May 28 09:31:11.690248 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687408    2572 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 28 09:31:11.690248 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687411    2572 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 28 09:31:11.690248 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687415    2572 flags.go:64] FLAG: --eviction-hard=""
May 28 09:31:11.690248 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687418    2572 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 28 09:31:11.690248 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687421    2572 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 28 09:31:11.690248 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687424    2572 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 28 09:31:11.690248 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687427    2572 flags.go:64] FLAG: --eviction-soft=""
May 28 09:31:11.690248 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687430    2572 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 28 09:31:11.690248 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687433    2572 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 28 09:31:11.690248 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687436    2572 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 28 09:31:11.690248 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687439    2572 flags.go:64] FLAG: --experimental-mounter-path=""
May 28 09:31:11.690248 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687442    2572 flags.go:64] FLAG: --fail-cgroupv1="false"
May 28 09:31:11.690248 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687444    2572 flags.go:64] FLAG: --fail-swap-on="true"
May 28 09:31:11.690248 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687448    2572 flags.go:64] FLAG: --feature-gates=""
May 28 09:31:11.690248 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687454    2572 flags.go:64] FLAG: --file-check-frequency="20s"
May 28 09:31:11.690248 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687457    2572 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 28 09:31:11.690248 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687460    2572 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 28 09:31:11.690891 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687464    2572 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 28 09:31:11.690891 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687468    2572 flags.go:64] FLAG: --healthz-port="10248"
May 28 09:31:11.690891 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687471    2572 flags.go:64] FLAG: --help="false"
May 28 09:31:11.690891 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687474    2572 flags.go:64] FLAG: --hostname-override="ip-10-0-139-204.ec2.internal"
May 28 09:31:11.690891 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687477    2572 flags.go:64] FLAG: --housekeeping-interval="10s"
May 28 09:31:11.690891 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687480    2572 flags.go:64] FLAG: --http-check-frequency="20s"
May 28 09:31:11.690891 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687484    2572 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 28 09:31:11.690891 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687487    2572 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 28 09:31:11.690891 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687491    2572 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 28 09:31:11.690891 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687494    2572 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 28 09:31:11.690891 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687497    2572 flags.go:64] FLAG: --image-service-endpoint=""
May 28 09:31:11.690891 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687500    2572 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 28 09:31:11.690891 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687502    2572 flags.go:64] FLAG: --kube-api-burst="100"
May 28 09:31:11.690891 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687505    2572 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 28 09:31:11.690891 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687508    2572 flags.go:64] FLAG: --kube-api-qps="50"
May 28 09:31:11.690891 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687511    2572 flags.go:64] FLAG: --kube-reserved=""
May 28 09:31:11.690891 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687514    2572 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 28 09:31:11.690891 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687517    2572 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 28 09:31:11.690891 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687521    2572 flags.go:64] FLAG: --kubelet-cgroups=""
May 28 09:31:11.690891 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687523    2572 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 28 09:31:11.690891 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687526    2572 flags.go:64] FLAG: --lock-file=""
May 28 09:31:11.690891 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687529    2572 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 28 09:31:11.690891 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687532    2572 flags.go:64] FLAG: --log-flush-frequency="5s"
May 28 09:31:11.690891 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687535    2572 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 28 09:31:11.691495 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687541    2572 flags.go:64] FLAG: --log-json-split-stream="false"
May 28 09:31:11.691495 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687545    2572 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 28 09:31:11.691495 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687548    2572 flags.go:64] FLAG: --log-text-split-stream="false"
May 28 09:31:11.691495 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687551    2572 flags.go:64] FLAG: --logging-format="text"
May 28 09:31:11.691495 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687554    2572 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 28 09:31:11.691495 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687557    2572 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 28 09:31:11.691495 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687560    2572 flags.go:64] FLAG: --manifest-url=""
May 28 09:31:11.691495 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687563    2572 flags.go:64] FLAG: --manifest-url-header=""
May 28 09:31:11.691495 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687568    2572 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 28 09:31:11.691495 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687572    2572 flags.go:64] FLAG: --max-open-files="1000000"
May 28 09:31:11.691495 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687576    2572 flags.go:64] FLAG: --max-pods="110"
May 28 09:31:11.691495 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687579    2572 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 28 09:31:11.691495 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687587    2572 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 28 09:31:11.691495 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687590    2572 flags.go:64] FLAG: --memory-manager-policy="None"
May 28 09:31:11.691495 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687593    2572 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 28 09:31:11.691495 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687596    2572 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 28 09:31:11.691495 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687599    2572 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 28 09:31:11.691495 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687602    2572 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 28 09:31:11.691495 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687610    2572 flags.go:64] FLAG: --node-status-max-images="50"
May 28 09:31:11.691495 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687614    2572 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 28 09:31:11.691495 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687617    2572 flags.go:64] FLAG: --oom-score-adj="-999"
May 28 09:31:11.691495 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687620    2572 flags.go:64] FLAG: --pod-cidr=""
May 28 09:31:11.691495 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687623    2572 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 28 09:31:11.692139 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687629    2572 flags.go:64] FLAG: --pod-manifest-path=""
May 28 09:31:11.692139 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687632    2572 flags.go:64] FLAG: --pod-max-pids="-1"
May 28 09:31:11.692139 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687635    2572 flags.go:64] FLAG: --pods-per-core="0"
May 28 09:31:11.692139 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687638    2572 flags.go:64] FLAG: --port="10250"
May 28 09:31:11.692139 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687642    2572 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 28 09:31:11.692139 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687645    2572 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0923240acb1e44e86"
May 28 09:31:11.692139 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687648    2572 flags.go:64] FLAG: --qos-reserved=""
May 28 09:31:11.692139 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687651    2572 flags.go:64] FLAG: --read-only-port="10255"
May 28 09:31:11.692139 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687654    2572 flags.go:64] FLAG: --register-node="true"
May 28 09:31:11.692139 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687657    2572 flags.go:64] FLAG: --register-schedulable="true"
May 28 09:31:11.692139 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687660    2572 flags.go:64] FLAG: --register-with-taints=""
May 28 09:31:11.692139 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687664    2572 flags.go:64] FLAG: --registry-burst="10"
May 28 09:31:11.692139 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687667    2572 flags.go:64] FLAG: --registry-qps="5"
May 28 09:31:11.692139 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687670    2572 flags.go:64] FLAG: --reserved-cpus=""
May 28 09:31:11.692139 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687673    2572 flags.go:64] FLAG: --reserved-memory=""
May 28 09:31:11.692139 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687676    2572 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 28 09:31:11.692139 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687679    2572 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 28 09:31:11.692139 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687682    2572 flags.go:64] FLAG: --rotate-certificates="false"
May 28 09:31:11.692139 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687685    2572 flags.go:64] FLAG: --rotate-server-certificates="false"
May 28 09:31:11.692139 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687688    2572 flags.go:64] FLAG: --runonce="false"
May 28 09:31:11.692139 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687691    2572 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 28 09:31:11.692139 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687695    2572 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 28 09:31:11.692139 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687700    2572 flags.go:64] FLAG: --seccomp-default="false"
May 28 09:31:11.692139 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687703    2572 flags.go:64] FLAG: --serialize-image-pulls="true"
May 28 09:31:11.692139 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687706    2572 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 28 09:31:11.692139 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687709    2572 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 28 09:31:11.692778 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687712    2572 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 28 09:31:11.692778 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687715    2572 flags.go:64] FLAG: --storage-driver-password="root"
May 28 09:31:11.692778 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687718    2572 flags.go:64] FLAG: --storage-driver-secure="false"
May 28 09:31:11.692778 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687721    2572 flags.go:64] FLAG: --storage-driver-table="stats"
May 28 09:31:11.692778 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687724    2572 flags.go:64] FLAG: --storage-driver-user="root"
May 28 09:31:11.692778 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687727    2572 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 28 09:31:11.692778 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687730    2572 flags.go:64] FLAG: --sync-frequency="1m0s"
May 28 09:31:11.692778 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687733    2572 flags.go:64] FLAG: --system-cgroups=""
May 28 09:31:11.692778 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687736    2572 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 28 09:31:11.692778 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687741    2572 flags.go:64] FLAG: --system-reserved-cgroup=""
May 28 09:31:11.692778 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687744    2572 flags.go:64] FLAG: --tls-cert-file=""
May 28 09:31:11.692778 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687747    2572 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 28 09:31:11.692778 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687754    2572 flags.go:64] FLAG: --tls-min-version=""
May 28 09:31:11.692778 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687757    2572 flags.go:64] FLAG: --tls-private-key-file=""
May 28 09:31:11.692778 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687760    2572 flags.go:64] FLAG: --topology-manager-policy="none"
May 28 09:31:11.692778 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687763    2572 flags.go:64] FLAG: --topology-manager-policy-options=""
May 28 09:31:11.692778 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687766    2572 flags.go:64] FLAG: --topology-manager-scope="container"
May 28 09:31:11.692778 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687769    2572 flags.go:64] FLAG: --v="2"
May 28 09:31:11.692778 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687774    2572 flags.go:64] FLAG: --version="false"
May 28 09:31:11.692778 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687778    2572 flags.go:64] FLAG: --vmodule=""
May 28 09:31:11.692778 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687783    2572 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 28 09:31:11.692778 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.687786    2572 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 28 09:31:11.692778 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.687902    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 09:31:11.692778 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.687906    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 09:31:11.693428 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.687909    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 09:31:11.693428 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.687911    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 09:31:11.693428 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.687920    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 09:31:11.693428 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.687922    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 09:31:11.693428 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.687926    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 09:31:11.693428 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.687929    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 09:31:11.693428 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.687932    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 09:31:11.693428 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.687934    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 09:31:11.693428 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.687938    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 09:31:11.693428 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.687941    2572 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 09:31:11.693428 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.687943    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 09:31:11.693428 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.687946    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 09:31:11.693428 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.687950    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 09:31:11.693428 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.687954    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 09:31:11.693428 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.687957    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 09:31:11.693428 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.687960    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 09:31:11.693428 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.687963    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 09:31:11.693428 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.687977    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 09:31:11.693428 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.687981    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 09:31:11.693906 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.687983    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 09:31:11.693906 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.687986    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 09:31:11.693906 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.687988    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 09:31:11.693906 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.687991    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 09:31:11.693906 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.687994    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 09:31:11.693906 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.687997    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 09:31:11.693906 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.687999    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 09:31:11.693906 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.688002    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 09:31:11.693906 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.688004    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 09:31:11.693906 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.688007    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 09:31:11.693906 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.688010    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 09:31:11.693906 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.688013    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 09:31:11.693906 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.688015    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 09:31:11.693906 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.688018    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 09:31:11.693906 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.688020    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 09:31:11.693906 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.688023    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 09:31:11.693906 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.688034    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 09:31:11.693906 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.688037    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 09:31:11.693906 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.688040    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 09:31:11.693906 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.688043    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 09:31:11.694462 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.688045    2572 feature_gate.go:328] unrecognized feature gate: Example
May 28 09:31:11.694462 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.688048    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 09:31:11.694462 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.688050    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 09:31:11.694462 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.688053    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 09:31:11.694462 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.688056    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 09:31:11.694462 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.688058    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 09:31:11.694462 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.688061    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 09:31:11.694462 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.688063    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 09:31:11.694462 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.688066    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 09:31:11.694462 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.688068    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 09:31:11.694462 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.688071    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 09:31:11.694462 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.688074    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 09:31:11.694462 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.688076    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 09:31:11.694462 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.688080    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 09:31:11.694462 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.688083    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 09:31:11.694462 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.688086    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 09:31:11.694462 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.688090    2572 feature_gate.go:328] unrecognized feature gate: Example2
May 28 09:31:11.694462 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.688093    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 09:31:11.694462 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.688096    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 09:31:11.694462 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.688098    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 09:31:11.694961 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.688101    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 09:31:11.694961 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.688103    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 09:31:11.694961 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.688106    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 09:31:11.694961 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.688109    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 09:31:11.694961 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.688111    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 09:31:11.694961 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.688114    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 09:31:11.694961 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.688117    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 09:31:11.694961 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.688119    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 09:31:11.694961 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.688122    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 09:31:11.694961 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.688133    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 09:31:11.694961 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.688136    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 09:31:11.694961 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.688138    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 09:31:11.694961 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.688141    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 09:31:11.694961 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.688143    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 09:31:11.694961 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.688146    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 09:31:11.694961 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.688148    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 09:31:11.694961 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.688151    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 09:31:11.694961 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.688154    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 09:31:11.694961 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.688156    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 09:31:11.694961 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.688159    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 09:31:11.695499 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.688161    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 09:31:11.695499 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.688164    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 09:31:11.695499 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.688167    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 09:31:11.695499 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.688169    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 09:31:11.695499 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.688172    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 09:31:11.695499 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.688927    2572 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 09:31:11.697200 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.697178    2572 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 28 09:31:11.697234 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.697202    2572 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 28 09:31:11.697274 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697266    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 09:31:11.697274 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697274    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 09:31:11.697324 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697277    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 09:31:11.697324 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697281    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 09:31:11.697324 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697284    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 09:31:11.697324 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697287    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 09:31:11.697324 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697290    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 09:31:11.697324 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697293    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 09:31:11.697324 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697295    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 09:31:11.697324 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697298    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 09:31:11.697324 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697300    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 09:31:11.697324 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697303    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 09:31:11.697324 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697305    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 09:31:11.697324 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697308    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 09:31:11.697324 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697311    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 09:31:11.697324 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697313    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 09:31:11.697324 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697316    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 09:31:11.697324 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697318    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 09:31:11.697324 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697321    2572 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 09:31:11.697324 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697324    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 09:31:11.697324 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697327    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 09:31:11.697794 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697330    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 09:31:11.697794 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697333    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 09:31:11.697794 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697335    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 09:31:11.697794 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697338    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 09:31:11.697794 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697341    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 09:31:11.697794 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697343    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 09:31:11.697794 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697346    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 09:31:11.697794 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697348    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 09:31:11.697794 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697351    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 09:31:11.697794 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697354    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 09:31:11.697794 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697363    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 09:31:11.697794 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697365    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 09:31:11.697794 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697368    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 09:31:11.697794 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697370    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 09:31:11.697794 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697373    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 09:31:11.697794 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697375    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 09:31:11.697794 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697378    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 09:31:11.697794 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697380    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 09:31:11.697794 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697383    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 09:31:11.697794 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697385    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 09:31:11.698407 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697387    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 09:31:11.698407 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697390    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 09:31:11.698407 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697392    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 09:31:11.698407 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697395    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 09:31:11.698407 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697397    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 09:31:11.698407 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697400    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 09:31:11.698407 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697403    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 09:31:11.698407 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697408    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 09:31:11.698407 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697411    2572 feature_gate.go:328] unrecognized feature gate: Example2
May 28 09:31:11.698407 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697414    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 09:31:11.698407 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697416    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 09:31:11.698407 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697419    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 09:31:11.698407 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697423    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 09:31:11.698407 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697427    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 09:31:11.698407 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697430    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 09:31:11.698407 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697433    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 09:31:11.698407 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697436    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 09:31:11.698407 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697439    2572 feature_gate.go:328] unrecognized feature gate: Example
May 28 09:31:11.698407 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697441    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 09:31:11.698866 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697444    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 09:31:11.698866 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697446    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 09:31:11.698866 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697449    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 09:31:11.698866 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697451    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 09:31:11.698866 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697461    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 09:31:11.698866 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697464    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 09:31:11.698866 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697466    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 09:31:11.698866 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697469    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 09:31:11.698866 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697471    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 09:31:11.698866 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697474    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 09:31:11.698866 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697476    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 09:31:11.698866 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697479    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 09:31:11.698866 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697481    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 09:31:11.698866 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697484    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 09:31:11.698866 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697487    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 09:31:11.698866 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697489    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 09:31:11.698866 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697491    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 09:31:11.698866 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697494    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 09:31:11.698866 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697497    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 09:31:11.698866 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697500    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 09:31:11.699380 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697502    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 09:31:11.699380 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697505    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 09:31:11.699380 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697507    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 09:31:11.699380 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697510    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 09:31:11.699380 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697512    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 09:31:11.699380 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697515    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 09:31:11.699380 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.697521    2572 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 09:31:11.699380 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697673    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 09:31:11.699380 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697678    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 09:31:11.699380 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697681    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 09:31:11.699380 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697684    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 09:31:11.699380 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697687    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 09:31:11.699380 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697690    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 09:31:11.699380 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697693    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 09:31:11.699380 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697697    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 09:31:11.699756 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697701    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 09:31:11.699756 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697704    2572 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 09:31:11.699756 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697713    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 09:31:11.699756 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697716    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 09:31:11.699756 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697719    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 09:31:11.699756 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697721    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 09:31:11.699756 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697724    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 09:31:11.699756 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697726    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 09:31:11.699756 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697729    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 09:31:11.699756 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697732    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 09:31:11.699756 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697734    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 09:31:11.699756 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697737    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 09:31:11.699756 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697739    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 09:31:11.699756 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697742    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 09:31:11.699756 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697744    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 09:31:11.699756 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697748    2572 feature_gate.go:328] unrecognized feature gate: Example2
May 28 09:31:11.699756 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697750    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 09:31:11.699756 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697753    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 09:31:11.699756 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697756    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 09:31:11.700242 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697758    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 09:31:11.700242 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697761    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 09:31:11.700242 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697763    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 09:31:11.700242 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697766    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 09:31:11.700242 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697769    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 09:31:11.700242 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697771    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 09:31:11.700242 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697773    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 09:31:11.700242 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697776    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 09:31:11.700242 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697778    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 09:31:11.700242 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697781    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 09:31:11.700242 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697783    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 09:31:11.700242 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697786    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 09:31:11.700242 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697788    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 09:31:11.700242 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697791    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 09:31:11.700242 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697794    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 09:31:11.700242 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697796    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 09:31:11.700242 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697812    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 09:31:11.700242 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697815    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 09:31:11.700242 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697818    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 09:31:11.700242 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697820    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 09:31:11.700729 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697823    2572 feature_gate.go:328] unrecognized feature gate: Example
May 28 09:31:11.700729 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697825    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 09:31:11.700729 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697828    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 09:31:11.700729 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697830    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 09:31:11.700729 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697834    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 09:31:11.700729 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697838    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 09:31:11.700729 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697841    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 09:31:11.700729 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697844    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 09:31:11.700729 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697847    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 09:31:11.700729 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697850    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 09:31:11.700729 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697852    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 09:31:11.700729 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697855    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 09:31:11.700729 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697858    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 09:31:11.700729 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697860    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 09:31:11.700729 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697862    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 09:31:11.700729 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697865    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 09:31:11.700729 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697867    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 09:31:11.700729 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697870    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 09:31:11.700729 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697872    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 09:31:11.700729 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697875    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 09:31:11.701229 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697877    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 09:31:11.701229 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697880    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 09:31:11.701229 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697882    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 09:31:11.701229 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697885    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 09:31:11.701229 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697887    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 09:31:11.701229 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697890    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 09:31:11.701229 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697893    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 09:31:11.701229 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697895    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 09:31:11.701229 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697897    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 09:31:11.701229 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697905    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 09:31:11.701229 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697908    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 09:31:11.701229 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697910    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 09:31:11.701229 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697913    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 09:31:11.701229 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697915    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 09:31:11.701229 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697918    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 09:31:11.701229 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697920    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 09:31:11.701229 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697923    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 09:31:11.701229 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697925    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 09:31:11.701229 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:11.697928    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 09:31:11.701728 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.697933    2572 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 09:31:11.701728 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.698675    2572 server.go:962] "Client rotation is on, will bootstrap in background"
May 28 09:31:11.701728 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.700828    2572 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 28 09:31:11.701811 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.701798    2572 server.go:1019] "Starting client certificate rotation"
May 28 09:31:11.701921 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.701904    2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 28 09:31:11.701950 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.701941    2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 28 09:31:11.728195 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.728168    2572 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 28 09:31:11.733211 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.733166    2572 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 28 09:31:11.748129 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.748100    2572 log.go:25] "Validated CRI v1 runtime API"
May 28 09:31:11.754440 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.754421    2572 log.go:25] "Validated CRI v1 image API"
May 28 09:31:11.756666 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.756649    2572 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 28 09:31:11.761722 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.761686    2572 fs.go:135] Filesystem UUIDs: map[2d482989-93d2-447c-bf00-547572b5e0e9:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 e548c4b1-3764-45ba-a3a3-9ab59afb929d:/dev/nvme0n1p3]
May 28 09:31:11.761840 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.761718    2572 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 28 09:31:11.766786 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.766652    2572 manager.go:217] Machine: {Timestamp:2026-05-28 09:31:11.766144816 +0000 UTC m=+0.449065591 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3093444 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ba610f90c99a551b53568fc89848f SystemUUID:ec2ba610-f90c-99a5-51b5-3568fc89848f BootID:dfd186a6-72c5-4426-afd8-5e5ceddcb751 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:fd:8e:d8:79:01 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:fd:8e:d8:79:01 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ea:e6:b3:c0:3b:db Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 28 09:31:11.767423 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.767408    2572 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 28 09:31:11.767592 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.767569    2572 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 28 09:31:11.769945 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.769915    2572 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 28 09:31:11.770312 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.769948    2572 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-204.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 28 09:31:11.770367 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.770324    2572 topology_manager.go:138] "Creating topology manager with none policy"
May 28 09:31:11.770367 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.770334    2572 container_manager_linux.go:306] "Creating device plugin manager"
May 28 09:31:11.770367 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.770343    2572 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 28 09:31:11.772484 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.772466    2572 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 28 09:31:11.774248 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.773986    2572 state_mem.go:36] "Initialized new in-memory state store"
May 28 09:31:11.774284 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.774277    2572 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 28 09:31:11.778164 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.778153    2572 kubelet.go:491] "Attempting to sync node with API server"
May 28 09:31:11.778200 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.778175    2572 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 28 09:31:11.778200 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.778191    2572 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 28 09:31:11.778200 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.778200    2572 kubelet.go:397] "Adding apiserver pod source"
May 28 09:31:11.778281 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.778210    2572 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 28 09:31:11.779746 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.779731    2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 28 09:31:11.779806 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.779752    2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 28 09:31:11.784238 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.783918    2572 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 28 09:31:11.786954 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.786913    2572 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 28 09:31:11.789421 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.789403    2572 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 28 09:31:11.791455 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.791442    2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 28 09:31:11.791526 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.791459    2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 28 09:31:11.791526 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.791466    2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 28 09:31:11.791526 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.791472    2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 28 09:31:11.791526 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.791480    2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 28 09:31:11.791526 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.791486    2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 28 09:31:11.791526 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.791492    2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 28 09:31:11.791526 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.791497    2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 28 09:31:11.791526 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.791505    2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 28 09:31:11.791526 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.791511    2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 28 09:31:11.791526 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.791519    2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 28 09:31:11.791526 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.791525    2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 28 09:31:11.792392 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.792382    2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 28 09:31:11.792392 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.792392    2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 28 09:31:11.795640 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.795625    2572 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 28 09:31:11.795733 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.795663    2572 server.go:1295] "Started kubelet"
May 28 09:31:11.795777 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.795723    2572 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 28 09:31:11.795811 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.795753    2572 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 28 09:31:11.795858 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.795846    2572 server_v1.go:47] "podresources" method="list" useActivePods=true
May 28 09:31:11.796564 ip-10-0-139-204 systemd[1]: Started Kubernetes Kubelet.
May 28 09:31:11.797329 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.797290    2572 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 28 09:31:11.797924 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.797908    2572 server.go:317] "Adding debug handlers to kubelet server"
May 28 09:31:11.798618 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:11.798592    2572 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-204.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 28 09:31:11.799469 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:11.799437    2572 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 28 09:31:11.799541 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.799519    2572 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-204.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 28 09:31:11.803288 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.803270    2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 28 09:31:11.804258 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.804237    2572 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 28 09:31:11.804554 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.804535    2572 volume_manager.go:295] "The desired_state_of_world populator starts"
May 28 09:31:11.804554 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.804551    2572 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 28 09:31:11.804730 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.804609    2572 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 28 09:31:11.804788 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.804750    2572 reconstruct.go:97] "Volume reconstruction finished"
May 28 09:31:11.804788 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.804762    2572 reconciler.go:26] "Reconciler: start to sync state"
May 28 09:31:11.806076 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.805962    2572 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 28 09:31:11.806076 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.805993    2572 factory.go:55] Registering systemd factory
May 28 09:31:11.806076 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.806004    2572 factory.go:223] Registration of the systemd container factory successfully
May 28 09:31:11.807048 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:11.807023    2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-204.ec2.internal\" not found"
May 28 09:31:11.807208 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.807195    2572 factory.go:153] Registering CRI-O factory
May 28 09:31:11.807321 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.807305    2572 factory.go:223] Registration of the crio container factory successfully
May 28 09:31:11.807407 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.807399    2572 factory.go:103] Registering Raw factory
May 28 09:31:11.807500 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.807492    2572 manager.go:1196] Started watching for new ooms in manager
May 28 09:31:11.808068 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.808053    2572 manager.go:319] Starting recovery of all containers
May 28 09:31:11.808668 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:11.808547    2572 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 28 09:31:11.808914 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:11.807008    2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-204.ec2.internal.18b3b0cce48b712b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-204.ec2.internal,UID:ip-10-0-139-204.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-204.ec2.internal,},FirstTimestamp:2026-05-28 09:31:11.795638571 +0000 UTC m=+0.478559344,LastTimestamp:2026-05-28 09:31:11.795638571 +0000 UTC m=+0.478559344,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-204.ec2.internal,}"
May 28 09:31:11.811494 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:11.811469    2572 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
May 28 09:31:11.811654 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:11.811447    2572 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-204.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
May 28 09:31:11.813892 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.813865    2572 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 28 09:31:11.822535 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.822518    2572 manager.go:324] Recovery completed
May 28 09:31:11.826604 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.826591    2572 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 09:31:11.828624 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.828602    2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-204.ec2.internal" event="NodeHasSufficientMemory"
May 28 09:31:11.828670 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.828638    2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-204.ec2.internal" event="NodeHasNoDiskPressure"
May 28 09:31:11.828670 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.828649    2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-204.ec2.internal" event="NodeHasSufficientPID"
May 28 09:31:11.829153 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.829139    2572 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 28 09:31:11.829153 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.829152    2572 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 28 09:31:11.829232 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.829169    2572 state_mem.go:36] "Initialized new in-memory state store"
May 28 09:31:11.831800 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.831788    2572 policy_none.go:49] "None policy: Start"
May 28 09:31:11.831849 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.831805    2572 memory_manager.go:186] "Starting memorymanager" policy="None"
May 28 09:31:11.831849 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.831815    2572 state_mem.go:35] "Initializing new in-memory state store"
May 28 09:31:11.832367 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:11.832298    2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-204.ec2.internal.18b3b0cce682c658  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-204.ec2.internal,UID:ip-10-0-139-204.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-204.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-204.ec2.internal,},FirstTimestamp:2026-05-28 09:31:11.828624984 +0000 UTC m=+0.511545758,LastTimestamp:2026-05-28 09:31:11.828624984 +0000 UTC m=+0.511545758,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-204.ec2.internal,}"
May 28 09:31:11.838234 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.838217    2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mcvw8"
May 28 09:31:11.843180 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:11.843112    2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-204.ec2.internal.18b3b0cce6830c8d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-204.ec2.internal,UID:ip-10-0-139-204.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-139-204.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-139-204.ec2.internal,},FirstTimestamp:2026-05-28 09:31:11.828642957 +0000 UTC m=+0.511563734,LastTimestamp:2026-05-28 09:31:11.828642957 +0000 UTC m=+0.511563734,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-204.ec2.internal,}"
May 28 09:31:11.852642 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.852617    2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mcvw8"
May 28 09:31:11.854179 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:11.854079    2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-204.ec2.internal.18b3b0cce683328c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-204.ec2.internal,UID:ip-10-0-139-204.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-139-204.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-139-204.ec2.internal,},FirstTimestamp:2026-05-28 09:31:11.828652684 +0000 UTC m=+0.511573458,LastTimestamp:2026-05-28 09:31:11.828652684 +0000 UTC m=+0.511573458,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-204.ec2.internal,}"
May 28 09:31:11.871731 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.871715    2572 manager.go:341] "Starting Device Plugin manager"
May 28 09:31:11.892119 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:11.871748    2572 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 28 09:31:11.892119 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.871760    2572 server.go:85] "Starting device plugin registration server"
May 28 09:31:11.892119 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.872055    2572 eviction_manager.go:189] "Eviction manager: starting control loop"
May 28 09:31:11.892119 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.872072    2572 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 28 09:31:11.892119 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.872206    2572 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 28 09:31:11.892119 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.872339    2572 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 28 09:31:11.892119 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.872352    2572 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 28 09:31:11.892119 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:11.872951    2572 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 28 09:31:11.892119 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:11.873005    2572 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-204.ec2.internal\" not found"
May 28 09:31:11.915162 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.915128    2572 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 28 09:31:11.915162 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.915163    2572 status_manager.go:230] "Starting to sync pod status with apiserver"
May 28 09:31:11.915345 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.915181    2572 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 28 09:31:11.915345 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.915191    2572 kubelet.go:2451] "Starting kubelet main sync loop"
May 28 09:31:11.915345 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:11.915226    2572 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 28 09:31:11.920842 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.920818    2572 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 09:31:11.972600 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.972527    2572 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 09:31:11.973845 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.973830    2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-204.ec2.internal" event="NodeHasSufficientMemory"
May 28 09:31:11.973954 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.973864    2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-204.ec2.internal" event="NodeHasNoDiskPressure"
May 28 09:31:11.973954 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.973876    2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-204.ec2.internal" event="NodeHasSufficientPID"
May 28 09:31:11.973954 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.973899    2572 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-204.ec2.internal"
May 28 09:31:11.988322 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:11.988295    2572 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-204.ec2.internal"
May 28 09:31:11.988405 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:11.988326    2572 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-204.ec2.internal\": node \"ip-10-0-139-204.ec2.internal\" not found"
May 28 09:31:12.016237 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:12.016177    2572 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-204.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-204.ec2.internal"]
May 28 09:31:12.016405 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:12.016282    2572 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 09:31:12.017261 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:12.017237    2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-204.ec2.internal" event="NodeHasSufficientMemory"
May 28 09:31:12.017369 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:12.017268    2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-204.ec2.internal" event="NodeHasNoDiskPressure"
May 28 09:31:12.017369 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:12.017277    2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-204.ec2.internal" event="NodeHasSufficientPID"
May 28 09:31:12.017369 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:12.017316    2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-204.ec2.internal\" not found"
May 28 09:31:12.018861 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:12.018849    2572 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 09:31:12.019083 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:12.019066    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-204.ec2.internal"
May 28 09:31:12.019135 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:12.019100    2572 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 09:31:12.019669 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:12.019652    2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-204.ec2.internal" event="NodeHasSufficientMemory"
May 28 09:31:12.019742 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:12.019675    2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-204.ec2.internal" event="NodeHasNoDiskPressure"
May 28 09:31:12.019742 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:12.019679    2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-204.ec2.internal" event="NodeHasSufficientMemory"
May 28 09:31:12.019742 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:12.019700    2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-204.ec2.internal" event="NodeHasNoDiskPressure"
May 28 09:31:12.019742 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:12.019709    2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-204.ec2.internal" event="NodeHasSufficientPID"
May 28 09:31:12.019742 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:12.019686    2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-204.ec2.internal" event="NodeHasSufficientPID"
May 28 09:31:12.021304 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:12.021292    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-204.ec2.internal"
May 28 09:31:12.021355 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:12.021333    2572 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 09:31:12.022158 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:12.022144    2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-204.ec2.internal" event="NodeHasSufficientMemory"
May 28 09:31:12.022234 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:12.022165    2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-204.ec2.internal" event="NodeHasNoDiskPressure"
May 28 09:31:12.022234 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:12.022175    2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-204.ec2.internal" event="NodeHasSufficientPID"
May 28 09:31:12.049844 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:12.049823    2572 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-204.ec2.internal\" not found" node="ip-10-0-139-204.ec2.internal"
May 28 09:31:12.054472 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:12.054454    2572 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-204.ec2.internal\" not found" node="ip-10-0-139-204.ec2.internal"
May 28 09:31:12.118073 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:12.118034    2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-204.ec2.internal\" not found"
May 28 09:31:12.205239 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:12.205206    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ab4679d9308dd4bfe245e4be6b41a75f-config\") pod \"kube-apiserver-proxy-ip-10-0-139-204.ec2.internal\" (UID: \"ab4679d9308dd4bfe245e4be6b41a75f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-204.ec2.internal"
May 28 09:31:12.205239 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:12.205238    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9fceee618507396ff5bf6dfb90ee19d5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-204.ec2.internal\" (UID: \"9fceee618507396ff5bf6dfb90ee19d5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-204.ec2.internal"
May 28 09:31:12.205418 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:12.205263    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9fceee618507396ff5bf6dfb90ee19d5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-204.ec2.internal\" (UID: \"9fceee618507396ff5bf6dfb90ee19d5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-204.ec2.internal"
May 28 09:31:12.218284 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:12.218255    2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-204.ec2.internal\" not found"
May 28 09:31:12.305692 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:12.305602    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ab4679d9308dd4bfe245e4be6b41a75f-config\") pod \"kube-apiserver-proxy-ip-10-0-139-204.ec2.internal\" (UID: \"ab4679d9308dd4bfe245e4be6b41a75f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-204.ec2.internal"
May 28 09:31:12.305692 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:12.305641    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9fceee618507396ff5bf6dfb90ee19d5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-204.ec2.internal\" (UID: \"9fceee618507396ff5bf6dfb90ee19d5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-204.ec2.internal"
May 28 09:31:12.305692 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:12.305678    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9fceee618507396ff5bf6dfb90ee19d5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-204.ec2.internal\" (UID: \"9fceee618507396ff5bf6dfb90ee19d5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-204.ec2.internal"
May 28 09:31:12.305888 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:12.305714    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9fceee618507396ff5bf6dfb90ee19d5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-204.ec2.internal\" (UID: \"9fceee618507396ff5bf6dfb90ee19d5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-204.ec2.internal"
May 28 09:31:12.305888 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:12.305716    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9fceee618507396ff5bf6dfb90ee19d5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-204.ec2.internal\" (UID: \"9fceee618507396ff5bf6dfb90ee19d5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-204.ec2.internal"
May 28 09:31:12.305888 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:12.305748    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ab4679d9308dd4bfe245e4be6b41a75f-config\") pod \"kube-apiserver-proxy-ip-10-0-139-204.ec2.internal\" (UID: \"ab4679d9308dd4bfe245e4be6b41a75f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-204.ec2.internal"
May 28 09:31:12.318744 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:12.318711    2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-204.ec2.internal\" not found"
May 28 09:31:12.353000 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:12.352959    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-204.ec2.internal"
May 28 09:31:12.357643 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:12.357623    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-204.ec2.internal"
May 28 09:31:12.419541 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:12.419499    2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-204.ec2.internal\" not found"
May 28 09:31:12.520514 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:12.520475    2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-204.ec2.internal\" not found"
May 28 09:31:12.621079 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:12.620995    2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-204.ec2.internal\" not found"
May 28 09:31:12.701346 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:12.701296    2572 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 28 09:31:12.702072 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:12.701502    2572 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 28 09:31:12.721768 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:12.721734    2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-204.ec2.internal\" not found"
May 28 09:31:12.804203 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:12.804177    2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 28 09:31:12.822747 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:12.822721    2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-204.ec2.internal\" not found"
May 28 09:31:12.841564 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:12.841537    2572 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 28 09:31:12.855286 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:12.855244    2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-27 09:26:11 +0000 UTC" deadline="2027-12-09 10:17:16.138098822 +0000 UTC"
May 28 09:31:12.855286 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:12.855280    2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13440h46m3.282821922s"
May 28 09:31:12.865445 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:12.865408    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fceee618507396ff5bf6dfb90ee19d5.slice/crio-a965e86c74405e35cd0822bb889a9bb9eedb10b8f0df58f0718431da37442456 WatchSource:0}: Error finding container a965e86c74405e35cd0822bb889a9bb9eedb10b8f0df58f0718431da37442456: Status 404 returned error can't find the container with id a965e86c74405e35cd0822bb889a9bb9eedb10b8f0df58f0718431da37442456
May 28 09:31:12.865667 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:12.865643    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab4679d9308dd4bfe245e4be6b41a75f.slice/crio-000de716dcd08809ada6c7be88cc0df4a5ae3dbfbfafae9ffb4fef1a135eb229 WatchSource:0}: Error finding container 000de716dcd08809ada6c7be88cc0df4a5ae3dbfbfafae9ffb4fef1a135eb229: Status 404 returned error can't find the container with id 000de716dcd08809ada6c7be88cc0df4a5ae3dbfbfafae9ffb4fef1a135eb229
May 28 09:31:12.872737 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:12.872718    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 09:31:12.882926 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:12.882903    2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wb5x7"
May 28 09:31:12.900737 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:12.900709    2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wb5x7"
May 28 09:31:12.918414 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:12.918370    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-204.ec2.internal" event={"ID":"ab4679d9308dd4bfe245e4be6b41a75f","Type":"ContainerStarted","Data":"000de716dcd08809ada6c7be88cc0df4a5ae3dbfbfafae9ffb4fef1a135eb229"}
May 28 09:31:12.919300 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:12.919273    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-204.ec2.internal" event={"ID":"9fceee618507396ff5bf6dfb90ee19d5","Type":"ContainerStarted","Data":"a965e86c74405e35cd0822bb889a9bb9eedb10b8f0df58f0718431da37442456"}
May 28 09:31:12.923412 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:12.923398    2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-204.ec2.internal\" not found"
May 28 09:31:13.023918 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:13.023892    2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-204.ec2.internal\" not found"
May 28 09:31:13.124426 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:13.124356    2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-204.ec2.internal\" not found"
May 28 09:31:13.134656 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.134637    2572 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 09:31:13.205154 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.205123    2572 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-204.ec2.internal"
May 28 09:31:13.224360 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.224332    2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 28 09:31:13.225587 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.225563    2572 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-204.ec2.internal"
May 28 09:31:13.226682 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.226664    2572 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 09:31:13.243073 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.243045    2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 28 09:31:13.290223 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.290192    2572 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 09:31:13.780700 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.780666    2572 apiserver.go:52] "Watching apiserver"
May 28 09:31:13.792772 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.792744    2572 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 28 09:31:13.793238 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.793188    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-204.ec2.internal","openshift-multus/multus-additional-cni-plugins-pcxbr","openshift-network-diagnostics/network-check-target-jx9bd","openshift-network-operator/iptables-alerter-7pj2k","kube-system/konnectivity-agent-w8rpf","kube-system/kube-apiserver-proxy-ip-10-0-139-204.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwqn5","openshift-cluster-node-tuning-operator/tuned-hlwkc","openshift-image-registry/node-ca-7xzsh","openshift-multus/multus-vcggl","openshift-multus/network-metrics-daemon-6crv6","openshift-ovn-kubernetes/ovnkube-node-hxhf6"]
May 28 09:31:13.795514 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.795490    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6"
May 28 09:31:13.796885 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.796864    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pcxbr"
May 28 09:31:13.798564 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.798541    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jx9bd"
May 28 09:31:13.798660 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:13.798621    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jx9bd" podUID="744e07a8-4e72-49f1-998a-525cef2d5fc1"
May 28 09:31:13.799845 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.799822    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7pj2k"
May 28 09:31:13.801634 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.801613    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-w8rpf"
May 28 09:31:13.803121 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.803102    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwqn5"
May 28 09:31:13.806539 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.806521    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hlwkc"
May 28 09:31:13.808227 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.808209    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7xzsh"
May 28 09:31:13.810280 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.810258    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vcggl"
May 28 09:31:13.812641 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.812180    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 28 09:31:13.812641 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.812203    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 28 09:31:13.812641 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.812239    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6crv6"
May 28 09:31:13.812641 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:13.812312    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6crv6" podUID="90716333-13a4-4983-b47a-c001d1da1e56"
May 28 09:31:13.812641 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.812364    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 28 09:31:13.812641 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.812402    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 28 09:31:13.812641 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.812544    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 28 09:31:13.812641 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.812572    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 28 09:31:13.812641 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.812628    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 28 09:31:13.813736 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.813713    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 28 09:31:13.814661 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.814638    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d9523f19-58d0-4856-bc66-6f5f92f7bbde-etc-sysconfig\") pod \"tuned-hlwkc\" (UID: \"d9523f19-58d0-4856-bc66-6f5f92f7bbde\") " pod="openshift-cluster-node-tuning-operator/tuned-hlwkc"
May 28 09:31:13.814762 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.814675    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d9523f19-58d0-4856-bc66-6f5f92f7bbde-etc-systemd\") pod \"tuned-hlwkc\" (UID: \"d9523f19-58d0-4856-bc66-6f5f92f7bbde\") " pod="openshift-cluster-node-tuning-operator/tuned-hlwkc"
May 28 09:31:13.814762 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.814697    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d9523f19-58d0-4856-bc66-6f5f92f7bbde-run\") pod \"tuned-hlwkc\" (UID: \"d9523f19-58d0-4856-bc66-6f5f92f7bbde\") " pod="openshift-cluster-node-tuning-operator/tuned-hlwkc"
May 28 09:31:13.814762 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.814728    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ccf30b25-8ebf-406d-acb8-9a6234f58b7c-systemd-units\") pod \"ovnkube-node-hxhf6\" (UID: \"ccf30b25-8ebf-406d-acb8-9a6234f58b7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6"
May 28 09:31:13.814899 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.814787    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ccf30b25-8ebf-406d-acb8-9a6234f58b7c-ovnkube-script-lib\") pod \"ovnkube-node-hxhf6\" (UID: \"ccf30b25-8ebf-406d-acb8-9a6234f58b7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6"
May 28 09:31:13.814899 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.814827    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d9523f19-58d0-4856-bc66-6f5f92f7bbde-etc-sysctl-conf\") pod \"tuned-hlwkc\" (UID: \"d9523f19-58d0-4856-bc66-6f5f92f7bbde\") " pod="openshift-cluster-node-tuning-operator/tuned-hlwkc"
May 28 09:31:13.814899 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.814873    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ccf30b25-8ebf-406d-acb8-9a6234f58b7c-node-log\") pod \"ovnkube-node-hxhf6\" (UID: \"ccf30b25-8ebf-406d-acb8-9a6234f58b7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6"
May 28 09:31:13.815081 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.814897    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ccf30b25-8ebf-406d-acb8-9a6234f58b7c-host-run-ovn-kubernetes\") pod \"ovnkube-node-hxhf6\" (UID: \"ccf30b25-8ebf-406d-acb8-9a6234f58b7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6"
May 28 09:31:13.815081 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.814923    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mxjs\" (UniqueName: \"kubernetes.io/projected/744e07a8-4e72-49f1-998a-525cef2d5fc1-kube-api-access-7mxjs\") pod \"network-check-target-jx9bd\" (UID: \"744e07a8-4e72-49f1-998a-525cef2d5fc1\") " pod="openshift-network-diagnostics/network-check-target-jx9bd"
May 28 09:31:13.815081 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.814993    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/98e6ce8d-ad11-47b7-9b11-ce34957eb822-konnectivity-ca\") pod \"konnectivity-agent-w8rpf\" (UID: \"98e6ce8d-ad11-47b7-9b11-ce34957eb822\") " pod="kube-system/konnectivity-agent-w8rpf"
May 28 09:31:13.815081 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.815035    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pcxbr\" (UID: \"fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3\") " pod="openshift-multus/multus-additional-cni-plugins-pcxbr"
May 28 09:31:13.815081 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.815062    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ccf30b25-8ebf-406d-acb8-9a6234f58b7c-run-ovn\") pod \"ovnkube-node-hxhf6\" (UID: \"ccf30b25-8ebf-406d-acb8-9a6234f58b7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6"
May 28 09:31:13.815316 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.815085    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ccf30b25-8ebf-406d-acb8-9a6234f58b7c-host-cni-netd\") pod \"ovnkube-node-hxhf6\" (UID: \"ccf30b25-8ebf-406d-acb8-9a6234f58b7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6"
May 28 09:31:13.815316 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.815111    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ccf30b25-8ebf-406d-acb8-9a6234f58b7c-ovnkube-config\") pod \"ovnkube-node-hxhf6\" (UID: \"ccf30b25-8ebf-406d-acb8-9a6234f58b7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6"
May 28 09:31:13.815316 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.815136    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/98e6ce8d-ad11-47b7-9b11-ce34957eb822-agent-certs\") pod \"konnectivity-agent-w8rpf\" (UID: \"98e6ce8d-ad11-47b7-9b11-ce34957eb822\") " pod="kube-system/konnectivity-agent-w8rpf"
May 28 09:31:13.815316 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.815160    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d9523f19-58d0-4856-bc66-6f5f92f7bbde-etc-kubernetes\") pod \"tuned-hlwkc\" (UID: \"d9523f19-58d0-4856-bc66-6f5f92f7bbde\") " pod="openshift-cluster-node-tuning-operator/tuned-hlwkc"
May 28 09:31:13.815316 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.815183    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pcxbr\" (UID: \"fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3\") " pod="openshift-multus/multus-additional-cni-plugins-pcxbr"
May 28 09:31:13.815316 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.815220    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pcxbr\" (UID: \"fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3\") " pod="openshift-multus/multus-additional-cni-plugins-pcxbr"
May 28 09:31:13.815316 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.815245    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d9523f19-58d0-4856-bc66-6f5f92f7bbde-etc-modprobe-d\") pod \"tuned-hlwkc\" (UID: \"d9523f19-58d0-4856-bc66-6f5f92f7bbde\") " pod="openshift-cluster-node-tuning-operator/tuned-hlwkc"
May 28 09:31:13.815316 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.815286    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ccf30b25-8ebf-406d-acb8-9a6234f58b7c-log-socket\") pod \"ovnkube-node-hxhf6\" (UID: \"ccf30b25-8ebf-406d-acb8-9a6234f58b7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6"
May 28 09:31:13.815638 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.815345    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ccf30b25-8ebf-406d-acb8-9a6234f58b7c-host-cni-bin\") pod \"ovnkube-node-hxhf6\" (UID: \"ccf30b25-8ebf-406d-acb8-9a6234f58b7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6"
May 28 09:31:13.815638 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.815375    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ccf30b25-8ebf-406d-acb8-9a6234f58b7c-ovn-node-metrics-cert\") pod \"ovnkube-node-hxhf6\" (UID: \"ccf30b25-8ebf-406d-acb8-9a6234f58b7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6"
May 28 09:31:13.815638 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.815402    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45jm4\" (UniqueName: \"kubernetes.io/projected/d675a27b-a361-485d-bea2-9eb571533c84-kube-api-access-45jm4\") pod \"iptables-alerter-7pj2k\" (UID: \"d675a27b-a361-485d-bea2-9eb571533c84\") " pod="openshift-network-operator/iptables-alerter-7pj2k"
May 28 09:31:13.815638 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.815426    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d9523f19-58d0-4856-bc66-6f5f92f7bbde-host\") pod \"tuned-hlwkc\" (UID: \"d9523f19-58d0-4856-bc66-6f5f92f7bbde\") " pod="openshift-cluster-node-tuning-operator/tuned-hlwkc"
May 28 09:31:13.815638 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.815452    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e2c51057-7d4b-4bae-92df-7357832498fc-etc-selinux\") pod \"aws-ebs-csi-driver-node-qwqn5\" (UID: \"e2c51057-7d4b-4bae-92df-7357832498fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwqn5"
May 28 09:31:13.815638 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.815474    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clt5t\" (UniqueName: \"kubernetes.io/projected/d9523f19-58d0-4856-bc66-6f5f92f7bbde-kube-api-access-clt5t\") pod \"tuned-hlwkc\" (UID: \"d9523f19-58d0-4856-bc66-6f5f92f7bbde\") " pod="openshift-cluster-node-tuning-operator/tuned-hlwkc"
May 28 09:31:13.815638 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.815499    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3-system-cni-dir\") pod \"multus-additional-cni-plugins-pcxbr\" (UID: \"fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3\") " pod="openshift-multus/multus-additional-cni-plugins-pcxbr"
May 28 09:31:13.815638 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.815521    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ccf30b25-8ebf-406d-acb8-9a6234f58b7c-host-kubelet\") pod \"ovnkube-node-hxhf6\" (UID: \"ccf30b25-8ebf-406d-acb8-9a6234f58b7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6"
May 28 09:31:13.815638 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.815547    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ccf30b25-8ebf-406d-acb8-9a6234f58b7c-var-lib-openvswitch\") pod \"ovnkube-node-hxhf6\" (UID: \"ccf30b25-8ebf-406d-acb8-9a6234f58b7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6"
May 28 09:31:13.815638 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.815571    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3-cnibin\") pod \"multus-additional-cni-plugins-pcxbr\" (UID: \"fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3\") " pod="openshift-multus/multus-additional-cni-plugins-pcxbr"
May 28 09:31:13.815638 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.815593    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ccf30b25-8ebf-406d-acb8-9a6234f58b7c-run-systemd\") pod \"ovnkube-node-hxhf6\" (UID: \"ccf30b25-8ebf-406d-acb8-9a6234f58b7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6"
May 28 09:31:13.815638 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.815619    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e2c51057-7d4b-4bae-92df-7357832498fc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qwqn5\" (UID: \"e2c51057-7d4b-4bae-92df-7357832498fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwqn5"
May 28 09:31:13.816166 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.815643    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d9523f19-58d0-4856-bc66-6f5f92f7bbde-etc-sysctl-d\") pod \"tuned-hlwkc\" (UID: \"d9523f19-58d0-4856-bc66-6f5f92f7bbde\") " pod="openshift-cluster-node-tuning-operator/tuned-hlwkc"
May 28 09:31:13.816166 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.815682    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkbzb\" (UniqueName: \"kubernetes.io/projected/fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3-kube-api-access-vkbzb\") pod \"multus-additional-cni-plugins-pcxbr\" (UID: \"fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3\") " pod="openshift-multus/multus-additional-cni-plugins-pcxbr"
May 28 09:31:13.816166 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.815724    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ccf30b25-8ebf-406d-acb8-9a6234f58b7c-run-openvswitch\") pod \"ovnkube-node-hxhf6\" (UID: \"ccf30b25-8ebf-406d-acb8-9a6234f58b7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6"
May 28 09:31:13.816166 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.815764    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d9523f19-58d0-4856-bc66-6f5f92f7bbde-var-lib-kubelet\") pod \"tuned-hlwkc\" (UID: \"d9523f19-58d0-4856-bc66-6f5f92f7bbde\") " pod="openshift-cluster-node-tuning-operator/tuned-hlwkc"
May 28 09:31:13.816166 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.815792    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d9523f19-58d0-4856-bc66-6f5f92f7bbde-etc-tuned\") pod \"tuned-hlwkc\" (UID: \"d9523f19-58d0-4856-bc66-6f5f92f7bbde\") " pod="openshift-cluster-node-tuning-operator/tuned-hlwkc"
May 28 09:31:13.816166 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.815818    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ccf30b25-8ebf-406d-acb8-9a6234f58b7c-host-run-netns\") pod \"ovnkube-node-hxhf6\" (UID: \"ccf30b25-8ebf-406d-acb8-9a6234f58b7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6"
May 28 09:31:13.816166 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.815838    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d9523f19-58d0-4856-bc66-6f5f92f7bbde-sys\") pod \"tuned-hlwkc\" (UID: \"d9523f19-58d0-4856-bc66-6f5f92f7bbde\") " pod="openshift-cluster-node-tuning-operator/tuned-hlwkc"
May 28 09:31:13.816166 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.815861    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d9523f19-58d0-4856-bc66-6f5f92f7bbde-lib-modules\") pod \"tuned-hlwkc\" (UID: \"d9523f19-58d0-4856-bc66-6f5f92f7bbde\") " pod="openshift-cluster-node-tuning-operator/tuned-hlwkc"
May 28 09:31:13.816166 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.815883    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d9523f19-58d0-4856-bc66-6f5f92f7bbde-tmp\") pod \"tuned-hlwkc\" (UID: \"d9523f19-58d0-4856-bc66-6f5f92f7bbde\") " pod="openshift-cluster-node-tuning-operator/tuned-hlwkc"
May 28 09:31:13.816166 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.815906    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3-os-release\") pod \"multus-additional-cni-plugins-pcxbr\" (UID: \"fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3\") " pod="openshift-multus/multus-additional-cni-plugins-pcxbr"
May 28 09:31:13.816166 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.815944    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ccf30b25-8ebf-406d-acb8-9a6234f58b7c-env-overrides\") pod \"ovnkube-node-hxhf6\" (UID: \"ccf30b25-8ebf-406d-acb8-9a6234f58b7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6"
May 28 09:31:13.816166 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.816000    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e2c51057-7d4b-4bae-92df-7357832498fc-registration-dir\") pod \"aws-ebs-csi-driver-node-qwqn5\" (UID: \"e2c51057-7d4b-4bae-92df-7357832498fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwqn5"
May 28 09:31:13.816166 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.816029    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3-cni-binary-copy\") pod \"multus-additional-cni-plugins-pcxbr\" (UID: \"fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3\") " pod="openshift-multus/multus-additional-cni-plugins-pcxbr"
May 28 09:31:13.816166 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.816058    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d675a27b-a361-485d-bea2-9eb571533c84-host-slash\") pod \"iptables-alerter-7pj2k\" (UID: \"d675a27b-a361-485d-bea2-9eb571533c84\") " pod="openshift-network-operator/iptables-alerter-7pj2k"
May 28 09:31:13.816166 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.816094    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqkz4\" (UniqueName: \"kubernetes.io/projected/e2c51057-7d4b-4bae-92df-7357832498fc-kube-api-access-dqkz4\") pod \"aws-ebs-csi-driver-node-qwqn5\" (UID: \"e2c51057-7d4b-4bae-92df-7357832498fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwqn5"
May 28 09:31:13.816166 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.816118    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ccf30b25-8ebf-406d-acb8-9a6234f58b7c-host-slash\") pod \"ovnkube-node-hxhf6\" (UID: \"ccf30b25-8ebf-406d-acb8-9a6234f58b7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6"
May 28 09:31:13.816770 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.816151    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ccf30b25-8ebf-406d-acb8-9a6234f58b7c-etc-openvswitch\") pod \"ovnkube-node-hxhf6\" (UID: \"ccf30b25-8ebf-406d-acb8-9a6234f58b7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6"
May 28 09:31:13.816770 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.816175    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ccf30b25-8ebf-406d-acb8-9a6234f58b7c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hxhf6\" (UID: \"ccf30b25-8ebf-406d-acb8-9a6234f58b7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6"
May 28 09:31:13.816770 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.816201    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tghqz\" (UniqueName: \"kubernetes.io/projected/ccf30b25-8ebf-406d-acb8-9a6234f58b7c-kube-api-access-tghqz\") pod \"ovnkube-node-hxhf6\" (UID: \"ccf30b25-8ebf-406d-acb8-9a6234f58b7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6"
May 28 09:31:13.816770 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.816226    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e2c51057-7d4b-4bae-92df-7357832498fc-socket-dir\") pod \"aws-ebs-csi-driver-node-qwqn5\" (UID: \"e2c51057-7d4b-4bae-92df-7357832498fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwqn5"
May 28 09:31:13.816770 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.816248    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e2c51057-7d4b-4bae-92df-7357832498fc-device-dir\") pod \"aws-ebs-csi-driver-node-qwqn5\" (UID: \"e2c51057-7d4b-4bae-92df-7357832498fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwqn5"
May 28 09:31:13.816770 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.816286    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e2c51057-7d4b-4bae-92df-7357832498fc-sys-fs\") pod \"aws-ebs-csi-driver-node-qwqn5\" (UID: \"e2c51057-7d4b-4bae-92df-7357832498fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwqn5"
May 28 09:31:13.816770 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.816309    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d675a27b-a361-485d-bea2-9eb571533c84-iptables-alerter-script\") pod \"iptables-alerter-7pj2k\" (UID: \"d675a27b-a361-485d-bea2-9eb571533c84\") " pod="openshift-network-operator/iptables-alerter-7pj2k"
May 28 09:31:13.818193 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.818172    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 28 09:31:13.818419 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.818402    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 28 09:31:13.819202 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.819183    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 28 09:31:13.820581 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.820561    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 28 09:31:13.821435 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.821414    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 28 09:31:13.824669 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.824652    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 28 09:31:13.832100 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.832071    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 28 09:31:13.834960 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.832447    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rjsf8\""
May 28 09:31:13.834960 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.832821    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 28 09:31:13.834960 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.832949    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 28 09:31:13.834960 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.832999    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 28 09:31:13.834960 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.833033    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 28 09:31:13.834960 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.832451    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-dc2rk\""
May 28 09:31:13.834960 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.833306    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-z4558\""
May 28 09:31:13.834960 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.833870    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 28 09:31:13.835386 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.835230    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 28 09:31:13.835386 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.835250    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9r4dw\""
May 28 09:31:13.835386 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.835258    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 28 09:31:13.835531 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.835422    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-f56bv\""
May 28 09:31:13.835531 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.835477    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-w7xld\""
May 28 09:31:13.835625 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.835529    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5wv7s\""
May 28 09:31:13.835677 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.835625    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-pssck\""
May 28 09:31:13.835677 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.835654    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 28 09:31:13.835767 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.835701    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 28 09:31:13.851949 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.851927    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 28 09:31:13.902238 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.902194    2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 09:26:12 +0000 UTC" deadline="2027-12-25 22:04:15.204874473 +0000 UTC"
May 28 09:31:13.902238 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.902223    2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13836h33m1.302654102s"
May 28 09:31:13.905852 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.905827    2572 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 28 09:31:13.916757 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.916726    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d9523f19-58d0-4856-bc66-6f5f92f7bbde-host\") pod \"tuned-hlwkc\" (UID: \"d9523f19-58d0-4856-bc66-6f5f92f7bbde\") " pod="openshift-cluster-node-tuning-operator/tuned-hlwkc"
May 28 09:31:13.916882 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.916780    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/14a8a4a1-0374-4a48-bd7c-f38ea1dd5730-os-release\") pod \"multus-vcggl\" (UID: \"14a8a4a1-0374-4a48-bd7c-f38ea1dd5730\") " pod="openshift-multus/multus-vcggl"
May 28 09:31:13.916882 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.916808    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90716333-13a4-4983-b47a-c001d1da1e56-metrics-certs\") pod \"network-metrics-daemon-6crv6\" (UID: \"90716333-13a4-4983-b47a-c001d1da1e56\") " pod="openshift-multus/network-metrics-daemon-6crv6"
May 28 09:31:13.916882 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.916837    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e2c51057-7d4b-4bae-92df-7357832498fc-etc-selinux\") pod \"aws-ebs-csi-driver-node-qwqn5\" (UID: \"e2c51057-7d4b-4bae-92df-7357832498fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwqn5"
May 28 09:31:13.916882 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.916845    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d9523f19-58d0-4856-bc66-6f5f92f7bbde-host\") pod \"tuned-hlwkc\" (UID: \"d9523f19-58d0-4856-bc66-6f5f92f7bbde\") " pod="openshift-cluster-node-tuning-operator/tuned-hlwkc"
May 28 09:31:13.916882 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.916862    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-clt5t\" (UniqueName: \"kubernetes.io/projected/d9523f19-58d0-4856-bc66-6f5f92f7bbde-kube-api-access-clt5t\") pod \"tuned-hlwkc\" (UID: \"d9523f19-58d0-4856-bc66-6f5f92f7bbde\") " pod="openshift-cluster-node-tuning-operator/tuned-hlwkc"
May 28 09:31:13.917111 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.916907    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3-system-cni-dir\") pod \"multus-additional-cni-plugins-pcxbr\" (UID: \"fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3\") " pod="openshift-multus/multus-additional-cni-plugins-pcxbr"
May 28 09:31:13.917111 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.916961    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3-system-cni-dir\") pod \"multus-additional-cni-plugins-pcxbr\" (UID: \"fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3\") " pod="openshift-multus/multus-additional-cni-plugins-pcxbr"
May 28 09:31:13.917111 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.916999    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ccf30b25-8ebf-406d-acb8-9a6234f58b7c-host-kubelet\") pod \"ovnkube-node-hxhf6\" (UID: \"ccf30b25-8ebf-406d-acb8-9a6234f58b7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6"
May 28 09:31:13.917111 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.917040    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ccf30b25-8ebf-406d-acb8-9a6234f58b7c-var-lib-openvswitch\") pod \"ovnkube-node-hxhf6\" (UID: \"ccf30b25-8ebf-406d-acb8-9a6234f58b7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6"
May 28 09:31:13.917111 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.917044    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e2c51057-7d4b-4bae-92df-7357832498fc-etc-selinux\") pod \"aws-ebs-csi-driver-node-qwqn5\" (UID: \"e2c51057-7d4b-4bae-92df-7357832498fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwqn5"
May 28 09:31:13.917111 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.917043    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ccf30b25-8ebf-406d-acb8-9a6234f58b7c-host-kubelet\") pod \"ovnkube-node-hxhf6\" (UID: \"ccf30b25-8ebf-406d-acb8-9a6234f58b7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6"
May 28 09:31:13.917111 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.917072    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2b6qb\" (UniqueName: \"kubernetes.io/projected/ef852b03-b030-45ab-a48d-1d61305b27fa-kube-api-access-2b6qb\") pod \"node-ca-7xzsh\" (UID: \"ef852b03-b030-45ab-a48d-1d61305b27fa\") " pod="openshift-image-registry/node-ca-7xzsh"
May 28 09:31:13.917111 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.917076    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ccf30b25-8ebf-406d-acb8-9a6234f58b7c-var-lib-openvswitch\") pod \"ovnkube-node-hxhf6\" (UID: \"ccf30b25-8ebf-406d-acb8-9a6234f58b7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6"
May 28 09:31:13.917111 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.917100    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/14a8a4a1-0374-4a48-bd7c-f38ea1dd5730-host-var-lib-kubelet\") pod \"multus-vcggl\" (UID: \"14a8a4a1-0374-4a48-bd7c-f38ea1dd5730\") " pod="openshift-multus/multus-vcggl"
May 28 09:31:13.917479 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.917123    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3-cnibin\") pod \"multus-additional-cni-plugins-pcxbr\" (UID: \"fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3\") " pod="openshift-multus/multus-additional-cni-plugins-pcxbr"
May 28 09:31:13.917479 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.917141    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ccf30b25-8ebf-406d-acb8-9a6234f58b7c-run-systemd\") pod \"ovnkube-node-hxhf6\" (UID: \"ccf30b25-8ebf-406d-acb8-9a6234f58b7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6"
May 28 09:31:13.917479 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.917166    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3-cnibin\") pod \"multus-additional-cni-plugins-pcxbr\" (UID: \"fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3\") " pod="openshift-multus/multus-additional-cni-plugins-pcxbr"
May 28 09:31:13.917479 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.917158    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/14a8a4a1-0374-4a48-bd7c-f38ea1dd5730-host-run-k8s-cni-cncf-io\") pod \"multus-vcggl\" (UID: \"14a8a4a1-0374-4a48-bd7c-f38ea1dd5730\") " pod="openshift-multus/multus-vcggl"
May 28 09:31:13.917479 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.917202    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ccf30b25-8ebf-406d-acb8-9a6234f58b7c-run-systemd\") pod \"ovnkube-node-hxhf6\" (UID: \"ccf30b25-8ebf-406d-acb8-9a6234f58b7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6"
May 28 09:31:13.917479 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.917211    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/14a8a4a1-0374-4a48-bd7c-f38ea1dd5730-hostroot\") pod \"multus-vcggl\" (UID: \"14a8a4a1-0374-4a48-bd7c-f38ea1dd5730\") " pod="openshift-multus/multus-vcggl"
May 28 09:31:13.917479 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.917257    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e2c51057-7d4b-4bae-92df-7357832498fc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qwqn5\" (UID: \"e2c51057-7d4b-4bae-92df-7357832498fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwqn5"
May 28 09:31:13.917479 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.917297    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d9523f19-58d0-4856-bc66-6f5f92f7bbde-etc-sysctl-d\") pod \"tuned-hlwkc\" (UID: \"d9523f19-58d0-4856-bc66-6f5f92f7bbde\") " pod="openshift-cluster-node-tuning-operator/tuned-hlwkc"
May 28 09:31:13.917479 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.917324    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vkbzb\" (UniqueName: \"kubernetes.io/projected/fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3-kube-api-access-vkbzb\") pod \"multus-additional-cni-plugins-pcxbr\" (UID: \"fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3\") " pod="openshift-multus/multus-additional-cni-plugins-pcxbr"
May 28 09:31:13.917479 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.917339    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e2c51057-7d4b-4bae-92df-7357832498fc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qwqn5\" (UID: \"e2c51057-7d4b-4bae-92df-7357832498fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwqn5"
May 28 09:31:13.917479 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.917349    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ccf30b25-8ebf-406d-acb8-9a6234f58b7c-run-openvswitch\") pod \"ovnkube-node-hxhf6\" (UID: \"ccf30b25-8ebf-406d-acb8-9a6234f58b7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6"
May 28 09:31:13.917479 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.917382    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ccf30b25-8ebf-406d-acb8-9a6234f58b7c-run-openvswitch\") pod \"ovnkube-node-hxhf6\" (UID: \"ccf30b25-8ebf-406d-acb8-9a6234f58b7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6"
May 28 09:31:13.917479 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.917381    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/14a8a4a1-0374-4a48-bd7c-f38ea1dd5730-cnibin\") pod \"multus-vcggl\" (UID: \"14a8a4a1-0374-4a48-bd7c-f38ea1dd5730\") " pod="openshift-multus/multus-vcggl"
May 28 09:31:13.917479 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.917415    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/14a8a4a1-0374-4a48-bd7c-f38ea1dd5730-cni-binary-copy\") pod \"multus-vcggl\" (UID: \"14a8a4a1-0374-4a48-bd7c-f38ea1dd5730\") " pod="openshift-multus/multus-vcggl"
May 28 09:31:13.917479 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.917437    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d9523f19-58d0-4856-bc66-6f5f92f7bbde-var-lib-kubelet\") pod \"tuned-hlwkc\" (UID: \"d9523f19-58d0-4856-bc66-6f5f92f7bbde\") " pod="openshift-cluster-node-tuning-operator/tuned-hlwkc"
May 28 09:31:13.917479 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.917441    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d9523f19-58d0-4856-bc66-6f5f92f7bbde-etc-sysctl-d\") pod \"tuned-hlwkc\" (UID: \"d9523f19-58d0-4856-bc66-6f5f92f7bbde\") " pod="openshift-cluster-node-tuning-operator/tuned-hlwkc"
May 28 09:31:13.917479 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.917470    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d9523f19-58d0-4856-bc66-6f5f92f7bbde-var-lib-kubelet\") pod \"tuned-hlwkc\" (UID: \"d9523f19-58d0-4856-bc66-6f5f92f7bbde\") " pod="openshift-cluster-node-tuning-operator/tuned-hlwkc"
May 28 09:31:13.918217 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.917482    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d9523f19-58d0-4856-bc66-6f5f92f7bbde-etc-tuned\") pod \"tuned-hlwkc\" (UID: \"d9523f19-58d0-4856-bc66-6f5f92f7bbde\") " pod="openshift-cluster-node-tuning-operator/tuned-hlwkc"
May 28 09:31:13.918217 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.917514    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ccf30b25-8ebf-406d-acb8-9a6234f58b7c-host-run-netns\") pod \"ovnkube-node-hxhf6\" (UID: \"ccf30b25-8ebf-406d-acb8-9a6234f58b7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6"
May 28 09:31:13.918217 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.917541    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/14a8a4a1-0374-4a48-bd7c-f38ea1dd5730-host-var-lib-cni-multus\") pod \"multus-vcggl\" (UID: \"14a8a4a1-0374-4a48-bd7c-f38ea1dd5730\") " pod="openshift-multus/multus-vcggl"
May 28 09:31:13.918217 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.917572    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d9523f19-58d0-4856-bc66-6f5f92f7bbde-sys\") pod \"tuned-hlwkc\" (UID: \"d9523f19-58d0-4856-bc66-6f5f92f7bbde\") " pod="openshift-cluster-node-tuning-operator/tuned-hlwkc"
May 28 09:31:13.918217 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.917572    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ccf30b25-8ebf-406d-acb8-9a6234f58b7c-host-run-netns\") pod \"ovnkube-node-hxhf6\" (UID: \"ccf30b25-8ebf-406d-acb8-9a6234f58b7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6"
May 28 09:31:13.918217 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.917592    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d9523f19-58d0-4856-bc66-6f5f92f7bbde-lib-modules\") pod \"tuned-hlwkc\" (UID: \"d9523f19-58d0-4856-bc66-6f5f92f7bbde\") " pod="openshift-cluster-node-tuning-operator/tuned-hlwkc"
May 28 09:31:13.918217 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.917607    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d9523f19-58d0-4856-bc66-6f5f92f7bbde-tmp\") pod \"tuned-hlwkc\" (UID: \"d9523f19-58d0-4856-bc66-6f5f92f7bbde\") " pod="openshift-cluster-node-tuning-operator/tuned-hlwkc"
May 28 09:31:13.918217 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.917660    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3-os-release\") pod \"multus-additional-cni-plugins-pcxbr\" (UID: \"fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3\") " pod="openshift-multus/multus-additional-cni-plugins-pcxbr"
May 28 09:31:13.918217 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.917689    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ccf30b25-8ebf-406d-acb8-9a6234f58b7c-env-overrides\") pod \"ovnkube-node-hxhf6\" (UID: \"ccf30b25-8ebf-406d-acb8-9a6234f58b7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6"
May 28 09:31:13.918217 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.917691    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d9523f19-58d0-4856-bc66-6f5f92f7bbde-sys\") pod \"tuned-hlwkc\" (UID: \"d9523f19-58d0-4856-bc66-6f5f92f7bbde\") " pod="openshift-cluster-node-tuning-operator/tuned-hlwkc"
May 28 09:31:13.918217 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.917733    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e2c51057-7d4b-4bae-92df-7357832498fc-registration-dir\") pod \"aws-ebs-csi-driver-node-qwqn5\" (UID: \"e2c51057-7d4b-4bae-92df-7357832498fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwqn5"
May 28 09:31:13.918217 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.917751    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d9523f19-58d0-4856-bc66-6f5f92f7bbde-lib-modules\") pod \"tuned-hlwkc\" (UID: \"d9523f19-58d0-4856-bc66-6f5f92f7bbde\") " pod="openshift-cluster-node-tuning-operator/tuned-hlwkc"
May 28 09:31:13.918217 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.917759    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3-cni-binary-copy\") pod \"multus-additional-cni-plugins-pcxbr\" (UID: \"fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3\") " pod="openshift-multus/multus-additional-cni-plugins-pcxbr"
May 28 09:31:13.918217 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.917783    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d675a27b-a361-485d-bea2-9eb571533c84-host-slash\") pod \"iptables-alerter-7pj2k\" (UID: \"d675a27b-a361-485d-bea2-9eb571533c84\") " pod="openshift-network-operator/iptables-alerter-7pj2k"
May 28 09:31:13.918217 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.917810    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/14a8a4a1-0374-4a48-bd7c-f38ea1dd5730-host-run-netns\") pod \"multus-vcggl\" (UID: \"14a8a4a1-0374-4a48-bd7c-f38ea1dd5730\") " pod="openshift-multus/multus-vcggl"
May 28 09:31:13.918217 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.917825    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e2c51057-7d4b-4bae-92df-7357832498fc-registration-dir\") pod \"aws-ebs-csi-driver-node-qwqn5\" (UID: \"e2c51057-7d4b-4bae-92df-7357832498fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwqn5"
May 28 09:31:13.918217 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.917835    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wc6q\" (UniqueName: \"kubernetes.io/projected/90716333-13a4-4983-b47a-c001d1da1e56-kube-api-access-9wc6q\") pod \"network-metrics-daemon-6crv6\" (UID: \"90716333-13a4-4983-b47a-c001d1da1e56\") " pod="openshift-multus/network-metrics-daemon-6crv6"
May 28 09:31:13.918217 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.917828    2572 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 28 09:31:13.919047 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.917889    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3-os-release\") pod \"multus-additional-cni-plugins-pcxbr\" (UID: \"fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3\") " pod="openshift-multus/multus-additional-cni-plugins-pcxbr"
May 28 09:31:13.919047 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.917898    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d675a27b-a361-485d-bea2-9eb571533c84-host-slash\") pod \"iptables-alerter-7pj2k\" (UID: \"d675a27b-a361-485d-bea2-9eb571533c84\") " pod="openshift-network-operator/iptables-alerter-7pj2k"
May 28 09:31:13.919047 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.917955    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dqkz4\" (UniqueName: \"kubernetes.io/projected/e2c51057-7d4b-4bae-92df-7357832498fc-kube-api-access-dqkz4\") pod \"aws-ebs-csi-driver-node-qwqn5\" (UID: \"e2c51057-7d4b-4bae-92df-7357832498fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwqn5"
May 28 09:31:13.919047 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.918000    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ccf30b25-8ebf-406d-acb8-9a6234f58b7c-host-slash\") pod \"ovnkube-node-hxhf6\" (UID: \"ccf30b25-8ebf-406d-acb8-9a6234f58b7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6"
May 28 09:31:13.919047 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.918029    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ccf30b25-8ebf-406d-acb8-9a6234f58b7c-etc-openvswitch\") pod \"ovnkube-node-hxhf6\" (UID: \"ccf30b25-8ebf-406d-acb8-9a6234f58b7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6"
May 28 09:31:13.919047 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.918055    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ccf30b25-8ebf-406d-acb8-9a6234f58b7c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hxhf6\" (UID: \"ccf30b25-8ebf-406d-acb8-9a6234f58b7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6"
May 28 09:31:13.919047 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.918084    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tghqz\" (UniqueName: \"kubernetes.io/projected/ccf30b25-8ebf-406d-acb8-9a6234f58b7c-kube-api-access-tghqz\") pod \"ovnkube-node-hxhf6\" (UID: \"ccf30b25-8ebf-406d-acb8-9a6234f58b7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6"
May 28 09:31:13.919047 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.918113    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/14a8a4a1-0374-4a48-bd7c-f38ea1dd5730-host-run-multus-certs\") pod \"multus-vcggl\" (UID: \"14a8a4a1-0374-4a48-bd7c-f38ea1dd5730\") " pod="openshift-multus/multus-vcggl"
May 28 09:31:13.919047 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.918140    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e2c51057-7d4b-4bae-92df-7357832498fc-socket-dir\") pod \"aws-ebs-csi-driver-node-qwqn5\" (UID: \"e2c51057-7d4b-4bae-92df-7357832498fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwqn5"
May 28 09:31:13.919047 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.918165    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e2c51057-7d4b-4bae-92df-7357832498fc-device-dir\") pod \"aws-ebs-csi-driver-node-qwqn5\" (UID: \"e2c51057-7d4b-4bae-92df-7357832498fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwqn5"
May 28 09:31:13.919047 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.918171    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ccf30b25-8ebf-406d-acb8-9a6234f58b7c-host-slash\") pod \"ovnkube-node-hxhf6\" (UID: \"ccf30b25-8ebf-406d-acb8-9a6234f58b7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6"
May 28 09:31:13.919047 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.918191    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e2c51057-7d4b-4bae-92df-7357832498fc-sys-fs\") pod \"aws-ebs-csi-driver-node-qwqn5\" (UID: \"e2c51057-7d4b-4bae-92df-7357832498fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwqn5"
May 28 09:31:13.919047 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.918254    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d675a27b-a361-485d-bea2-9eb571533c84-iptables-alerter-script\") pod \"iptables-alerter-7pj2k\" (UID: \"d675a27b-a361-485d-bea2-9eb571533c84\") " pod="openshift-network-operator/iptables-alerter-7pj2k"
May 28 09:31:13.919047 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.918277    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ccf30b25-8ebf-406d-acb8-9a6234f58b7c-env-overrides\") pod \"ovnkube-node-hxhf6\" (UID: \"ccf30b25-8ebf-406d-acb8-9a6234f58b7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6"
May 28 09:31:13.919047 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.918378    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ccf30b25-8ebf-406d-acb8-9a6234f58b7c-etc-openvswitch\") pod \"ovnkube-node-hxhf6\" (UID: \"ccf30b25-8ebf-406d-acb8-9a6234f58b7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6"
May 28 09:31:13.919047 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.918284    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14a8a4a1-0374-4a48-bd7c-f38ea1dd5730-system-cni-dir\") pod \"multus-vcggl\" (UID: \"14a8a4a1-0374-4a48-bd7c-f38ea1dd5730\") " pod="openshift-multus/multus-vcggl"
May 28 09:31:13.919047 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.918392    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e2c51057-7d4b-4bae-92df-7357832498fc-socket-dir\") pod \"aws-ebs-csi-driver-node-qwqn5\" (UID: \"e2c51057-7d4b-4bae-92df-7357832498fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwqn5"
May 28 09:31:13.919800 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.918381    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3-cni-binary-copy\") pod \"multus-additional-cni-plugins-pcxbr\" (UID: \"fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3\") " pod="openshift-multus/multus-additional-cni-plugins-pcxbr"
May 28 09:31:13.919800 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.918404    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ccf30b25-8ebf-406d-acb8-9a6234f58b7c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hxhf6\" (UID: \"ccf30b25-8ebf-406d-acb8-9a6234f58b7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6"
May 28 09:31:13.919800 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.918421    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14a8a4a1-0374-4a48-bd7c-f38ea1dd5730-multus-cni-dir\") pod \"multus-vcggl\" (UID: \"14a8a4a1-0374-4a48-bd7c-f38ea1dd5730\") " pod="openshift-multus/multus-vcggl"
May 28 09:31:13.919800 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.918447    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/14a8a4a1-0374-4a48-bd7c-f38ea1dd5730-multus-socket-dir-parent\") pod \"multus-vcggl\" (UID: \"14a8a4a1-0374-4a48-bd7c-f38ea1dd5730\") " pod="openshift-multus/multus-vcggl"
May 28 09:31:13.919800 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.918450    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e2c51057-7d4b-4bae-92df-7357832498fc-device-dir\") pod \"aws-ebs-csi-driver-node-qwqn5\" (UID: \"e2c51057-7d4b-4bae-92df-7357832498fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwqn5"
May 28 09:31:13.919800 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.918478    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d9523f19-58d0-4856-bc66-6f5f92f7bbde-etc-sysconfig\") pod \"tuned-hlwkc\" (UID: \"d9523f19-58d0-4856-bc66-6f5f92f7bbde\") " pod="openshift-cluster-node-tuning-operator/tuned-hlwkc"
May 28 09:31:13.919800 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.918486    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e2c51057-7d4b-4bae-92df-7357832498fc-sys-fs\") pod \"aws-ebs-csi-driver-node-qwqn5\" (UID: \"e2c51057-7d4b-4bae-92df-7357832498fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwqn5"
May 28 09:31:13.919800 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.918520    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d9523f19-58d0-4856-bc66-6f5f92f7bbde-etc-systemd\") pod \"tuned-hlwkc\" (UID: \"d9523f19-58d0-4856-bc66-6f5f92f7bbde\") " pod="openshift-cluster-node-tuning-operator/tuned-hlwkc"
May 28 09:31:13.919800 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.918545    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d9523f19-58d0-4856-bc66-6f5f92f7bbde-run\") pod \"tuned-hlwkc\" (UID: \"d9523f19-58d0-4856-bc66-6f5f92f7bbde\") " pod="openshift-cluster-node-tuning-operator/tuned-hlwkc"
May 28 09:31:13.919800 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.918564    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ef852b03-b030-45ab-a48d-1d61305b27fa-host\") pod \"node-ca-7xzsh\" (UID: \"ef852b03-b030-45ab-a48d-1d61305b27fa\") " pod="openshift-image-registry/node-ca-7xzsh"
May 28 09:31:13.919800 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.918543    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d9523f19-58d0-4856-bc66-6f5f92f7bbde-etc-sysconfig\") pod \"tuned-hlwkc\" (UID: \"d9523f19-58d0-4856-bc66-6f5f92f7bbde\") " pod="openshift-cluster-node-tuning-operator/tuned-hlwkc"
May 28 09:31:13.919800 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.918584    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d9523f19-58d0-4856-bc66-6f5f92f7bbde-etc-systemd\") pod \"tuned-hlwkc\" (UID: \"d9523f19-58d0-4856-bc66-6f5f92f7bbde\") " pod="openshift-cluster-node-tuning-operator/tuned-hlwkc"
May 28 09:31:13.919800 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.918608    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/14a8a4a1-0374-4a48-bd7c-f38ea1dd5730-multus-daemon-config\") pod \"multus-vcggl\" (UID: \"14a8a4a1-0374-4a48-bd7c-f38ea1dd5730\") " pod="openshift-multus/multus-vcggl"
May 28 09:31:13.919800 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.918617    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d9523f19-58d0-4856-bc66-6f5f92f7bbde-run\") pod \"tuned-hlwkc\" (UID: \"d9523f19-58d0-4856-bc66-6f5f92f7bbde\") " pod="openshift-cluster-node-tuning-operator/tuned-hlwkc"
May 28 09:31:13.919800 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.918628    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ccf30b25-8ebf-406d-acb8-9a6234f58b7c-systemd-units\") pod \"ovnkube-node-hxhf6\" (UID: \"ccf30b25-8ebf-406d-acb8-9a6234f58b7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6"
May 28 09:31:13.919800 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.918659    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ccf30b25-8ebf-406d-acb8-9a6234f58b7c-systemd-units\") pod \"ovnkube-node-hxhf6\" (UID: \"ccf30b25-8ebf-406d-acb8-9a6234f58b7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6"
May 28 09:31:13.919800 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.918674    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ccf30b25-8ebf-406d-acb8-9a6234f58b7c-ovnkube-script-lib\") pod \"ovnkube-node-hxhf6\" (UID: \"ccf30b25-8ebf-406d-acb8-9a6234f58b7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6"
May 28 09:31:13.920505 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.918705    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/14a8a4a1-0374-4a48-bd7c-f38ea1dd5730-etc-kubernetes\") pod \"multus-vcggl\" (UID: \"14a8a4a1-0374-4a48-bd7c-f38ea1dd5730\") " pod="openshift-multus/multus-vcggl"
May 28 09:31:13.920505 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.918738    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d9523f19-58d0-4856-bc66-6f5f92f7bbde-etc-sysctl-conf\") pod \"tuned-hlwkc\" (UID: \"d9523f19-58d0-4856-bc66-6f5f92f7bbde\") " pod="openshift-cluster-node-tuning-operator/tuned-hlwkc"
May 28 09:31:13.920505 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.918764    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ccf30b25-8ebf-406d-acb8-9a6234f58b7c-node-log\") pod \"ovnkube-node-hxhf6\" (UID: \"ccf30b25-8ebf-406d-acb8-9a6234f58b7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6"
May 28 09:31:13.920505 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.918787    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ccf30b25-8ebf-406d-acb8-9a6234f58b7c-host-run-ovn-kubernetes\") pod \"ovnkube-node-hxhf6\" (UID: \"ccf30b25-8ebf-406d-acb8-9a6234f58b7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6"
May 28 09:31:13.920505 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.918826    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7mxjs\" (UniqueName: \"kubernetes.io/projected/744e07a8-4e72-49f1-998a-525cef2d5fc1-kube-api-access-7mxjs\") pod \"network-check-target-jx9bd\" (UID: \"744e07a8-4e72-49f1-998a-525cef2d5fc1\") " pod="openshift-network-diagnostics/network-check-target-jx9bd"
May 28 09:31:13.920505 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.918851    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/98e6ce8d-ad11-47b7-9b11-ce34957eb822-konnectivity-ca\") pod \"konnectivity-agent-w8rpf\" (UID: \"98e6ce8d-ad11-47b7-9b11-ce34957eb822\") " pod="kube-system/konnectivity-agent-w8rpf"
May 28 09:31:13.920505 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.918864    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d9523f19-58d0-4856-bc66-6f5f92f7bbde-etc-sysctl-conf\") pod \"tuned-hlwkc\" (UID: \"d9523f19-58d0-4856-bc66-6f5f92f7bbde\") " pod="openshift-cluster-node-tuning-operator/tuned-hlwkc"
May 28 09:31:13.920505 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.918876    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ef852b03-b030-45ab-a48d-1d61305b27fa-serviceca\") pod \"node-ca-7xzsh\" (UID: \"ef852b03-b030-45ab-a48d-1d61305b27fa\") " pod="openshift-image-registry/node-ca-7xzsh"
May 28 09:31:13.920505 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.918902    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/14a8a4a1-0374-4a48-bd7c-f38ea1dd5730-host-var-lib-cni-bin\") pod \"multus-vcggl\" (UID: \"14a8a4a1-0374-4a48-bd7c-f38ea1dd5730\") " pod="openshift-multus/multus-vcggl"
May 28 09:31:13.920505 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.918905    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d675a27b-a361-485d-bea2-9eb571533c84-iptables-alerter-script\") pod \"iptables-alerter-7pj2k\" (UID: \"d675a27b-a361-485d-bea2-9eb571533c84\") " pod="openshift-network-operator/iptables-alerter-7pj2k"
May 28 09:31:13.920505 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.918911    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ccf30b25-8ebf-406d-acb8-9a6234f58b7c-host-run-ovn-kubernetes\") pod \"ovnkube-node-hxhf6\" (UID: \"ccf30b25-8ebf-406d-acb8-9a6234f58b7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6"
May 28 09:31:13.920505 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.918928    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pcxbr\" (UID: \"fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3\") " pod="openshift-multus/multus-additional-cni-plugins-pcxbr"
May 28 09:31:13.920505 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.918950    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ccf30b25-8ebf-406d-acb8-9a6234f58b7c-node-log\") pod \"ovnkube-node-hxhf6\" (UID: \"ccf30b25-8ebf-406d-acb8-9a6234f58b7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6"
May 28 09:31:13.920505 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.919203    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ccf30b25-8ebf-406d-acb8-9a6234f58b7c-run-ovn\") pod \"ovnkube-node-hxhf6\" (UID: \"ccf30b25-8ebf-406d-acb8-9a6234f58b7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6"
May 28 09:31:13.920505 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.919235    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ccf30b25-8ebf-406d-acb8-9a6234f58b7c-host-cni-netd\") pod \"ovnkube-node-hxhf6\" (UID: \"ccf30b25-8ebf-406d-acb8-9a6234f58b7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6"
May 28 09:31:13.920505 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.919261    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ccf30b25-8ebf-406d-acb8-9a6234f58b7c-ovnkube-config\") pod \"ovnkube-node-hxhf6\" (UID: \"ccf30b25-8ebf-406d-acb8-9a6234f58b7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6"
May 28 09:31:13.920505 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.919289    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/98e6ce8d-ad11-47b7-9b11-ce34957eb822-agent-certs\") pod \"konnectivity-agent-w8rpf\" (UID: \"98e6ce8d-ad11-47b7-9b11-ce34957eb822\") " pod="kube-system/konnectivity-agent-w8rpf"
May 28 09:31:13.921282 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.919295    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ccf30b25-8ebf-406d-acb8-9a6234f58b7c-ovnkube-script-lib\") pod \"ovnkube-node-hxhf6\" (UID: \"ccf30b25-8ebf-406d-acb8-9a6234f58b7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6"
May 28 09:31:13.921282 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.919345    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d9523f19-58d0-4856-bc66-6f5f92f7bbde-etc-kubernetes\") pod \"tuned-hlwkc\" (UID: \"d9523f19-58d0-4856-bc66-6f5f92f7bbde\") " pod="openshift-cluster-node-tuning-operator/tuned-hlwkc"
May 28 09:31:13.921282 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.919370    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ccf30b25-8ebf-406d-acb8-9a6234f58b7c-host-cni-netd\") pod \"ovnkube-node-hxhf6\" (UID: \"ccf30b25-8ebf-406d-acb8-9a6234f58b7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6"
May 28 09:31:13.921282 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.919375    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pcxbr\" (UID: \"fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3\") " pod="openshift-multus/multus-additional-cni-plugins-pcxbr"
May 28 09:31:13.921282 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.919406    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pcxbr\" (UID: \"fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3\") " pod="openshift-multus/multus-additional-cni-plugins-pcxbr"
May 28 09:31:13.921282 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.919413    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ccf30b25-8ebf-406d-acb8-9a6234f58b7c-run-ovn\") pod \"ovnkube-node-hxhf6\" (UID: \"ccf30b25-8ebf-406d-acb8-9a6234f58b7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6"
May 28 09:31:13.921282 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.919420    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pcxbr\" (UID: \"fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3\") " pod="openshift-multus/multus-additional-cni-plugins-pcxbr"
May 28 09:31:13.921282 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.919443    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/14a8a4a1-0374-4a48-bd7c-f38ea1dd5730-multus-conf-dir\") pod \"multus-vcggl\" (UID: \"14a8a4a1-0374-4a48-bd7c-f38ea1dd5730\") " pod="openshift-multus/multus-vcggl"
May 28 09:31:13.921282 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.919472    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/98e6ce8d-ad11-47b7-9b11-ce34957eb822-konnectivity-ca\") pod \"konnectivity-agent-w8rpf\" (UID: \"98e6ce8d-ad11-47b7-9b11-ce34957eb822\") " pod="kube-system/konnectivity-agent-w8rpf"
May 28 09:31:13.921282 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.919492    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d9523f19-58d0-4856-bc66-6f5f92f7bbde-etc-kubernetes\") pod \"tuned-hlwkc\" (UID: \"d9523f19-58d0-4856-bc66-6f5f92f7bbde\") " pod="openshift-cluster-node-tuning-operator/tuned-hlwkc"
May 28 09:31:13.921282 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.919524    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rn2q\" (UniqueName: \"kubernetes.io/projected/14a8a4a1-0374-4a48-bd7c-f38ea1dd5730-kube-api-access-7rn2q\") pod \"multus-vcggl\" (UID: \"14a8a4a1-0374-4a48-bd7c-f38ea1dd5730\") " pod="openshift-multus/multus-vcggl"
May 28 09:31:13.921282 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.919553    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d9523f19-58d0-4856-bc66-6f5f92f7bbde-etc-modprobe-d\") pod \"tuned-hlwkc\" (UID: \"d9523f19-58d0-4856-bc66-6f5f92f7bbde\") " pod="openshift-cluster-node-tuning-operator/tuned-hlwkc"
May 28 09:31:13.921282 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.919581    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pcxbr\" (UID: \"fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3\") " pod="openshift-multus/multus-additional-cni-plugins-pcxbr"
May 28 09:31:13.921282 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.919600    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ccf30b25-8ebf-406d-acb8-9a6234f58b7c-log-socket\") pod \"ovnkube-node-hxhf6\" (UID: \"ccf30b25-8ebf-406d-acb8-9a6234f58b7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6"
May 28 09:31:13.921282 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.919625    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ccf30b25-8ebf-406d-acb8-9a6234f58b7c-host-cni-bin\") pod \"ovnkube-node-hxhf6\" (UID: \"ccf30b25-8ebf-406d-acb8-9a6234f58b7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6"
May 28 09:31:13.921282 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.919650    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ccf30b25-8ebf-406d-acb8-9a6234f58b7c-ovn-node-metrics-cert\") pod \"ovnkube-node-hxhf6\" (UID: \"ccf30b25-8ebf-406d-acb8-9a6234f58b7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6"
May 28 09:31:13.921282 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.919682    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-45jm4\" (UniqueName: \"kubernetes.io/projected/d675a27b-a361-485d-bea2-9eb571533c84-kube-api-access-45jm4\") pod \"iptables-alerter-7pj2k\" (UID: \"d675a27b-a361-485d-bea2-9eb571533c84\") " pod="openshift-network-operator/iptables-alerter-7pj2k"
May 28 09:31:13.922120 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.919701    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ccf30b25-8ebf-406d-acb8-9a6234f58b7c-log-socket\") pod \"ovnkube-node-hxhf6\" (UID: \"ccf30b25-8ebf-406d-acb8-9a6234f58b7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6"
May 28 09:31:13.922120 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.919788    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d9523f19-58d0-4856-bc66-6f5f92f7bbde-etc-modprobe-d\") pod \"tuned-hlwkc\" (UID: \"d9523f19-58d0-4856-bc66-6f5f92f7bbde\") " pod="openshift-cluster-node-tuning-operator/tuned-hlwkc"
May 28 09:31:13.922120 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.919831    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ccf30b25-8ebf-406d-acb8-9a6234f58b7c-host-cni-bin\") pod \"ovnkube-node-hxhf6\" (UID: \"ccf30b25-8ebf-406d-acb8-9a6234f58b7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6"
May 28 09:31:13.922120 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.920015    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ccf30b25-8ebf-406d-acb8-9a6234f58b7c-ovnkube-config\") pod \"ovnkube-node-hxhf6\" (UID: \"ccf30b25-8ebf-406d-acb8-9a6234f58b7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6"
May 28 09:31:13.922120 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.920769    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pcxbr\" (UID: \"fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3\") " pod="openshift-multus/multus-additional-cni-plugins-pcxbr"
May 28 09:31:13.922120 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.921864    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d9523f19-58d0-4856-bc66-6f5f92f7bbde-tmp\") pod \"tuned-hlwkc\" (UID: \"d9523f19-58d0-4856-bc66-6f5f92f7bbde\") " pod="openshift-cluster-node-tuning-operator/tuned-hlwkc"
May 28 09:31:13.922120 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.921959    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d9523f19-58d0-4856-bc66-6f5f92f7bbde-etc-tuned\") pod \"tuned-hlwkc\" (UID: \"d9523f19-58d0-4856-bc66-6f5f92f7bbde\") " pod="openshift-cluster-node-tuning-operator/tuned-hlwkc"
May 28 09:31:13.922458 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.922216    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/98e6ce8d-ad11-47b7-9b11-ce34957eb822-agent-certs\") pod \"konnectivity-agent-w8rpf\" (UID: \"98e6ce8d-ad11-47b7-9b11-ce34957eb822\") " pod="kube-system/konnectivity-agent-w8rpf"
May 28 09:31:13.922458 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.922267    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ccf30b25-8ebf-406d-acb8-9a6234f58b7c-ovn-node-metrics-cert\") pod \"ovnkube-node-hxhf6\" (UID: \"ccf30b25-8ebf-406d-acb8-9a6234f58b7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6"
May 28 09:31:13.945539 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.945508    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tghqz\" (UniqueName: \"kubernetes.io/projected/ccf30b25-8ebf-406d-acb8-9a6234f58b7c-kube-api-access-tghqz\") pod \"ovnkube-node-hxhf6\" (UID: \"ccf30b25-8ebf-406d-acb8-9a6234f58b7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6"
May 28 09:31:13.945786 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.945745    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqkz4\" (UniqueName: \"kubernetes.io/projected/e2c51057-7d4b-4bae-92df-7357832498fc-kube-api-access-dqkz4\") pod \"aws-ebs-csi-driver-node-qwqn5\" (UID: \"e2c51057-7d4b-4bae-92df-7357832498fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwqn5"
May 28 09:31:13.946058 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:13.946037    2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 09:31:13.946145 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:13.946063    2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 09:31:13.946145 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:13.946077    2572 projected.go:194] Error preparing data for projected volume kube-api-access-7mxjs for pod openshift-network-diagnostics/network-check-target-jx9bd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 09:31:13.946258 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:13.946169    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/744e07a8-4e72-49f1-998a-525cef2d5fc1-kube-api-access-7mxjs podName:744e07a8-4e72-49f1-998a-525cef2d5fc1 nodeName:}" failed. No retries permitted until 2026-05-28 09:31:14.446133035 +0000 UTC m=+3.129053810 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7mxjs" (UniqueName: "kubernetes.io/projected/744e07a8-4e72-49f1-998a-525cef2d5fc1-kube-api-access-7mxjs") pod "network-check-target-jx9bd" (UID: "744e07a8-4e72-49f1-998a-525cef2d5fc1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 09:31:13.947568 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.947544    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkbzb\" (UniqueName: \"kubernetes.io/projected/fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3-kube-api-access-vkbzb\") pod \"multus-additional-cni-plugins-pcxbr\" (UID: \"fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3\") " pod="openshift-multus/multus-additional-cni-plugins-pcxbr"
May 28 09:31:13.948073 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.948048    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-45jm4\" (UniqueName: \"kubernetes.io/projected/d675a27b-a361-485d-bea2-9eb571533c84-kube-api-access-45jm4\") pod \"iptables-alerter-7pj2k\" (UID: \"d675a27b-a361-485d-bea2-9eb571533c84\") " pod="openshift-network-operator/iptables-alerter-7pj2k"
May 28 09:31:13.948182 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:13.948162    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clt5t\" (UniqueName: \"kubernetes.io/projected/d9523f19-58d0-4856-bc66-6f5f92f7bbde-kube-api-access-clt5t\") pod \"tuned-hlwkc\" (UID: \"d9523f19-58d0-4856-bc66-6f5f92f7bbde\") " pod="openshift-cluster-node-tuning-operator/tuned-hlwkc"
May 28 09:31:14.020822 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:14.020783    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ef852b03-b030-45ab-a48d-1d61305b27fa-host\") pod \"node-ca-7xzsh\" (UID: \"ef852b03-b030-45ab-a48d-1d61305b27fa\") " pod="openshift-image-registry/node-ca-7xzsh"
May 28 09:31:14.021022 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:14.020836    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/14a8a4a1-0374-4a48-bd7c-f38ea1dd5730-multus-daemon-config\") pod \"multus-vcggl\" (UID: \"14a8a4a1-0374-4a48-bd7c-f38ea1dd5730\") " pod="openshift-multus/multus-vcggl"
May 28 09:31:14.021022 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:14.020869    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/14a8a4a1-0374-4a48-bd7c-f38ea1dd5730-etc-kubernetes\") pod \"multus-vcggl\" (UID: \"14a8a4a1-0374-4a48-bd7c-f38ea1dd5730\") " pod="openshift-multus/multus-vcggl"
May 28 09:31:14.021022 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:14.020909    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ef852b03-b030-45ab-a48d-1d61305b27fa-serviceca\") pod \"node-ca-7xzsh\" (UID: \"ef852b03-b030-45ab-a48d-1d61305b27fa\") " pod="openshift-image-registry/node-ca-7xzsh"
May 28 09:31:14.021022 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:14.020916    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ef852b03-b030-45ab-a48d-1d61305b27fa-host\") pod \"node-ca-7xzsh\" (UID: \"ef852b03-b030-45ab-a48d-1d61305b27fa\") " pod="openshift-image-registry/node-ca-7xzsh"
May 28 09:31:14.021022 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:14.020952    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/14a8a4a1-0374-4a48-bd7c-f38ea1dd5730-host-var-lib-cni-bin\") pod \"multus-vcggl\" (UID: \"14a8a4a1-0374-4a48-bd7c-f38ea1dd5730\") " pod="openshift-multus/multus-vcggl"
May 28 09:31:14.021022 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:14.020925    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/14a8a4a1-0374-4a48-bd7c-f38ea1dd5730-host-var-lib-cni-bin\") pod \"multus-vcggl\" (UID: \"14a8a4a1-0374-4a48-bd7c-f38ea1dd5730\") " pod="openshift-multus/multus-vcggl"
May 28 09:31:14.021022 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:14.021000    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/14a8a4a1-0374-4a48-bd7c-f38ea1dd5730-etc-kubernetes\") pod \"multus-vcggl\" (UID: \"14a8a4a1-0374-4a48-bd7c-f38ea1dd5730\") " pod="openshift-multus/multus-vcggl"
May 28 09:31:14.021022 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:14.021005    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/14a8a4a1-0374-4a48-bd7c-f38ea1dd5730-multus-conf-dir\") pod \"multus-vcggl\" (UID: \"14a8a4a1-0374-4a48-bd7c-f38ea1dd5730\") " pod="openshift-multus/multus-vcggl"
May 28 09:31:14.021409 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:14.021042    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/14a8a4a1-0374-4a48-bd7c-f38ea1dd5730-multus-conf-dir\") pod \"multus-vcggl\" (UID: \"14a8a4a1-0374-4a48-bd7c-f38ea1dd5730\") " pod="openshift-multus/multus-vcggl"
May 28 09:31:14.021409 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:14.021043    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7rn2q\" (UniqueName: \"kubernetes.io/projected/14a8a4a1-0374-4a48-bd7c-f38ea1dd5730-kube-api-access-7rn2q\") pod \"multus-vcggl\" (UID: \"14a8a4a1-0374-4a48-bd7c-f38ea1dd5730\") " pod="openshift-multus/multus-vcggl"
May 28 09:31:14.021409 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:14.021089    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/14a8a4a1-0374-4a48-bd7c-f38ea1dd5730-os-release\") pod \"multus-vcggl\" (UID: \"14a8a4a1-0374-4a48-bd7c-f38ea1dd5730\") " pod="openshift-multus/multus-vcggl"
May 28 09:31:14.021409 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:14.021114    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90716333-13a4-4983-b47a-c001d1da1e56-metrics-certs\") pod \"network-metrics-daemon-6crv6\" (UID: \"90716333-13a4-4983-b47a-c001d1da1e56\") " pod="openshift-multus/network-metrics-daemon-6crv6"
May 28 09:31:14.021409 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:14.021144    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2b6qb\" (UniqueName: \"kubernetes.io/projected/ef852b03-b030-45ab-a48d-1d61305b27fa-kube-api-access-2b6qb\") pod \"node-ca-7xzsh\" (UID: \"ef852b03-b030-45ab-a48d-1d61305b27fa\") " pod="openshift-image-registry/node-ca-7xzsh"
May 28 09:31:14.021409 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:14.021200    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/14a8a4a1-0374-4a48-bd7c-f38ea1dd5730-os-release\") pod \"multus-vcggl\" (UID: \"14a8a4a1-0374-4a48-bd7c-f38ea1dd5730\") " pod="openshift-multus/multus-vcggl"
May 28 09:31:14.021409 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:14.021221    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 09:31:14.021409 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:14.021250    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/14a8a4a1-0374-4a48-bd7c-f38ea1dd5730-host-var-lib-kubelet\") pod \"multus-vcggl\" (UID: \"14a8a4a1-0374-4a48-bd7c-f38ea1dd5730\") " pod="openshift-multus/multus-vcggl"
May 28 09:31:14.021409 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:14.021285    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/14a8a4a1-0374-4a48-bd7c-f38ea1dd5730-host-run-k8s-cni-cncf-io\") pod \"multus-vcggl\" (UID: \"14a8a4a1-0374-4a48-bd7c-f38ea1dd5730\") " pod="openshift-multus/multus-vcggl"
May 28 09:31:14.021409 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:14.021305    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90716333-13a4-4983-b47a-c001d1da1e56-metrics-certs podName:90716333-13a4-4983-b47a-c001d1da1e56 nodeName:}" failed. No retries permitted until 2026-05-28 09:31:14.521285622 +0000 UTC m=+3.204206402 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/90716333-13a4-4983-b47a-c001d1da1e56-metrics-certs") pod "network-metrics-daemon-6crv6" (UID: "90716333-13a4-4983-b47a-c001d1da1e56") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 09:31:14.021409 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:14.021323    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/14a8a4a1-0374-4a48-bd7c-f38ea1dd5730-host-run-k8s-cni-cncf-io\") pod \"multus-vcggl\" (UID: \"14a8a4a1-0374-4a48-bd7c-f38ea1dd5730\") " pod="openshift-multus/multus-vcggl"
May 28 09:31:14.021409 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:14.021324    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/14a8a4a1-0374-4a48-bd7c-f38ea1dd5730-host-var-lib-kubelet\") pod \"multus-vcggl\" (UID: \"14a8a4a1-0374-4a48-bd7c-f38ea1dd5730\") " pod="openshift-multus/multus-vcggl"
May 28 09:31:14.021409 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:14.021337    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/14a8a4a1-0374-4a48-bd7c-f38ea1dd5730-hostroot\") pod \"multus-vcggl\" (UID: \"14a8a4a1-0374-4a48-bd7c-f38ea1dd5730\") " pod="openshift-multus/multus-vcggl"
May 28 09:31:14.021409 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:14.021370    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/14a8a4a1-0374-4a48-bd7c-f38ea1dd5730-cnibin\") pod \"multus-vcggl\" (UID: \"14a8a4a1-0374-4a48-bd7c-f38ea1dd5730\") " pod="openshift-multus/multus-vcggl"
May 28 09:31:14.021409 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:14.021399    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/14a8a4a1-0374-4a48-bd7c-f38ea1dd5730-cni-binary-copy\") pod \"multus-vcggl\" (UID: \"14a8a4a1-0374-4a48-bd7c-f38ea1dd5730\") " pod="openshift-multus/multus-vcggl"
May 28 09:31:14.021409 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:14.021416    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ef852b03-b030-45ab-a48d-1d61305b27fa-serviceca\") pod \"node-ca-7xzsh\" (UID: \"ef852b03-b030-45ab-a48d-1d61305b27fa\") " pod="openshift-image-registry/node-ca-7xzsh"
May 28 09:31:14.022113 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:14.021426    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/14a8a4a1-0374-4a48-bd7c-f38ea1dd5730-hostroot\") pod \"multus-vcggl\" (UID: \"14a8a4a1-0374-4a48-bd7c-f38ea1dd5730\") " pod="openshift-multus/multus-vcggl"
May 28 09:31:14.022113 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:14.021462    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/14a8a4a1-0374-4a48-bd7c-f38ea1dd5730-host-var-lib-cni-multus\") pod \"multus-vcggl\" (UID: \"14a8a4a1-0374-4a48-bd7c-f38ea1dd5730\") " pod="openshift-multus/multus-vcggl"
May 28 09:31:14.022113 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:14.021429    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/14a8a4a1-0374-4a48-bd7c-f38ea1dd5730-host-var-lib-cni-multus\") pod \"multus-vcggl\" (UID: \"14a8a4a1-0374-4a48-bd7c-f38ea1dd5730\") " pod="openshift-multus/multus-vcggl"
May 28 09:31:14.022113 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:14.021428    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/14a8a4a1-0374-4a48-bd7c-f38ea1dd5730-multus-daemon-config\") pod \"multus-vcggl\" (UID: \"14a8a4a1-0374-4a48-bd7c-f38ea1dd5730\") " pod="openshift-multus/multus-vcggl"
May 28 09:31:14.022113 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:14.021484    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/14a8a4a1-0374-4a48-bd7c-f38ea1dd5730-cnibin\") pod \"multus-vcggl\" (UID: \"14a8a4a1-0374-4a48-bd7c-f38ea1dd5730\") " pod="openshift-multus/multus-vcggl"
May 28 09:31:14.022113 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:14.021593    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/14a8a4a1-0374-4a48-bd7c-f38ea1dd5730-host-run-netns\") pod \"multus-vcggl\" (UID: \"14a8a4a1-0374-4a48-bd7c-f38ea1dd5730\") " pod="openshift-multus/multus-vcggl"
May 28 09:31:14.022113 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:14.021622    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9wc6q\" (UniqueName: \"kubernetes.io/projected/90716333-13a4-4983-b47a-c001d1da1e56-kube-api-access-9wc6q\") pod \"network-metrics-daemon-6crv6\" (UID: \"90716333-13a4-4983-b47a-c001d1da1e56\") " pod="openshift-multus/network-metrics-daemon-6crv6"
May 28 09:31:14.022113 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:14.021655    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/14a8a4a1-0374-4a48-bd7c-f38ea1dd5730-host-run-multus-certs\") pod \"multus-vcggl\" (UID: \"14a8a4a1-0374-4a48-bd7c-f38ea1dd5730\") " pod="openshift-multus/multus-vcggl"
May 28 09:31:14.022113 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:14.021694    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/14a8a4a1-0374-4a48-bd7c-f38ea1dd5730-host-run-multus-certs\") pod \"multus-vcggl\" (UID: \"14a8a4a1-0374-4a48-bd7c-f38ea1dd5730\") " pod="openshift-multus/multus-vcggl"
May 28 09:31:14.022113 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:14.021693    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/14a8a4a1-0374-4a48-bd7c-f38ea1dd5730-host-run-netns\") pod \"multus-vcggl\" (UID: \"14a8a4a1-0374-4a48-bd7c-f38ea1dd5730\") " pod="openshift-multus/multus-vcggl"
May 28 09:31:14.022113 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:14.021762    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14a8a4a1-0374-4a48-bd7c-f38ea1dd5730-system-cni-dir\") pod \"multus-vcggl\" (UID: \"14a8a4a1-0374-4a48-bd7c-f38ea1dd5730\") " pod="openshift-multus/multus-vcggl"
May 28 09:31:14.022113 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:14.021801    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14a8a4a1-0374-4a48-bd7c-f38ea1dd5730-multus-cni-dir\") pod \"multus-vcggl\" (UID: \"14a8a4a1-0374-4a48-bd7c-f38ea1dd5730\") " pod="openshift-multus/multus-vcggl"
May 28 09:31:14.022113 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:14.021821    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14a8a4a1-0374-4a48-bd7c-f38ea1dd5730-system-cni-dir\") pod \"multus-vcggl\" (UID: \"14a8a4a1-0374-4a48-bd7c-f38ea1dd5730\") " pod="openshift-multus/multus-vcggl"
May 28 09:31:14.022113 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:14.021837    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/14a8a4a1-0374-4a48-bd7c-f38ea1dd5730-multus-socket-dir-parent\") pod \"multus-vcggl\" (UID: \"14a8a4a1-0374-4a48-bd7c-f38ea1dd5730\") " pod="openshift-multus/multus-vcggl"
May 28 09:31:14.022113 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:14.021853    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/14a8a4a1-0374-4a48-bd7c-f38ea1dd5730-cni-binary-copy\") pod \"multus-vcggl\" (UID: \"14a8a4a1-0374-4a48-bd7c-f38ea1dd5730\") " pod="openshift-multus/multus-vcggl"
May 28 09:31:14.022113 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:14.021878    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14a8a4a1-0374-4a48-bd7c-f38ea1dd5730-multus-cni-dir\") pod \"multus-vcggl\" (UID: \"14a8a4a1-0374-4a48-bd7c-f38ea1dd5730\") " pod="openshift-multus/multus-vcggl"
May 28 09:31:14.022113 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:14.021906    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/14a8a4a1-0374-4a48-bd7c-f38ea1dd5730-multus-socket-dir-parent\") pod \"multus-vcggl\" (UID: \"14a8a4a1-0374-4a48-bd7c-f38ea1dd5730\") " pod="openshift-multus/multus-vcggl"
May 28 09:31:14.038722 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:14.038660    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rn2q\" (UniqueName: \"kubernetes.io/projected/14a8a4a1-0374-4a48-bd7c-f38ea1dd5730-kube-api-access-7rn2q\") pod \"multus-vcggl\" (UID: \"14a8a4a1-0374-4a48-bd7c-f38ea1dd5730\") " pod="openshift-multus/multus-vcggl"
May 28 09:31:14.040320 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:14.040285    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wc6q\" (UniqueName: \"kubernetes.io/projected/90716333-13a4-4983-b47a-c001d1da1e56-kube-api-access-9wc6q\") pod \"network-metrics-daemon-6crv6\" (UID: \"90716333-13a4-4983-b47a-c001d1da1e56\") " pod="openshift-multus/network-metrics-daemon-6crv6"
May 28 09:31:14.042548 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:14.042526    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2b6qb\" (UniqueName: \"kubernetes.io/projected/ef852b03-b030-45ab-a48d-1d61305b27fa-kube-api-access-2b6qb\") pod \"node-ca-7xzsh\" (UID: \"ef852b03-b030-45ab-a48d-1d61305b27fa\") " pod="openshift-image-registry/node-ca-7xzsh"
May 28 09:31:14.061587 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:14.061558    2572 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 09:31:14.109547 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:14.109513    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6"
May 28 09:31:14.117327 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:14.117298    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pcxbr"
May 28 09:31:14.126311 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:14.126288    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7pj2k"
May 28 09:31:14.132589 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:14.132566    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-w8rpf"
May 28 09:31:14.141613 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:14.141590    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwqn5"
May 28 09:31:14.149054 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:14.149031    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hlwkc"
May 28 09:31:14.155420 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:14.155396    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7xzsh"
May 28 09:31:14.160982 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:14.160948    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vcggl"
May 28 09:31:14.449956 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:14.449737    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14a8a4a1_0374_4a48_bd7c_f38ea1dd5730.slice/crio-e8b0e474d3b171ba783697ea47a959cffc7c8e22bd42a09892f8f007b525617d WatchSource:0}: Error finding container e8b0e474d3b171ba783697ea47a959cffc7c8e22bd42a09892f8f007b525617d: Status 404 returned error can't find the container with id e8b0e474d3b171ba783697ea47a959cffc7c8e22bd42a09892f8f007b525617d
May 28 09:31:14.450946 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:14.450919    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef852b03_b030_45ab_a48d_1d61305b27fa.slice/crio-b7dd936617e88b9d1237b2620465f17697e92afed064bab07afe4ea1f4e64b55 WatchSource:0}: Error finding container b7dd936617e88b9d1237b2620465f17697e92afed064bab07afe4ea1f4e64b55: Status 404 returned error can't find the container with id b7dd936617e88b9d1237b2620465f17697e92afed064bab07afe4ea1f4e64b55
May 28 09:31:14.452334 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:14.452314    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd675a27b_a361_485d_bea2_9eb571533c84.slice/crio-ef3433b722a6a1cfb7986b64951621511b31a9857af980857e872795318b2585 WatchSource:0}: Error finding container ef3433b722a6a1cfb7986b64951621511b31a9857af980857e872795318b2585: Status 404 returned error can't find the container with id ef3433b722a6a1cfb7986b64951621511b31a9857af980857e872795318b2585
May 28 09:31:14.455084 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:14.455058    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccf30b25_8ebf_406d_acb8_9a6234f58b7c.slice/crio-72786705f0425f02bbac1bda1167e95565437e3f450a2335118ff692e5da6f49 WatchSource:0}: Error finding container 72786705f0425f02bbac1bda1167e95565437e3f450a2335118ff692e5da6f49: Status 404 returned error can't find the container with id 72786705f0425f02bbac1bda1167e95565437e3f450a2335118ff692e5da6f49
May 28 09:31:14.456195 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:14.456175    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98e6ce8d_ad11_47b7_9b11_ce34957eb822.slice/crio-360e11ad8d979bfd3b8c2e0771fa5a7037ce0ff3dcf8bae497afc85db760d2fa WatchSource:0}: Error finding container 360e11ad8d979bfd3b8c2e0771fa5a7037ce0ff3dcf8bae497afc85db760d2fa: Status 404 returned error can't find the container with id 360e11ad8d979bfd3b8c2e0771fa5a7037ce0ff3dcf8bae497afc85db760d2fa
May 28 09:31:14.457082 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:14.457032    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9523f19_58d0_4856_bc66_6f5f92f7bbde.slice/crio-e2832e4275cb2d541d7324891ed48e336cbafeee00dc22d74cd1ab64c8bc68b2 WatchSource:0}: Error finding container e2832e4275cb2d541d7324891ed48e336cbafeee00dc22d74cd1ab64c8bc68b2: Status 404 returned error can't find the container with id e2832e4275cb2d541d7324891ed48e336cbafeee00dc22d74cd1ab64c8bc68b2
May 28 09:31:14.458540 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:14.457911    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2c51057_7d4b_4bae_92df_7357832498fc.slice/crio-da6e7b658c98923e61a33dd8376f5d71f62207c000ff3aeeb879087df03a860b WatchSource:0}: Error finding container da6e7b658c98923e61a33dd8376f5d71f62207c000ff3aeeb879087df03a860b: Status 404 returned error can't find the container with id da6e7b658c98923e61a33dd8376f5d71f62207c000ff3aeeb879087df03a860b
May 28 09:31:14.524679 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:14.524652    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7mxjs\" (UniqueName: \"kubernetes.io/projected/744e07a8-4e72-49f1-998a-525cef2d5fc1-kube-api-access-7mxjs\") pod \"network-check-target-jx9bd\" (UID: \"744e07a8-4e72-49f1-998a-525cef2d5fc1\") " pod="openshift-network-diagnostics/network-check-target-jx9bd"
May 28 09:31:14.524790 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:14.524695    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90716333-13a4-4983-b47a-c001d1da1e56-metrics-certs\") pod \"network-metrics-daemon-6crv6\" (UID: \"90716333-13a4-4983-b47a-c001d1da1e56\") " pod="openshift-multus/network-metrics-daemon-6crv6"
May 28 09:31:14.524833 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:14.524796    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 09:31:14.524833 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:14.524816    2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 09:31:14.524893 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:14.524834    2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 09:31:14.524893 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:14.524844    2572 projected.go:194] Error preparing data for projected volume kube-api-access-7mxjs for pod openshift-network-diagnostics/network-check-target-jx9bd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 09:31:14.524893 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:14.524849    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90716333-13a4-4983-b47a-c001d1da1e56-metrics-certs podName:90716333-13a4-4983-b47a-c001d1da1e56 nodeName:}" failed. No retries permitted until 2026-05-28 09:31:15.524835454 +0000 UTC m=+4.207756217 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/90716333-13a4-4983-b47a-c001d1da1e56-metrics-certs") pod "network-metrics-daemon-6crv6" (UID: "90716333-13a4-4983-b47a-c001d1da1e56") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 09:31:14.525009 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:14.524895    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/744e07a8-4e72-49f1-998a-525cef2d5fc1-kube-api-access-7mxjs podName:744e07a8-4e72-49f1-998a-525cef2d5fc1 nodeName:}" failed. No retries permitted until 2026-05-28 09:31:15.524883783 +0000 UTC m=+4.207804558 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7mxjs" (UniqueName: "kubernetes.io/projected/744e07a8-4e72-49f1-998a-525cef2d5fc1-kube-api-access-7mxjs") pod "network-check-target-jx9bd" (UID: "744e07a8-4e72-49f1-998a-525cef2d5fc1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 09:31:14.903314 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:14.903243    2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 09:26:12 +0000 UTC" deadline="2027-12-30 04:45:11.573787097 +0000 UTC"
May 28 09:31:14.903314 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:14.903287    2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13939h13m56.670504243s"
May 28 09:31:14.950132 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:14.950040    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-204.ec2.internal" event={"ID":"ab4679d9308dd4bfe245e4be6b41a75f","Type":"ContainerStarted","Data":"2fd99f9531ffa37926d6125959c0badc375d80e459d59c730bbc18bacdf18d37"}
May 28 09:31:14.955281 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:14.955249    2572 generic.go:358] "Generic (PLEG): container finished" podID="9fceee618507396ff5bf6dfb90ee19d5" containerID="055ecb405cfb7ccc9ebfbcfc6bb10b7441551eb8b61d5ad62a3703c3e70d5728" exitCode=0
May 28 09:31:14.955429 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:14.955326    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-204.ec2.internal" event={"ID":"9fceee618507396ff5bf6dfb90ee19d5","Type":"ContainerDied","Data":"055ecb405cfb7ccc9ebfbcfc6bb10b7441551eb8b61d5ad62a3703c3e70d5728"}
May 28 09:31:14.960291 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:14.960260    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-w8rpf" event={"ID":"98e6ce8d-ad11-47b7-9b11-ce34957eb822","Type":"ContainerStarted","Data":"360e11ad8d979bfd3b8c2e0771fa5a7037ce0ff3dcf8bae497afc85db760d2fa"}
May 28 09:31:14.965863 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:14.965832    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7xzsh" event={"ID":"ef852b03-b030-45ab-a48d-1d61305b27fa","Type":"ContainerStarted","Data":"b7dd936617e88b9d1237b2620465f17697e92afed064bab07afe4ea1f4e64b55"}
May 28 09:31:14.973452 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:14.973384    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pcxbr" event={"ID":"fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3","Type":"ContainerStarted","Data":"1e720946812fbfa0a7ba645353cced83252db024c66189fe8934910044626cf3"}
May 28 09:31:14.978385 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:14.978311    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwqn5" event={"ID":"e2c51057-7d4b-4bae-92df-7357832498fc","Type":"ContainerStarted","Data":"da6e7b658c98923e61a33dd8376f5d71f62207c000ff3aeeb879087df03a860b"}
May 28 09:31:14.990119 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:14.990085    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hlwkc" event={"ID":"d9523f19-58d0-4856-bc66-6f5f92f7bbde","Type":"ContainerStarted","Data":"e2832e4275cb2d541d7324891ed48e336cbafeee00dc22d74cd1ab64c8bc68b2"}
May 28 09:31:14.997684 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:14.997621    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6" event={"ID":"ccf30b25-8ebf-406d-acb8-9a6234f58b7c","Type":"ContainerStarted","Data":"72786705f0425f02bbac1bda1167e95565437e3f450a2335118ff692e5da6f49"}
May 28 09:31:14.999586 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:14.999519    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7pj2k" event={"ID":"d675a27b-a361-485d-bea2-9eb571533c84","Type":"ContainerStarted","Data":"ef3433b722a6a1cfb7986b64951621511b31a9857af980857e872795318b2585"}
May 28 09:31:15.003143 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:15.002963    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vcggl" event={"ID":"14a8a4a1-0374-4a48-bd7c-f38ea1dd5730","Type":"ContainerStarted","Data":"e8b0e474d3b171ba783697ea47a959cffc7c8e22bd42a09892f8f007b525617d"}
May 28 09:31:15.015172 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:15.014780    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-204.ec2.internal" podStartSLOduration=2.014741815 podStartE2EDuration="2.014741815s" podCreationTimestamp="2026-05-28 09:31:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 09:31:14.986328039 +0000 UTC m=+3.669248820" watchObservedRunningTime="2026-05-28 09:31:15.014741815 +0000 UTC m=+3.697662598"
May 28 09:31:15.536768 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:15.536729    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7mxjs\" (UniqueName: \"kubernetes.io/projected/744e07a8-4e72-49f1-998a-525cef2d5fc1-kube-api-access-7mxjs\") pod \"network-check-target-jx9bd\" (UID: \"744e07a8-4e72-49f1-998a-525cef2d5fc1\") " pod="openshift-network-diagnostics/network-check-target-jx9bd"
May 28 09:31:15.537036 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:15.536796    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90716333-13a4-4983-b47a-c001d1da1e56-metrics-certs\") pod \"network-metrics-daemon-6crv6\" (UID: \"90716333-13a4-4983-b47a-c001d1da1e56\") " pod="openshift-multus/network-metrics-daemon-6crv6"
May 28 09:31:15.537036 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:15.536931    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 09:31:15.537036 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:15.536928    2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 09:31:15.537036 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:15.537017    2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 09:31:15.537036 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:15.537032    2572 projected.go:194] Error preparing data for projected volume kube-api-access-7mxjs for pod openshift-network-diagnostics/network-check-target-jx9bd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 09:31:15.537036 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:15.537034    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90716333-13a4-4983-b47a-c001d1da1e56-metrics-certs podName:90716333-13a4-4983-b47a-c001d1da1e56 nodeName:}" failed. No retries permitted until 2026-05-28 09:31:17.537012392 +0000 UTC m=+6.219933172 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/90716333-13a4-4983-b47a-c001d1da1e56-metrics-certs") pod "network-metrics-daemon-6crv6" (UID: "90716333-13a4-4983-b47a-c001d1da1e56") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 09:31:15.537341 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:15.537088    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/744e07a8-4e72-49f1-998a-525cef2d5fc1-kube-api-access-7mxjs podName:744e07a8-4e72-49f1-998a-525cef2d5fc1 nodeName:}" failed. No retries permitted until 2026-05-28 09:31:17.537068941 +0000 UTC m=+6.219989736 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7mxjs" (UniqueName: "kubernetes.io/projected/744e07a8-4e72-49f1-998a-525cef2d5fc1-kube-api-access-7mxjs") pod "network-check-target-jx9bd" (UID: "744e07a8-4e72-49f1-998a-525cef2d5fc1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 09:31:15.917691 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:15.917129    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jx9bd"
May 28 09:31:15.917691 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:15.917258    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jx9bd" podUID="744e07a8-4e72-49f1-998a-525cef2d5fc1"
May 28 09:31:15.918597 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:15.918363    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6crv6"
May 28 09:31:15.918597 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:15.918483    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6crv6" podUID="90716333-13a4-4983-b47a-c001d1da1e56"
May 28 09:31:16.027547 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:16.027417    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-204.ec2.internal" event={"ID":"9fceee618507396ff5bf6dfb90ee19d5","Type":"ContainerStarted","Data":"4bb1bf50c51dd5000254696cf9f1a863471a847a8e2f936a080b2e7af53866fa"}
May 28 09:31:16.051538 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:16.051473    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-204.ec2.internal" podStartSLOduration=3.051452078 podStartE2EDuration="3.051452078s" podCreationTimestamp="2026-05-28 09:31:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 09:31:16.050190566 +0000 UTC m=+4.733111350" watchObservedRunningTime="2026-05-28 09:31:16.051452078 +0000 UTC m=+4.734372863"
May 28 09:31:17.552356 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:17.552312    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7mxjs\" (UniqueName: \"kubernetes.io/projected/744e07a8-4e72-49f1-998a-525cef2d5fc1-kube-api-access-7mxjs\") pod \"network-check-target-jx9bd\" (UID: \"744e07a8-4e72-49f1-998a-525cef2d5fc1\") " pod="openshift-network-diagnostics/network-check-target-jx9bd"
May 28 09:31:17.552804 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:17.552384    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90716333-13a4-4983-b47a-c001d1da1e56-metrics-certs\") pod \"network-metrics-daemon-6crv6\" (UID: \"90716333-13a4-4983-b47a-c001d1da1e56\") " pod="openshift-multus/network-metrics-daemon-6crv6"
May 28 09:31:17.552804 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:17.552530    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 09:31:17.552804 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:17.552591    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90716333-13a4-4983-b47a-c001d1da1e56-metrics-certs podName:90716333-13a4-4983-b47a-c001d1da1e56 nodeName:}" failed. No retries permitted until 2026-05-28 09:31:21.552571893 +0000 UTC m=+10.235492676 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/90716333-13a4-4983-b47a-c001d1da1e56-metrics-certs") pod "network-metrics-daemon-6crv6" (UID: "90716333-13a4-4983-b47a-c001d1da1e56") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 09:31:17.553088 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:17.553067    2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 09:31:17.553170 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:17.553095    2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 09:31:17.553170 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:17.553109    2572 projected.go:194] Error preparing data for projected volume kube-api-access-7mxjs for pod openshift-network-diagnostics/network-check-target-jx9bd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 09:31:17.553170 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:17.553158    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/744e07a8-4e72-49f1-998a-525cef2d5fc1-kube-api-access-7mxjs podName:744e07a8-4e72-49f1-998a-525cef2d5fc1 nodeName:}" failed. No retries permitted until 2026-05-28 09:31:21.553141837 +0000 UTC m=+10.236062601 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7mxjs" (UniqueName: "kubernetes.io/projected/744e07a8-4e72-49f1-998a-525cef2d5fc1-kube-api-access-7mxjs") pod "network-check-target-jx9bd" (UID: "744e07a8-4e72-49f1-998a-525cef2d5fc1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 09:31:17.917206 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:17.916425    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jx9bd"
May 28 09:31:17.917206 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:17.916580    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jx9bd" podUID="744e07a8-4e72-49f1-998a-525cef2d5fc1"
May 28 09:31:17.917206 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:17.916990    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6crv6"
May 28 09:31:17.917206 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:17.917096    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6crv6" podUID="90716333-13a4-4983-b47a-c001d1da1e56"
May 28 09:31:19.915802 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:19.915764    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jx9bd"
May 28 09:31:19.916294 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:19.915765    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6crv6"
May 28 09:31:19.916294 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:19.915913    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jx9bd" podUID="744e07a8-4e72-49f1-998a-525cef2d5fc1"
May 28 09:31:19.916294 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:19.916058    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6crv6" podUID="90716333-13a4-4983-b47a-c001d1da1e56"
May 28 09:31:21.586629 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:21.586595    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90716333-13a4-4983-b47a-c001d1da1e56-metrics-certs\") pod \"network-metrics-daemon-6crv6\" (UID: \"90716333-13a4-4983-b47a-c001d1da1e56\") " pod="openshift-multus/network-metrics-daemon-6crv6"
May 28 09:31:21.587094 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:21.586675    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7mxjs\" (UniqueName: \"kubernetes.io/projected/744e07a8-4e72-49f1-998a-525cef2d5fc1-kube-api-access-7mxjs\") pod \"network-check-target-jx9bd\" (UID: \"744e07a8-4e72-49f1-998a-525cef2d5fc1\") " pod="openshift-network-diagnostics/network-check-target-jx9bd"
May 28 09:31:21.587094 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:21.586762    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 09:31:21.587094 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:21.586783    2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 09:31:21.587094 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:21.586796    2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 09:31:21.587094 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:21.586808    2572 projected.go:194] Error preparing data for projected volume kube-api-access-7mxjs for pod openshift-network-diagnostics/network-check-target-jx9bd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 09:31:21.587094 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:21.586830    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90716333-13a4-4983-b47a-c001d1da1e56-metrics-certs podName:90716333-13a4-4983-b47a-c001d1da1e56 nodeName:}" failed. No retries permitted until 2026-05-28 09:31:29.586809707 +0000 UTC m=+18.269730488 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/90716333-13a4-4983-b47a-c001d1da1e56-metrics-certs") pod "network-metrics-daemon-6crv6" (UID: "90716333-13a4-4983-b47a-c001d1da1e56") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 09:31:21.587094 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:21.586848    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/744e07a8-4e72-49f1-998a-525cef2d5fc1-kube-api-access-7mxjs podName:744e07a8-4e72-49f1-998a-525cef2d5fc1 nodeName:}" failed. No retries permitted until 2026-05-28 09:31:29.586839001 +0000 UTC m=+18.269759768 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7mxjs" (UniqueName: "kubernetes.io/projected/744e07a8-4e72-49f1-998a-525cef2d5fc1-kube-api-access-7mxjs") pod "network-check-target-jx9bd" (UID: "744e07a8-4e72-49f1-998a-525cef2d5fc1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 09:31:21.898919 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:21.898767    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-wx6tn"]
May 28 09:31:21.919521 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:21.919483    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wx6tn"
May 28 09:31:21.922508 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:21.922479    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6crv6"
May 28 09:31:21.922657 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:21.922622    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6crv6" podUID="90716333-13a4-4983-b47a-c001d1da1e56"
May 28 09:31:21.922737 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:21.922719    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jx9bd"
May 28 09:31:21.922804 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:21.922782    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jx9bd" podUID="744e07a8-4e72-49f1-998a-525cef2d5fc1"
May 28 09:31:21.923919 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:21.923898    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 28 09:31:21.924267 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:21.924248    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qch9f\""
May 28 09:31:21.924955 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:21.924932    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 28 09:31:21.990169 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:21.990128    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4bfa5bf-9ef8-43fd-907a-54e2a44a0db1-tmp-dir\") pod \"node-resolver-wx6tn\" (UID: \"c4bfa5bf-9ef8-43fd-907a-54e2a44a0db1\") " pod="openshift-dns/node-resolver-wx6tn"
May 28 09:31:21.990329 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:21.990238    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c4bfa5bf-9ef8-43fd-907a-54e2a44a0db1-hosts-file\") pod \"node-resolver-wx6tn\" (UID: \"c4bfa5bf-9ef8-43fd-907a-54e2a44a0db1\") " pod="openshift-dns/node-resolver-wx6tn"
May 28 09:31:21.990329 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:21.990318    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fd92\" (UniqueName: \"kubernetes.io/projected/c4bfa5bf-9ef8-43fd-907a-54e2a44a0db1-kube-api-access-8fd92\") pod \"node-resolver-wx6tn\" (UID: \"c4bfa5bf-9ef8-43fd-907a-54e2a44a0db1\") " pod="openshift-dns/node-resolver-wx6tn"
May 28 09:31:22.091090 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:22.091024    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8fd92\" (UniqueName: \"kubernetes.io/projected/c4bfa5bf-9ef8-43fd-907a-54e2a44a0db1-kube-api-access-8fd92\") pod \"node-resolver-wx6tn\" (UID: \"c4bfa5bf-9ef8-43fd-907a-54e2a44a0db1\") " pod="openshift-dns/node-resolver-wx6tn"
May 28 09:31:22.091259 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:22.091119    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4bfa5bf-9ef8-43fd-907a-54e2a44a0db1-tmp-dir\") pod \"node-resolver-wx6tn\" (UID: \"c4bfa5bf-9ef8-43fd-907a-54e2a44a0db1\") " pod="openshift-dns/node-resolver-wx6tn"
May 28 09:31:22.091259 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:22.091154    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c4bfa5bf-9ef8-43fd-907a-54e2a44a0db1-hosts-file\") pod \"node-resolver-wx6tn\" (UID: \"c4bfa5bf-9ef8-43fd-907a-54e2a44a0db1\") " pod="openshift-dns/node-resolver-wx6tn"
May 28 09:31:22.091497 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:22.091470    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4bfa5bf-9ef8-43fd-907a-54e2a44a0db1-tmp-dir\") pod \"node-resolver-wx6tn\" (UID: \"c4bfa5bf-9ef8-43fd-907a-54e2a44a0db1\") " pod="openshift-dns/node-resolver-wx6tn"
May 28 09:31:22.091622 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:22.091533    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c4bfa5bf-9ef8-43fd-907a-54e2a44a0db1-hosts-file\") pod \"node-resolver-wx6tn\" (UID: \"c4bfa5bf-9ef8-43fd-907a-54e2a44a0db1\") " pod="openshift-dns/node-resolver-wx6tn"
May 28 09:31:22.115747 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:22.115718    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fd92\" (UniqueName: \"kubernetes.io/projected/c4bfa5bf-9ef8-43fd-907a-54e2a44a0db1-kube-api-access-8fd92\") pod \"node-resolver-wx6tn\" (UID: \"c4bfa5bf-9ef8-43fd-907a-54e2a44a0db1\") " pod="openshift-dns/node-resolver-wx6tn"
May 28 09:31:22.232791 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:22.232709    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wx6tn"
May 28 09:31:23.916732 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:23.916691    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6crv6"
May 28 09:31:23.917213 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:23.916753    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jx9bd"
May 28 09:31:23.917213 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:23.916903    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6crv6" podUID="90716333-13a4-4983-b47a-c001d1da1e56"
May 28 09:31:23.917213 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:23.917044    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jx9bd" podUID="744e07a8-4e72-49f1-998a-525cef2d5fc1"
May 28 09:31:25.915723 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:25.915687    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6crv6"
May 28 09:31:25.916190 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:25.915727    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jx9bd"
May 28 09:31:25.916190 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:25.915839    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6crv6" podUID="90716333-13a4-4983-b47a-c001d1da1e56"
May 28 09:31:25.916190 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:25.915955    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jx9bd" podUID="744e07a8-4e72-49f1-998a-525cef2d5fc1"
May 28 09:31:27.915913 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:27.915873    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6crv6"
May 28 09:31:27.915913 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:27.915908    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jx9bd"
May 28 09:31:27.916424 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:27.916034    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6crv6" podUID="90716333-13a4-4983-b47a-c001d1da1e56"
May 28 09:31:27.916424 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:27.916124    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jx9bd" podUID="744e07a8-4e72-49f1-998a-525cef2d5fc1"
May 28 09:31:29.643293 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:29.643254    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7mxjs\" (UniqueName: \"kubernetes.io/projected/744e07a8-4e72-49f1-998a-525cef2d5fc1-kube-api-access-7mxjs\") pod \"network-check-target-jx9bd\" (UID: \"744e07a8-4e72-49f1-998a-525cef2d5fc1\") " pod="openshift-network-diagnostics/network-check-target-jx9bd"
May 28 09:31:29.643885 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:29.643311    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90716333-13a4-4983-b47a-c001d1da1e56-metrics-certs\") pod \"network-metrics-daemon-6crv6\" (UID: \"90716333-13a4-4983-b47a-c001d1da1e56\") " pod="openshift-multus/network-metrics-daemon-6crv6"
May 28 09:31:29.643885 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:29.643430    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 09:31:29.643885 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:29.643450    2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 09:31:29.643885 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:29.643480    2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 09:31:29.643885 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:29.643495    2572 projected.go:194] Error preparing data for projected volume kube-api-access-7mxjs for pod openshift-network-diagnostics/network-check-target-jx9bd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 09:31:29.643885 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:29.643504    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90716333-13a4-4983-b47a-c001d1da1e56-metrics-certs podName:90716333-13a4-4983-b47a-c001d1da1e56 nodeName:}" failed. No retries permitted until 2026-05-28 09:31:45.643483939 +0000 UTC m=+34.326404701 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/90716333-13a4-4983-b47a-c001d1da1e56-metrics-certs") pod "network-metrics-daemon-6crv6" (UID: "90716333-13a4-4983-b47a-c001d1da1e56") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 09:31:29.643885 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:29.643550    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/744e07a8-4e72-49f1-998a-525cef2d5fc1-kube-api-access-7mxjs podName:744e07a8-4e72-49f1-998a-525cef2d5fc1 nodeName:}" failed. No retries permitted until 2026-05-28 09:31:45.643533141 +0000 UTC m=+34.326453905 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7mxjs" (UniqueName: "kubernetes.io/projected/744e07a8-4e72-49f1-998a-525cef2d5fc1-kube-api-access-7mxjs") pod "network-check-target-jx9bd" (UID: "744e07a8-4e72-49f1-998a-525cef2d5fc1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 09:31:29.916056 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:29.915955    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jx9bd"
May 28 09:31:29.916200 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:29.915955    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6crv6"
May 28 09:31:29.916200 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:29.916091    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jx9bd" podUID="744e07a8-4e72-49f1-998a-525cef2d5fc1"
May 28 09:31:29.916274 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:29.916189    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6crv6" podUID="90716333-13a4-4983-b47a-c001d1da1e56"
May 28 09:31:31.916752 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:31.916712    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jx9bd"
May 28 09:31:31.917212 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:31.916849    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jx9bd" podUID="744e07a8-4e72-49f1-998a-525cef2d5fc1"
May 28 09:31:31.917212 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:31.916880    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6crv6"
May 28 09:31:31.917212 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:31.916988    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6crv6" podUID="90716333-13a4-4983-b47a-c001d1da1e56"
May 28 09:31:32.622353 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:31:32.622322    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4bfa5bf_9ef8_43fd_907a_54e2a44a0db1.slice/crio-e7eed88f9bb9f311b39d1dc7610d3f66d6b8b1069fc64aaf88506934ff213e31 WatchSource:0}: Error finding container e7eed88f9bb9f311b39d1dc7610d3f66d6b8b1069fc64aaf88506934ff213e31: Status 404 returned error can't find the container with id e7eed88f9bb9f311b39d1dc7610d3f66d6b8b1069fc64aaf88506934ff213e31
May 28 09:31:33.059657 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:33.059457    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6" event={"ID":"ccf30b25-8ebf-406d-acb8-9a6234f58b7c","Type":"ContainerStarted","Data":"3550f156657647959f847c499693957c37669e82bda0b174ae935dd58b5d41c3"}
May 28 09:31:33.060326 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:33.059674    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6" event={"ID":"ccf30b25-8ebf-406d-acb8-9a6234f58b7c","Type":"ContainerStarted","Data":"b2cc52c33bef9dc63425e5df1c4b130060dadb38718a853aa341daca5ae91ec3"}
May 28 09:31:33.060326 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:33.059691    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6" event={"ID":"ccf30b25-8ebf-406d-acb8-9a6234f58b7c","Type":"ContainerStarted","Data":"3a29e32d5983c5dfb7f42812058057be7ca32e126e79fc364f0351836b2a641c"}
May 28 09:31:33.060326 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:33.059703    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6" event={"ID":"ccf30b25-8ebf-406d-acb8-9a6234f58b7c","Type":"ContainerStarted","Data":"c0e1829beda91dcdd3c547fec59eda423c193cb16be2b6de9ea7cddf4f5295fc"}
May 28 09:31:33.061088 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:33.061062    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vcggl" event={"ID":"14a8a4a1-0374-4a48-bd7c-f38ea1dd5730","Type":"ContainerStarted","Data":"b45c5814d99af8c555bb69951249b1f1716963336027eaf318959aa9f93f663d"}
May 28 09:31:33.062474 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:33.062449    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wx6tn" event={"ID":"c4bfa5bf-9ef8-43fd-907a-54e2a44a0db1","Type":"ContainerStarted","Data":"13bb30dbf666cbdc643010fc3d085a89a3e9c0825eb4e4b2dfe525bdf68db63b"}
May 28 09:31:33.062549 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:33.062484    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wx6tn" event={"ID":"c4bfa5bf-9ef8-43fd-907a-54e2a44a0db1","Type":"ContainerStarted","Data":"e7eed88f9bb9f311b39d1dc7610d3f66d6b8b1069fc64aaf88506934ff213e31"}
May 28 09:31:33.063587 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:33.063567    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-w8rpf" event={"ID":"98e6ce8d-ad11-47b7-9b11-ce34957eb822","Type":"ContainerStarted","Data":"c344a87c194ffd414a833c936051a1867d9c0fbf10ba50b66f2d689cc64b585a"}
May 28 09:31:33.064777 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:33.064757    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7xzsh" event={"ID":"ef852b03-b030-45ab-a48d-1d61305b27fa","Type":"ContainerStarted","Data":"e5e882fb4ed3884717be171e02da82bcf2c54e084f05edf69ef5f43b3b2c5e47"}
May 28 09:31:33.066195 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:33.066169    2572 generic.go:358] "Generic (PLEG): container finished" podID="fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3" containerID="92bb26facbd9d184604d3cf94ca81b12a371a62684b4c0e1f2fef8b978158391" exitCode=0
May 28 09:31:33.066269 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:33.066245    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pcxbr" event={"ID":"fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3","Type":"ContainerDied","Data":"92bb26facbd9d184604d3cf94ca81b12a371a62684b4c0e1f2fef8b978158391"}
May 28 09:31:33.067530 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:33.067505    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwqn5" event={"ID":"e2c51057-7d4b-4bae-92df-7357832498fc","Type":"ContainerStarted","Data":"2172cdc0df27ac4f6e52b4a1b8bcc4db17919b6ed21c4855c16ed336b4d8a2be"}
May 28 09:31:33.069199 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:33.069171    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hlwkc" event={"ID":"d9523f19-58d0-4856-bc66-6f5f92f7bbde","Type":"ContainerStarted","Data":"7fd21de7c5fd6e819c537f427cab326026d1a8aaa7b802d304ddb55d8d836760"}
May 28 09:31:33.084177 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:33.084131    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-vcggl" podStartSLOduration=2.833177193 podStartE2EDuration="21.084116028s" podCreationTimestamp="2026-05-28 09:31:12 +0000 UTC" firstStartedPulling="2026-05-28 09:31:14.451560906 +0000 UTC m=+3.134481681" lastFinishedPulling="2026-05-28 09:31:32.702499735 +0000 UTC m=+21.385420516" observedRunningTime="2026-05-28 09:31:33.083932184 +0000 UTC m=+21.766852977" watchObservedRunningTime="2026-05-28 09:31:33.084116028 +0000 UTC m=+21.767036812"
May 28 09:31:33.107095 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:33.107055    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-wx6tn" podStartSLOduration=12.107040751 podStartE2EDuration="12.107040751s" podCreationTimestamp="2026-05-28 09:31:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 09:31:33.1067594 +0000 UTC m=+21.789680194" watchObservedRunningTime="2026-05-28 09:31:33.107040751 +0000 UTC m=+21.789961534"
May 28 09:31:33.146460 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:33.146424    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-w8rpf" podStartSLOduration=3.037048238 podStartE2EDuration="21.146410316s" podCreationTimestamp="2026-05-28 09:31:12 +0000 UTC" firstStartedPulling="2026-05-28 09:31:14.460157329 +0000 UTC m=+3.143078095" lastFinishedPulling="2026-05-28 09:31:32.569519405 +0000 UTC m=+21.252440173" observedRunningTime="2026-05-28 09:31:33.127553052 +0000 UTC m=+21.810473838" watchObservedRunningTime="2026-05-28 09:31:33.146410316 +0000 UTC m=+21.829331098"
May 28 09:31:33.146646 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:33.146625    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-7xzsh" podStartSLOduration=3.03005327 podStartE2EDuration="21.146619741s" podCreationTimestamp="2026-05-28 09:31:12 +0000 UTC" firstStartedPulling="2026-05-28 09:31:14.45295075 +0000 UTC m=+3.135871522" lastFinishedPulling="2026-05-28 09:31:32.569517224 +0000 UTC m=+21.252437993" observedRunningTime="2026-05-28 09:31:33.146394882 +0000 UTC m=+21.829315666" watchObservedRunningTime="2026-05-28 09:31:33.146619741 +0000 UTC m=+21.829540524"
May 28 09:31:33.916247 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:33.916202    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jx9bd"
May 28 09:31:33.916247 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:33.916248    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6crv6"
May 28 09:31:33.916509 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:33.916345    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jx9bd" podUID="744e07a8-4e72-49f1-998a-525cef2d5fc1"
May 28 09:31:33.916509 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:33.916476    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6crv6" podUID="90716333-13a4-4983-b47a-c001d1da1e56"
May 28 09:31:34.075679 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:34.075639    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6" event={"ID":"ccf30b25-8ebf-406d-acb8-9a6234f58b7c","Type":"ContainerStarted","Data":"2e30f24a125335ce5aff25ebeee2b4203f31dec5a00e3899fd40e8ee89ae76e5"}
May 28 09:31:34.076131 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:34.075686    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6" event={"ID":"ccf30b25-8ebf-406d-acb8-9a6234f58b7c","Type":"ContainerStarted","Data":"b5dd139db55fa3680d223beb24e95db4ac235747604a992145d07679394f6f01"}
May 28 09:31:34.181514 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:34.181324    2572 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 28 09:31:34.881854 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:34.881728    2572 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-28T09:31:34.181506539Z","UUID":"d967fc40-cf56-4bff-b18e-463e66c68acb","Handler":null,"Name":"","Endpoint":""}
May 28 09:31:34.885089 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:34.885063    2572 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 28 09:31:34.885089 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:34.885096    2572 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 28 09:31:35.079066 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:35.079020    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwqn5" event={"ID":"e2c51057-7d4b-4bae-92df-7357832498fc","Type":"ContainerStarted","Data":"a264f60e6556a0df9ebca89e070a1894245abbf17f56a1c8a56546b767b6d50e"}
May 28 09:31:35.080866 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:35.080834    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7pj2k" event={"ID":"d675a27b-a361-485d-bea2-9eb571533c84","Type":"ContainerStarted","Data":"27e052a2e5865303b78dc142fd8a4a1fa8ff9981953405b5f97f15524c4348e2"}
May 28 09:31:35.099576 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:35.099527    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-hlwkc" podStartSLOduration=4.943560304 podStartE2EDuration="23.099513374s" podCreationTimestamp="2026-05-28 09:31:12 +0000 UTC" firstStartedPulling="2026-05-28 09:31:14.462133719 +0000 UTC m=+3.145054493" lastFinishedPulling="2026-05-28 09:31:32.618086801 +0000 UTC m=+21.301007563" observedRunningTime="2026-05-28 09:31:33.194432099 +0000 UTC m=+21.877352882" watchObservedRunningTime="2026-05-28 09:31:35.099513374 +0000 UTC m=+23.782434157"
May 28 09:31:35.100083 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:35.100045    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7pj2k" podStartSLOduration=4.936198275 podStartE2EDuration="23.100037356s" podCreationTimestamp="2026-05-28 09:31:12 +0000 UTC" firstStartedPulling="2026-05-28 09:31:14.454311371 +0000 UTC m=+3.137232133" lastFinishedPulling="2026-05-28 09:31:32.618150449 +0000 UTC m=+21.301071214" observedRunningTime="2026-05-28 09:31:35.099450812 +0000 UTC m=+23.782371596" watchObservedRunningTime="2026-05-28 09:31:35.100037356 +0000 UTC m=+23.782958139"
May 28 09:31:35.186807 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:35.186773    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-w8rpf"
May 28 09:31:35.187441 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:35.187417    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-w8rpf"
May 28 09:31:35.915690 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:35.915657    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6crv6"
May 28 09:31:35.915876 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:35.915657    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jx9bd"
May 28 09:31:35.915876 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:35.915789    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6crv6" podUID="90716333-13a4-4983-b47a-c001d1da1e56"
May 28 09:31:35.915876 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:35.915862    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jx9bd" podUID="744e07a8-4e72-49f1-998a-525cef2d5fc1"
May 28 09:31:36.084751 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:36.084715    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwqn5" event={"ID":"e2c51057-7d4b-4bae-92df-7357832498fc","Type":"ContainerStarted","Data":"0a7e1ef1841846085ec84e4325d2459aa1d3468078f569b888cc58a3f904503b"}
May 28 09:31:36.088193 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:36.088158    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6" event={"ID":"ccf30b25-8ebf-406d-acb8-9a6234f58b7c","Type":"ContainerStarted","Data":"19b0003304657e80725a0fdd4167877b45d21653b841fa6d86ea1a905324947f"}
May 28 09:31:36.104032 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:36.103957    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwqn5" podStartSLOduration=3.483327118 podStartE2EDuration="24.103934964s" podCreationTimestamp="2026-05-28 09:31:12 +0000 UTC" firstStartedPulling="2026-05-28 09:31:14.461892095 +0000 UTC m=+3.144812856" lastFinishedPulling="2026-05-28 09:31:35.082499937 +0000 UTC m=+23.765420702" observedRunningTime="2026-05-28 09:31:36.103662294 +0000 UTC m=+24.786583078" watchObservedRunningTime="2026-05-28 09:31:36.103934964 +0000 UTC m=+24.786855743"
May 28 09:31:37.915709 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:37.915480    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6crv6"
May 28 09:31:37.916226 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:37.915625    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jx9bd"
May 28 09:31:37.916226 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:37.915827    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6crv6" podUID="90716333-13a4-4983-b47a-c001d1da1e56"
May 28 09:31:37.916226 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:37.915893    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jx9bd" podUID="744e07a8-4e72-49f1-998a-525cef2d5fc1"
May 28 09:31:38.094540 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:38.094504    2572 generic.go:358] "Generic (PLEG): container finished" podID="fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3" containerID="e3eaa6db276b43af70c64fdb48f37b3ed0b8850c8a978f7981263d85e768f719" exitCode=0
May 28 09:31:38.094697 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:38.094588    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pcxbr" event={"ID":"fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3","Type":"ContainerDied","Data":"e3eaa6db276b43af70c64fdb48f37b3ed0b8850c8a978f7981263d85e768f719"}
May 28 09:31:38.098542 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:38.098520    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6" event={"ID":"ccf30b25-8ebf-406d-acb8-9a6234f58b7c","Type":"ContainerStarted","Data":"821f539eb1206bd817ad224651955552952d1f47b0be8e0d58caf92dd5cc7e01"}
May 28 09:31:38.098848 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:38.098825    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6"
May 28 09:31:38.098948 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:38.098858    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6"
May 28 09:31:38.098948 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:38.098881    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6"
May 28 09:31:38.114660 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:38.114632    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6"
May 28 09:31:38.114812 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:38.114715    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6"
May 28 09:31:38.151373 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:38.151316    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6" podStartSLOduration=8.956568717 podStartE2EDuration="27.151301048s" podCreationTimestamp="2026-05-28 09:31:11 +0000 UTC" firstStartedPulling="2026-05-28 09:31:14.460375013 +0000 UTC m=+3.143295793" lastFinishedPulling="2026-05-28 09:31:32.655107356 +0000 UTC m=+21.338028124" observedRunningTime="2026-05-28 09:31:38.150920406 +0000 UTC m=+26.833841188" watchObservedRunningTime="2026-05-28 09:31:38.151301048 +0000 UTC m=+26.834221831"
May 28 09:31:39.654143 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:39.653933    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jx9bd"]
May 28 09:31:39.654516 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:39.654247    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jx9bd"
May 28 09:31:39.654516 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:39.654333    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jx9bd" podUID="744e07a8-4e72-49f1-998a-525cef2d5fc1"
May 28 09:31:39.656797 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:39.656770    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6crv6"]
May 28 09:31:39.656949 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:39.656875    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6crv6"
May 28 09:31:39.657041 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:39.656982    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6crv6" podUID="90716333-13a4-4983-b47a-c001d1da1e56"
May 28 09:31:40.105258 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:40.105225    2572 generic.go:358] "Generic (PLEG): container finished" podID="fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3" containerID="b1f2ba4b3c2fe6d14595c76885231c2dd2dcdc7324e687d1448577ce4a8662b6" exitCode=0
May 28 09:31:40.105421 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:40.105309    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pcxbr" event={"ID":"fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3","Type":"ContainerDied","Data":"b1f2ba4b3c2fe6d14595c76885231c2dd2dcdc7324e687d1448577ce4a8662b6"}
May 28 09:31:41.916211 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:41.916181    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jx9bd"
May 28 09:31:41.916926 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:41.916291    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jx9bd" podUID="744e07a8-4e72-49f1-998a-525cef2d5fc1"
May 28 09:31:41.916926 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:41.916338    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6crv6"
May 28 09:31:41.916926 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:41.916479    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6crv6" podUID="90716333-13a4-4983-b47a-c001d1da1e56"
May 28 09:31:42.112155 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:42.112051    2572 generic.go:358] "Generic (PLEG): container finished" podID="fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3" containerID="6a1388a28a726b038b5c324ddf90ec0f16542858bdebd684418c80c8fce90c89" exitCode=0
May 28 09:31:42.112155 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:42.112103    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pcxbr" event={"ID":"fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3","Type":"ContainerDied","Data":"6a1388a28a726b038b5c324ddf90ec0f16542858bdebd684418c80c8fce90c89"}
May 28 09:31:43.182321 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:43.182295    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wx6tn_c4bfa5bf-9ef8-43fd-907a-54e2a44a0db1/dns-node-resolver/0.log"
May 28 09:31:43.490801 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:43.490712    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-w8rpf"
May 28 09:31:43.490955 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:43.490875    2572 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
May 28 09:31:43.491333 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:43.491310    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-w8rpf"
May 28 09:31:43.918246 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:43.918219    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6crv6"
May 28 09:31:43.918246 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:43.918230    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jx9bd"
May 28 09:31:43.918456 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:43.918321    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6crv6" podUID="90716333-13a4-4983-b47a-c001d1da1e56"
May 28 09:31:43.918504 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:43.918465    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jx9bd" podUID="744e07a8-4e72-49f1-998a-525cef2d5fc1"
May 28 09:31:43.958123 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:43.958095    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7xzsh_ef852b03-b030-45ab-a48d-1d61305b27fa/node-ca/0.log"
May 28 09:31:45.629782 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:45.629745    2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-204.ec2.internal" event="NodeReady"
May 28 09:31:45.630363 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:45.629911    2572 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 28 09:31:45.661988 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:45.661937    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90716333-13a4-4983-b47a-c001d1da1e56-metrics-certs\") pod \"network-metrics-daemon-6crv6\" (UID: \"90716333-13a4-4983-b47a-c001d1da1e56\") " pod="openshift-multus/network-metrics-daemon-6crv6"
May 28 09:31:45.662179 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:45.662028    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7mxjs\" (UniqueName: \"kubernetes.io/projected/744e07a8-4e72-49f1-998a-525cef2d5fc1-kube-api-access-7mxjs\") pod \"network-check-target-jx9bd\" (UID: \"744e07a8-4e72-49f1-998a-525cef2d5fc1\") " pod="openshift-network-diagnostics/network-check-target-jx9bd"
May 28 09:31:45.662179 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:45.662125    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 09:31:45.662179 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:45.662152    2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 09:31:45.662179 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:45.662165    2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 09:31:45.662179 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:45.662175    2572 projected.go:194] Error preparing data for projected volume kube-api-access-7mxjs for pod openshift-network-diagnostics/network-check-target-jx9bd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 09:31:45.662431 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:45.662226    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90716333-13a4-4983-b47a-c001d1da1e56-metrics-certs podName:90716333-13a4-4983-b47a-c001d1da1e56 nodeName:}" failed. No retries permitted until 2026-05-28 09:32:17.662203667 +0000 UTC m=+66.345124447 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/90716333-13a4-4983-b47a-c001d1da1e56-metrics-certs") pod "network-metrics-daemon-6crv6" (UID: "90716333-13a4-4983-b47a-c001d1da1e56") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 09:31:45.662431 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:31:45.662249    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/744e07a8-4e72-49f1-998a-525cef2d5fc1-kube-api-access-7mxjs podName:744e07a8-4e72-49f1-998a-525cef2d5fc1 nodeName:}" failed. No retries permitted until 2026-05-28 09:32:17.66223732 +0000 UTC m=+66.345158082 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7mxjs" (UniqueName: "kubernetes.io/projected/744e07a8-4e72-49f1-998a-525cef2d5fc1-kube-api-access-7mxjs") pod "network-check-target-jx9bd" (UID: "744e07a8-4e72-49f1-998a-525cef2d5fc1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 09:31:45.916111 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:45.916020    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jx9bd"
May 28 09:31:45.916285 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:45.916250    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6crv6"
May 28 09:31:45.919522 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:45.919499    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 28 09:31:45.919522 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:45.919520    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 28 09:31:45.920406 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:45.920371    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5crdw\""
May 28 09:31:45.920406 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:45.920383    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 28 09:31:45.920598 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:45.920371    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qtzdz\""
May 28 09:31:48.126051 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:48.125764    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pcxbr" event={"ID":"fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3","Type":"ContainerStarted","Data":"313e49ba8bb63d3a3ccc6ed0dc14b73ea40677a50f09ddd880db661ecb846ccb"}
May 28 09:31:49.130302 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:49.130265    2572 generic.go:358] "Generic (PLEG): container finished" podID="fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3" containerID="313e49ba8bb63d3a3ccc6ed0dc14b73ea40677a50f09ddd880db661ecb846ccb" exitCode=0
May 28 09:31:49.130664 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:49.130334    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pcxbr" event={"ID":"fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3","Type":"ContainerDied","Data":"313e49ba8bb63d3a3ccc6ed0dc14b73ea40677a50f09ddd880db661ecb846ccb"}
May 28 09:31:50.135509 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:50.135475    2572 generic.go:358] "Generic (PLEG): container finished" podID="fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3" containerID="7392b237f5d5b229f3d4bf2f2fa67d07db8f789da9ebd98f29638d237cf9d480" exitCode=0
May 28 09:31:50.135883 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:50.135541    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pcxbr" event={"ID":"fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3","Type":"ContainerDied","Data":"7392b237f5d5b229f3d4bf2f2fa67d07db8f789da9ebd98f29638d237cf9d480"}
May 28 09:31:51.140125 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:51.140088    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pcxbr" event={"ID":"fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3","Type":"ContainerStarted","Data":"aa25fa30e24572262bff786e25fd43fca629f973b37afb4cf9775fcb5561ef80"}
May 28 09:31:51.168833 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:31:51.168785    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-pcxbr" podStartSLOduration=5.660538404 podStartE2EDuration="39.168770503s" podCreationTimestamp="2026-05-28 09:31:12 +0000 UTC" firstStartedPulling="2026-05-28 09:31:14.46312424 +0000 UTC m=+3.146045016" lastFinishedPulling="2026-05-28 09:31:47.971356354 +0000 UTC m=+36.654277115" observedRunningTime="2026-05-28 09:31:51.167507409 +0000 UTC m=+39.850428194" watchObservedRunningTime="2026-05-28 09:31:51.168770503 +0000 UTC m=+39.851691283"
May 28 09:32:06.754304 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:06.754267    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-lqlpn"]
May 28 09:32:06.757536 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:06.757514    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lqlpn"
May 28 09:32:06.762862 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:06.762840    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 28 09:32:06.762999 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:06.762843    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 28 09:32:06.763481 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:06.763463    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-x9c46\""
May 28 09:32:06.763578 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:06.763480    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 28 09:32:06.763928 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:06.763901    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 28 09:32:06.772197 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:06.772174    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lqlpn"]
May 28 09:32:06.814541 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:06.814508    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-656bq"]
May 28 09:32:06.816289 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:06.816273    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-j8n6p"]
May 28 09:32:06.816447 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:06.816429    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-656bq"
May 28 09:32:06.817872 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:06.817853    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-cf76765f6-bttcq"]
May 28 09:32:06.818011 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:06.817993    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-j8n6p"
May 28 09:32:06.819642 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:06.819624    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cf76765f6-bttcq"
May 28 09:32:06.820015 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:06.820000    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 28 09:32:06.820102 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:06.820077    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 28 09:32:06.820463 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:06.820445    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5bfk5\""
May 28 09:32:06.821728 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:06.821713    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 28 09:32:06.823051 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:06.823033    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-hnw24\""
May 28 09:32:06.823137 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:06.823073    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 28 09:32:06.823195 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:06.823138    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 28 09:32:06.823726 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:06.823520    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wsbbx\""
May 28 09:32:06.823726 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:06.823553    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 28 09:32:06.824444 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:06.824425    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 28 09:32:06.824534 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:06.824490    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 28 09:32:06.828350 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:06.828333    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 28 09:32:06.830238 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:06.830218    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-656bq"]
May 28 09:32:06.833621 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:06.833601    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-cf76765f6-bttcq"]
May 28 09:32:06.840482 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:06.840460    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-j8n6p"]
May 28 09:32:06.911990 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:06.911934    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b56515ab-9ae7-4c35-a832-1341539ceaad-crio-socket\") pod \"insights-runtime-extractor-lqlpn\" (UID: \"b56515ab-9ae7-4c35-a832-1341539ceaad\") " pod="openshift-insights/insights-runtime-extractor-lqlpn"
May 28 09:32:06.912188 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:06.912028    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b56515ab-9ae7-4c35-a832-1341539ceaad-data-volume\") pod \"insights-runtime-extractor-lqlpn\" (UID: \"b56515ab-9ae7-4c35-a832-1341539ceaad\") " pod="openshift-insights/insights-runtime-extractor-lqlpn"
May 28 09:32:06.912188 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:06.912055    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2zzx\" (UniqueName: \"kubernetes.io/projected/b56515ab-9ae7-4c35-a832-1341539ceaad-kube-api-access-l2zzx\") pod \"insights-runtime-extractor-lqlpn\" (UID: \"b56515ab-9ae7-4c35-a832-1341539ceaad\") " pod="openshift-insights/insights-runtime-extractor-lqlpn"
May 28 09:32:06.912188 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:06.912094    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b56515ab-9ae7-4c35-a832-1341539ceaad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lqlpn\" (UID: \"b56515ab-9ae7-4c35-a832-1341539ceaad\") " pod="openshift-insights/insights-runtime-extractor-lqlpn"
May 28 09:32:06.912188 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:06.912115    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b56515ab-9ae7-4c35-a832-1341539ceaad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lqlpn\" (UID: \"b56515ab-9ae7-4c35-a832-1341539ceaad\") " pod="openshift-insights/insights-runtime-extractor-lqlpn"
May 28 09:32:07.012784 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:07.012693    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b56515ab-9ae7-4c35-a832-1341539ceaad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lqlpn\" (UID: \"b56515ab-9ae7-4c35-a832-1341539ceaad\") " pod="openshift-insights/insights-runtime-extractor-lqlpn"
May 28 09:32:07.012784 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:07.012732    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b56fcd18-cb73-4cc8-aa23-027c743c7722-bound-sa-token\") pod \"image-registry-cf76765f6-bttcq\" (UID: \"b56fcd18-cb73-4cc8-aa23-027c743c7722\") " pod="openshift-image-registry/image-registry-cf76765f6-bttcq"
May 28 09:32:07.012784 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:07.012777    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b56515ab-9ae7-4c35-a832-1341539ceaad-crio-socket\") pod \"insights-runtime-extractor-lqlpn\" (UID: \"b56515ab-9ae7-4c35-a832-1341539ceaad\") " pod="openshift-insights/insights-runtime-extractor-lqlpn"
May 28 09:32:07.013051 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:07.012798    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glcjm\" (UniqueName: \"kubernetes.io/projected/c3e72f88-41fa-4871-aed7-62339c90e118-kube-api-access-glcjm\") pod \"dns-default-656bq\" (UID: \"c3e72f88-41fa-4871-aed7-62339c90e118\") " pod="openshift-dns/dns-default-656bq"
May 28 09:32:07.013051 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:07.012814    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b56fcd18-cb73-4cc8-aa23-027c743c7722-registry-tls\") pod \"image-registry-cf76765f6-bttcq\" (UID: \"b56fcd18-cb73-4cc8-aa23-027c743c7722\") " pod="openshift-image-registry/image-registry-cf76765f6-bttcq"
May 28 09:32:07.013051 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:07.012846    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kr6p\" (UniqueName: \"kubernetes.io/projected/b56fcd18-cb73-4cc8-aa23-027c743c7722-kube-api-access-4kr6p\") pod \"image-registry-cf76765f6-bttcq\" (UID: \"b56fcd18-cb73-4cc8-aa23-027c743c7722\") " pod="openshift-image-registry/image-registry-cf76765f6-bttcq"
May 28 09:32:07.013051 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:07.012902    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b56515ab-9ae7-4c35-a832-1341539ceaad-crio-socket\") pod \"insights-runtime-extractor-lqlpn\" (UID: \"b56515ab-9ae7-4c35-a832-1341539ceaad\") " pod="openshift-insights/insights-runtime-extractor-lqlpn"
May 28 09:32:07.013051 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:07.012901    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b56fcd18-cb73-4cc8-aa23-027c743c7722-trusted-ca\") pod \"image-registry-cf76765f6-bttcq\" (UID: \"b56fcd18-cb73-4cc8-aa23-027c743c7722\") " pod="openshift-image-registry/image-registry-cf76765f6-bttcq"
May 28 09:32:07.013051 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:07.012943    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c3e72f88-41fa-4871-aed7-62339c90e118-config-volume\") pod \"dns-default-656bq\" (UID: \"c3e72f88-41fa-4871-aed7-62339c90e118\") " pod="openshift-dns/dns-default-656bq"
May 28 09:32:07.013051 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:07.012990    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b56fcd18-cb73-4cc8-aa23-027c743c7722-ca-trust-extracted\") pod \"image-registry-cf76765f6-bttcq\" (UID: \"b56fcd18-cb73-4cc8-aa23-027c743c7722\") " pod="openshift-image-registry/image-registry-cf76765f6-bttcq"
May 28 09:32:07.013051 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:07.013026    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b56515ab-9ae7-4c35-a832-1341539ceaad-data-volume\") pod \"insights-runtime-extractor-lqlpn\" (UID: \"b56515ab-9ae7-4c35-a832-1341539ceaad\") " pod="openshift-insights/insights-runtime-extractor-lqlpn"
May 28 09:32:07.013051 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:07.013050    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l2zzx\" (UniqueName: \"kubernetes.io/projected/b56515ab-9ae7-4c35-a832-1341539ceaad-kube-api-access-l2zzx\") pod \"insights-runtime-extractor-lqlpn\" (UID: \"b56515ab-9ae7-4c35-a832-1341539ceaad\") " pod="openshift-insights/insights-runtime-extractor-lqlpn"
May 28 09:32:07.013466 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:07.013116    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3e72f88-41fa-4871-aed7-62339c90e118-metrics-tls\") pod \"dns-default-656bq\" (UID: \"c3e72f88-41fa-4871-aed7-62339c90e118\") " pod="openshift-dns/dns-default-656bq"
May 28 09:32:07.013466 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:07.013141    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3e72f88-41fa-4871-aed7-62339c90e118-tmp-dir\") pod \"dns-default-656bq\" (UID: \"c3e72f88-41fa-4871-aed7-62339c90e118\") " pod="openshift-dns/dns-default-656bq"
May 28 09:32:07.013466 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:07.013167    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4fee2b30-cecf-4ae8-bd5a-d36adbfee0f8-cert\") pod \"ingress-canary-j8n6p\" (UID: \"4fee2b30-cecf-4ae8-bd5a-d36adbfee0f8\") " pod="openshift-ingress-canary/ingress-canary-j8n6p"
May 28 09:32:07.013466 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:07.013190    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b56fcd18-cb73-4cc8-aa23-027c743c7722-installation-pull-secrets\") pod \"image-registry-cf76765f6-bttcq\" (UID: \"b56fcd18-cb73-4cc8-aa23-027c743c7722\") " pod="openshift-image-registry/image-registry-cf76765f6-bttcq"
May 28 09:32:07.013466 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:07.013224    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b56fcd18-cb73-4cc8-aa23-027c743c7722-image-registry-private-configuration\") pod \"image-registry-cf76765f6-bttcq\" (UID: \"b56fcd18-cb73-4cc8-aa23-027c743c7722\") " pod="openshift-image-registry/image-registry-cf76765f6-bttcq"
May 28 09:32:07.013466 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:07.013252    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcbl8\" (UniqueName: \"kubernetes.io/projected/4fee2b30-cecf-4ae8-bd5a-d36adbfee0f8-kube-api-access-rcbl8\") pod \"ingress-canary-j8n6p\" (UID: \"4fee2b30-cecf-4ae8-bd5a-d36adbfee0f8\") " pod="openshift-ingress-canary/ingress-canary-j8n6p"
May 28 09:32:07.013466 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:07.013275    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b56fcd18-cb73-4cc8-aa23-027c743c7722-registry-certificates\") pod \"image-registry-cf76765f6-bttcq\" (UID: \"b56fcd18-cb73-4cc8-aa23-027c743c7722\") " pod="openshift-image-registry/image-registry-cf76765f6-bttcq"
May 28 09:32:07.013466 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:07.013312    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b56515ab-9ae7-4c35-a832-1341539ceaad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lqlpn\" (UID: \"b56515ab-9ae7-4c35-a832-1341539ceaad\") " pod="openshift-insights/insights-runtime-extractor-lqlpn"
May 28 09:32:07.013466 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:07.013349    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b56515ab-9ae7-4c35-a832-1341539ceaad-data-volume\") pod \"insights-runtime-extractor-lqlpn\" (UID: \"b56515ab-9ae7-4c35-a832-1341539ceaad\") " pod="openshift-insights/insights-runtime-extractor-lqlpn"
May 28 09:32:07.013725 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:07.013694    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b56515ab-9ae7-4c35-a832-1341539ceaad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lqlpn\" (UID: \"b56515ab-9ae7-4c35-a832-1341539ceaad\") " pod="openshift-insights/insights-runtime-extractor-lqlpn"
May 28 09:32:07.016808 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:07.016787    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b56515ab-9ae7-4c35-a832-1341539ceaad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lqlpn\" (UID: \"b56515ab-9ae7-4c35-a832-1341539ceaad\") " pod="openshift-insights/insights-runtime-extractor-lqlpn"
May 28 09:32:07.029516 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:07.029491    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2zzx\" (UniqueName: \"kubernetes.io/projected/b56515ab-9ae7-4c35-a832-1341539ceaad-kube-api-access-l2zzx\") pod \"insights-runtime-extractor-lqlpn\" (UID: \"b56515ab-9ae7-4c35-a832-1341539ceaad\") " pod="openshift-insights/insights-runtime-extractor-lqlpn"
May 28 09:32:07.066345 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:07.066310    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lqlpn"
May 28 09:32:07.113825 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:07.113787    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3e72f88-41fa-4871-aed7-62339c90e118-metrics-tls\") pod \"dns-default-656bq\" (UID: \"c3e72f88-41fa-4871-aed7-62339c90e118\") " pod="openshift-dns/dns-default-656bq"
May 28 09:32:07.113825 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:07.113820    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3e72f88-41fa-4871-aed7-62339c90e118-tmp-dir\") pod \"dns-default-656bq\" (UID: \"c3e72f88-41fa-4871-aed7-62339c90e118\") " pod="openshift-dns/dns-default-656bq"
May 28 09:32:07.114085 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:07.113847    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4fee2b30-cecf-4ae8-bd5a-d36adbfee0f8-cert\") pod \"ingress-canary-j8n6p\" (UID: \"4fee2b30-cecf-4ae8-bd5a-d36adbfee0f8\") " pod="openshift-ingress-canary/ingress-canary-j8n6p"
May 28 09:32:07.114085 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:07.113872    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b56fcd18-cb73-4cc8-aa23-027c743c7722-installation-pull-secrets\") pod \"image-registry-cf76765f6-bttcq\" (UID: \"b56fcd18-cb73-4cc8-aa23-027c743c7722\") " pod="openshift-image-registry/image-registry-cf76765f6-bttcq"
May 28 09:32:07.114085 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:07.113909    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b56fcd18-cb73-4cc8-aa23-027c743c7722-image-registry-private-configuration\") pod \"image-registry-cf76765f6-bttcq\" (UID: \"b56fcd18-cb73-4cc8-aa23-027c743c7722\") " pod="openshift-image-registry/image-registry-cf76765f6-bttcq"
May 28 09:32:07.114085 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:07.113937    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rcbl8\" (UniqueName: \"kubernetes.io/projected/4fee2b30-cecf-4ae8-bd5a-d36adbfee0f8-kube-api-access-rcbl8\") pod \"ingress-canary-j8n6p\" (UID: \"4fee2b30-cecf-4ae8-bd5a-d36adbfee0f8\") " pod="openshift-ingress-canary/ingress-canary-j8n6p"
May 28 09:32:07.114085 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:07.113965    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b56fcd18-cb73-4cc8-aa23-027c743c7722-registry-certificates\") pod \"image-registry-cf76765f6-bttcq\" (UID: \"b56fcd18-cb73-4cc8-aa23-027c743c7722\") " pod="openshift-image-registry/image-registry-cf76765f6-bttcq"
May 28 09:32:07.114085 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:07.114015    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b56fcd18-cb73-4cc8-aa23-027c743c7722-bound-sa-token\") pod \"image-registry-cf76765f6-bttcq\" (UID: \"b56fcd18-cb73-4cc8-aa23-027c743c7722\") " pod="openshift-image-registry/image-registry-cf76765f6-bttcq"
May 28 09:32:07.114085 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:07.114063    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-glcjm\" (UniqueName: \"kubernetes.io/projected/c3e72f88-41fa-4871-aed7-62339c90e118-kube-api-access-glcjm\") pod \"dns-default-656bq\" (UID: \"c3e72f88-41fa-4871-aed7-62339c90e118\") " pod="openshift-dns/dns-default-656bq"
May 28 09:32:07.114085 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:07.114088    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b56fcd18-cb73-4cc8-aa23-027c743c7722-registry-tls\") pod \"image-registry-cf76765f6-bttcq\" (UID: \"b56fcd18-cb73-4cc8-aa23-027c743c7722\") " pod="openshift-image-registry/image-registry-cf76765f6-bttcq"
May 28 09:32:07.114452 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:07.114120    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4kr6p\" (UniqueName: \"kubernetes.io/projected/b56fcd18-cb73-4cc8-aa23-027c743c7722-kube-api-access-4kr6p\") pod \"image-registry-cf76765f6-bttcq\" (UID: \"b56fcd18-cb73-4cc8-aa23-027c743c7722\") " pod="openshift-image-registry/image-registry-cf76765f6-bttcq"
May 28 09:32:07.114452 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:07.114145    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b56fcd18-cb73-4cc8-aa23-027c743c7722-trusted-ca\") pod \"image-registry-cf76765f6-bttcq\" (UID: \"b56fcd18-cb73-4cc8-aa23-027c743c7722\") " pod="openshift-image-registry/image-registry-cf76765f6-bttcq"
May 28 09:32:07.114452 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:07.114168    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c3e72f88-41fa-4871-aed7-62339c90e118-config-volume\") pod \"dns-default-656bq\" (UID: \"c3e72f88-41fa-4871-aed7-62339c90e118\") " pod="openshift-dns/dns-default-656bq"
May 28 09:32:07.114452 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:07.114184    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b56fcd18-cb73-4cc8-aa23-027c743c7722-ca-trust-extracted\") pod \"image-registry-cf76765f6-bttcq\" (UID: \"b56fcd18-cb73-4cc8-aa23-027c743c7722\") " pod="openshift-image-registry/image-registry-cf76765f6-bttcq"
May 28 09:32:07.114452 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:07.114246    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3e72f88-41fa-4871-aed7-62339c90e118-tmp-dir\") pod \"dns-default-656bq\" (UID: \"c3e72f88-41fa-4871-aed7-62339c90e118\") " pod="openshift-dns/dns-default-656bq"
May 28 09:32:07.114680 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:07.114521    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b56fcd18-cb73-4cc8-aa23-027c743c7722-ca-trust-extracted\") pod \"image-registry-cf76765f6-bttcq\" (UID: \"b56fcd18-cb73-4cc8-aa23-027c743c7722\") " pod="openshift-image-registry/image-registry-cf76765f6-bttcq"
May 28 09:32:07.115338 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:07.115188    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b56fcd18-cb73-4cc8-aa23-027c743c7722-registry-certificates\") pod \"image-registry-cf76765f6-bttcq\" (UID: \"b56fcd18-cb73-4cc8-aa23-027c743c7722\") " pod="openshift-image-registry/image-registry-cf76765f6-bttcq"
May 28 09:32:07.115338 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:07.115270    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c3e72f88-41fa-4871-aed7-62339c90e118-config-volume\") pod \"dns-default-656bq\" (UID: \"c3e72f88-41fa-4871-aed7-62339c90e118\") " pod="openshift-dns/dns-default-656bq"
May 28 09:32:07.115575 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:07.115549    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b56fcd18-cb73-4cc8-aa23-027c743c7722-trusted-ca\") pod \"image-registry-cf76765f6-bttcq\" (UID: \"b56fcd18-cb73-4cc8-aa23-027c743c7722\") " pod="openshift-image-registry/image-registry-cf76765f6-bttcq"
May 28 09:32:07.116648 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:07.116607    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b56fcd18-cb73-4cc8-aa23-027c743c7722-installation-pull-secrets\") pod \"image-registry-cf76765f6-bttcq\" (UID: \"b56fcd18-cb73-4cc8-aa23-027c743c7722\") " pod="openshift-image-registry/image-registry-cf76765f6-bttcq"
May 28 09:32:07.117211 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:07.117183    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3e72f88-41fa-4871-aed7-62339c90e118-metrics-tls\") pod \"dns-default-656bq\" (UID: \"c3e72f88-41fa-4871-aed7-62339c90e118\") " pod="openshift-dns/dns-default-656bq"
May 28 09:32:07.117336 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:07.117308    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4fee2b30-cecf-4ae8-bd5a-d36adbfee0f8-cert\") pod \"ingress-canary-j8n6p\" (UID: \"4fee2b30-cecf-4ae8-bd5a-d36adbfee0f8\") " pod="openshift-ingress-canary/ingress-canary-j8n6p"
May 28 09:32:07.117645 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:07.117621    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b56fcd18-cb73-4cc8-aa23-027c743c7722-registry-tls\") pod \"image-registry-cf76765f6-bttcq\" (UID: \"b56fcd18-cb73-4cc8-aa23-027c743c7722\") " pod="openshift-image-registry/image-registry-cf76765f6-bttcq"
May 28 09:32:07.119627 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:07.119546    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b56fcd18-cb73-4cc8-aa23-027c743c7722-image-registry-private-configuration\") pod \"image-registry-cf76765f6-bttcq\" (UID: \"b56fcd18-cb73-4cc8-aa23-027c743c7722\") " pod="openshift-image-registry/image-registry-cf76765f6-bttcq"
May 28 09:32:07.129350 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:07.129290    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b56fcd18-cb73-4cc8-aa23-027c743c7722-bound-sa-token\") pod \"image-registry-cf76765f6-bttcq\" (UID: \"b56fcd18-cb73-4cc8-aa23-027c743c7722\") " pod="openshift-image-registry/image-registry-cf76765f6-bttcq"
May 28 09:32:07.129666 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:07.129642    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kr6p\" (UniqueName: \"kubernetes.io/projected/b56fcd18-cb73-4cc8-aa23-027c743c7722-kube-api-access-4kr6p\") pod \"image-registry-cf76765f6-bttcq\" (UID: \"b56fcd18-cb73-4cc8-aa23-027c743c7722\") " pod="openshift-image-registry/image-registry-cf76765f6-bttcq"
May 28 09:32:07.129862 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:07.129843    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcbl8\" (UniqueName: \"kubernetes.io/projected/4fee2b30-cecf-4ae8-bd5a-d36adbfee0f8-kube-api-access-rcbl8\") pod \"ingress-canary-j8n6p\" (UID: \"4fee2b30-cecf-4ae8-bd5a-d36adbfee0f8\") " pod="openshift-ingress-canary/ingress-canary-j8n6p"
May 28 09:32:07.130074 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:07.130054    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-glcjm\" (UniqueName: \"kubernetes.io/projected/c3e72f88-41fa-4871-aed7-62339c90e118-kube-api-access-glcjm\") pod \"dns-default-656bq\" (UID: \"c3e72f88-41fa-4871-aed7-62339c90e118\") " pod="openshift-dns/dns-default-656bq"
May 28 09:32:07.134842 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:07.134814    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-j8n6p"
May 28 09:32:07.140922 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:07.140728    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cf76765f6-bttcq"
May 28 09:32:07.233595 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:07.231024    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lqlpn"]
May 28 09:32:07.234180 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:32:07.234154    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb56515ab_9ae7_4c35_a832_1341539ceaad.slice/crio-93b3d270e92e9dc09bf91525a3cb3c7323682e64d5d507ef696b7698e8ed650d WatchSource:0}: Error finding container 93b3d270e92e9dc09bf91525a3cb3c7323682e64d5d507ef696b7698e8ed650d: Status 404 returned error can't find the container with id 93b3d270e92e9dc09bf91525a3cb3c7323682e64d5d507ef696b7698e8ed650d
May 28 09:32:07.292272 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:07.292224    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-j8n6p"]
May 28 09:32:07.297228 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:32:07.297196    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fee2b30_cecf_4ae8_bd5a_d36adbfee0f8.slice/crio-a56f0ee28ad61e257f4cbed70f089a8ebb760b94124a0b17d837c7dd64c0850b WatchSource:0}: Error finding container a56f0ee28ad61e257f4cbed70f089a8ebb760b94124a0b17d837c7dd64c0850b: Status 404 returned error can't find the container with id a56f0ee28ad61e257f4cbed70f089a8ebb760b94124a0b17d837c7dd64c0850b
May 28 09:32:07.344280 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:07.344250    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-cf76765f6-bttcq"]
May 28 09:32:07.348223 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:32:07.348196    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb56fcd18_cb73_4cc8_aa23_027c743c7722.slice/crio-d73321ae10a9a38f7ec677779064503c8b2fd22fd8eae41c596467fdf1c3fb3c WatchSource:0}: Error finding container d73321ae10a9a38f7ec677779064503c8b2fd22fd8eae41c596467fdf1c3fb3c: Status 404 returned error can't find the container with id d73321ae10a9a38f7ec677779064503c8b2fd22fd8eae41c596467fdf1c3fb3c
May 28 09:32:07.426876 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:07.426845    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-656bq"
May 28 09:32:07.553222 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:07.553142    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-656bq"]
May 28 09:32:07.556548 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:32:07.556515    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3e72f88_41fa_4871_aed7_62339c90e118.slice/crio-23c2c323f340c25a111a31c0b599f2a6955cb6a504f475a5143e4e00fbdb7fdb WatchSource:0}: Error finding container 23c2c323f340c25a111a31c0b599f2a6955cb6a504f475a5143e4e00fbdb7fdb: Status 404 returned error can't find the container with id 23c2c323f340c25a111a31c0b599f2a6955cb6a504f475a5143e4e00fbdb7fdb
May 28 09:32:08.177137 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:08.177094    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-656bq" event={"ID":"c3e72f88-41fa-4871-aed7-62339c90e118","Type":"ContainerStarted","Data":"23c2c323f340c25a111a31c0b599f2a6955cb6a504f475a5143e4e00fbdb7fdb"}
May 28 09:32:08.178954 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:08.178868    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-cf76765f6-bttcq" event={"ID":"b56fcd18-cb73-4cc8-aa23-027c743c7722","Type":"ContainerStarted","Data":"60db4824f4570c2827fbc3fddf520e2d25275df86f75771011bf2eb67b899516"}
May 28 09:32:08.178954 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:08.178905    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-cf76765f6-bttcq" event={"ID":"b56fcd18-cb73-4cc8-aa23-027c743c7722","Type":"ContainerStarted","Data":"d73321ae10a9a38f7ec677779064503c8b2fd22fd8eae41c596467fdf1c3fb3c"}
May 28 09:32:08.179277 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:08.179009    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-cf76765f6-bttcq"
May 28 09:32:08.180917 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:08.180888    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-j8n6p" event={"ID":"4fee2b30-cecf-4ae8-bd5a-d36adbfee0f8","Type":"ContainerStarted","Data":"a56f0ee28ad61e257f4cbed70f089a8ebb760b94124a0b17d837c7dd64c0850b"}
May 28 09:32:08.183129 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:08.183106    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lqlpn" event={"ID":"b56515ab-9ae7-4c35-a832-1341539ceaad","Type":"ContainerStarted","Data":"32aec085ccbb71a1ce06fd2f3fd0dd824c562bc2d99569da59a7096b510b152e"}
May 28 09:32:08.183245 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:08.183137    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lqlpn" event={"ID":"b56515ab-9ae7-4c35-a832-1341539ceaad","Type":"ContainerStarted","Data":"7b261466a1d084c2a4f76ff709f5955efd7a9537f64d082b6152a721934ca481"}
May 28 09:32:08.183245 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:08.183152    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lqlpn" event={"ID":"b56515ab-9ae7-4c35-a832-1341539ceaad","Type":"ContainerStarted","Data":"93b3d270e92e9dc09bf91525a3cb3c7323682e64d5d507ef696b7698e8ed650d"}
May 28 09:32:08.202130 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:08.202079    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-cf76765f6-bttcq" podStartSLOduration=2.202063753 podStartE2EDuration="2.202063753s" podCreationTimestamp="2026-05-28 09:32:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 09:32:08.201352919 +0000 UTC m=+56.884273743" watchObservedRunningTime="2026-05-28 09:32:08.202063753 +0000 UTC m=+56.884984568"
May 28 09:32:10.126343 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:10.126313    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hxhf6"
May 28 09:32:11.191079 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:11.191025    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-656bq" event={"ID":"c3e72f88-41fa-4871-aed7-62339c90e118","Type":"ContainerStarted","Data":"6e68c2e06face8ac11f647638036e2b7dd20f382223e9a4e0b2a40212f6cc9a6"}
May 28 09:32:11.191079 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:11.191083    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-656bq" event={"ID":"c3e72f88-41fa-4871-aed7-62339c90e118","Type":"ContainerStarted","Data":"7ab41c178fc4079f5183ef19c491f65254e4606474048b9c8fefce373ac77e60"}
May 28 09:32:11.191564 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:11.191162    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-656bq"
May 28 09:32:11.192334 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:11.192308    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-j8n6p" event={"ID":"4fee2b30-cecf-4ae8-bd5a-d36adbfee0f8","Type":"ContainerStarted","Data":"a2efd4c810c38dca1a7e6e7106ec0fce30c6937d3c0a60dd9257f1d715f02e2f"}
May 28 09:32:11.195770 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:11.195744    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lqlpn" event={"ID":"b56515ab-9ae7-4c35-a832-1341539ceaad","Type":"ContainerStarted","Data":"2d22e41871333cf8241487de546ca7a1e50682b9fac33201f7e189363e9f33e3"}
May 28 09:32:11.219572 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:11.219517    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-656bq" podStartSLOduration=2.579522208 podStartE2EDuration="5.219502717s" podCreationTimestamp="2026-05-28 09:32:06 +0000 UTC" firstStartedPulling="2026-05-28 09:32:07.558319507 +0000 UTC m=+56.241240267" lastFinishedPulling="2026-05-28 09:32:10.198300006 +0000 UTC m=+58.881220776" observedRunningTime="2026-05-28 09:32:11.218740651 +0000 UTC m=+59.901661447" watchObservedRunningTime="2026-05-28 09:32:11.219502717 +0000 UTC m=+59.902423537"
May 28 09:32:11.266728 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:11.266675    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-lqlpn" podStartSLOduration=2.385555466 podStartE2EDuration="5.266656718s" podCreationTimestamp="2026-05-28 09:32:06 +0000 UTC" firstStartedPulling="2026-05-28 09:32:07.32051867 +0000 UTC m=+56.003439434" lastFinishedPulling="2026-05-28 09:32:10.201619925 +0000 UTC m=+58.884540686" observedRunningTime="2026-05-28 09:32:11.244293898 +0000 UTC m=+59.927214691" watchObservedRunningTime="2026-05-28 09:32:11.266656718 +0000 UTC m=+59.949577502"
May 28 09:32:11.267097 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:11.267066    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-j8n6p" podStartSLOduration=2.369735308 podStartE2EDuration="5.267055769s" podCreationTimestamp="2026-05-28 09:32:06 +0000 UTC" firstStartedPulling="2026-05-28 09:32:07.301014191 +0000 UTC m=+55.983934955" lastFinishedPulling="2026-05-28 09:32:10.198334642 +0000 UTC m=+58.881255416" observedRunningTime="2026-05-28 09:32:11.266618344 +0000 UTC m=+59.949539128" watchObservedRunningTime="2026-05-28 09:32:11.267055769 +0000 UTC m=+59.949976548"
May 28 09:32:17.691649 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:17.691608    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7mxjs\" (UniqueName: \"kubernetes.io/projected/744e07a8-4e72-49f1-998a-525cef2d5fc1-kube-api-access-7mxjs\") pod \"network-check-target-jx9bd\" (UID: \"744e07a8-4e72-49f1-998a-525cef2d5fc1\") " pod="openshift-network-diagnostics/network-check-target-jx9bd"
May 28 09:32:17.692153 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:17.691663    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90716333-13a4-4983-b47a-c001d1da1e56-metrics-certs\") pod \"network-metrics-daemon-6crv6\" (UID: \"90716333-13a4-4983-b47a-c001d1da1e56\") " pod="openshift-multus/network-metrics-daemon-6crv6"
May 28 09:32:17.694828 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:17.694807    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 28 09:32:17.695565 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:17.695549    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 28 09:32:17.705076 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:17.705048    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90716333-13a4-4983-b47a-c001d1da1e56-metrics-certs\") pod \"network-metrics-daemon-6crv6\" (UID: \"90716333-13a4-4983-b47a-c001d1da1e56\") " pod="openshift-multus/network-metrics-daemon-6crv6"
May 28 09:32:17.705619 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:17.705602    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 28 09:32:17.715649 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:17.715628    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mxjs\" (UniqueName: \"kubernetes.io/projected/744e07a8-4e72-49f1-998a-525cef2d5fc1-kube-api-access-7mxjs\") pod \"network-check-target-jx9bd\" (UID: \"744e07a8-4e72-49f1-998a-525cef2d5fc1\") " pod="openshift-network-diagnostics/network-check-target-jx9bd"
May 28 09:32:17.732268 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:17.732247    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qtzdz\""
May 28 09:32:17.736901 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:17.736878    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5crdw\""
May 28 09:32:17.740009 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:17.739994    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jx9bd"
May 28 09:32:17.744685 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:17.744664    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6crv6"
May 28 09:32:17.871428 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:17.871366    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jx9bd"]
May 28 09:32:17.877435 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:32:17.877067    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod744e07a8_4e72_49f1_998a_525cef2d5fc1.slice/crio-846a966065cdc7e85de3b3c9df91183524b5888412b260526d5d7a27a90f948a WatchSource:0}: Error finding container 846a966065cdc7e85de3b3c9df91183524b5888412b260526d5d7a27a90f948a: Status 404 returned error can't find the container with id 846a966065cdc7e85de3b3c9df91183524b5888412b260526d5d7a27a90f948a
May 28 09:32:17.890300 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:17.890270    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6crv6"]
May 28 09:32:17.893621 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:32:17.893592    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90716333_13a4_4983_b47a_c001d1da1e56.slice/crio-8060d608142d4b6f59acbcde6a52d8721645dcb30fe3d9a60e253bce47d5fa7f WatchSource:0}: Error finding container 8060d608142d4b6f59acbcde6a52d8721645dcb30fe3d9a60e253bce47d5fa7f: Status 404 returned error can't find the container with id 8060d608142d4b6f59acbcde6a52d8721645dcb30fe3d9a60e253bce47d5fa7f
May 28 09:32:18.214791 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:18.214754    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6crv6" event={"ID":"90716333-13a4-4983-b47a-c001d1da1e56","Type":"ContainerStarted","Data":"8060d608142d4b6f59acbcde6a52d8721645dcb30fe3d9a60e253bce47d5fa7f"}
May 28 09:32:18.215662 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:18.215628    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jx9bd" event={"ID":"744e07a8-4e72-49f1-998a-525cef2d5fc1","Type":"ContainerStarted","Data":"846a966065cdc7e85de3b3c9df91183524b5888412b260526d5d7a27a90f948a"}
May 28 09:32:20.223108 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:20.223006    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6crv6" event={"ID":"90716333-13a4-4983-b47a-c001d1da1e56","Type":"ContainerStarted","Data":"b90f7131778b861a6cb20c72eb40021911cb36d03db57809f3143fe4195a3b19"}
May 28 09:32:20.223108 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:20.223047    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6crv6" event={"ID":"90716333-13a4-4983-b47a-c001d1da1e56","Type":"ContainerStarted","Data":"3f5a8904e7b8aee39dbfdaddb815032c8897ba407646c2ad2cb0c722199c9314"}
May 28 09:32:20.243428 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:20.243367    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6crv6" podStartSLOduration=66.654043516 podStartE2EDuration="1m8.243346667s" podCreationTimestamp="2026-05-28 09:31:12 +0000 UTC" firstStartedPulling="2026-05-28 09:32:17.895476945 +0000 UTC m=+66.578397706" lastFinishedPulling="2026-05-28 09:32:19.484780078 +0000 UTC m=+68.167700857" observedRunningTime="2026-05-28 09:32:20.24223113 +0000 UTC m=+68.925151918" watchObservedRunningTime="2026-05-28 09:32:20.243346667 +0000 UTC m=+68.926267451"
May 28 09:32:21.200905 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:21.200873    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-656bq"
May 28 09:32:21.229603 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:21.229560    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jx9bd" event={"ID":"744e07a8-4e72-49f1-998a-525cef2d5fc1","Type":"ContainerStarted","Data":"e4210eb3c95ad2f8268c690483d89f1f5a991a1669a8119efa29af325d7af41d"}
May 28 09:32:21.247608 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:21.247561    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jx9bd" podStartSLOduration=66.03033253 podStartE2EDuration="1m9.247544918s" podCreationTimestamp="2026-05-28 09:31:12 +0000 UTC" firstStartedPulling="2026-05-28 09:32:17.878733615 +0000 UTC m=+66.561654379" lastFinishedPulling="2026-05-28 09:32:21.095946004 +0000 UTC m=+69.778866767" observedRunningTime="2026-05-28 09:32:21.246780611 +0000 UTC m=+69.929701395" watchObservedRunningTime="2026-05-28 09:32:21.247544918 +0000 UTC m=+69.930465700"
May 28 09:32:22.232250 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:22.232221    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jx9bd"
May 28 09:32:25.056870 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:25.056831    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-57bd96b888-m7b8c"]
May 28 09:32:25.059039 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:25.059013    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-m7b8c"
May 28 09:32:25.062483 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:25.062465    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-xnm8n\""
May 28 09:32:25.062749 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:25.062729    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
May 28 09:32:25.062904 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:25.062889    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
May 28 09:32:25.069842 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:25.069812    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-m7b8c"]
May 28 09:32:25.144149 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:25.144115    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbftn\" (UniqueName: \"kubernetes.io/projected/6c007210-9934-4fe1-ad3f-7bef0dccbe0c-kube-api-access-vbftn\") pod \"downloads-57bd96b888-m7b8c\" (UID: \"6c007210-9934-4fe1-ad3f-7bef0dccbe0c\") " pod="openshift-console/downloads-57bd96b888-m7b8c"
May 28 09:32:25.245173 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:25.245137    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vbftn\" (UniqueName: \"kubernetes.io/projected/6c007210-9934-4fe1-ad3f-7bef0dccbe0c-kube-api-access-vbftn\") pod \"downloads-57bd96b888-m7b8c\" (UID: \"6c007210-9934-4fe1-ad3f-7bef0dccbe0c\") " pod="openshift-console/downloads-57bd96b888-m7b8c"
May 28 09:32:25.265022 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:25.264985    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbftn\" (UniqueName: \"kubernetes.io/projected/6c007210-9934-4fe1-ad3f-7bef0dccbe0c-kube-api-access-vbftn\") pod \"downloads-57bd96b888-m7b8c\" (UID: \"6c007210-9934-4fe1-ad3f-7bef0dccbe0c\") " pod="openshift-console/downloads-57bd96b888-m7b8c"
May 28 09:32:25.367378 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:25.367282    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-m7b8c"
May 28 09:32:25.497565 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:25.497533    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-m7b8c"]
May 28 09:32:25.500832 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:32:25.500794    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c007210_9934_4fe1_ad3f_7bef0dccbe0c.slice/crio-87130ddecdfd7c63a02afe11ebc3f1f05f8a2ca0a5d678b3948ae167c455e5b0 WatchSource:0}: Error finding container 87130ddecdfd7c63a02afe11ebc3f1f05f8a2ca0a5d678b3948ae167c455e5b0: Status 404 returned error can't find the container with id 87130ddecdfd7c63a02afe11ebc3f1f05f8a2ca0a5d678b3948ae167c455e5b0
May 28 09:32:26.242559 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:26.242520    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-m7b8c" event={"ID":"6c007210-9934-4fe1-ad3f-7bef0dccbe0c","Type":"ContainerStarted","Data":"87130ddecdfd7c63a02afe11ebc3f1f05f8a2ca0a5d678b3948ae167c455e5b0"}
May 28 09:32:28.571726 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:28.571592    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-9t2vp"]
May 28 09:32:28.574077 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:28.574052    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-9t2vp"
May 28 09:32:28.577237 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:28.577214    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
May 28 09:32:28.577550 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:28.577528    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-6r2nr\""
May 28 09:32:28.589223 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:28.589200    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-9t2vp"]
May 28 09:32:28.669284 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:28.669239    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2a92c2b2-ec77-4eef-8b00-c938f0ab4e88-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-9t2vp\" (UID: \"2a92c2b2-ec77-4eef-8b00-c938f0ab4e88\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-9t2vp"
May 28 09:32:28.769701 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:28.769654    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2a92c2b2-ec77-4eef-8b00-c938f0ab4e88-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-9t2vp\" (UID: \"2a92c2b2-ec77-4eef-8b00-c938f0ab4e88\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-9t2vp"
May 28 09:32:28.769892 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:32:28.769848    2572 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
May 28 09:32:28.769962 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:32:28.769953    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a92c2b2-ec77-4eef-8b00-c938f0ab4e88-tls-certificates podName:2a92c2b2-ec77-4eef-8b00-c938f0ab4e88 nodeName:}" failed. No retries permitted until 2026-05-28 09:32:29.269928005 +0000 UTC m=+77.952848769 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/2a92c2b2-ec77-4eef-8b00-c938f0ab4e88-tls-certificates") pod "prometheus-operator-admission-webhook-6c4bbc67b7-9t2vp" (UID: "2a92c2b2-ec77-4eef-8b00-c938f0ab4e88") : secret "prometheus-operator-admission-webhook-tls" not found
May 28 09:32:29.190406 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:29.190375    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-cf76765f6-bttcq"
May 28 09:32:29.274296 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:29.274259    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2a92c2b2-ec77-4eef-8b00-c938f0ab4e88-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-9t2vp\" (UID: \"2a92c2b2-ec77-4eef-8b00-c938f0ab4e88\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-9t2vp"
May 28 09:32:29.277846 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:29.277815    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2a92c2b2-ec77-4eef-8b00-c938f0ab4e88-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-9t2vp\" (UID: \"2a92c2b2-ec77-4eef-8b00-c938f0ab4e88\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-9t2vp"
May 28 09:32:29.486089 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:29.485998    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-9t2vp"
May 28 09:32:29.578919 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:29.578892    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6c544f5446-2b9dd"]
May 28 09:32:29.583363 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:29.583332    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c544f5446-2b9dd"
May 28 09:32:29.586414 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:29.586386    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
May 28 09:32:29.586612 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:29.586595    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
May 28 09:32:29.586917 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:29.586780    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
May 28 09:32:29.586917 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:29.586809    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
May 28 09:32:29.586917 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:29.586918    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
May 28 09:32:29.587417 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:29.587400    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-hgpqj\""
May 28 09:32:29.595915 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:29.595891    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c544f5446-2b9dd"]
May 28 09:32:29.643519 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:29.643485    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-9t2vp"]
May 28 09:32:29.647255 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:32:29.647227    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a92c2b2_ec77_4eef_8b00_c938f0ab4e88.slice/crio-abc46c685a776d80f69fe9334453675c1f9614b0324911583a924f9118d52dd1 WatchSource:0}: Error finding container abc46c685a776d80f69fe9334453675c1f9614b0324911583a924f9118d52dd1: Status 404 returned error can't find the container with id abc46c685a776d80f69fe9334453675c1f9614b0324911583a924f9118d52dd1
May 28 09:32:29.678651 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:29.678610    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c268d352-6650-4d76-8b97-86b050f3c6d4-console-oauth-config\") pod \"console-6c544f5446-2b9dd\" (UID: \"c268d352-6650-4d76-8b97-86b050f3c6d4\") " pod="openshift-console/console-6c544f5446-2b9dd"
May 28 09:32:29.678835 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:29.678672    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c268d352-6650-4d76-8b97-86b050f3c6d4-service-ca\") pod \"console-6c544f5446-2b9dd\" (UID: \"c268d352-6650-4d76-8b97-86b050f3c6d4\") " pod="openshift-console/console-6c544f5446-2b9dd"
May 28 09:32:29.678835 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:29.678733    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c268d352-6650-4d76-8b97-86b050f3c6d4-console-config\") pod \"console-6c544f5446-2b9dd\" (UID: \"c268d352-6650-4d76-8b97-86b050f3c6d4\") " pod="openshift-console/console-6c544f5446-2b9dd"
May 28 09:32:29.678835 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:29.678790    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c268d352-6650-4d76-8b97-86b050f3c6d4-console-serving-cert\") pod \"console-6c544f5446-2b9dd\" (UID: \"c268d352-6650-4d76-8b97-86b050f3c6d4\") " pod="openshift-console/console-6c544f5446-2b9dd"
May 28 09:32:29.678835 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:29.678830    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c268d352-6650-4d76-8b97-86b050f3c6d4-oauth-serving-cert\") pod \"console-6c544f5446-2b9dd\" (UID: \"c268d352-6650-4d76-8b97-86b050f3c6d4\") " pod="openshift-console/console-6c544f5446-2b9dd"
May 28 09:32:29.679039 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:29.678884    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2p4k\" (UniqueName: \"kubernetes.io/projected/c268d352-6650-4d76-8b97-86b050f3c6d4-kube-api-access-j2p4k\") pod \"console-6c544f5446-2b9dd\" (UID: \"c268d352-6650-4d76-8b97-86b050f3c6d4\") " pod="openshift-console/console-6c544f5446-2b9dd"
May 28 09:32:29.780117 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:29.780077    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c268d352-6650-4d76-8b97-86b050f3c6d4-console-serving-cert\") pod \"console-6c544f5446-2b9dd\" (UID: \"c268d352-6650-4d76-8b97-86b050f3c6d4\") " pod="openshift-console/console-6c544f5446-2b9dd"
May 28 09:32:29.780368 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:29.780136    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c268d352-6650-4d76-8b97-86b050f3c6d4-oauth-serving-cert\") pod \"console-6c544f5446-2b9dd\" (UID: \"c268d352-6650-4d76-8b97-86b050f3c6d4\") " pod="openshift-console/console-6c544f5446-2b9dd"
May 28 09:32:29.780368 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:29.780170    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j2p4k\" (UniqueName: \"kubernetes.io/projected/c268d352-6650-4d76-8b97-86b050f3c6d4-kube-api-access-j2p4k\") pod \"console-6c544f5446-2b9dd\" (UID: \"c268d352-6650-4d76-8b97-86b050f3c6d4\") " pod="openshift-console/console-6c544f5446-2b9dd"
May 28 09:32:29.780368 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:29.780206    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c268d352-6650-4d76-8b97-86b050f3c6d4-console-oauth-config\") pod \"console-6c544f5446-2b9dd\" (UID: \"c268d352-6650-4d76-8b97-86b050f3c6d4\") " pod="openshift-console/console-6c544f5446-2b9dd"
May 28 09:32:29.780368 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:29.780246    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c268d352-6650-4d76-8b97-86b050f3c6d4-service-ca\") pod \"console-6c544f5446-2b9dd\" (UID: \"c268d352-6650-4d76-8b97-86b050f3c6d4\") " pod="openshift-console/console-6c544f5446-2b9dd"
May 28 09:32:29.780368 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:29.780272    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c268d352-6650-4d76-8b97-86b050f3c6d4-console-config\") pod \"console-6c544f5446-2b9dd\" (UID: \"c268d352-6650-4d76-8b97-86b050f3c6d4\") " pod="openshift-console/console-6c544f5446-2b9dd"
May 28 09:32:29.781223 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:29.781195    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c268d352-6650-4d76-8b97-86b050f3c6d4-console-config\") pod \"console-6c544f5446-2b9dd\" (UID: \"c268d352-6650-4d76-8b97-86b050f3c6d4\") " pod="openshift-console/console-6c544f5446-2b9dd"
May 28 09:32:29.781223 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:29.781212    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c268d352-6650-4d76-8b97-86b050f3c6d4-oauth-serving-cert\") pod \"console-6c544f5446-2b9dd\" (UID: \"c268d352-6650-4d76-8b97-86b050f3c6d4\") " pod="openshift-console/console-6c544f5446-2b9dd"
May 28 09:32:29.781462 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:29.781267    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c268d352-6650-4d76-8b97-86b050f3c6d4-service-ca\") pod \"console-6c544f5446-2b9dd\" (UID: \"c268d352-6650-4d76-8b97-86b050f3c6d4\") " pod="openshift-console/console-6c544f5446-2b9dd"
May 28 09:32:29.782884 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:29.782858    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c268d352-6650-4d76-8b97-86b050f3c6d4-console-serving-cert\") pod \"console-6c544f5446-2b9dd\" (UID: \"c268d352-6650-4d76-8b97-86b050f3c6d4\") " pod="openshift-console/console-6c544f5446-2b9dd"
May 28 09:32:29.782991 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:29.782954    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c268d352-6650-4d76-8b97-86b050f3c6d4-console-oauth-config\") pod \"console-6c544f5446-2b9dd\" (UID: \"c268d352-6650-4d76-8b97-86b050f3c6d4\") " pod="openshift-console/console-6c544f5446-2b9dd"
May 28 09:32:29.790476 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:29.790444    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2p4k\" (UniqueName: \"kubernetes.io/projected/c268d352-6650-4d76-8b97-86b050f3c6d4-kube-api-access-j2p4k\") pod \"console-6c544f5446-2b9dd\" (UID: \"c268d352-6650-4d76-8b97-86b050f3c6d4\") " pod="openshift-console/console-6c544f5446-2b9dd"
May 28 09:32:29.894432 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:29.894391    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c544f5446-2b9dd"
May 28 09:32:30.041771 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:30.041738    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c544f5446-2b9dd"]
May 28 09:32:30.044488 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:32:30.044453    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc268d352_6650_4d76_8b97_86b050f3c6d4.slice/crio-c663a35e5875234b56cf12ed605f1ea9cf7b6f900d3b33ceaf34513ae29a1709 WatchSource:0}: Error finding container c663a35e5875234b56cf12ed605f1ea9cf7b6f900d3b33ceaf34513ae29a1709: Status 404 returned error can't find the container with id c663a35e5875234b56cf12ed605f1ea9cf7b6f900d3b33ceaf34513ae29a1709
May 28 09:32:30.254042 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:30.254001    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c544f5446-2b9dd" event={"ID":"c268d352-6650-4d76-8b97-86b050f3c6d4","Type":"ContainerStarted","Data":"c663a35e5875234b56cf12ed605f1ea9cf7b6f900d3b33ceaf34513ae29a1709"}
May 28 09:32:30.255210 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:30.255175    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-9t2vp" event={"ID":"2a92c2b2-ec77-4eef-8b00-c938f0ab4e88","Type":"ContainerStarted","Data":"abc46c685a776d80f69fe9334453675c1f9614b0324911583a924f9118d52dd1"}
May 28 09:32:31.259103 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:31.259050    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-9t2vp" event={"ID":"2a92c2b2-ec77-4eef-8b00-c938f0ab4e88","Type":"ContainerStarted","Data":"fae67199a44882ec1b2f6152c097e48bda0a62301ea9424f986232e99597e837"}
May 28 09:32:31.259539 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:31.259307    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-9t2vp"
May 28 09:32:31.264811 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:31.264782    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-9t2vp"
May 28 09:32:31.277561 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:31.277516    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-9t2vp" podStartSLOduration=1.820993655 podStartE2EDuration="3.277502333s" podCreationTimestamp="2026-05-28 09:32:28 +0000 UTC" firstStartedPulling="2026-05-28 09:32:29.649637971 +0000 UTC m=+78.332558735" lastFinishedPulling="2026-05-28 09:32:31.106146652 +0000 UTC m=+79.789067413" observedRunningTime="2026-05-28 09:32:31.276088276 +0000 UTC m=+79.959009061" watchObservedRunningTime="2026-05-28 09:32:31.277502333 +0000 UTC m=+79.960423110"
May 28 09:32:31.635869 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:31.635830    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-mk4lh"]
May 28 09:32:31.638370 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:31.638344    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-mk4lh"
May 28 09:32:31.641265 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:31.641233    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
May 28 09:32:31.641396 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:31.641304    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 28 09:32:31.642241 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:31.642220    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-vrlbb\""
May 28 09:32:31.642353 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:31.642254    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 28 09:32:31.642429 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:31.642394    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 28 09:32:31.642429 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:31.642400    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
May 28 09:32:31.648952 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:31.648923    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-mk4lh"]
May 28 09:32:31.697398 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:31.697362    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/99d249e3-84b4-416b-a44f-ab8e9fae4199-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-mk4lh\" (UID: \"99d249e3-84b4-416b-a44f-ab8e9fae4199\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-mk4lh"
May 28 09:32:31.697398 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:31.697407    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/99d249e3-84b4-416b-a44f-ab8e9fae4199-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-mk4lh\" (UID: \"99d249e3-84b4-416b-a44f-ab8e9fae4199\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-mk4lh"
May 28 09:32:31.697654 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:31.697452    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ngfh\" (UniqueName: \"kubernetes.io/projected/99d249e3-84b4-416b-a44f-ab8e9fae4199-kube-api-access-7ngfh\") pod \"prometheus-operator-7779bbdd78-mk4lh\" (UID: \"99d249e3-84b4-416b-a44f-ab8e9fae4199\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-mk4lh"
May 28 09:32:31.697654 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:31.697490    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/99d249e3-84b4-416b-a44f-ab8e9fae4199-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-mk4lh\" (UID: \"99d249e3-84b4-416b-a44f-ab8e9fae4199\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-mk4lh"
May 28 09:32:31.798854 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:31.798819    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/99d249e3-84b4-416b-a44f-ab8e9fae4199-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-mk4lh\" (UID: \"99d249e3-84b4-416b-a44f-ab8e9fae4199\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-mk4lh"
May 28 09:32:31.799057 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:31.798902    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/99d249e3-84b4-416b-a44f-ab8e9fae4199-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-mk4lh\" (UID: \"99d249e3-84b4-416b-a44f-ab8e9fae4199\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-mk4lh"
May 28 09:32:31.799057 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:31.798937    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/99d249e3-84b4-416b-a44f-ab8e9fae4199-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-mk4lh\" (UID: \"99d249e3-84b4-416b-a44f-ab8e9fae4199\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-mk4lh"
May 28 09:32:31.799057 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:31.798991    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7ngfh\" (UniqueName: \"kubernetes.io/projected/99d249e3-84b4-416b-a44f-ab8e9fae4199-kube-api-access-7ngfh\") pod \"prometheus-operator-7779bbdd78-mk4lh\" (UID: \"99d249e3-84b4-416b-a44f-ab8e9fae4199\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-mk4lh"
May 28 09:32:31.800118 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:31.800088    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/99d249e3-84b4-416b-a44f-ab8e9fae4199-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-mk4lh\" (UID: \"99d249e3-84b4-416b-a44f-ab8e9fae4199\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-mk4lh"
May 28 09:32:31.802030 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:31.802001    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/99d249e3-84b4-416b-a44f-ab8e9fae4199-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-mk4lh\" (UID: \"99d249e3-84b4-416b-a44f-ab8e9fae4199\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-mk4lh"
May 28 09:32:31.802157 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:31.802131    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/99d249e3-84b4-416b-a44f-ab8e9fae4199-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-mk4lh\" (UID: \"99d249e3-84b4-416b-a44f-ab8e9fae4199\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-mk4lh"
May 28 09:32:31.813061 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:31.813027    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ngfh\" (UniqueName: \"kubernetes.io/projected/99d249e3-84b4-416b-a44f-ab8e9fae4199-kube-api-access-7ngfh\") pod \"prometheus-operator-7779bbdd78-mk4lh\" (UID: \"99d249e3-84b4-416b-a44f-ab8e9fae4199\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-mk4lh"
May 28 09:32:31.950858 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:31.950780    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-mk4lh"
May 28 09:32:32.105564 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:32.105531    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-mk4lh"]
May 28 09:32:32.109890 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:32:32.109855    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99d249e3_84b4_416b_a44f_ab8e9fae4199.slice/crio-40f0e8e754904977bb472360c8f1741a8734b8f6ba13e422d7925e26c2b7cba0 WatchSource:0}: Error finding container 40f0e8e754904977bb472360c8f1741a8734b8f6ba13e422d7925e26c2b7cba0: Status 404 returned error can't find the container with id 40f0e8e754904977bb472360c8f1741a8734b8f6ba13e422d7925e26c2b7cba0
May 28 09:32:32.262840 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:32.262788    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-mk4lh" event={"ID":"99d249e3-84b4-416b-a44f-ab8e9fae4199","Type":"ContainerStarted","Data":"40f0e8e754904977bb472360c8f1741a8734b8f6ba13e422d7925e26c2b7cba0"}
May 28 09:32:34.270901 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:34.270850    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c544f5446-2b9dd" event={"ID":"c268d352-6650-4d76-8b97-86b050f3c6d4","Type":"ContainerStarted","Data":"cd072debf0977c70e176ed903d3a029da1f4cd903148d8abb5024c8be755fc9c"}
May 28 09:32:34.294709 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:34.294637    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6c544f5446-2b9dd" podStartSLOduration=1.849146539 podStartE2EDuration="5.294617999s" podCreationTimestamp="2026-05-28 09:32:29 +0000 UTC" firstStartedPulling="2026-05-28 09:32:30.046650035 +0000 UTC m=+78.729570796" lastFinishedPulling="2026-05-28 09:32:33.492121496 +0000 UTC m=+82.175042256" observedRunningTime="2026-05-28 09:32:34.293001114 +0000 UTC m=+82.975921897" watchObservedRunningTime="2026-05-28 09:32:34.294617999 +0000 UTC m=+82.977538785"
May 28 09:32:35.275065 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:35.275030    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-mk4lh" event={"ID":"99d249e3-84b4-416b-a44f-ab8e9fae4199","Type":"ContainerStarted","Data":"7dd91f19f8c2432c6066001bf66d1c9bf655243542fb4746560f74804c69dd8e"}
May 28 09:32:35.275065 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:35.275068    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-mk4lh" event={"ID":"99d249e3-84b4-416b-a44f-ab8e9fae4199","Type":"ContainerStarted","Data":"f0fc9c44d04f12823fa3b83b2df7409e061f7c82e4552623ae99c387f3282cf2"}
May 28 09:32:35.301877 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:35.301819    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-mk4lh" podStartSLOduration=1.836556906 podStartE2EDuration="4.301801905s" podCreationTimestamp="2026-05-28 09:32:31 +0000 UTC" firstStartedPulling="2026-05-28 09:32:32.112491602 +0000 UTC m=+80.795412364" lastFinishedPulling="2026-05-28 09:32:34.577736601 +0000 UTC m=+83.260657363" observedRunningTime="2026-05-28 09:32:35.301139796 +0000 UTC m=+83.984060579" watchObservedRunningTime="2026-05-28 09:32:35.301801905 +0000 UTC m=+83.984722690"
May 28 09:32:37.010494 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:37.010451    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-gvkjg"]
May 28 09:32:37.013607 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:37.013582    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-gvkjg"
May 28 09:32:37.016483 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:37.016449    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
May 28 09:32:37.016837 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:37.016818    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-fbvk5\""
May 28 09:32:37.018072 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:37.018050    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
May 28 09:32:37.025627 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:37.025601    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-gvkjg"]
May 28 09:32:37.059015 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:37.058962    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-2z4sq"]
May 28 09:32:37.061428 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:37.061403    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2z4sq"
May 28 09:32:37.064017 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:37.063987    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 28 09:32:37.064173 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:37.064041    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 28 09:32:37.064896 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:37.064873    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 28 09:32:37.065040 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:37.064879    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vwjck\""
May 28 09:32:37.140032 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:37.139992    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6a192bb8-4720-4626-be36-92d00e71bc94-node-exporter-accelerators-collector-config\") pod \"node-exporter-2z4sq\" (UID: \"6a192bb8-4720-4626-be36-92d00e71bc94\") " pod="openshift-monitoring/node-exporter-2z4sq"
May 28 09:32:37.140032 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:37.140034    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc370a6b-afcb-48f5-8234-d90d8b5c2ef2-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-gvkjg\" (UID: \"fc370a6b-afcb-48f5-8234-d90d8b5c2ef2\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-gvkjg"
May 28 09:32:37.140272 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:37.140067    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6a192bb8-4720-4626-be36-92d00e71bc94-node-exporter-textfile\") pod \"node-exporter-2z4sq\" (UID: \"6a192bb8-4720-4626-be36-92d00e71bc94\") " pod="openshift-monitoring/node-exporter-2z4sq"
May 28 09:32:37.140272 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:37.140187    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fc370a6b-afcb-48f5-8234-d90d8b5c2ef2-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-gvkjg\" (UID: \"fc370a6b-afcb-48f5-8234-d90d8b5c2ef2\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-gvkjg"
May 28 09:32:37.140272 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:37.140251    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a192bb8-4720-4626-be36-92d00e71bc94-sys\") pod \"node-exporter-2z4sq\" (UID: \"6a192bb8-4720-4626-be36-92d00e71bc94\") " pod="openshift-monitoring/node-exporter-2z4sq"
May 28 09:32:37.140425 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:37.140306    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lx9lk\" (UniqueName: \"kubernetes.io/projected/6a192bb8-4720-4626-be36-92d00e71bc94-kube-api-access-lx9lk\") pod \"node-exporter-2z4sq\" (UID: \"6a192bb8-4720-4626-be36-92d00e71bc94\") " pod="openshift-monitoring/node-exporter-2z4sq"
May 28 09:32:37.140425 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:37.140343    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a192bb8-4720-4626-be36-92d00e71bc94-metrics-client-ca\") pod \"node-exporter-2z4sq\" (UID: \"6a192bb8-4720-4626-be36-92d00e71bc94\") " pod="openshift-monitoring/node-exporter-2z4sq"
May 28 09:32:37.140425 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:37.140374    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6a192bb8-4720-4626-be36-92d00e71bc94-node-exporter-wtmp\") pod \"node-exporter-2z4sq\" (UID: \"6a192bb8-4720-4626-be36-92d00e71bc94\") " pod="openshift-monitoring/node-exporter-2z4sq"
May 28 09:32:37.140425 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:37.140415    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6a192bb8-4720-4626-be36-92d00e71bc94-node-exporter-tls\") pod \"node-exporter-2z4sq\" (UID: \"6a192bb8-4720-4626-be36-92d00e71bc94\") " pod="openshift-monitoring/node-exporter-2z4sq"
May 28 09:32:37.140565 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:37.140446    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc370a6b-afcb-48f5-8234-d90d8b5c2ef2-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-gvkjg\" (UID: \"fc370a6b-afcb-48f5-8234-d90d8b5c2ef2\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-gvkjg"
May 28 09:32:37.140565 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:37.140476    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6a192bb8-4720-4626-be36-92d00e71bc94-root\") pod \"node-exporter-2z4sq\" (UID: \"6a192bb8-4720-4626-be36-92d00e71bc94\") " pod="openshift-monitoring/node-exporter-2z4sq"
May 28 09:32:37.140565 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:37.140504    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6a192bb8-4720-4626-be36-92d00e71bc94-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2z4sq\" (UID: \"6a192bb8-4720-4626-be36-92d00e71bc94\") " pod="openshift-monitoring/node-exporter-2z4sq"
May 28 09:32:37.140673 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:37.140574    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwjtc\" (UniqueName: \"kubernetes.io/projected/fc370a6b-afcb-48f5-8234-d90d8b5c2ef2-kube-api-access-qwjtc\") pod \"openshift-state-metrics-9c959559f-gvkjg\" (UID: \"fc370a6b-afcb-48f5-8234-d90d8b5c2ef2\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-gvkjg"
May 28 09:32:37.241565 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:37.241526    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fc370a6b-afcb-48f5-8234-d90d8b5c2ef2-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-gvkjg\" (UID: \"fc370a6b-afcb-48f5-8234-d90d8b5c2ef2\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-gvkjg"
May 28 09:32:37.241748 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:37.241575    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a192bb8-4720-4626-be36-92d00e71bc94-sys\") pod \"node-exporter-2z4sq\" (UID: \"6a192bb8-4720-4626-be36-92d00e71bc94\") " pod="openshift-monitoring/node-exporter-2z4sq"
May 28 09:32:37.241748 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:37.241607    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lx9lk\" (UniqueName: \"kubernetes.io/projected/6a192bb8-4720-4626-be36-92d00e71bc94-kube-api-access-lx9lk\") pod \"node-exporter-2z4sq\" (UID: \"6a192bb8-4720-4626-be36-92d00e71bc94\") " pod="openshift-monitoring/node-exporter-2z4sq"
May 28 09:32:37.241748 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:37.241638    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a192bb8-4720-4626-be36-92d00e71bc94-metrics-client-ca\") pod \"node-exporter-2z4sq\" (UID: \"6a192bb8-4720-4626-be36-92d00e71bc94\") " pod="openshift-monitoring/node-exporter-2z4sq"
May 28 09:32:37.241748 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:37.241672    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6a192bb8-4720-4626-be36-92d00e71bc94-node-exporter-wtmp\") pod \"node-exporter-2z4sq\" (UID: \"6a192bb8-4720-4626-be36-92d00e71bc94\") " pod="openshift-monitoring/node-exporter-2z4sq"
May 28 09:32:37.241748 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:37.241702    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6a192bb8-4720-4626-be36-92d00e71bc94-node-exporter-tls\") pod \"node-exporter-2z4sq\" (UID: \"6a192bb8-4720-4626-be36-92d00e71bc94\") " pod="openshift-monitoring/node-exporter-2z4sq"
May 28 09:32:37.241748 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:37.241709    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a192bb8-4720-4626-be36-92d00e71bc94-sys\") pod \"node-exporter-2z4sq\" (UID: \"6a192bb8-4720-4626-be36-92d00e71bc94\") " pod="openshift-monitoring/node-exporter-2z4sq"
May 28 09:32:37.241748 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:37.241732    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc370a6b-afcb-48f5-8234-d90d8b5c2ef2-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-gvkjg\" (UID: \"fc370a6b-afcb-48f5-8234-d90d8b5c2ef2\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-gvkjg"
May 28 09:32:37.242139 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:37.241784    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6a192bb8-4720-4626-be36-92d00e71bc94-root\") pod \"node-exporter-2z4sq\" (UID: \"6a192bb8-4720-4626-be36-92d00e71bc94\") " pod="openshift-monitoring/node-exporter-2z4sq"
May 28 09:32:37.242139 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:37.241820    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6a192bb8-4720-4626-be36-92d00e71bc94-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2z4sq\" (UID: \"6a192bb8-4720-4626-be36-92d00e71bc94\") " pod="openshift-monitoring/node-exporter-2z4sq"
May 28 09:32:37.242139 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:37.241826    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6a192bb8-4720-4626-be36-92d00e71bc94-node-exporter-wtmp\") pod \"node-exporter-2z4sq\" (UID: \"6a192bb8-4720-4626-be36-92d00e71bc94\") " pod="openshift-monitoring/node-exporter-2z4sq"
May 28 09:32:37.242139 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:37.241884    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qwjtc\" (UniqueName: \"kubernetes.io/projected/fc370a6b-afcb-48f5-8234-d90d8b5c2ef2-kube-api-access-qwjtc\") pod \"openshift-state-metrics-9c959559f-gvkjg\" (UID: \"fc370a6b-afcb-48f5-8234-d90d8b5c2ef2\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-gvkjg"
May 28 09:32:37.242139 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:37.241930    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6a192bb8-4720-4626-be36-92d00e71bc94-node-exporter-accelerators-collector-config\") pod \"node-exporter-2z4sq\" (UID: \"6a192bb8-4720-4626-be36-92d00e71bc94\") " pod="openshift-monitoring/node-exporter-2z4sq"
May 28 09:32:37.242139 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:37.241962    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc370a6b-afcb-48f5-8234-d90d8b5c2ef2-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-gvkjg\" (UID: \"fc370a6b-afcb-48f5-8234-d90d8b5c2ef2\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-gvkjg"
May 28 09:32:37.242139 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:37.242009    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6a192bb8-4720-4626-be36-92d00e71bc94-node-exporter-textfile\") pod \"node-exporter-2z4sq\" (UID: \"6a192bb8-4720-4626-be36-92d00e71bc94\") " pod="openshift-monitoring/node-exporter-2z4sq"
May 28 09:32:37.242139 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:37.242062    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6a192bb8-4720-4626-be36-92d00e71bc94-root\") pod \"node-exporter-2z4sq\" (UID: \"6a192bb8-4720-4626-be36-92d00e71bc94\") " pod="openshift-monitoring/node-exporter-2z4sq"
May 28 09:32:37.242524 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:37.242325    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6a192bb8-4720-4626-be36-92d00e71bc94-node-exporter-textfile\") pod \"node-exporter-2z4sq\" (UID: \"6a192bb8-4720-4626-be36-92d00e71bc94\") " pod="openshift-monitoring/node-exporter-2z4sq"
May 28 09:32:37.242524 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:37.242332    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a192bb8-4720-4626-be36-92d00e71bc94-metrics-client-ca\") pod \"node-exporter-2z4sq\" (UID: \"6a192bb8-4720-4626-be36-92d00e71bc94\") " pod="openshift-monitoring/node-exporter-2z4sq"
May 28 09:32:37.242524 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:37.242477    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc370a6b-afcb-48f5-8234-d90d8b5c2ef2-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-gvkjg\" (UID: \"fc370a6b-afcb-48f5-8234-d90d8b5c2ef2\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-gvkjg"
May 28 09:32:37.242670 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:37.242643    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6a192bb8-4720-4626-be36-92d00e71bc94-node-exporter-accelerators-collector-config\") pod \"node-exporter-2z4sq\" (UID: \"6a192bb8-4720-4626-be36-92d00e71bc94\") " pod="openshift-monitoring/node-exporter-2z4sq"
May 28 09:32:37.244562 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:37.244498    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fc370a6b-afcb-48f5-8234-d90d8b5c2ef2-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-gvkjg\" (UID: \"fc370a6b-afcb-48f5-8234-d90d8b5c2ef2\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-gvkjg"
May 28 09:32:37.244683 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:37.244656    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6a192bb8-4720-4626-be36-92d00e71bc94-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2z4sq\" (UID: \"6a192bb8-4720-4626-be36-92d00e71bc94\") " pod="openshift-monitoring/node-exporter-2z4sq"
May 28 09:32:37.244866 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:37.244844    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6a192bb8-4720-4626-be36-92d00e71bc94-node-exporter-tls\") pod \"node-exporter-2z4sq\" (UID: \"6a192bb8-4720-4626-be36-92d00e71bc94\") " pod="openshift-monitoring/node-exporter-2z4sq"
May 28 09:32:37.244962 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:37.244885    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc370a6b-afcb-48f5-8234-d90d8b5c2ef2-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-gvkjg\" (UID: \"fc370a6b-afcb-48f5-8234-d90d8b5c2ef2\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-gvkjg"
May 28 09:32:37.261400 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:37.261327    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lx9lk\" (UniqueName: \"kubernetes.io/projected/6a192bb8-4720-4626-be36-92d00e71bc94-kube-api-access-lx9lk\") pod \"node-exporter-2z4sq\" (UID: \"6a192bb8-4720-4626-be36-92d00e71bc94\") " pod="openshift-monitoring/node-exporter-2z4sq"
May 28 09:32:37.261527 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:37.261436    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwjtc\" (UniqueName: \"kubernetes.io/projected/fc370a6b-afcb-48f5-8234-d90d8b5c2ef2-kube-api-access-qwjtc\") pod \"openshift-state-metrics-9c959559f-gvkjg\" (UID: \"fc370a6b-afcb-48f5-8234-d90d8b5c2ef2\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-gvkjg"
May 28 09:32:37.324697 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:37.324658    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-gvkjg"
May 28 09:32:37.372728 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:37.372692    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2z4sq"
May 28 09:32:39.008317 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:39.008284    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-84f75585c8-t2rb4"]
May 28 09:32:39.012239 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:39.012214    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-84f75585c8-t2rb4"
May 28 09:32:39.015394 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:39.015326    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-c2ml5\""
May 28 09:32:39.015394 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:39.015344    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-9uubdjvvf0rk3\""
May 28 09:32:39.015575 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:39.015467    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
May 28 09:32:39.015575 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:39.015489    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
May 28 09:32:39.015682 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:39.015594    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
May 28 09:32:39.016182 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:39.016165    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
May 28 09:32:39.016272 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:39.016189    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
May 28 09:32:39.021432 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:39.021408    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-84f75585c8-t2rb4"]
May 28 09:32:39.056564 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:39.056521    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gldjs\" (UniqueName: \"kubernetes.io/projected/74d7e2b7-f87f-45ee-b7b4-3ad8bf9c2c09-kube-api-access-gldjs\") pod \"thanos-querier-84f75585c8-t2rb4\" (UID: \"74d7e2b7-f87f-45ee-b7b4-3ad8bf9c2c09\") " pod="openshift-monitoring/thanos-querier-84f75585c8-t2rb4"
May 28 09:32:39.056721 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:39.056576    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/74d7e2b7-f87f-45ee-b7b4-3ad8bf9c2c09-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-84f75585c8-t2rb4\" (UID: \"74d7e2b7-f87f-45ee-b7b4-3ad8bf9c2c09\") " pod="openshift-monitoring/thanos-querier-84f75585c8-t2rb4"
May 28 09:32:39.056721 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:39.056610    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/74d7e2b7-f87f-45ee-b7b4-3ad8bf9c2c09-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-84f75585c8-t2rb4\" (UID: \"74d7e2b7-f87f-45ee-b7b4-3ad8bf9c2c09\") " pod="openshift-monitoring/thanos-querier-84f75585c8-t2rb4"
May 28 09:32:39.056721 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:39.056635    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/74d7e2b7-f87f-45ee-b7b4-3ad8bf9c2c09-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-84f75585c8-t2rb4\" (UID: \"74d7e2b7-f87f-45ee-b7b4-3ad8bf9c2c09\") " pod="openshift-monitoring/thanos-querier-84f75585c8-t2rb4"
May 28 09:32:39.056898 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:39.056731    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/74d7e2b7-f87f-45ee-b7b4-3ad8bf9c2c09-secret-thanos-querier-tls\") pod \"thanos-querier-84f75585c8-t2rb4\" (UID: \"74d7e2b7-f87f-45ee-b7b4-3ad8bf9c2c09\") " pod="openshift-monitoring/thanos-querier-84f75585c8-t2rb4"
May 28 09:32:39.056898 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:39.056789    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/74d7e2b7-f87f-45ee-b7b4-3ad8bf9c2c09-secret-grpc-tls\") pod \"thanos-querier-84f75585c8-t2rb4\" (UID: \"74d7e2b7-f87f-45ee-b7b4-3ad8bf9c2c09\") " pod="openshift-monitoring/thanos-querier-84f75585c8-t2rb4"
May 28 09:32:39.056898 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:39.056865    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74d7e2b7-f87f-45ee-b7b4-3ad8bf9c2c09-metrics-client-ca\") pod \"thanos-querier-84f75585c8-t2rb4\" (UID: \"74d7e2b7-f87f-45ee-b7b4-3ad8bf9c2c09\") " pod="openshift-monitoring/thanos-querier-84f75585c8-t2rb4"
May 28 09:32:39.057080 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:39.056897    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/74d7e2b7-f87f-45ee-b7b4-3ad8bf9c2c09-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-84f75585c8-t2rb4\" (UID: \"74d7e2b7-f87f-45ee-b7b4-3ad8bf9c2c09\") " pod="openshift-monitoring/thanos-querier-84f75585c8-t2rb4"
May 28 09:32:39.157942 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:39.157905    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74d7e2b7-f87f-45ee-b7b4-3ad8bf9c2c09-metrics-client-ca\") pod \"thanos-querier-84f75585c8-t2rb4\" (UID: \"74d7e2b7-f87f-45ee-b7b4-3ad8bf9c2c09\") " pod="openshift-monitoring/thanos-querier-84f75585c8-t2rb4"
May 28 09:32:39.158126 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:39.157961    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/74d7e2b7-f87f-45ee-b7b4-3ad8bf9c2c09-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-84f75585c8-t2rb4\" (UID: \"74d7e2b7-f87f-45ee-b7b4-3ad8bf9c2c09\") " pod="openshift-monitoring/thanos-querier-84f75585c8-t2rb4"
May 28 09:32:39.158126 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:39.158009    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gldjs\" (UniqueName: \"kubernetes.io/projected/74d7e2b7-f87f-45ee-b7b4-3ad8bf9c2c09-kube-api-access-gldjs\") pod \"thanos-querier-84f75585c8-t2rb4\" (UID: \"74d7e2b7-f87f-45ee-b7b4-3ad8bf9c2c09\") " pod="openshift-monitoring/thanos-querier-84f75585c8-t2rb4"
May 28 09:32:39.158126 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:39.158047    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/74d7e2b7-f87f-45ee-b7b4-3ad8bf9c2c09-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-84f75585c8-t2rb4\" (UID: \"74d7e2b7-f87f-45ee-b7b4-3ad8bf9c2c09\") " pod="openshift-monitoring/thanos-querier-84f75585c8-t2rb4"
May 28 09:32:39.158126 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:39.158075    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/74d7e2b7-f87f-45ee-b7b4-3ad8bf9c2c09-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-84f75585c8-t2rb4\" (UID: \"74d7e2b7-f87f-45ee-b7b4-3ad8bf9c2c09\") " pod="openshift-monitoring/thanos-querier-84f75585c8-t2rb4"
May 28 09:32:39.158385 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:39.158354    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/74d7e2b7-f87f-45ee-b7b4-3ad8bf9c2c09-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-84f75585c8-t2rb4\" (UID: \"74d7e2b7-f87f-45ee-b7b4-3ad8bf9c2c09\") " pod="openshift-monitoring/thanos-querier-84f75585c8-t2rb4"
May 28 09:32:39.158521 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:39.158411    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/74d7e2b7-f87f-45ee-b7b4-3ad8bf9c2c09-secret-thanos-querier-tls\") pod \"thanos-querier-84f75585c8-t2rb4\" (UID: \"74d7e2b7-f87f-45ee-b7b4-3ad8bf9c2c09\") " pod="openshift-monitoring/thanos-querier-84f75585c8-t2rb4"
May 28 09:32:39.158521 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:39.158442    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/74d7e2b7-f87f-45ee-b7b4-3ad8bf9c2c09-secret-grpc-tls\") pod \"thanos-querier-84f75585c8-t2rb4\" (UID: \"74d7e2b7-f87f-45ee-b7b4-3ad8bf9c2c09\") " pod="openshift-monitoring/thanos-querier-84f75585c8-t2rb4"
May 28 09:32:39.158729 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:39.158682    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74d7e2b7-f87f-45ee-b7b4-3ad8bf9c2c09-metrics-client-ca\") pod \"thanos-querier-84f75585c8-t2rb4\" (UID: \"74d7e2b7-f87f-45ee-b7b4-3ad8bf9c2c09\") " pod="openshift-monitoring/thanos-querier-84f75585c8-t2rb4"
May 28 09:32:39.161235 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:39.161164    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/74d7e2b7-f87f-45ee-b7b4-3ad8bf9c2c09-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-84f75585c8-t2rb4\" (UID: \"74d7e2b7-f87f-45ee-b7b4-3ad8bf9c2c09\") " pod="openshift-monitoring/thanos-querier-84f75585c8-t2rb4"
May 28 09:32:39.161235 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:39.161185    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/74d7e2b7-f87f-45ee-b7b4-3ad8bf9c2c09-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-84f75585c8-t2rb4\" (UID: \"74d7e2b7-f87f-45ee-b7b4-3ad8bf9c2c09\") " pod="openshift-monitoring/thanos-querier-84f75585c8-t2rb4"
May 28 09:32:39.161480 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:39.161459    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/74d7e2b7-f87f-45ee-b7b4-3ad8bf9c2c09-secret-grpc-tls\") pod \"thanos-querier-84f75585c8-t2rb4\" (UID: \"74d7e2b7-f87f-45ee-b7b4-3ad8bf9c2c09\") " pod="openshift-monitoring/thanos-querier-84f75585c8-t2rb4"
May 28 09:32:39.161887 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:39.161870    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/74d7e2b7-f87f-45ee-b7b4-3ad8bf9c2c09-secret-thanos-querier-tls\") pod \"thanos-querier-84f75585c8-t2rb4\" (UID: \"74d7e2b7-f87f-45ee-b7b4-3ad8bf9c2c09\") " pod="openshift-monitoring/thanos-querier-84f75585c8-t2rb4"
May 28 09:32:39.161983 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:39.161951    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/74d7e2b7-f87f-45ee-b7b4-3ad8bf9c2c09-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-84f75585c8-t2rb4\" (UID: \"74d7e2b7-f87f-45ee-b7b4-3ad8bf9c2c09\") " pod="openshift-monitoring/thanos-querier-84f75585c8-t2rb4"
May 28 09:32:39.162049 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:39.162015    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/74d7e2b7-f87f-45ee-b7b4-3ad8bf9c2c09-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-84f75585c8-t2rb4\" (UID: \"74d7e2b7-f87f-45ee-b7b4-3ad8bf9c2c09\") " pod="openshift-monitoring/thanos-querier-84f75585c8-t2rb4"
May 28 09:32:39.175874 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:39.175843    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gldjs\" (UniqueName: \"kubernetes.io/projected/74d7e2b7-f87f-45ee-b7b4-3ad8bf9c2c09-kube-api-access-gldjs\") pod \"thanos-querier-84f75585c8-t2rb4\" (UID: \"74d7e2b7-f87f-45ee-b7b4-3ad8bf9c2c09\") " pod="openshift-monitoring/thanos-querier-84f75585c8-t2rb4"
May 28 09:32:39.323903 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:39.323818    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-84f75585c8-t2rb4"
May 28 09:32:39.895098 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:39.895049    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6c544f5446-2b9dd"
May 28 09:32:39.895098 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:39.895104    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6c544f5446-2b9dd"
May 28 09:32:39.901389 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:39.901352    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6c544f5446-2b9dd"
May 28 09:32:40.295525 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:40.295495    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6c544f5446-2b9dd"
May 28 09:32:41.361809 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:41.361764    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-688b957f56-g6k8j"]
May 28 09:32:41.382170 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:41.382134    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-688b957f56-g6k8j"]
May 28 09:32:41.382327 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:41.382273    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-688b957f56-g6k8j"
May 28 09:32:41.385135 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:41.385098    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
May 28 09:32:41.385270 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:41.385249    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-mbfkh\""
May 28 09:32:41.385340 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:41.385332    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
May 28 09:32:41.386558 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:41.386332    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
May 28 09:32:41.386558 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:41.386390    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
May 28 09:32:41.386558 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:41.386333    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-b5pcnbreklcf4\""
May 28 09:32:41.480488 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:41.480445    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/26826edb-a070-408d-807d-84d411fe6c8c-metrics-server-audit-profiles\") pod \"metrics-server-688b957f56-g6k8j\" (UID: \"26826edb-a070-408d-807d-84d411fe6c8c\") " pod="openshift-monitoring/metrics-server-688b957f56-g6k8j"
May 28 09:32:41.480695 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:41.480511    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9w6z\" (UniqueName: \"kubernetes.io/projected/26826edb-a070-408d-807d-84d411fe6c8c-kube-api-access-l9w6z\") pod \"metrics-server-688b957f56-g6k8j\" (UID: \"26826edb-a070-408d-807d-84d411fe6c8c\") " pod="openshift-monitoring/metrics-server-688b957f56-g6k8j"
May 28 09:32:41.480695 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:41.480588    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/26826edb-a070-408d-807d-84d411fe6c8c-secret-metrics-server-client-certs\") pod \"metrics-server-688b957f56-g6k8j\" (UID: \"26826edb-a070-408d-807d-84d411fe6c8c\") " pod="openshift-monitoring/metrics-server-688b957f56-g6k8j"
May 28 09:32:41.480695 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:41.480627    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/26826edb-a070-408d-807d-84d411fe6c8c-client-ca-bundle\") pod \"metrics-server-688b957f56-g6k8j\" (UID: \"26826edb-a070-408d-807d-84d411fe6c8c\") " pod="openshift-monitoring/metrics-server-688b957f56-g6k8j"
May 28 09:32:41.480695 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:41.480671    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26826edb-a070-408d-807d-84d411fe6c8c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-688b957f56-g6k8j\" (UID: \"26826edb-a070-408d-807d-84d411fe6c8c\") " pod="openshift-monitoring/metrics-server-688b957f56-g6k8j"
May 28 09:32:41.480884 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:41.480738    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/26826edb-a070-408d-807d-84d411fe6c8c-audit-log\") pod \"metrics-server-688b957f56-g6k8j\" (UID: \"26826edb-a070-408d-807d-84d411fe6c8c\") " pod="openshift-monitoring/metrics-server-688b957f56-g6k8j"
May 28 09:32:41.480884 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:41.480797    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/26826edb-a070-408d-807d-84d411fe6c8c-secret-metrics-server-tls\") pod \"metrics-server-688b957f56-g6k8j\" (UID: \"26826edb-a070-408d-807d-84d411fe6c8c\") " pod="openshift-monitoring/metrics-server-688b957f56-g6k8j"
May 28 09:32:41.581811 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:41.581771    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/26826edb-a070-408d-807d-84d411fe6c8c-audit-log\") pod \"metrics-server-688b957f56-g6k8j\" (UID: \"26826edb-a070-408d-807d-84d411fe6c8c\") " pod="openshift-monitoring/metrics-server-688b957f56-g6k8j"
May 28 09:32:41.582004 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:41.581824    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/26826edb-a070-408d-807d-84d411fe6c8c-secret-metrics-server-tls\") pod \"metrics-server-688b957f56-g6k8j\" (UID: \"26826edb-a070-408d-807d-84d411fe6c8c\") " pod="openshift-monitoring/metrics-server-688b957f56-g6k8j"
May 28 09:32:41.582004 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:41.581865    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/26826edb-a070-408d-807d-84d411fe6c8c-metrics-server-audit-profiles\") pod \"metrics-server-688b957f56-g6k8j\" (UID: \"26826edb-a070-408d-807d-84d411fe6c8c\") " pod="openshift-monitoring/metrics-server-688b957f56-g6k8j"
May 28 09:32:41.582004 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:41.581910    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l9w6z\" (UniqueName: \"kubernetes.io/projected/26826edb-a070-408d-807d-84d411fe6c8c-kube-api-access-l9w6z\") pod \"metrics-server-688b957f56-g6k8j\" (UID: \"26826edb-a070-408d-807d-84d411fe6c8c\") " pod="openshift-monitoring/metrics-server-688b957f56-g6k8j"
May 28 09:32:41.582004 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:41.581952    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/26826edb-a070-408d-807d-84d411fe6c8c-secret-metrics-server-client-certs\") pod \"metrics-server-688b957f56-g6k8j\" (UID: \"26826edb-a070-408d-807d-84d411fe6c8c\") " pod="openshift-monitoring/metrics-server-688b957f56-g6k8j"
May 28 09:32:41.582004 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:41.581995    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/26826edb-a070-408d-807d-84d411fe6c8c-client-ca-bundle\") pod \"metrics-server-688b957f56-g6k8j\" (UID: \"26826edb-a070-408d-807d-84d411fe6c8c\") " pod="openshift-monitoring/metrics-server-688b957f56-g6k8j"
May 28 09:32:41.582270 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:41.582034    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26826edb-a070-408d-807d-84d411fe6c8c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-688b957f56-g6k8j\" (UID: \"26826edb-a070-408d-807d-84d411fe6c8c\") " pod="openshift-monitoring/metrics-server-688b957f56-g6k8j"
May 28 09:32:41.582329 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:41.582278    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/26826edb-a070-408d-807d-84d411fe6c8c-audit-log\") pod \"metrics-server-688b957f56-g6k8j\" (UID: \"26826edb-a070-408d-807d-84d411fe6c8c\") " pod="openshift-monitoring/metrics-server-688b957f56-g6k8j"
May 28 09:32:41.582794 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:41.582746    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26826edb-a070-408d-807d-84d411fe6c8c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-688b957f56-g6k8j\" (UID: \"26826edb-a070-408d-807d-84d411fe6c8c\") " pod="openshift-monitoring/metrics-server-688b957f56-g6k8j"
May 28 09:32:41.583049 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:41.583024    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/26826edb-a070-408d-807d-84d411fe6c8c-metrics-server-audit-profiles\") pod \"metrics-server-688b957f56-g6k8j\" (UID: \"26826edb-a070-408d-807d-84d411fe6c8c\") " pod="openshift-monitoring/metrics-server-688b957f56-g6k8j"
May 28 09:32:41.585074 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:41.585050    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/26826edb-a070-408d-807d-84d411fe6c8c-secret-metrics-server-client-certs\") pod \"metrics-server-688b957f56-g6k8j\" (UID: \"26826edb-a070-408d-807d-84d411fe6c8c\") " pod="openshift-monitoring/metrics-server-688b957f56-g6k8j"
May 28 09:32:41.585217 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:41.585185    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/26826edb-a070-408d-807d-84d411fe6c8c-client-ca-bundle\") pod \"metrics-server-688b957f56-g6k8j\" (UID: \"26826edb-a070-408d-807d-84d411fe6c8c\") " pod="openshift-monitoring/metrics-server-688b957f56-g6k8j"
May 28 09:32:41.585282 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:41.585183    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/26826edb-a070-408d-807d-84d411fe6c8c-secret-metrics-server-tls\") pod \"metrics-server-688b957f56-g6k8j\" (UID: \"26826edb-a070-408d-807d-84d411fe6c8c\") " pod="openshift-monitoring/metrics-server-688b957f56-g6k8j"
May 28 09:32:41.591201 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:41.591159    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9w6z\" (UniqueName: \"kubernetes.io/projected/26826edb-a070-408d-807d-84d411fe6c8c-kube-api-access-l9w6z\") pod \"metrics-server-688b957f56-g6k8j\" (UID: \"26826edb-a070-408d-807d-84d411fe6c8c\") " pod="openshift-monitoring/metrics-server-688b957f56-g6k8j"
May 28 09:32:41.694210 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:41.694123    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-688b957f56-g6k8j"
May 28 09:32:41.794457 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:41.794409    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-mh2ml"]
May 28 09:32:41.808955 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:41.808524    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-mh2ml"
May 28 09:32:41.810228 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:41.810176    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-mh2ml"]
May 28 09:32:41.811442 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:41.811411    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
May 28 09:32:41.811567 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:41.811517    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-f26lr\""
May 28 09:32:41.884629 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:41.884577    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e5a1ea7d-a239-4aab-ba0e-63a282f664a8-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-mh2ml\" (UID: \"e5a1ea7d-a239-4aab-ba0e-63a282f664a8\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-mh2ml"
May 28 09:32:41.985742 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:41.985649    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e5a1ea7d-a239-4aab-ba0e-63a282f664a8-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-mh2ml\" (UID: \"e5a1ea7d-a239-4aab-ba0e-63a282f664a8\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-mh2ml"
May 28 09:32:41.988363 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:41.988341    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e5a1ea7d-a239-4aab-ba0e-63a282f664a8-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-mh2ml\" (UID: \"e5a1ea7d-a239-4aab-ba0e-63a282f664a8\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-mh2ml"
May 28 09:32:42.121515 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:42.121481    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-mh2ml"
May 28 09:32:43.305098 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.305056    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 09:32:43.308610 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.308584    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:32:43.312598 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.312134    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
May 28 09:32:43.312598 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.312212    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
May 28 09:32:43.312598 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.312318    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
May 28 09:32:43.312598 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.312211    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
May 28 09:32:43.312598 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.312420    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
May 28 09:32:43.312598 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.312526    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
May 28 09:32:43.312598 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.312553    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
May 28 09:32:43.313559 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.313329    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
May 28 09:32:43.313559 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.313363    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-v7cr8\""
May 28 09:32:43.313559 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.313405    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-crt4dhe4od08t\""
May 28 09:32:43.313559 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.313411    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
May 28 09:32:43.313559 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.313343    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
May 28 09:32:43.313559 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.313343    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
May 28 09:32:43.315706 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.315688    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
May 28 09:32:43.329281 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.328697    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 09:32:43.391170 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:32:43.391118    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a192bb8_4720_4626_be36_92d00e71bc94.slice/crio-0ed2939635897f4053908368a9b011c20d0b7f07ee482b885c2d5821867fed8c WatchSource:0}: Error finding container 0ed2939635897f4053908368a9b011c20d0b7f07ee482b885c2d5821867fed8c: Status 404 returned error can't find the container with id 0ed2939635897f4053908368a9b011c20d0b7f07ee482b885c2d5821867fed8c
May 28 09:32:43.400517 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.400049    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b1f30324-a53c-449a-9cff-c44d3146c49c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:32:43.400517 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.400128    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b1f30324-a53c-449a-9cff-c44d3146c49c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:32:43.400517 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.400159    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b1f30324-a53c-449a-9cff-c44d3146c49c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:32:43.400517 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.400185    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b1f30324-a53c-449a-9cff-c44d3146c49c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:32:43.400517 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.400209    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1f30324-a53c-449a-9cff-c44d3146c49c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:32:43.400517 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.400239    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b1f30324-a53c-449a-9cff-c44d3146c49c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:32:43.400517 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.400264    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1f30324-a53c-449a-9cff-c44d3146c49c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:32:43.400517 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.400310    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b1f30324-a53c-449a-9cff-c44d3146c49c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:32:43.400517 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.400338    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b1f30324-a53c-449a-9cff-c44d3146c49c-web-config\") pod \"prometheus-k8s-0\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:32:43.400517 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.400368    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b1f30324-a53c-449a-9cff-c44d3146c49c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:32:43.400517 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.400400    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1f30324-a53c-449a-9cff-c44d3146c49c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:32:43.400517 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.400426    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9mqh\" (UniqueName: \"kubernetes.io/projected/b1f30324-a53c-449a-9cff-c44d3146c49c-kube-api-access-r9mqh\") pod \"prometheus-k8s-0\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:32:43.400517 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.400522    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b1f30324-a53c-449a-9cff-c44d3146c49c-config-out\") pod \"prometheus-k8s-0\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:32:43.401308 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.400561    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b1f30324-a53c-449a-9cff-c44d3146c49c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:32:43.401308 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.400627    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b1f30324-a53c-449a-9cff-c44d3146c49c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:32:43.401308 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.400698    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b1f30324-a53c-449a-9cff-c44d3146c49c-config\") pod \"prometheus-k8s-0\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:32:43.401308 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.400731    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b1f30324-a53c-449a-9cff-c44d3146c49c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:32:43.401308 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.400758    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b1f30324-a53c-449a-9cff-c44d3146c49c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:32:43.502046 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.501830    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b1f30324-a53c-449a-9cff-c44d3146c49c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:32:43.502046 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.501907    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b1f30324-a53c-449a-9cff-c44d3146c49c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:32:43.502046 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.501940    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b1f30324-a53c-449a-9cff-c44d3146c49c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:32:43.502898 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.501966    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b1f30324-a53c-449a-9cff-c44d3146c49c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:32:43.502898 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.502363    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1f30324-a53c-449a-9cff-c44d3146c49c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:32:43.502898 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.502409    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b1f30324-a53c-449a-9cff-c44d3146c49c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:32:43.502898 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.502437    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1f30324-a53c-449a-9cff-c44d3146c49c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:32:43.502898 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.502485    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b1f30324-a53c-449a-9cff-c44d3146c49c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:32:43.502898 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.502573    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b1f30324-a53c-449a-9cff-c44d3146c49c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:32:43.502898 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.502794    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b1f30324-a53c-449a-9cff-c44d3146c49c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:32:43.508495 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.504482    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b1f30324-a53c-449a-9cff-c44d3146c49c-web-config\") pod \"prometheus-k8s-0\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:32:43.508495 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.506805    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b1f30324-a53c-449a-9cff-c44d3146c49c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:32:43.508495 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.508179    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1f30324-a53c-449a-9cff-c44d3146c49c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:32:43.508495 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.508220    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1f30324-a53c-449a-9cff-c44d3146c49c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:32:43.508495 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.508284    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b1f30324-a53c-449a-9cff-c44d3146c49c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:32:43.508495 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.508297    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b1f30324-a53c-449a-9cff-c44d3146c49c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:32:43.508495 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.508379    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1f30324-a53c-449a-9cff-c44d3146c49c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:32:43.508495 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.508416    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r9mqh\" (UniqueName: \"kubernetes.io/projected/b1f30324-a53c-449a-9cff-c44d3146c49c-kube-api-access-r9mqh\") pod \"prometheus-k8s-0\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:32:43.508495 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.508451    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b1f30324-a53c-449a-9cff-c44d3146c49c-config-out\") pod \"prometheus-k8s-0\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:32:43.508495 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.508479    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b1f30324-a53c-449a-9cff-c44d3146c49c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:32:43.509007 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.508513    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b1f30324-a53c-449a-9cff-c44d3146c49c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:32:43.509007 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.508566    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b1f30324-a53c-449a-9cff-c44d3146c49c-config\") pod \"prometheus-k8s-0\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:32:43.509007 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.508599    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b1f30324-a53c-449a-9cff-c44d3146c49c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:32:43.509007 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.508633    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b1f30324-a53c-449a-9cff-c44d3146c49c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:32:43.511442 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.511084    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1f30324-a53c-449a-9cff-c44d3146c49c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:32:43.513375 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.513348    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b1f30324-a53c-449a-9cff-c44d3146c49c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:32:43.513935 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.513917    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b1f30324-a53c-449a-9cff-c44d3146c49c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:32:43.515284 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.514030    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b1f30324-a53c-449a-9cff-c44d3146c49c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:32:43.517527 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.517058    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b1f30324-a53c-449a-9cff-c44d3146c49c-web-config\") pod \"prometheus-k8s-0\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:32:43.517527 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.517482    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b1f30324-a53c-449a-9cff-c44d3146c49c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:32:43.520324 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.520111    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b1f30324-a53c-449a-9cff-c44d3146c49c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:32:43.520324 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.520130    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b1f30324-a53c-449a-9cff-c44d3146c49c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:32:43.520324 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.520285    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b1f30324-a53c-449a-9cff-c44d3146c49c-config-out\") pod \"prometheus-k8s-0\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:32:43.521619 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.521150    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9mqh\" (UniqueName: \"kubernetes.io/projected/b1f30324-a53c-449a-9cff-c44d3146c49c-kube-api-access-r9mqh\") pod \"prometheus-k8s-0\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:32:43.521619 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.521568    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b1f30324-a53c-449a-9cff-c44d3146c49c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:32:43.522203 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.522120    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/b1f30324-a53c-449a-9cff-c44d3146c49c-config\") pod \"prometheus-k8s-0\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:32:43.590708 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.590572    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-688b957f56-g6k8j"]
May 28 09:32:43.598532 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:32:43.598474    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26826edb_a070_408d_807d_84d411fe6c8c.slice/crio-117f6d08c1d4cd14416d7fd5c5cb549568156ed4a1a1c45cb10f3b2d2ef93bf3 WatchSource:0}: Error finding container 117f6d08c1d4cd14416d7fd5c5cb549568156ed4a1a1c45cb10f3b2d2ef93bf3: Status 404 returned error can't find the container with id 117f6d08c1d4cd14416d7fd5c5cb549568156ed4a1a1c45cb10f3b2d2ef93bf3
May 28 09:32:43.621804 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.621773    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:32:43.643193 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.641812    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-mh2ml"]
May 28 09:32:43.644580 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:32:43.644548    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5a1ea7d_a239_4aab_ba0e_63a282f664a8.slice/crio-219f9c36c03fb08be70089d6381413d2f4f669b7cd90f9ad3d219de17078ab3f WatchSource:0}: Error finding container 219f9c36c03fb08be70089d6381413d2f4f669b7cd90f9ad3d219de17078ab3f: Status 404 returned error can't find the container with id 219f9c36c03fb08be70089d6381413d2f4f669b7cd90f9ad3d219de17078ab3f
May 28 09:32:43.794686 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.794516    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 09:32:43.799392 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:32:43.799359    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1f30324_a53c_449a_9cff_c44d3146c49c.slice/crio-56473c704a8b3c78f4b8bae9d7630531a2092508355750878a0011d631164684 WatchSource:0}: Error finding container 56473c704a8b3c78f4b8bae9d7630531a2092508355750878a0011d631164684: Status 404 returned error can't find the container with id 56473c704a8b3c78f4b8bae9d7630531a2092508355750878a0011d631164684
May 28 09:32:43.809108 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.809084    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-gvkjg"]
May 28 09:32:43.812163 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:32:43.812120    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc370a6b_afcb_48f5_8234_d90d8b5c2ef2.slice/crio-74d6d68dfc1922ffe0703293ea99b0cd769d4307c322314257d78b5fc5177561 WatchSource:0}: Error finding container 74d6d68dfc1922ffe0703293ea99b0cd769d4307c322314257d78b5fc5177561: Status 404 returned error can't find the container with id 74d6d68dfc1922ffe0703293ea99b0cd769d4307c322314257d78b5fc5177561
May 28 09:32:43.817018 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:43.816847    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-84f75585c8-t2rb4"]
May 28 09:32:43.823621 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:32:43.823591    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74d7e2b7_f87f_45ee_b7b4_3ad8bf9c2c09.slice/crio-efb39571ec02fa78caa0559afdc09025e4feb0035ec2983b5d4d8eea26224124 WatchSource:0}: Error finding container efb39571ec02fa78caa0559afdc09025e4feb0035ec2983b5d4d8eea26224124: Status 404 returned error can't find the container with id efb39571ec02fa78caa0559afdc09025e4feb0035ec2983b5d4d8eea26224124
May 28 09:32:44.312041 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:44.310216    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-m7b8c" event={"ID":"6c007210-9934-4fe1-ad3f-7bef0dccbe0c","Type":"ContainerStarted","Data":"da92beedc679c7562543675b4cbeffc61081d1af1a353bff00a12ac2300b97dd"}
May 28 09:32:44.312041 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:44.312040    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-57bd96b888-m7b8c"
May 28 09:32:44.314615 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:44.314542    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-mh2ml" event={"ID":"e5a1ea7d-a239-4aab-ba0e-63a282f664a8","Type":"ContainerStarted","Data":"219f9c36c03fb08be70089d6381413d2f4f669b7cd90f9ad3d219de17078ab3f"}
May 28 09:32:44.316396 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:44.316358    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1f30324-a53c-449a-9cff-c44d3146c49c","Type":"ContainerStarted","Data":"56473c704a8b3c78f4b8bae9d7630531a2092508355750878a0011d631164684"}
May 28 09:32:44.318883 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:44.318835    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-688b957f56-g6k8j" event={"ID":"26826edb-a070-408d-807d-84d411fe6c8c","Type":"ContainerStarted","Data":"117f6d08c1d4cd14416d7fd5c5cb549568156ed4a1a1c45cb10f3b2d2ef93bf3"}
May 28 09:32:44.322353 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:44.322255    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-gvkjg" event={"ID":"fc370a6b-afcb-48f5-8234-d90d8b5c2ef2","Type":"ContainerStarted","Data":"368fca390eb1f6f9c074a5d34de9ce86a016284c6f73ba835e014c0f3f8c1b48"}
May 28 09:32:44.322353 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:44.322290    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-gvkjg" event={"ID":"fc370a6b-afcb-48f5-8234-d90d8b5c2ef2","Type":"ContainerStarted","Data":"d225f1103e9e1ebb6570097006b2d10035794db5012af7a039fa3cb5bf607696"}
May 28 09:32:44.322353 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:44.322304    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-gvkjg" event={"ID":"fc370a6b-afcb-48f5-8234-d90d8b5c2ef2","Type":"ContainerStarted","Data":"74d6d68dfc1922ffe0703293ea99b0cd769d4307c322314257d78b5fc5177561"}
May 28 09:32:44.324483 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:44.324429    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-84f75585c8-t2rb4" event={"ID":"74d7e2b7-f87f-45ee-b7b4-3ad8bf9c2c09","Type":"ContainerStarted","Data":"efb39571ec02fa78caa0559afdc09025e4feb0035ec2983b5d4d8eea26224124"}
May 28 09:32:44.327439 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:44.325199    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-57bd96b888-m7b8c"
May 28 09:32:44.328402 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:44.328375    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2z4sq" event={"ID":"6a192bb8-4720-4626-be36-92d00e71bc94","Type":"ContainerStarted","Data":"0ed2939635897f4053908368a9b011c20d0b7f07ee482b885c2d5821867fed8c"}
May 28 09:32:44.332994 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:44.332888    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-57bd96b888-m7b8c" podStartSLOduration=1.37898531 podStartE2EDuration="19.332872477s" podCreationTimestamp="2026-05-28 09:32:25 +0000 UTC" firstStartedPulling="2026-05-28 09:32:25.502611273 +0000 UTC m=+74.185532038" lastFinishedPulling="2026-05-28 09:32:43.456498428 +0000 UTC m=+92.139419205" observedRunningTime="2026-05-28 09:32:44.331531523 +0000 UTC m=+93.014452343" watchObservedRunningTime="2026-05-28 09:32:44.332872477 +0000 UTC m=+93.015793262"
May 28 09:32:44.594638 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:44.594540    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-557f76c968-zbdf8"]
May 28 09:32:44.619656 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:44.619626    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-557f76c968-zbdf8"]
May 28 09:32:44.620074 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:44.619958    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-557f76c968-zbdf8"
May 28 09:32:44.639169 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:44.639115    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
May 28 09:32:44.722788 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:44.722334    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcnm8\" (UniqueName: \"kubernetes.io/projected/488a4f27-9c0f-401b-95a3-0998d9ed7b70-kube-api-access-tcnm8\") pod \"console-557f76c968-zbdf8\" (UID: \"488a4f27-9c0f-401b-95a3-0998d9ed7b70\") " pod="openshift-console/console-557f76c968-zbdf8"
May 28 09:32:44.722788 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:44.722397    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/488a4f27-9c0f-401b-95a3-0998d9ed7b70-console-serving-cert\") pod \"console-557f76c968-zbdf8\" (UID: \"488a4f27-9c0f-401b-95a3-0998d9ed7b70\") " pod="openshift-console/console-557f76c968-zbdf8"
May 28 09:32:44.722788 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:44.722432    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/488a4f27-9c0f-401b-95a3-0998d9ed7b70-trusted-ca-bundle\") pod \"console-557f76c968-zbdf8\" (UID: \"488a4f27-9c0f-401b-95a3-0998d9ed7b70\") " pod="openshift-console/console-557f76c968-zbdf8"
May 28 09:32:44.722788 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:44.722460    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/488a4f27-9c0f-401b-95a3-0998d9ed7b70-oauth-serving-cert\") pod \"console-557f76c968-zbdf8\" (UID: \"488a4f27-9c0f-401b-95a3-0998d9ed7b70\") " pod="openshift-console/console-557f76c968-zbdf8"
May 28 09:32:44.722788 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:44.722549    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/488a4f27-9c0f-401b-95a3-0998d9ed7b70-service-ca\") pod \"console-557f76c968-zbdf8\" (UID: \"488a4f27-9c0f-401b-95a3-0998d9ed7b70\") " pod="openshift-console/console-557f76c968-zbdf8"
May 28 09:32:44.722788 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:44.722597    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/488a4f27-9c0f-401b-95a3-0998d9ed7b70-console-config\") pod \"console-557f76c968-zbdf8\" (UID: \"488a4f27-9c0f-401b-95a3-0998d9ed7b70\") " pod="openshift-console/console-557f76c968-zbdf8"
May 28 09:32:44.722788 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:44.722633    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/488a4f27-9c0f-401b-95a3-0998d9ed7b70-console-oauth-config\") pod \"console-557f76c968-zbdf8\" (UID: \"488a4f27-9c0f-401b-95a3-0998d9ed7b70\") " pod="openshift-console/console-557f76c968-zbdf8"
May 28 09:32:44.824052 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:44.823423    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/488a4f27-9c0f-401b-95a3-0998d9ed7b70-service-ca\") pod \"console-557f76c968-zbdf8\" (UID: \"488a4f27-9c0f-401b-95a3-0998d9ed7b70\") " pod="openshift-console/console-557f76c968-zbdf8"
May 28 09:32:44.824382 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:44.824347    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/488a4f27-9c0f-401b-95a3-0998d9ed7b70-console-config\") pod \"console-557f76c968-zbdf8\" (UID: \"488a4f27-9c0f-401b-95a3-0998d9ed7b70\") " pod="openshift-console/console-557f76c968-zbdf8"
May 28 09:32:44.824555 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:44.824387    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/488a4f27-9c0f-401b-95a3-0998d9ed7b70-console-config\") pod \"console-557f76c968-zbdf8\" (UID: \"488a4f27-9c0f-401b-95a3-0998d9ed7b70\") " pod="openshift-console/console-557f76c968-zbdf8"
May 28 09:32:44.825143 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:44.825090    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/488a4f27-9c0f-401b-95a3-0998d9ed7b70-console-oauth-config\") pod \"console-557f76c968-zbdf8\" (UID: \"488a4f27-9c0f-401b-95a3-0998d9ed7b70\") " pod="openshift-console/console-557f76c968-zbdf8"
May 28 09:32:44.826469 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:44.826118    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/488a4f27-9c0f-401b-95a3-0998d9ed7b70-service-ca\") pod \"console-557f76c968-zbdf8\" (UID: \"488a4f27-9c0f-401b-95a3-0998d9ed7b70\") " pod="openshift-console/console-557f76c968-zbdf8"
May 28 09:32:44.828880 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:44.826606    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tcnm8\" (UniqueName: \"kubernetes.io/projected/488a4f27-9c0f-401b-95a3-0998d9ed7b70-kube-api-access-tcnm8\") pod \"console-557f76c968-zbdf8\" (UID: \"488a4f27-9c0f-401b-95a3-0998d9ed7b70\") " pod="openshift-console/console-557f76c968-zbdf8"
May 28 09:32:44.828880 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:44.826658    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/488a4f27-9c0f-401b-95a3-0998d9ed7b70-console-serving-cert\") pod \"console-557f76c968-zbdf8\" (UID: \"488a4f27-9c0f-401b-95a3-0998d9ed7b70\") " pod="openshift-console/console-557f76c968-zbdf8"
May 28 09:32:44.828880 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:44.826692    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/488a4f27-9c0f-401b-95a3-0998d9ed7b70-trusted-ca-bundle\") pod \"console-557f76c968-zbdf8\" (UID: \"488a4f27-9c0f-401b-95a3-0998d9ed7b70\") " pod="openshift-console/console-557f76c968-zbdf8"
May 28 09:32:44.828880 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:44.826720    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/488a4f27-9c0f-401b-95a3-0998d9ed7b70-oauth-serving-cert\") pod \"console-557f76c968-zbdf8\" (UID: \"488a4f27-9c0f-401b-95a3-0998d9ed7b70\") " pod="openshift-console/console-557f76c968-zbdf8"
May 28 09:32:44.828880 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:44.827465    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/488a4f27-9c0f-401b-95a3-0998d9ed7b70-oauth-serving-cert\") pod \"console-557f76c968-zbdf8\" (UID: \"488a4f27-9c0f-401b-95a3-0998d9ed7b70\") " pod="openshift-console/console-557f76c968-zbdf8"
May 28 09:32:44.828880 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:44.828834    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/488a4f27-9c0f-401b-95a3-0998d9ed7b70-trusted-ca-bundle\") pod \"console-557f76c968-zbdf8\" (UID: \"488a4f27-9c0f-401b-95a3-0998d9ed7b70\") " pod="openshift-console/console-557f76c968-zbdf8"
May 28 09:32:44.841005 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:44.840928    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcnm8\" (UniqueName: \"kubernetes.io/projected/488a4f27-9c0f-401b-95a3-0998d9ed7b70-kube-api-access-tcnm8\") pod \"console-557f76c968-zbdf8\" (UID: \"488a4f27-9c0f-401b-95a3-0998d9ed7b70\") " pod="openshift-console/console-557f76c968-zbdf8"
May 28 09:32:44.842119 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:44.842062    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/488a4f27-9c0f-401b-95a3-0998d9ed7b70-console-serving-cert\") pod \"console-557f76c968-zbdf8\" (UID: \"488a4f27-9c0f-401b-95a3-0998d9ed7b70\") " pod="openshift-console/console-557f76c968-zbdf8"
May 28 09:32:44.858665 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:44.858556    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/488a4f27-9c0f-401b-95a3-0998d9ed7b70-console-oauth-config\") pod \"console-557f76c968-zbdf8\" (UID: \"488a4f27-9c0f-401b-95a3-0998d9ed7b70\") " pod="openshift-console/console-557f76c968-zbdf8"
May 28 09:32:44.936563 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:44.936498    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-557f76c968-zbdf8"
May 28 09:32:45.170375 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:45.169222    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-557f76c968-zbdf8"]
May 28 09:32:46.560052 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:32:46.560005    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod488a4f27_9c0f_401b_95a3_0998d9ed7b70.slice/crio-3320944798eb6cb4a03d78a2918d12715cd7cbfdead900a936d3d40da998d01c WatchSource:0}: Error finding container 3320944798eb6cb4a03d78a2918d12715cd7cbfdead900a936d3d40da998d01c: Status 404 returned error can't find the container with id 3320944798eb6cb4a03d78a2918d12715cd7cbfdead900a936d3d40da998d01c
May 28 09:32:47.143721 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:47.143678    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-557f76c968-zbdf8"]
May 28 09:32:47.182501 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:47.182469    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-b86cb56c5-p6mcn"]
May 28 09:32:47.200036 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:47.200003    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b86cb56c5-p6mcn"]
May 28 09:32:47.200212 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:47.200149    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b86cb56c5-p6mcn"
May 28 09:32:47.341106 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:47.341073    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-557f76c968-zbdf8" event={"ID":"488a4f27-9c0f-401b-95a3-0998d9ed7b70","Type":"ContainerStarted","Data":"3320944798eb6cb4a03d78a2918d12715cd7cbfdead900a936d3d40da998d01c"}
May 28 09:32:47.354019 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:47.353955    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf-console-config\") pod \"console-b86cb56c5-p6mcn\" (UID: \"a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf\") " pod="openshift-console/console-b86cb56c5-p6mcn"
May 28 09:32:47.354189 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:47.354027    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf-oauth-serving-cert\") pod \"console-b86cb56c5-p6mcn\" (UID: \"a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf\") " pod="openshift-console/console-b86cb56c5-p6mcn"
May 28 09:32:47.354189 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:47.354109    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf-console-serving-cert\") pod \"console-b86cb56c5-p6mcn\" (UID: \"a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf\") " pod="openshift-console/console-b86cb56c5-p6mcn"
May 28 09:32:47.354189 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:47.354150    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf-service-ca\") pod \"console-b86cb56c5-p6mcn\" (UID: \"a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf\") " pod="openshift-console/console-b86cb56c5-p6mcn"
May 28 09:32:47.354337 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:47.354212    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf-console-oauth-config\") pod \"console-b86cb56c5-p6mcn\" (UID: \"a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf\") " pod="openshift-console/console-b86cb56c5-p6mcn"
May 28 09:32:47.354337 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:47.354244    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z74pc\" (UniqueName: \"kubernetes.io/projected/a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf-kube-api-access-z74pc\") pod \"console-b86cb56c5-p6mcn\" (UID: \"a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf\") " pod="openshift-console/console-b86cb56c5-p6mcn"
May 28 09:32:47.354432 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:47.354351    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf-trusted-ca-bundle\") pod \"console-b86cb56c5-p6mcn\" (UID: \"a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf\") " pod="openshift-console/console-b86cb56c5-p6mcn"
May 28 09:32:47.455313 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:47.455219    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf-console-oauth-config\") pod \"console-b86cb56c5-p6mcn\" (UID: \"a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf\") " pod="openshift-console/console-b86cb56c5-p6mcn"
May 28 09:32:47.455313 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:47.455264    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z74pc\" (UniqueName: \"kubernetes.io/projected/a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf-kube-api-access-z74pc\") pod \"console-b86cb56c5-p6mcn\" (UID: \"a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf\") " pod="openshift-console/console-b86cb56c5-p6mcn"
May 28 09:32:47.455543 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:47.455334    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf-trusted-ca-bundle\") pod \"console-b86cb56c5-p6mcn\" (UID: \"a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf\") " pod="openshift-console/console-b86cb56c5-p6mcn"
May 28 09:32:47.455543 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:47.455377    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf-console-config\") pod \"console-b86cb56c5-p6mcn\" (UID: \"a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf\") " pod="openshift-console/console-b86cb56c5-p6mcn"
May 28 09:32:47.455543 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:47.455409    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf-oauth-serving-cert\") pod \"console-b86cb56c5-p6mcn\" (UID: \"a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf\") " pod="openshift-console/console-b86cb56c5-p6mcn"
May 28 09:32:47.455543 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:47.455438    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf-console-serving-cert\") pod \"console-b86cb56c5-p6mcn\" (UID: \"a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf\") " pod="openshift-console/console-b86cb56c5-p6mcn"
May 28 09:32:47.455543 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:47.455469    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf-service-ca\") pod \"console-b86cb56c5-p6mcn\" (UID: \"a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf\") " pod="openshift-console/console-b86cb56c5-p6mcn"
May 28 09:32:47.456329 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:47.456295    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf-service-ca\") pod \"console-b86cb56c5-p6mcn\" (UID: \"a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf\") " pod="openshift-console/console-b86cb56c5-p6mcn"
May 28 09:32:47.456468 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:47.456445    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf-oauth-serving-cert\") pod \"console-b86cb56c5-p6mcn\" (UID: \"a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf\") " pod="openshift-console/console-b86cb56c5-p6mcn"
May 28 09:32:47.456630 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:47.456602    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf-trusted-ca-bundle\") pod \"console-b86cb56c5-p6mcn\" (UID: \"a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf\") " pod="openshift-console/console-b86cb56c5-p6mcn"
May 28 09:32:47.457055 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:47.457032    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf-console-config\") pod \"console-b86cb56c5-p6mcn\" (UID: \"a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf\") " pod="openshift-console/console-b86cb56c5-p6mcn"
May 28 09:32:47.458309 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:47.458281    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf-console-oauth-config\") pod \"console-b86cb56c5-p6mcn\" (UID: \"a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf\") " pod="openshift-console/console-b86cb56c5-p6mcn"
May 28 09:32:47.458567 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:47.458543    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf-console-serving-cert\") pod \"console-b86cb56c5-p6mcn\" (UID: \"a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf\") " pod="openshift-console/console-b86cb56c5-p6mcn"
May 28 09:32:47.464419 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:47.464390    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z74pc\" (UniqueName: \"kubernetes.io/projected/a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf-kube-api-access-z74pc\") pod \"console-b86cb56c5-p6mcn\" (UID: \"a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf\") " pod="openshift-console/console-b86cb56c5-p6mcn"
May 28 09:32:47.515317 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:47.515275    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b86cb56c5-p6mcn"
May 28 09:32:49.045003 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:49.044846    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b86cb56c5-p6mcn"]
May 28 09:32:49.068922 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:32:49.068580    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0a48051_7aaf_4e30_af2e_6cc1d4a61cdf.slice/crio-c7f79ce97376b3fb0726101d4a865854345201bc61face30c47a3f4d5644fc06 WatchSource:0}: Error finding container c7f79ce97376b3fb0726101d4a865854345201bc61face30c47a3f4d5644fc06: Status 404 returned error can't find the container with id c7f79ce97376b3fb0726101d4a865854345201bc61face30c47a3f4d5644fc06
May 28 09:32:49.349266 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:49.349233    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-mh2ml" event={"ID":"e5a1ea7d-a239-4aab-ba0e-63a282f664a8","Type":"ContainerStarted","Data":"1caca16f8cb044bf1bba09a8e8a433d0e33e5026c12eb6c52cc3a3829d7074fa"}
May 28 09:32:49.349452 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:49.349434    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-mh2ml"
May 28 09:32:49.351127 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:49.351099    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-84f75585c8-t2rb4" event={"ID":"74d7e2b7-f87f-45ee-b7b4-3ad8bf9c2c09","Type":"ContainerStarted","Data":"5522531e52753e0c8f21cf8cecfe679c5cfafc7cb8b89704aff4e15df6e9d18e"}
May 28 09:32:49.351246 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:49.351146    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-84f75585c8-t2rb4" event={"ID":"74d7e2b7-f87f-45ee-b7b4-3ad8bf9c2c09","Type":"ContainerStarted","Data":"7a7f28813fc06b7b352a2134d4f722e330dc954c3dca724379d610809fe9a988"}
May 28 09:32:49.352871 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:49.352781    2572 generic.go:358] "Generic (PLEG): container finished" podID="b1f30324-a53c-449a-9cff-c44d3146c49c" containerID="c387c9ad1d4716c5988e9d6d716dd9b0e990843dffe04ddda2485e1798f9f573" exitCode=0
May 28 09:32:49.352871 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:49.352860    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1f30324-a53c-449a-9cff-c44d3146c49c","Type":"ContainerDied","Data":"c387c9ad1d4716c5988e9d6d716dd9b0e990843dffe04ddda2485e1798f9f573"}
May 28 09:32:49.355329 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:49.355241    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-mh2ml"
May 28 09:32:49.356417 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:49.356393    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-688b957f56-g6k8j" event={"ID":"26826edb-a070-408d-807d-84d411fe6c8c","Type":"ContainerStarted","Data":"2c2c665425a846286fc79c029b71efd88268c4a0b76230749c2e414e7cebad78"}
May 28 09:32:49.358865 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:49.358836    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-gvkjg" event={"ID":"fc370a6b-afcb-48f5-8234-d90d8b5c2ef2","Type":"ContainerStarted","Data":"fe311e58d8227e77e1142dcf99f308d546a8d0f1c841d0e9a947c122d475e7a0"}
May 28 09:32:49.361114 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:49.360658    2572 generic.go:358] "Generic (PLEG): container finished" podID="6a192bb8-4720-4626-be36-92d00e71bc94" containerID="1012a72da4f83453f609ed3568f30c9b2f9f91219f67e5db588acdbf5841dd26" exitCode=0
May 28 09:32:49.361114 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:49.360726    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2z4sq" event={"ID":"6a192bb8-4720-4626-be36-92d00e71bc94","Type":"ContainerDied","Data":"1012a72da4f83453f609ed3568f30c9b2f9f91219f67e5db588acdbf5841dd26"}
May 28 09:32:49.363164 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:49.363023    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-557f76c968-zbdf8" event={"ID":"488a4f27-9c0f-401b-95a3-0998d9ed7b70","Type":"ContainerStarted","Data":"8cbf31139164324223361c17349a5b7e0ab83a93ec2b446df46ce24de03a773e"}
May 28 09:32:49.365503 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:49.365483    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b86cb56c5-p6mcn" event={"ID":"a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf","Type":"ContainerStarted","Data":"75ae9ebc623b4bb461e7159d24c3b168aae4a497ecf8004f6ff8a2f3ed6bcc86"}
May 28 09:32:49.365600 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:49.365508    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b86cb56c5-p6mcn" event={"ID":"a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf","Type":"ContainerStarted","Data":"c7f79ce97376b3fb0726101d4a865854345201bc61face30c47a3f4d5644fc06"}
May 28 09:32:49.373047 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:49.372999    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-665c9c8584-mh2ml" podStartSLOduration=3.197337373 podStartE2EDuration="8.372963499s" podCreationTimestamp="2026-05-28 09:32:41 +0000 UTC" firstStartedPulling="2026-05-28 09:32:43.646191266 +0000 UTC m=+92.329112031" lastFinishedPulling="2026-05-28 09:32:48.821817394 +0000 UTC m=+97.504738157" observedRunningTime="2026-05-28 09:32:49.370656448 +0000 UTC m=+98.053577237" watchObservedRunningTime="2026-05-28 09:32:49.372963499 +0000 UTC m=+98.055884283"
May 28 09:32:49.393869 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:49.393802    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-688b957f56-g6k8j" podStartSLOduration=3.173744064 podStartE2EDuration="8.39378317s" podCreationTimestamp="2026-05-28 09:32:41 +0000 UTC" firstStartedPulling="2026-05-28 09:32:43.601765673 +0000 UTC m=+92.284686434" lastFinishedPulling="2026-05-28 09:32:48.821804764 +0000 UTC m=+97.504725540" observedRunningTime="2026-05-28 09:32:49.391182302 +0000 UTC m=+98.074103066" watchObservedRunningTime="2026-05-28 09:32:49.39378317 +0000 UTC m=+98.076703954"
May 28 09:32:49.473397 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:49.473158    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-b86cb56c5-p6mcn" podStartSLOduration=2.473138224 podStartE2EDuration="2.473138224s" podCreationTimestamp="2026-05-28 09:32:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 09:32:49.471679328 +0000 UTC m=+98.154600127" watchObservedRunningTime="2026-05-28 09:32:49.473138224 +0000 UTC m=+98.156059009"
May 28 09:32:49.495186 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:49.495028    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-gvkjg" podStartSLOduration=8.632196842 podStartE2EDuration="13.495008022s" podCreationTimestamp="2026-05-28 09:32:36 +0000 UTC" firstStartedPulling="2026-05-28 09:32:43.982532844 +0000 UTC m=+92.665453605" lastFinishedPulling="2026-05-28 09:32:48.845344013 +0000 UTC m=+97.528264785" observedRunningTime="2026-05-28 09:32:49.494422481 +0000 UTC m=+98.177343265" watchObservedRunningTime="2026-05-28 09:32:49.495008022 +0000 UTC m=+98.177928807"
May 28 09:32:50.373386 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:50.373300    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-84f75585c8-t2rb4" event={"ID":"74d7e2b7-f87f-45ee-b7b4-3ad8bf9c2c09","Type":"ContainerStarted","Data":"4a328aee0d9aef5383405eec2754090715970c5949015ee45a0a1b740c534686"}
May 28 09:32:50.377458 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:50.377391    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2z4sq" event={"ID":"6a192bb8-4720-4626-be36-92d00e71bc94","Type":"ContainerStarted","Data":"744a15a0317cc04313291a011f6478865db8caddeae869bea2a933d853a933c4"}
May 28 09:32:50.377458 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:50.377437    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2z4sq" event={"ID":"6a192bb8-4720-4626-be36-92d00e71bc94","Type":"ContainerStarted","Data":"cee1dcac3d942146b99f924d96dec4da53fe0aedd11bbe36bf773ad1ef075749"}
May 28 09:32:50.402620 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:50.402561    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-557f76c968-zbdf8" podStartSLOduration=6.402543944 podStartE2EDuration="6.402543944s" podCreationTimestamp="2026-05-28 09:32:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 09:32:49.537727792 +0000 UTC m=+98.220648580" watchObservedRunningTime="2026-05-28 09:32:50.402543944 +0000 UTC m=+99.085464728"
May 28 09:32:50.404139 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:50.404090    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-2z4sq" podStartSLOduration=8.220207934 podStartE2EDuration="13.404074511s" podCreationTimestamp="2026-05-28 09:32:37 +0000 UTC" firstStartedPulling="2026-05-28 09:32:43.399409414 +0000 UTC m=+92.082330180" lastFinishedPulling="2026-05-28 09:32:48.583275982 +0000 UTC m=+97.266196757" observedRunningTime="2026-05-28 09:32:50.403188427 +0000 UTC m=+99.086109214" watchObservedRunningTime="2026-05-28 09:32:50.404074511 +0000 UTC m=+99.086995295"
May 28 09:32:51.386372 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:51.386269    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-84f75585c8-t2rb4" event={"ID":"74d7e2b7-f87f-45ee-b7b4-3ad8bf9c2c09","Type":"ContainerStarted","Data":"e9d541fa3cb8957390a63a81541abc06dbd24ed032a1906dd9113ca100cc3bd2"}
May 28 09:32:51.386372 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:51.386315    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-84f75585c8-t2rb4" event={"ID":"74d7e2b7-f87f-45ee-b7b4-3ad8bf9c2c09","Type":"ContainerStarted","Data":"56dfeff158f5493a68730146208a323579c8425d5efe42ab1046922510dfa035"}
May 28 09:32:52.395527 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:52.395480    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-84f75585c8-t2rb4" event={"ID":"74d7e2b7-f87f-45ee-b7b4-3ad8bf9c2c09","Type":"ContainerStarted","Data":"8a60655125dde5d383420360cbcaff55529cb5cb70c44456602eb31821bb0f70"}
May 28 09:32:52.396023 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:52.395639    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-84f75585c8-t2rb4"
May 28 09:32:52.424725 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:52.424676    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-84f75585c8-t2rb4" podStartSLOduration=7.175421876 podStartE2EDuration="14.424657481s" podCreationTimestamp="2026-05-28 09:32:38 +0000 UTC" firstStartedPulling="2026-05-28 09:32:43.827772208 +0000 UTC m=+92.510692981" lastFinishedPulling="2026-05-28 09:32:51.077007823 +0000 UTC m=+99.759928586" observedRunningTime="2026-05-28 09:32:52.422177355 +0000 UTC m=+101.105098143" watchObservedRunningTime="2026-05-28 09:32:52.424657481 +0000 UTC m=+101.107578264"
May 28 09:32:53.236622 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:53.236596    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jx9bd"
May 28 09:32:53.400862 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:53.400827    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1f30324-a53c-449a-9cff-c44d3146c49c","Type":"ContainerStarted","Data":"29fc6307e4826ec011bc287ac3e3e07004ead76663efc5d9238e2e55f5114649"}
May 28 09:32:53.400862 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:53.400867    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1f30324-a53c-449a-9cff-c44d3146c49c","Type":"ContainerStarted","Data":"4f1738681ea55098791c111495857856056c2e85f348bcfb9890e21199ea700d"}
May 28 09:32:53.401407 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:53.400881    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1f30324-a53c-449a-9cff-c44d3146c49c","Type":"ContainerStarted","Data":"9cdf0d080c7692aa36007cc6c6fb2661e4208ac4aa71b92b035b38543d5af686"}
May 28 09:32:54.407070 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:54.407028    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1f30324-a53c-449a-9cff-c44d3146c49c","Type":"ContainerStarted","Data":"0c49bccb696037a068cfd6656a7df2b6edb00013c006820c6da42aecf510fc13"}
May 28 09:32:54.407070 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:54.407074    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1f30324-a53c-449a-9cff-c44d3146c49c","Type":"ContainerStarted","Data":"3cb1911a911dacbc2682231de9cea6b2da61606f45784689a29b24ecff5c3ada"}
May 28 09:32:54.407560 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:54.407087    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1f30324-a53c-449a-9cff-c44d3146c49c","Type":"ContainerStarted","Data":"3e2f1bdab40529134e6e9f151e7c277a96b0d0866af15265a5e90f3b0d1e4816"}
May 28 09:32:54.439629 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:54.439567    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.299706409 podStartE2EDuration="11.439543613s" podCreationTimestamp="2026-05-28 09:32:43 +0000 UTC" firstStartedPulling="2026-05-28 09:32:43.804574307 +0000 UTC m=+92.487495084" lastFinishedPulling="2026-05-28 09:32:52.944411527 +0000 UTC m=+101.627332288" observedRunningTime="2026-05-28 09:32:54.437863131 +0000 UTC m=+103.120783912" watchObservedRunningTime="2026-05-28 09:32:54.439543613 +0000 UTC m=+103.122464394"
May 28 09:32:54.937604 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:54.937565    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-557f76c968-zbdf8"
May 28 09:32:57.516054 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:57.516011    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b86cb56c5-p6mcn"
May 28 09:32:57.516506 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:57.516106    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b86cb56c5-p6mcn"
May 28 09:32:57.520949 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:57.520920    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-b86cb56c5-p6mcn"
May 28 09:32:58.406703 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:58.406666    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-84f75585c8-t2rb4"
May 28 09:32:58.422117 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:58.422091    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-b86cb56c5-p6mcn"
May 28 09:32:58.483775 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:58.483744    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c544f5446-2b9dd"]
May 28 09:32:58.622448 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:32:58.622416    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:33:01.695149 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:01.695109    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-688b957f56-g6k8j"
May 28 09:33:01.695733 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:01.695172    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-688b957f56-g6k8j"
May 28 09:33:11.818492 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:11.818462    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-j8n6p_4fee2b30-cecf-4ae8-bd5a-d36adbfee0f8/serve-healthcheck-canary/0.log"
May 28 09:33:14.388947 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:14.388893    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-557f76c968-zbdf8" podUID="488a4f27-9c0f-401b-95a3-0998d9ed7b70" containerName="console" containerID="cri-o://8cbf31139164324223361c17349a5b7e0ab83a93ec2b446df46ce24de03a773e" gracePeriod=15
May 28 09:33:14.640414 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:14.640357    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-557f76c968-zbdf8_488a4f27-9c0f-401b-95a3-0998d9ed7b70/console/0.log"
May 28 09:33:14.640523 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:14.640433    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-557f76c968-zbdf8"
May 28 09:33:14.716251 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:14.716217    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/488a4f27-9c0f-401b-95a3-0998d9ed7b70-service-ca\") pod \"488a4f27-9c0f-401b-95a3-0998d9ed7b70\" (UID: \"488a4f27-9c0f-401b-95a3-0998d9ed7b70\") "
May 28 09:33:14.716442 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:14.716278    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/488a4f27-9c0f-401b-95a3-0998d9ed7b70-console-config\") pod \"488a4f27-9c0f-401b-95a3-0998d9ed7b70\" (UID: \"488a4f27-9c0f-401b-95a3-0998d9ed7b70\") "
May 28 09:33:14.716442 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:14.716314    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/488a4f27-9c0f-401b-95a3-0998d9ed7b70-console-serving-cert\") pod \"488a4f27-9c0f-401b-95a3-0998d9ed7b70\" (UID: \"488a4f27-9c0f-401b-95a3-0998d9ed7b70\") "
May 28 09:33:14.716442 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:14.716360    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/488a4f27-9c0f-401b-95a3-0998d9ed7b70-trusted-ca-bundle\") pod \"488a4f27-9c0f-401b-95a3-0998d9ed7b70\" (UID: \"488a4f27-9c0f-401b-95a3-0998d9ed7b70\") "
May 28 09:33:14.716442 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:14.716391    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tcnm8\" (UniqueName: \"kubernetes.io/projected/488a4f27-9c0f-401b-95a3-0998d9ed7b70-kube-api-access-tcnm8\") pod \"488a4f27-9c0f-401b-95a3-0998d9ed7b70\" (UID: \"488a4f27-9c0f-401b-95a3-0998d9ed7b70\") "
May 28 09:33:14.716442 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:14.716414    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/488a4f27-9c0f-401b-95a3-0998d9ed7b70-oauth-serving-cert\") pod \"488a4f27-9c0f-401b-95a3-0998d9ed7b70\" (UID: \"488a4f27-9c0f-401b-95a3-0998d9ed7b70\") "
May 28 09:33:14.716754 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:14.716468    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/488a4f27-9c0f-401b-95a3-0998d9ed7b70-console-oauth-config\") pod \"488a4f27-9c0f-401b-95a3-0998d9ed7b70\" (UID: \"488a4f27-9c0f-401b-95a3-0998d9ed7b70\") "
May 28 09:33:14.716807 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:14.716720    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/488a4f27-9c0f-401b-95a3-0998d9ed7b70-console-config" (OuterVolumeSpecName: "console-config") pod "488a4f27-9c0f-401b-95a3-0998d9ed7b70" (UID: "488a4f27-9c0f-401b-95a3-0998d9ed7b70"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 09:33:14.716850 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:14.716769    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/488a4f27-9c0f-401b-95a3-0998d9ed7b70-service-ca" (OuterVolumeSpecName: "service-ca") pod "488a4f27-9c0f-401b-95a3-0998d9ed7b70" (UID: "488a4f27-9c0f-401b-95a3-0998d9ed7b70"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 09:33:14.716885 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:14.716841    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/488a4f27-9c0f-401b-95a3-0998d9ed7b70-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "488a4f27-9c0f-401b-95a3-0998d9ed7b70" (UID: "488a4f27-9c0f-401b-95a3-0998d9ed7b70"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 09:33:14.716885 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:14.716866    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/488a4f27-9c0f-401b-95a3-0998d9ed7b70-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "488a4f27-9c0f-401b-95a3-0998d9ed7b70" (UID: "488a4f27-9c0f-401b-95a3-0998d9ed7b70"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 09:33:14.718816 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:14.718787    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/488a4f27-9c0f-401b-95a3-0998d9ed7b70-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "488a4f27-9c0f-401b-95a3-0998d9ed7b70" (UID: "488a4f27-9c0f-401b-95a3-0998d9ed7b70"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:33:14.718926 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:14.718817    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/488a4f27-9c0f-401b-95a3-0998d9ed7b70-kube-api-access-tcnm8" (OuterVolumeSpecName: "kube-api-access-tcnm8") pod "488a4f27-9c0f-401b-95a3-0998d9ed7b70" (UID: "488a4f27-9c0f-401b-95a3-0998d9ed7b70"). InnerVolumeSpecName "kube-api-access-tcnm8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 09:33:14.718926 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:14.718815    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/488a4f27-9c0f-401b-95a3-0998d9ed7b70-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "488a4f27-9c0f-401b-95a3-0998d9ed7b70" (UID: "488a4f27-9c0f-401b-95a3-0998d9ed7b70"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:33:14.817812 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:14.817772    2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/488a4f27-9c0f-401b-95a3-0998d9ed7b70-trusted-ca-bundle\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:33:14.817812 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:14.817804    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tcnm8\" (UniqueName: \"kubernetes.io/projected/488a4f27-9c0f-401b-95a3-0998d9ed7b70-kube-api-access-tcnm8\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:33:14.817812 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:14.817818    2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/488a4f27-9c0f-401b-95a3-0998d9ed7b70-oauth-serving-cert\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:33:14.818084 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:14.817831    2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/488a4f27-9c0f-401b-95a3-0998d9ed7b70-console-oauth-config\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:33:14.818084 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:14.817845    2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/488a4f27-9c0f-401b-95a3-0998d9ed7b70-service-ca\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:33:14.818084 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:14.817857    2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/488a4f27-9c0f-401b-95a3-0998d9ed7b70-console-config\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:33:14.818084 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:14.817867    2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/488a4f27-9c0f-401b-95a3-0998d9ed7b70-console-serving-cert\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:33:15.470130 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:15.470102    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-557f76c968-zbdf8_488a4f27-9c0f-401b-95a3-0998d9ed7b70/console/0.log"
May 28 09:33:15.470552 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:15.470144    2572 generic.go:358] "Generic (PLEG): container finished" podID="488a4f27-9c0f-401b-95a3-0998d9ed7b70" containerID="8cbf31139164324223361c17349a5b7e0ab83a93ec2b446df46ce24de03a773e" exitCode=2
May 28 09:33:15.470552 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:15.470216    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-557f76c968-zbdf8" event={"ID":"488a4f27-9c0f-401b-95a3-0998d9ed7b70","Type":"ContainerDied","Data":"8cbf31139164324223361c17349a5b7e0ab83a93ec2b446df46ce24de03a773e"}
May 28 09:33:15.470552 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:15.470246    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-557f76c968-zbdf8" event={"ID":"488a4f27-9c0f-401b-95a3-0998d9ed7b70","Type":"ContainerDied","Data":"3320944798eb6cb4a03d78a2918d12715cd7cbfdead900a936d3d40da998d01c"}
May 28 09:33:15.470552 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:15.470261    2572 scope.go:117] "RemoveContainer" containerID="8cbf31139164324223361c17349a5b7e0ab83a93ec2b446df46ce24de03a773e"
May 28 09:33:15.470552 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:15.470222    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-557f76c968-zbdf8"
May 28 09:33:15.480400 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:15.480316    2572 scope.go:117] "RemoveContainer" containerID="8cbf31139164324223361c17349a5b7e0ab83a93ec2b446df46ce24de03a773e"
May 28 09:33:15.481697 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:33:15.481671    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8cbf31139164324223361c17349a5b7e0ab83a93ec2b446df46ce24de03a773e\": container with ID starting with 8cbf31139164324223361c17349a5b7e0ab83a93ec2b446df46ce24de03a773e not found: ID does not exist" containerID="8cbf31139164324223361c17349a5b7e0ab83a93ec2b446df46ce24de03a773e"
May 28 09:33:15.481783 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:15.481706    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cbf31139164324223361c17349a5b7e0ab83a93ec2b446df46ce24de03a773e"} err="failed to get container status \"8cbf31139164324223361c17349a5b7e0ab83a93ec2b446df46ce24de03a773e\": rpc error: code = NotFound desc = could not find container \"8cbf31139164324223361c17349a5b7e0ab83a93ec2b446df46ce24de03a773e\": container with ID starting with 8cbf31139164324223361c17349a5b7e0ab83a93ec2b446df46ce24de03a773e not found: ID does not exist"
May 28 09:33:15.494554 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:15.494528    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-557f76c968-zbdf8"]
May 28 09:33:15.499490 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:15.499469    2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-557f76c968-zbdf8"]
May 28 09:33:15.920388 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:15.920355    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="488a4f27-9c0f-401b-95a3-0998d9ed7b70" path="/var/lib/kubelet/pods/488a4f27-9c0f-401b-95a3-0998d9ed7b70/volumes"
May 28 09:33:21.699613 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:21.699583    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-688b957f56-g6k8j"
May 28 09:33:21.703568 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:21.703541    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-688b957f56-g6k8j"
May 28 09:33:23.505674 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:23.505595    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-6c544f5446-2b9dd" podUID="c268d352-6650-4d76-8b97-86b050f3c6d4" containerName="console" containerID="cri-o://cd072debf0977c70e176ed903d3a029da1f4cd903148d8abb5024c8be755fc9c" gracePeriod=15
May 28 09:33:23.837442 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:23.837409    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6c544f5446-2b9dd_c268d352-6650-4d76-8b97-86b050f3c6d4/console/0.log"
May 28 09:33:23.837573 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:23.837508    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c544f5446-2b9dd"
May 28 09:33:23.903337 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:23.903299    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c268d352-6650-4d76-8b97-86b050f3c6d4-console-config\") pod \"c268d352-6650-4d76-8b97-86b050f3c6d4\" (UID: \"c268d352-6650-4d76-8b97-86b050f3c6d4\") "
May 28 09:33:23.903523 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:23.903356    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c268d352-6650-4d76-8b97-86b050f3c6d4-service-ca\") pod \"c268d352-6650-4d76-8b97-86b050f3c6d4\" (UID: \"c268d352-6650-4d76-8b97-86b050f3c6d4\") "
May 28 09:33:23.903523 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:23.903406    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c268d352-6650-4d76-8b97-86b050f3c6d4-console-serving-cert\") pod \"c268d352-6650-4d76-8b97-86b050f3c6d4\" (UID: \"c268d352-6650-4d76-8b97-86b050f3c6d4\") "
May 28 09:33:23.903523 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:23.903481    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c268d352-6650-4d76-8b97-86b050f3c6d4-oauth-serving-cert\") pod \"c268d352-6650-4d76-8b97-86b050f3c6d4\" (UID: \"c268d352-6650-4d76-8b97-86b050f3c6d4\") "
May 28 09:33:23.903523 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:23.903507    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c268d352-6650-4d76-8b97-86b050f3c6d4-console-oauth-config\") pod \"c268d352-6650-4d76-8b97-86b050f3c6d4\" (UID: \"c268d352-6650-4d76-8b97-86b050f3c6d4\") "
May 28 09:33:23.903723 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:23.903547    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j2p4k\" (UniqueName: \"kubernetes.io/projected/c268d352-6650-4d76-8b97-86b050f3c6d4-kube-api-access-j2p4k\") pod \"c268d352-6650-4d76-8b97-86b050f3c6d4\" (UID: \"c268d352-6650-4d76-8b97-86b050f3c6d4\") "
May 28 09:33:23.903782 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:23.903739    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c268d352-6650-4d76-8b97-86b050f3c6d4-service-ca" (OuterVolumeSpecName: "service-ca") pod "c268d352-6650-4d76-8b97-86b050f3c6d4" (UID: "c268d352-6650-4d76-8b97-86b050f3c6d4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 09:33:23.903834 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:23.903817    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c268d352-6650-4d76-8b97-86b050f3c6d4-console-config" (OuterVolumeSpecName: "console-config") pod "c268d352-6650-4d76-8b97-86b050f3c6d4" (UID: "c268d352-6650-4d76-8b97-86b050f3c6d4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 09:33:23.903888 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:23.903858    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c268d352-6650-4d76-8b97-86b050f3c6d4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c268d352-6650-4d76-8b97-86b050f3c6d4" (UID: "c268d352-6650-4d76-8b97-86b050f3c6d4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 09:33:23.905839 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:23.905806    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c268d352-6650-4d76-8b97-86b050f3c6d4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c268d352-6650-4d76-8b97-86b050f3c6d4" (UID: "c268d352-6650-4d76-8b97-86b050f3c6d4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:33:23.905966 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:23.905892    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c268d352-6650-4d76-8b97-86b050f3c6d4-kube-api-access-j2p4k" (OuterVolumeSpecName: "kube-api-access-j2p4k") pod "c268d352-6650-4d76-8b97-86b050f3c6d4" (UID: "c268d352-6650-4d76-8b97-86b050f3c6d4"). InnerVolumeSpecName "kube-api-access-j2p4k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 09:33:23.905966 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:23.905897    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c268d352-6650-4d76-8b97-86b050f3c6d4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c268d352-6650-4d76-8b97-86b050f3c6d4" (UID: "c268d352-6650-4d76-8b97-86b050f3c6d4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:33:24.005173 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:24.005137    2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c268d352-6650-4d76-8b97-86b050f3c6d4-console-oauth-config\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:33:24.005173 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:24.005170    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j2p4k\" (UniqueName: \"kubernetes.io/projected/c268d352-6650-4d76-8b97-86b050f3c6d4-kube-api-access-j2p4k\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:33:24.005173 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:24.005181    2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c268d352-6650-4d76-8b97-86b050f3c6d4-console-config\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:33:24.005407 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:24.005191    2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c268d352-6650-4d76-8b97-86b050f3c6d4-service-ca\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:33:24.005407 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:24.005199    2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c268d352-6650-4d76-8b97-86b050f3c6d4-console-serving-cert\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:33:24.005407 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:24.005212    2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c268d352-6650-4d76-8b97-86b050f3c6d4-oauth-serving-cert\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:33:24.509753 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:24.509727    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6c544f5446-2b9dd_c268d352-6650-4d76-8b97-86b050f3c6d4/console/0.log"
May 28 09:33:24.510251 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:24.509765    2572 generic.go:358] "Generic (PLEG): container finished" podID="c268d352-6650-4d76-8b97-86b050f3c6d4" containerID="cd072debf0977c70e176ed903d3a029da1f4cd903148d8abb5024c8be755fc9c" exitCode=2
May 28 09:33:24.510251 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:24.509813    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c544f5446-2b9dd" event={"ID":"c268d352-6650-4d76-8b97-86b050f3c6d4","Type":"ContainerDied","Data":"cd072debf0977c70e176ed903d3a029da1f4cd903148d8abb5024c8be755fc9c"}
May 28 09:33:24.510251 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:24.509837    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c544f5446-2b9dd"
May 28 09:33:24.510251 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:24.509852    2572 scope.go:117] "RemoveContainer" containerID="cd072debf0977c70e176ed903d3a029da1f4cd903148d8abb5024c8be755fc9c"
May 28 09:33:24.510251 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:24.509841    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c544f5446-2b9dd" event={"ID":"c268d352-6650-4d76-8b97-86b050f3c6d4","Type":"ContainerDied","Data":"c663a35e5875234b56cf12ed605f1ea9cf7b6f900d3b33ceaf34513ae29a1709"}
May 28 09:33:24.517946 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:24.517921    2572 scope.go:117] "RemoveContainer" containerID="cd072debf0977c70e176ed903d3a029da1f4cd903148d8abb5024c8be755fc9c"
May 28 09:33:24.518283 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:33:24.518260    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd072debf0977c70e176ed903d3a029da1f4cd903148d8abb5024c8be755fc9c\": container with ID starting with cd072debf0977c70e176ed903d3a029da1f4cd903148d8abb5024c8be755fc9c not found: ID does not exist" containerID="cd072debf0977c70e176ed903d3a029da1f4cd903148d8abb5024c8be755fc9c"
May 28 09:33:24.518360 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:24.518291    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd072debf0977c70e176ed903d3a029da1f4cd903148d8abb5024c8be755fc9c"} err="failed to get container status \"cd072debf0977c70e176ed903d3a029da1f4cd903148d8abb5024c8be755fc9c\": rpc error: code = NotFound desc = could not find container \"cd072debf0977c70e176ed903d3a029da1f4cd903148d8abb5024c8be755fc9c\": container with ID starting with cd072debf0977c70e176ed903d3a029da1f4cd903148d8abb5024c8be755fc9c not found: ID does not exist"
May 28 09:33:24.529448 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:24.529422    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c544f5446-2b9dd"]
May 28 09:33:24.534892 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:24.534865    2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6c544f5446-2b9dd"]
May 28 09:33:25.920249 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:25.920217    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c268d352-6650-4d76-8b97-86b050f3c6d4" path="/var/lib/kubelet/pods/c268d352-6650-4d76-8b97-86b050f3c6d4/volumes"
May 28 09:33:43.622170 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:43.622129    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:33:43.642603 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:43.642570    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:33:44.590428 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:33:44.590398    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:01.674206 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:01.674112    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 09:34:01.674998 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:01.674782    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b1f30324-a53c-449a-9cff-c44d3146c49c" containerName="prometheus" containerID="cri-o://9cdf0d080c7692aa36007cc6c6fb2661e4208ac4aa71b92b035b38543d5af686" gracePeriod=600
May 28 09:34:01.674998 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:01.674827    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b1f30324-a53c-449a-9cff-c44d3146c49c" containerName="kube-rbac-proxy-web" containerID="cri-o://3e2f1bdab40529134e6e9f151e7c277a96b0d0866af15265a5e90f3b0d1e4816" gracePeriod=600
May 28 09:34:01.674998 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:01.674852    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b1f30324-a53c-449a-9cff-c44d3146c49c" containerName="config-reloader" containerID="cri-o://4f1738681ea55098791c111495857856056c2e85f348bcfb9890e21199ea700d" gracePeriod=600
May 28 09:34:01.674998 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:01.674836    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b1f30324-a53c-449a-9cff-c44d3146c49c" containerName="kube-rbac-proxy-thanos" containerID="cri-o://0c49bccb696037a068cfd6656a7df2b6edb00013c006820c6da42aecf510fc13" gracePeriod=600
May 28 09:34:01.674998 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:01.674827    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b1f30324-a53c-449a-9cff-c44d3146c49c" containerName="thanos-sidecar" containerID="cri-o://29fc6307e4826ec011bc287ac3e3e07004ead76663efc5d9238e2e55f5114649" gracePeriod=600
May 28 09:34:01.674998 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:01.674796    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b1f30324-a53c-449a-9cff-c44d3146c49c" containerName="kube-rbac-proxy" containerID="cri-o://3cb1911a911dacbc2682231de9cea6b2da61606f45784689a29b24ecff5c3ada" gracePeriod=600
May 28 09:34:01.930100 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:01.930037    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:02.018433 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.018386    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b1f30324-a53c-449a-9cff-c44d3146c49c-thanos-prometheus-http-client-file\") pod \"b1f30324-a53c-449a-9cff-c44d3146c49c\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") "
May 28 09:34:02.018625 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.018446    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b1f30324-a53c-449a-9cff-c44d3146c49c-secret-prometheus-k8s-tls\") pod \"b1f30324-a53c-449a-9cff-c44d3146c49c\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") "
May 28 09:34:02.018625 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.018485    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b1f30324-a53c-449a-9cff-c44d3146c49c-prometheus-k8s-db\") pod \"b1f30324-a53c-449a-9cff-c44d3146c49c\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") "
May 28 09:34:02.018625 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.018539    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b1f30324-a53c-449a-9cff-c44d3146c49c-secret-metrics-client-certs\") pod \"b1f30324-a53c-449a-9cff-c44d3146c49c\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") "
May 28 09:34:02.018625 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.018566    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b1f30324-a53c-449a-9cff-c44d3146c49c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"b1f30324-a53c-449a-9cff-c44d3146c49c\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") "
May 28 09:34:02.018625 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.018594    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b1f30324-a53c-449a-9cff-c44d3146c49c-tls-assets\") pod \"b1f30324-a53c-449a-9cff-c44d3146c49c\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") "
May 28 09:34:02.018625 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.018625    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1f30324-a53c-449a-9cff-c44d3146c49c-configmap-serving-certs-ca-bundle\") pod \"b1f30324-a53c-449a-9cff-c44d3146c49c\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") "
May 28 09:34:02.018926 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.018655    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b1f30324-a53c-449a-9cff-c44d3146c49c-config-out\") pod \"b1f30324-a53c-449a-9cff-c44d3146c49c\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") "
May 28 09:34:02.018926 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.018682    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b1f30324-a53c-449a-9cff-c44d3146c49c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"b1f30324-a53c-449a-9cff-c44d3146c49c\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") "
May 28 09:34:02.018926 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.018723    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b1f30324-a53c-449a-9cff-c44d3146c49c-secret-grpc-tls\") pod \"b1f30324-a53c-449a-9cff-c44d3146c49c\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") "
May 28 09:34:02.018926 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.018757    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b1f30324-a53c-449a-9cff-c44d3146c49c-configmap-metrics-client-ca\") pod \"b1f30324-a53c-449a-9cff-c44d3146c49c\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") "
May 28 09:34:02.018926 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.018793    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b1f30324-a53c-449a-9cff-c44d3146c49c-secret-kube-rbac-proxy\") pod \"b1f30324-a53c-449a-9cff-c44d3146c49c\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") "
May 28 09:34:02.018926 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.018833    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1f30324-a53c-449a-9cff-c44d3146c49c-prometheus-trusted-ca-bundle\") pod \"b1f30324-a53c-449a-9cff-c44d3146c49c\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") "
May 28 09:34:02.018926 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.018863    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r9mqh\" (UniqueName: \"kubernetes.io/projected/b1f30324-a53c-449a-9cff-c44d3146c49c-kube-api-access-r9mqh\") pod \"b1f30324-a53c-449a-9cff-c44d3146c49c\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") "
May 28 09:34:02.018926 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.018888    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1f30324-a53c-449a-9cff-c44d3146c49c-configmap-kubelet-serving-ca-bundle\") pod \"b1f30324-a53c-449a-9cff-c44d3146c49c\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") "
May 28 09:34:02.019373 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.018944    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b1f30324-a53c-449a-9cff-c44d3146c49c-prometheus-k8s-rulefiles-0\") pod \"b1f30324-a53c-449a-9cff-c44d3146c49c\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") "
May 28 09:34:02.019373 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.019014    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b1f30324-a53c-449a-9cff-c44d3146c49c-web-config\") pod \"b1f30324-a53c-449a-9cff-c44d3146c49c\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") "
May 28 09:34:02.019373 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.019043    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b1f30324-a53c-449a-9cff-c44d3146c49c-config\") pod \"b1f30324-a53c-449a-9cff-c44d3146c49c\" (UID: \"b1f30324-a53c-449a-9cff-c44d3146c49c\") "
May 28 09:34:02.023150 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.020771    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1f30324-a53c-449a-9cff-c44d3146c49c-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "b1f30324-a53c-449a-9cff-c44d3146c49c" (UID: "b1f30324-a53c-449a-9cff-c44d3146c49c"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 09:34:02.023150 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.021495    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1f30324-a53c-449a-9cff-c44d3146c49c-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "b1f30324-a53c-449a-9cff-c44d3146c49c" (UID: "b1f30324-a53c-449a-9cff-c44d3146c49c"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 09:34:02.023150 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.019630    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1f30324-a53c-449a-9cff-c44d3146c49c-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "b1f30324-a53c-449a-9cff-c44d3146c49c" (UID: "b1f30324-a53c-449a-9cff-c44d3146c49c"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 09:34:02.023150 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.022280    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1f30324-a53c-449a-9cff-c44d3146c49c-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "b1f30324-a53c-449a-9cff-c44d3146c49c" (UID: "b1f30324-a53c-449a-9cff-c44d3146c49c"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:34:02.023150 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.022282    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1f30324-a53c-449a-9cff-c44d3146c49c-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "b1f30324-a53c-449a-9cff-c44d3146c49c" (UID: "b1f30324-a53c-449a-9cff-c44d3146c49c"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:34:02.023150 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.022373    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1f30324-a53c-449a-9cff-c44d3146c49c-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "b1f30324-a53c-449a-9cff-c44d3146c49c" (UID: "b1f30324-a53c-449a-9cff-c44d3146c49c"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:34:02.023150 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.022846    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1f30324-a53c-449a-9cff-c44d3146c49c-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "b1f30324-a53c-449a-9cff-c44d3146c49c" (UID: "b1f30324-a53c-449a-9cff-c44d3146c49c"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 09:34:02.023150 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.023040    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1f30324-a53c-449a-9cff-c44d3146c49c-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "b1f30324-a53c-449a-9cff-c44d3146c49c" (UID: "b1f30324-a53c-449a-9cff-c44d3146c49c"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 09:34:02.028002 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.024294    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1f30324-a53c-449a-9cff-c44d3146c49c-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "b1f30324-a53c-449a-9cff-c44d3146c49c" (UID: "b1f30324-a53c-449a-9cff-c44d3146c49c"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 09:34:02.028002 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.024612    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1f30324-a53c-449a-9cff-c44d3146c49c-config" (OuterVolumeSpecName: "config") pod "b1f30324-a53c-449a-9cff-c44d3146c49c" (UID: "b1f30324-a53c-449a-9cff-c44d3146c49c"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:34:02.028002 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.026011    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1f30324-a53c-449a-9cff-c44d3146c49c-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "b1f30324-a53c-449a-9cff-c44d3146c49c" (UID: "b1f30324-a53c-449a-9cff-c44d3146c49c"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 09:34:02.028002 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.027961    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1f30324-a53c-449a-9cff-c44d3146c49c-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "b1f30324-a53c-449a-9cff-c44d3146c49c" (UID: "b1f30324-a53c-449a-9cff-c44d3146c49c"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:34:02.028350 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.028322    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1f30324-a53c-449a-9cff-c44d3146c49c-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "b1f30324-a53c-449a-9cff-c44d3146c49c" (UID: "b1f30324-a53c-449a-9cff-c44d3146c49c"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:34:02.028673 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.028638    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1f30324-a53c-449a-9cff-c44d3146c49c-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "b1f30324-a53c-449a-9cff-c44d3146c49c" (UID: "b1f30324-a53c-449a-9cff-c44d3146c49c"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:34:02.029251 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.028878    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1f30324-a53c-449a-9cff-c44d3146c49c-kube-api-access-r9mqh" (OuterVolumeSpecName: "kube-api-access-r9mqh") pod "b1f30324-a53c-449a-9cff-c44d3146c49c" (UID: "b1f30324-a53c-449a-9cff-c44d3146c49c"). InnerVolumeSpecName "kube-api-access-r9mqh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 09:34:02.029754 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.029727    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1f30324-a53c-449a-9cff-c44d3146c49c-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "b1f30324-a53c-449a-9cff-c44d3146c49c" (UID: "b1f30324-a53c-449a-9cff-c44d3146c49c"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:34:02.029917 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.029896    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1f30324-a53c-449a-9cff-c44d3146c49c-config-out" (OuterVolumeSpecName: "config-out") pod "b1f30324-a53c-449a-9cff-c44d3146c49c" (UID: "b1f30324-a53c-449a-9cff-c44d3146c49c"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 09:34:02.040027 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.039998    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1f30324-a53c-449a-9cff-c44d3146c49c-web-config" (OuterVolumeSpecName: "web-config") pod "b1f30324-a53c-449a-9cff-c44d3146c49c" (UID: "b1f30324-a53c-449a-9cff-c44d3146c49c"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:34:02.119839 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.119800    2572 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b1f30324-a53c-449a-9cff-c44d3146c49c-secret-metrics-client-certs\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:34:02.119839 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.119832    2572 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b1f30324-a53c-449a-9cff-c44d3146c49c-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:34:02.119839 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.119845    2572 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b1f30324-a53c-449a-9cff-c44d3146c49c-tls-assets\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:34:02.120121 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.119855    2572 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1f30324-a53c-449a-9cff-c44d3146c49c-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:34:02.120121 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.119866    2572 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b1f30324-a53c-449a-9cff-c44d3146c49c-config-out\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:34:02.120121 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.119875    2572 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b1f30324-a53c-449a-9cff-c44d3146c49c-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:34:02.120121 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.119883    2572 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b1f30324-a53c-449a-9cff-c44d3146c49c-secret-grpc-tls\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:34:02.120121 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.119893    2572 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b1f30324-a53c-449a-9cff-c44d3146c49c-configmap-metrics-client-ca\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:34:02.120121 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.119901    2572 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b1f30324-a53c-449a-9cff-c44d3146c49c-secret-kube-rbac-proxy\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:34:02.120121 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.119910    2572 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1f30324-a53c-449a-9cff-c44d3146c49c-prometheus-trusted-ca-bundle\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:34:02.120121 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.119919    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r9mqh\" (UniqueName: \"kubernetes.io/projected/b1f30324-a53c-449a-9cff-c44d3146c49c-kube-api-access-r9mqh\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:34:02.120121 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.119928    2572 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1f30324-a53c-449a-9cff-c44d3146c49c-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:34:02.120121 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.119937    2572 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b1f30324-a53c-449a-9cff-c44d3146c49c-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:34:02.120121 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.119946    2572 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b1f30324-a53c-449a-9cff-c44d3146c49c-web-config\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:34:02.120121 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.119955    2572 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/b1f30324-a53c-449a-9cff-c44d3146c49c-config\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:34:02.120121 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.119963    2572 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b1f30324-a53c-449a-9cff-c44d3146c49c-thanos-prometheus-http-client-file\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:34:02.120121 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.120004    2572 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b1f30324-a53c-449a-9cff-c44d3146c49c-secret-prometheus-k8s-tls\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:34:02.120121 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.120014    2572 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b1f30324-a53c-449a-9cff-c44d3146c49c-prometheus-k8s-db\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:34:02.628073 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.628034    2572 generic.go:358] "Generic (PLEG): container finished" podID="b1f30324-a53c-449a-9cff-c44d3146c49c" containerID="0c49bccb696037a068cfd6656a7df2b6edb00013c006820c6da42aecf510fc13" exitCode=0
May 28 09:34:02.628073 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.628068    2572 generic.go:358] "Generic (PLEG): container finished" podID="b1f30324-a53c-449a-9cff-c44d3146c49c" containerID="3cb1911a911dacbc2682231de9cea6b2da61606f45784689a29b24ecff5c3ada" exitCode=0
May 28 09:34:02.628073 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.628074    2572 generic.go:358] "Generic (PLEG): container finished" podID="b1f30324-a53c-449a-9cff-c44d3146c49c" containerID="3e2f1bdab40529134e6e9f151e7c277a96b0d0866af15265a5e90f3b0d1e4816" exitCode=0
May 28 09:34:02.628073 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.628080    2572 generic.go:358] "Generic (PLEG): container finished" podID="b1f30324-a53c-449a-9cff-c44d3146c49c" containerID="29fc6307e4826ec011bc287ac3e3e07004ead76663efc5d9238e2e55f5114649" exitCode=0
May 28 09:34:02.628346 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.628087    2572 generic.go:358] "Generic (PLEG): container finished" podID="b1f30324-a53c-449a-9cff-c44d3146c49c" containerID="4f1738681ea55098791c111495857856056c2e85f348bcfb9890e21199ea700d" exitCode=0
May 28 09:34:02.628346 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.628093    2572 generic.go:358] "Generic (PLEG): container finished" podID="b1f30324-a53c-449a-9cff-c44d3146c49c" containerID="9cdf0d080c7692aa36007cc6c6fb2661e4208ac4aa71b92b035b38543d5af686" exitCode=0
May 28 09:34:02.628346 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.628124    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1f30324-a53c-449a-9cff-c44d3146c49c","Type":"ContainerDied","Data":"0c49bccb696037a068cfd6656a7df2b6edb00013c006820c6da42aecf510fc13"}
May 28 09:34:02.628346 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.628162    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:02.628346 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.628176    2572 scope.go:117] "RemoveContainer" containerID="0c49bccb696037a068cfd6656a7df2b6edb00013c006820c6da42aecf510fc13"
May 28 09:34:02.628346 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.628165    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1f30324-a53c-449a-9cff-c44d3146c49c","Type":"ContainerDied","Data":"3cb1911a911dacbc2682231de9cea6b2da61606f45784689a29b24ecff5c3ada"}
May 28 09:34:02.628568 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.628355    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1f30324-a53c-449a-9cff-c44d3146c49c","Type":"ContainerDied","Data":"3e2f1bdab40529134e6e9f151e7c277a96b0d0866af15265a5e90f3b0d1e4816"}
May 28 09:34:02.628568 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.628377    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1f30324-a53c-449a-9cff-c44d3146c49c","Type":"ContainerDied","Data":"29fc6307e4826ec011bc287ac3e3e07004ead76663efc5d9238e2e55f5114649"}
May 28 09:34:02.628568 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.628393    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1f30324-a53c-449a-9cff-c44d3146c49c","Type":"ContainerDied","Data":"4f1738681ea55098791c111495857856056c2e85f348bcfb9890e21199ea700d"}
May 28 09:34:02.628568 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.628408    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1f30324-a53c-449a-9cff-c44d3146c49c","Type":"ContainerDied","Data":"9cdf0d080c7692aa36007cc6c6fb2661e4208ac4aa71b92b035b38543d5af686"}
May 28 09:34:02.628568 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.628422    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1f30324-a53c-449a-9cff-c44d3146c49c","Type":"ContainerDied","Data":"56473c704a8b3c78f4b8bae9d7630531a2092508355750878a0011d631164684"}
May 28 09:34:02.635725 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.635701    2572 scope.go:117] "RemoveContainer" containerID="3cb1911a911dacbc2682231de9cea6b2da61606f45784689a29b24ecff5c3ada"
May 28 09:34:02.643088 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.643072    2572 scope.go:117] "RemoveContainer" containerID="3e2f1bdab40529134e6e9f151e7c277a96b0d0866af15265a5e90f3b0d1e4816"
May 28 09:34:02.649836 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.649813    2572 scope.go:117] "RemoveContainer" containerID="29fc6307e4826ec011bc287ac3e3e07004ead76663efc5d9238e2e55f5114649"
May 28 09:34:02.653573 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.653548    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 09:34:02.657076 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.657056    2572 scope.go:117] "RemoveContainer" containerID="4f1738681ea55098791c111495857856056c2e85f348bcfb9890e21199ea700d"
May 28 09:34:02.660338 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.660317    2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 09:34:02.666224 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.666201    2572 scope.go:117] "RemoveContainer" containerID="9cdf0d080c7692aa36007cc6c6fb2661e4208ac4aa71b92b035b38543d5af686"
May 28 09:34:02.673383 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.673365    2572 scope.go:117] "RemoveContainer" containerID="c387c9ad1d4716c5988e9d6d716dd9b0e990843dffe04ddda2485e1798f9f573"
May 28 09:34:02.680225 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.680110    2572 scope.go:117] "RemoveContainer" containerID="0c49bccb696037a068cfd6656a7df2b6edb00013c006820c6da42aecf510fc13"
May 28 09:34:02.680444 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:34:02.680379    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c49bccb696037a068cfd6656a7df2b6edb00013c006820c6da42aecf510fc13\": container with ID starting with 0c49bccb696037a068cfd6656a7df2b6edb00013c006820c6da42aecf510fc13 not found: ID does not exist" containerID="0c49bccb696037a068cfd6656a7df2b6edb00013c006820c6da42aecf510fc13"
May 28 09:34:02.680444 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.680402    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c49bccb696037a068cfd6656a7df2b6edb00013c006820c6da42aecf510fc13"} err="failed to get container status \"0c49bccb696037a068cfd6656a7df2b6edb00013c006820c6da42aecf510fc13\": rpc error: code = NotFound desc = could not find container \"0c49bccb696037a068cfd6656a7df2b6edb00013c006820c6da42aecf510fc13\": container with ID starting with 0c49bccb696037a068cfd6656a7df2b6edb00013c006820c6da42aecf510fc13 not found: ID does not exist"
May 28 09:34:02.680444 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.680421    2572 scope.go:117] "RemoveContainer" containerID="3cb1911a911dacbc2682231de9cea6b2da61606f45784689a29b24ecff5c3ada"
May 28 09:34:02.680649 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:34:02.680629    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3cb1911a911dacbc2682231de9cea6b2da61606f45784689a29b24ecff5c3ada\": container with ID starting with 3cb1911a911dacbc2682231de9cea6b2da61606f45784689a29b24ecff5c3ada not found: ID does not exist" containerID="3cb1911a911dacbc2682231de9cea6b2da61606f45784689a29b24ecff5c3ada"
May 28 09:34:02.680684 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.680657    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cb1911a911dacbc2682231de9cea6b2da61606f45784689a29b24ecff5c3ada"} err="failed to get container status \"3cb1911a911dacbc2682231de9cea6b2da61606f45784689a29b24ecff5c3ada\": rpc error: code = NotFound desc = could not find container \"3cb1911a911dacbc2682231de9cea6b2da61606f45784689a29b24ecff5c3ada\": container with ID starting with 3cb1911a911dacbc2682231de9cea6b2da61606f45784689a29b24ecff5c3ada not found: ID does not exist"
May 28 09:34:02.680684 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.680676    2572 scope.go:117] "RemoveContainer" containerID="3e2f1bdab40529134e6e9f151e7c277a96b0d0866af15265a5e90f3b0d1e4816"
May 28 09:34:02.680886 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:34:02.680871    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e2f1bdab40529134e6e9f151e7c277a96b0d0866af15265a5e90f3b0d1e4816\": container with ID starting with 3e2f1bdab40529134e6e9f151e7c277a96b0d0866af15265a5e90f3b0d1e4816 not found: ID does not exist" containerID="3e2f1bdab40529134e6e9f151e7c277a96b0d0866af15265a5e90f3b0d1e4816"
May 28 09:34:02.680928 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.680890    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e2f1bdab40529134e6e9f151e7c277a96b0d0866af15265a5e90f3b0d1e4816"} err="failed to get container status \"3e2f1bdab40529134e6e9f151e7c277a96b0d0866af15265a5e90f3b0d1e4816\": rpc error: code = NotFound desc = could not find container \"3e2f1bdab40529134e6e9f151e7c277a96b0d0866af15265a5e90f3b0d1e4816\": container with ID starting with 3e2f1bdab40529134e6e9f151e7c277a96b0d0866af15265a5e90f3b0d1e4816 not found: ID does not exist"
May 28 09:34:02.680928 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.680904    2572 scope.go:117] "RemoveContainer" containerID="29fc6307e4826ec011bc287ac3e3e07004ead76663efc5d9238e2e55f5114649"
May 28 09:34:02.681083 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:34:02.681068    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29fc6307e4826ec011bc287ac3e3e07004ead76663efc5d9238e2e55f5114649\": container with ID starting with 29fc6307e4826ec011bc287ac3e3e07004ead76663efc5d9238e2e55f5114649 not found: ID does not exist" containerID="29fc6307e4826ec011bc287ac3e3e07004ead76663efc5d9238e2e55f5114649"
May 28 09:34:02.681124 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.681086    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29fc6307e4826ec011bc287ac3e3e07004ead76663efc5d9238e2e55f5114649"} err="failed to get container status \"29fc6307e4826ec011bc287ac3e3e07004ead76663efc5d9238e2e55f5114649\": rpc error: code = NotFound desc = could not find container \"29fc6307e4826ec011bc287ac3e3e07004ead76663efc5d9238e2e55f5114649\": container with ID starting with 29fc6307e4826ec011bc287ac3e3e07004ead76663efc5d9238e2e55f5114649 not found: ID does not exist"
May 28 09:34:02.681124 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.681099    2572 scope.go:117] "RemoveContainer" containerID="4f1738681ea55098791c111495857856056c2e85f348bcfb9890e21199ea700d"
May 28 09:34:02.681258 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:34:02.681243    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f1738681ea55098791c111495857856056c2e85f348bcfb9890e21199ea700d\": container with ID starting with 4f1738681ea55098791c111495857856056c2e85f348bcfb9890e21199ea700d not found: ID does not exist" containerID="4f1738681ea55098791c111495857856056c2e85f348bcfb9890e21199ea700d"
May 28 09:34:02.681294 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.681259    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f1738681ea55098791c111495857856056c2e85f348bcfb9890e21199ea700d"} err="failed to get container status \"4f1738681ea55098791c111495857856056c2e85f348bcfb9890e21199ea700d\": rpc error: code = NotFound desc = could not find container \"4f1738681ea55098791c111495857856056c2e85f348bcfb9890e21199ea700d\": container with ID starting with 4f1738681ea55098791c111495857856056c2e85f348bcfb9890e21199ea700d not found: ID does not exist"
May 28 09:34:02.681294 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.681270    2572 scope.go:117] "RemoveContainer" containerID="9cdf0d080c7692aa36007cc6c6fb2661e4208ac4aa71b92b035b38543d5af686"
May 28 09:34:02.681440 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:34:02.681426    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9cdf0d080c7692aa36007cc6c6fb2661e4208ac4aa71b92b035b38543d5af686\": container with ID starting with 9cdf0d080c7692aa36007cc6c6fb2661e4208ac4aa71b92b035b38543d5af686 not found: ID does not exist" containerID="9cdf0d080c7692aa36007cc6c6fb2661e4208ac4aa71b92b035b38543d5af686"
May 28 09:34:02.681478 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.681443    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cdf0d080c7692aa36007cc6c6fb2661e4208ac4aa71b92b035b38543d5af686"} err="failed to get container status \"9cdf0d080c7692aa36007cc6c6fb2661e4208ac4aa71b92b035b38543d5af686\": rpc error: code = NotFound desc = could not find container \"9cdf0d080c7692aa36007cc6c6fb2661e4208ac4aa71b92b035b38543d5af686\": container with ID starting with 9cdf0d080c7692aa36007cc6c6fb2661e4208ac4aa71b92b035b38543d5af686 not found: ID does not exist"
May 28 09:34:02.681478 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.681455    2572 scope.go:117] "RemoveContainer" containerID="c387c9ad1d4716c5988e9d6d716dd9b0e990843dffe04ddda2485e1798f9f573"
May 28 09:34:02.681635 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:34:02.681621    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c387c9ad1d4716c5988e9d6d716dd9b0e990843dffe04ddda2485e1798f9f573\": container with ID starting with c387c9ad1d4716c5988e9d6d716dd9b0e990843dffe04ddda2485e1798f9f573 not found: ID does not exist" containerID="c387c9ad1d4716c5988e9d6d716dd9b0e990843dffe04ddda2485e1798f9f573"
May 28 09:34:02.681680 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.681637    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c387c9ad1d4716c5988e9d6d716dd9b0e990843dffe04ddda2485e1798f9f573"} err="failed to get container status \"c387c9ad1d4716c5988e9d6d716dd9b0e990843dffe04ddda2485e1798f9f573\": rpc error: code = NotFound desc = could not find container \"c387c9ad1d4716c5988e9d6d716dd9b0e990843dffe04ddda2485e1798f9f573\": container with ID starting with c387c9ad1d4716c5988e9d6d716dd9b0e990843dffe04ddda2485e1798f9f573 not found: ID does not exist"
May 28 09:34:02.681680 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.681649    2572 scope.go:117] "RemoveContainer" containerID="0c49bccb696037a068cfd6656a7df2b6edb00013c006820c6da42aecf510fc13"
May 28 09:34:02.681807 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.681793    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c49bccb696037a068cfd6656a7df2b6edb00013c006820c6da42aecf510fc13"} err="failed to get container status \"0c49bccb696037a068cfd6656a7df2b6edb00013c006820c6da42aecf510fc13\": rpc error: code = NotFound desc = could not find container \"0c49bccb696037a068cfd6656a7df2b6edb00013c006820c6da42aecf510fc13\": container with ID starting with 0c49bccb696037a068cfd6656a7df2b6edb00013c006820c6da42aecf510fc13 not found: ID does not exist"
May 28 09:34:02.681850 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.681808    2572 scope.go:117] "RemoveContainer" containerID="3cb1911a911dacbc2682231de9cea6b2da61606f45784689a29b24ecff5c3ada"
May 28 09:34:02.682035 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.682018    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cb1911a911dacbc2682231de9cea6b2da61606f45784689a29b24ecff5c3ada"} err="failed to get container status \"3cb1911a911dacbc2682231de9cea6b2da61606f45784689a29b24ecff5c3ada\": rpc error: code = NotFound desc = could not find container \"3cb1911a911dacbc2682231de9cea6b2da61606f45784689a29b24ecff5c3ada\": container with ID starting with 3cb1911a911dacbc2682231de9cea6b2da61606f45784689a29b24ecff5c3ada not found: ID does not exist"
May 28 09:34:02.682089 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.682036    2572 scope.go:117] "RemoveContainer" containerID="3e2f1bdab40529134e6e9f151e7c277a96b0d0866af15265a5e90f3b0d1e4816"
May 28 09:34:02.682245 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.682227    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e2f1bdab40529134e6e9f151e7c277a96b0d0866af15265a5e90f3b0d1e4816"} err="failed to get container status \"3e2f1bdab40529134e6e9f151e7c277a96b0d0866af15265a5e90f3b0d1e4816\": rpc error: code = NotFound desc = could not find container \"3e2f1bdab40529134e6e9f151e7c277a96b0d0866af15265a5e90f3b0d1e4816\": container with ID starting with 3e2f1bdab40529134e6e9f151e7c277a96b0d0866af15265a5e90f3b0d1e4816 not found: ID does not exist"
May 28 09:34:02.682287 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.682246    2572 scope.go:117] "RemoveContainer" containerID="29fc6307e4826ec011bc287ac3e3e07004ead76663efc5d9238e2e55f5114649"
May 28 09:34:02.682421 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.682406    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29fc6307e4826ec011bc287ac3e3e07004ead76663efc5d9238e2e55f5114649"} err="failed to get container status \"29fc6307e4826ec011bc287ac3e3e07004ead76663efc5d9238e2e55f5114649\": rpc error: code = NotFound desc = could not find container \"29fc6307e4826ec011bc287ac3e3e07004ead76663efc5d9238e2e55f5114649\": container with ID starting with 29fc6307e4826ec011bc287ac3e3e07004ead76663efc5d9238e2e55f5114649 not found: ID does not exist"
May 28 09:34:02.682462 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.682421    2572 scope.go:117] "RemoveContainer" containerID="4f1738681ea55098791c111495857856056c2e85f348bcfb9890e21199ea700d"
May 28 09:34:02.682605 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.682592    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f1738681ea55098791c111495857856056c2e85f348bcfb9890e21199ea700d"} err="failed to get container status \"4f1738681ea55098791c111495857856056c2e85f348bcfb9890e21199ea700d\": rpc error: code = NotFound desc = could not find container \"4f1738681ea55098791c111495857856056c2e85f348bcfb9890e21199ea700d\": container with ID starting with 4f1738681ea55098791c111495857856056c2e85f348bcfb9890e21199ea700d not found: ID does not exist"
May 28 09:34:02.682641 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.682606    2572 scope.go:117] "RemoveContainer" containerID="9cdf0d080c7692aa36007cc6c6fb2661e4208ac4aa71b92b035b38543d5af686"
May 28 09:34:02.682779 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.682765    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cdf0d080c7692aa36007cc6c6fb2661e4208ac4aa71b92b035b38543d5af686"} err="failed to get container status \"9cdf0d080c7692aa36007cc6c6fb2661e4208ac4aa71b92b035b38543d5af686\": rpc error: code = NotFound desc = could not find container \"9cdf0d080c7692aa36007cc6c6fb2661e4208ac4aa71b92b035b38543d5af686\": container with ID starting with 9cdf0d080c7692aa36007cc6c6fb2661e4208ac4aa71b92b035b38543d5af686 not found: ID does not exist"
May 28 09:34:02.682779 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.682779    2572 scope.go:117] "RemoveContainer" containerID="c387c9ad1d4716c5988e9d6d716dd9b0e990843dffe04ddda2485e1798f9f573"
May 28 09:34:02.683027 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.682996    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c387c9ad1d4716c5988e9d6d716dd9b0e990843dffe04ddda2485e1798f9f573"} err="failed to get container status \"c387c9ad1d4716c5988e9d6d716dd9b0e990843dffe04ddda2485e1798f9f573\": rpc error: code = NotFound desc = could not find container \"c387c9ad1d4716c5988e9d6d716dd9b0e990843dffe04ddda2485e1798f9f573\": container with ID starting with c387c9ad1d4716c5988e9d6d716dd9b0e990843dffe04ddda2485e1798f9f573 not found: ID does not exist"
May 28 09:34:02.683118 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.683029    2572 scope.go:117] "RemoveContainer" containerID="0c49bccb696037a068cfd6656a7df2b6edb00013c006820c6da42aecf510fc13"
May 28 09:34:02.683232 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.683217    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c49bccb696037a068cfd6656a7df2b6edb00013c006820c6da42aecf510fc13"} err="failed to get container status \"0c49bccb696037a068cfd6656a7df2b6edb00013c006820c6da42aecf510fc13\": rpc error: code = NotFound desc = could not find container \"0c49bccb696037a068cfd6656a7df2b6edb00013c006820c6da42aecf510fc13\": container with ID starting with 0c49bccb696037a068cfd6656a7df2b6edb00013c006820c6da42aecf510fc13 not found: ID does not exist"
May 28 09:34:02.683284 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.683233    2572 scope.go:117] "RemoveContainer" containerID="3cb1911a911dacbc2682231de9cea6b2da61606f45784689a29b24ecff5c3ada"
May 28 09:34:02.683441 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.683424    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cb1911a911dacbc2682231de9cea6b2da61606f45784689a29b24ecff5c3ada"} err="failed to get container status \"3cb1911a911dacbc2682231de9cea6b2da61606f45784689a29b24ecff5c3ada\": rpc error: code = NotFound desc = could not find container \"3cb1911a911dacbc2682231de9cea6b2da61606f45784689a29b24ecff5c3ada\": container with ID starting with 3cb1911a911dacbc2682231de9cea6b2da61606f45784689a29b24ecff5c3ada not found: ID does not exist"
May 28 09:34:02.683497 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.683442    2572 scope.go:117] "RemoveContainer" containerID="3e2f1bdab40529134e6e9f151e7c277a96b0d0866af15265a5e90f3b0d1e4816"
May 28 09:34:02.683635 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.683616    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e2f1bdab40529134e6e9f151e7c277a96b0d0866af15265a5e90f3b0d1e4816"} err="failed to get container status \"3e2f1bdab40529134e6e9f151e7c277a96b0d0866af15265a5e90f3b0d1e4816\": rpc error: code = NotFound desc = could not find container \"3e2f1bdab40529134e6e9f151e7c277a96b0d0866af15265a5e90f3b0d1e4816\": container with ID starting with 3e2f1bdab40529134e6e9f151e7c277a96b0d0866af15265a5e90f3b0d1e4816 not found: ID does not exist"
May 28 09:34:02.683676 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.683636    2572 scope.go:117] "RemoveContainer" containerID="29fc6307e4826ec011bc287ac3e3e07004ead76663efc5d9238e2e55f5114649"
May 28 09:34:02.683829 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.683815    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29fc6307e4826ec011bc287ac3e3e07004ead76663efc5d9238e2e55f5114649"} err="failed to get container status \"29fc6307e4826ec011bc287ac3e3e07004ead76663efc5d9238e2e55f5114649\": rpc error: code = NotFound desc = could not find container \"29fc6307e4826ec011bc287ac3e3e07004ead76663efc5d9238e2e55f5114649\": container with ID starting with 29fc6307e4826ec011bc287ac3e3e07004ead76663efc5d9238e2e55f5114649 not found: ID does not exist"
May 28 09:34:02.683880 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.683830    2572 scope.go:117] "RemoveContainer" containerID="4f1738681ea55098791c111495857856056c2e85f348bcfb9890e21199ea700d"
May 28 09:34:02.684040 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.684024    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f1738681ea55098791c111495857856056c2e85f348bcfb9890e21199ea700d"} err="failed to get container status \"4f1738681ea55098791c111495857856056c2e85f348bcfb9890e21199ea700d\": rpc error: code = NotFound desc = could not find container \"4f1738681ea55098791c111495857856056c2e85f348bcfb9890e21199ea700d\": container with ID starting with 4f1738681ea55098791c111495857856056c2e85f348bcfb9890e21199ea700d not found: ID does not exist"
May 28 09:34:02.684040 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.684039    2572 scope.go:117] "RemoveContainer" containerID="9cdf0d080c7692aa36007cc6c6fb2661e4208ac4aa71b92b035b38543d5af686"
May 28 09:34:02.684237 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.684221    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cdf0d080c7692aa36007cc6c6fb2661e4208ac4aa71b92b035b38543d5af686"} err="failed to get container status \"9cdf0d080c7692aa36007cc6c6fb2661e4208ac4aa71b92b035b38543d5af686\": rpc error: code = NotFound desc = could not find container \"9cdf0d080c7692aa36007cc6c6fb2661e4208ac4aa71b92b035b38543d5af686\": container with ID starting with 9cdf0d080c7692aa36007cc6c6fb2661e4208ac4aa71b92b035b38543d5af686 not found: ID does not exist"
May 28 09:34:02.684284 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.684237    2572 scope.go:117] "RemoveContainer" containerID="c387c9ad1d4716c5988e9d6d716dd9b0e990843dffe04ddda2485e1798f9f573"
May 28 09:34:02.684410 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.684394    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c387c9ad1d4716c5988e9d6d716dd9b0e990843dffe04ddda2485e1798f9f573"} err="failed to get container status \"c387c9ad1d4716c5988e9d6d716dd9b0e990843dffe04ddda2485e1798f9f573\": rpc error: code = NotFound desc = could not find container \"c387c9ad1d4716c5988e9d6d716dd9b0e990843dffe04ddda2485e1798f9f573\": container with ID starting with c387c9ad1d4716c5988e9d6d716dd9b0e990843dffe04ddda2485e1798f9f573 not found: ID does not exist"
May 28 09:34:02.684410 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.684409    2572 scope.go:117] "RemoveContainer" containerID="0c49bccb696037a068cfd6656a7df2b6edb00013c006820c6da42aecf510fc13"
May 28 09:34:02.684581 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.684565    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c49bccb696037a068cfd6656a7df2b6edb00013c006820c6da42aecf510fc13"} err="failed to get container status \"0c49bccb696037a068cfd6656a7df2b6edb00013c006820c6da42aecf510fc13\": rpc error: code = NotFound desc = could not find container \"0c49bccb696037a068cfd6656a7df2b6edb00013c006820c6da42aecf510fc13\": container with ID starting with 0c49bccb696037a068cfd6656a7df2b6edb00013c006820c6da42aecf510fc13 not found: ID does not exist"
May 28 09:34:02.684581 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.684581    2572 scope.go:117] "RemoveContainer" containerID="3cb1911a911dacbc2682231de9cea6b2da61606f45784689a29b24ecff5c3ada"
May 28 09:34:02.684743 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.684728    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cb1911a911dacbc2682231de9cea6b2da61606f45784689a29b24ecff5c3ada"} err="failed to get container status \"3cb1911a911dacbc2682231de9cea6b2da61606f45784689a29b24ecff5c3ada\": rpc error: code = NotFound desc = could not find container \"3cb1911a911dacbc2682231de9cea6b2da61606f45784689a29b24ecff5c3ada\": container with ID starting with 3cb1911a911dacbc2682231de9cea6b2da61606f45784689a29b24ecff5c3ada not found: ID does not exist"
May 28 09:34:02.684782 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.684742    2572 scope.go:117] "RemoveContainer" containerID="3e2f1bdab40529134e6e9f151e7c277a96b0d0866af15265a5e90f3b0d1e4816"
May 28 09:34:02.684940 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.684925    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e2f1bdab40529134e6e9f151e7c277a96b0d0866af15265a5e90f3b0d1e4816"} err="failed to get container status \"3e2f1bdab40529134e6e9f151e7c277a96b0d0866af15265a5e90f3b0d1e4816\": rpc error: code = NotFound desc = could not find container \"3e2f1bdab40529134e6e9f151e7c277a96b0d0866af15265a5e90f3b0d1e4816\": container with ID starting with 3e2f1bdab40529134e6e9f151e7c277a96b0d0866af15265a5e90f3b0d1e4816 not found: ID does not exist"
May 28 09:34:02.684940 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.684939    2572 scope.go:117] "RemoveContainer" containerID="29fc6307e4826ec011bc287ac3e3e07004ead76663efc5d9238e2e55f5114649"
May 28 09:34:02.685127 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.685105    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29fc6307e4826ec011bc287ac3e3e07004ead76663efc5d9238e2e55f5114649"} err="failed to get container status \"29fc6307e4826ec011bc287ac3e3e07004ead76663efc5d9238e2e55f5114649\": rpc error: code = NotFound desc = could not find container \"29fc6307e4826ec011bc287ac3e3e07004ead76663efc5d9238e2e55f5114649\": container with ID starting with 29fc6307e4826ec011bc287ac3e3e07004ead76663efc5d9238e2e55f5114649 not found: ID does not exist"
May 28 09:34:02.685200 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.685130    2572 scope.go:117] "RemoveContainer" containerID="4f1738681ea55098791c111495857856056c2e85f348bcfb9890e21199ea700d"
May 28 09:34:02.685387 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.685366    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f1738681ea55098791c111495857856056c2e85f348bcfb9890e21199ea700d"} err="failed to get container status \"4f1738681ea55098791c111495857856056c2e85f348bcfb9890e21199ea700d\": rpc error: code = NotFound desc = could not find container \"4f1738681ea55098791c111495857856056c2e85f348bcfb9890e21199ea700d\": container with ID starting with 4f1738681ea55098791c111495857856056c2e85f348bcfb9890e21199ea700d not found: ID does not exist"
May 28 09:34:02.685426 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.685388    2572 scope.go:117] "RemoveContainer" containerID="9cdf0d080c7692aa36007cc6c6fb2661e4208ac4aa71b92b035b38543d5af686"
May 28 09:34:02.685550 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.685534    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cdf0d080c7692aa36007cc6c6fb2661e4208ac4aa71b92b035b38543d5af686"} err="failed to get container status \"9cdf0d080c7692aa36007cc6c6fb2661e4208ac4aa71b92b035b38543d5af686\": rpc error: code = NotFound desc = could not find container \"9cdf0d080c7692aa36007cc6c6fb2661e4208ac4aa71b92b035b38543d5af686\": container with ID starting with 9cdf0d080c7692aa36007cc6c6fb2661e4208ac4aa71b92b035b38543d5af686 not found: ID does not exist"
May 28 09:34:02.685604 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.685549    2572 scope.go:117] "RemoveContainer" containerID="c387c9ad1d4716c5988e9d6d716dd9b0e990843dffe04ddda2485e1798f9f573"
May 28 09:34:02.685708 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.685689    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c387c9ad1d4716c5988e9d6d716dd9b0e990843dffe04ddda2485e1798f9f573"} err="failed to get container status \"c387c9ad1d4716c5988e9d6d716dd9b0e990843dffe04ddda2485e1798f9f573\": rpc error: code = NotFound desc = could not find container \"c387c9ad1d4716c5988e9d6d716dd9b0e990843dffe04ddda2485e1798f9f573\": container with ID starting with c387c9ad1d4716c5988e9d6d716dd9b0e990843dffe04ddda2485e1798f9f573 not found: ID does not exist"
May 28 09:34:02.685817 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.685718    2572 scope.go:117] "RemoveContainer" containerID="0c49bccb696037a068cfd6656a7df2b6edb00013c006820c6da42aecf510fc13"
May 28 09:34:02.685950 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.685933    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c49bccb696037a068cfd6656a7df2b6edb00013c006820c6da42aecf510fc13"} err="failed to get container status \"0c49bccb696037a068cfd6656a7df2b6edb00013c006820c6da42aecf510fc13\": rpc error: code = NotFound desc = could not find container \"0c49bccb696037a068cfd6656a7df2b6edb00013c006820c6da42aecf510fc13\": container with ID starting with 0c49bccb696037a068cfd6656a7df2b6edb00013c006820c6da42aecf510fc13 not found: ID does not exist"
May 28 09:34:02.685950 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.685949    2572 scope.go:117] "RemoveContainer" containerID="3cb1911a911dacbc2682231de9cea6b2da61606f45784689a29b24ecff5c3ada"
May 28 09:34:02.686370 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.686225    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cb1911a911dacbc2682231de9cea6b2da61606f45784689a29b24ecff5c3ada"} err="failed to get container status \"3cb1911a911dacbc2682231de9cea6b2da61606f45784689a29b24ecff5c3ada\": rpc error: code = NotFound desc = could not find container \"3cb1911a911dacbc2682231de9cea6b2da61606f45784689a29b24ecff5c3ada\": container with ID starting with 3cb1911a911dacbc2682231de9cea6b2da61606f45784689a29b24ecff5c3ada not found: ID does not exist"
May 28 09:34:02.686370 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.686270    2572 scope.go:117] "RemoveContainer" containerID="3e2f1bdab40529134e6e9f151e7c277a96b0d0866af15265a5e90f3b0d1e4816"
May 28 09:34:02.686634 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.686563    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e2f1bdab40529134e6e9f151e7c277a96b0d0866af15265a5e90f3b0d1e4816"} err="failed to get container status \"3e2f1bdab40529134e6e9f151e7c277a96b0d0866af15265a5e90f3b0d1e4816\": rpc error: code = NotFound desc = could not find container \"3e2f1bdab40529134e6e9f151e7c277a96b0d0866af15265a5e90f3b0d1e4816\": container with ID starting with 3e2f1bdab40529134e6e9f151e7c277a96b0d0866af15265a5e90f3b0d1e4816 not found: ID does not exist"
May 28 09:34:02.686634 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.686584    2572 scope.go:117] "RemoveContainer" containerID="29fc6307e4826ec011bc287ac3e3e07004ead76663efc5d9238e2e55f5114649"
May 28 09:34:02.686934 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.686907    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29fc6307e4826ec011bc287ac3e3e07004ead76663efc5d9238e2e55f5114649"} err="failed to get container status \"29fc6307e4826ec011bc287ac3e3e07004ead76663efc5d9238e2e55f5114649\": rpc error: code = NotFound desc = could not find container \"29fc6307e4826ec011bc287ac3e3e07004ead76663efc5d9238e2e55f5114649\": container with ID starting with 29fc6307e4826ec011bc287ac3e3e07004ead76663efc5d9238e2e55f5114649 not found: ID does not exist"
May 28 09:34:02.687063 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.686934    2572 scope.go:117] "RemoveContainer" containerID="4f1738681ea55098791c111495857856056c2e85f348bcfb9890e21199ea700d"
May 28 09:34:02.687215 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.687187    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f1738681ea55098791c111495857856056c2e85f348bcfb9890e21199ea700d"} err="failed to get container status \"4f1738681ea55098791c111495857856056c2e85f348bcfb9890e21199ea700d\": rpc error: code = NotFound desc = could not find container \"4f1738681ea55098791c111495857856056c2e85f348bcfb9890e21199ea700d\": container with ID starting with 4f1738681ea55098791c111495857856056c2e85f348bcfb9890e21199ea700d not found: ID does not exist"
May 28 09:34:02.687215 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.687211    2572 scope.go:117] "RemoveContainer" containerID="9cdf0d080c7692aa36007cc6c6fb2661e4208ac4aa71b92b035b38543d5af686"
May 28 09:34:02.687477 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.687458    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cdf0d080c7692aa36007cc6c6fb2661e4208ac4aa71b92b035b38543d5af686"} err="failed to get container status \"9cdf0d080c7692aa36007cc6c6fb2661e4208ac4aa71b92b035b38543d5af686\": rpc error: code = NotFound desc = could not find container \"9cdf0d080c7692aa36007cc6c6fb2661e4208ac4aa71b92b035b38543d5af686\": container with ID starting with 9cdf0d080c7692aa36007cc6c6fb2661e4208ac4aa71b92b035b38543d5af686 not found: ID does not exist"
May 28 09:34:02.687543 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.687478    2572 scope.go:117] "RemoveContainer" containerID="c387c9ad1d4716c5988e9d6d716dd9b0e990843dffe04ddda2485e1798f9f573"
May 28 09:34:02.687751 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.687726    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c387c9ad1d4716c5988e9d6d716dd9b0e990843dffe04ddda2485e1798f9f573"} err="failed to get container status \"c387c9ad1d4716c5988e9d6d716dd9b0e990843dffe04ddda2485e1798f9f573\": rpc error: code = NotFound desc = could not find container \"c387c9ad1d4716c5988e9d6d716dd9b0e990843dffe04ddda2485e1798f9f573\": container with ID starting with c387c9ad1d4716c5988e9d6d716dd9b0e990843dffe04ddda2485e1798f9f573 not found: ID does not exist"
May 28 09:34:02.687863 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.687752    2572 scope.go:117] "RemoveContainer" containerID="0c49bccb696037a068cfd6656a7df2b6edb00013c006820c6da42aecf510fc13"
May 28 09:34:02.688003 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.687963    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c49bccb696037a068cfd6656a7df2b6edb00013c006820c6da42aecf510fc13"} err="failed to get container status \"0c49bccb696037a068cfd6656a7df2b6edb00013c006820c6da42aecf510fc13\": rpc error: code = NotFound desc = could not find container \"0c49bccb696037a068cfd6656a7df2b6edb00013c006820c6da42aecf510fc13\": container with ID starting with 0c49bccb696037a068cfd6656a7df2b6edb00013c006820c6da42aecf510fc13 not found: ID does not exist"
May 28 09:34:02.688068 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.688006    2572 scope.go:117] "RemoveContainer" containerID="3cb1911a911dacbc2682231de9cea6b2da61606f45784689a29b24ecff5c3ada"
May 28 09:34:02.688293 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.688270    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cb1911a911dacbc2682231de9cea6b2da61606f45784689a29b24ecff5c3ada"} err="failed to get container status \"3cb1911a911dacbc2682231de9cea6b2da61606f45784689a29b24ecff5c3ada\": rpc error: code = NotFound desc = could not find container \"3cb1911a911dacbc2682231de9cea6b2da61606f45784689a29b24ecff5c3ada\": container with ID starting with 3cb1911a911dacbc2682231de9cea6b2da61606f45784689a29b24ecff5c3ada not found: ID does not exist"
May 28 09:34:02.688377 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.688295    2572 scope.go:117] "RemoveContainer" containerID="3e2f1bdab40529134e6e9f151e7c277a96b0d0866af15265a5e90f3b0d1e4816"
May 28 09:34:02.688477 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.688449    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 09:34:02.688577 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.688532    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e2f1bdab40529134e6e9f151e7c277a96b0d0866af15265a5e90f3b0d1e4816"} err="failed to get container status \"3e2f1bdab40529134e6e9f151e7c277a96b0d0866af15265a5e90f3b0d1e4816\": rpc error: code = NotFound desc = could not find container \"3e2f1bdab40529134e6e9f151e7c277a96b0d0866af15265a5e90f3b0d1e4816\": container with ID starting with 3e2f1bdab40529134e6e9f151e7c277a96b0d0866af15265a5e90f3b0d1e4816 not found: ID does not exist"
May 28 09:34:02.688577 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.688572    2572 scope.go:117] "RemoveContainer" containerID="29fc6307e4826ec011bc287ac3e3e07004ead76663efc5d9238e2e55f5114649"
May 28 09:34:02.688849 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.688824    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29fc6307e4826ec011bc287ac3e3e07004ead76663efc5d9238e2e55f5114649"} err="failed to get container status \"29fc6307e4826ec011bc287ac3e3e07004ead76663efc5d9238e2e55f5114649\": rpc error: code = NotFound desc = could not find container \"29fc6307e4826ec011bc287ac3e3e07004ead76663efc5d9238e2e55f5114649\": container with ID starting with 29fc6307e4826ec011bc287ac3e3e07004ead76663efc5d9238e2e55f5114649 not found: ID does not exist"
May 28 09:34:02.688920 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.688850    2572 scope.go:117] "RemoveContainer" containerID="4f1738681ea55098791c111495857856056c2e85f348bcfb9890e21199ea700d"
May 28 09:34:02.688920 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.688852    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1f30324-a53c-449a-9cff-c44d3146c49c" containerName="thanos-sidecar"
May 28 09:34:02.688920 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.688918    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1f30324-a53c-449a-9cff-c44d3146c49c" containerName="thanos-sidecar"
May 28 09:34:02.689044 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.688933    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1f30324-a53c-449a-9cff-c44d3146c49c" containerName="kube-rbac-proxy"
May 28 09:34:02.689044 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.688945    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1f30324-a53c-449a-9cff-c44d3146c49c" containerName="kube-rbac-proxy"
May 28 09:34:02.689044 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.688959    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1f30324-a53c-449a-9cff-c44d3146c49c" containerName="init-config-reloader"
May 28 09:34:02.689044 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.688982    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1f30324-a53c-449a-9cff-c44d3146c49c" containerName="init-config-reloader"
May 28 09:34:02.689044 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.688997    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1f30324-a53c-449a-9cff-c44d3146c49c" containerName="prometheus"
May 28 09:34:02.689044 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.689006    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1f30324-a53c-449a-9cff-c44d3146c49c" containerName="prometheus"
May 28 09:34:02.689044 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.689030    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1f30324-a53c-449a-9cff-c44d3146c49c" containerName="kube-rbac-proxy-thanos"
May 28 09:34:02.689044 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.689038    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1f30324-a53c-449a-9cff-c44d3146c49c" containerName="kube-rbac-proxy-thanos"
May 28 09:34:02.689319 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.689051    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1f30324-a53c-449a-9cff-c44d3146c49c" containerName="config-reloader"
May 28 09:34:02.689319 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.689060    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1f30324-a53c-449a-9cff-c44d3146c49c" containerName="config-reloader"
May 28 09:34:02.689319 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.689074    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1f30324-a53c-449a-9cff-c44d3146c49c" containerName="kube-rbac-proxy-web"
May 28 09:34:02.689319 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.689082    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1f30324-a53c-449a-9cff-c44d3146c49c" containerName="kube-rbac-proxy-web"
May 28 09:34:02.689319 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.689093    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="488a4f27-9c0f-401b-95a3-0998d9ed7b70" containerName="console"
May 28 09:34:02.689319 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.689102    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="488a4f27-9c0f-401b-95a3-0998d9ed7b70" containerName="console"
May 28 09:34:02.689319 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.689113    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c268d352-6650-4d76-8b97-86b050f3c6d4" containerName="console"
May 28 09:34:02.689319 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.689123    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c268d352-6650-4d76-8b97-86b050f3c6d4" containerName="console"
May 28 09:34:02.689319 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.689126    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f1738681ea55098791c111495857856056c2e85f348bcfb9890e21199ea700d"} err="failed to get container status \"4f1738681ea55098791c111495857856056c2e85f348bcfb9890e21199ea700d\": rpc error: code = NotFound desc = could not find container \"4f1738681ea55098791c111495857856056c2e85f348bcfb9890e21199ea700d\": container with ID starting with 4f1738681ea55098791c111495857856056c2e85f348bcfb9890e21199ea700d not found: ID does not exist"
May 28 09:34:02.689319 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.689143    2572 scope.go:117] "RemoveContainer" containerID="9cdf0d080c7692aa36007cc6c6fb2661e4208ac4aa71b92b035b38543d5af686"
May 28 09:34:02.689319 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.689205    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="c268d352-6650-4d76-8b97-86b050f3c6d4" containerName="console"
May 28 09:34:02.689319 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.689217    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="b1f30324-a53c-449a-9cff-c44d3146c49c" containerName="thanos-sidecar"
May 28 09:34:02.689319 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.689227    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="b1f30324-a53c-449a-9cff-c44d3146c49c" containerName="kube-rbac-proxy-web"
May 28 09:34:02.689319 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.689236    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="b1f30324-a53c-449a-9cff-c44d3146c49c" containerName="kube-rbac-proxy-thanos"
May 28 09:34:02.689319 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.689248    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="b1f30324-a53c-449a-9cff-c44d3146c49c" containerName="prometheus"
May 28 09:34:02.689319 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.689260    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="b1f30324-a53c-449a-9cff-c44d3146c49c" containerName="kube-rbac-proxy"
May 28 09:34:02.689319 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.689271    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="488a4f27-9c0f-401b-95a3-0998d9ed7b70" containerName="console"
May 28 09:34:02.689319 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.689281    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="b1f30324-a53c-449a-9cff-c44d3146c49c" containerName="config-reloader"
May 28 09:34:02.689860 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.689351    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cdf0d080c7692aa36007cc6c6fb2661e4208ac4aa71b92b035b38543d5af686"} err="failed to get container status \"9cdf0d080c7692aa36007cc6c6fb2661e4208ac4aa71b92b035b38543d5af686\": rpc error: code = NotFound desc = could not find container \"9cdf0d080c7692aa36007cc6c6fb2661e4208ac4aa71b92b035b38543d5af686\": container with ID starting with 9cdf0d080c7692aa36007cc6c6fb2661e4208ac4aa71b92b035b38543d5af686 not found: ID does not exist"
May 28 09:34:02.689860 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.689365    2572 scope.go:117] "RemoveContainer" containerID="c387c9ad1d4716c5988e9d6d716dd9b0e990843dffe04ddda2485e1798f9f573"
May 28 09:34:02.689860 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.689578    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c387c9ad1d4716c5988e9d6d716dd9b0e990843dffe04ddda2485e1798f9f573"} err="failed to get container status \"c387c9ad1d4716c5988e9d6d716dd9b0e990843dffe04ddda2485e1798f9f573\": rpc error: code = NotFound desc = could not find container \"c387c9ad1d4716c5988e9d6d716dd9b0e990843dffe04ddda2485e1798f9f573\": container with ID starting with c387c9ad1d4716c5988e9d6d716dd9b0e990843dffe04ddda2485e1798f9f573 not found: ID does not exist"
May 28 09:34:02.693732 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.693717    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:02.696528 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.696500    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
May 28 09:34:02.696650 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.696503    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
May 28 09:34:02.696787 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.696767    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-v7cr8\""
May 28 09:34:02.696871 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.696838    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-crt4dhe4od08t\""
May 28 09:34:02.697102 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.697081    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
May 28 09:34:02.697393 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.697362    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
May 28 09:34:02.697604 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.697581    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
May 28 09:34:02.697823 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.697777    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
May 28 09:34:02.698096 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.698078    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
May 28 09:34:02.698856 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.698197    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
May 28 09:34:02.698856 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.698272    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
May 28 09:34:02.699008 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.698905    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
May 28 09:34:02.701662 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.701635    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
May 28 09:34:02.704818 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.704799    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
May 28 09:34:02.707984 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.707951    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 09:34:02.725118 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.725090    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9c9e22ad-ef40-445e-b6b6-c3c031b5b601-config\") pod \"prometheus-k8s-0\" (UID: \"9c9e22ad-ef40-445e-b6b6-c3c031b5b601\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:02.725118 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.725128    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c9e22ad-ef40-445e-b6b6-c3c031b5b601-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9c9e22ad-ef40-445e-b6b6-c3c031b5b601\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:02.725284 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.725162    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c9e22ad-ef40-445e-b6b6-c3c031b5b601-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9c9e22ad-ef40-445e-b6b6-c3c031b5b601\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:02.725284 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.725181    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9c9e22ad-ef40-445e-b6b6-c3c031b5b601-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9c9e22ad-ef40-445e-b6b6-c3c031b5b601\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:02.725284 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.725197    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c9e22ad-ef40-445e-b6b6-c3c031b5b601-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9c9e22ad-ef40-445e-b6b6-c3c031b5b601\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:02.725284 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.725213    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5n5k\" (UniqueName: \"kubernetes.io/projected/9c9e22ad-ef40-445e-b6b6-c3c031b5b601-kube-api-access-n5n5k\") pod \"prometheus-k8s-0\" (UID: \"9c9e22ad-ef40-445e-b6b6-c3c031b5b601\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:02.725284 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.725236    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9c9e22ad-ef40-445e-b6b6-c3c031b5b601-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9c9e22ad-ef40-445e-b6b6-c3c031b5b601\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:02.725284 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.725258    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9c9e22ad-ef40-445e-b6b6-c3c031b5b601-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9c9e22ad-ef40-445e-b6b6-c3c031b5b601\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:02.725284 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.725278    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9c9e22ad-ef40-445e-b6b6-c3c031b5b601-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9c9e22ad-ef40-445e-b6b6-c3c031b5b601\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:02.725499 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.725304    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c9e22ad-ef40-445e-b6b6-c3c031b5b601-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9c9e22ad-ef40-445e-b6b6-c3c031b5b601\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:02.725499 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.725331    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9c9e22ad-ef40-445e-b6b6-c3c031b5b601-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9c9e22ad-ef40-445e-b6b6-c3c031b5b601\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:02.725499 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.725348    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9c9e22ad-ef40-445e-b6b6-c3c031b5b601-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9c9e22ad-ef40-445e-b6b6-c3c031b5b601\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:02.725499 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.725365    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9c9e22ad-ef40-445e-b6b6-c3c031b5b601-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9c9e22ad-ef40-445e-b6b6-c3c031b5b601\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:02.725499 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.725386    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9c9e22ad-ef40-445e-b6b6-c3c031b5b601-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9c9e22ad-ef40-445e-b6b6-c3c031b5b601\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:02.725499 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.725425    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9c9e22ad-ef40-445e-b6b6-c3c031b5b601-web-config\") pod \"prometheus-k8s-0\" (UID: \"9c9e22ad-ef40-445e-b6b6-c3c031b5b601\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:02.725499 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.725441    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9c9e22ad-ef40-445e-b6b6-c3c031b5b601-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9c9e22ad-ef40-445e-b6b6-c3c031b5b601\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:02.725499 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.725459    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9c9e22ad-ef40-445e-b6b6-c3c031b5b601-config-out\") pod \"prometheus-k8s-0\" (UID: \"9c9e22ad-ef40-445e-b6b6-c3c031b5b601\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:02.725722 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.725508    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9c9e22ad-ef40-445e-b6b6-c3c031b5b601-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9c9e22ad-ef40-445e-b6b6-c3c031b5b601\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:02.826547 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.826506    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9c9e22ad-ef40-445e-b6b6-c3c031b5b601-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9c9e22ad-ef40-445e-b6b6-c3c031b5b601\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:02.826547 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.826549    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9c9e22ad-ef40-445e-b6b6-c3c031b5b601-config\") pod \"prometheus-k8s-0\" (UID: \"9c9e22ad-ef40-445e-b6b6-c3c031b5b601\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:02.826736 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.826574    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c9e22ad-ef40-445e-b6b6-c3c031b5b601-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9c9e22ad-ef40-445e-b6b6-c3c031b5b601\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:02.826736 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.826601    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c9e22ad-ef40-445e-b6b6-c3c031b5b601-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9c9e22ad-ef40-445e-b6b6-c3c031b5b601\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:02.826736 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.826626    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9c9e22ad-ef40-445e-b6b6-c3c031b5b601-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9c9e22ad-ef40-445e-b6b6-c3c031b5b601\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:02.826736 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.826652    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c9e22ad-ef40-445e-b6b6-c3c031b5b601-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9c9e22ad-ef40-445e-b6b6-c3c031b5b601\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:02.826736 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.826675    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n5n5k\" (UniqueName: \"kubernetes.io/projected/9c9e22ad-ef40-445e-b6b6-c3c031b5b601-kube-api-access-n5n5k\") pod \"prometheus-k8s-0\" (UID: \"9c9e22ad-ef40-445e-b6b6-c3c031b5b601\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:02.826736 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.826702    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9c9e22ad-ef40-445e-b6b6-c3c031b5b601-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9c9e22ad-ef40-445e-b6b6-c3c031b5b601\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:02.826736 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.826728    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9c9e22ad-ef40-445e-b6b6-c3c031b5b601-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9c9e22ad-ef40-445e-b6b6-c3c031b5b601\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:02.827130 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.826755    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9c9e22ad-ef40-445e-b6b6-c3c031b5b601-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9c9e22ad-ef40-445e-b6b6-c3c031b5b601\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:02.827130 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.826792    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c9e22ad-ef40-445e-b6b6-c3c031b5b601-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9c9e22ad-ef40-445e-b6b6-c3c031b5b601\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:02.827130 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.826825    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9c9e22ad-ef40-445e-b6b6-c3c031b5b601-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9c9e22ad-ef40-445e-b6b6-c3c031b5b601\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:02.827130 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.826849    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9c9e22ad-ef40-445e-b6b6-c3c031b5b601-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9c9e22ad-ef40-445e-b6b6-c3c031b5b601\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:02.827130 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.826878    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9c9e22ad-ef40-445e-b6b6-c3c031b5b601-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9c9e22ad-ef40-445e-b6b6-c3c031b5b601\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:02.827130 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.826913    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9c9e22ad-ef40-445e-b6b6-c3c031b5b601-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9c9e22ad-ef40-445e-b6b6-c3c031b5b601\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:02.827130 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.826956    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9c9e22ad-ef40-445e-b6b6-c3c031b5b601-web-config\") pod \"prometheus-k8s-0\" (UID: \"9c9e22ad-ef40-445e-b6b6-c3c031b5b601\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:02.827130 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.827007    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9c9e22ad-ef40-445e-b6b6-c3c031b5b601-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9c9e22ad-ef40-445e-b6b6-c3c031b5b601\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:02.827130 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.827045    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9c9e22ad-ef40-445e-b6b6-c3c031b5b601-config-out\") pod \"prometheus-k8s-0\" (UID: \"9c9e22ad-ef40-445e-b6b6-c3c031b5b601\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:02.827545 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.827455    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c9e22ad-ef40-445e-b6b6-c3c031b5b601-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9c9e22ad-ef40-445e-b6b6-c3c031b5b601\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:02.828112 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.827729    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c9e22ad-ef40-445e-b6b6-c3c031b5b601-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9c9e22ad-ef40-445e-b6b6-c3c031b5b601\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:02.828112 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.828098    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c9e22ad-ef40-445e-b6b6-c3c031b5b601-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9c9e22ad-ef40-445e-b6b6-c3c031b5b601\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:02.828459 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.828435    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c9e22ad-ef40-445e-b6b6-c3c031b5b601-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9c9e22ad-ef40-445e-b6b6-c3c031b5b601\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:02.830084 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.829872    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/9c9e22ad-ef40-445e-b6b6-c3c031b5b601-config\") pod \"prometheus-k8s-0\" (UID: \"9c9e22ad-ef40-445e-b6b6-c3c031b5b601\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:02.830630 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.830605    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9c9e22ad-ef40-445e-b6b6-c3c031b5b601-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9c9e22ad-ef40-445e-b6b6-c3c031b5b601\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:02.830749 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.830725    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9c9e22ad-ef40-445e-b6b6-c3c031b5b601-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9c9e22ad-ef40-445e-b6b6-c3c031b5b601\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:02.830829 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.830807    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9c9e22ad-ef40-445e-b6b6-c3c031b5b601-config-out\") pod \"prometheus-k8s-0\" (UID: \"9c9e22ad-ef40-445e-b6b6-c3c031b5b601\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:02.830829 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.830818    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9c9e22ad-ef40-445e-b6b6-c3c031b5b601-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9c9e22ad-ef40-445e-b6b6-c3c031b5b601\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:02.831731 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.831465    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9c9e22ad-ef40-445e-b6b6-c3c031b5b601-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9c9e22ad-ef40-445e-b6b6-c3c031b5b601\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:02.831731 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.831539    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9c9e22ad-ef40-445e-b6b6-c3c031b5b601-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9c9e22ad-ef40-445e-b6b6-c3c031b5b601\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:02.831731 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.831668    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9c9e22ad-ef40-445e-b6b6-c3c031b5b601-web-config\") pod \"prometheus-k8s-0\" (UID: \"9c9e22ad-ef40-445e-b6b6-c3c031b5b601\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:02.831935 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.831850    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9c9e22ad-ef40-445e-b6b6-c3c031b5b601-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9c9e22ad-ef40-445e-b6b6-c3c031b5b601\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:02.831935 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.831876    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9c9e22ad-ef40-445e-b6b6-c3c031b5b601-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9c9e22ad-ef40-445e-b6b6-c3c031b5b601\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:02.833087 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.833064    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9c9e22ad-ef40-445e-b6b6-c3c031b5b601-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9c9e22ad-ef40-445e-b6b6-c3c031b5b601\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:02.833169 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.833114    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9c9e22ad-ef40-445e-b6b6-c3c031b5b601-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9c9e22ad-ef40-445e-b6b6-c3c031b5b601\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:02.833235 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.833213    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9c9e22ad-ef40-445e-b6b6-c3c031b5b601-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9c9e22ad-ef40-445e-b6b6-c3c031b5b601\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:02.835795 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:02.835777    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5n5k\" (UniqueName: \"kubernetes.io/projected/9c9e22ad-ef40-445e-b6b6-c3c031b5b601-kube-api-access-n5n5k\") pod \"prometheus-k8s-0\" (UID: \"9c9e22ad-ef40-445e-b6b6-c3c031b5b601\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:03.013663 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:03.013621    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:03.156836 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:03.156804    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 09:34:03.159496 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:34:03.159459    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c9e22ad_ef40_445e_b6b6_c3c031b5b601.slice/crio-8b84e6130d6264b4c9678a31927ccf936f417c552a14b9a52eba8f68fe93ebcd WatchSource:0}: Error finding container 8b84e6130d6264b4c9678a31927ccf936f417c552a14b9a52eba8f68fe93ebcd: Status 404 returned error can't find the container with id 8b84e6130d6264b4c9678a31927ccf936f417c552a14b9a52eba8f68fe93ebcd
May 28 09:34:03.637363 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:03.637318    2572 generic.go:358] "Generic (PLEG): container finished" podID="9c9e22ad-ef40-445e-b6b6-c3c031b5b601" containerID="fe45e5ae0b75c115e5fa153c0018c0cc034e21095ad143fdcb767d99e66a8aac" exitCode=0
May 28 09:34:03.637525 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:03.637406    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9c9e22ad-ef40-445e-b6b6-c3c031b5b601","Type":"ContainerDied","Data":"fe45e5ae0b75c115e5fa153c0018c0cc034e21095ad143fdcb767d99e66a8aac"}
May 28 09:34:03.637525 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:03.637439    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9c9e22ad-ef40-445e-b6b6-c3c031b5b601","Type":"ContainerStarted","Data":"8b84e6130d6264b4c9678a31927ccf936f417c552a14b9a52eba8f68fe93ebcd"}
May 28 09:34:03.922944 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:03.922889    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1f30324-a53c-449a-9cff-c44d3146c49c" path="/var/lib/kubelet/pods/b1f30324-a53c-449a-9cff-c44d3146c49c/volumes"
May 28 09:34:04.643946 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:04.643910    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9c9e22ad-ef40-445e-b6b6-c3c031b5b601","Type":"ContainerStarted","Data":"2d0e4cfc20c40217cd32086fe8e30355876d9b1e4ebd7b577c0116d5ad5e98c9"}
May 28 09:34:04.644135 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:04.643952    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9c9e22ad-ef40-445e-b6b6-c3c031b5b601","Type":"ContainerStarted","Data":"8a4fb1d22b60750b4cee6cc5206f75f440002eb59bd353231ccf9db1d5792187"}
May 28 09:34:04.644135 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:04.643982    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9c9e22ad-ef40-445e-b6b6-c3c031b5b601","Type":"ContainerStarted","Data":"85d2b6da005efd1903de7f18d46c78ac43ebe699ae1efbf553bdf431770ef350"}
May 28 09:34:04.644135 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:04.643998    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9c9e22ad-ef40-445e-b6b6-c3c031b5b601","Type":"ContainerStarted","Data":"7f8a99a67305994831455ffb5bd6c60a4d16cc278e039df0333f7060441fc76d"}
May 28 09:34:04.644135 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:04.644010    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9c9e22ad-ef40-445e-b6b6-c3c031b5b601","Type":"ContainerStarted","Data":"d3a36574415764f482d279a90e7c367600df9a32716af626530e7443e8a9c07e"}
May 28 09:34:04.644135 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:04.644021    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9c9e22ad-ef40-445e-b6b6-c3c031b5b601","Type":"ContainerStarted","Data":"82d6ea95eecee91c2545394895558cb70e3a2a71bbfa0572a550220e1e255cb4"}
May 28 09:34:04.681996 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:04.681887    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.6818516089999997 podStartE2EDuration="2.681851609s" podCreationTimestamp="2026-05-28 09:34:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 09:34:04.680811532 +0000 UTC m=+173.363732315" watchObservedRunningTime="2026-05-28 09:34:04.681851609 +0000 UTC m=+173.364772393"
May 28 09:34:07.338237 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:07.338199    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b86cb56c5-p6mcn"]
May 28 09:34:08.014158 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:08.014115    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:32.357477 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:32.357410    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-b86cb56c5-p6mcn" podUID="a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf" containerName="console" containerID="cri-o://75ae9ebc623b4bb461e7159d24c3b168aae4a497ecf8004f6ff8a2f3ed6bcc86" gracePeriod=15
May 28 09:34:32.609877 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:32.609816    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-b86cb56c5-p6mcn_a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf/console/0.log"
May 28 09:34:32.610011 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:32.609878    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b86cb56c5-p6mcn"
May 28 09:34:32.696318 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:32.696282    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf-console-serving-cert\") pod \"a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf\" (UID: \"a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf\") "
May 28 09:34:32.696318 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:32.696324    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf-service-ca\") pod \"a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf\" (UID: \"a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf\") "
May 28 09:34:32.696537 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:32.696348    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf-trusted-ca-bundle\") pod \"a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf\" (UID: \"a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf\") "
May 28 09:34:32.696537 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:32.696377    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf-oauth-serving-cert\") pod \"a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf\" (UID: \"a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf\") "
May 28 09:34:32.696537 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:32.696407    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z74pc\" (UniqueName: \"kubernetes.io/projected/a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf-kube-api-access-z74pc\") pod \"a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf\" (UID: \"a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf\") "
May 28 09:34:32.696537 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:32.696431    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf-console-oauth-config\") pod \"a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf\" (UID: \"a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf\") "
May 28 09:34:32.696537 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:32.696454    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf-console-config\") pod \"a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf\" (UID: \"a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf\") "
May 28 09:34:32.696907 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:32.696863    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf-service-ca" (OuterVolumeSpecName: "service-ca") pod "a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf" (UID: "a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 09:34:32.696907 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:32.696877    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf" (UID: "a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 09:34:32.697067 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:32.696869    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf" (UID: "a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 09:34:32.697067 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:32.697003    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf-console-config" (OuterVolumeSpecName: "console-config") pod "a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf" (UID: "a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 09:34:32.698509 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:32.698489    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf" (UID: "a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:34:32.698633 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:32.698608    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf-kube-api-access-z74pc" (OuterVolumeSpecName: "kube-api-access-z74pc") pod "a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf" (UID: "a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf"). InnerVolumeSpecName "kube-api-access-z74pc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 09:34:32.698692 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:32.698640    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf" (UID: "a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:34:32.732164 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:32.732134    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-b86cb56c5-p6mcn_a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf/console/0.log"
May 28 09:34:32.732302 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:32.732177    2572 generic.go:358] "Generic (PLEG): container finished" podID="a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf" containerID="75ae9ebc623b4bb461e7159d24c3b168aae4a497ecf8004f6ff8a2f3ed6bcc86" exitCode=2
May 28 09:34:32.732302 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:32.732238    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b86cb56c5-p6mcn"
May 28 09:34:32.732302 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:32.732261    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b86cb56c5-p6mcn" event={"ID":"a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf","Type":"ContainerDied","Data":"75ae9ebc623b4bb461e7159d24c3b168aae4a497ecf8004f6ff8a2f3ed6bcc86"}
May 28 09:34:32.732302 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:32.732299    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b86cb56c5-p6mcn" event={"ID":"a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf","Type":"ContainerDied","Data":"c7f79ce97376b3fb0726101d4a865854345201bc61face30c47a3f4d5644fc06"}
May 28 09:34:32.732467 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:32.732315    2572 scope.go:117] "RemoveContainer" containerID="75ae9ebc623b4bb461e7159d24c3b168aae4a497ecf8004f6ff8a2f3ed6bcc86"
May 28 09:34:32.740759 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:32.740739    2572 scope.go:117] "RemoveContainer" containerID="75ae9ebc623b4bb461e7159d24c3b168aae4a497ecf8004f6ff8a2f3ed6bcc86"
May 28 09:34:32.741026 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:34:32.741003    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75ae9ebc623b4bb461e7159d24c3b168aae4a497ecf8004f6ff8a2f3ed6bcc86\": container with ID starting with 75ae9ebc623b4bb461e7159d24c3b168aae4a497ecf8004f6ff8a2f3ed6bcc86 not found: ID does not exist" containerID="75ae9ebc623b4bb461e7159d24c3b168aae4a497ecf8004f6ff8a2f3ed6bcc86"
May 28 09:34:32.741104 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:32.741033    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75ae9ebc623b4bb461e7159d24c3b168aae4a497ecf8004f6ff8a2f3ed6bcc86"} err="failed to get container status \"75ae9ebc623b4bb461e7159d24c3b168aae4a497ecf8004f6ff8a2f3ed6bcc86\": rpc error: code = NotFound desc = could not find container \"75ae9ebc623b4bb461e7159d24c3b168aae4a497ecf8004f6ff8a2f3ed6bcc86\": container with ID starting with 75ae9ebc623b4bb461e7159d24c3b168aae4a497ecf8004f6ff8a2f3ed6bcc86 not found: ID does not exist"
May 28 09:34:32.755484 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:32.755450    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b86cb56c5-p6mcn"]
May 28 09:34:32.757864 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:32.757841    2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-b86cb56c5-p6mcn"]
May 28 09:34:32.797139 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:32.797111    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z74pc\" (UniqueName: \"kubernetes.io/projected/a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf-kube-api-access-z74pc\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:34:32.797139 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:32.797138    2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf-console-oauth-config\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:34:32.797139 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:32.797148    2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf-console-config\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:34:32.797336 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:32.797159    2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf-console-serving-cert\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:34:32.797336 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:32.797168    2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf-service-ca\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:34:32.797336 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:32.797176    2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf-trusted-ca-bundle\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:34:32.797336 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:32.797184    2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf-oauth-serving-cert\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:34:33.919434 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:33.919401    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf" path="/var/lib/kubelet/pods/a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf/volumes"
May 28 09:34:34.516229 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:34.516196    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-nhlh5"]
May 28 09:34:34.516540 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:34.516520    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf" containerName="console"
May 28 09:34:34.516540 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:34.516535    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf" containerName="console"
May 28 09:34:34.516642 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:34.516591    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="a0a48051-7aaf-4e30-af2e-6cc1d4a61cdf" containerName="console"
May 28 09:34:34.519569 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:34.519551    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhlh5"
May 28 09:34:34.523719 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:34.523701    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 28 09:34:34.538543 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:34.538511    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nhlh5"]
May 28 09:34:34.609303 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:34.609265    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/30ff7447-74e3-4cd1-97bd-2f1c4e9507a2-dbus\") pod \"global-pull-secret-syncer-nhlh5\" (UID: \"30ff7447-74e3-4cd1-97bd-2f1c4e9507a2\") " pod="kube-system/global-pull-secret-syncer-nhlh5"
May 28 09:34:34.609478 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:34.609314    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/30ff7447-74e3-4cd1-97bd-2f1c4e9507a2-original-pull-secret\") pod \"global-pull-secret-syncer-nhlh5\" (UID: \"30ff7447-74e3-4cd1-97bd-2f1c4e9507a2\") " pod="kube-system/global-pull-secret-syncer-nhlh5"
May 28 09:34:34.609478 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:34.609345    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/30ff7447-74e3-4cd1-97bd-2f1c4e9507a2-kubelet-config\") pod \"global-pull-secret-syncer-nhlh5\" (UID: \"30ff7447-74e3-4cd1-97bd-2f1c4e9507a2\") " pod="kube-system/global-pull-secret-syncer-nhlh5"
May 28 09:34:34.710398 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:34.710365    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/30ff7447-74e3-4cd1-97bd-2f1c4e9507a2-original-pull-secret\") pod \"global-pull-secret-syncer-nhlh5\" (UID: \"30ff7447-74e3-4cd1-97bd-2f1c4e9507a2\") " pod="kube-system/global-pull-secret-syncer-nhlh5"
May 28 09:34:34.710558 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:34.710408    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/30ff7447-74e3-4cd1-97bd-2f1c4e9507a2-kubelet-config\") pod \"global-pull-secret-syncer-nhlh5\" (UID: \"30ff7447-74e3-4cd1-97bd-2f1c4e9507a2\") " pod="kube-system/global-pull-secret-syncer-nhlh5"
May 28 09:34:34.710558 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:34.710461    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/30ff7447-74e3-4cd1-97bd-2f1c4e9507a2-dbus\") pod \"global-pull-secret-syncer-nhlh5\" (UID: \"30ff7447-74e3-4cd1-97bd-2f1c4e9507a2\") " pod="kube-system/global-pull-secret-syncer-nhlh5"
May 28 09:34:34.710627 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:34.710554    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/30ff7447-74e3-4cd1-97bd-2f1c4e9507a2-kubelet-config\") pod \"global-pull-secret-syncer-nhlh5\" (UID: \"30ff7447-74e3-4cd1-97bd-2f1c4e9507a2\") " pod="kube-system/global-pull-secret-syncer-nhlh5"
May 28 09:34:34.710627 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:34.710607    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/30ff7447-74e3-4cd1-97bd-2f1c4e9507a2-dbus\") pod \"global-pull-secret-syncer-nhlh5\" (UID: \"30ff7447-74e3-4cd1-97bd-2f1c4e9507a2\") " pod="kube-system/global-pull-secret-syncer-nhlh5"
May 28 09:34:34.712614 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:34.712596    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/30ff7447-74e3-4cd1-97bd-2f1c4e9507a2-original-pull-secret\") pod \"global-pull-secret-syncer-nhlh5\" (UID: \"30ff7447-74e3-4cd1-97bd-2f1c4e9507a2\") " pod="kube-system/global-pull-secret-syncer-nhlh5"
May 28 09:34:34.828342 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:34.828236    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhlh5"
May 28 09:34:34.955080 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:34.955040    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nhlh5"]
May 28 09:34:34.958572 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:34:34.958546    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30ff7447_74e3_4cd1_97bd_2f1c4e9507a2.slice/crio-ee13339d97b18bf89865c24ce229d80844eb291868fedd1bff15ce42e4e1c054 WatchSource:0}: Error finding container ee13339d97b18bf89865c24ce229d80844eb291868fedd1bff15ce42e4e1c054: Status 404 returned error can't find the container with id ee13339d97b18bf89865c24ce229d80844eb291868fedd1bff15ce42e4e1c054
May 28 09:34:35.742731 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:35.742683    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nhlh5" event={"ID":"30ff7447-74e3-4cd1-97bd-2f1c4e9507a2","Type":"ContainerStarted","Data":"ee13339d97b18bf89865c24ce229d80844eb291868fedd1bff15ce42e4e1c054"}
May 28 09:34:39.756166 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:39.756125    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nhlh5" event={"ID":"30ff7447-74e3-4cd1-97bd-2f1c4e9507a2","Type":"ContainerStarted","Data":"6e4d092132fbc07970ba22be180986789a5af3c05552201028a46b3f8cff1bde"}
May 28 09:34:39.777733 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:34:39.777686    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-nhlh5" podStartSLOduration=1.149136988 podStartE2EDuration="5.77766954s" podCreationTimestamp="2026-05-28 09:34:34 +0000 UTC" firstStartedPulling="2026-05-28 09:34:34.960489419 +0000 UTC m=+203.643410184" lastFinishedPulling="2026-05-28 09:34:39.589021969 +0000 UTC m=+208.271942736" observedRunningTime="2026-05-28 09:34:39.776936558 +0000 UTC m=+208.459857362" watchObservedRunningTime="2026-05-28 09:34:39.77766954 +0000 UTC m=+208.460590327"
May 28 09:35:03.014736 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:35:03.014694    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:35:03.030346 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:35:03.030317    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:35:03.843036 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:35:03.843008    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:36:11.832651 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:36:11.832622    2572 kubelet.go:1628] "Image garbage collection succeeded"
May 28 09:42:46.445466 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:42:46.445431    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-test-apply-4hf5w"]
May 28 09:42:46.448553 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:42:46.448536    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-4hf5w"
May 28 09:42:46.454437 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:42:46.454409    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\""
May 28 09:42:46.454437 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:42:46.454426    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
May 28 09:42:46.455528 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:42:46.455508    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-nhp7c\""
May 28 09:42:46.455635 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:42:46.455542    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
May 28 09:42:46.467605 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:42:46.467581    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-4hf5w"]
May 28 09:42:46.509375 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:42:46.509330    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kflds\" (UniqueName: \"kubernetes.io/projected/5ad7cf95-6679-4413-a181-4fffafbe9774-kube-api-access-kflds\") pod \"feast-test-apply-4hf5w\" (UID: \"5ad7cf95-6679-4413-a181-4fffafbe9774\") " pod="test-ns-feast/feast-test-apply-4hf5w"
May 28 09:42:46.610636 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:42:46.610598    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kflds\" (UniqueName: \"kubernetes.io/projected/5ad7cf95-6679-4413-a181-4fffafbe9774-kube-api-access-kflds\") pod \"feast-test-apply-4hf5w\" (UID: \"5ad7cf95-6679-4413-a181-4fffafbe9774\") " pod="test-ns-feast/feast-test-apply-4hf5w"
May 28 09:42:46.620644 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:42:46.620607    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kflds\" (UniqueName: \"kubernetes.io/projected/5ad7cf95-6679-4413-a181-4fffafbe9774-kube-api-access-kflds\") pod \"feast-test-apply-4hf5w\" (UID: \"5ad7cf95-6679-4413-a181-4fffafbe9774\") " pod="test-ns-feast/feast-test-apply-4hf5w"
May 28 09:42:46.781991 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:42:46.781931    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-4hf5w"
May 28 09:42:46.912649 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:42:46.912617    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-4hf5w"]
May 28 09:42:46.915462 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:42:46.915430    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5ad7cf95_6679_4413_a181_4fffafbe9774.slice/crio-d8bf93281ea775dd6f153f4bfaf27d5ed44c8ad1b42a676de444a14d23923ef8 WatchSource:0}: Error finding container d8bf93281ea775dd6f153f4bfaf27d5ed44c8ad1b42a676de444a14d23923ef8: Status 404 returned error can't find the container with id d8bf93281ea775dd6f153f4bfaf27d5ed44c8ad1b42a676de444a14d23923ef8
May 28 09:42:46.917113 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:42:46.917090    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 09:42:47.111699 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:42:47.111608    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-4hf5w" event={"ID":"5ad7cf95-6679-4413-a181-4fffafbe9774","Type":"ContainerStarted","Data":"d8bf93281ea775dd6f153f4bfaf27d5ed44c8ad1b42a676de444a14d23923ef8"}
May 28 09:42:52.130158 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:42:52.130120    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-4hf5w" event={"ID":"5ad7cf95-6679-4413-a181-4fffafbe9774","Type":"ContainerStarted","Data":"311cffdb71f5f2c360c7739ce88759bb9743788b2ace12b0398c70ad3e2d0ecf"}
May 28 09:42:59.153489 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:42:59.153449    2572 generic.go:358] "Generic (PLEG): container finished" podID="5ad7cf95-6679-4413-a181-4fffafbe9774" containerID="311cffdb71f5f2c360c7739ce88759bb9743788b2ace12b0398c70ad3e2d0ecf" exitCode=0
May 28 09:42:59.153871 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:42:59.153521    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-4hf5w" event={"ID":"5ad7cf95-6679-4413-a181-4fffafbe9774","Type":"ContainerDied","Data":"311cffdb71f5f2c360c7739ce88759bb9743788b2ace12b0398c70ad3e2d0ecf"}
May 28 09:43:00.158424 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:43:00.158384    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-4hf5w" event={"ID":"5ad7cf95-6679-4413-a181-4fffafbe9774","Type":"ContainerStarted","Data":"f09a41176e1f73dce421c1f9e06fedc84f6b930597e4643714e2bd3af65e6916"}
May 28 09:43:00.177733 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:43:00.177676    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-test-apply-4hf5w" podStartSLOduration=9.35588519 podStartE2EDuration="14.177662772s" podCreationTimestamp="2026-05-28 09:42:46 +0000 UTC" firstStartedPulling="2026-05-28 09:42:46.917224323 +0000 UTC m=+695.600145084" lastFinishedPulling="2026-05-28 09:42:51.739001902 +0000 UTC m=+700.421922666" observedRunningTime="2026-05-28 09:43:00.176720825 +0000 UTC m=+708.859641599" watchObservedRunningTime="2026-05-28 09:43:00.177662772 +0000 UTC m=+708.860583555"
May 28 09:43:09.185330 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:43:09.185296    2572 generic.go:358] "Generic (PLEG): container finished" podID="5ad7cf95-6679-4413-a181-4fffafbe9774" containerID="f09a41176e1f73dce421c1f9e06fedc84f6b930597e4643714e2bd3af65e6916" exitCode=0
May 28 09:43:09.185725 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:43:09.185350    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-4hf5w" event={"ID":"5ad7cf95-6679-4413-a181-4fffafbe9774","Type":"ContainerDied","Data":"f09a41176e1f73dce421c1f9e06fedc84f6b930597e4643714e2bd3af65e6916"}
May 28 09:43:10.314811 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:43:10.314784    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-4hf5w"
May 28 09:43:10.419131 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:43:10.419080    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kflds\" (UniqueName: \"kubernetes.io/projected/5ad7cf95-6679-4413-a181-4fffafbe9774-kube-api-access-kflds\") pod \"5ad7cf95-6679-4413-a181-4fffafbe9774\" (UID: \"5ad7cf95-6679-4413-a181-4fffafbe9774\") "
May 28 09:43:10.421238 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:43:10.421208    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ad7cf95-6679-4413-a181-4fffafbe9774-kube-api-access-kflds" (OuterVolumeSpecName: "kube-api-access-kflds") pod "5ad7cf95-6679-4413-a181-4fffafbe9774" (UID: "5ad7cf95-6679-4413-a181-4fffafbe9774"). InnerVolumeSpecName "kube-api-access-kflds". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 09:43:10.520026 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:43:10.519950    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kflds\" (UniqueName: \"kubernetes.io/projected/5ad7cf95-6679-4413-a181-4fffafbe9774-kube-api-access-kflds\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:43:11.192121 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:43:11.192090    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-4hf5w"
May 28 09:43:11.192266 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:43:11.192087    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-4hf5w" event={"ID":"5ad7cf95-6679-4413-a181-4fffafbe9774","Type":"ContainerDied","Data":"d8bf93281ea775dd6f153f4bfaf27d5ed44c8ad1b42a676de444a14d23923ef8"}
May 28 09:43:11.192266 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:43:11.192199    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d8bf93281ea775dd6f153f4bfaf27d5ed44c8ad1b42a676de444a14d23923ef8"
May 28 09:43:11.394427 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:43:11.394394    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-4hf5w_5ad7cf95-6679-4413-a181-4fffafbe9774/feast-0/0.log"
May 28 09:43:11.400810 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:43:11.400773    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-4hf5w_5ad7cf95-6679-4413-a181-4fffafbe9774/feast-1/0.log"
May 28 09:43:47.978043 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:43:47.978005    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-test-apply-4hf5w"]
May 28 09:43:47.980061 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:43:47.980039    2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-test-apply-4hf5w"]
May 28 09:43:49.920251 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:43:49.920213    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ad7cf95-6679-4413-a181-4fffafbe9774" path="/var/lib/kubelet/pods/5ad7cf95-6679-4413-a181-4fffafbe9774/volumes"
May 28 09:48:41.372757 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:48:41.372721    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-j725t"]
May 28 09:48:41.373261 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:48:41.373035    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ad7cf95-6679-4413-a181-4fffafbe9774" containerName="feast-0"
May 28 09:48:41.373261 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:48:41.373047    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ad7cf95-6679-4413-a181-4fffafbe9774" containerName="feast-0"
May 28 09:48:41.373261 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:48:41.373067    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ad7cf95-6679-4413-a181-4fffafbe9774" containerName="feast-1"
May 28 09:48:41.373261 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:48:41.373073    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ad7cf95-6679-4413-a181-4fffafbe9774" containerName="feast-1"
May 28 09:48:41.373261 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:48:41.373120    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="5ad7cf95-6679-4413-a181-4fffafbe9774" containerName="feast-1"
May 28 09:48:41.375948 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:48:41.375927    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-j725t"
May 28 09:48:41.378715 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:48:41.378693    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\""
May 28 09:48:41.379738 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:48:41.379723    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\""
May 28 09:48:41.379738 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:48:41.379732    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-twxq6\""
May 28 09:48:41.386050 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:48:41.386029    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-j725t"]
May 28 09:48:41.418937 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:48:41.418904    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6dwk\" (UniqueName: \"kubernetes.io/projected/9c029cb1-3e9e-4b34-bf47-8f2600dff364-kube-api-access-f6dwk\") pod \"feast-operator-controller-manager-cf99db75-j725t\" (UID: \"9c029cb1-3e9e-4b34-bf47-8f2600dff364\") " pod="feast-operator-system/feast-operator-controller-manager-cf99db75-j725t"
May 28 09:48:41.520270 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:48:41.520229    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f6dwk\" (UniqueName: \"kubernetes.io/projected/9c029cb1-3e9e-4b34-bf47-8f2600dff364-kube-api-access-f6dwk\") pod \"feast-operator-controller-manager-cf99db75-j725t\" (UID: \"9c029cb1-3e9e-4b34-bf47-8f2600dff364\") " pod="feast-operator-system/feast-operator-controller-manager-cf99db75-j725t"
May 28 09:48:41.533515 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:48:41.533487    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6dwk\" (UniqueName: \"kubernetes.io/projected/9c029cb1-3e9e-4b34-bf47-8f2600dff364-kube-api-access-f6dwk\") pod \"feast-operator-controller-manager-cf99db75-j725t\" (UID: \"9c029cb1-3e9e-4b34-bf47-8f2600dff364\") " pod="feast-operator-system/feast-operator-controller-manager-cf99db75-j725t"
May 28 09:48:41.685885 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:48:41.685794    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-j725t"
May 28 09:48:41.822605 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:48:41.822435    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-j725t"]
May 28 09:48:41.826367 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:48:41.826329    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c029cb1_3e9e_4b34_bf47_8f2600dff364.slice/crio-46cb1ca2d3a269ef33863e93c26b3bc9a3a7e048d58e7139fb00e329b73c3d03 WatchSource:0}: Error finding container 46cb1ca2d3a269ef33863e93c26b3bc9a3a7e048d58e7139fb00e329b73c3d03: Status 404 returned error can't find the container with id 46cb1ca2d3a269ef33863e93c26b3bc9a3a7e048d58e7139fb00e329b73c3d03
May 28 09:48:41.828344 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:48:41.828322    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 09:48:42.136737 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:48:42.136700    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-j725t" event={"ID":"9c029cb1-3e9e-4b34-bf47-8f2600dff364","Type":"ContainerStarted","Data":"46cb1ca2d3a269ef33863e93c26b3bc9a3a7e048d58e7139fb00e329b73c3d03"}
May 28 09:48:45.146645 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:48:45.146596    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-j725t" event={"ID":"9c029cb1-3e9e-4b34-bf47-8f2600dff364","Type":"ContainerStarted","Data":"7270d4985bd6b4277097b38ddba01c2f1f410f1bbe5d7da35e4b96a450185ca9"}
May 28 09:48:45.147074 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:48:45.146741    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-j725t"
May 28 09:48:45.165928 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:48:45.165876    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-j725t" podStartSLOduration=1.480598955 podStartE2EDuration="4.165859365s" podCreationTimestamp="2026-05-28 09:48:41 +0000 UTC" firstStartedPulling="2026-05-28 09:48:41.828453557 +0000 UTC m=+1050.511374321" lastFinishedPulling="2026-05-28 09:48:44.513713955 +0000 UTC m=+1053.196634731" observedRunningTime="2026-05-28 09:48:45.164185932 +0000 UTC m=+1053.847106712" watchObservedRunningTime="2026-05-28 09:48:45.165859365 +0000 UTC m=+1053.848780147"
May 28 09:48:56.151929 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:48:56.151897    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-j725t"
May 28 09:48:58.172876 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:48:58.172798    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn"]
May 28 09:48:58.179611 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:48:58.179584    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn"
May 28 09:48:58.184599 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:48:58.184574    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
May 28 09:48:58.184743 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:48:58.184643    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
May 28 09:48:58.184743 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:48:58.184677    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
May 28 09:48:58.184743 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:48:58.184712    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
May 28 09:48:58.184938 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:48:58.184919    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
May 28 09:48:58.185087 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:48:58.184960    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-9c2vw\""
May 28 09:48:58.185087 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:48:58.184992    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
May 28 09:48:58.190841 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:48:58.190821    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn"]
May 28 09:48:58.255817 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:48:58.255786    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5668cbb9-b529-4fec-9a3e-ab2e2e309982-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-bf5rn\" (UID: \"5668cbb9-b529-4fec-9a3e-ab2e2e309982\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn"
May 28 09:48:58.256009 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:48:58.255833    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5668cbb9-b529-4fec-9a3e-ab2e2e309982-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-bf5rn\" (UID: \"5668cbb9-b529-4fec-9a3e-ab2e2e309982\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn"
May 28 09:48:58.256009 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:48:58.255850    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5668cbb9-b529-4fec-9a3e-ab2e2e309982-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-bf5rn\" (UID: \"5668cbb9-b529-4fec-9a3e-ab2e2e309982\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn"
May 28 09:48:58.256009 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:48:58.255933    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5668cbb9-b529-4fec-9a3e-ab2e2e309982-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-bf5rn\" (UID: \"5668cbb9-b529-4fec-9a3e-ab2e2e309982\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn"
May 28 09:48:58.256009 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:48:58.255996    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqvkg\" (UniqueName: \"kubernetes.io/projected/5668cbb9-b529-4fec-9a3e-ab2e2e309982-kube-api-access-rqvkg\") pod \"feast-simple-feast-setup-664fcfcc58-bf5rn\" (UID: \"5668cbb9-b529-4fec-9a3e-ab2e2e309982\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn"
May 28 09:48:58.256156 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:48:58.256024    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5668cbb9-b529-4fec-9a3e-ab2e2e309982-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-bf5rn\" (UID: \"5668cbb9-b529-4fec-9a3e-ab2e2e309982\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn"
May 28 09:48:58.356781 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:48:58.356741    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5668cbb9-b529-4fec-9a3e-ab2e2e309982-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-bf5rn\" (UID: \"5668cbb9-b529-4fec-9a3e-ab2e2e309982\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn"
May 28 09:48:58.356781 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:48:58.356782    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5668cbb9-b529-4fec-9a3e-ab2e2e309982-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-bf5rn\" (UID: \"5668cbb9-b529-4fec-9a3e-ab2e2e309982\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn"
May 28 09:48:58.357074 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:48:58.356808    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5668cbb9-b529-4fec-9a3e-ab2e2e309982-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-bf5rn\" (UID: \"5668cbb9-b529-4fec-9a3e-ab2e2e309982\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn"
May 28 09:48:58.357074 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:48:58.356841    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rqvkg\" (UniqueName: \"kubernetes.io/projected/5668cbb9-b529-4fec-9a3e-ab2e2e309982-kube-api-access-rqvkg\") pod \"feast-simple-feast-setup-664fcfcc58-bf5rn\" (UID: \"5668cbb9-b529-4fec-9a3e-ab2e2e309982\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn"
May 28 09:48:58.357074 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:48:58.356870    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5668cbb9-b529-4fec-9a3e-ab2e2e309982-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-bf5rn\" (UID: \"5668cbb9-b529-4fec-9a3e-ab2e2e309982\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn"
May 28 09:48:58.357074 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:48:58.356948    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5668cbb9-b529-4fec-9a3e-ab2e2e309982-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-bf5rn\" (UID: \"5668cbb9-b529-4fec-9a3e-ab2e2e309982\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn"
May 28 09:48:58.357337 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:48:58.357311    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5668cbb9-b529-4fec-9a3e-ab2e2e309982-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-bf5rn\" (UID: \"5668cbb9-b529-4fec-9a3e-ab2e2e309982\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn"
May 28 09:48:58.359417 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:48:58.359382    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5668cbb9-b529-4fec-9a3e-ab2e2e309982-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-bf5rn\" (UID: \"5668cbb9-b529-4fec-9a3e-ab2e2e309982\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn"
May 28 09:48:58.359524 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:48:58.359502    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5668cbb9-b529-4fec-9a3e-ab2e2e309982-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-bf5rn\" (UID: \"5668cbb9-b529-4fec-9a3e-ab2e2e309982\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn"
May 28 09:48:58.359590 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:48:58.359507    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5668cbb9-b529-4fec-9a3e-ab2e2e309982-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-bf5rn\" (UID: \"5668cbb9-b529-4fec-9a3e-ab2e2e309982\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn"
May 28 09:48:58.359590 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:48:58.359510    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5668cbb9-b529-4fec-9a3e-ab2e2e309982-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-bf5rn\" (UID: \"5668cbb9-b529-4fec-9a3e-ab2e2e309982\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn"
May 28 09:48:58.366249 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:48:58.366228    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqvkg\" (UniqueName: \"kubernetes.io/projected/5668cbb9-b529-4fec-9a3e-ab2e2e309982-kube-api-access-rqvkg\") pod \"feast-simple-feast-setup-664fcfcc58-bf5rn\" (UID: \"5668cbb9-b529-4fec-9a3e-ab2e2e309982\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn"
May 28 09:48:58.500463 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:48:58.500419    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn"
May 28 09:48:58.634184 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:48:58.634133    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn"]
May 28 09:48:58.638007 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:48:58.637965    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5668cbb9_b529_4fec_9a3e_ab2e2e309982.slice/crio-76ce40caede4ed943998aef62fb6e176ea19fde1c8a19fc6ea0c9c0dc7af967c WatchSource:0}: Error finding container 76ce40caede4ed943998aef62fb6e176ea19fde1c8a19fc6ea0c9c0dc7af967c: Status 404 returned error can't find the container with id 76ce40caede4ed943998aef62fb6e176ea19fde1c8a19fc6ea0c9c0dc7af967c
May 28 09:48:59.190593 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:48:59.190557    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn" event={"ID":"5668cbb9-b529-4fec-9a3e-ab2e2e309982","Type":"ContainerStarted","Data":"76ce40caede4ed943998aef62fb6e176ea19fde1c8a19fc6ea0c9c0dc7af967c"}
May 28 09:49:11.893227 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:49:11.893193    2572 scope.go:117] "RemoveContainer" containerID="311cffdb71f5f2c360c7739ce88759bb9743788b2ace12b0398c70ad3e2d0ecf"
May 28 09:49:12.902088 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:49:12.901685    2572 scope.go:117] "RemoveContainer" containerID="f09a41176e1f73dce421c1f9e06fedc84f6b930597e4643714e2bd3af65e6916"
May 28 09:49:13.238750 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:49:13.238644    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn" event={"ID":"5668cbb9-b529-4fec-9a3e-ab2e2e309982","Type":"ContainerStarted","Data":"be58a0a5ccde8b1b7deca0cb4dad8f9b4df7cd625f2c04cca56e04b1ee0bd9e5"}
May 28 09:49:18.254604 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:49:18.254563    2572 generic.go:358] "Generic (PLEG): container finished" podID="5668cbb9-b529-4fec-9a3e-ab2e2e309982" containerID="be58a0a5ccde8b1b7deca0cb4dad8f9b4df7cd625f2c04cca56e04b1ee0bd9e5" exitCode=0
May 28 09:49:18.254964 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:49:18.254632    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn" event={"ID":"5668cbb9-b529-4fec-9a3e-ab2e2e309982","Type":"ContainerDied","Data":"be58a0a5ccde8b1b7deca0cb4dad8f9b4df7cd625f2c04cca56e04b1ee0bd9e5"}
May 28 09:49:19.258716 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:49:19.258682    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn" event={"ID":"5668cbb9-b529-4fec-9a3e-ab2e2e309982","Type":"ContainerStarted","Data":"cee40be78849316b7c752af5082c87961b119b8efcddc6a1d1650bc13d9c8521"}
May 28 09:49:24.273755 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:49:24.273721    2572 generic.go:358] "Generic (PLEG): container finished" podID="5668cbb9-b529-4fec-9a3e-ab2e2e309982" containerID="cee40be78849316b7c752af5082c87961b119b8efcddc6a1d1650bc13d9c8521" exitCode=0
May 28 09:49:24.274135 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:49:24.273792    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn" event={"ID":"5668cbb9-b529-4fec-9a3e-ab2e2e309982","Type":"ContainerDied","Data":"cee40be78849316b7c752af5082c87961b119b8efcddc6a1d1650bc13d9c8521"}
May 28 09:49:25.281296 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:49:25.281255    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn" event={"ID":"5668cbb9-b529-4fec-9a3e-ab2e2e309982","Type":"ContainerStarted","Data":"0a920c782e59fa598c05becc9f94c16bc0b52b7d9a30daf0269cd7a70fd437b4"}
May 28 09:49:25.281775 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:49:25.281308    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn" event={"ID":"5668cbb9-b529-4fec-9a3e-ab2e2e309982","Type":"ContainerStarted","Data":"87d4302f691c5a0e231f698bb87f78f97b7a3521540409089b24e6543be5fccc"}
May 28 09:49:25.281775 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:49:25.281327    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn" event={"ID":"5668cbb9-b529-4fec-9a3e-ab2e2e309982","Type":"ContainerStarted","Data":"f4720d224aaff972321dbe5cb199178024dbbbd28609e1ae2adacfd8ebf28705"}
May 28 09:49:25.281775 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:49:25.281340    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn" event={"ID":"5668cbb9-b529-4fec-9a3e-ab2e2e309982","Type":"ContainerStarted","Data":"3c04e0444b5db5faba39cc88148488401a8a741fed2274624777f51a456f44f8"}
May 28 09:49:25.311729 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:49:25.311662    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn" podStartSLOduration=12.962995303 podStartE2EDuration="27.311639315s" podCreationTimestamp="2026-05-28 09:48:58 +0000 UTC" firstStartedPulling="2026-05-28 09:48:58.639681602 +0000 UTC m=+1067.322602364" lastFinishedPulling="2026-05-28 09:49:12.988325608 +0000 UTC m=+1081.671246376" observedRunningTime="2026-05-28 09:49:25.308271314 +0000 UTC m=+1093.991192121" watchObservedRunningTime="2026-05-28 09:49:25.311639315 +0000 UTC m=+1093.994560099"
May 28 09:49:25.501499 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:49:25.501452    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn"
May 28 09:49:25.501499 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:49:25.501509    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn"
May 28 09:49:25.501754 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:49:25.501524    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn"
May 28 09:49:25.501754 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:49:25.501537    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn"
May 28 09:49:25.503777 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:49:25.503626    2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn" podUID="5668cbb9-b529-4fec-9a3e-ab2e2e309982" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.24:6571: connect: connection refused"
May 28 09:49:25.503777 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:49:25.503663    2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn" podUID="5668cbb9-b529-4fec-9a3e-ab2e2e309982" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.24:8443: connect: connection refused"
May 28 09:49:25.503777 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:49:25.503686    2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn" podUID="5668cbb9-b529-4fec-9a3e-ab2e2e309982" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.24:8816: connect: connection refused"
May 28 09:49:25.503777 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:49:25.503717    2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn" podUID="5668cbb9-b529-4fec-9a3e-ab2e2e309982" containerName="online" probeResult="failure" output="Get \"https://10.134.0.24:6567/health\": dial tcp 10.134.0.24:6567: connect: connection refused"
May 28 09:49:28.501399 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:49:28.501157    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn"
May 28 09:49:28.501873 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:49:28.501442    2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn" podUID="5668cbb9-b529-4fec-9a3e-ab2e2e309982" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.24:8443: connect: connection refused"
May 28 09:49:28.501873 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:49:28.501457    2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn" podUID="5668cbb9-b529-4fec-9a3e-ab2e2e309982" containerName="online" probeResult="failure" output="Get \"https://10.134.0.24:6567/health\": dial tcp 10.134.0.24:6567: connect: connection refused"
May 28 09:49:28.501873 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:49:28.501529    2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn" podUID="5668cbb9-b529-4fec-9a3e-ab2e2e309982" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.24:8816: connect: connection refused"
May 28 09:49:28.501873 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:49:28.501594    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn"
May 28 09:49:28.501873 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:49:28.501746    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn"
May 28 09:49:28.501873 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:49:28.501774    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn"
May 28 09:49:28.501873 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:49:28.501804    2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn" podUID="5668cbb9-b529-4fec-9a3e-ab2e2e309982" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.24:6571: connect: connection refused"
May 28 09:49:31.501357 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:49:31.501323    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn"
May 28 09:49:31.501813 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:49:31.501757    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn"
May 28 09:49:31.501931 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:49:31.501918    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn"
May 28 09:49:31.502433 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:49:31.502407    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn"
May 28 09:49:31.502563 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:49:31.502540    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn"
May 28 09:49:31.502775 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:49:31.502759    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn"
May 28 09:49:31.505991 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:49:31.505963    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn"
May 28 09:49:32.307430 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:49:32.307404    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn"
May 28 09:50:35.411548 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:35.411463    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn"]
May 28 09:50:35.412131 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:35.411927    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn" podUID="5668cbb9-b529-4fec-9a3e-ab2e2e309982" containerName="registry" containerID="cri-o://3c04e0444b5db5faba39cc88148488401a8a741fed2274624777f51a456f44f8" gracePeriod=30
May 28 09:50:35.412131 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:35.412073    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn" podUID="5668cbb9-b529-4fec-9a3e-ab2e2e309982" containerName="offline" containerID="cri-o://87d4302f691c5a0e231f698bb87f78f97b7a3521540409089b24e6543be5fccc" gracePeriod=30
May 28 09:50:35.412131 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:35.412123    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn" podUID="5668cbb9-b529-4fec-9a3e-ab2e2e309982" containerName="online" containerID="cri-o://f4720d224aaff972321dbe5cb199178024dbbbd28609e1ae2adacfd8ebf28705" gracePeriod=30
May 28 09:50:35.412306 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:35.412179    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn" podUID="5668cbb9-b529-4fec-9a3e-ab2e2e309982" containerName="ui" containerID="cri-o://0a920c782e59fa598c05becc9f94c16bc0b52b7d9a30daf0269cd7a70fd437b4" gracePeriod=30
May 28 09:50:35.799936 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:35.799897    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28"]
May 28 09:50:35.803681 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:35.803661    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28"
May 28 09:50:35.806188 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:35.806168    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-j7prx\""
May 28 09:50:35.813466 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:35.813439    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28"]
May 28 09:50:35.907401 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:35.907357    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a337a030-ca4f-43a3-80d4-20147ce35a89-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-kdf28\" (UID: \"a337a030-ca4f-43a3-80d4-20147ce35a89\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28"
May 28 09:50:35.907513 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:35.907471    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a337a030-ca4f-43a3-80d4-20147ce35a89-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-kdf28\" (UID: \"a337a030-ca4f-43a3-80d4-20147ce35a89\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28"
May 28 09:50:35.907513 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:35.907499    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a337a030-ca4f-43a3-80d4-20147ce35a89-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-kdf28\" (UID: \"a337a030-ca4f-43a3-80d4-20147ce35a89\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28"
May 28 09:50:35.907598 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:35.907525    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qktg\" (UniqueName: \"kubernetes.io/projected/a337a030-ca4f-43a3-80d4-20147ce35a89-kube-api-access-5qktg\") pod \"feast-simple-feast-setup-664fcfcc58-kdf28\" (UID: \"a337a030-ca4f-43a3-80d4-20147ce35a89\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28"
May 28 09:50:35.907655 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:35.907631    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a337a030-ca4f-43a3-80d4-20147ce35a89-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-kdf28\" (UID: \"a337a030-ca4f-43a3-80d4-20147ce35a89\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28"
May 28 09:50:35.907716 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:35.907698    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a337a030-ca4f-43a3-80d4-20147ce35a89-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-kdf28\" (UID: \"a337a030-ca4f-43a3-80d4-20147ce35a89\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28"
May 28 09:50:36.008418 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:36.008379    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a337a030-ca4f-43a3-80d4-20147ce35a89-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-kdf28\" (UID: \"a337a030-ca4f-43a3-80d4-20147ce35a89\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28"
May 28 09:50:36.008418 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:36.008422    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a337a030-ca4f-43a3-80d4-20147ce35a89-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-kdf28\" (UID: \"a337a030-ca4f-43a3-80d4-20147ce35a89\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28"
May 28 09:50:36.008650 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:36.008438    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5qktg\" (UniqueName: \"kubernetes.io/projected/a337a030-ca4f-43a3-80d4-20147ce35a89-kube-api-access-5qktg\") pod \"feast-simple-feast-setup-664fcfcc58-kdf28\" (UID: \"a337a030-ca4f-43a3-80d4-20147ce35a89\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28"
May 28 09:50:36.008650 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:36.008489    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a337a030-ca4f-43a3-80d4-20147ce35a89-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-kdf28\" (UID: \"a337a030-ca4f-43a3-80d4-20147ce35a89\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28"
May 28 09:50:36.008650 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:36.008513    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a337a030-ca4f-43a3-80d4-20147ce35a89-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-kdf28\" (UID: \"a337a030-ca4f-43a3-80d4-20147ce35a89\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28"
May 28 09:50:36.008650 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:50:36.008554    2572 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
May 28 09:50:36.008650 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:50:36.008638    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a337a030-ca4f-43a3-80d4-20147ce35a89-online-tls podName:a337a030-ca4f-43a3-80d4-20147ce35a89 nodeName:}" failed. No retries permitted until 2026-05-28 09:50:36.508616114 +0000 UTC m=+1165.191536888 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/a337a030-ca4f-43a3-80d4-20147ce35a89-online-tls") pod "feast-simple-feast-setup-664fcfcc58-kdf28" (UID: "a337a030-ca4f-43a3-80d4-20147ce35a89") : secret "feast-simple-feast-setup-online-tls" not found
May 28 09:50:36.008940 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:36.008564    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a337a030-ca4f-43a3-80d4-20147ce35a89-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-kdf28\" (UID: \"a337a030-ca4f-43a3-80d4-20147ce35a89\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28"
May 28 09:50:36.009067 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:36.009049    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a337a030-ca4f-43a3-80d4-20147ce35a89-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-kdf28\" (UID: \"a337a030-ca4f-43a3-80d4-20147ce35a89\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28"
May 28 09:50:36.011173 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:36.011148    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a337a030-ca4f-43a3-80d4-20147ce35a89-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-kdf28\" (UID: \"a337a030-ca4f-43a3-80d4-20147ce35a89\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28"
May 28 09:50:36.011261 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:36.011152    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a337a030-ca4f-43a3-80d4-20147ce35a89-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-kdf28\" (UID: \"a337a030-ca4f-43a3-80d4-20147ce35a89\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28"
May 28 09:50:36.011261 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:36.011150    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a337a030-ca4f-43a3-80d4-20147ce35a89-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-kdf28\" (UID: \"a337a030-ca4f-43a3-80d4-20147ce35a89\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28"
May 28 09:50:36.017253 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:36.017230    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qktg\" (UniqueName: \"kubernetes.io/projected/a337a030-ca4f-43a3-80d4-20147ce35a89-kube-api-access-5qktg\") pod \"feast-simple-feast-setup-664fcfcc58-kdf28\" (UID: \"a337a030-ca4f-43a3-80d4-20147ce35a89\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28"
May 28 09:50:36.489402 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:36.489312    2572 generic.go:358] "Generic (PLEG): container finished" podID="5668cbb9-b529-4fec-9a3e-ab2e2e309982" containerID="0a920c782e59fa598c05becc9f94c16bc0b52b7d9a30daf0269cd7a70fd437b4" exitCode=0
May 28 09:50:36.489402 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:36.489340    2572 generic.go:358] "Generic (PLEG): container finished" podID="5668cbb9-b529-4fec-9a3e-ab2e2e309982" containerID="f4720d224aaff972321dbe5cb199178024dbbbd28609e1ae2adacfd8ebf28705" exitCode=0
May 28 09:50:36.489402 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:36.489384    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn" event={"ID":"5668cbb9-b529-4fec-9a3e-ab2e2e309982","Type":"ContainerDied","Data":"0a920c782e59fa598c05becc9f94c16bc0b52b7d9a30daf0269cd7a70fd437b4"}
May 28 09:50:36.489797 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:36.489416    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn" event={"ID":"5668cbb9-b529-4fec-9a3e-ab2e2e309982","Type":"ContainerDied","Data":"f4720d224aaff972321dbe5cb199178024dbbbd28609e1ae2adacfd8ebf28705"}
May 28 09:50:36.513481 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:36.513454    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a337a030-ca4f-43a3-80d4-20147ce35a89-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-kdf28\" (UID: \"a337a030-ca4f-43a3-80d4-20147ce35a89\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28"
May 28 09:50:36.515914 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:36.515879    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a337a030-ca4f-43a3-80d4-20147ce35a89-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-kdf28\" (UID: \"a337a030-ca4f-43a3-80d4-20147ce35a89\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28"
May 28 09:50:36.715169 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:36.715136    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28"
May 28 09:50:36.848367 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:36.848338    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28"]
May 28 09:50:36.850445 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:50:36.850420    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda337a030_ca4f_43a3_80d4_20147ce35a89.slice/crio-a7e2cd1f8b00b99167fbcc66230072a6feeaaaf63a05599fe884e7a4b4833c59 WatchSource:0}: Error finding container a7e2cd1f8b00b99167fbcc66230072a6feeaaaf63a05599fe884e7a4b4833c59: Status 404 returned error can't find the container with id a7e2cd1f8b00b99167fbcc66230072a6feeaaaf63a05599fe884e7a4b4833c59
May 28 09:50:37.493192 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:37.493148    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28" event={"ID":"a337a030-ca4f-43a3-80d4-20147ce35a89","Type":"ContainerStarted","Data":"fdc64768c59641c2f2ec257a1614174ea3eb2aae8caacf8313eec6660ff855c9"}
May 28 09:50:37.493546 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:37.493199    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28" event={"ID":"a337a030-ca4f-43a3-80d4-20147ce35a89","Type":"ContainerStarted","Data":"a7e2cd1f8b00b99167fbcc66230072a6feeaaaf63a05599fe884e7a4b4833c59"}
May 28 09:50:41.503371 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:41.503325    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn" podUID="5668cbb9-b529-4fec-9a3e-ab2e2e309982" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.24:8443: connect: connection refused"
May 28 09:50:41.507234 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:41.507212    2572 generic.go:358] "Generic (PLEG): container finished" podID="a337a030-ca4f-43a3-80d4-20147ce35a89" containerID="fdc64768c59641c2f2ec257a1614174ea3eb2aae8caacf8313eec6660ff855c9" exitCode=0
May 28 09:50:41.507326 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:41.507280    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28" event={"ID":"a337a030-ca4f-43a3-80d4-20147ce35a89","Type":"ContainerDied","Data":"fdc64768c59641c2f2ec257a1614174ea3eb2aae8caacf8313eec6660ff855c9"}
May 28 09:50:42.305393 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:42.305356    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn" podUID="5668cbb9-b529-4fec-9a3e-ab2e2e309982" containerName="online" probeResult="failure" output="Get \"https://10.134.0.24:6567/health\": dial tcp 10.134.0.24:6567: connect: connection refused"
May 28 09:50:42.511528 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:42.511497    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28" event={"ID":"a337a030-ca4f-43a3-80d4-20147ce35a89","Type":"ContainerStarted","Data":"bc8d315f175987cb5d090d9a1995d49d14367e49c564cfe47e41ce15cc987371"}
May 28 09:50:47.527082 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:47.527046    2572 generic.go:358] "Generic (PLEG): container finished" podID="a337a030-ca4f-43a3-80d4-20147ce35a89" containerID="bc8d315f175987cb5d090d9a1995d49d14367e49c564cfe47e41ce15cc987371" exitCode=0
May 28 09:50:47.527446 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:47.527104    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28" event={"ID":"a337a030-ca4f-43a3-80d4-20147ce35a89","Type":"ContainerDied","Data":"bc8d315f175987cb5d090d9a1995d49d14367e49c564cfe47e41ce15cc987371"}
May 28 09:50:48.540191 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:48.540127    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28" event={"ID":"a337a030-ca4f-43a3-80d4-20147ce35a89","Type":"ContainerStarted","Data":"0976821a35baeb0d7d19267f38638fa688236b10e21e77c13d79301be7bb8729"}
May 28 09:50:48.540191 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:48.540197    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28" event={"ID":"a337a030-ca4f-43a3-80d4-20147ce35a89","Type":"ContainerStarted","Data":"82bc0d2479330d74df236eb330966784a9c505299475b874c050c35d37b18014"}
May 28 09:50:48.540715 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:48.540212    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28" event={"ID":"a337a030-ca4f-43a3-80d4-20147ce35a89","Type":"ContainerStarted","Data":"e31039c0c93f7cb8caddf357142c47117a8252ac1f6bef381fd9ff162eba7458"}
May 28 09:50:48.540715 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:48.540239    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28" event={"ID":"a337a030-ca4f-43a3-80d4-20147ce35a89","Type":"ContainerStarted","Data":"8459a9946071e2ad7d665d530f07a4e4d63b0d35d92d9275afc0c6b522db5826"}
May 28 09:50:48.569812 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:48.569743    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28" podStartSLOduration=13.569722239 podStartE2EDuration="13.569722239s" podCreationTimestamp="2026-05-28 09:50:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 09:50:48.568390517 +0000 UTC m=+1177.251311311" watchObservedRunningTime="2026-05-28 09:50:48.569722239 +0000 UTC m=+1177.252643024"
May 28 09:50:48.715660 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:48.715557    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28"
May 28 09:50:48.715660 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:48.715604    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28"
May 28 09:50:48.715660 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:48.715618    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28"
May 28 09:50:48.715660 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:48.715630    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28"
May 28 09:50:48.717936 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:48.717886    2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28" podUID="a337a030-ca4f-43a3-80d4-20147ce35a89" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.25:8443: connect: connection refused"
May 28 09:50:48.718079 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:48.718019    2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28" podUID="a337a030-ca4f-43a3-80d4-20147ce35a89" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.25:8816: connect: connection refused"
May 28 09:50:48.718161 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:48.718026    2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28" podUID="a337a030-ca4f-43a3-80d4-20147ce35a89" containerName="online" probeResult="failure" output="Get \"https://10.134.0.25:6567/health\": dial tcp 10.134.0.25:6567: connect: connection refused"
May 28 09:50:48.718224 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:48.718166    2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28" podUID="a337a030-ca4f-43a3-80d4-20147ce35a89" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.25:6571: connect: connection refused"
May 28 09:50:51.503492 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:51.503441    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn" podUID="5668cbb9-b529-4fec-9a3e-ab2e2e309982" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.24:8443: connect: connection refused"
May 28 09:50:51.716189 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:51.716140    2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28" podUID="a337a030-ca4f-43a3-80d4-20147ce35a89" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.25:8443: connect: connection refused"
May 28 09:50:51.716479 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:51.716140    2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28" podUID="a337a030-ca4f-43a3-80d4-20147ce35a89" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.25:6571: connect: connection refused"
May 28 09:50:51.716682 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:51.716155    2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28" podUID="a337a030-ca4f-43a3-80d4-20147ce35a89" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.25:8816: connect: connection refused"
May 28 09:50:51.717446 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:51.716227    2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28" podUID="a337a030-ca4f-43a3-80d4-20147ce35a89" containerName="online" probeResult="failure" output="Get \"https://10.134.0.25:6567/health\": dial tcp 10.134.0.25:6567: connect: connection refused"
May 28 09:50:52.305083 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:52.305024    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn" podUID="5668cbb9-b529-4fec-9a3e-ab2e2e309982" containerName="online" probeResult="failure" output="Get \"https://10.134.0.24:6567/health\": dial tcp 10.134.0.24:6567: connect: connection refused"
May 28 09:50:54.716344 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:54.716310    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28"
May 28 09:50:54.716695 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:54.716422    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28"
May 28 09:50:54.716749 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:54.716690    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28"
May 28 09:50:54.717151 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:54.717081    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28"
May 28 09:50:54.717151 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:54.717118    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28"
May 28 09:50:54.717151 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:54.717131    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28"
May 28 09:50:54.717429 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:54.717238    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28"
May 28 09:50:54.717429 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:54.717316    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28"
May 28 09:50:54.717586 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:54.717572    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28"
May 28 09:50:54.721062 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:54.721047    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28"
May 28 09:50:55.575496 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:55.575469    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28"
May 28 09:50:55.578365 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:50:55.578348    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28"
May 28 09:51:01.503375 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:01.503323    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn" podUID="5668cbb9-b529-4fec-9a3e-ab2e2e309982" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.24:8443: connect: connection refused"
May 28 09:51:01.503805 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:01.503466    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn"
May 28 09:51:02.305547 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:02.305500    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn" podUID="5668cbb9-b529-4fec-9a3e-ab2e2e309982" containerName="online" probeResult="failure" output="Get \"https://10.134.0.24:6567/health\": dial tcp 10.134.0.24:6567: connect: connection refused"
May 28 09:51:02.305735 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:02.305630    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn"
May 28 09:51:05.607830 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:05.607795    2572 generic.go:358] "Generic (PLEG): container finished" podID="5668cbb9-b529-4fec-9a3e-ab2e2e309982" containerID="87d4302f691c5a0e231f698bb87f78f97b7a3521540409089b24e6543be5fccc" exitCode=137
May 28 09:51:05.607830 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:05.607822    2572 generic.go:358] "Generic (PLEG): container finished" podID="5668cbb9-b529-4fec-9a3e-ab2e2e309982" containerID="3c04e0444b5db5faba39cc88148488401a8a741fed2274624777f51a456f44f8" exitCode=137
May 28 09:51:05.608235 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:05.607863    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn" event={"ID":"5668cbb9-b529-4fec-9a3e-ab2e2e309982","Type":"ContainerDied","Data":"87d4302f691c5a0e231f698bb87f78f97b7a3521540409089b24e6543be5fccc"}
May 28 09:51:05.608235 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:05.607894    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn" event={"ID":"5668cbb9-b529-4fec-9a3e-ab2e2e309982","Type":"ContainerDied","Data":"3c04e0444b5db5faba39cc88148488401a8a741fed2274624777f51a456f44f8"}
May 28 09:51:06.060767 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:06.060744    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn"
May 28 09:51:06.183385 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:06.183290    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5668cbb9-b529-4fec-9a3e-ab2e2e309982-ui-tls\") pod \"5668cbb9-b529-4fec-9a3e-ab2e2e309982\" (UID: \"5668cbb9-b529-4fec-9a3e-ab2e2e309982\") "
May 28 09:51:06.183385 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:06.183369    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rqvkg\" (UniqueName: \"kubernetes.io/projected/5668cbb9-b529-4fec-9a3e-ab2e2e309982-kube-api-access-rqvkg\") pod \"5668cbb9-b529-4fec-9a3e-ab2e2e309982\" (UID: \"5668cbb9-b529-4fec-9a3e-ab2e2e309982\") "
May 28 09:51:06.183628 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:06.183407    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5668cbb9-b529-4fec-9a3e-ab2e2e309982-registry-tls\") pod \"5668cbb9-b529-4fec-9a3e-ab2e2e309982\" (UID: \"5668cbb9-b529-4fec-9a3e-ab2e2e309982\") "
May 28 09:51:06.183628 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:06.183429    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5668cbb9-b529-4fec-9a3e-ab2e2e309982-feast-data\") pod \"5668cbb9-b529-4fec-9a3e-ab2e2e309982\" (UID: \"5668cbb9-b529-4fec-9a3e-ab2e2e309982\") "
May 28 09:51:06.183628 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:06.183456    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5668cbb9-b529-4fec-9a3e-ab2e2e309982-online-tls\") pod \"5668cbb9-b529-4fec-9a3e-ab2e2e309982\" (UID: \"5668cbb9-b529-4fec-9a3e-ab2e2e309982\") "
May 28 09:51:06.183628 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:06.183491    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5668cbb9-b529-4fec-9a3e-ab2e2e309982-offline-tls\") pod \"5668cbb9-b529-4fec-9a3e-ab2e2e309982\" (UID: \"5668cbb9-b529-4fec-9a3e-ab2e2e309982\") "
May 28 09:51:06.184030 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:06.184002    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5668cbb9-b529-4fec-9a3e-ab2e2e309982-feast-data" (OuterVolumeSpecName: "feast-data") pod "5668cbb9-b529-4fec-9a3e-ab2e2e309982" (UID: "5668cbb9-b529-4fec-9a3e-ab2e2e309982"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 09:51:06.185782 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:06.185750    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5668cbb9-b529-4fec-9a3e-ab2e2e309982-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "5668cbb9-b529-4fec-9a3e-ab2e2e309982" (UID: "5668cbb9-b529-4fec-9a3e-ab2e2e309982"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:51:06.186070 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:06.186030    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5668cbb9-b529-4fec-9a3e-ab2e2e309982-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "5668cbb9-b529-4fec-9a3e-ab2e2e309982" (UID: "5668cbb9-b529-4fec-9a3e-ab2e2e309982"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:51:06.186169 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:06.186113    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5668cbb9-b529-4fec-9a3e-ab2e2e309982-kube-api-access-rqvkg" (OuterVolumeSpecName: "kube-api-access-rqvkg") pod "5668cbb9-b529-4fec-9a3e-ab2e2e309982" (UID: "5668cbb9-b529-4fec-9a3e-ab2e2e309982"). InnerVolumeSpecName "kube-api-access-rqvkg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 09:51:06.186169 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:06.186139    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5668cbb9-b529-4fec-9a3e-ab2e2e309982-online-tls" (OuterVolumeSpecName: "online-tls") pod "5668cbb9-b529-4fec-9a3e-ab2e2e309982" (UID: "5668cbb9-b529-4fec-9a3e-ab2e2e309982"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:51:06.186295 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:06.186274    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5668cbb9-b529-4fec-9a3e-ab2e2e309982-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "5668cbb9-b529-4fec-9a3e-ab2e2e309982" (UID: "5668cbb9-b529-4fec-9a3e-ab2e2e309982"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:51:06.284554 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:06.284520    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rqvkg\" (UniqueName: \"kubernetes.io/projected/5668cbb9-b529-4fec-9a3e-ab2e2e309982-kube-api-access-rqvkg\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:51:06.284554 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:06.284550    2572 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5668cbb9-b529-4fec-9a3e-ab2e2e309982-registry-tls\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:51:06.284554 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:06.284560    2572 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5668cbb9-b529-4fec-9a3e-ab2e2e309982-feast-data\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:51:06.284772 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:06.284568    2572 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5668cbb9-b529-4fec-9a3e-ab2e2e309982-online-tls\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:51:06.284772 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:06.284590    2572 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5668cbb9-b529-4fec-9a3e-ab2e2e309982-offline-tls\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:51:06.284772 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:06.284598    2572 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5668cbb9-b529-4fec-9a3e-ab2e2e309982-ui-tls\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:51:06.613457 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:06.613420    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn" event={"ID":"5668cbb9-b529-4fec-9a3e-ab2e2e309982","Type":"ContainerDied","Data":"76ce40caede4ed943998aef62fb6e176ea19fde1c8a19fc6ea0c9c0dc7af967c"}
May 28 09:51:06.613955 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:06.613465    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn"
May 28 09:51:06.613955 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:06.613475    2572 scope.go:117] "RemoveContainer" containerID="0a920c782e59fa598c05becc9f94c16bc0b52b7d9a30daf0269cd7a70fd437b4"
May 28 09:51:06.622793 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:06.622771    2572 scope.go:117] "RemoveContainer" containerID="87d4302f691c5a0e231f698bb87f78f97b7a3521540409089b24e6543be5fccc"
May 28 09:51:06.630185 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:06.630165    2572 scope.go:117] "RemoveContainer" containerID="f4720d224aaff972321dbe5cb199178024dbbbd28609e1ae2adacfd8ebf28705"
May 28 09:51:06.636950 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:06.636931    2572 scope.go:117] "RemoveContainer" containerID="3c04e0444b5db5faba39cc88148488401a8a741fed2274624777f51a456f44f8"
May 28 09:51:06.640128 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:06.640107    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn"]
May 28 09:51:06.643936 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:06.643913    2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-bf5rn"]
May 28 09:51:06.644774 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:06.644759    2572 scope.go:117] "RemoveContainer" containerID="cee40be78849316b7c752af5082c87961b119b8efcddc6a1d1650bc13d9c8521"
May 28 09:51:06.651799 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:06.651781    2572 scope.go:117] "RemoveContainer" containerID="be58a0a5ccde8b1b7deca0cb4dad8f9b4df7cd625f2c04cca56e04b1ee0bd9e5"
May 28 09:51:07.919575 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:07.919536    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5668cbb9-b529-4fec-9a3e-ab2e2e309982" path="/var/lib/kubelet/pods/5668cbb9-b529-4fec-9a3e-ab2e2e309982/volumes"
May 28 09:51:57.502628 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:57.502594    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz"]
May 28 09:51:57.503107 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:57.502908    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5668cbb9-b529-4fec-9a3e-ab2e2e309982" containerName="offline"
May 28 09:51:57.503107 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:57.502919    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="5668cbb9-b529-4fec-9a3e-ab2e2e309982" containerName="offline"
May 28 09:51:57.503107 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:57.502930    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5668cbb9-b529-4fec-9a3e-ab2e2e309982" containerName="registry"
May 28 09:51:57.503107 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:57.502936    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="5668cbb9-b529-4fec-9a3e-ab2e2e309982" containerName="registry"
May 28 09:51:57.503107 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:57.502944    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5668cbb9-b529-4fec-9a3e-ab2e2e309982" containerName="online"
May 28 09:51:57.503107 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:57.502950    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="5668cbb9-b529-4fec-9a3e-ab2e2e309982" containerName="online"
May 28 09:51:57.503107 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:57.502957    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5668cbb9-b529-4fec-9a3e-ab2e2e309982" containerName="feast-init"
May 28 09:51:57.503107 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:57.502962    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="5668cbb9-b529-4fec-9a3e-ab2e2e309982" containerName="feast-init"
May 28 09:51:57.503107 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:57.502982    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5668cbb9-b529-4fec-9a3e-ab2e2e309982" containerName="feast-apply"
May 28 09:51:57.503107 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:57.502987    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="5668cbb9-b529-4fec-9a3e-ab2e2e309982" containerName="feast-apply"
May 28 09:51:57.503107 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:57.502994    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5668cbb9-b529-4fec-9a3e-ab2e2e309982" containerName="ui"
May 28 09:51:57.503107 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:57.502999    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="5668cbb9-b529-4fec-9a3e-ab2e2e309982" containerName="ui"
May 28 09:51:57.503107 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:57.503050    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="5668cbb9-b529-4fec-9a3e-ab2e2e309982" containerName="online"
May 28 09:51:57.503107 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:57.503060    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="5668cbb9-b529-4fec-9a3e-ab2e2e309982" containerName="registry"
May 28 09:51:57.503107 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:57.503067    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="5668cbb9-b529-4fec-9a3e-ab2e2e309982" containerName="offline"
May 28 09:51:57.503107 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:57.503082    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="5668cbb9-b529-4fec-9a3e-ab2e2e309982" containerName="ui"
May 28 09:51:57.505271 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:57.505253    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz"
May 28 09:51:57.508038 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:57.508009    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-lhjdm\""
May 28 09:51:57.508279 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:57.508263    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
May 28 09:51:57.508376 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:57.508361    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
May 28 09:51:57.508678 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:57.508662    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
May 28 09:51:57.508734 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:57.508684    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
May 28 09:51:57.508734 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:57.508721    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
May 28 09:51:57.508815 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:57.508775    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
May 28 09:51:57.520267 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:57.520243    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz"]
May 28 09:51:57.598442 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:57.598408    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b0ce7882-8c06-4f0f-8330-a2f1dbd9380b-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-x7cnz\" (UID: \"b0ce7882-8c06-4f0f-8330-a2f1dbd9380b\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz"
May 28 09:51:57.598622 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:57.598451    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b0ce7882-8c06-4f0f-8330-a2f1dbd9380b-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-x7cnz\" (UID: \"b0ce7882-8c06-4f0f-8330-a2f1dbd9380b\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz"
May 28 09:51:57.598622 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:57.598478    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b0ce7882-8c06-4f0f-8330-a2f1dbd9380b-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-x7cnz\" (UID: \"b0ce7882-8c06-4f0f-8330-a2f1dbd9380b\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz"
May 28 09:51:57.598622 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:57.598540    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zlb7\" (UniqueName: \"kubernetes.io/projected/b0ce7882-8c06-4f0f-8330-a2f1dbd9380b-kube-api-access-2zlb7\") pod \"feast-simple-feast-remote-setup-5cff94746b-x7cnz\" (UID: \"b0ce7882-8c06-4f0f-8330-a2f1dbd9380b\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz"
May 28 09:51:57.598622 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:57.598604    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/b0ce7882-8c06-4f0f-8330-a2f1dbd9380b-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-x7cnz\" (UID: \"b0ce7882-8c06-4f0f-8330-a2f1dbd9380b\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz"
May 28 09:51:57.598769 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:57.598627    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b0ce7882-8c06-4f0f-8330-a2f1dbd9380b-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-x7cnz\" (UID: \"b0ce7882-8c06-4f0f-8330-a2f1dbd9380b\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz"
May 28 09:51:57.699401 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:57.699361    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/b0ce7882-8c06-4f0f-8330-a2f1dbd9380b-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-x7cnz\" (UID: \"b0ce7882-8c06-4f0f-8330-a2f1dbd9380b\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz"
May 28 09:51:57.699401 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:57.699402    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b0ce7882-8c06-4f0f-8330-a2f1dbd9380b-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-x7cnz\" (UID: \"b0ce7882-8c06-4f0f-8330-a2f1dbd9380b\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz"
May 28 09:51:57.699620 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:57.699428    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b0ce7882-8c06-4f0f-8330-a2f1dbd9380b-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-x7cnz\" (UID: \"b0ce7882-8c06-4f0f-8330-a2f1dbd9380b\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz"
May 28 09:51:57.699620 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:57.699458    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b0ce7882-8c06-4f0f-8330-a2f1dbd9380b-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-x7cnz\" (UID: \"b0ce7882-8c06-4f0f-8330-a2f1dbd9380b\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz"
May 28 09:51:57.699620 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:57.699484    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b0ce7882-8c06-4f0f-8330-a2f1dbd9380b-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-x7cnz\" (UID: \"b0ce7882-8c06-4f0f-8330-a2f1dbd9380b\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz"
May 28 09:51:57.699620 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:57.699514    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2zlb7\" (UniqueName: \"kubernetes.io/projected/b0ce7882-8c06-4f0f-8330-a2f1dbd9380b-kube-api-access-2zlb7\") pod \"feast-simple-feast-remote-setup-5cff94746b-x7cnz\" (UID: \"b0ce7882-8c06-4f0f-8330-a2f1dbd9380b\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz"
May 28 09:51:57.699620 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:51:57.699514    2572 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-ui-tls: secret "feast-simple-feast-remote-setup-ui-tls" not found
May 28 09:51:57.699620 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:51:57.699586    2572 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-offline-tls: secret "feast-simple-feast-remote-setup-offline-tls" not found
May 28 09:51:57.699620 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:51:57.699619    2572 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-online-tls: secret "feast-simple-feast-remote-setup-online-tls" not found
May 28 09:51:57.699868 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:51:57.699591    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0ce7882-8c06-4f0f-8330-a2f1dbd9380b-ui-tls podName:b0ce7882-8c06-4f0f-8330-a2f1dbd9380b nodeName:}" failed. No retries permitted until 2026-05-28 09:51:58.199569455 +0000 UTC m=+1246.882490216 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/b0ce7882-8c06-4f0f-8330-a2f1dbd9380b-ui-tls") pod "feast-simple-feast-remote-setup-5cff94746b-x7cnz" (UID: "b0ce7882-8c06-4f0f-8330-a2f1dbd9380b") : secret "feast-simple-feast-remote-setup-ui-tls" not found
May 28 09:51:57.699868 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:51:57.699669    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0ce7882-8c06-4f0f-8330-a2f1dbd9380b-offline-tls podName:b0ce7882-8c06-4f0f-8330-a2f1dbd9380b nodeName:}" failed. No retries permitted until 2026-05-28 09:51:58.199650774 +0000 UTC m=+1246.882571540 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/b0ce7882-8c06-4f0f-8330-a2f1dbd9380b-offline-tls") pod "feast-simple-feast-remote-setup-5cff94746b-x7cnz" (UID: "b0ce7882-8c06-4f0f-8330-a2f1dbd9380b") : secret "feast-simple-feast-remote-setup-offline-tls" not found
May 28 09:51:57.699868 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:51:57.699688    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0ce7882-8c06-4f0f-8330-a2f1dbd9380b-online-tls podName:b0ce7882-8c06-4f0f-8330-a2f1dbd9380b nodeName:}" failed. No retries permitted until 2026-05-28 09:51:58.199677769 +0000 UTC m=+1246.882598531 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/b0ce7882-8c06-4f0f-8330-a2f1dbd9380b-online-tls") pod "feast-simple-feast-remote-setup-5cff94746b-x7cnz" (UID: "b0ce7882-8c06-4f0f-8330-a2f1dbd9380b") : secret "feast-simple-feast-remote-setup-online-tls" not found
May 28 09:51:57.700030 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:57.699866    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b0ce7882-8c06-4f0f-8330-a2f1dbd9380b-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-x7cnz\" (UID: \"b0ce7882-8c06-4f0f-8330-a2f1dbd9380b\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz"
May 28 09:51:57.700107 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:57.700091    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/b0ce7882-8c06-4f0f-8330-a2f1dbd9380b-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-x7cnz\" (UID: \"b0ce7882-8c06-4f0f-8330-a2f1dbd9380b\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz"
May 28 09:51:57.710788 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:57.710762    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zlb7\" (UniqueName: \"kubernetes.io/projected/b0ce7882-8c06-4f0f-8330-a2f1dbd9380b-kube-api-access-2zlb7\") pod \"feast-simple-feast-remote-setup-5cff94746b-x7cnz\" (UID: \"b0ce7882-8c06-4f0f-8330-a2f1dbd9380b\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz"
May 28 09:51:58.204052 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:58.203955    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b0ce7882-8c06-4f0f-8330-a2f1dbd9380b-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-x7cnz\" (UID: \"b0ce7882-8c06-4f0f-8330-a2f1dbd9380b\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz"
May 28 09:51:58.204052 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:58.204050    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b0ce7882-8c06-4f0f-8330-a2f1dbd9380b-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-x7cnz\" (UID: \"b0ce7882-8c06-4f0f-8330-a2f1dbd9380b\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz"
May 28 09:51:58.204230 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:58.204082    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b0ce7882-8c06-4f0f-8330-a2f1dbd9380b-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-x7cnz\" (UID: \"b0ce7882-8c06-4f0f-8330-a2f1dbd9380b\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz"
May 28 09:51:58.206381 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:58.206350    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b0ce7882-8c06-4f0f-8330-a2f1dbd9380b-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-x7cnz\" (UID: \"b0ce7882-8c06-4f0f-8330-a2f1dbd9380b\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz"
May 28 09:51:58.206521 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:58.206427    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b0ce7882-8c06-4f0f-8330-a2f1dbd9380b-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-x7cnz\" (UID: \"b0ce7882-8c06-4f0f-8330-a2f1dbd9380b\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz"
May 28 09:51:58.206598 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:58.206575    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b0ce7882-8c06-4f0f-8330-a2f1dbd9380b-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-x7cnz\" (UID: \"b0ce7882-8c06-4f0f-8330-a2f1dbd9380b\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz"
May 28 09:51:58.414613 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:58.414579    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz"
May 28 09:51:58.553039 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:58.553009    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz"]
May 28 09:51:58.554297 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:51:58.554268    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb0ce7882_8c06_4f0f_8330_a2f1dbd9380b.slice/crio-858f60a9ab144bdf93bec339e14fae23ca73039dd40b495d2d2868f15e065192 WatchSource:0}: Error finding container 858f60a9ab144bdf93bec339e14fae23ca73039dd40b495d2d2868f15e065192: Status 404 returned error can't find the container with id 858f60a9ab144bdf93bec339e14fae23ca73039dd40b495d2d2868f15e065192
May 28 09:51:58.764256 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:58.764215    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz" event={"ID":"b0ce7882-8c06-4f0f-8330-a2f1dbd9380b","Type":"ContainerStarted","Data":"a7ac70c9c8d4ff66b2278d09a576e9c64d442a0ca2898a84a52d721f1838752b"}
May 28 09:51:58.764256 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:51:58.764252    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz" event={"ID":"b0ce7882-8c06-4f0f-8330-a2f1dbd9380b","Type":"ContainerStarted","Data":"858f60a9ab144bdf93bec339e14fae23ca73039dd40b495d2d2868f15e065192"}
May 28 09:52:03.780217 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:52:03.780182    2572 generic.go:358] "Generic (PLEG): container finished" podID="b0ce7882-8c06-4f0f-8330-a2f1dbd9380b" containerID="a7ac70c9c8d4ff66b2278d09a576e9c64d442a0ca2898a84a52d721f1838752b" exitCode=0
May 28 09:52:03.780600 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:52:03.780254    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz" event={"ID":"b0ce7882-8c06-4f0f-8330-a2f1dbd9380b","Type":"ContainerDied","Data":"a7ac70c9c8d4ff66b2278d09a576e9c64d442a0ca2898a84a52d721f1838752b"}
May 28 09:52:04.785116 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:52:04.785072    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz" event={"ID":"b0ce7882-8c06-4f0f-8330-a2f1dbd9380b","Type":"ContainerStarted","Data":"2e38cd6beaa2659ddec1c0f6402517a5aef83e8684afb1d4a1c4ceb75efe1bf5"}
May 28 09:52:09.801004 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:52:09.800942    2572 generic.go:358] "Generic (PLEG): container finished" podID="b0ce7882-8c06-4f0f-8330-a2f1dbd9380b" containerID="2e38cd6beaa2659ddec1c0f6402517a5aef83e8684afb1d4a1c4ceb75efe1bf5" exitCode=0
May 28 09:52:09.801357 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:52:09.801025    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz" event={"ID":"b0ce7882-8c06-4f0f-8330-a2f1dbd9380b","Type":"ContainerDied","Data":"2e38cd6beaa2659ddec1c0f6402517a5aef83e8684afb1d4a1c4ceb75efe1bf5"}
May 28 09:52:10.806872 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:52:10.806831    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz" event={"ID":"b0ce7882-8c06-4f0f-8330-a2f1dbd9380b","Type":"ContainerStarted","Data":"9470c7e26fb5775dab00baf3139c56530ce0f549cbfdcab1a8b52abd8b3b25e7"}
May 28 09:52:10.807273 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:52:10.806886    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz" event={"ID":"b0ce7882-8c06-4f0f-8330-a2f1dbd9380b","Type":"ContainerStarted","Data":"595b881c95c557f47aa9b23ad6b7f8a0df8e2e2c7791ffceea2636a74334d28c"}
May 28 09:52:10.807273 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:52:10.806915    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz" event={"ID":"b0ce7882-8c06-4f0f-8330-a2f1dbd9380b","Type":"ContainerStarted","Data":"ba7c647093a82626cadd049352c821b54ed44cd9f4ef5393a3c89f71b9147ba2"}
May 28 09:52:10.844270 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:52:10.844181    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz" podStartSLOduration=13.844168304 podStartE2EDuration="13.844168304s" podCreationTimestamp="2026-05-28 09:51:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 09:52:10.843155813 +0000 UTC m=+1259.526076597" watchObservedRunningTime="2026-05-28 09:52:10.844168304 +0000 UTC m=+1259.527089086"
May 28 09:52:13.415555 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:52:13.415509    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz"
May 28 09:52:13.415555 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:52:13.415557    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz"
May 28 09:52:13.416103 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:52:13.415569    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz"
May 28 09:52:13.417158 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:52:13.417108    2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz" podUID="b0ce7882-8c06-4f0f-8330-a2f1dbd9380b" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.26:8443: connect: connection refused"
May 28 09:52:13.417382 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:52:13.417125    2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz" podUID="b0ce7882-8c06-4f0f-8330-a2f1dbd9380b" containerName="online" probeResult="failure" output="Get \"https://10.134.0.26:6567/health\": dial tcp 10.134.0.26:6567: connect: connection refused"
May 28 09:52:13.417499 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:52:13.417122    2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz" podUID="b0ce7882-8c06-4f0f-8330-a2f1dbd9380b" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.26:8816: connect: connection refused"
May 28 09:52:16.416107 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:52:16.416078    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz"
May 28 09:52:16.416584 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:52:16.416198    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz"
May 28 09:52:16.416584 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:52:16.416552    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz"
May 28 09:52:16.416584 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:52:16.416583    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz"
May 28 09:52:16.416795 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:52:16.416777    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz"
May 28 09:52:16.417002 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:52:16.416965    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz"
May 28 09:52:16.420113 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:52:16.420097    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz"
May 28 09:52:16.830195 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:52:16.830168    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz"
May 28 09:52:16.833266 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:52:16.833243    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz"
May 28 09:53:18.755657 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:18.755620    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz"]
May 28 09:53:18.756174 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:18.756083    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz" podUID="b0ce7882-8c06-4f0f-8330-a2f1dbd9380b" containerName="online" containerID="cri-o://ba7c647093a82626cadd049352c821b54ed44cd9f4ef5393a3c89f71b9147ba2" gracePeriod=30
May 28 09:53:18.756174 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:18.756133    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz" podUID="b0ce7882-8c06-4f0f-8330-a2f1dbd9380b" containerName="offline" containerID="cri-o://595b881c95c557f47aa9b23ad6b7f8a0df8e2e2c7791ffceea2636a74334d28c" gracePeriod=30
May 28 09:53:18.756174 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:18.756141    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz" podUID="b0ce7882-8c06-4f0f-8330-a2f1dbd9380b" containerName="ui" containerID="cri-o://9470c7e26fb5775dab00baf3139c56530ce0f549cbfdcab1a8b52abd8b3b25e7" gracePeriod=30
May 28 09:53:18.909705 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:18.909671    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28"]
May 28 09:53:18.910067 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:18.910010    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28" podUID="a337a030-ca4f-43a3-80d4-20147ce35a89" containerName="registry" containerID="cri-o://8459a9946071e2ad7d665d530f07a4e4d63b0d35d92d9275afc0c6b522db5826" gracePeriod=30
May 28 09:53:18.910217 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:18.910067    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28" podUID="a337a030-ca4f-43a3-80d4-20147ce35a89" containerName="online" containerID="cri-o://e31039c0c93f7cb8caddf357142c47117a8252ac1f6bef381fd9ff162eba7458" gracePeriod=30
May 28 09:53:18.910217 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:18.910063    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28" podUID="a337a030-ca4f-43a3-80d4-20147ce35a89" containerName="offline" containerID="cri-o://82bc0d2479330d74df236eb330966784a9c505299475b874c050c35d37b18014" gracePeriod=30
May 28 09:53:18.910217 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:18.910036    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28" podUID="a337a030-ca4f-43a3-80d4-20147ce35a89" containerName="ui" containerID="cri-o://0976821a35baeb0d7d19267f38638fa688236b10e21e77c13d79301be7bb8729" gracePeriod=30
May 28 09:53:20.012799 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:20.012763    2572 generic.go:358] "Generic (PLEG): container finished" podID="a337a030-ca4f-43a3-80d4-20147ce35a89" containerID="0976821a35baeb0d7d19267f38638fa688236b10e21e77c13d79301be7bb8729" exitCode=0
May 28 09:53:20.012799 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:20.012789    2572 generic.go:358] "Generic (PLEG): container finished" podID="a337a030-ca4f-43a3-80d4-20147ce35a89" containerID="e31039c0c93f7cb8caddf357142c47117a8252ac1f6bef381fd9ff162eba7458" exitCode=0
May 28 09:53:20.013258 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:20.012835    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28" event={"ID":"a337a030-ca4f-43a3-80d4-20147ce35a89","Type":"ContainerDied","Data":"0976821a35baeb0d7d19267f38638fa688236b10e21e77c13d79301be7bb8729"}
May 28 09:53:20.013258 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:20.012876    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28" event={"ID":"a337a030-ca4f-43a3-80d4-20147ce35a89","Type":"ContainerDied","Data":"e31039c0c93f7cb8caddf357142c47117a8252ac1f6bef381fd9ff162eba7458"}
May 28 09:53:20.014958 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:20.014939    2572 generic.go:358] "Generic (PLEG): container finished" podID="b0ce7882-8c06-4f0f-8330-a2f1dbd9380b" containerID="9470c7e26fb5775dab00baf3139c56530ce0f549cbfdcab1a8b52abd8b3b25e7" exitCode=0
May 28 09:53:20.014958 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:20.014957    2572 generic.go:358] "Generic (PLEG): container finished" podID="b0ce7882-8c06-4f0f-8330-a2f1dbd9380b" containerID="ba7c647093a82626cadd049352c821b54ed44cd9f4ef5393a3c89f71b9147ba2" exitCode=0
May 28 09:53:20.015122 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:20.014997    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz" event={"ID":"b0ce7882-8c06-4f0f-8330-a2f1dbd9380b","Type":"ContainerDied","Data":"9470c7e26fb5775dab00baf3139c56530ce0f549cbfdcab1a8b52abd8b3b25e7"}
May 28 09:53:20.015122 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:20.015026    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz" event={"ID":"b0ce7882-8c06-4f0f-8330-a2f1dbd9380b","Type":"ContainerDied","Data":"ba7c647093a82626cadd049352c821b54ed44cd9f4ef5393a3c89f71b9147ba2"}
May 28 09:53:24.717703 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:24.717654    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28" podUID="a337a030-ca4f-43a3-80d4-20147ce35a89" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.25:8443: connect: connection refused"
May 28 09:53:25.576361 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:25.576314    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28" podUID="a337a030-ca4f-43a3-80d4-20147ce35a89" containerName="online" probeResult="failure" output="Get \"https://10.134.0.25:6567/health\": dial tcp 10.134.0.25:6567: connect: connection refused"
May 28 09:53:26.416892 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:26.416854    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz" podUID="b0ce7882-8c06-4f0f-8330-a2f1dbd9380b" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.26:8443: connect: connection refused"
May 28 09:53:26.831282 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:26.831241    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz" podUID="b0ce7882-8c06-4f0f-8330-a2f1dbd9380b" containerName="online" probeResult="failure" output="Get \"https://10.134.0.26:6567/health\": dial tcp 10.134.0.26:6567: connect: connection refused"
May 28 09:53:34.717916 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:34.717815    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28" podUID="a337a030-ca4f-43a3-80d4-20147ce35a89" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.25:8443: connect: connection refused"
May 28 09:53:35.576538 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:35.576503    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28" podUID="a337a030-ca4f-43a3-80d4-20147ce35a89" containerName="online" probeResult="failure" output="Get \"https://10.134.0.25:6567/health\": dial tcp 10.134.0.25:6567: connect: connection refused"
May 28 09:53:36.417356 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:36.417306    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz" podUID="b0ce7882-8c06-4f0f-8330-a2f1dbd9380b" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.26:8443: connect: connection refused"
May 28 09:53:36.830362 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:36.830326    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz" podUID="b0ce7882-8c06-4f0f-8330-a2f1dbd9380b" containerName="online" probeResult="failure" output="Get \"https://10.134.0.26:6567/health\": dial tcp 10.134.0.26:6567: connect: connection refused"
May 28 09:53:44.718059 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:44.718007    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28" podUID="a337a030-ca4f-43a3-80d4-20147ce35a89" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.25:8443: connect: connection refused"
May 28 09:53:44.718491 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:44.718146    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28"
May 28 09:53:45.575722 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:45.575679    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28" podUID="a337a030-ca4f-43a3-80d4-20147ce35a89" containerName="online" probeResult="failure" output="Get \"https://10.134.0.25:6567/health\": dial tcp 10.134.0.25:6567: connect: connection refused"
May 28 09:53:45.575882 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:45.575797    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28"
May 28 09:53:46.417557 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:46.417515    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz" podUID="b0ce7882-8c06-4f0f-8330-a2f1dbd9380b" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.26:8443: connect: connection refused"
May 28 09:53:46.417934 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:46.417646    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz"
May 28 09:53:46.830841 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:46.830795    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz" podUID="b0ce7882-8c06-4f0f-8330-a2f1dbd9380b" containerName="online" probeResult="failure" output="Get \"https://10.134.0.26:6567/health\": dial tcp 10.134.0.26:6567: connect: connection refused"
May 28 09:53:46.831060 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:46.830930    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz"
May 28 09:53:49.102494 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:49.102417    2572 generic.go:358] "Generic (PLEG): container finished" podID="a337a030-ca4f-43a3-80d4-20147ce35a89" containerID="82bc0d2479330d74df236eb330966784a9c505299475b874c050c35d37b18014" exitCode=137
May 28 09:53:49.102494 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:49.102441    2572 generic.go:358] "Generic (PLEG): container finished" podID="a337a030-ca4f-43a3-80d4-20147ce35a89" containerID="8459a9946071e2ad7d665d530f07a4e4d63b0d35d92d9275afc0c6b522db5826" exitCode=137
May 28 09:53:49.102930 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:49.102493    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28" event={"ID":"a337a030-ca4f-43a3-80d4-20147ce35a89","Type":"ContainerDied","Data":"82bc0d2479330d74df236eb330966784a9c505299475b874c050c35d37b18014"}
May 28 09:53:49.102930 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:49.102531    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28" event={"ID":"a337a030-ca4f-43a3-80d4-20147ce35a89","Type":"ContainerDied","Data":"8459a9946071e2ad7d665d530f07a4e4d63b0d35d92d9275afc0c6b522db5826"}
May 28 09:53:49.104672 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:49.104649    2572 generic.go:358] "Generic (PLEG): container finished" podID="b0ce7882-8c06-4f0f-8330-a2f1dbd9380b" containerID="595b881c95c557f47aa9b23ad6b7f8a0df8e2e2c7791ffceea2636a74334d28c" exitCode=137
May 28 09:53:49.104773 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:49.104702    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz" event={"ID":"b0ce7882-8c06-4f0f-8330-a2f1dbd9380b","Type":"ContainerDied","Data":"595b881c95c557f47aa9b23ad6b7f8a0df8e2e2c7791ffceea2636a74334d28c"}
May 28 09:53:49.403834 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:49.403812    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz"
May 28 09:53:49.546448 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:49.546425    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28"
May 28 09:53:49.561879 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:49.561858    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/b0ce7882-8c06-4f0f-8330-a2f1dbd9380b-registry-tls\") pod \"b0ce7882-8c06-4f0f-8330-a2f1dbd9380b\" (UID: \"b0ce7882-8c06-4f0f-8330-a2f1dbd9380b\") "
May 28 09:53:49.562000 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:49.561889    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b0ce7882-8c06-4f0f-8330-a2f1dbd9380b-offline-tls\") pod \"b0ce7882-8c06-4f0f-8330-a2f1dbd9380b\" (UID: \"b0ce7882-8c06-4f0f-8330-a2f1dbd9380b\") "
May 28 09:53:49.562000 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:49.561927    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2zlb7\" (UniqueName: \"kubernetes.io/projected/b0ce7882-8c06-4f0f-8330-a2f1dbd9380b-kube-api-access-2zlb7\") pod \"b0ce7882-8c06-4f0f-8330-a2f1dbd9380b\" (UID: \"b0ce7882-8c06-4f0f-8330-a2f1dbd9380b\") "
May 28 09:53:49.562000 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:49.561987    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b0ce7882-8c06-4f0f-8330-a2f1dbd9380b-online-tls\") pod \"b0ce7882-8c06-4f0f-8330-a2f1dbd9380b\" (UID: \"b0ce7882-8c06-4f0f-8330-a2f1dbd9380b\") "
May 28 09:53:49.562168 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:49.562012    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b0ce7882-8c06-4f0f-8330-a2f1dbd9380b-ui-tls\") pod \"b0ce7882-8c06-4f0f-8330-a2f1dbd9380b\" (UID: \"b0ce7882-8c06-4f0f-8330-a2f1dbd9380b\") "
May 28 09:53:49.562168 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:49.562160    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b0ce7882-8c06-4f0f-8330-a2f1dbd9380b-feast-data\") pod \"b0ce7882-8c06-4f0f-8330-a2f1dbd9380b\" (UID: \"b0ce7882-8c06-4f0f-8330-a2f1dbd9380b\") "
May 28 09:53:49.562446 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:49.562413    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0ce7882-8c06-4f0f-8330-a2f1dbd9380b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b0ce7882-8c06-4f0f-8330-a2f1dbd9380b" (UID: "b0ce7882-8c06-4f0f-8330-a2f1dbd9380b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 09:53:49.562619 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:49.562596    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0ce7882-8c06-4f0f-8330-a2f1dbd9380b-feast-data" (OuterVolumeSpecName: "feast-data") pod "b0ce7882-8c06-4f0f-8330-a2f1dbd9380b" (UID: "b0ce7882-8c06-4f0f-8330-a2f1dbd9380b"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 09:53:49.564167 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:49.564144    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0ce7882-8c06-4f0f-8330-a2f1dbd9380b-kube-api-access-2zlb7" (OuterVolumeSpecName: "kube-api-access-2zlb7") pod "b0ce7882-8c06-4f0f-8330-a2f1dbd9380b" (UID: "b0ce7882-8c06-4f0f-8330-a2f1dbd9380b"). InnerVolumeSpecName "kube-api-access-2zlb7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 09:53:49.564246 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:49.564203    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0ce7882-8c06-4f0f-8330-a2f1dbd9380b-online-tls" (OuterVolumeSpecName: "online-tls") pod "b0ce7882-8c06-4f0f-8330-a2f1dbd9380b" (UID: "b0ce7882-8c06-4f0f-8330-a2f1dbd9380b"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:53:49.564376 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:49.564359    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0ce7882-8c06-4f0f-8330-a2f1dbd9380b-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "b0ce7882-8c06-4f0f-8330-a2f1dbd9380b" (UID: "b0ce7882-8c06-4f0f-8330-a2f1dbd9380b"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:53:49.564427 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:49.564366    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0ce7882-8c06-4f0f-8330-a2f1dbd9380b-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "b0ce7882-8c06-4f0f-8330-a2f1dbd9380b" (UID: "b0ce7882-8c06-4f0f-8330-a2f1dbd9380b"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:53:49.662950 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:49.662871    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a337a030-ca4f-43a3-80d4-20147ce35a89-online-tls\") pod \"a337a030-ca4f-43a3-80d4-20147ce35a89\" (UID: \"a337a030-ca4f-43a3-80d4-20147ce35a89\") "
May 28 09:53:49.662950 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:49.662923    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a337a030-ca4f-43a3-80d4-20147ce35a89-registry-tls\") pod \"a337a030-ca4f-43a3-80d4-20147ce35a89\" (UID: \"a337a030-ca4f-43a3-80d4-20147ce35a89\") "
May 28 09:53:49.663193 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:49.663011    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a337a030-ca4f-43a3-80d4-20147ce35a89-feast-data\") pod \"a337a030-ca4f-43a3-80d4-20147ce35a89\" (UID: \"a337a030-ca4f-43a3-80d4-20147ce35a89\") "
May 28 09:53:49.663193 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:49.663035    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a337a030-ca4f-43a3-80d4-20147ce35a89-ui-tls\") pod \"a337a030-ca4f-43a3-80d4-20147ce35a89\" (UID: \"a337a030-ca4f-43a3-80d4-20147ce35a89\") "
May 28 09:53:49.663193 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:49.663052    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a337a030-ca4f-43a3-80d4-20147ce35a89-offline-tls\") pod \"a337a030-ca4f-43a3-80d4-20147ce35a89\" (UID: \"a337a030-ca4f-43a3-80d4-20147ce35a89\") "
May 28 09:53:49.663193 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:49.663085    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5qktg\" (UniqueName: \"kubernetes.io/projected/a337a030-ca4f-43a3-80d4-20147ce35a89-kube-api-access-5qktg\") pod \"a337a030-ca4f-43a3-80d4-20147ce35a89\" (UID: \"a337a030-ca4f-43a3-80d4-20147ce35a89\") "
May 28 09:53:49.663413 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:49.663295    2572 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b0ce7882-8c06-4f0f-8330-a2f1dbd9380b-online-tls\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:53:49.663413 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:49.663315    2572 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b0ce7882-8c06-4f0f-8330-a2f1dbd9380b-ui-tls\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:53:49.663413 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:49.663330    2572 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b0ce7882-8c06-4f0f-8330-a2f1dbd9380b-feast-data\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:53:49.663413 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:49.663343    2572 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/b0ce7882-8c06-4f0f-8330-a2f1dbd9380b-registry-tls\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:53:49.663413 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:49.663357    2572 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b0ce7882-8c06-4f0f-8330-a2f1dbd9380b-offline-tls\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:53:49.663413 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:49.663371    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2zlb7\" (UniqueName: \"kubernetes.io/projected/b0ce7882-8c06-4f0f-8330-a2f1dbd9380b-kube-api-access-2zlb7\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:53:49.663718 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:49.663549    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a337a030-ca4f-43a3-80d4-20147ce35a89-feast-data" (OuterVolumeSpecName: "feast-data") pod "a337a030-ca4f-43a3-80d4-20147ce35a89" (UID: "a337a030-ca4f-43a3-80d4-20147ce35a89"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 09:53:49.665094 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:49.665064    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a337a030-ca4f-43a3-80d4-20147ce35a89-online-tls" (OuterVolumeSpecName: "online-tls") pod "a337a030-ca4f-43a3-80d4-20147ce35a89" (UID: "a337a030-ca4f-43a3-80d4-20147ce35a89"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:53:49.665094 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:49.665080    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a337a030-ca4f-43a3-80d4-20147ce35a89-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a337a030-ca4f-43a3-80d4-20147ce35a89" (UID: "a337a030-ca4f-43a3-80d4-20147ce35a89"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:53:49.665240 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:49.665127    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a337a030-ca4f-43a3-80d4-20147ce35a89-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "a337a030-ca4f-43a3-80d4-20147ce35a89" (UID: "a337a030-ca4f-43a3-80d4-20147ce35a89"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:53:49.665442 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:49.665427    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a337a030-ca4f-43a3-80d4-20147ce35a89-kube-api-access-5qktg" (OuterVolumeSpecName: "kube-api-access-5qktg") pod "a337a030-ca4f-43a3-80d4-20147ce35a89" (UID: "a337a030-ca4f-43a3-80d4-20147ce35a89"). InnerVolumeSpecName "kube-api-access-5qktg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 09:53:49.665442 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:49.665432    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a337a030-ca4f-43a3-80d4-20147ce35a89-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "a337a030-ca4f-43a3-80d4-20147ce35a89" (UID: "a337a030-ca4f-43a3-80d4-20147ce35a89"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:53:49.764075 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:49.764037    2572 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a337a030-ca4f-43a3-80d4-20147ce35a89-registry-tls\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:53:49.764075 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:49.764068    2572 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a337a030-ca4f-43a3-80d4-20147ce35a89-feast-data\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:53:49.764075 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:49.764077    2572 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a337a030-ca4f-43a3-80d4-20147ce35a89-ui-tls\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:53:49.764296 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:49.764086    2572 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a337a030-ca4f-43a3-80d4-20147ce35a89-offline-tls\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:53:49.764296 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:49.764095    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5qktg\" (UniqueName: \"kubernetes.io/projected/a337a030-ca4f-43a3-80d4-20147ce35a89-kube-api-access-5qktg\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:53:49.764296 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:49.764106    2572 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a337a030-ca4f-43a3-80d4-20147ce35a89-online-tls\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:53:50.109895 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:50.109865    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz"
May 28 09:53:50.109895 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:50.109869    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz" event={"ID":"b0ce7882-8c06-4f0f-8330-a2f1dbd9380b","Type":"ContainerDied","Data":"858f60a9ab144bdf93bec339e14fae23ca73039dd40b495d2d2868f15e065192"}
May 28 09:53:50.110399 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:50.109919    2572 scope.go:117] "RemoveContainer" containerID="9470c7e26fb5775dab00baf3139c56530ce0f549cbfdcab1a8b52abd8b3b25e7"
May 28 09:53:50.112789 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:50.112762    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28" event={"ID":"a337a030-ca4f-43a3-80d4-20147ce35a89","Type":"ContainerDied","Data":"a7e2cd1f8b00b99167fbcc66230072a6feeaaaf63a05599fe884e7a4b4833c59"}
May 28 09:53:50.112912 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:50.112902    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28"
May 28 09:53:50.119131 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:50.119077    2572 scope.go:117] "RemoveContainer" containerID="595b881c95c557f47aa9b23ad6b7f8a0df8e2e2c7791ffceea2636a74334d28c"
May 28 09:53:50.125996 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:50.125964    2572 scope.go:117] "RemoveContainer" containerID="ba7c647093a82626cadd049352c821b54ed44cd9f4ef5393a3c89f71b9147ba2"
May 28 09:53:50.131834 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:50.131812    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28"]
May 28 09:53:50.133803 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:50.133782    2572 scope.go:117] "RemoveContainer" containerID="2e38cd6beaa2659ddec1c0f6402517a5aef83e8684afb1d4a1c4ceb75efe1bf5"
May 28 09:53:50.135684 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:50.135665    2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-kdf28"]
May 28 09:53:50.140535 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:50.140520    2572 scope.go:117] "RemoveContainer" containerID="a7ac70c9c8d4ff66b2278d09a576e9c64d442a0ca2898a84a52d721f1838752b"
May 28 09:53:50.148262 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:50.147604    2572 scope.go:117] "RemoveContainer" containerID="0976821a35baeb0d7d19267f38638fa688236b10e21e77c13d79301be7bb8729"
May 28 09:53:50.149176 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:50.149159    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz"]
May 28 09:53:50.151794 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:50.151772    2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-x7cnz"]
May 28 09:53:50.155366 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:50.155351    2572 scope.go:117] "RemoveContainer" containerID="82bc0d2479330d74df236eb330966784a9c505299475b874c050c35d37b18014"
May 28 09:53:50.161794 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:50.161770    2572 scope.go:117] "RemoveContainer" containerID="e31039c0c93f7cb8caddf357142c47117a8252ac1f6bef381fd9ff162eba7458"
May 28 09:53:50.168231 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:50.168213    2572 scope.go:117] "RemoveContainer" containerID="8459a9946071e2ad7d665d530f07a4e4d63b0d35d92d9275afc0c6b522db5826"
May 28 09:53:50.176600 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:50.176576    2572 scope.go:117] "RemoveContainer" containerID="bc8d315f175987cb5d090d9a1995d49d14367e49c564cfe47e41ce15cc987371"
May 28 09:53:50.183100 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:50.183083    2572 scope.go:117] "RemoveContainer" containerID="fdc64768c59641c2f2ec257a1614174ea3eb2aae8caacf8313eec6660ff855c9"
May 28 09:53:51.924241 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:51.921674    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a337a030-ca4f-43a3-80d4-20147ce35a89" path="/var/lib/kubelet/pods/a337a030-ca4f-43a3-80d4-20147ce35a89/volumes"
May 28 09:53:51.924241 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:53:51.922566    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0ce7882-8c06-4f0f-8330-a2f1dbd9380b" path="/var/lib/kubelet/pods/b0ce7882-8c06-4f0f-8330-a2f1dbd9380b/volumes"
May 28 09:54:08.194575 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:08.194542    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-j725t"]
May 28 09:54:08.195042 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:08.194774    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-j725t" podUID="9c029cb1-3e9e-4b34-bf47-8f2600dff364" containerName="manager" containerID="cri-o://7270d4985bd6b4277097b38ddba01c2f1f410f1bbe5d7da35e4b96a450185ca9" gracePeriod=10
May 28 09:54:08.432092 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:08.432067    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-j725t"
May 28 09:54:08.515056 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:08.515031    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f6dwk\" (UniqueName: \"kubernetes.io/projected/9c029cb1-3e9e-4b34-bf47-8f2600dff364-kube-api-access-f6dwk\") pod \"9c029cb1-3e9e-4b34-bf47-8f2600dff364\" (UID: \"9c029cb1-3e9e-4b34-bf47-8f2600dff364\") "
May 28 09:54:08.517095 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:08.517074    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c029cb1-3e9e-4b34-bf47-8f2600dff364-kube-api-access-f6dwk" (OuterVolumeSpecName: "kube-api-access-f6dwk") pod "9c029cb1-3e9e-4b34-bf47-8f2600dff364" (UID: "9c029cb1-3e9e-4b34-bf47-8f2600dff364"). InnerVolumeSpecName "kube-api-access-f6dwk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 09:54:08.616183 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:08.616144    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f6dwk\" (UniqueName: \"kubernetes.io/projected/9c029cb1-3e9e-4b34-bf47-8f2600dff364-kube-api-access-f6dwk\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:54:09.167394 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:09.167360    2572 generic.go:358] "Generic (PLEG): container finished" podID="9c029cb1-3e9e-4b34-bf47-8f2600dff364" containerID="7270d4985bd6b4277097b38ddba01c2f1f410f1bbe5d7da35e4b96a450185ca9" exitCode=0
May 28 09:54:09.167535 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:09.167424    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-j725t"
May 28 09:54:09.167535 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:09.167430    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-j725t" event={"ID":"9c029cb1-3e9e-4b34-bf47-8f2600dff364","Type":"ContainerDied","Data":"7270d4985bd6b4277097b38ddba01c2f1f410f1bbe5d7da35e4b96a450185ca9"}
May 28 09:54:09.167535 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:09.167456    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-j725t" event={"ID":"9c029cb1-3e9e-4b34-bf47-8f2600dff364","Type":"ContainerDied","Data":"46cb1ca2d3a269ef33863e93c26b3bc9a3a7e048d58e7139fb00e329b73c3d03"}
May 28 09:54:09.167535 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:09.167471    2572 scope.go:117] "RemoveContainer" containerID="7270d4985bd6b4277097b38ddba01c2f1f410f1bbe5d7da35e4b96a450185ca9"
May 28 09:54:09.177202 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:09.177183    2572 scope.go:117] "RemoveContainer" containerID="7270d4985bd6b4277097b38ddba01c2f1f410f1bbe5d7da35e4b96a450185ca9"
May 28 09:54:09.177508 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:54:09.177486    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7270d4985bd6b4277097b38ddba01c2f1f410f1bbe5d7da35e4b96a450185ca9\": container with ID starting with 7270d4985bd6b4277097b38ddba01c2f1f410f1bbe5d7da35e4b96a450185ca9 not found: ID does not exist" containerID="7270d4985bd6b4277097b38ddba01c2f1f410f1bbe5d7da35e4b96a450185ca9"
May 28 09:54:09.177601 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:09.177517    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7270d4985bd6b4277097b38ddba01c2f1f410f1bbe5d7da35e4b96a450185ca9"} err="failed to get container status \"7270d4985bd6b4277097b38ddba01c2f1f410f1bbe5d7da35e4b96a450185ca9\": rpc error: code = NotFound desc = could not find container \"7270d4985bd6b4277097b38ddba01c2f1f410f1bbe5d7da35e4b96a450185ca9\": container with ID starting with 7270d4985bd6b4277097b38ddba01c2f1f410f1bbe5d7da35e4b96a450185ca9 not found: ID does not exist"
May 28 09:54:09.189790 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:09.189765    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-j725t"]
May 28 09:54:09.193773 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:09.193749    2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-j725t"]
May 28 09:54:09.919913 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:09.919876    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c029cb1-3e9e-4b34-bf47-8f2600dff364" path="/var/lib/kubelet/pods/9c029cb1-3e9e-4b34-bf47-8f2600dff364/volumes"
May 28 09:54:31.489051 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:31.489017    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4"]
May 28 09:54:31.489500 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:31.489372    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0ce7882-8c06-4f0f-8330-a2f1dbd9380b" containerName="feast-apply"
May 28 09:54:31.489500 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:31.489387    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0ce7882-8c06-4f0f-8330-a2f1dbd9380b" containerName="feast-apply"
May 28 09:54:31.489500 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:31.489396    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a337a030-ca4f-43a3-80d4-20147ce35a89" containerName="feast-apply"
May 28 09:54:31.489500 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:31.489401    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a337a030-ca4f-43a3-80d4-20147ce35a89" containerName="feast-apply"
May 28 09:54:31.489500 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:31.489408    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0ce7882-8c06-4f0f-8330-a2f1dbd9380b" containerName="ui"
May 28 09:54:31.489500 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:31.489414    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0ce7882-8c06-4f0f-8330-a2f1dbd9380b" containerName="ui"
May 28 09:54:31.489500 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:31.489428    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0ce7882-8c06-4f0f-8330-a2f1dbd9380b" containerName="feast-init"
May 28 09:54:31.489500 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:31.489433    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0ce7882-8c06-4f0f-8330-a2f1dbd9380b" containerName="feast-init"
May 28 09:54:31.489500 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:31.489440    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a337a030-ca4f-43a3-80d4-20147ce35a89" containerName="registry"
May 28 09:54:31.489500 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:31.489445    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a337a030-ca4f-43a3-80d4-20147ce35a89" containerName="registry"
May 28 09:54:31.489500 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:31.489450    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a337a030-ca4f-43a3-80d4-20147ce35a89" containerName="ui"
May 28 09:54:31.489500 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:31.489455    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a337a030-ca4f-43a3-80d4-20147ce35a89" containerName="ui"
May 28 09:54:31.489500 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:31.489463    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a337a030-ca4f-43a3-80d4-20147ce35a89" containerName="feast-init"
May 28 09:54:31.489500 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:31.489468    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a337a030-ca4f-43a3-80d4-20147ce35a89" containerName="feast-init"
May 28 09:54:31.489500 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:31.489474    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a337a030-ca4f-43a3-80d4-20147ce35a89" containerName="online"
May 28 09:54:31.489500 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:31.489479    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a337a030-ca4f-43a3-80d4-20147ce35a89" containerName="online"
May 28 09:54:31.489500 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:31.489485    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0ce7882-8c06-4f0f-8330-a2f1dbd9380b" containerName="online"
May 28 09:54:31.489500 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:31.489489    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0ce7882-8c06-4f0f-8330-a2f1dbd9380b" containerName="online"
May 28 09:54:31.489500 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:31.489496    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c029cb1-3e9e-4b34-bf47-8f2600dff364" containerName="manager"
May 28 09:54:31.489500 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:31.489501    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c029cb1-3e9e-4b34-bf47-8f2600dff364" containerName="manager"
May 28 09:54:31.489500 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:31.489506    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0ce7882-8c06-4f0f-8330-a2f1dbd9380b" containerName="offline"
May 28 09:54:31.489500 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:31.489511    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0ce7882-8c06-4f0f-8330-a2f1dbd9380b" containerName="offline"
May 28 09:54:31.489500 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:31.489518    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a337a030-ca4f-43a3-80d4-20147ce35a89" containerName="offline"
May 28 09:54:31.490598 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:31.489522    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a337a030-ca4f-43a3-80d4-20147ce35a89" containerName="offline"
May 28 09:54:31.490598 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:31.489573    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="b0ce7882-8c06-4f0f-8330-a2f1dbd9380b" containerName="offline"
May 28 09:54:31.490598 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:31.489582    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="a337a030-ca4f-43a3-80d4-20147ce35a89" containerName="offline"
May 28 09:54:31.490598 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:31.489590    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="9c029cb1-3e9e-4b34-bf47-8f2600dff364" containerName="manager"
May 28 09:54:31.490598 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:31.489596    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="b0ce7882-8c06-4f0f-8330-a2f1dbd9380b" containerName="ui"
May 28 09:54:31.490598 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:31.489602    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="b0ce7882-8c06-4f0f-8330-a2f1dbd9380b" containerName="online"
May 28 09:54:31.490598 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:31.489609    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="a337a030-ca4f-43a3-80d4-20147ce35a89" containerName="registry"
May 28 09:54:31.490598 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:31.489614    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="a337a030-ca4f-43a3-80d4-20147ce35a89" containerName="online"
May 28 09:54:31.490598 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:31.489621    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="a337a030-ca4f-43a3-80d4-20147ce35a89" containerName="ui"
May 28 09:54:31.494091 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:31.494074    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4"
May 28 09:54:31.497071 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:31.497043    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
May 28 09:54:31.497430 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:31.497404    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
May 28 09:54:31.497583 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:31.497557    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
May 28 09:54:31.497583 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:31.497410    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
May 28 09:54:31.497698 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:31.497659    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
May 28 09:54:31.497748 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:31.497564    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-mj2ks\""
May 28 09:54:31.497882 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:31.497862    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
May 28 09:54:31.503656 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:31.503637    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4"]
May 28 09:54:31.591927 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:31.591900    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/569cdf1b-59e9-4b17-b454-6e4d5601ca44-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-fhws4\" (UID: \"569cdf1b-59e9-4b17-b454-6e4d5601ca44\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4"
May 28 09:54:31.592069 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:31.591931    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/569cdf1b-59e9-4b17-b454-6e4d5601ca44-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-fhws4\" (UID: \"569cdf1b-59e9-4b17-b454-6e4d5601ca44\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4"
May 28 09:54:31.592069 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:31.592026    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmrx8\" (UniqueName: \"kubernetes.io/projected/569cdf1b-59e9-4b17-b454-6e4d5601ca44-kube-api-access-mmrx8\") pod \"feast-simple-feast-setup-664fcfcc58-fhws4\" (UID: \"569cdf1b-59e9-4b17-b454-6e4d5601ca44\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4"
May 28 09:54:31.592144 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:31.592080    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/569cdf1b-59e9-4b17-b454-6e4d5601ca44-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-fhws4\" (UID: \"569cdf1b-59e9-4b17-b454-6e4d5601ca44\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4"
May 28 09:54:31.592144 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:31.592099    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/569cdf1b-59e9-4b17-b454-6e4d5601ca44-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-fhws4\" (UID: \"569cdf1b-59e9-4b17-b454-6e4d5601ca44\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4"
May 28 09:54:31.592211 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:31.592165    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/569cdf1b-59e9-4b17-b454-6e4d5601ca44-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-fhws4\" (UID: \"569cdf1b-59e9-4b17-b454-6e4d5601ca44\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4"
May 28 09:54:31.693351 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:31.693318    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mmrx8\" (UniqueName: \"kubernetes.io/projected/569cdf1b-59e9-4b17-b454-6e4d5601ca44-kube-api-access-mmrx8\") pod \"feast-simple-feast-setup-664fcfcc58-fhws4\" (UID: \"569cdf1b-59e9-4b17-b454-6e4d5601ca44\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4"
May 28 09:54:31.693527 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:31.693368    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/569cdf1b-59e9-4b17-b454-6e4d5601ca44-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-fhws4\" (UID: \"569cdf1b-59e9-4b17-b454-6e4d5601ca44\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4"
May 28 09:54:31.693527 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:31.693393    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/569cdf1b-59e9-4b17-b454-6e4d5601ca44-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-fhws4\" (UID: \"569cdf1b-59e9-4b17-b454-6e4d5601ca44\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4"
May 28 09:54:31.693527 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:31.693423    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/569cdf1b-59e9-4b17-b454-6e4d5601ca44-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-fhws4\" (UID: \"569cdf1b-59e9-4b17-b454-6e4d5601ca44\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4"
May 28 09:54:31.693694 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:31.693552    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/569cdf1b-59e9-4b17-b454-6e4d5601ca44-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-fhws4\" (UID: \"569cdf1b-59e9-4b17-b454-6e4d5601ca44\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4"
May 28 09:54:31.693694 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:31.693594    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/569cdf1b-59e9-4b17-b454-6e4d5601ca44-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-fhws4\" (UID: \"569cdf1b-59e9-4b17-b454-6e4d5601ca44\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4"
May 28 09:54:31.693813 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:31.693795    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/569cdf1b-59e9-4b17-b454-6e4d5601ca44-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-fhws4\" (UID: \"569cdf1b-59e9-4b17-b454-6e4d5601ca44\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4"
May 28 09:54:31.696049 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:31.696025    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/569cdf1b-59e9-4b17-b454-6e4d5601ca44-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-fhws4\" (UID: \"569cdf1b-59e9-4b17-b454-6e4d5601ca44\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4"
May 28 09:54:31.696167 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:31.696103    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/569cdf1b-59e9-4b17-b454-6e4d5601ca44-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-fhws4\" (UID: \"569cdf1b-59e9-4b17-b454-6e4d5601ca44\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4"
May 28 09:54:31.696233 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:31.696210    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/569cdf1b-59e9-4b17-b454-6e4d5601ca44-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-fhws4\" (UID: \"569cdf1b-59e9-4b17-b454-6e4d5601ca44\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4"
May 28 09:54:31.696304 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:31.696281    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/569cdf1b-59e9-4b17-b454-6e4d5601ca44-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-fhws4\" (UID: \"569cdf1b-59e9-4b17-b454-6e4d5601ca44\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4"
May 28 09:54:31.702010 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:31.701991    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmrx8\" (UniqueName: \"kubernetes.io/projected/569cdf1b-59e9-4b17-b454-6e4d5601ca44-kube-api-access-mmrx8\") pod \"feast-simple-feast-setup-664fcfcc58-fhws4\" (UID: \"569cdf1b-59e9-4b17-b454-6e4d5601ca44\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4"
May 28 09:54:31.819977 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:31.819941    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4"
May 28 09:54:31.953162 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:31.953138    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4"]
May 28 09:54:31.955244 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:54:31.955218    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod569cdf1b_59e9_4b17_b454_6e4d5601ca44.slice/crio-966ed8f8a070d83dc8f30f82b0147a11768368c22d6b887ac37d09765bef5f91 WatchSource:0}: Error finding container 966ed8f8a070d83dc8f30f82b0147a11768368c22d6b887ac37d09765bef5f91: Status 404 returned error can't find the container with id 966ed8f8a070d83dc8f30f82b0147a11768368c22d6b887ac37d09765bef5f91
May 28 09:54:31.956806 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:31.956790    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 09:54:32.232260 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:32.232164    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4" event={"ID":"569cdf1b-59e9-4b17-b454-6e4d5601ca44","Type":"ContainerStarted","Data":"09d928fd092863889a12f06bdce0bc750d6083f06c15b3624ed0242be6b9667f"}
May 28 09:54:32.232496 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:32.232474    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4" event={"ID":"569cdf1b-59e9-4b17-b454-6e4d5601ca44","Type":"ContainerStarted","Data":"966ed8f8a070d83dc8f30f82b0147a11768368c22d6b887ac37d09765bef5f91"}
May 28 09:54:37.252323 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:37.252291    2572 generic.go:358] "Generic (PLEG): container finished" podID="569cdf1b-59e9-4b17-b454-6e4d5601ca44" containerID="09d928fd092863889a12f06bdce0bc750d6083f06c15b3624ed0242be6b9667f" exitCode=0
May 28 09:54:37.252721 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:37.252364    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4" event={"ID":"569cdf1b-59e9-4b17-b454-6e4d5601ca44","Type":"ContainerDied","Data":"09d928fd092863889a12f06bdce0bc750d6083f06c15b3624ed0242be6b9667f"}
May 28 09:54:38.257478 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:38.257435    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4" event={"ID":"569cdf1b-59e9-4b17-b454-6e4d5601ca44","Type":"ContainerStarted","Data":"da61f47ed3252059a830cca47a41732f826464ae40418a9471d40c5491b02aa9"}
May 28 09:54:43.272671 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:43.272634    2572 generic.go:358] "Generic (PLEG): container finished" podID="569cdf1b-59e9-4b17-b454-6e4d5601ca44" containerID="da61f47ed3252059a830cca47a41732f826464ae40418a9471d40c5491b02aa9" exitCode=0
May 28 09:54:43.273044 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:43.272709    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4" event={"ID":"569cdf1b-59e9-4b17-b454-6e4d5601ca44","Type":"ContainerDied","Data":"da61f47ed3252059a830cca47a41732f826464ae40418a9471d40c5491b02aa9"}
May 28 09:54:44.281126 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:44.281086    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4" event={"ID":"569cdf1b-59e9-4b17-b454-6e4d5601ca44","Type":"ContainerStarted","Data":"7f310a3f7dcbe46b922f478d0c3e8d6040e03635bfbeff49591f1e506d455c59"}
May 28 09:54:44.281126 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:44.281129    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4" event={"ID":"569cdf1b-59e9-4b17-b454-6e4d5601ca44","Type":"ContainerStarted","Data":"0eb9eb4d3ff8e9c9b74b8a27c7fef292a318b5f441d03444c77f1134a3869c59"}
May 28 09:54:44.281700 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:44.281143    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4" event={"ID":"569cdf1b-59e9-4b17-b454-6e4d5601ca44","Type":"ContainerStarted","Data":"8adcae27ea8c85baaea9a00f00f74e4816272e6d620bdeb933b81effe401a7b8"}
May 28 09:54:44.281700 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:44.281155    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4" event={"ID":"569cdf1b-59e9-4b17-b454-6e4d5601ca44","Type":"ContainerStarted","Data":"7cb521a00c48fc3f61dcfd8a7bbeef206d50874b4158e496e508fc6512f46b32"}
May 28 09:54:44.310237 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:44.310173    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4" podStartSLOduration=13.310153726 podStartE2EDuration="13.310153726s" podCreationTimestamp="2026-05-28 09:54:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 09:54:44.307947592 +0000 UTC m=+1412.990868376" watchObservedRunningTime="2026-05-28 09:54:44.310153726 +0000 UTC m=+1412.993074510"
May 28 09:54:46.820816 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:46.820779    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4"
May 28 09:54:46.821359 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:46.821333    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4"
May 28 09:54:46.821359 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:46.821360    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4"
May 28 09:54:46.821563 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:46.821373    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4"
May 28 09:54:46.822632 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:46.822600    2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4" podUID="569cdf1b-59e9-4b17-b454-6e4d5601ca44" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.27:8816: connect: connection refused"
May 28 09:54:46.822862 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:46.822632    2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4" podUID="569cdf1b-59e9-4b17-b454-6e4d5601ca44" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.27:6571: connect: connection refused"
May 28 09:54:46.822999 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:46.822633    2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4" podUID="569cdf1b-59e9-4b17-b454-6e4d5601ca44" containerName="online" probeResult="failure" output="Get \"https://10.134.0.27:6567/health\": dial tcp 10.134.0.27:6567: connect: connection refused"
May 28 09:54:46.822999 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:46.822668    2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4" podUID="569cdf1b-59e9-4b17-b454-6e4d5601ca44" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.27:8443: connect: connection refused"
May 28 09:54:49.821603 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:49.821573    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4"
May 28 09:54:49.822064 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:49.821872    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4"
May 28 09:54:49.822161 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:49.822140    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4"
May 28 09:54:49.822228 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:49.822172    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4"
May 28 09:54:49.822280 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:49.822264    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4"
May 28 09:54:49.822338 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:49.822297    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4"
May 28 09:54:49.822396 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:49.822381    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4"
May 28 09:54:49.826190 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:49.826175    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4"
May 28 09:54:50.301941 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:50.301909    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4"
May 28 09:54:50.301941 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:50.301949    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4"
May 28 09:54:50.302208 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:50.302118    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4"
May 28 09:54:50.304858 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:54:50.304838    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4"
May 28 09:55:52.505150 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:55:52.505103    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4"]
May 28 09:55:52.505684 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:55:52.505441    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4" podUID="569cdf1b-59e9-4b17-b454-6e4d5601ca44" containerName="registry" containerID="cri-o://7cb521a00c48fc3f61dcfd8a7bbeef206d50874b4158e496e508fc6512f46b32" gracePeriod=30
May 28 09:55:52.505684 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:55:52.505580    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4" podUID="569cdf1b-59e9-4b17-b454-6e4d5601ca44" containerName="online" containerID="cri-o://8adcae27ea8c85baaea9a00f00f74e4816272e6d620bdeb933b81effe401a7b8" gracePeriod=30
May 28 09:55:52.505684 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:55:52.505565    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4" podUID="569cdf1b-59e9-4b17-b454-6e4d5601ca44" containerName="offline" containerID="cri-o://0eb9eb4d3ff8e9c9b74b8a27c7fef292a318b5f441d03444c77f1134a3869c59" gracePeriod=30
May 28 09:55:52.505684 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:55:52.505640    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4" podUID="569cdf1b-59e9-4b17-b454-6e4d5601ca44" containerName="ui" containerID="cri-o://7f310a3f7dcbe46b922f478d0c3e8d6040e03635bfbeff49591f1e506d455c59" gracePeriod=30
May 28 09:55:52.796367 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:55:52.796285    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf"]
May 28 09:55:52.800086 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:55:52.800068    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf"
May 28 09:55:52.802759 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:55:52.802736    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-nsfwh\""
May 28 09:55:52.810487 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:55:52.810455    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf"]
May 28 09:55:52.876107 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:55:52.876069    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/7bda7c6a-0393-49ed-8c1c-b7d2884d14db-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-rh7cf\" (UID: \"7bda7c6a-0393-49ed-8c1c-b7d2884d14db\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf"
May 28 09:55:52.876292 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:55:52.876116    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7bda7c6a-0393-49ed-8c1c-b7d2884d14db-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-rh7cf\" (UID: \"7bda7c6a-0393-49ed-8c1c-b7d2884d14db\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf"
May 28 09:55:52.876292 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:55:52.876228    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7bda7c6a-0393-49ed-8c1c-b7d2884d14db-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-rh7cf\" (UID: \"7bda7c6a-0393-49ed-8c1c-b7d2884d14db\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf"
May 28 09:55:52.876292 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:55:52.876280    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/7bda7c6a-0393-49ed-8c1c-b7d2884d14db-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-rh7cf\" (UID: \"7bda7c6a-0393-49ed-8c1c-b7d2884d14db\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf"
May 28 09:55:52.876420 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:55:52.876351    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7bda7c6a-0393-49ed-8c1c-b7d2884d14db-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-rh7cf\" (UID: \"7bda7c6a-0393-49ed-8c1c-b7d2884d14db\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf"
May 28 09:55:52.876420 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:55:52.876398    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klpq5\" (UniqueName: \"kubernetes.io/projected/7bda7c6a-0393-49ed-8c1c-b7d2884d14db-kube-api-access-klpq5\") pod \"feast-simple-feast-setup-664fcfcc58-rh7cf\" (UID: \"7bda7c6a-0393-49ed-8c1c-b7d2884d14db\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf"
May 28 09:55:52.977043 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:55:52.977004    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/7bda7c6a-0393-49ed-8c1c-b7d2884d14db-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-rh7cf\" (UID: \"7bda7c6a-0393-49ed-8c1c-b7d2884d14db\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf"
May 28 09:55:52.977233 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:55:52.977056    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7bda7c6a-0393-49ed-8c1c-b7d2884d14db-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-rh7cf\" (UID: \"7bda7c6a-0393-49ed-8c1c-b7d2884d14db\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf"
May 28 09:55:52.977233 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:55:52.977080    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-klpq5\" (UniqueName: \"kubernetes.io/projected/7bda7c6a-0393-49ed-8c1c-b7d2884d14db-kube-api-access-klpq5\") pod \"feast-simple-feast-setup-664fcfcc58-rh7cf\" (UID: \"7bda7c6a-0393-49ed-8c1c-b7d2884d14db\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf"
May 28 09:55:52.977233 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:55:52.977120    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/7bda7c6a-0393-49ed-8c1c-b7d2884d14db-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-rh7cf\" (UID: \"7bda7c6a-0393-49ed-8c1c-b7d2884d14db\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf"
May 28 09:55:52.977233 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:55:52.977146    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7bda7c6a-0393-49ed-8c1c-b7d2884d14db-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-rh7cf\" (UID: \"7bda7c6a-0393-49ed-8c1c-b7d2884d14db\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf"
May 28 09:55:52.977233 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:55:52.977219    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7bda7c6a-0393-49ed-8c1c-b7d2884d14db-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-rh7cf\" (UID: \"7bda7c6a-0393-49ed-8c1c-b7d2884d14db\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf"
May 28 09:55:52.977495 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:55:52.977323    2572 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
May 28 09:55:52.977495 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:55:52.977344    2572 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
May 28 09:55:52.977495 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:55:52.977424    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bda7c6a-0393-49ed-8c1c-b7d2884d14db-online-tls podName:7bda7c6a-0393-49ed-8c1c-b7d2884d14db nodeName:}" failed. No retries permitted until 2026-05-28 09:55:53.477400348 +0000 UTC m=+1482.160321114 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/7bda7c6a-0393-49ed-8c1c-b7d2884d14db-online-tls") pod "feast-simple-feast-setup-664fcfcc58-rh7cf" (UID: "7bda7c6a-0393-49ed-8c1c-b7d2884d14db") : secret "feast-simple-feast-setup-online-tls" not found
May 28 09:55:52.977495 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:55:52.977444    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bda7c6a-0393-49ed-8c1c-b7d2884d14db-ui-tls podName:7bda7c6a-0393-49ed-8c1c-b7d2884d14db nodeName:}" failed. No retries permitted until 2026-05-28 09:55:53.477435497 +0000 UTC m=+1482.160356268 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/7bda7c6a-0393-49ed-8c1c-b7d2884d14db-ui-tls") pod "feast-simple-feast-setup-664fcfcc58-rh7cf" (UID: "7bda7c6a-0393-49ed-8c1c-b7d2884d14db") : secret "feast-simple-feast-setup-ui-tls" not found
May 28 09:55:52.977695 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:55:52.977616    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7bda7c6a-0393-49ed-8c1c-b7d2884d14db-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-rh7cf\" (UID: \"7bda7c6a-0393-49ed-8c1c-b7d2884d14db\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf"
May 28 09:55:52.979599 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:55:52.979576    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/7bda7c6a-0393-49ed-8c1c-b7d2884d14db-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-rh7cf\" (UID: \"7bda7c6a-0393-49ed-8c1c-b7d2884d14db\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf"
May 28 09:55:52.980345 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:55:52.980328    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7bda7c6a-0393-49ed-8c1c-b7d2884d14db-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-rh7cf\" (UID: \"7bda7c6a-0393-49ed-8c1c-b7d2884d14db\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf"
May 28 09:55:52.988360 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:55:52.988339    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-klpq5\" (UniqueName: \"kubernetes.io/projected/7bda7c6a-0393-49ed-8c1c-b7d2884d14db-kube-api-access-klpq5\") pod \"feast-simple-feast-setup-664fcfcc58-rh7cf\" (UID: \"7bda7c6a-0393-49ed-8c1c-b7d2884d14db\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf"
May 28 09:55:53.481751 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:55:53.481721    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/7bda7c6a-0393-49ed-8c1c-b7d2884d14db-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-rh7cf\" (UID: \"7bda7c6a-0393-49ed-8c1c-b7d2884d14db\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf"
May 28 09:55:53.481751 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:55:53.481755    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7bda7c6a-0393-49ed-8c1c-b7d2884d14db-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-rh7cf\" (UID: \"7bda7c6a-0393-49ed-8c1c-b7d2884d14db\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf"
May 28 09:55:53.484046 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:55:53.484008    2572 generic.go:358] "Generic (PLEG): container finished" podID="569cdf1b-59e9-4b17-b454-6e4d5601ca44" containerID="7f310a3f7dcbe46b922f478d0c3e8d6040e03635bfbeff49591f1e506d455c59" exitCode=0
May 28 09:55:53.484046 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:55:53.484039    2572 generic.go:358] "Generic (PLEG): container finished" podID="569cdf1b-59e9-4b17-b454-6e4d5601ca44" containerID="8adcae27ea8c85baaea9a00f00f74e4816272e6d620bdeb933b81effe401a7b8" exitCode=0
May 28 09:55:53.484208 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:55:53.484049    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4" event={"ID":"569cdf1b-59e9-4b17-b454-6e4d5601ca44","Type":"ContainerDied","Data":"7f310a3f7dcbe46b922f478d0c3e8d6040e03635bfbeff49591f1e506d455c59"}
May 28 09:55:53.484208 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:55:53.484096    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4" event={"ID":"569cdf1b-59e9-4b17-b454-6e4d5601ca44","Type":"ContainerDied","Data":"8adcae27ea8c85baaea9a00f00f74e4816272e6d620bdeb933b81effe401a7b8"}
May 28 09:55:53.484398 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:55:53.484381    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/7bda7c6a-0393-49ed-8c1c-b7d2884d14db-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-rh7cf\" (UID: \"7bda7c6a-0393-49ed-8c1c-b7d2884d14db\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf"
May 28 09:55:53.484433 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:55:53.484410    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7bda7c6a-0393-49ed-8c1c-b7d2884d14db-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-rh7cf\" (UID: \"7bda7c6a-0393-49ed-8c1c-b7d2884d14db\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf"
May 28 09:55:53.710102 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:55:53.710018    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf"
May 28 09:55:53.845815 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:55:53.845776    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf"]
May 28 09:55:53.849050 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:55:53.849014    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7bda7c6a_0393_49ed_8c1c_b7d2884d14db.slice/crio-3178c96da79d58a3526cb13169e2b30b62bca4ac4c2dc8a61a09a259284d9fe6 WatchSource:0}: Error finding container 3178c96da79d58a3526cb13169e2b30b62bca4ac4c2dc8a61a09a259284d9fe6: Status 404 returned error can't find the container with id 3178c96da79d58a3526cb13169e2b30b62bca4ac4c2dc8a61a09a259284d9fe6
May 28 09:55:54.488558 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:55:54.488517    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf" event={"ID":"7bda7c6a-0393-49ed-8c1c-b7d2884d14db","Type":"ContainerStarted","Data":"7e522e77600d9c3025e4fd51e8402b681f946bfaf9109f0962483cccb80d3fc7"}
May 28 09:55:54.488558 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:55:54.488563    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf" event={"ID":"7bda7c6a-0393-49ed-8c1c-b7d2884d14db","Type":"ContainerStarted","Data":"3178c96da79d58a3526cb13169e2b30b62bca4ac4c2dc8a61a09a259284d9fe6"}
May 28 09:55:59.506702 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:55:59.506667    2572 generic.go:358] "Generic (PLEG): container finished" podID="7bda7c6a-0393-49ed-8c1c-b7d2884d14db" containerID="7e522e77600d9c3025e4fd51e8402b681f946bfaf9109f0962483cccb80d3fc7" exitCode=0
May 28 09:55:59.507179 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:55:59.506717    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf" event={"ID":"7bda7c6a-0393-49ed-8c1c-b7d2884d14db","Type":"ContainerDied","Data":"7e522e77600d9c3025e4fd51e8402b681f946bfaf9109f0962483cccb80d3fc7"}
May 28 09:55:59.822416 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:55:59.822309    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4" podUID="569cdf1b-59e9-4b17-b454-6e4d5601ca44" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.27:8443: connect: connection refused"
May 28 09:56:00.302761 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:56:00.302714    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4" podUID="569cdf1b-59e9-4b17-b454-6e4d5601ca44" containerName="online" probeResult="failure" output="Get \"https://10.134.0.27:6567/health\": dial tcp 10.134.0.27:6567: connect: connection refused"
May 28 09:56:00.511386 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:56:00.511351    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf" event={"ID":"7bda7c6a-0393-49ed-8c1c-b7d2884d14db","Type":"ContainerStarted","Data":"f173261aa64849ceda8583f6d0ceedefa7343f5e40f7d893f8befac6c1ced91c"}
May 28 09:56:05.528314 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:56:05.528278    2572 generic.go:358] "Generic (PLEG): container finished" podID="7bda7c6a-0393-49ed-8c1c-b7d2884d14db" containerID="f173261aa64849ceda8583f6d0ceedefa7343f5e40f7d893f8befac6c1ced91c" exitCode=0
May 28 09:56:05.528836 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:56:05.528360    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf" event={"ID":"7bda7c6a-0393-49ed-8c1c-b7d2884d14db","Type":"ContainerDied","Data":"f173261aa64849ceda8583f6d0ceedefa7343f5e40f7d893f8befac6c1ced91c"}
May 28 09:56:06.535660 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:56:06.535617    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf" event={"ID":"7bda7c6a-0393-49ed-8c1c-b7d2884d14db","Type":"ContainerStarted","Data":"9892eaddab562014b7ab16e38efc507e79399e9a41c40f11323c408b4e8e0299"}
May 28 09:56:06.536147 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:56:06.535670    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf" event={"ID":"7bda7c6a-0393-49ed-8c1c-b7d2884d14db","Type":"ContainerStarted","Data":"f6644632b4bc85bb287c6dda94d5e20067af305b3011ceaafa8e6c673d1ee900"}
May 28 09:56:06.536147 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:56:06.535689    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf" event={"ID":"7bda7c6a-0393-49ed-8c1c-b7d2884d14db","Type":"ContainerStarted","Data":"1f9c70c7d257e7f17b44d91ba179e76f14249e19b36df7358595452d3dfa764f"}
May 28 09:56:06.536147 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:56:06.535703    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf" event={"ID":"7bda7c6a-0393-49ed-8c1c-b7d2884d14db","Type":"ContainerStarted","Data":"d2c15b8e64ac84004e5ca187e5dd118b2c7dd9b428410db2cda27ba647db0ae5"}
May 28 09:56:06.562688 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:56:06.562629    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf" podStartSLOduration=14.562610063 podStartE2EDuration="14.562610063s" podCreationTimestamp="2026-05-28 09:55:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 09:56:06.559580898 +0000 UTC m=+1495.242501681" watchObservedRunningTime="2026-05-28 09:56:06.562610063 +0000 UTC m=+1495.245530847"
May 28 09:56:08.710690 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:56:08.710652    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf"
May 28 09:56:08.711278 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:56:08.711259    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf"
May 28 09:56:08.711388 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:56:08.711377    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf"
May 28 09:56:08.711748 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:56:08.711732    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf"
May 28 09:56:08.713064 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:56:08.712886    2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf" podUID="7bda7c6a-0393-49ed-8c1c-b7d2884d14db" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.28:8816: connect: connection refused"
May 28 09:56:08.713064 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:56:08.712904    2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf" podUID="7bda7c6a-0393-49ed-8c1c-b7d2884d14db" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.28:6571: connect: connection refused"
May 28 09:56:08.713064 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:56:08.712913    2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf" podUID="7bda7c6a-0393-49ed-8c1c-b7d2884d14db" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.28:8443: connect: connection refused"
May 28 09:56:08.713064 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:56:08.712960    2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf" podUID="7bda7c6a-0393-49ed-8c1c-b7d2884d14db" containerName="online" probeResult="failure" output="Get \"https://10.134.0.28:6567/health\": dial tcp 10.134.0.28:6567: connect: connection refused"
May 28 09:56:09.822489 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:56:09.822441    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4" podUID="569cdf1b-59e9-4b17-b454-6e4d5601ca44" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.27:8443: connect: connection refused"
May 28 09:56:10.302461 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:56:10.302406    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4" podUID="569cdf1b-59e9-4b17-b454-6e4d5601ca44" containerName="online" probeResult="failure" output="Get \"https://10.134.0.27:6567/health\": dial tcp 10.134.0.27:6567: connect: connection refused"
May 28 09:56:11.711277 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:56:11.711243    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf"
May 28 09:56:11.711712 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:56:11.711397    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf"
May 28 09:56:11.711712 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:56:11.711579    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf"
May 28 09:56:11.711931 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:56:11.711907    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf"
May 28 09:56:11.712035 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:56:11.711944    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf"
May 28 09:56:11.712035 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:56:11.711958    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf"
May 28 09:56:11.712142 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:56:11.712114    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf"
May 28 09:56:11.712310 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:56:11.712293    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf"
May 28 09:56:11.712401 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:56:11.712387    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf"
May 28 09:56:11.715891 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:56:11.715873    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf"
May 28 09:56:12.562963 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:56:12.562925    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf"
May 28 09:56:12.565853 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:56:12.565828    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf"
May 28 09:56:19.822851 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:56:19.822800    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4" podUID="569cdf1b-59e9-4b17-b454-6e4d5601ca44" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.27:8443: connect: connection refused"
May 28 09:56:19.823305 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:56:19.823002    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4"
May 28 09:56:20.302650 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:56:20.302603    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4" podUID="569cdf1b-59e9-4b17-b454-6e4d5601ca44" containerName="online" probeResult="failure" output="Get \"https://10.134.0.27:6567/health\": dial tcp 10.134.0.27:6567: connect: connection refused"
May 28 09:56:20.302799 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:56:20.302773    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4"
May 28 09:56:22.600505 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:56:22.600469    2572 generic.go:358] "Generic (PLEG): container finished" podID="569cdf1b-59e9-4b17-b454-6e4d5601ca44" containerID="0eb9eb4d3ff8e9c9b74b8a27c7fef292a318b5f441d03444c77f1134a3869c59" exitCode=137
May 28 09:56:22.600505 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:56:22.600496    2572 generic.go:358] "Generic (PLEG): container finished" podID="569cdf1b-59e9-4b17-b454-6e4d5601ca44" containerID="7cb521a00c48fc3f61dcfd8a7bbeef206d50874b4158e496e508fc6512f46b32" exitCode=137
May 28 09:56:22.600934 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:56:22.600535    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4" event={"ID":"569cdf1b-59e9-4b17-b454-6e4d5601ca44","Type":"ContainerDied","Data":"0eb9eb4d3ff8e9c9b74b8a27c7fef292a318b5f441d03444c77f1134a3869c59"}
May 28 09:56:22.600934 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:56:22.600569    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4" event={"ID":"569cdf1b-59e9-4b17-b454-6e4d5601ca44","Type":"ContainerDied","Data":"7cb521a00c48fc3f61dcfd8a7bbeef206d50874b4158e496e508fc6512f46b32"}
May 28 09:56:23.154036 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:56:23.154010    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4"
May 28 09:56:23.252731 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:56:23.252696    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/569cdf1b-59e9-4b17-b454-6e4d5601ca44-online-tls\") pod \"569cdf1b-59e9-4b17-b454-6e4d5601ca44\" (UID: \"569cdf1b-59e9-4b17-b454-6e4d5601ca44\") "
May 28 09:56:23.252922 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:56:23.252756    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/569cdf1b-59e9-4b17-b454-6e4d5601ca44-feast-data\") pod \"569cdf1b-59e9-4b17-b454-6e4d5601ca44\" (UID: \"569cdf1b-59e9-4b17-b454-6e4d5601ca44\") "
May 28 09:56:23.252922 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:56:23.252807    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mmrx8\" (UniqueName: \"kubernetes.io/projected/569cdf1b-59e9-4b17-b454-6e4d5601ca44-kube-api-access-mmrx8\") pod \"569cdf1b-59e9-4b17-b454-6e4d5601ca44\" (UID: \"569cdf1b-59e9-4b17-b454-6e4d5601ca44\") "
May 28 09:56:23.252922 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:56:23.252827    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/569cdf1b-59e9-4b17-b454-6e4d5601ca44-ui-tls\") pod \"569cdf1b-59e9-4b17-b454-6e4d5601ca44\" (UID: \"569cdf1b-59e9-4b17-b454-6e4d5601ca44\") "
May 28 09:56:23.252922 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:56:23.252844    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/569cdf1b-59e9-4b17-b454-6e4d5601ca44-offline-tls\") pod \"569cdf1b-59e9-4b17-b454-6e4d5601ca44\" (UID: \"569cdf1b-59e9-4b17-b454-6e4d5601ca44\") "
May 28 09:56:23.252922 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:56:23.252893    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/569cdf1b-59e9-4b17-b454-6e4d5601ca44-registry-tls\") pod \"569cdf1b-59e9-4b17-b454-6e4d5601ca44\" (UID: \"569cdf1b-59e9-4b17-b454-6e4d5601ca44\") "
May 28 09:56:23.253432 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:56:23.253402    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/569cdf1b-59e9-4b17-b454-6e4d5601ca44-feast-data" (OuterVolumeSpecName: "feast-data") pod "569cdf1b-59e9-4b17-b454-6e4d5601ca44" (UID: "569cdf1b-59e9-4b17-b454-6e4d5601ca44"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 09:56:23.255268 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:56:23.255240    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/569cdf1b-59e9-4b17-b454-6e4d5601ca44-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "569cdf1b-59e9-4b17-b454-6e4d5601ca44" (UID: "569cdf1b-59e9-4b17-b454-6e4d5601ca44"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:56:23.255373 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:56:23.255262    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/569cdf1b-59e9-4b17-b454-6e4d5601ca44-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "569cdf1b-59e9-4b17-b454-6e4d5601ca44" (UID: "569cdf1b-59e9-4b17-b454-6e4d5601ca44"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:56:23.255373 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:56:23.255282    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/569cdf1b-59e9-4b17-b454-6e4d5601ca44-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "569cdf1b-59e9-4b17-b454-6e4d5601ca44" (UID: "569cdf1b-59e9-4b17-b454-6e4d5601ca44"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:56:23.255469 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:56:23.255401    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/569cdf1b-59e9-4b17-b454-6e4d5601ca44-online-tls" (OuterVolumeSpecName: "online-tls") pod "569cdf1b-59e9-4b17-b454-6e4d5601ca44" (UID: "569cdf1b-59e9-4b17-b454-6e4d5601ca44"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:56:23.255469 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:56:23.255417    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/569cdf1b-59e9-4b17-b454-6e4d5601ca44-kube-api-access-mmrx8" (OuterVolumeSpecName: "kube-api-access-mmrx8") pod "569cdf1b-59e9-4b17-b454-6e4d5601ca44" (UID: "569cdf1b-59e9-4b17-b454-6e4d5601ca44"). InnerVolumeSpecName "kube-api-access-mmrx8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 09:56:23.354025 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:56:23.353917    2572 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/569cdf1b-59e9-4b17-b454-6e4d5601ca44-online-tls\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:56:23.354025 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:56:23.353944    2572 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/569cdf1b-59e9-4b17-b454-6e4d5601ca44-feast-data\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:56:23.354025 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:56:23.353953    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mmrx8\" (UniqueName: \"kubernetes.io/projected/569cdf1b-59e9-4b17-b454-6e4d5601ca44-kube-api-access-mmrx8\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:56:23.354025 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:56:23.353964    2572 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/569cdf1b-59e9-4b17-b454-6e4d5601ca44-ui-tls\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:56:23.354025 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:56:23.353986    2572 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/569cdf1b-59e9-4b17-b454-6e4d5601ca44-offline-tls\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:56:23.354025 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:56:23.353997    2572 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/569cdf1b-59e9-4b17-b454-6e4d5601ca44-registry-tls\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:56:23.606396 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:56:23.606308    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4" event={"ID":"569cdf1b-59e9-4b17-b454-6e4d5601ca44","Type":"ContainerDied","Data":"966ed8f8a070d83dc8f30f82b0147a11768368c22d6b887ac37d09765bef5f91"}
May 28 09:56:23.606396 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:56:23.606357    2572 scope.go:117] "RemoveContainer" containerID="7f310a3f7dcbe46b922f478d0c3e8d6040e03635bfbeff49591f1e506d455c59"
May 28 09:56:23.606396 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:56:23.606362    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4"
May 28 09:56:23.615736 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:56:23.615718    2572 scope.go:117] "RemoveContainer" containerID="0eb9eb4d3ff8e9c9b74b8a27c7fef292a318b5f441d03444c77f1134a3869c59"
May 28 09:56:23.623622 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:56:23.623603    2572 scope.go:117] "RemoveContainer" containerID="8adcae27ea8c85baaea9a00f00f74e4816272e6d620bdeb933b81effe401a7b8"
May 28 09:56:23.630437 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:56:23.630419    2572 scope.go:117] "RemoveContainer" containerID="7cb521a00c48fc3f61dcfd8a7bbeef206d50874b4158e496e508fc6512f46b32"
May 28 09:56:23.633857 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:56:23.633837    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4"]
May 28 09:56:23.637243 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:56:23.637211    2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-fhws4"]
May 28 09:56:23.638222 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:56:23.638203    2572 scope.go:117] "RemoveContainer" containerID="da61f47ed3252059a830cca47a41732f826464ae40418a9471d40c5491b02aa9"
May 28 09:56:23.645085 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:56:23.645049    2572 scope.go:117] "RemoveContainer" containerID="09d928fd092863889a12f06bdce0bc750d6083f06c15b3624ed0242be6b9667f"
May 28 09:56:23.925250 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:56:23.925170    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="569cdf1b-59e9-4b17-b454-6e4d5601ca44" path="/var/lib/kubelet/pods/569cdf1b-59e9-4b17-b454-6e4d5601ca44/volumes"
May 28 09:57:14.157562 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:14.157526    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-9vjwj"]
May 28 09:57:14.157954 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:14.157828    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="569cdf1b-59e9-4b17-b454-6e4d5601ca44" containerName="feast-init"
May 28 09:57:14.157954 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:14.157838    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="569cdf1b-59e9-4b17-b454-6e4d5601ca44" containerName="feast-init"
May 28 09:57:14.157954 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:14.157847    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="569cdf1b-59e9-4b17-b454-6e4d5601ca44" containerName="offline"
May 28 09:57:14.157954 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:14.157853    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="569cdf1b-59e9-4b17-b454-6e4d5601ca44" containerName="offline"
May 28 09:57:14.157954 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:14.157866    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="569cdf1b-59e9-4b17-b454-6e4d5601ca44" containerName="registry"
May 28 09:57:14.157954 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:14.157874    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="569cdf1b-59e9-4b17-b454-6e4d5601ca44" containerName="registry"
May 28 09:57:14.157954 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:14.157885    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="569cdf1b-59e9-4b17-b454-6e4d5601ca44" containerName="online"
May 28 09:57:14.157954 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:14.157893    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="569cdf1b-59e9-4b17-b454-6e4d5601ca44" containerName="online"
May 28 09:57:14.157954 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:14.157903    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="569cdf1b-59e9-4b17-b454-6e4d5601ca44" containerName="ui"
May 28 09:57:14.157954 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:14.157911    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="569cdf1b-59e9-4b17-b454-6e4d5601ca44" containerName="ui"
May 28 09:57:14.157954 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:14.157925    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="569cdf1b-59e9-4b17-b454-6e4d5601ca44" containerName="feast-apply"
May 28 09:57:14.157954 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:14.157930    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="569cdf1b-59e9-4b17-b454-6e4d5601ca44" containerName="feast-apply"
May 28 09:57:14.158356 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:14.157994    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="569cdf1b-59e9-4b17-b454-6e4d5601ca44" containerName="offline"
May 28 09:57:14.158356 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:14.158006    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="569cdf1b-59e9-4b17-b454-6e4d5601ca44" containerName="ui"
May 28 09:57:14.158356 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:14.158014    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="569cdf1b-59e9-4b17-b454-6e4d5601ca44" containerName="online"
May 28 09:57:14.158356 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:14.158021    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="569cdf1b-59e9-4b17-b454-6e4d5601ca44" containerName="registry"
May 28 09:57:14.162180 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:14.162157    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-9vjwj"
May 28 09:57:14.164956 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:14.164930    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
May 28 09:57:14.165813 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:14.165780    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
May 28 09:57:14.165813 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:14.165799    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
May 28 09:57:14.165813 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:14.165808    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-4klqp\""
May 28 09:57:14.166059 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:14.165843    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
May 28 09:57:14.166059 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:14.165802    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
May 28 09:57:14.166059 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:14.165801    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
May 28 09:57:14.176395 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:14.176371    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-9vjwj"]
May 28 09:57:14.281691 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:14.281645    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrwx8\" (UniqueName: \"kubernetes.io/projected/9246e146-c9fa-41c6-aff0-a7413aa399b6-kube-api-access-mrwx8\") pod \"feast-simple-feast-remote-setup-5cff94746b-9vjwj\" (UID: \"9246e146-c9fa-41c6-aff0-a7413aa399b6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-9vjwj"
May 28 09:57:14.281691 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:14.281693    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9246e146-c9fa-41c6-aff0-a7413aa399b6-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-9vjwj\" (UID: \"9246e146-c9fa-41c6-aff0-a7413aa399b6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-9vjwj"
May 28 09:57:14.281941 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:14.281716    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/9246e146-c9fa-41c6-aff0-a7413aa399b6-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-9vjwj\" (UID: \"9246e146-c9fa-41c6-aff0-a7413aa399b6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-9vjwj"
May 28 09:57:14.281941 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:14.281734    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9246e146-c9fa-41c6-aff0-a7413aa399b6-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-9vjwj\" (UID: \"9246e146-c9fa-41c6-aff0-a7413aa399b6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-9vjwj"
May 28 09:57:14.281941 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:14.281777    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/9246e146-c9fa-41c6-aff0-a7413aa399b6-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-9vjwj\" (UID: \"9246e146-c9fa-41c6-aff0-a7413aa399b6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-9vjwj"
May 28 09:57:14.281941 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:14.281810    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/9246e146-c9fa-41c6-aff0-a7413aa399b6-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-9vjwj\" (UID: \"9246e146-c9fa-41c6-aff0-a7413aa399b6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-9vjwj"
May 28 09:57:14.382996 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:14.382920    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mrwx8\" (UniqueName: \"kubernetes.io/projected/9246e146-c9fa-41c6-aff0-a7413aa399b6-kube-api-access-mrwx8\") pod \"feast-simple-feast-remote-setup-5cff94746b-9vjwj\" (UID: \"9246e146-c9fa-41c6-aff0-a7413aa399b6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-9vjwj"
May 28 09:57:14.382996 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:14.383009    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9246e146-c9fa-41c6-aff0-a7413aa399b6-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-9vjwj\" (UID: \"9246e146-c9fa-41c6-aff0-a7413aa399b6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-9vjwj"
May 28 09:57:14.383243 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:14.383032    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/9246e146-c9fa-41c6-aff0-a7413aa399b6-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-9vjwj\" (UID: \"9246e146-c9fa-41c6-aff0-a7413aa399b6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-9vjwj"
May 28 09:57:14.383243 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:14.383049    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9246e146-c9fa-41c6-aff0-a7413aa399b6-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-9vjwj\" (UID: \"9246e146-c9fa-41c6-aff0-a7413aa399b6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-9vjwj"
May 28 09:57:14.383243 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:14.383078    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/9246e146-c9fa-41c6-aff0-a7413aa399b6-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-9vjwj\" (UID: \"9246e146-c9fa-41c6-aff0-a7413aa399b6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-9vjwj"
May 28 09:57:14.383243 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:14.383111    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/9246e146-c9fa-41c6-aff0-a7413aa399b6-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-9vjwj\" (UID: \"9246e146-c9fa-41c6-aff0-a7413aa399b6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-9vjwj"
May 28 09:57:14.383243 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:57:14.383175    2572 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-online-tls: secret "feast-simple-feast-remote-setup-online-tls" not found
May 28 09:57:14.383473 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:57:14.383251    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9246e146-c9fa-41c6-aff0-a7413aa399b6-online-tls podName:9246e146-c9fa-41c6-aff0-a7413aa399b6 nodeName:}" failed. No retries permitted until 2026-05-28 09:57:14.88323495 +0000 UTC m=+1563.566155710 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/9246e146-c9fa-41c6-aff0-a7413aa399b6-online-tls") pod "feast-simple-feast-remote-setup-5cff94746b-9vjwj" (UID: "9246e146-c9fa-41c6-aff0-a7413aa399b6") : secret "feast-simple-feast-remote-setup-online-tls" not found
May 28 09:57:14.383473 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:57:14.383175    2572 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-ui-tls: secret "feast-simple-feast-remote-setup-ui-tls" not found
May 28 09:57:14.383473 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:57:14.383293    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9246e146-c9fa-41c6-aff0-a7413aa399b6-ui-tls podName:9246e146-c9fa-41c6-aff0-a7413aa399b6 nodeName:}" failed. No retries permitted until 2026-05-28 09:57:14.883283597 +0000 UTC m=+1563.566204375 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/9246e146-c9fa-41c6-aff0-a7413aa399b6-ui-tls") pod "feast-simple-feast-remote-setup-5cff94746b-9vjwj" (UID: "9246e146-c9fa-41c6-aff0-a7413aa399b6") : secret "feast-simple-feast-remote-setup-ui-tls" not found
May 28 09:57:14.383635 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:14.383493    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9246e146-c9fa-41c6-aff0-a7413aa399b6-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-9vjwj\" (UID: \"9246e146-c9fa-41c6-aff0-a7413aa399b6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-9vjwj"
May 28 09:57:14.383713 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:14.383697    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/9246e146-c9fa-41c6-aff0-a7413aa399b6-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-9vjwj\" (UID: \"9246e146-c9fa-41c6-aff0-a7413aa399b6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-9vjwj"
May 28 09:57:14.385935 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:14.385903    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/9246e146-c9fa-41c6-aff0-a7413aa399b6-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-9vjwj\" (UID: \"9246e146-c9fa-41c6-aff0-a7413aa399b6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-9vjwj"
May 28 09:57:14.392320 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:14.392292    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrwx8\" (UniqueName: \"kubernetes.io/projected/9246e146-c9fa-41c6-aff0-a7413aa399b6-kube-api-access-mrwx8\") pod \"feast-simple-feast-remote-setup-5cff94746b-9vjwj\" (UID: \"9246e146-c9fa-41c6-aff0-a7413aa399b6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-9vjwj"
May 28 09:57:14.886949 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:14.886907    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9246e146-c9fa-41c6-aff0-a7413aa399b6-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-9vjwj\" (UID: \"9246e146-c9fa-41c6-aff0-a7413aa399b6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-9vjwj"
May 28 09:57:14.886949 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:14.886953    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/9246e146-c9fa-41c6-aff0-a7413aa399b6-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-9vjwj\" (UID: \"9246e146-c9fa-41c6-aff0-a7413aa399b6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-9vjwj"
May 28 09:57:14.889405 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:14.889377    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9246e146-c9fa-41c6-aff0-a7413aa399b6-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-9vjwj\" (UID: \"9246e146-c9fa-41c6-aff0-a7413aa399b6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-9vjwj"
May 28 09:57:14.889519 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:14.889443    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/9246e146-c9fa-41c6-aff0-a7413aa399b6-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-9vjwj\" (UID: \"9246e146-c9fa-41c6-aff0-a7413aa399b6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-9vjwj"
May 28 09:57:15.071461 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:15.071418    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-9vjwj"
May 28 09:57:15.209298 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:15.209271    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-9vjwj"]
May 28 09:57:15.211847 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:57:15.211818    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9246e146_c9fa_41c6_aff0_a7413aa399b6.slice/crio-a84e1c623cccaf1e5e07993eecf9039ee81d635f28903bfcc94f7f3cd120cf05 WatchSource:0}: Error finding container a84e1c623cccaf1e5e07993eecf9039ee81d635f28903bfcc94f7f3cd120cf05: Status 404 returned error can't find the container with id a84e1c623cccaf1e5e07993eecf9039ee81d635f28903bfcc94f7f3cd120cf05
May 28 09:57:15.759572 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:15.759530    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-9vjwj" event={"ID":"9246e146-c9fa-41c6-aff0-a7413aa399b6","Type":"ContainerStarted","Data":"0e61be5d9cdfd51759dd5d676a79645944e33f1a763969875435d28fab4a3587"}
May 28 09:57:15.759572 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:15.759572    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-9vjwj" event={"ID":"9246e146-c9fa-41c6-aff0-a7413aa399b6","Type":"ContainerStarted","Data":"a84e1c623cccaf1e5e07993eecf9039ee81d635f28903bfcc94f7f3cd120cf05"}
May 28 09:57:20.775505 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:20.775470    2572 generic.go:358] "Generic (PLEG): container finished" podID="9246e146-c9fa-41c6-aff0-a7413aa399b6" containerID="0e61be5d9cdfd51759dd5d676a79645944e33f1a763969875435d28fab4a3587" exitCode=0
May 28 09:57:20.775505 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:20.775509    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-9vjwj" event={"ID":"9246e146-c9fa-41c6-aff0-a7413aa399b6","Type":"ContainerDied","Data":"0e61be5d9cdfd51759dd5d676a79645944e33f1a763969875435d28fab4a3587"}
May 28 09:57:21.780479 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:21.780439    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-9vjwj" event={"ID":"9246e146-c9fa-41c6-aff0-a7413aa399b6","Type":"ContainerStarted","Data":"35218a56b289b3f0fad0f447559246a2882861cc70120d84511e25c40bc6c625"}
May 28 09:57:26.796160 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:26.796073    2572 generic.go:358] "Generic (PLEG): container finished" podID="9246e146-c9fa-41c6-aff0-a7413aa399b6" containerID="35218a56b289b3f0fad0f447559246a2882861cc70120d84511e25c40bc6c625" exitCode=0
May 28 09:57:26.796160 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:26.796140    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-9vjwj" event={"ID":"9246e146-c9fa-41c6-aff0-a7413aa399b6","Type":"ContainerDied","Data":"35218a56b289b3f0fad0f447559246a2882861cc70120d84511e25c40bc6c625"}
May 28 09:57:27.803106 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:27.803067    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-9vjwj" event={"ID":"9246e146-c9fa-41c6-aff0-a7413aa399b6","Type":"ContainerStarted","Data":"73a2f9bac8eebc1f8fbca7ea29e574a9fd390d177b768da56d15cd876b3a19b6"}
May 28 09:57:27.803568 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:27.803119    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-9vjwj" event={"ID":"9246e146-c9fa-41c6-aff0-a7413aa399b6","Type":"ContainerStarted","Data":"d4b70e0dcd1c1c5f76b5a08d29de5c8a6d7b7285224e78cfe0bdd929785ea574"}
May 28 09:57:27.803568 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:27.803133    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-9vjwj" event={"ID":"9246e146-c9fa-41c6-aff0-a7413aa399b6","Type":"ContainerStarted","Data":"0bc6169aa4e76d2a8234e1b6f14485ec9727de804a8d6215acc2c90f7dfac5c8"}
May 28 09:57:27.827890 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:27.827832    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-9vjwj" podStartSLOduration=13.827811061 podStartE2EDuration="13.827811061s" podCreationTimestamp="2026-05-28 09:57:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 09:57:27.825329382 +0000 UTC m=+1576.508250167" watchObservedRunningTime="2026-05-28 09:57:27.827811061 +0000 UTC m=+1576.510731857"
May 28 09:57:30.071883 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:30.071833    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-9vjwj"
May 28 09:57:30.071883 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:30.071891    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-9vjwj"
May 28 09:57:30.072452 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:30.071906    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-9vjwj"
May 28 09:57:30.073667 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:30.073627    2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-9vjwj" podUID="9246e146-c9fa-41c6-aff0-a7413aa399b6" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.29:8443: connect: connection refused"
May 28 09:57:30.073667 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:30.073644    2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-9vjwj" podUID="9246e146-c9fa-41c6-aff0-a7413aa399b6" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.29:8816: connect: connection refused"
May 28 09:57:30.073889 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:30.073674    2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-9vjwj" podUID="9246e146-c9fa-41c6-aff0-a7413aa399b6" containerName="online" probeResult="failure" output="Get \"https://10.134.0.29:6567/health\": dial tcp 10.134.0.29:6567: connect: connection refused"
May 28 09:57:33.073239 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:33.073207    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-9vjwj"
May 28 09:57:33.073834 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:33.073813    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-9vjwj"
May 28 09:57:33.073942 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:33.073848    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-9vjwj"
May 28 09:57:33.074152 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:33.074132    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-9vjwj"
May 28 09:57:33.077674 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:33.077656    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-9vjwj"
May 28 09:57:33.822818 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:33.822775    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-9vjwj"
May 28 09:57:33.822818 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:33.822820    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-9vjwj"
May 28 09:57:33.823450 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:33.823428    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-9vjwj"
May 28 09:57:33.825690 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:57:33.825675    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-9vjwj"
May 28 09:58:35.191209 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:58:35.191169    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-9vjwj"]
May 28 09:58:35.191832 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:58:35.191598    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-9vjwj" podUID="9246e146-c9fa-41c6-aff0-a7413aa399b6" containerName="online" containerID="cri-o://0bc6169aa4e76d2a8234e1b6f14485ec9727de804a8d6215acc2c90f7dfac5c8" gracePeriod=30
May 28 09:58:35.192007 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:58:35.191963    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-9vjwj" podUID="9246e146-c9fa-41c6-aff0-a7413aa399b6" containerName="ui" containerID="cri-o://73a2f9bac8eebc1f8fbca7ea29e574a9fd390d177b768da56d15cd876b3a19b6" gracePeriod=30
May 28 09:58:35.192101 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:58:35.192009    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-9vjwj" podUID="9246e146-c9fa-41c6-aff0-a7413aa399b6" containerName="offline" containerID="cri-o://d4b70e0dcd1c1c5f76b5a08d29de5c8a6d7b7285224e78cfe0bdd929785ea574" gracePeriod=30
May 28 09:58:35.363622 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:58:35.363576    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf"]
May 28 09:58:35.364125 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:58:35.364065    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf" podUID="7bda7c6a-0393-49ed-8c1c-b7d2884d14db" containerName="registry" containerID="cri-o://d2c15b8e64ac84004e5ca187e5dd118b2c7dd9b428410db2cda27ba647db0ae5" gracePeriod=30
May 28 09:58:35.364366 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:58:35.364165    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf" podUID="7bda7c6a-0393-49ed-8c1c-b7d2884d14db" containerName="offline" containerID="cri-o://f6644632b4bc85bb287c6dda94d5e20067af305b3011ceaafa8e6c673d1ee900" gracePeriod=30
May 28 09:58:35.364566 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:58:35.364207    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf" podUID="7bda7c6a-0393-49ed-8c1c-b7d2884d14db" containerName="ui" containerID="cri-o://9892eaddab562014b7ab16e38efc507e79399e9a41c40f11323c408b4e8e0299" gracePeriod=30
May 28 09:58:35.364689 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:58:35.364237    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf" podUID="7bda7c6a-0393-49ed-8c1c-b7d2884d14db" containerName="online" containerID="cri-o://1f9c70c7d257e7f17b44d91ba179e76f14249e19b36df7358595452d3dfa764f" gracePeriod=30
May 28 09:58:36.006440 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:58:36.006406    2572 generic.go:358] "Generic (PLEG): container finished" podID="7bda7c6a-0393-49ed-8c1c-b7d2884d14db" containerID="9892eaddab562014b7ab16e38efc507e79399e9a41c40f11323c408b4e8e0299" exitCode=0
May 28 09:58:36.006601 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:58:36.006485    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf" event={"ID":"7bda7c6a-0393-49ed-8c1c-b7d2884d14db","Type":"ContainerDied","Data":"9892eaddab562014b7ab16e38efc507e79399e9a41c40f11323c408b4e8e0299"}
May 28 09:58:36.008895 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:58:36.008870    2572 generic.go:358] "Generic (PLEG): container finished" podID="9246e146-c9fa-41c6-aff0-a7413aa399b6" containerID="73a2f9bac8eebc1f8fbca7ea29e574a9fd390d177b768da56d15cd876b3a19b6" exitCode=0
May 28 09:58:36.009030 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:58:36.008916    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-9vjwj" event={"ID":"9246e146-c9fa-41c6-aff0-a7413aa399b6","Type":"ContainerDied","Data":"73a2f9bac8eebc1f8fbca7ea29e574a9fd390d177b768da56d15cd876b3a19b6"}
May 28 09:58:37.014221 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:58:37.014186    2572 generic.go:358] "Generic (PLEG): container finished" podID="9246e146-c9fa-41c6-aff0-a7413aa399b6" containerID="0bc6169aa4e76d2a8234e1b6f14485ec9727de804a8d6215acc2c90f7dfac5c8" exitCode=0
May 28 09:58:37.014615 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:58:37.014252    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-9vjwj" event={"ID":"9246e146-c9fa-41c6-aff0-a7413aa399b6","Type":"ContainerDied","Data":"0bc6169aa4e76d2a8234e1b6f14485ec9727de804a8d6215acc2c90f7dfac5c8"}
May 28 09:58:37.016651 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:58:37.016628    2572 generic.go:358] "Generic (PLEG): container finished" podID="7bda7c6a-0393-49ed-8c1c-b7d2884d14db" containerID="1f9c70c7d257e7f17b44d91ba179e76f14249e19b36df7358595452d3dfa764f" exitCode=0
May 28 09:58:37.016755 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:58:37.016672    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf" event={"ID":"7bda7c6a-0393-49ed-8c1c-b7d2884d14db","Type":"ContainerDied","Data":"1f9c70c7d257e7f17b44d91ba179e76f14249e19b36df7358595452d3dfa764f"}
May 28 09:58:41.712148 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:58:41.712095    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf" podUID="7bda7c6a-0393-49ed-8c1c-b7d2884d14db" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.28:8443: connect: connection refused"
May 28 09:58:42.563731 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:58:42.563683    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf" podUID="7bda7c6a-0393-49ed-8c1c-b7d2884d14db" containerName="online" probeResult="failure" output="Get \"https://10.134.0.28:6567/health\": dial tcp 10.134.0.28:6567: connect: connection refused"
May 28 09:58:43.823602 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:58:43.823560    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-9vjwj" podUID="9246e146-c9fa-41c6-aff0-a7413aa399b6" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.29:8443: connect: connection refused"
May 28 09:58:43.824021 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:58:43.823568    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-9vjwj" podUID="9246e146-c9fa-41c6-aff0-a7413aa399b6" containerName="online" probeResult="failure" output="Get \"https://10.134.0.29:6567/health\": dial tcp 10.134.0.29:6567: connect: connection refused"
May 28 09:58:51.712286 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:58:51.712234    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf" podUID="7bda7c6a-0393-49ed-8c1c-b7d2884d14db" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.28:8443: connect: connection refused"
May 28 09:58:52.563566 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:58:52.563522    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf" podUID="7bda7c6a-0393-49ed-8c1c-b7d2884d14db" containerName="online" probeResult="failure" output="Get \"https://10.134.0.28:6567/health\": dial tcp 10.134.0.28:6567: connect: connection refused"
May 28 09:58:53.823139 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:58:53.823094    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-9vjwj" podUID="9246e146-c9fa-41c6-aff0-a7413aa399b6" containerName="online" probeResult="failure" output="Get \"https://10.134.0.29:6567/health\": dial tcp 10.134.0.29:6567: connect: connection refused"
May 28 09:58:53.823550 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:58:53.823086    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-9vjwj" podUID="9246e146-c9fa-41c6-aff0-a7413aa399b6" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.29:8443: connect: connection refused"
May 28 09:59:01.712493 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:01.712451    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf" podUID="7bda7c6a-0393-49ed-8c1c-b7d2884d14db" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.28:8443: connect: connection refused"
May 28 09:59:01.713000 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:01.712578    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf"
May 28 09:59:02.563828 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:02.563778    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf" podUID="7bda7c6a-0393-49ed-8c1c-b7d2884d14db" containerName="online" probeResult="failure" output="Get \"https://10.134.0.28:6567/health\": dial tcp 10.134.0.28:6567: connect: connection refused"
May 28 09:59:02.564039 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:02.563908    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf"
May 28 09:59:03.823364 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:03.823319    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-9vjwj" podUID="9246e146-c9fa-41c6-aff0-a7413aa399b6" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.29:8443: connect: connection refused"
May 28 09:59:03.823821 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:03.823370    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-9vjwj" podUID="9246e146-c9fa-41c6-aff0-a7413aa399b6" containerName="online" probeResult="failure" output="Get \"https://10.134.0.29:6567/health\": dial tcp 10.134.0.29:6567: connect: connection refused"
May 28 09:59:03.823821 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:03.823429    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-9vjwj"
May 28 09:59:03.823821 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:03.823475    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-9vjwj"
May 28 09:59:05.839769 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:05.839737    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-9vjwj"
May 28 09:59:05.856864 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:05.856834    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/9246e146-c9fa-41c6-aff0-a7413aa399b6-registry-tls\") pod \"9246e146-c9fa-41c6-aff0-a7413aa399b6\" (UID: \"9246e146-c9fa-41c6-aff0-a7413aa399b6\") "
May 28 09:59:05.857070 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:05.856888    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mrwx8\" (UniqueName: \"kubernetes.io/projected/9246e146-c9fa-41c6-aff0-a7413aa399b6-kube-api-access-mrwx8\") pod \"9246e146-c9fa-41c6-aff0-a7413aa399b6\" (UID: \"9246e146-c9fa-41c6-aff0-a7413aa399b6\") "
May 28 09:59:05.857070 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:05.856917    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9246e146-c9fa-41c6-aff0-a7413aa399b6-online-tls\") pod \"9246e146-c9fa-41c6-aff0-a7413aa399b6\" (UID: \"9246e146-c9fa-41c6-aff0-a7413aa399b6\") "
May 28 09:59:05.857070 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:05.856952    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9246e146-c9fa-41c6-aff0-a7413aa399b6-feast-data\") pod \"9246e146-c9fa-41c6-aff0-a7413aa399b6\" (UID: \"9246e146-c9fa-41c6-aff0-a7413aa399b6\") "
May 28 09:59:05.857070 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:05.857026    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/9246e146-c9fa-41c6-aff0-a7413aa399b6-ui-tls\") pod \"9246e146-c9fa-41c6-aff0-a7413aa399b6\" (UID: \"9246e146-c9fa-41c6-aff0-a7413aa399b6\") "
May 28 09:59:05.857070 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:05.857051    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/9246e146-c9fa-41c6-aff0-a7413aa399b6-offline-tls\") pod \"9246e146-c9fa-41c6-aff0-a7413aa399b6\" (UID: \"9246e146-c9fa-41c6-aff0-a7413aa399b6\") "
May 28 09:59:05.857317 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:05.857270    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9246e146-c9fa-41c6-aff0-a7413aa399b6-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "9246e146-c9fa-41c6-aff0-a7413aa399b6" (UID: "9246e146-c9fa-41c6-aff0-a7413aa399b6"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 09:59:05.857565 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:05.857510    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9246e146-c9fa-41c6-aff0-a7413aa399b6-feast-data" (OuterVolumeSpecName: "feast-data") pod "9246e146-c9fa-41c6-aff0-a7413aa399b6" (UID: "9246e146-c9fa-41c6-aff0-a7413aa399b6"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 09:59:05.859328 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:05.859301    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9246e146-c9fa-41c6-aff0-a7413aa399b6-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "9246e146-c9fa-41c6-aff0-a7413aa399b6" (UID: "9246e146-c9fa-41c6-aff0-a7413aa399b6"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:59:05.859458 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:05.859429    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9246e146-c9fa-41c6-aff0-a7413aa399b6-online-tls" (OuterVolumeSpecName: "online-tls") pod "9246e146-c9fa-41c6-aff0-a7413aa399b6" (UID: "9246e146-c9fa-41c6-aff0-a7413aa399b6"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:59:05.859552 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:05.859447    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9246e146-c9fa-41c6-aff0-a7413aa399b6-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "9246e146-c9fa-41c6-aff0-a7413aa399b6" (UID: "9246e146-c9fa-41c6-aff0-a7413aa399b6"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:59:05.859552 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:05.859485    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9246e146-c9fa-41c6-aff0-a7413aa399b6-kube-api-access-mrwx8" (OuterVolumeSpecName: "kube-api-access-mrwx8") pod "9246e146-c9fa-41c6-aff0-a7413aa399b6" (UID: "9246e146-c9fa-41c6-aff0-a7413aa399b6"). InnerVolumeSpecName "kube-api-access-mrwx8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 09:59:05.958707 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:05.958631    2572 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9246e146-c9fa-41c6-aff0-a7413aa399b6-online-tls\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:59:05.958707 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:05.958660    2572 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9246e146-c9fa-41c6-aff0-a7413aa399b6-feast-data\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:59:05.958707 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:05.958669    2572 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/9246e146-c9fa-41c6-aff0-a7413aa399b6-ui-tls\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:59:05.958707 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:05.958677    2572 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/9246e146-c9fa-41c6-aff0-a7413aa399b6-offline-tls\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:59:05.958707 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:05.958686    2572 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/9246e146-c9fa-41c6-aff0-a7413aa399b6-registry-tls\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:59:05.958707 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:05.958695    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mrwx8\" (UniqueName: \"kubernetes.io/projected/9246e146-c9fa-41c6-aff0-a7413aa399b6-kube-api-access-mrwx8\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:59:06.008076 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.008048    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf"
May 28 09:59:06.059152 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.059113    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/7bda7c6a-0393-49ed-8c1c-b7d2884d14db-ui-tls\") pod \"7bda7c6a-0393-49ed-8c1c-b7d2884d14db\" (UID: \"7bda7c6a-0393-49ed-8c1c-b7d2884d14db\") "
May 28 09:59:06.059335 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.059169    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-klpq5\" (UniqueName: \"kubernetes.io/projected/7bda7c6a-0393-49ed-8c1c-b7d2884d14db-kube-api-access-klpq5\") pod \"7bda7c6a-0393-49ed-8c1c-b7d2884d14db\" (UID: \"7bda7c6a-0393-49ed-8c1c-b7d2884d14db\") "
May 28 09:59:06.059335 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.059200    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7bda7c6a-0393-49ed-8c1c-b7d2884d14db-feast-data\") pod \"7bda7c6a-0393-49ed-8c1c-b7d2884d14db\" (UID: \"7bda7c6a-0393-49ed-8c1c-b7d2884d14db\") "
May 28 09:59:06.059335 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.059216    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7bda7c6a-0393-49ed-8c1c-b7d2884d14db-offline-tls\") pod \"7bda7c6a-0393-49ed-8c1c-b7d2884d14db\" (UID: \"7bda7c6a-0393-49ed-8c1c-b7d2884d14db\") "
May 28 09:59:06.059335 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.059249    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/7bda7c6a-0393-49ed-8c1c-b7d2884d14db-registry-tls\") pod \"7bda7c6a-0393-49ed-8c1c-b7d2884d14db\" (UID: \"7bda7c6a-0393-49ed-8c1c-b7d2884d14db\") "
May 28 09:59:06.059335 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.059267    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7bda7c6a-0393-49ed-8c1c-b7d2884d14db-online-tls\") pod \"7bda7c6a-0393-49ed-8c1c-b7d2884d14db\" (UID: \"7bda7c6a-0393-49ed-8c1c-b7d2884d14db\") "
May 28 09:59:06.059900 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.059871    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bda7c6a-0393-49ed-8c1c-b7d2884d14db-feast-data" (OuterVolumeSpecName: "feast-data") pod "7bda7c6a-0393-49ed-8c1c-b7d2884d14db" (UID: "7bda7c6a-0393-49ed-8c1c-b7d2884d14db"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 09:59:06.061469 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.061433    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7bda7c6a-0393-49ed-8c1c-b7d2884d14db-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "7bda7c6a-0393-49ed-8c1c-b7d2884d14db" (UID: "7bda7c6a-0393-49ed-8c1c-b7d2884d14db"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:59:06.061469 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.061447    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bda7c6a-0393-49ed-8c1c-b7d2884d14db-kube-api-access-klpq5" (OuterVolumeSpecName: "kube-api-access-klpq5") pod "7bda7c6a-0393-49ed-8c1c-b7d2884d14db" (UID: "7bda7c6a-0393-49ed-8c1c-b7d2884d14db"). InnerVolumeSpecName "kube-api-access-klpq5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 09:59:06.061602 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.061473    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7bda7c6a-0393-49ed-8c1c-b7d2884d14db-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "7bda7c6a-0393-49ed-8c1c-b7d2884d14db" (UID: "7bda7c6a-0393-49ed-8c1c-b7d2884d14db"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:59:06.061718 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.061700    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7bda7c6a-0393-49ed-8c1c-b7d2884d14db-online-tls" (OuterVolumeSpecName: "online-tls") pod "7bda7c6a-0393-49ed-8c1c-b7d2884d14db" (UID: "7bda7c6a-0393-49ed-8c1c-b7d2884d14db"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:59:06.061768 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.061713    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7bda7c6a-0393-49ed-8c1c-b7d2884d14db-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "7bda7c6a-0393-49ed-8c1c-b7d2884d14db" (UID: "7bda7c6a-0393-49ed-8c1c-b7d2884d14db"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:59:06.107995 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.107943    2572 generic.go:358] "Generic (PLEG): container finished" podID="9246e146-c9fa-41c6-aff0-a7413aa399b6" containerID="d4b70e0dcd1c1c5f76b5a08d29de5c8a6d7b7285224e78cfe0bdd929785ea574" exitCode=137
May 28 09:59:06.108190 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.108025    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-9vjwj"
May 28 09:59:06.108190 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.108036    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-9vjwj" event={"ID":"9246e146-c9fa-41c6-aff0-a7413aa399b6","Type":"ContainerDied","Data":"d4b70e0dcd1c1c5f76b5a08d29de5c8a6d7b7285224e78cfe0bdd929785ea574"}
May 28 09:59:06.108190 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.108084    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-9vjwj" event={"ID":"9246e146-c9fa-41c6-aff0-a7413aa399b6","Type":"ContainerDied","Data":"a84e1c623cccaf1e5e07993eecf9039ee81d635f28903bfcc94f7f3cd120cf05"}
May 28 09:59:06.108190 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.108107    2572 scope.go:117] "RemoveContainer" containerID="73a2f9bac8eebc1f8fbca7ea29e574a9fd390d177b768da56d15cd876b3a19b6"
May 28 09:59:06.110989 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.110952    2572 generic.go:358] "Generic (PLEG): container finished" podID="7bda7c6a-0393-49ed-8c1c-b7d2884d14db" containerID="f6644632b4bc85bb287c6dda94d5e20067af305b3011ceaafa8e6c673d1ee900" exitCode=137
May 28 09:59:06.110989 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.110988    2572 generic.go:358] "Generic (PLEG): container finished" podID="7bda7c6a-0393-49ed-8c1c-b7d2884d14db" containerID="d2c15b8e64ac84004e5ca187e5dd118b2c7dd9b428410db2cda27ba647db0ae5" exitCode=137
May 28 09:59:06.111133 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.111001    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf" event={"ID":"7bda7c6a-0393-49ed-8c1c-b7d2884d14db","Type":"ContainerDied","Data":"f6644632b4bc85bb287c6dda94d5e20067af305b3011ceaafa8e6c673d1ee900"}
May 28 09:59:06.111133 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.111037    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf" event={"ID":"7bda7c6a-0393-49ed-8c1c-b7d2884d14db","Type":"ContainerDied","Data":"d2c15b8e64ac84004e5ca187e5dd118b2c7dd9b428410db2cda27ba647db0ae5"}
May 28 09:59:06.111133 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.111053    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf" event={"ID":"7bda7c6a-0393-49ed-8c1c-b7d2884d14db","Type":"ContainerDied","Data":"3178c96da79d58a3526cb13169e2b30b62bca4ac4c2dc8a61a09a259284d9fe6"}
May 28 09:59:06.111133 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.111055    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf"
May 28 09:59:06.118517 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.118488    2572 scope.go:117] "RemoveContainer" containerID="d4b70e0dcd1c1c5f76b5a08d29de5c8a6d7b7285224e78cfe0bdd929785ea574"
May 28 09:59:06.125849 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.125832    2572 scope.go:117] "RemoveContainer" containerID="0bc6169aa4e76d2a8234e1b6f14485ec9727de804a8d6215acc2c90f7dfac5c8"
May 28 09:59:06.129773 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.129753    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-9vjwj"]
May 28 09:59:06.133892 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.133865    2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-9vjwj"]
May 28 09:59:06.134205 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.134190    2572 scope.go:117] "RemoveContainer" containerID="35218a56b289b3f0fad0f447559246a2882861cc70120d84511e25c40bc6c625"
May 28 09:59:06.141540 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.141525    2572 scope.go:117] "RemoveContainer" containerID="0e61be5d9cdfd51759dd5d676a79645944e33f1a763969875435d28fab4a3587"
May 28 09:59:06.148565 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.148551    2572 scope.go:117] "RemoveContainer" containerID="73a2f9bac8eebc1f8fbca7ea29e574a9fd390d177b768da56d15cd876b3a19b6"
May 28 09:59:06.148848 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:59:06.148822    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73a2f9bac8eebc1f8fbca7ea29e574a9fd390d177b768da56d15cd876b3a19b6\": container with ID starting with 73a2f9bac8eebc1f8fbca7ea29e574a9fd390d177b768da56d15cd876b3a19b6 not found: ID does not exist" containerID="73a2f9bac8eebc1f8fbca7ea29e574a9fd390d177b768da56d15cd876b3a19b6"
May 28 09:59:06.148944 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.148857    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73a2f9bac8eebc1f8fbca7ea29e574a9fd390d177b768da56d15cd876b3a19b6"} err="failed to get container status \"73a2f9bac8eebc1f8fbca7ea29e574a9fd390d177b768da56d15cd876b3a19b6\": rpc error: code = NotFound desc = could not find container \"73a2f9bac8eebc1f8fbca7ea29e574a9fd390d177b768da56d15cd876b3a19b6\": container with ID starting with 73a2f9bac8eebc1f8fbca7ea29e574a9fd390d177b768da56d15cd876b3a19b6 not found: ID does not exist"
May 28 09:59:06.148944 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.148883    2572 scope.go:117] "RemoveContainer" containerID="d4b70e0dcd1c1c5f76b5a08d29de5c8a6d7b7285224e78cfe0bdd929785ea574"
May 28 09:59:06.149331 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:59:06.149167    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4b70e0dcd1c1c5f76b5a08d29de5c8a6d7b7285224e78cfe0bdd929785ea574\": container with ID starting with d4b70e0dcd1c1c5f76b5a08d29de5c8a6d7b7285224e78cfe0bdd929785ea574 not found: ID does not exist" containerID="d4b70e0dcd1c1c5f76b5a08d29de5c8a6d7b7285224e78cfe0bdd929785ea574"
May 28 09:59:06.149331 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.149239    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4b70e0dcd1c1c5f76b5a08d29de5c8a6d7b7285224e78cfe0bdd929785ea574"} err="failed to get container status \"d4b70e0dcd1c1c5f76b5a08d29de5c8a6d7b7285224e78cfe0bdd929785ea574\": rpc error: code = NotFound desc = could not find container \"d4b70e0dcd1c1c5f76b5a08d29de5c8a6d7b7285224e78cfe0bdd929785ea574\": container with ID starting with d4b70e0dcd1c1c5f76b5a08d29de5c8a6d7b7285224e78cfe0bdd929785ea574 not found: ID does not exist"
May 28 09:59:06.149331 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.149265    2572 scope.go:117] "RemoveContainer" containerID="0bc6169aa4e76d2a8234e1b6f14485ec9727de804a8d6215acc2c90f7dfac5c8"
May 28 09:59:06.149640 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:59:06.149622    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0bc6169aa4e76d2a8234e1b6f14485ec9727de804a8d6215acc2c90f7dfac5c8\": container with ID starting with 0bc6169aa4e76d2a8234e1b6f14485ec9727de804a8d6215acc2c90f7dfac5c8 not found: ID does not exist" containerID="0bc6169aa4e76d2a8234e1b6f14485ec9727de804a8d6215acc2c90f7dfac5c8"
May 28 09:59:06.149708 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.149647    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bc6169aa4e76d2a8234e1b6f14485ec9727de804a8d6215acc2c90f7dfac5c8"} err="failed to get container status \"0bc6169aa4e76d2a8234e1b6f14485ec9727de804a8d6215acc2c90f7dfac5c8\": rpc error: code = NotFound desc = could not find container \"0bc6169aa4e76d2a8234e1b6f14485ec9727de804a8d6215acc2c90f7dfac5c8\": container with ID starting with 0bc6169aa4e76d2a8234e1b6f14485ec9727de804a8d6215acc2c90f7dfac5c8 not found: ID does not exist"
May 28 09:59:06.149708 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.149669    2572 scope.go:117] "RemoveContainer" containerID="35218a56b289b3f0fad0f447559246a2882861cc70120d84511e25c40bc6c625"
May 28 09:59:06.149930 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:59:06.149906    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35218a56b289b3f0fad0f447559246a2882861cc70120d84511e25c40bc6c625\": container with ID starting with 35218a56b289b3f0fad0f447559246a2882861cc70120d84511e25c40bc6c625 not found: ID does not exist" containerID="35218a56b289b3f0fad0f447559246a2882861cc70120d84511e25c40bc6c625"
May 28 09:59:06.150015 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.149935    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35218a56b289b3f0fad0f447559246a2882861cc70120d84511e25c40bc6c625"} err="failed to get container status \"35218a56b289b3f0fad0f447559246a2882861cc70120d84511e25c40bc6c625\": rpc error: code = NotFound desc = could not find container \"35218a56b289b3f0fad0f447559246a2882861cc70120d84511e25c40bc6c625\": container with ID starting with 35218a56b289b3f0fad0f447559246a2882861cc70120d84511e25c40bc6c625 not found: ID does not exist"
May 28 09:59:06.150015 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.149954    2572 scope.go:117] "RemoveContainer" containerID="0e61be5d9cdfd51759dd5d676a79645944e33f1a763969875435d28fab4a3587"
May 28 09:59:06.150211 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:59:06.150194    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e61be5d9cdfd51759dd5d676a79645944e33f1a763969875435d28fab4a3587\": container with ID starting with 0e61be5d9cdfd51759dd5d676a79645944e33f1a763969875435d28fab4a3587 not found: ID does not exist" containerID="0e61be5d9cdfd51759dd5d676a79645944e33f1a763969875435d28fab4a3587"
May 28 09:59:06.150260 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.150216    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e61be5d9cdfd51759dd5d676a79645944e33f1a763969875435d28fab4a3587"} err="failed to get container status \"0e61be5d9cdfd51759dd5d676a79645944e33f1a763969875435d28fab4a3587\": rpc error: code = NotFound desc = could not find container \"0e61be5d9cdfd51759dd5d676a79645944e33f1a763969875435d28fab4a3587\": container with ID starting with 0e61be5d9cdfd51759dd5d676a79645944e33f1a763969875435d28fab4a3587 not found: ID does not exist"
May 28 09:59:06.150260 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.150230    2572 scope.go:117] "RemoveContainer" containerID="9892eaddab562014b7ab16e38efc507e79399e9a41c40f11323c408b4e8e0299"
May 28 09:59:06.150625 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.150597    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf"]
May 28 09:59:06.154625 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.154605    2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-rh7cf"]
May 28 09:59:06.159696 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.159670    2572 scope.go:117] "RemoveContainer" containerID="f6644632b4bc85bb287c6dda94d5e20067af305b3011ceaafa8e6c673d1ee900"
May 28 09:59:06.160133 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.160114    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-klpq5\" (UniqueName: \"kubernetes.io/projected/7bda7c6a-0393-49ed-8c1c-b7d2884d14db-kube-api-access-klpq5\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:59:06.160212 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.160135    2572 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7bda7c6a-0393-49ed-8c1c-b7d2884d14db-feast-data\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:59:06.160212 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.160146    2572 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7bda7c6a-0393-49ed-8c1c-b7d2884d14db-offline-tls\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:59:06.160212 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.160154    2572 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/7bda7c6a-0393-49ed-8c1c-b7d2884d14db-registry-tls\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:59:06.160212 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.160163    2572 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7bda7c6a-0393-49ed-8c1c-b7d2884d14db-online-tls\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:59:06.160212 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.160171    2572 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/7bda7c6a-0393-49ed-8c1c-b7d2884d14db-ui-tls\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
May 28 09:59:06.166942 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.166921    2572 scope.go:117] "RemoveContainer" containerID="1f9c70c7d257e7f17b44d91ba179e76f14249e19b36df7358595452d3dfa764f"
May 28 09:59:06.173844 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.173827    2572 scope.go:117] "RemoveContainer" containerID="d2c15b8e64ac84004e5ca187e5dd118b2c7dd9b428410db2cda27ba647db0ae5"
May 28 09:59:06.180480 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.180464    2572 scope.go:117] "RemoveContainer" containerID="f173261aa64849ceda8583f6d0ceedefa7343f5e40f7d893f8befac6c1ced91c"
May 28 09:59:06.187452 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.187433    2572 scope.go:117] "RemoveContainer" containerID="7e522e77600d9c3025e4fd51e8402b681f946bfaf9109f0962483cccb80d3fc7"
May 28 09:59:06.194166 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.194147    2572 scope.go:117] "RemoveContainer" containerID="9892eaddab562014b7ab16e38efc507e79399e9a41c40f11323c408b4e8e0299"
May 28 09:59:06.194443 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:59:06.194411    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9892eaddab562014b7ab16e38efc507e79399e9a41c40f11323c408b4e8e0299\": container with ID starting with 9892eaddab562014b7ab16e38efc507e79399e9a41c40f11323c408b4e8e0299 not found: ID does not exist" containerID="9892eaddab562014b7ab16e38efc507e79399e9a41c40f11323c408b4e8e0299"
May 28 09:59:06.194506 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.194451    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9892eaddab562014b7ab16e38efc507e79399e9a41c40f11323c408b4e8e0299"} err="failed to get container status \"9892eaddab562014b7ab16e38efc507e79399e9a41c40f11323c408b4e8e0299\": rpc error: code = NotFound desc = could not find container \"9892eaddab562014b7ab16e38efc507e79399e9a41c40f11323c408b4e8e0299\": container with ID starting with 9892eaddab562014b7ab16e38efc507e79399e9a41c40f11323c408b4e8e0299 not found: ID does not exist"
May 28 09:59:06.194506 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.194470    2572 scope.go:117] "RemoveContainer" containerID="f6644632b4bc85bb287c6dda94d5e20067af305b3011ceaafa8e6c673d1ee900"
May 28 09:59:06.194680 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:59:06.194657    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6644632b4bc85bb287c6dda94d5e20067af305b3011ceaafa8e6c673d1ee900\": container with ID starting with f6644632b4bc85bb287c6dda94d5e20067af305b3011ceaafa8e6c673d1ee900 not found: ID does not exist" containerID="f6644632b4bc85bb287c6dda94d5e20067af305b3011ceaafa8e6c673d1ee900"
May 28 09:59:06.194680 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.194674    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6644632b4bc85bb287c6dda94d5e20067af305b3011ceaafa8e6c673d1ee900"} err="failed to get container status \"f6644632b4bc85bb287c6dda94d5e20067af305b3011ceaafa8e6c673d1ee900\": rpc error: code = NotFound desc = could not find container \"f6644632b4bc85bb287c6dda94d5e20067af305b3011ceaafa8e6c673d1ee900\": container with ID starting with f6644632b4bc85bb287c6dda94d5e20067af305b3011ceaafa8e6c673d1ee900 not found: ID does not exist"
May 28 09:59:06.194760 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.194686    2572 scope.go:117] "RemoveContainer" containerID="1f9c70c7d257e7f17b44d91ba179e76f14249e19b36df7358595452d3dfa764f"
May 28 09:59:06.194931 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:59:06.194915    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f9c70c7d257e7f17b44d91ba179e76f14249e19b36df7358595452d3dfa764f\": container with ID starting with 1f9c70c7d257e7f17b44d91ba179e76f14249e19b36df7358595452d3dfa764f not found: ID does not exist" containerID="1f9c70c7d257e7f17b44d91ba179e76f14249e19b36df7358595452d3dfa764f"
May 28 09:59:06.195011 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.194934    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f9c70c7d257e7f17b44d91ba179e76f14249e19b36df7358595452d3dfa764f"} err="failed to get container status \"1f9c70c7d257e7f17b44d91ba179e76f14249e19b36df7358595452d3dfa764f\": rpc error: code = NotFound desc = could not find container \"1f9c70c7d257e7f17b44d91ba179e76f14249e19b36df7358595452d3dfa764f\": container with ID starting with 1f9c70c7d257e7f17b44d91ba179e76f14249e19b36df7358595452d3dfa764f not found: ID does not exist"
May 28 09:59:06.195011 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.194946    2572 scope.go:117] "RemoveContainer" containerID="d2c15b8e64ac84004e5ca187e5dd118b2c7dd9b428410db2cda27ba647db0ae5"
May 28 09:59:06.195213 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:59:06.195196    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2c15b8e64ac84004e5ca187e5dd118b2c7dd9b428410db2cda27ba647db0ae5\": container with ID starting with d2c15b8e64ac84004e5ca187e5dd118b2c7dd9b428410db2cda27ba647db0ae5 not found: ID does not exist" containerID="d2c15b8e64ac84004e5ca187e5dd118b2c7dd9b428410db2cda27ba647db0ae5"
May 28 09:59:06.195264 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.195217    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2c15b8e64ac84004e5ca187e5dd118b2c7dd9b428410db2cda27ba647db0ae5"} err="failed to get container status \"d2c15b8e64ac84004e5ca187e5dd118b2c7dd9b428410db2cda27ba647db0ae5\": rpc error: code = NotFound desc = could not find container \"d2c15b8e64ac84004e5ca187e5dd118b2c7dd9b428410db2cda27ba647db0ae5\": container with ID starting with d2c15b8e64ac84004e5ca187e5dd118b2c7dd9b428410db2cda27ba647db0ae5 not found: ID does not exist"
May 28 09:59:06.195264 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.195240    2572 scope.go:117] "RemoveContainer" containerID="f173261aa64849ceda8583f6d0ceedefa7343f5e40f7d893f8befac6c1ced91c"
May 28 09:59:06.195459 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:59:06.195442    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f173261aa64849ceda8583f6d0ceedefa7343f5e40f7d893f8befac6c1ced91c\": container with ID starting with f173261aa64849ceda8583f6d0ceedefa7343f5e40f7d893f8befac6c1ced91c not found: ID does not exist" containerID="f173261aa64849ceda8583f6d0ceedefa7343f5e40f7d893f8befac6c1ced91c"
May 28 09:59:06.195497 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.195467    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f173261aa64849ceda8583f6d0ceedefa7343f5e40f7d893f8befac6c1ced91c"} err="failed to get container status \"f173261aa64849ceda8583f6d0ceedefa7343f5e40f7d893f8befac6c1ced91c\": rpc error: code = NotFound desc = could not find container \"f173261aa64849ceda8583f6d0ceedefa7343f5e40f7d893f8befac6c1ced91c\": container with ID starting with f173261aa64849ceda8583f6d0ceedefa7343f5e40f7d893f8befac6c1ced91c not found: ID does not exist"
May 28 09:59:06.195497 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.195483    2572 scope.go:117] "RemoveContainer" containerID="7e522e77600d9c3025e4fd51e8402b681f946bfaf9109f0962483cccb80d3fc7"
May 28 09:59:06.195680 ip-10-0-139-204 kubenswrapper[2572]: E0528 09:59:06.195666    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e522e77600d9c3025e4fd51e8402b681f946bfaf9109f0962483cccb80d3fc7\": container with ID starting with 7e522e77600d9c3025e4fd51e8402b681f946bfaf9109f0962483cccb80d3fc7 not found: ID does not exist" containerID="7e522e77600d9c3025e4fd51e8402b681f946bfaf9109f0962483cccb80d3fc7"
May 28 09:59:06.195714 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.195684    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e522e77600d9c3025e4fd51e8402b681f946bfaf9109f0962483cccb80d3fc7"} err="failed to get container status \"7e522e77600d9c3025e4fd51e8402b681f946bfaf9109f0962483cccb80d3fc7\": rpc error: code = NotFound desc = could not find container \"7e522e77600d9c3025e4fd51e8402b681f946bfaf9109f0962483cccb80d3fc7\": container with ID starting with 7e522e77600d9c3025e4fd51e8402b681f946bfaf9109f0962483cccb80d3fc7 not found: ID does not exist"
May 28 09:59:06.195714 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.195697    2572 scope.go:117] "RemoveContainer" containerID="9892eaddab562014b7ab16e38efc507e79399e9a41c40f11323c408b4e8e0299"
May 28 09:59:06.195889 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.195861    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9892eaddab562014b7ab16e38efc507e79399e9a41c40f11323c408b4e8e0299"} err="failed to get container status \"9892eaddab562014b7ab16e38efc507e79399e9a41c40f11323c408b4e8e0299\": rpc error: code = NotFound desc = could not find container \"9892eaddab562014b7ab16e38efc507e79399e9a41c40f11323c408b4e8e0299\": container with ID starting with 9892eaddab562014b7ab16e38efc507e79399e9a41c40f11323c408b4e8e0299 not found: ID does not exist"
May 28 09:59:06.195934 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.195890    2572 scope.go:117] "RemoveContainer" containerID="f6644632b4bc85bb287c6dda94d5e20067af305b3011ceaafa8e6c673d1ee900"
May 28 09:59:06.196211 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.196189    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6644632b4bc85bb287c6dda94d5e20067af305b3011ceaafa8e6c673d1ee900"} err="failed to get container status \"f6644632b4bc85bb287c6dda94d5e20067af305b3011ceaafa8e6c673d1ee900\": rpc error: code = NotFound desc = could not find container \"f6644632b4bc85bb287c6dda94d5e20067af305b3011ceaafa8e6c673d1ee900\": container with ID starting with f6644632b4bc85bb287c6dda94d5e20067af305b3011ceaafa8e6c673d1ee900 not found: ID does not exist"
May 28 09:59:06.196277 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.196211    2572 scope.go:117] "RemoveContainer" containerID="1f9c70c7d257e7f17b44d91ba179e76f14249e19b36df7358595452d3dfa764f"
May 28 09:59:06.196439 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.196424    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f9c70c7d257e7f17b44d91ba179e76f14249e19b36df7358595452d3dfa764f"} err="failed to get container status \"1f9c70c7d257e7f17b44d91ba179e76f14249e19b36df7358595452d3dfa764f\": rpc error: code = NotFound desc = could not find container \"1f9c70c7d257e7f17b44d91ba179e76f14249e19b36df7358595452d3dfa764f\": container with ID starting with 1f9c70c7d257e7f17b44d91ba179e76f14249e19b36df7358595452d3dfa764f not found: ID does not exist"
May 28 09:59:06.196502 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.196440    2572 scope.go:117] "RemoveContainer" containerID="d2c15b8e64ac84004e5ca187e5dd118b2c7dd9b428410db2cda27ba647db0ae5"
May 28 09:59:06.196651 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.196633    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2c15b8e64ac84004e5ca187e5dd118b2c7dd9b428410db2cda27ba647db0ae5"} err="failed to get container status \"d2c15b8e64ac84004e5ca187e5dd118b2c7dd9b428410db2cda27ba647db0ae5\": rpc error: code = NotFound desc = could not find container \"d2c15b8e64ac84004e5ca187e5dd118b2c7dd9b428410db2cda27ba647db0ae5\": container with ID starting with d2c15b8e64ac84004e5ca187e5dd118b2c7dd9b428410db2cda27ba647db0ae5 not found: ID does not exist"
May 28 09:59:06.196694 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.196653    2572 scope.go:117] "RemoveContainer" containerID="f173261aa64849ceda8583f6d0ceedefa7343f5e40f7d893f8befac6c1ced91c"
May 28 09:59:06.196845 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.196829    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f173261aa64849ceda8583f6d0ceedefa7343f5e40f7d893f8befac6c1ced91c"} err="failed to get container status \"f173261aa64849ceda8583f6d0ceedefa7343f5e40f7d893f8befac6c1ced91c\": rpc error: code = NotFound desc = could not find container \"f173261aa64849ceda8583f6d0ceedefa7343f5e40f7d893f8befac6c1ced91c\": container with ID starting with f173261aa64849ceda8583f6d0ceedefa7343f5e40f7d893f8befac6c1ced91c not found: ID does not exist"
May 28 09:59:06.196845 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.196844    2572 scope.go:117] "RemoveContainer" containerID="7e522e77600d9c3025e4fd51e8402b681f946bfaf9109f0962483cccb80d3fc7"
May 28 09:59:06.197073 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:06.197056    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e522e77600d9c3025e4fd51e8402b681f946bfaf9109f0962483cccb80d3fc7"} err="failed to get container status \"7e522e77600d9c3025e4fd51e8402b681f946bfaf9109f0962483cccb80d3fc7\": rpc error: code = NotFound desc = could not find container \"7e522e77600d9c3025e4fd51e8402b681f946bfaf9109f0962483cccb80d3fc7\": container with ID starting with 7e522e77600d9c3025e4fd51e8402b681f946bfaf9109f0962483cccb80d3fc7 not found: ID does not exist"
May 28 09:59:07.919983 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:07.919946    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7bda7c6a-0393-49ed-8c1c-b7d2884d14db" path="/var/lib/kubelet/pods/7bda7c6a-0393-49ed-8c1c-b7d2884d14db/volumes"
May 28 09:59:07.920554 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:07.920541    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9246e146-c9fa-41c6-aff0-a7413aa399b6" path="/var/lib/kubelet/pods/9246e146-c9fa-41c6-aff0-a7413aa399b6/volumes"
May 28 09:59:46.078331 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:46.078244    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-nhlh5_30ff7447-74e3-4cd1-97bd-2f1c4e9507a2/global-pull-secret-syncer/0.log"
May 28 09:59:46.190641 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:46.190611    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-w8rpf_98e6ce8d-ad11-47b7-9b11-ce34957eb822/konnectivity-agent/0.log"
May 28 09:59:46.251941 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:46.251890    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-204.ec2.internal_ab4679d9308dd4bfe245e4be6b41a75f/haproxy/0.log"
May 28 09:59:49.422660 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:49.422629    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-688b957f56-g6k8j_26826edb-a070-408d-807d-84d411fe6c8c/metrics-server/0.log"
May 28 09:59:49.454928 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:49.454899    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-mh2ml_e5a1ea7d-a239-4aab-ba0e-63a282f664a8/monitoring-plugin/0.log"
May 28 09:59:49.487860 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:49.487791    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2z4sq_6a192bb8-4720-4626-be36-92d00e71bc94/node-exporter/0.log"
May 28 09:59:49.512329 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:49.512303    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2z4sq_6a192bb8-4720-4626-be36-92d00e71bc94/kube-rbac-proxy/0.log"
May 28 09:59:49.536763 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:49.536344    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2z4sq_6a192bb8-4720-4626-be36-92d00e71bc94/init-textfile/0.log"
May 28 09:59:49.731117 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:49.731087    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-gvkjg_fc370a6b-afcb-48f5-8234-d90d8b5c2ef2/kube-rbac-proxy-main/0.log"
May 28 09:59:49.758930 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:49.758900    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-gvkjg_fc370a6b-afcb-48f5-8234-d90d8b5c2ef2/kube-rbac-proxy-self/0.log"
May 28 09:59:49.785666 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:49.785637    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-gvkjg_fc370a6b-afcb-48f5-8234-d90d8b5c2ef2/openshift-state-metrics/0.log"
May 28 09:59:49.828475 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:49.828442    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9c9e22ad-ef40-445e-b6b6-c3c031b5b601/prometheus/0.log"
May 28 09:59:49.855416 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:49.855385    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9c9e22ad-ef40-445e-b6b6-c3c031b5b601/config-reloader/0.log"
May 28 09:59:49.881063 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:49.881037    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9c9e22ad-ef40-445e-b6b6-c3c031b5b601/thanos-sidecar/0.log"
May 28 09:59:49.912855 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:49.912829    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9c9e22ad-ef40-445e-b6b6-c3c031b5b601/kube-rbac-proxy-web/0.log"
May 28 09:59:49.947993 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:49.947949    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9c9e22ad-ef40-445e-b6b6-c3c031b5b601/kube-rbac-proxy/0.log"
May 28 09:59:49.973335 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:49.973306    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9c9e22ad-ef40-445e-b6b6-c3c031b5b601/kube-rbac-proxy-thanos/0.log"
May 28 09:59:50.001225 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:50.001205    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9c9e22ad-ef40-445e-b6b6-c3c031b5b601/init-config-reloader/0.log"
May 28 09:59:50.035510 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:50.035433    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-mk4lh_99d249e3-84b4-416b-a44f-ab8e9fae4199/prometheus-operator/0.log"
May 28 09:59:50.068710 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:50.068671    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-mk4lh_99d249e3-84b4-416b-a44f-ab8e9fae4199/kube-rbac-proxy/0.log"
May 28 09:59:50.101126 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:50.101097    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-9t2vp_2a92c2b2-ec77-4eef-8b00-c938f0ab4e88/prometheus-operator-admission-webhook/0.log"
May 28 09:59:50.225381 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:50.225348    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-84f75585c8-t2rb4_74d7e2b7-f87f-45ee-b7b4-3ad8bf9c2c09/thanos-query/0.log"
May 28 09:59:50.248484 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:50.248452    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-84f75585c8-t2rb4_74d7e2b7-f87f-45ee-b7b4-3ad8bf9c2c09/kube-rbac-proxy-web/0.log"
May 28 09:59:50.274436 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:50.274408    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-84f75585c8-t2rb4_74d7e2b7-f87f-45ee-b7b4-3ad8bf9c2c09/kube-rbac-proxy/0.log"
May 28 09:59:50.299610 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:50.299541    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-84f75585c8-t2rb4_74d7e2b7-f87f-45ee-b7b4-3ad8bf9c2c09/prom-label-proxy/0.log"
May 28 09:59:50.327093 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:50.327061    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-84f75585c8-t2rb4_74d7e2b7-f87f-45ee-b7b4-3ad8bf9c2c09/kube-rbac-proxy-rules/0.log"
May 28 09:59:50.354268 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:50.354242    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-84f75585c8-t2rb4_74d7e2b7-f87f-45ee-b7b4-3ad8bf9c2c09/kube-rbac-proxy-metrics/0.log"
May 28 09:59:52.640992 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:52.640946    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-57bd96b888-m7b8c_6c007210-9934-4fe1-ad3f-7bef0dccbe0c/download-server/0.log"
May 28 09:59:52.955856 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:52.955772    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-v99lr/perf-node-gather-daemonset-gk2pz"]
May 28 09:59:52.956097 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:52.956085    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9246e146-c9fa-41c6-aff0-a7413aa399b6" containerName="feast-init"
May 28 09:59:52.956147 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:52.956099    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="9246e146-c9fa-41c6-aff0-a7413aa399b6" containerName="feast-init"
May 28 09:59:52.956147 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:52.956111    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bda7c6a-0393-49ed-8c1c-b7d2884d14db" containerName="registry"
May 28 09:59:52.956147 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:52.956119    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bda7c6a-0393-49ed-8c1c-b7d2884d14db" containerName="registry"
May 28 09:59:52.956147 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:52.956134    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bda7c6a-0393-49ed-8c1c-b7d2884d14db" containerName="feast-init"
May 28 09:59:52.956147 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:52.956142    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bda7c6a-0393-49ed-8c1c-b7d2884d14db" containerName="feast-init"
May 28 09:59:52.956373 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:52.956160    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bda7c6a-0393-49ed-8c1c-b7d2884d14db" containerName="online"
May 28 09:59:52.956373 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:52.956169    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bda7c6a-0393-49ed-8c1c-b7d2884d14db" containerName="online"
May 28 09:59:52.956373 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:52.956180    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9246e146-c9fa-41c6-aff0-a7413aa399b6" containerName="feast-apply"
May 28 09:59:52.956373 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:52.956186    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="9246e146-c9fa-41c6-aff0-a7413aa399b6" containerName="feast-apply"
May 28 09:59:52.956373 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:52.956194    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bda7c6a-0393-49ed-8c1c-b7d2884d14db" containerName="offline"
May 28 09:59:52.956373 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:52.956202    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bda7c6a-0393-49ed-8c1c-b7d2884d14db" containerName="offline"
May 28 09:59:52.956373 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:52.956208    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9246e146-c9fa-41c6-aff0-a7413aa399b6" containerName="ui"
May 28 09:59:52.956373 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:52.956213    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="9246e146-c9fa-41c6-aff0-a7413aa399b6" containerName="ui"
May 28 09:59:52.956373 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:52.956223    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bda7c6a-0393-49ed-8c1c-b7d2884d14db" containerName="ui"
May 28 09:59:52.956373 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:52.956228    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bda7c6a-0393-49ed-8c1c-b7d2884d14db" containerName="ui"
May 28 09:59:52.956373 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:52.956234    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9246e146-c9fa-41c6-aff0-a7413aa399b6" containerName="online"
May 28 09:59:52.956373 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:52.956239    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="9246e146-c9fa-41c6-aff0-a7413aa399b6" containerName="online"
May 28 09:59:52.956373 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:52.956245    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bda7c6a-0393-49ed-8c1c-b7d2884d14db" containerName="feast-apply"
May 28 09:59:52.956373 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:52.956251    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bda7c6a-0393-49ed-8c1c-b7d2884d14db" containerName="feast-apply"
May 28 09:59:52.956373 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:52.956258    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9246e146-c9fa-41c6-aff0-a7413aa399b6" containerName="offline"
May 28 09:59:52.956373 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:52.956263    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="9246e146-c9fa-41c6-aff0-a7413aa399b6" containerName="offline"
May 28 09:59:52.956373 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:52.956309    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="7bda7c6a-0393-49ed-8c1c-b7d2884d14db" containerName="ui"
May 28 09:59:52.956373 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:52.956318    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="9246e146-c9fa-41c6-aff0-a7413aa399b6" containerName="offline"
May 28 09:59:52.956373 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:52.956324    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="7bda7c6a-0393-49ed-8c1c-b7d2884d14db" containerName="online"
May 28 09:59:52.956373 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:52.956330    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="9246e146-c9fa-41c6-aff0-a7413aa399b6" containerName="online"
May 28 09:59:52.956373 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:52.956336    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="9246e146-c9fa-41c6-aff0-a7413aa399b6" containerName="ui"
May 28 09:59:52.956373 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:52.956344    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="7bda7c6a-0393-49ed-8c1c-b7d2884d14db" containerName="registry"
May 28 09:59:52.956373 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:52.956351    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="7bda7c6a-0393-49ed-8c1c-b7d2884d14db" containerName="offline"
May 28 09:59:52.958487 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:52.958470    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-v99lr/perf-node-gather-daemonset-gk2pz"
May 28 09:59:52.960603 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:52.960577    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9eb6d179-2d53-4a4c-8d53-4c366448866a-lib-modules\") pod \"perf-node-gather-daemonset-gk2pz\" (UID: \"9eb6d179-2d53-4a4c-8d53-4c366448866a\") " pod="openshift-must-gather-v99lr/perf-node-gather-daemonset-gk2pz"
May 28 09:59:52.960713 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:52.960621    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9eb6d179-2d53-4a4c-8d53-4c366448866a-sys\") pod \"perf-node-gather-daemonset-gk2pz\" (UID: \"9eb6d179-2d53-4a4c-8d53-4c366448866a\") " pod="openshift-must-gather-v99lr/perf-node-gather-daemonset-gk2pz"
May 28 09:59:52.960713 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:52.960704    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlxjv\" (UniqueName: \"kubernetes.io/projected/9eb6d179-2d53-4a4c-8d53-4c366448866a-kube-api-access-qlxjv\") pod \"perf-node-gather-daemonset-gk2pz\" (UID: \"9eb6d179-2d53-4a4c-8d53-4c366448866a\") " pod="openshift-must-gather-v99lr/perf-node-gather-daemonset-gk2pz"
May 28 09:59:52.960800 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:52.960740    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9eb6d179-2d53-4a4c-8d53-4c366448866a-podres\") pod \"perf-node-gather-daemonset-gk2pz\" (UID: \"9eb6d179-2d53-4a4c-8d53-4c366448866a\") " pod="openshift-must-gather-v99lr/perf-node-gather-daemonset-gk2pz"
May 28 09:59:52.960800 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:52.960775    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9eb6d179-2d53-4a4c-8d53-4c366448866a-proc\") pod \"perf-node-gather-daemonset-gk2pz\" (UID: \"9eb6d179-2d53-4a4c-8d53-4c366448866a\") " pod="openshift-must-gather-v99lr/perf-node-gather-daemonset-gk2pz"
May 28 09:59:52.962095 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:52.962077    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-v99lr\"/\"kube-root-ca.crt\""
May 28 09:59:52.962402 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:52.962384    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-v99lr\"/\"openshift-service-ca.crt\""
May 28 09:59:52.963337 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:52.963319    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-v99lr\"/\"default-dockercfg-jk27c\""
May 28 09:59:52.975625 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:52.975601    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-v99lr/perf-node-gather-daemonset-gk2pz"]
May 28 09:59:53.061894 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:53.061855    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qlxjv\" (UniqueName: \"kubernetes.io/projected/9eb6d179-2d53-4a4c-8d53-4c366448866a-kube-api-access-qlxjv\") pod \"perf-node-gather-daemonset-gk2pz\" (UID: \"9eb6d179-2d53-4a4c-8d53-4c366448866a\") " pod="openshift-must-gather-v99lr/perf-node-gather-daemonset-gk2pz"
May 28 09:59:53.061894 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:53.061898    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9eb6d179-2d53-4a4c-8d53-4c366448866a-podres\") pod \"perf-node-gather-daemonset-gk2pz\" (UID: \"9eb6d179-2d53-4a4c-8d53-4c366448866a\") " pod="openshift-must-gather-v99lr/perf-node-gather-daemonset-gk2pz"
May 28 09:59:53.062159 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:53.061924    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9eb6d179-2d53-4a4c-8d53-4c366448866a-proc\") pod \"perf-node-gather-daemonset-gk2pz\" (UID: \"9eb6d179-2d53-4a4c-8d53-4c366448866a\") " pod="openshift-must-gather-v99lr/perf-node-gather-daemonset-gk2pz"
May 28 09:59:53.062159 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:53.061957    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9eb6d179-2d53-4a4c-8d53-4c366448866a-lib-modules\") pod \"perf-node-gather-daemonset-gk2pz\" (UID: \"9eb6d179-2d53-4a4c-8d53-4c366448866a\") " pod="openshift-must-gather-v99lr/perf-node-gather-daemonset-gk2pz"
May 28 09:59:53.062159 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:53.061999    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9eb6d179-2d53-4a4c-8d53-4c366448866a-sys\") pod \"perf-node-gather-daemonset-gk2pz\" (UID: \"9eb6d179-2d53-4a4c-8d53-4c366448866a\") " pod="openshift-must-gather-v99lr/perf-node-gather-daemonset-gk2pz"
May 28 09:59:53.062159 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:53.062080    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9eb6d179-2d53-4a4c-8d53-4c366448866a-sys\") pod \"perf-node-gather-daemonset-gk2pz\" (UID: \"9eb6d179-2d53-4a4c-8d53-4c366448866a\") " pod="openshift-must-gather-v99lr/perf-node-gather-daemonset-gk2pz"
May 28 09:59:53.062159 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:53.062084    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9eb6d179-2d53-4a4c-8d53-4c366448866a-proc\") pod \"perf-node-gather-daemonset-gk2pz\" (UID: \"9eb6d179-2d53-4a4c-8d53-4c366448866a\") " pod="openshift-must-gather-v99lr/perf-node-gather-daemonset-gk2pz"
May 28 09:59:53.062159 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:53.062084    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9eb6d179-2d53-4a4c-8d53-4c366448866a-podres\") pod \"perf-node-gather-daemonset-gk2pz\" (UID: \"9eb6d179-2d53-4a4c-8d53-4c366448866a\") " pod="openshift-must-gather-v99lr/perf-node-gather-daemonset-gk2pz"
May 28 09:59:53.062159 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:53.062141    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9eb6d179-2d53-4a4c-8d53-4c366448866a-lib-modules\") pod \"perf-node-gather-daemonset-gk2pz\" (UID: \"9eb6d179-2d53-4a4c-8d53-4c366448866a\") " pod="openshift-must-gather-v99lr/perf-node-gather-daemonset-gk2pz"
May 28 09:59:53.074791 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:53.074765    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlxjv\" (UniqueName: \"kubernetes.io/projected/9eb6d179-2d53-4a4c-8d53-4c366448866a-kube-api-access-qlxjv\") pod \"perf-node-gather-daemonset-gk2pz\" (UID: \"9eb6d179-2d53-4a4c-8d53-4c366448866a\") " pod="openshift-must-gather-v99lr/perf-node-gather-daemonset-gk2pz"
May 28 09:59:53.268361 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:53.268333    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-v99lr/perf-node-gather-daemonset-gk2pz"
May 28 09:59:53.402158 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:53.402120    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-v99lr/perf-node-gather-daemonset-gk2pz"]
May 28 09:59:53.405426 ip-10-0-139-204 kubenswrapper[2572]: W0528 09:59:53.405395    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9eb6d179_2d53_4a4c_8d53_4c366448866a.slice/crio-0704f3cbcdd0ffe274c9a2233b933e3c6ad1b2eb405aba295416b64982f1710f WatchSource:0}: Error finding container 0704f3cbcdd0ffe274c9a2233b933e3c6ad1b2eb405aba295416b64982f1710f: Status 404 returned error can't find the container with id 0704f3cbcdd0ffe274c9a2233b933e3c6ad1b2eb405aba295416b64982f1710f
May 28 09:59:53.407356 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:53.407342    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 09:59:53.855170 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:53.855080    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-656bq_c3e72f88-41fa-4871-aed7-62339c90e118/dns/0.log"
May 28 09:59:53.876429 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:53.876404    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-656bq_c3e72f88-41fa-4871-aed7-62339c90e118/kube-rbac-proxy/0.log"
May 28 09:59:54.043109 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:54.043078    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wx6tn_c4bfa5bf-9ef8-43fd-907a-54e2a44a0db1/dns-node-resolver/0.log"
May 28 09:59:54.246820 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:54.246786    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-v99lr/perf-node-gather-daemonset-gk2pz" event={"ID":"9eb6d179-2d53-4a4c-8d53-4c366448866a","Type":"ContainerStarted","Data":"497edf512f2b8e33a7c311527958179274b1ef237a1c63ade9ed327a12421d04"}
May 28 09:59:54.246820 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:54.246823    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-v99lr/perf-node-gather-daemonset-gk2pz" event={"ID":"9eb6d179-2d53-4a4c-8d53-4c366448866a","Type":"ContainerStarted","Data":"0704f3cbcdd0ffe274c9a2233b933e3c6ad1b2eb405aba295416b64982f1710f"}
May 28 09:59:54.247106 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:54.246925    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-v99lr/perf-node-gather-daemonset-gk2pz"
May 28 09:59:54.264921 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:54.264876    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-v99lr/perf-node-gather-daemonset-gk2pz" podStartSLOduration=2.264863386 podStartE2EDuration="2.264863386s" podCreationTimestamp="2026-05-28 09:59:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 09:59:54.263914145 +0000 UTC m=+1722.946834930" watchObservedRunningTime="2026-05-28 09:59:54.264863386 +0000 UTC m=+1722.947784221"
May 28 09:59:54.474185 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:54.474153    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-cf76765f6-bttcq_b56fcd18-cb73-4cc8-aa23-027c743c7722/registry/0.log"
May 28 09:59:54.545372 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:54.545280    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7xzsh_ef852b03-b030-45ab-a48d-1d61305b27fa/node-ca/0.log"
May 28 09:59:55.652502 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:55.652470    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-j8n6p_4fee2b30-cecf-4ae8-bd5a-d36adbfee0f8/serve-healthcheck-canary/0.log"
May 28 09:59:56.046713 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:56.046679    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lqlpn_b56515ab-9ae7-4c35-a832-1341539ceaad/kube-rbac-proxy/0.log"
May 28 09:59:56.065464 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:56.065438    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lqlpn_b56515ab-9ae7-4c35-a832-1341539ceaad/exporter/0.log"
May 28 09:59:56.085331 ip-10-0-139-204 kubenswrapper[2572]: I0528 09:59:56.085294    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lqlpn_b56515ab-9ae7-4c35-a832-1341539ceaad/extractor/0.log"
May 28 10:00:00.259501 ip-10-0-139-204 kubenswrapper[2572]: I0528 10:00:00.259467    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-v99lr/perf-node-gather-daemonset-gk2pz"
May 28 10:00:01.800071 ip-10-0-139-204 kubenswrapper[2572]: I0528 10:00:01.800042    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pcxbr_fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3/kube-multus-additional-cni-plugins/0.log"
May 28 10:00:01.820842 ip-10-0-139-204 kubenswrapper[2572]: I0528 10:00:01.820812    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pcxbr_fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3/egress-router-binary-copy/0.log"
May 28 10:00:01.843428 ip-10-0-139-204 kubenswrapper[2572]: I0528 10:00:01.843400    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pcxbr_fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3/cni-plugins/0.log"
May 28 10:00:01.865766 ip-10-0-139-204 kubenswrapper[2572]: I0528 10:00:01.865741    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pcxbr_fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3/bond-cni-plugin/0.log"
May 28 10:00:01.887683 ip-10-0-139-204 kubenswrapper[2572]: I0528 10:00:01.887657    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pcxbr_fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3/routeoverride-cni/0.log"
May 28 10:00:01.911696 ip-10-0-139-204 kubenswrapper[2572]: I0528 10:00:01.911673    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pcxbr_fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3/whereabouts-cni-bincopy/0.log"
May 28 10:00:01.932232 ip-10-0-139-204 kubenswrapper[2572]: I0528 10:00:01.932208    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pcxbr_fc9f81f4-b4ac-4fdc-a9b3-9998b661d9e3/whereabouts-cni/0.log"
May 28 10:00:02.177361 ip-10-0-139-204 kubenswrapper[2572]: I0528 10:00:02.177331    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-vcggl_14a8a4a1-0374-4a48-bd7c-f38ea1dd5730/kube-multus/0.log"
May 28 10:00:02.207465 ip-10-0-139-204 kubenswrapper[2572]: I0528 10:00:02.207436    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6crv6_90716333-13a4-4983-b47a-c001d1da1e56/network-metrics-daemon/0.log"
May 28 10:00:02.226733 ip-10-0-139-204 kubenswrapper[2572]: I0528 10:00:02.226702    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6crv6_90716333-13a4-4983-b47a-c001d1da1e56/kube-rbac-proxy/0.log"
May 28 10:00:03.404279 ip-10-0-139-204 kubenswrapper[2572]: I0528 10:00:03.404248    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hxhf6_ccf30b25-8ebf-406d-acb8-9a6234f58b7c/ovn-controller/0.log"
May 28 10:00:03.430136 ip-10-0-139-204 kubenswrapper[2572]: I0528 10:00:03.430103    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hxhf6_ccf30b25-8ebf-406d-acb8-9a6234f58b7c/ovn-acl-logging/0.log"
May 28 10:00:03.449677 ip-10-0-139-204 kubenswrapper[2572]: I0528 10:00:03.449631    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hxhf6_ccf30b25-8ebf-406d-acb8-9a6234f58b7c/kube-rbac-proxy-node/0.log"
May 28 10:00:03.476030 ip-10-0-139-204 kubenswrapper[2572]: I0528 10:00:03.475990    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hxhf6_ccf30b25-8ebf-406d-acb8-9a6234f58b7c/kube-rbac-proxy-ovn-metrics/0.log"
May 28 10:00:03.503321 ip-10-0-139-204 kubenswrapper[2572]: I0528 10:00:03.503288    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hxhf6_ccf30b25-8ebf-406d-acb8-9a6234f58b7c/northd/0.log"
May 28 10:00:03.529438 ip-10-0-139-204 kubenswrapper[2572]: I0528 10:00:03.529415    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hxhf6_ccf30b25-8ebf-406d-acb8-9a6234f58b7c/nbdb/0.log"
May 28 10:00:03.551716 ip-10-0-139-204 kubenswrapper[2572]: I0528 10:00:03.551692    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hxhf6_ccf30b25-8ebf-406d-acb8-9a6234f58b7c/sbdb/0.log"
May 28 10:00:03.649003 ip-10-0-139-204 kubenswrapper[2572]: I0528 10:00:03.648953    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hxhf6_ccf30b25-8ebf-406d-acb8-9a6234f58b7c/ovnkube-controller/0.log"
May 28 10:00:04.973878 ip-10-0-139-204 kubenswrapper[2572]: I0528 10:00:04.973843    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-jx9bd_744e07a8-4e72-49f1-998a-525cef2d5fc1/network-check-target-container/0.log"
May 28 10:00:05.997152 ip-10-0-139-204 kubenswrapper[2572]: I0528 10:00:05.997123    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-7pj2k_d675a27b-a361-485d-bea2-9eb571533c84/iptables-alerter/0.log"
May 28 10:00:06.687759 ip-10-0-139-204 kubenswrapper[2572]: I0528 10:00:06.687717    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-hlwkc_d9523f19-58d0-4856-bc66-6f5f92f7bbde/tuned/0.log"