Jun 08 11:47:58.613309 ip-10-0-136-189 systemd[1]: Starting Kubernetes Kubelet...
Jun 08 11:47:59.029413 ip-10-0-136-189 kubenswrapper[2583]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 08 11:47:59.029413 ip-10-0-136-189 kubenswrapper[2583]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jun 08 11:47:59.029413 ip-10-0-136-189 kubenswrapper[2583]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 08 11:47:59.029413 ip-10-0-136-189 kubenswrapper[2583]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jun 08 11:47:59.029413 ip-10-0-136-189 kubenswrapper[2583]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 08 11:47:59.030557 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.029461    2583 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jun 08 11:47:59.035609 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035594    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 08 11:47:59.035609 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035609    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 08 11:47:59.035671 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035613    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 08 11:47:59.035671 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035616    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 08 11:47:59.035671 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035620    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jun 08 11:47:59.035671 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035623    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 08 11:47:59.035671 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035627    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 08 11:47:59.035671 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035630    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 08 11:47:59.035671 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035633    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 08 11:47:59.035671 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035636    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 08 11:47:59.035671 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035639    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 08 11:47:59.035671 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035641    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 08 11:47:59.035671 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035649    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 08 11:47:59.035671 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035652    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 08 11:47:59.035671 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035654    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 08 11:47:59.035671 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035657    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 08 11:47:59.035671 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035660    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 08 11:47:59.035671 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035662    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 08 11:47:59.035671 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035665    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 08 11:47:59.035671 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035667    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 08 11:47:59.035671 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035670    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 08 11:47:59.035671 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035673    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 08 11:47:59.036187 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035675    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 08 11:47:59.036187 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035678    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 08 11:47:59.036187 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035681    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 08 11:47:59.036187 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035684    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 08 11:47:59.036187 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035687    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 08 11:47:59.036187 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035689    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 08 11:47:59.036187 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035692    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 08 11:47:59.036187 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035694    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 08 11:47:59.036187 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035697    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 08 11:47:59.036187 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035699    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 08 11:47:59.036187 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035702    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 08 11:47:59.036187 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035704    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 08 11:47:59.036187 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035707    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 08 11:47:59.036187 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035710    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 08 11:47:59.036187 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035712    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 08 11:47:59.036187 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035716    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 08 11:47:59.036187 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035721    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 08 11:47:59.036187 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035725    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 08 11:47:59.036187 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035729    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 08 11:47:59.036634 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035732    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 08 11:47:59.036634 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035735    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 08 11:47:59.036634 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035737    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 08 11:47:59.036634 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035740    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 08 11:47:59.036634 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035743    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 08 11:47:59.036634 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035745    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 08 11:47:59.036634 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035748    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 08 11:47:59.036634 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035751    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 08 11:47:59.036634 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035753    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 08 11:47:59.036634 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035755    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 08 11:47:59.036634 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035758    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 08 11:47:59.036634 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035760    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 08 11:47:59.036634 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035763    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 08 11:47:59.036634 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035765    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 08 11:47:59.036634 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035769    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 08 11:47:59.036634 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035772    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 08 11:47:59.036634 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035775    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 08 11:47:59.036634 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035777    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 08 11:47:59.036634 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035780    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 08 11:47:59.037152 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035784    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 08 11:47:59.037152 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035787    2583 feature_gate.go:328] unrecognized feature gate: Example
Jun 08 11:47:59.037152 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035791    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 08 11:47:59.037152 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035794    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 08 11:47:59.037152 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035796    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 08 11:47:59.037152 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035799    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 08 11:47:59.037152 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035803    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 08 11:47:59.037152 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035805    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 08 11:47:59.037152 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035808    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 08 11:47:59.037152 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035810    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 08 11:47:59.037152 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035813    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 08 11:47:59.037152 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035816    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 08 11:47:59.037152 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035819    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 08 11:47:59.037152 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035822    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 08 11:47:59.037152 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035824    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 08 11:47:59.037152 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035826    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 08 11:47:59.037152 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035829    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 08 11:47:59.037152 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035831    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 08 11:47:59.037152 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035834    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 08 11:47:59.037152 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035836    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 08 11:47:59.037686 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035839    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 08 11:47:59.037686 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035841    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 08 11:47:59.037686 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035844    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 08 11:47:59.037686 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035846    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 08 11:47:59.037686 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035849    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 08 11:47:59.037686 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035851    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 08 11:47:59.037686 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035854    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 08 11:47:59.037686 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035858    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 08 11:47:59.037686 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035861    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 08 11:47:59.037686 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035864    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 08 11:47:59.037686 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035866    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 08 11:47:59.037686 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035869    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 08 11:47:59.037686 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035871    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 08 11:47:59.037686 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035874    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 08 11:47:59.037686 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035876    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 08 11:47:59.037686 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035879    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 08 11:47:59.037686 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035881    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 08 11:47:59.037686 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035883    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 08 11:47:59.037686 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.035886    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 08 11:47:59.037686 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036595    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 08 11:47:59.038226 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036602    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 08 11:47:59.038226 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036605    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 08 11:47:59.038226 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036608    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 08 11:47:59.038226 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036610    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 08 11:47:59.038226 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036614    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 08 11:47:59.038226 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036616    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 08 11:47:59.038226 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036621    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 08 11:47:59.038226 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036625    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 08 11:47:59.038226 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036628    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 08 11:47:59.038226 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036631    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 08 11:47:59.038226 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036633    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 08 11:47:59.038226 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036637    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 08 11:47:59.038226 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036640    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 08 11:47:59.038226 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036643    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 08 11:47:59.038226 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036646    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 08 11:47:59.038226 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036648    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 08 11:47:59.038226 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036651    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 08 11:47:59.038226 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036653    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 08 11:47:59.038226 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036656    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 08 11:47:59.038226 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036659    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 08 11:47:59.038798 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036662    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 08 11:47:59.038798 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036665    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 08 11:47:59.038798 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036668    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 08 11:47:59.038798 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036670    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 08 11:47:59.038798 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036673    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 08 11:47:59.038798 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036675    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 08 11:47:59.038798 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036678    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 08 11:47:59.038798 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036680    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 08 11:47:59.038798 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036683    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 08 11:47:59.038798 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036686    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 08 11:47:59.038798 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036688    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 08 11:47:59.038798 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036690    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 08 11:47:59.038798 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036692    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 08 11:47:59.038798 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036695    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 08 11:47:59.038798 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036697    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 08 11:47:59.038798 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036700    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 08 11:47:59.038798 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036704    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 08 11:47:59.038798 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036707    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 08 11:47:59.038798 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036710    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 08 11:47:59.039326 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036713    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 08 11:47:59.039326 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036716    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 08 11:47:59.039326 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036719    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 08 11:47:59.039326 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036721    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 08 11:47:59.039326 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036723    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 08 11:47:59.039326 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036726    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 08 11:47:59.039326 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036728    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 08 11:47:59.039326 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036731    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 08 11:47:59.039326 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036733    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 08 11:47:59.039326 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036736    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 08 11:47:59.039326 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036738    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 08 11:47:59.039326 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036740    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 08 11:47:59.039326 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036743    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 08 11:47:59.039326 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036745    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 08 11:47:59.039326 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036748    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 08 11:47:59.039326 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036750    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 08 11:47:59.039326 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036753    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 08 11:47:59.039326 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036756    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 08 11:47:59.039326 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036759    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 08 11:47:59.039326 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036762    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 08 11:47:59.039846 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036764    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 08 11:47:59.039846 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036767    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 08 11:47:59.039846 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036769    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 08 11:47:59.039846 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036772    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 08 11:47:59.039846 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036774    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 08 11:47:59.039846 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036777    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 08 11:47:59.039846 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036779    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 08 11:47:59.039846 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036782    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 08 11:47:59.039846 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036784    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 08 11:47:59.039846 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036786    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 08 11:47:59.039846 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036789    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 08 11:47:59.039846 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036792    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 08 11:47:59.039846 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036794    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 08 11:47:59.039846 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036797    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 08 11:47:59.039846 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036799    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 08 11:47:59.039846 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036802    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 08 11:47:59.039846 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036804    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 08 11:47:59.039846 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036806    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 08 11:47:59.039846 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036809    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 08 11:47:59.039846 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036811    2583 feature_gate.go:328] unrecognized feature gate: Example
Jun 08 11:47:59.040385 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036814    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 08 11:47:59.040385 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036816    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 08 11:47:59.040385 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036819    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 08 11:47:59.040385 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036822    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 08 11:47:59.040385 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036825    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 08 11:47:59.040385 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036828    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 08 11:47:59.040385 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036832    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 08 11:47:59.040385 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036837    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jun 08 11:47:59.040385 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036839    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 08 11:47:59.040385 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036842    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 08 11:47:59.040385 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036844    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 08 11:47:59.040385 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036846    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 08 11:47:59.040385 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036849    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 08 11:47:59.040385 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036852    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 08 11:47:59.040385 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036855    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 08 11:47:59.040385 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036857    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 08 11:47:59.040385 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036860    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 08 11:47:59.040385 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036862    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 08 11:47:59.040385 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.036865    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 08 11:47:59.040895 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037270    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 08 11:47:59.040895 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037276    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 08 11:47:59.040895 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037279    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 08 11:47:59.040895 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037281    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 08 11:47:59.040895 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037285    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 08 11:47:59.040895 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037288    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 08 11:47:59.040895 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037290    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 08 11:47:59.040895 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037293    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 08 11:47:59.040895 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037295    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 08 11:47:59.040895 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037298    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 08 11:47:59.040895 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037300    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 08 11:47:59.040895 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037303    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 08 11:47:59.040895 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037306    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 08 11:47:59.040895 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037308    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 08 11:47:59.040895 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037311    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 08 11:47:59.040895 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037314    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 08 11:47:59.040895 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037316    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 08 11:47:59.040895 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037320    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 08 11:47:59.040895 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037324    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 08 11:47:59.041395 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037327    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 08 11:47:59.041395 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037330    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 08 11:47:59.041395 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037333    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 08 11:47:59.041395 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037335    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 08 11:47:59.041395 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037338    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 08 11:47:59.041395 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037341    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 08 11:47:59.041395 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037346    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 08 11:47:59.041395 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037348    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 08 11:47:59.041395 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037351    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 08 11:47:59.041395 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037353    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 08 11:47:59.041395 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037356    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 08 11:47:59.041395 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037358    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 08 11:47:59.041395 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037361    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 08 11:47:59.041395 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037363    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 08 11:47:59.041395 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037366    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 08 11:47:59.041395 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037368    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 08 11:47:59.041395 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037371    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 08 11:47:59.041395 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037373    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 08 11:47:59.041395 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037379    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 08 11:47:59.041395 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037383    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 08 11:47:59.041872 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037387    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 08 11:47:59.041872 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037390    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 08 11:47:59.041872 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037393    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 08 11:47:59.041872 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037395    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 08 11:47:59.041872 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037398    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 08 11:47:59.041872 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037401    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 08 11:47:59.041872 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037407    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 08 11:47:59.041872 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037409    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 08 11:47:59.041872 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037412    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 08 11:47:59.041872 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037414    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 08 11:47:59.041872 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037417    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 08 11:47:59.041872 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037419    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 08 11:47:59.041872 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037422    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 08 11:47:59.041872 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037424    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 08 11:47:59.041872 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037427    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 08 11:47:59.041872 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037430    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 08 11:47:59.041872 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037432    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 08 11:47:59.041872 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037435    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 08 11:47:59.041872 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037439    2583 feature_gate.go:328] unrecognized feature gate: Example
Jun 08 11:47:59.041872 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037442    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 08 11:47:59.042370 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037471    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 08 11:47:59.042370 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037474    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 08 11:47:59.042370 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037477    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 08 11:47:59.042370 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037480    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 08 11:47:59.042370 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037483    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 08 11:47:59.042370 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037485    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 08 11:47:59.042370 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037488    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 08 11:47:59.042370 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037490    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 08 11:47:59.042370 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037493    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 08 11:47:59.042370 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037495    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 08 11:47:59.042370 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037498    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 08 11:47:59.042370 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037501    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 08 11:47:59.042370 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037503    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 08 11:47:59.042370 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037506    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 08 11:47:59.042370 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037508    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 08 11:47:59.042370 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037511    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 08 11:47:59.042370 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037513    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 08 11:47:59.042370 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037515    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 08 11:47:59.042370 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037519    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 08 11:47:59.042370 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037522    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 08 11:47:59.042933 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037525    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jun 08 11:47:59.042933 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037528    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 08 11:47:59.042933 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037530    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 08 11:47:59.042933 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037533    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 08 11:47:59.042933 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037536    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 08 11:47:59.042933 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037538    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 08 11:47:59.042933 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037541    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 08 11:47:59.042933 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037543    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 08 11:47:59.042933 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037546    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 08 11:47:59.042933 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037550    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 08 11:47:59.042933 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037555    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 08 11:47:59.042933 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037557    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 08 11:47:59.042933 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037560    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 08 11:47:59.042933 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037562    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 08 11:47:59.042933 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037565    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 08 11:47:59.042933 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037567    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 08 11:47:59.042933 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037570    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 08 11:47:59.042933 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037572    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 08 11:47:59.042933 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037574    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 08 11:47:59.043402 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.037577    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 08 11:47:59.043402 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037641    2583 flags.go:64] FLAG: --address="0.0.0.0"
Jun 08 11:47:59.043402 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037647    2583 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jun 08 11:47:59.043402 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037656    2583 flags.go:64] FLAG: --anonymous-auth="true"
Jun 08 11:47:59.043402 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037662    2583 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jun 08 11:47:59.043402 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037669    2583 flags.go:64] FLAG: --authentication-token-webhook="false"
Jun 08 11:47:59.043402 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037674    2583 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jun 08 11:47:59.043402 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037680    2583 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jun 08 11:47:59.043402 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037685    2583 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jun 08 11:47:59.043402 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037688    2583 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jun 08 11:47:59.043402 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037692    2583 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jun 08 11:47:59.043402 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037696    2583 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jun 08 11:47:59.043402 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037700    2583 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jun 08 11:47:59.043402 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037703    2583 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jun 08 11:47:59.043402 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037706    2583 flags.go:64] FLAG: --cgroup-root=""
Jun 08 11:47:59.043402 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037709    2583 flags.go:64] FLAG: --cgroups-per-qos="true"
Jun 08 11:47:59.043402 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037711    2583 flags.go:64] FLAG: --client-ca-file=""
Jun 08 11:47:59.043402 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037714    2583 flags.go:64] FLAG: --cloud-provider="external"
Jun 08 11:47:59.043402 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037717    2583 flags.go:64] FLAG: --cluster-dns="[]"
Jun 08 11:47:59.043402 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037721    2583 flags.go:64] FLAG: --cluster-domain=""
Jun 08 11:47:59.043402 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037724    2583 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jun 08 11:47:59.043402 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037727    2583 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jun 08 11:47:59.043402 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037730    2583 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jun 08 11:47:59.043402 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037735    2583 flags.go:64] FLAG: --container-log-max-files="5"
Jun 08 11:47:59.043969 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037738    2583 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jun 08 11:47:59.043969 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037741    2583 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jun 08 11:47:59.043969 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037744    2583 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jun 08 11:47:59.043969 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037747    2583 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jun 08 11:47:59.043969 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037750    2583 flags.go:64] FLAG: --contention-profiling="false"
Jun 08 11:47:59.043969 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037753    2583 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jun 08 11:47:59.043969 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037755    2583 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jun 08 11:47:59.043969 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037759    2583 flags.go:64] FLAG: --cpu-manager-policy="none"
Jun 08 11:47:59.043969 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037762    2583 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jun 08 11:47:59.043969 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037765    2583 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jun 08 11:47:59.043969 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037768    2583 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jun 08 11:47:59.043969 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037771    2583 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jun 08 11:47:59.043969 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037774    2583 flags.go:64] FLAG: --enable-load-reader="false"
Jun 08 11:47:59.043969 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037777    2583 flags.go:64] FLAG: --enable-server="true"
Jun 08 11:47:59.043969 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037780    2583 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jun 08 11:47:59.043969 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037785    2583 flags.go:64] FLAG: --event-burst="100"
Jun 08 11:47:59.043969 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037788    2583 flags.go:64] FLAG: --event-qps="50"
Jun 08 11:47:59.043969 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037791    2583 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jun 08 11:47:59.043969 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037794    2583 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jun 08 11:47:59.043969 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037797    2583 flags.go:64] FLAG: --eviction-hard=""
Jun 08 11:47:59.043969 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037801    2583 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jun 08 11:47:59.043969 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037804    2583 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jun 08 11:47:59.043969 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037807    2583 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jun 08 11:47:59.043969 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037810    2583 flags.go:64] FLAG: --eviction-soft=""
Jun 08 11:47:59.043969 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037813    2583 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jun 08 11:47:59.044833 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037816    2583 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jun 08 11:47:59.044833 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037819    2583 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jun 08 11:47:59.044833 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037821    2583 flags.go:64] FLAG: --experimental-mounter-path=""
Jun 08 11:47:59.044833 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037824    2583 flags.go:64] FLAG: --fail-cgroupv1="false"
Jun 08 11:47:59.044833 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037827    2583 flags.go:64] FLAG: --fail-swap-on="true"
Jun 08 11:47:59.044833 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037830    2583 flags.go:64] FLAG: --feature-gates=""
Jun 08 11:47:59.044833 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037835    2583 flags.go:64] FLAG: --file-check-frequency="20s"
Jun 08 11:47:59.044833 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037839    2583 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jun 08 11:47:59.044833 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037842    2583 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jun 08 11:47:59.044833 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037845    2583 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jun 08 11:47:59.044833 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037848    2583 flags.go:64] FLAG: --healthz-port="10248"
Jun 08 11:47:59.044833 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037851    2583 flags.go:64] FLAG: --help="false"
Jun 08 11:47:59.044833 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037853    2583 flags.go:64] FLAG: --hostname-override="ip-10-0-136-189.ec2.internal"
Jun 08 11:47:59.044833 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037857    2583 flags.go:64] FLAG: --housekeeping-interval="10s"
Jun 08 11:47:59.044833 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037860    2583 flags.go:64] FLAG: --http-check-frequency="20s"
Jun 08 11:47:59.044833 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037862    2583 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jun 08 11:47:59.044833 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037866    2583 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jun 08 11:47:59.044833 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037869    2583 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jun 08 11:47:59.044833 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037872    2583 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jun 08 11:47:59.044833 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037875    2583 flags.go:64] FLAG: --image-service-endpoint=""
Jun 08 11:47:59.044833 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037877    2583 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jun 08 11:47:59.044833 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037880    2583 flags.go:64] FLAG: --kube-api-burst="100"
Jun 08 11:47:59.044833 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037884    2583 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jun 08 11:47:59.045841 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037887    2583 flags.go:64] FLAG: --kube-api-qps="50"
Jun 08 11:47:59.045841 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037890    2583 flags.go:64] FLAG: --kube-reserved=""
Jun 08 11:47:59.045841 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037892    2583 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jun 08 11:47:59.045841 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037895    2583 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jun 08 11:47:59.045841 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037898    2583 flags.go:64] FLAG: --kubelet-cgroups=""
Jun 08 11:47:59.045841 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037901    2583 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jun 08 11:47:59.045841 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037904    2583 flags.go:64] FLAG: --lock-file=""
Jun 08 11:47:59.045841 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037907    2583 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jun 08 11:47:59.045841 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037909    2583 flags.go:64] FLAG: --log-flush-frequency="5s"
Jun 08 11:47:59.045841 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037912    2583 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jun 08 11:47:59.045841 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037917    2583 flags.go:64] FLAG: --log-json-split-stream="false"
Jun 08 11:47:59.045841 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037920    2583 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jun 08 11:47:59.045841 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037922    2583 flags.go:64] FLAG: --log-text-split-stream="false"
Jun 08 11:47:59.045841 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037925    2583 flags.go:64] FLAG: --logging-format="text"
Jun 08 11:47:59.045841 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037928    2583 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jun 08 11:47:59.045841 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037933    2583 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jun 08 11:47:59.045841 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037936    2583 flags.go:64] FLAG: --manifest-url=""
Jun 08 11:47:59.045841 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037938    2583 flags.go:64] FLAG: --manifest-url-header=""
Jun 08 11:47:59.045841 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037942    2583 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jun 08 11:47:59.045841 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037945    2583 flags.go:64] FLAG: --max-open-files="1000000"
Jun 08 11:47:59.045841 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037949    2583 flags.go:64] FLAG: --max-pods="110"
Jun 08 11:47:59.045841 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037952    2583 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jun 08 11:47:59.045841 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037955    2583 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jun 08 11:47:59.045841 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037958    2583 flags.go:64] FLAG: --memory-manager-policy="None"
Jun 08 11:47:59.045841 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037960    2583 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jun 08 11:47:59.046952 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037963    2583 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jun 08 11:47:59.046952 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037966    2583 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jun 08 11:47:59.046952 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037969    2583 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jun 08 11:47:59.046952 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037976    2583 flags.go:64] FLAG: --node-status-max-images="50"
Jun 08 11:47:59.046952 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037979    2583 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jun 08 11:47:59.046952 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037982    2583 flags.go:64] FLAG: --oom-score-adj="-999"
Jun 08 11:47:59.046952 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037986    2583 flags.go:64] FLAG: --pod-cidr=""
Jun 08 11:47:59.046952 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037989    2583 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d"
Jun 08 11:47:59.046952 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037994    2583 flags.go:64] FLAG: --pod-manifest-path=""
Jun 08 11:47:59.046952 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.037997    2583 flags.go:64] FLAG: --pod-max-pids="-1"
Jun 08 11:47:59.046952 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.038000    2583 flags.go:64] FLAG: --pods-per-core="0"
Jun 08 11:47:59.046952 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.038002    2583 flags.go:64] FLAG: --port="10250"
Jun 08 11:47:59.046952 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.038005    2583 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jun 08 11:47:59.046952 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.038008    2583 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-021b712dbb871a6f7"
Jun 08 11:47:59.046952 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.038011    2583 flags.go:64] FLAG: --qos-reserved=""
Jun 08 11:47:59.046952 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.038014    2583 flags.go:64] FLAG: --read-only-port="10255"
Jun 08 11:47:59.046952 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.038017    2583 flags.go:64] FLAG: --register-node="true"
Jun 08 11:47:59.046952 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.038020    2583 flags.go:64] FLAG: --register-with-taints=""
Jun 08 11:47:59.046952 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.038023    2583 flags.go:64] FLAG: --registry-burst="10"
Jun 08 11:47:59.046952 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.038026    2583 flags.go:64] FLAG: --registry-qps="5"
Jun 08 11:47:59.046952 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.038028    2583 flags.go:64] FLAG: --reserved-cpus=""
Jun 08 11:47:59.046952 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.038031    2583 flags.go:64] FLAG: --reserved-memory=""
Jun 08 11:47:59.046952 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.038036    2583 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jun 08 11:47:59.046952 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.038039    2583 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jun 08 11:47:59.046952 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.038042    2583 flags.go:64] FLAG: --rotate-certificates="false"
Jun 08 11:47:59.048061 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.038058    2583 flags.go:64] FLAG: --rotate-server-certificates="false"
Jun 08 11:47:59.048061 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.038061    2583 flags.go:64] FLAG: --runonce="false"
Jun 08 11:47:59.048061 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.038064    2583 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jun 08 11:47:59.048061 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.038067    2583 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jun 08 11:47:59.048061 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.038070    2583 flags.go:64] FLAG: --seccomp-default="false"
Jun 08 11:47:59.048061 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.038073    2583 flags.go:64] FLAG: --serialize-image-pulls="true"
Jun 08 11:47:59.048061 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.038076    2583 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jun 08 11:47:59.048061 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.038078    2583 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jun 08 11:47:59.048061 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.038081    2583 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jun 08 11:47:59.048061 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.038084    2583 flags.go:64] FLAG: --storage-driver-password="root"
Jun 08 11:47:59.048061 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.038087    2583 flags.go:64] FLAG: --storage-driver-secure="false"
Jun 08 11:47:59.048061 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.038089    2583 flags.go:64] FLAG: --storage-driver-table="stats"
Jun 08 11:47:59.048061 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.038092    2583 flags.go:64] FLAG: --storage-driver-user="root"
Jun 08 11:47:59.048061 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.038095    2583 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jun 08 11:47:59.048061 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.038098    2583 flags.go:64] FLAG: --sync-frequency="1m0s"
Jun 08 11:47:59.048061 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.038101    2583 flags.go:64] FLAG: --system-cgroups=""
Jun 08 11:47:59.048061 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.038104    2583 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jun 08 11:47:59.048061 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.038109    2583 flags.go:64] FLAG: --system-reserved-cgroup=""
Jun 08 11:47:59.048061 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.038113    2583 flags.go:64] FLAG: --tls-cert-file=""
Jun 08 11:47:59.048061 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.038116    2583 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jun 08 11:47:59.048061 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.038120    2583 flags.go:64] FLAG: --tls-min-version=""
Jun 08 11:47:59.048061 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.038123    2583 flags.go:64] FLAG: --tls-private-key-file=""
Jun 08 11:47:59.048061 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.038125    2583 flags.go:64] FLAG: --topology-manager-policy="none"
Jun 08 11:47:59.048061 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.038128    2583 flags.go:64] FLAG: --topology-manager-policy-options=""
Jun 08 11:47:59.048061 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.038131    2583 flags.go:64] FLAG: --topology-manager-scope="container"
Jun 08 11:47:59.048826 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.038134    2583 flags.go:64] FLAG: --v="2"
Jun 08 11:47:59.048826 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.038138    2583 flags.go:64] FLAG: --version="false"
Jun 08 11:47:59.048826 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.038142    2583 flags.go:64] FLAG: --vmodule=""
Jun 08 11:47:59.048826 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.038146    2583 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jun 08 11:47:59.048826 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.038150    2583 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jun 08 11:47:59.048826 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038283    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 08 11:47:59.048826 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038287    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 08 11:47:59.048826 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038290    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 08 11:47:59.048826 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038293    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 08 11:47:59.048826 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038296    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 08 11:47:59.048826 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038299    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 08 11:47:59.048826 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038302    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 08 11:47:59.048826 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038305    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 08 11:47:59.048826 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038307    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 08 11:47:59.048826 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038310    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 08 11:47:59.048826 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038313    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 08 11:47:59.048826 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038315    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 08 11:47:59.048826 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038318    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 08 11:47:59.048826 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038320    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 08 11:47:59.048826 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038323    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 08 11:47:59.048826 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038325    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 08 11:47:59.049670 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038327    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 08 11:47:59.049670 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038330    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 08 11:47:59.049670 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038333    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 08 11:47:59.049670 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038336    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 08 11:47:59.049670 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038340    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 08 11:47:59.049670 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038342    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 08 11:47:59.049670 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038345    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 08 11:47:59.049670 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038347    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 08 11:47:59.049670 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038350    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 08 11:47:59.049670 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038353    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 08 11:47:59.049670 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038355    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 08 11:47:59.049670 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038358    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 08 11:47:59.049670 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038360    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 08 11:47:59.049670 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038363    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 08 11:47:59.049670 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038366    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 08 11:47:59.049670 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038369    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 08 11:47:59.049670 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038372    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 08 11:47:59.049670 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038374    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 08 11:47:59.049670 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038377    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 08 11:47:59.049670 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038379    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 08 11:47:59.050418 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038382    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 08 11:47:59.050418 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038385    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 08 11:47:59.050418 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038389    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 08 11:47:59.050418 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038392    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 08 11:47:59.050418 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038395    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 08 11:47:59.050418 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038398    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 08 11:47:59.050418 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038401    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 08 11:47:59.050418 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038404    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 08 11:47:59.050418 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038406    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 08 11:47:59.050418 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038409    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 08 11:47:59.050418 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038411    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 08 11:47:59.050418 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038414    2583 feature_gate.go:328] unrecognized feature gate: Example
Jun 08 11:47:59.050418 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038416    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 08 11:47:59.050418 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038419    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 08 11:47:59.050418 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038422    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 08 11:47:59.050418 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038425    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 08 11:47:59.050418 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038429    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 08 11:47:59.050418 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038431    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 08 11:47:59.050418 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038434    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 08 11:47:59.051032 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038436    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 08 11:47:59.051032 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038439    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 08 11:47:59.051032 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038441    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 08 11:47:59.051032 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038444    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 08 11:47:59.051032 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038446    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 08 11:47:59.051032 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038449    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 08 11:47:59.051032 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038451    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 08 11:47:59.051032 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038455    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 08 11:47:59.051032 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038459    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 08 11:47:59.051032 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038462    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 08 11:47:59.051032 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038465    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 08 11:47:59.051032 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038468    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 08 11:47:59.051032 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038471    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 08 11:47:59.051032 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038473    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 08 11:47:59.051032 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038476    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 08 11:47:59.051032 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038479    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 08 11:47:59.051032 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038481    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 08 11:47:59.051032 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038484    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 08 11:47:59.051032 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038486    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 08 11:47:59.051506 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038489    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jun 08 11:47:59.051506 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038492    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 08 11:47:59.051506 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038494    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 08 11:47:59.051506 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038497    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 08 11:47:59.051506 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038499    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 08 11:47:59.051506 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038502    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 08 11:47:59.051506 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038504    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 08 11:47:59.051506 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038507    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 08 11:47:59.051506 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038509    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 08 11:47:59.051506 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038512    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 08 11:47:59.051506 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038518    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 08 11:47:59.051506 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038521    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 08 11:47:59.051506 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038524    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 08 11:47:59.051506 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038527    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 08 11:47:59.051506 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038529    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 08 11:47:59.051506 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038532    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 08 11:47:59.051506 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038535    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 08 11:47:59.051506 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038537    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 08 11:47:59.051506 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038540    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 08 11:47:59.051970 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038542    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 08 11:47:59.051970 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038545    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 08 11:47:59.051970 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038547    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 08 11:47:59.051970 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038550    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 08 11:47:59.051970 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038553    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 08 11:47:59.051970 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.038555    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 08 11:47:59.051970 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.039192    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 08 11:47:59.051970 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.046499    2583 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jun 08 11:47:59.051970 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.046517    2583 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jun 08 11:47:59.051970 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.046544    2583 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jun 08 11:47:59.051970 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.046553    2583 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jun 08 11:47:59.051970 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046642    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 08 11:47:59.051970 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046650    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 08 11:47:59.051970 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046655    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 08 11:47:59.051970 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046660    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 08 11:47:59.052353 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046664    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 08 11:47:59.052353 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046669    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 08 11:47:59.052353 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046673    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 08 11:47:59.052353 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046678    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 08 11:47:59.052353 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046682    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 08 11:47:59.052353 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046686    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 08 11:47:59.052353 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046690    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 08 11:47:59.052353 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046694    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 08 11:47:59.052353 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046699    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 08 11:47:59.052353 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046704    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 08 11:47:59.052353 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046710    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 08 11:47:59.052353 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046716    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 08 11:47:59.052353 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046720    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 08 11:47:59.052353 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046725    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 08 11:47:59.052353 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046729    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 08 11:47:59.052353 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046733    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 08 11:47:59.052353 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046737    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 08 11:47:59.052353 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046741    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 08 11:47:59.052353 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046746    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 08 11:47:59.052353 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046750    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 08 11:47:59.052829 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046754    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 08 11:47:59.052829 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046758    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 08 11:47:59.052829 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046762    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 08 11:47:59.052829 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046766    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 08 11:47:59.052829 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046771    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 08 11:47:59.052829 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046776    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 08 11:47:59.052829 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046780    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 08 11:47:59.052829 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046784    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 08 11:47:59.052829 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046788    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 08 11:47:59.052829 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046792    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 08 11:47:59.052829 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046797    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 08 11:47:59.052829 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046800    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 08 11:47:59.052829 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046804    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 08 11:47:59.052829 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046808    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 08 11:47:59.052829 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046812    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 08 11:47:59.052829 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046816    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 08 11:47:59.052829 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046820    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 08 11:47:59.052829 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046824    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 08 11:47:59.052829 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046828    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 08 11:47:59.052829 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046832    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 08 11:47:59.052829 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046836    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 08 11:47:59.053338 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046841    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 08 11:47:59.053338 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046846    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 08 11:47:59.053338 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046850    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 08 11:47:59.053338 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046853    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 08 11:47:59.053338 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046857    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 08 11:47:59.053338 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046861    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 08 11:47:59.053338 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046865    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 08 11:47:59.053338 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046869    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 08 11:47:59.053338 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046873    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jun 08 11:47:59.053338 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046877    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 08 11:47:59.053338 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046881    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 08 11:47:59.053338 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046885    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 08 11:47:59.053338 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046890    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 08 11:47:59.053338 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046893    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 08 11:47:59.053338 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046897    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 08 11:47:59.053338 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046901    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 08 11:47:59.053338 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046908    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 08 11:47:59.053338 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046913    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 08 11:47:59.053338 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046918    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 08 11:47:59.053823 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046922    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 08 11:47:59.053823 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046926    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 08 11:47:59.053823 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046931    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 08 11:47:59.053823 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046934    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 08 11:47:59.053823 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046938    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 08 11:47:59.053823 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046942    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 08 11:47:59.053823 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046946    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 08 11:47:59.053823 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046950    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 08 11:47:59.053823 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046953    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 08 11:47:59.053823 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046957    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 08 11:47:59.053823 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046961    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 08 11:47:59.053823 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046964    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 08 11:47:59.053823 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046968    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 08 11:47:59.053823 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046972    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 08 11:47:59.053823 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046977    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 08 11:47:59.053823 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046981    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 08 11:47:59.053823 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046985    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 08 11:47:59.053823 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046989    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 08 11:47:59.053823 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046994    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 08 11:47:59.054272 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.046998    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 08 11:47:59.054272 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047002    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 08 11:47:59.054272 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047006    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 08 11:47:59.054272 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047010    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 08 11:47:59.054272 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047016    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 08 11:47:59.054272 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047021    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 08 11:47:59.054272 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047026    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 08 11:47:59.054272 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047029    2583 feature_gate.go:328] unrecognized feature gate: Example
Jun 08 11:47:59.054272 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047034    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 08 11:47:59.054272 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047038    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 08 11:47:59.054272 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047043    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 08 11:47:59.054272 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047066    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 08 11:47:59.054272 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047070    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 08 11:47:59.054272 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047073    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 08 11:47:59.054272 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047077    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 08 11:47:59.054272 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047081    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 08 11:47:59.054642 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.047087    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 08 11:47:59.054642 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047255    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 08 11:47:59.054642 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047263    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 08 11:47:59.054642 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047268    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 08 11:47:59.054642 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047272    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 08 11:47:59.054642 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047276    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 08 11:47:59.054642 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047281    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 08 11:47:59.054642 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047285    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 08 11:47:59.054642 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047289    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 08 11:47:59.054642 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047292    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 08 11:47:59.054642 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047297    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 08 11:47:59.054642 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047301    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 08 11:47:59.054642 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047306    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 08 11:47:59.054642 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047310    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 08 11:47:59.054642 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047314    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 08 11:47:59.054995 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047319    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 08 11:47:59.054995 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047323    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 08 11:47:59.054995 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047327    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 08 11:47:59.054995 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047331    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 08 11:47:59.054995 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047335    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 08 11:47:59.054995 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047339    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 08 11:47:59.054995 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047343    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 08 11:47:59.054995 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047347    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 08 11:47:59.054995 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047352    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 08 11:47:59.054995 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047356    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 08 11:47:59.054995 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047359    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 08 11:47:59.054995 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047363    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 08 11:47:59.054995 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047368    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 08 11:47:59.054995 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047372    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 08 11:47:59.054995 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047376    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 08 11:47:59.054995 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047380    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 08 11:47:59.054995 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047384    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jun 08 11:47:59.054995 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047388    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 08 11:47:59.054995 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047393    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 08 11:47:59.054995 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047397    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 08 11:47:59.055565 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047401    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 08 11:47:59.055565 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047405    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 08 11:47:59.055565 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047410    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 08 11:47:59.055565 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047414    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 08 11:47:59.055565 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047418    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 08 11:47:59.055565 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047422    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 08 11:47:59.055565 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047426    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 08 11:47:59.055565 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047431    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 08 11:47:59.055565 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047435    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 08 11:47:59.055565 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047439    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 08 11:47:59.055565 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047445    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 08 11:47:59.055565 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047449    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 08 11:47:59.055565 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047453    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 08 11:47:59.055565 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047457    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 08 11:47:59.055565 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047461    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 08 11:47:59.055565 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047467    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 08 11:47:59.055565 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047473    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 08 11:47:59.055565 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047478    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 08 11:47:59.055565 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047482    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 08 11:47:59.055565 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047487    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 08 11:47:59.056034 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047492    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 08 11:47:59.056034 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047496    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 08 11:47:59.056034 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047501    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 08 11:47:59.056034 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047506    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 08 11:47:59.056034 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047512    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 08 11:47:59.056034 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047516    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 08 11:47:59.056034 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047520    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 08 11:47:59.056034 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047524    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 08 11:47:59.056034 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047529    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 08 11:47:59.056034 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047533    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 08 11:47:59.056034 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047537    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 08 11:47:59.056034 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047545    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 08 11:47:59.056034 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047550    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 08 11:47:59.056034 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047554    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 08 11:47:59.056034 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047558    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 08 11:47:59.056034 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047562    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 08 11:47:59.056034 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047566    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 08 11:47:59.056034 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047571    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 08 11:47:59.056034 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047575    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 08 11:47:59.056034 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047578    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 08 11:47:59.056514 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047583    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 08 11:47:59.056514 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047587    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 08 11:47:59.056514 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047591    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 08 11:47:59.056514 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047596    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 08 11:47:59.056514 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047601    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 08 11:47:59.056514 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047605    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 08 11:47:59.056514 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047610    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 08 11:47:59.056514 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047614    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 08 11:47:59.056514 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047618    2583 feature_gate.go:328] unrecognized feature gate: Example
Jun 08 11:47:59.056514 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047622    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 08 11:47:59.056514 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047626    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 08 11:47:59.056514 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047630    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 08 11:47:59.056514 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047637    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 08 11:47:59.056514 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047642    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 08 11:47:59.056514 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047648    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 08 11:47:59.056514 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047653    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 08 11:47:59.056514 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047659    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 08 11:47:59.056514 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047664    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 08 11:47:59.056514 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047668    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 08 11:47:59.056963 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047673    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 08 11:47:59.056963 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047677    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 08 11:47:59.056963 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047681    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 08 11:47:59.056963 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047685    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 08 11:47:59.056963 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047691    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 08 11:47:59.056963 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:47:59.047696    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 08 11:47:59.056963 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.047703    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 08 11:47:59.056963 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.047839    2583 server.go:962] "Client rotation is on, will bootstrap in background"
Jun 08 11:47:59.056963 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.052269    2583 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jun 08 11:47:59.056963 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.053711    2583 server.go:1019] "Starting client certificate rotation"
Jun 08 11:47:59.056963 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.053812    2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 08 11:47:59.056963 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.054410    2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 08 11:47:59.056963 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.056436    2583 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 08 11:47:59.057795 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.057779    2583 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 08 11:47:59.065747 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.065730    2583 log.go:25] "Validated CRI v1 runtime API"
Jun 08 11:47:59.069476 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.069461    2583 log.go:25] "Validated CRI v1 image API"
Jun 08 11:47:59.071021 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.071005    2583 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jun 08 11:47:59.076293 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.076270    2583 fs.go:135] Filesystem UUIDs: map[5ac69c63-260a-4fc8-abe0-69d239657c46:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 a860512e-bc5a-40b1-9b00-ff697d8e07ec:/dev/nvme0n1p4]
Jun 08 11:47:59.076359 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.076292    2583 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jun 08 11:47:59.079660 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.079636    2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 08 11:47:59.081951 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.081840    2583 manager.go:216] Machine: {Timestamp:2026-06-08 11:47:59.080563739 +0000 UTC m=+0.352138917 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3203610 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2beb51f5268920821106a60d57ca2a SystemUUID:ec2beb51-f526-8920-8211-06a60d57ca2a BootID:8c590899-a296-461e-85e8-2f8548e6b5ba Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ee:a1:88:86:03 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ee:a1:88:86:03 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:22:02:de:a5:f6:55 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jun 08 11:47:59.081951 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.081944    2583 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jun 08 11:47:59.082075 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.082024    2583 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jun 08 11:47:59.084561 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.084533    2583 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jun 08 11:47:59.084710 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.084565    2583 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-189.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jun 08 11:47:59.086441 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.086429    2583 topology_manager.go:138] "Creating topology manager with none policy"
Jun 08 11:47:59.086441 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.086441    2583 container_manager_linux.go:309] "Creating device plugin manager"
Jun 08 11:47:59.086518 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.086449    2583 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 08 11:47:59.087772 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.087758    2583 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 08 11:47:59.088552 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.088542    2583 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jun 08 11:47:59.091357 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.091344    2583 state_mem.go:36] "Initialized new in-memory state store"
Jun 08 11:47:59.091486 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.091477    2583 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jun 08 11:47:59.091514 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.091509    2583 kubelet.go:486] "Attempting to sync node with API server"
Jun 08 11:47:59.091547 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.091520    2583 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jun 08 11:47:59.091547 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.091535    2583 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jun 08 11:47:59.091547 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.091546    2583 kubelet.go:398] "Adding apiserver pod source"
Jun 08 11:47:59.091643 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.091557    2583 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jun 08 11:47:59.091937 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.091923    2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 08 11:47:59.091970 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.091946    2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 08 11:47:59.095249 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.095234    2583 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jun 08 11:47:59.097154 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.097128    2583 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jun 08 11:47:59.097247 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.097179    2583 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jun 08 11:47:59.098471 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.098450    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jun 08 11:47:59.098750 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.098728    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jun 08 11:47:59.098750 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.098748    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jun 08 11:47:59.098820 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.098755    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jun 08 11:47:59.098820 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.098764    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jun 08 11:47:59.098820 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.098770    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jun 08 11:47:59.098820 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.098777    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jun 08 11:47:59.098820 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.098782    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jun 08 11:47:59.098820 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.098789    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jun 08 11:47:59.098820 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.098795    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jun 08 11:47:59.098820 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.098810    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jun 08 11:47:59.098820 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.098815    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jun 08 11:47:59.099618 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.099609    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jun 08 11:47:59.099618 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.099618    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jun 08 11:47:59.102811 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.102797    2583 server.go:1268] "Started kubelet"
Jun 08 11:47:59.102939 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.102887    2583 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jun 08 11:47:59.103029 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.102972    2583 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jun 08 11:47:59.103096 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.103031    2583 server_v1.go:49] "podresources" method="list" useActivePods=true
Jun 08 11:47:59.103491 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.103473    2583 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-189.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jun 08 11:47:59.103566 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:47:59.103521    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jun 08 11:47:59.103566 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:47:59.103544    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-189.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jun 08 11:47:59.103728 ip-10-0-136-189 systemd[1]: Started Kubernetes Kubelet.
Jun 08 11:47:59.104631 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.104610    2583 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jun 08 11:47:59.106155 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.106138    2583 server.go:310] "Adding debug handlers to kubelet server"
Jun 08 11:47:59.109282 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:47:59.109262    2583 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jun 08 11:47:59.110094 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:47:59.109126    2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-189.ec2.internal.18b718a60c90acb5  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-189.ec2.internal,UID:ip-10-0-136-189.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-189.ec2.internal,},FirstTimestamp:2026-06-08 11:47:59.102766261 +0000 UTC m=+0.374341428,LastTimestamp:2026-06-08 11:47:59.102766261 +0000 UTC m=+0.374341428,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-189.ec2.internal,}"
Jun 08 11:47:59.110236 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.110222    2583 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jun 08 11:47:59.110282 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.110223    2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jun 08 11:47:59.110351 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:47:59.110337    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-189.ec2.internal\" not found"
Jun 08 11:47:59.110976 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.110961    2583 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jun 08 11:47:59.111120 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.110962    2583 volume_manager.go:311] "The desired_state_of_world populator starts"
Jun 08 11:47:59.111207 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.111189    2583 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jun 08 11:47:59.111292 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.111258    2583 reconstruct.go:97] "Volume reconstruction finished"
Jun 08 11:47:59.111292 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.111267    2583 reconciler.go:29] "Reconciler: start to sync state"
Jun 08 11:47:59.111390 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.111379    2583 factory.go:153] Registering CRI-O factory
Jun 08 11:47:59.111422 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.111394    2583 factory.go:223] Registration of the crio container factory successfully
Jun 08 11:47:59.111471 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.111461    2583 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jun 08 11:47:59.111519 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.111471    2583 factory.go:55] Registering systemd factory
Jun 08 11:47:59.111519 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.111476    2583 factory.go:223] Registration of the systemd container factory successfully
Jun 08 11:47:59.111519 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.111493    2583 factory.go:103] Registering Raw factory
Jun 08 11:47:59.111519 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.111503    2583 manager.go:1196] Started watching for new ooms in manager
Jun 08 11:47:59.111821 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.111810    2583 manager.go:349] Starting recovery of all containers
Jun 08 11:47:59.118410 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:47:59.118369    2583 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-189.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jun 08 11:47:59.118527 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:47:59.118506    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jun 08 11:47:59.119453 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.119428    2583 manager.go:354] Recovery completed
Jun 08 11:47:59.125901 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.125798    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 08 11:47:59.127950 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.127930    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-189.ec2.internal" event="NodeHasSufficientMemory"
Jun 08 11:47:59.128020 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.127967    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-189.ec2.internal" event="NodeHasNoDiskPressure"
Jun 08 11:47:59.128020 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.127981    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-189.ec2.internal" event="NodeHasSufficientPID"
Jun 08 11:47:59.128462 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.128446    2583 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jun 08 11:47:59.128462 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.128461    2583 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jun 08 11:47:59.128534 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.128475    2583 state_mem.go:36] "Initialized new in-memory state store"
Jun 08 11:47:59.128534 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.128501    2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wtvql"
Jun 08 11:47:59.128534 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.128508    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 08 11:47:59.129209 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.129193    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-189.ec2.internal" event="NodeHasSufficientMemory"
Jun 08 11:47:59.129279 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.129223    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-189.ec2.internal" event="NodeHasNoDiskPressure"
Jun 08 11:47:59.129279 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.129236    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-189.ec2.internal" event="NodeHasSufficientPID"
Jun 08 11:47:59.129528 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.129512    2583 policy_none.go:49] "None policy: Start"
Jun 08 11:47:59.129528 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.129529    2583 memory_manager.go:187] "Starting memorymanager" policy="None"
Jun 08 11:47:59.129624 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.129539    2583 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jun 08 11:47:59.129902 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:47:59.129823    2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-189.ec2.internal.18b718a60e10f296  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-189.ec2.internal,UID:ip-10-0-136-189.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-189.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-189.ec2.internal,},FirstTimestamp:2026-06-08 11:47:59.127949974 +0000 UTC m=+0.399525149,LastTimestamp:2026-06-08 11:47:59.127949974 +0000 UTC m=+0.399525149,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-189.ec2.internal,}"
Jun 08 11:47:59.130502 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.130490    2583 policy_none.go:47] "Start"
Jun 08 11:47:59.136885 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.136867    2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wtvql"
Jun 08 11:47:59.137351 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:47:59.137289    2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-189.ec2.internal.18b718a60e11517f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-189.ec2.internal,UID:ip-10-0-136-189.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-136-189.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-136-189.ec2.internal,},FirstTimestamp:2026-06-08 11:47:59.127974271 +0000 UTC m=+0.399549441,LastTimestamp:2026-06-08 11:47:59.127974271 +0000 UTC m=+0.399549441,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-189.ec2.internal,}"
Jun 08 11:47:59.172685 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.172668    2583 manager.go:337] "Starting Device Plugin manager"
Jun 08 11:47:59.178214 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:47:59.172708    2583 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jun 08 11:47:59.178214 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.172722    2583 server.go:87] "Starting device plugin registration server"
Jun 08 11:47:59.178214 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.173009    2583 eviction_manager.go:189] "Eviction manager: starting control loop"
Jun 08 11:47:59.178214 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.173022    2583 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jun 08 11:47:59.178214 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.173107    2583 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jun 08 11:47:59.178214 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.173184    2583 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jun 08 11:47:59.178214 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.173193    2583 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jun 08 11:47:59.178214 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:47:59.173800    2583 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jun 08 11:47:59.178214 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:47:59.173843    2583 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-189.ec2.internal\" not found"
Jun 08 11:47:59.179289 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.179268    2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jun 08 11:47:59.180311 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.180293    2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jun 08 11:47:59.180397 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.180326    2583 status_manager.go:244] "Starting to sync pod status with apiserver"
Jun 08 11:47:59.180397 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.180345    2583 kubelet.go:2448] "Starting kubelet main sync loop"
Jun 08 11:47:59.180397 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:47:59.180374    2583 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jun 08 11:47:59.182637 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.182618    2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 08 11:47:59.273891 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.273858    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 08 11:47:59.274830 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.274814    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-189.ec2.internal" event="NodeHasSufficientMemory"
Jun 08 11:47:59.274894 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.274846    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-189.ec2.internal" event="NodeHasNoDiskPressure"
Jun 08 11:47:59.274894 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.274857    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-189.ec2.internal" event="NodeHasSufficientPID"
Jun 08 11:47:59.274894 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.274879    2583 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-189.ec2.internal"
Jun 08 11:47:59.281431 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.281382    2583 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-189.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-189.ec2.internal"]
Jun 08 11:47:59.281502 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.281458    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 08 11:47:59.282917 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.282895    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-189.ec2.internal" event="NodeHasSufficientMemory"
Jun 08 11:47:59.282998 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.282926    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-189.ec2.internal" event="NodeHasNoDiskPressure"
Jun 08 11:47:59.282998 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.282941    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-189.ec2.internal" event="NodeHasSufficientPID"
Jun 08 11:47:59.284193 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.284181    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 08 11:47:59.284316 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.284303    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-189.ec2.internal"
Jun 08 11:47:59.284353 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.284333    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 08 11:47:59.284563 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.284547    2583 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-189.ec2.internal"
Jun 08 11:47:59.284631 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:47:59.284568    2583 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-189.ec2.internal\": node \"ip-10-0-136-189.ec2.internal\" not found"
Jun 08 11:47:59.284900 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.284880    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-189.ec2.internal" event="NodeHasSufficientMemory"
Jun 08 11:47:59.284960 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.284913    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-189.ec2.internal" event="NodeHasNoDiskPressure"
Jun 08 11:47:59.284960 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.284890    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-189.ec2.internal" event="NodeHasSufficientMemory"
Jun 08 11:47:59.284960 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.284926    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-189.ec2.internal" event="NodeHasSufficientPID"
Jun 08 11:47:59.284960 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.284940    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-189.ec2.internal" event="NodeHasNoDiskPressure"
Jun 08 11:47:59.284960 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.284949    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-189.ec2.internal" event="NodeHasSufficientPID"
Jun 08 11:47:59.286062 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.286029    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-189.ec2.internal"
Jun 08 11:47:59.286137 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.286076    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 08 11:47:59.286765 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.286745    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-189.ec2.internal" event="NodeHasSufficientMemory"
Jun 08 11:47:59.286850 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.286769    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-189.ec2.internal" event="NodeHasNoDiskPressure"
Jun 08 11:47:59.286850 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.286779    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-189.ec2.internal" event="NodeHasSufficientPID"
Jun 08 11:47:59.310243 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:47:59.310223    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-189.ec2.internal\" not found"
Jun 08 11:47:59.312377 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.312360    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/47d87748d4fd6c5c566093e7f434c0bf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-189.ec2.internal\" (UID: \"47d87748d4fd6c5c566093e7f434c0bf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-189.ec2.internal"
Jun 08 11:47:59.312460 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.312392    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/47d87748d4fd6c5c566093e7f434c0bf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-189.ec2.internal\" (UID: \"47d87748d4fd6c5c566093e7f434c0bf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-189.ec2.internal"
Jun 08 11:47:59.312460 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.312415    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/506ef425fb62c5dbd2433ce02355f53c-config\") pod \"kube-apiserver-proxy-ip-10-0-136-189.ec2.internal\" (UID: \"506ef425fb62c5dbd2433ce02355f53c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-189.ec2.internal"
Jun 08 11:47:59.314737 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:47:59.314721    2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-189.ec2.internal\" not found" node="ip-10-0-136-189.ec2.internal"
Jun 08 11:47:59.319091 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:47:59.319076    2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-189.ec2.internal\" not found" node="ip-10-0-136-189.ec2.internal"
Jun 08 11:47:59.410401 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:47:59.410369    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-189.ec2.internal\" not found"
Jun 08 11:47:59.412553 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.412533    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/47d87748d4fd6c5c566093e7f434c0bf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-189.ec2.internal\" (UID: \"47d87748d4fd6c5c566093e7f434c0bf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-189.ec2.internal"
Jun 08 11:47:59.412635 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.412563    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/47d87748d4fd6c5c566093e7f434c0bf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-189.ec2.internal\" (UID: \"47d87748d4fd6c5c566093e7f434c0bf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-189.ec2.internal"
Jun 08 11:47:59.412635 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.412580    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/506ef425fb62c5dbd2433ce02355f53c-config\") pod \"kube-apiserver-proxy-ip-10-0-136-189.ec2.internal\" (UID: \"506ef425fb62c5dbd2433ce02355f53c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-189.ec2.internal"
Jun 08 11:47:59.412711 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.412635    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/47d87748d4fd6c5c566093e7f434c0bf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-189.ec2.internal\" (UID: \"47d87748d4fd6c5c566093e7f434c0bf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-189.ec2.internal"
Jun 08 11:47:59.412711 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.412630    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/47d87748d4fd6c5c566093e7f434c0bf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-189.ec2.internal\" (UID: \"47d87748d4fd6c5c566093e7f434c0bf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-189.ec2.internal"
Jun 08 11:47:59.412711 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.412699    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/506ef425fb62c5dbd2433ce02355f53c-config\") pod \"kube-apiserver-proxy-ip-10-0-136-189.ec2.internal\" (UID: \"506ef425fb62c5dbd2433ce02355f53c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-189.ec2.internal"
Jun 08 11:47:59.510761 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:47:59.510723    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-189.ec2.internal\" not found"
Jun 08 11:47:59.611361 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:47:59.611317    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-189.ec2.internal\" not found"
Jun 08 11:47:59.618655 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.618633    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-189.ec2.internal"
Jun 08 11:47:59.623505 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.623489    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-189.ec2.internal"
Jun 08 11:47:59.712148 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:47:59.712103    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-189.ec2.internal\" not found"
Jun 08 11:47:59.812551 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:47:59.812522    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-189.ec2.internal\" not found"
Jun 08 11:47:59.913085 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:47:59.913003    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-189.ec2.internal\" not found"
Jun 08 11:47:59.973225 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:47:59.973200    2583 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 08 11:48:00.013381 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:00.013358    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-189.ec2.internal\" not found"
Jun 08 11:48:00.052598 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:00.052571    2583 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jun 08 11:48:00.053207 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:00.052726    2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jun 08 11:48:00.053207 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:00.052745    2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jun 08 11:48:00.093973 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:48:00.093941    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47d87748d4fd6c5c566093e7f434c0bf.slice/crio-7b62cdf7d258fb5c0610bd6d1450ccf79bc22721a30cba7f971ce4ca7a48a115 WatchSource:0}: Error finding container 7b62cdf7d258fb5c0610bd6d1450ccf79bc22721a30cba7f971ce4ca7a48a115: Status 404 returned error can't find the container with id 7b62cdf7d258fb5c0610bd6d1450ccf79bc22721a30cba7f971ce4ca7a48a115
Jun 08 11:48:00.094458 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:48:00.094444    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod506ef425fb62c5dbd2433ce02355f53c.slice/crio-4b2cd4485406f326663907f37394b2889281b29bdd6118257093a1a49a301931 WatchSource:0}: Error finding container 4b2cd4485406f326663907f37394b2889281b29bdd6118257093a1a49a301931: Status 404 returned error can't find the container with id 4b2cd4485406f326663907f37394b2889281b29bdd6118257093a1a49a301931
Jun 08 11:48:00.101480 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:00.101464    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 08 11:48:00.113451 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:00.113424    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-189.ec2.internal\" not found"
Jun 08 11:48:00.139597 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:00.139561    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-07 11:42:59 +0000 UTC" deadline="2028-03-02 08:12:41.581263364 +0000 UTC"
Jun 08 11:48:00.139597 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:00.139593    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15188h24m41.441673381s"
Jun 08 11:48:00.184074 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:00.183981    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-189.ec2.internal" event={"ID":"506ef425fb62c5dbd2433ce02355f53c","Type":"ContainerStarted","Data":"4b2cd4485406f326663907f37394b2889281b29bdd6118257093a1a49a301931"}
Jun 08 11:48:00.185145 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:00.185123    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-189.ec2.internal" event={"ID":"47d87748d4fd6c5c566093e7f434c0bf","Type":"ContainerStarted","Data":"7b62cdf7d258fb5c0610bd6d1450ccf79bc22721a30cba7f971ce4ca7a48a115"}
Jun 08 11:48:00.214381 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:00.214362    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-189.ec2.internal\" not found"
Jun 08 11:48:00.256910 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:00.256888    2583 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 08 11:48:00.291039 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:00.291017    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 08 11:48:00.292237 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:00.292215    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-189.ec2.internal" event="NodeHasSufficientMemory"
Jun 08 11:48:00.292330 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:00.292249    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-189.ec2.internal" event="NodeHasNoDiskPressure"
Jun 08 11:48:00.292330 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:00.292272    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-189.ec2.internal" event="NodeHasSufficientPID"
Jun 08 11:48:00.315141 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:00.315120    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-189.ec2.internal\" not found"
Jun 08 11:48:00.415644 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:00.415618    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-189.ec2.internal\" not found"
Jun 08 11:48:00.516266 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:00.516190    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-189.ec2.internal\" not found"
Jun 08 11:48:00.617060 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:00.617017    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-189.ec2.internal\" not found"
Jun 08 11:48:00.678170 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:00.678128    2583 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 08 11:48:00.710528 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:00.710494    2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-189.ec2.internal"
Jun 08 11:48:00.726611 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:00.726586    2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jun 08 11:48:00.727958 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:00.727939    2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-189.ec2.internal"
Jun 08 11:48:00.735074 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:00.735039    2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jun 08 11:48:01.092814 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.092732    2583 apiserver.go:52] "Watching apiserver"
Jun 08 11:48:01.098871 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.098851    2583 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jun 08 11:48:01.099262 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.099242    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-c6hh2","kube-system/konnectivity-agent-vxkpp","kube-system/kube-apiserver-proxy-ip-10-0-136-189.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzh85","openshift-cluster-node-tuning-operator/tuned-pm229","openshift-dns/node-resolver-dmbw7","openshift-multus/network-metrics-daemon-6m4cb","openshift-network-operator/iptables-alerter-dplqn","openshift-image-registry/node-ca-ps66l","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-189.ec2.internal","openshift-multus/multus-additional-cni-plugins-bzgvn","openshift-multus/multus-f4gdp","openshift-network-diagnostics/network-check-target-rx5rz","openshift-ovn-kubernetes/ovnkube-node-9x6v7"]
Jun 08 11:48:01.101853 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.101825    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6m4cb"
Jun 08 11:48:01.101960 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:01.101905    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6m4cb" podUID="0b2281a3-722f-4113-b3e1-7f4b4614f599"
Jun 08 11:48:01.103992 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.103969    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rx5rz"
Jun 08 11:48:01.104107 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:01.104040    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rx5rz" podUID="3b153dca-66ed-4681-b70b-6061158f6676"
Jun 08 11:48:01.106216 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.106199    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7"
Jun 08 11:48:01.108547 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.108521    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzh85"
Jun 08 11:48:01.108656 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.108582    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jun 08 11:48:01.108656 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.108597    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-zgrng\""
Jun 08 11:48:01.108771 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.108753    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jun 08 11:48:01.108887 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.108871    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jun 08 11:48:01.108979 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.108907    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jun 08 11:48:01.109077 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.109065    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jun 08 11:48:01.109214 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.109194    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jun 08 11:48:01.110708 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.110694    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jun 08 11:48:01.110810 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.110744    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9d7pv\""
Jun 08 11:48:01.110957 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.110942    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jun 08 11:48:01.110957 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.110947    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pm229"
Jun 08 11:48:01.111100 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.110973    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jun 08 11:48:01.111204 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.111191    2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jun 08 11:48:01.112860 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.112841    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dmbw7"
Jun 08 11:48:01.113373 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.112984    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jun 08 11:48:01.113373 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.113174    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-sf6r9\""
Jun 08 11:48:01.113373 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.113254    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jun 08 11:48:01.115088 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.115071    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jun 08 11:48:01.115274 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.115232    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-rg5fw\""
Jun 08 11:48:01.115354 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.115292    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jun 08 11:48:01.115411 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.115360    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ps66l"
Jun 08 11:48:01.117253 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.117237    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-nc2rk\""
Jun 08 11:48:01.117409 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.117391    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jun 08 11:48:01.117484 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.117413    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jun 08 11:48:01.117677 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.117654    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c6hh2"
Jun 08 11:48:01.117749 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:01.117714    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c6hh2" podUID="2579f4ef-e90c-4da0-9617-9ba892dba6ef"
Jun 08 11:48:01.117850 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.117830    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jun 08 11:48:01.119856 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.119839    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vxkpp"
Jun 08 11:48:01.121662 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.121644    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a447431c-750b-4ed2-b229-59acbc3534e8-host-run-netns\") pod \"ovnkube-node-9x6v7\" (UID: \"a447431c-750b-4ed2-b229-59acbc3534e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7"
Jun 08 11:48:01.121724 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.121670    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a447431c-750b-4ed2-b229-59acbc3534e8-run-systemd\") pod \"ovnkube-node-9x6v7\" (UID: \"a447431c-750b-4ed2-b229-59acbc3534e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7"
Jun 08 11:48:01.121724 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.121687    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzdxb\" (UniqueName: \"kubernetes.io/projected/a447431c-750b-4ed2-b229-59acbc3534e8-kube-api-access-jzdxb\") pod \"ovnkube-node-9x6v7\" (UID: \"a447431c-750b-4ed2-b229-59acbc3534e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7"
Jun 08 11:48:01.121724 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.121704    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a447431c-750b-4ed2-b229-59acbc3534e8-host-kubelet\") pod \"ovnkube-node-9x6v7\" (UID: \"a447431c-750b-4ed2-b229-59acbc3534e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7"
Jun 08 11:48:01.121874 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.121727    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a447431c-750b-4ed2-b229-59acbc3534e8-run-openvswitch\") pod \"ovnkube-node-9x6v7\" (UID: \"a447431c-750b-4ed2-b229-59acbc3534e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7"
Jun 08 11:48:01.121874 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.121747    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a447431c-750b-4ed2-b229-59acbc3534e8-log-socket\") pod \"ovnkube-node-9x6v7\" (UID: \"a447431c-750b-4ed2-b229-59acbc3534e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7"
Jun 08 11:48:01.121874 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.121767    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a447431c-750b-4ed2-b229-59acbc3534e8-host-cni-netd\") pod \"ovnkube-node-9x6v7\" (UID: \"a447431c-750b-4ed2-b229-59acbc3534e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7"
Jun 08 11:48:01.121874 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.121788    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ad420f23-b7b2-45a6-ad9a-118f28203f03-etc-sysctl-d\") pod \"tuned-pm229\" (UID: \"ad420f23-b7b2-45a6-ad9a-118f28203f03\") " pod="openshift-cluster-node-tuning-operator/tuned-pm229"
Jun 08 11:48:01.121874 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.121811    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ad420f23-b7b2-45a6-ad9a-118f28203f03-lib-modules\") pod \"tuned-pm229\" (UID: \"ad420f23-b7b2-45a6-ad9a-118f28203f03\") " pod="openshift-cluster-node-tuning-operator/tuned-pm229"
Jun 08 11:48:01.121874 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.121834    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7cbbb77-d234-4a11-811c-26a8a21019df-tmp-dir\") pod \"node-resolver-dmbw7\" (UID: \"f7cbbb77-d234-4a11-811c-26a8a21019df\") " pod="openshift-dns/node-resolver-dmbw7"
Jun 08 11:48:01.121874 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.121856    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a447431c-750b-4ed2-b229-59acbc3534e8-etc-openvswitch\") pod \"ovnkube-node-9x6v7\" (UID: \"a447431c-750b-4ed2-b229-59acbc3534e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7"
Jun 08 11:48:01.122253 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.121897    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6lmj4\""
Jun 08 11:48:01.122253 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.121899    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a447431c-750b-4ed2-b229-59acbc3534e8-run-ovn\") pod \"ovnkube-node-9x6v7\" (UID: \"a447431c-750b-4ed2-b229-59acbc3534e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7"
Jun 08 11:48:01.122253 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.121932    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/445c0f3b-b186-4d9d-befd-0d1bb215799d-etc-selinux\") pod \"aws-ebs-csi-driver-node-qzh85\" (UID: \"445c0f3b-b186-4d9d-befd-0d1bb215799d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzh85"
Jun 08 11:48:01.122253 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.121941    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jun 08 11:48:01.122253 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.121958    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ad420f23-b7b2-45a6-ad9a-118f28203f03-etc-systemd\") pod \"tuned-pm229\" (UID: \"ad420f23-b7b2-45a6-ad9a-118f28203f03\") " pod="openshift-cluster-node-tuning-operator/tuned-pm229"
Jun 08 11:48:01.122253 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.121999    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ad420f23-b7b2-45a6-ad9a-118f28203f03-sys\") pod \"tuned-pm229\" (UID: \"ad420f23-b7b2-45a6-ad9a-118f28203f03\") " pod="openshift-cluster-node-tuning-operator/tuned-pm229"
Jun 08 11:48:01.122253 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.122020    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad420f23-b7b2-45a6-ad9a-118f28203f03-tmp\") pod \"tuned-pm229\" (UID: \"ad420f23-b7b2-45a6-ad9a-118f28203f03\") " pod="openshift-cluster-node-tuning-operator/tuned-pm229"
Jun 08 11:48:01.122253 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.122042    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a447431c-750b-4ed2-b229-59acbc3534e8-node-log\") pod \"ovnkube-node-9x6v7\" (UID: \"a447431c-750b-4ed2-b229-59acbc3534e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7"
Jun 08 11:48:01.122253 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.122080    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a447431c-750b-4ed2-b229-59acbc3534e8-host-run-ovn-kubernetes\") pod \"ovnkube-node-9x6v7\" (UID: \"a447431c-750b-4ed2-b229-59acbc3534e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7"
Jun 08 11:48:01.122253 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.122105    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a447431c-750b-4ed2-b229-59acbc3534e8-host-cni-bin\") pod \"ovnkube-node-9x6v7\" (UID: \"a447431c-750b-4ed2-b229-59acbc3534e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7"
Jun 08 11:48:01.122253 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.122229    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ad420f23-b7b2-45a6-ad9a-118f28203f03-etc-sysconfig\") pod \"tuned-pm229\" (UID: \"ad420f23-b7b2-45a6-ad9a-118f28203f03\") " pod="openshift-cluster-node-tuning-operator/tuned-pm229"
Jun 08 11:48:01.122253 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.122240    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dplqn"
Jun 08 11:48:01.122253 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.122256    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ad420f23-b7b2-45a6-ad9a-118f28203f03-run\") pod \"tuned-pm229\" (UID: \"ad420f23-b7b2-45a6-ad9a-118f28203f03\") " pod="openshift-cluster-node-tuning-operator/tuned-pm229"
Jun 08 11:48:01.122867 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.122282    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a447431c-750b-4ed2-b229-59acbc3534e8-var-lib-openvswitch\") pod \"ovnkube-node-9x6v7\" (UID: \"a447431c-750b-4ed2-b229-59acbc3534e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7"
Jun 08 11:48:01.122867 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.122106    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jun 08 11:48:01.122867 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.122797    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a447431c-750b-4ed2-b229-59acbc3534e8-ovnkube-script-lib\") pod \"ovnkube-node-9x6v7\" (UID: \"a447431c-750b-4ed2-b229-59acbc3534e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7"
Jun 08 11:48:01.122997 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.122874    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/445c0f3b-b186-4d9d-befd-0d1bb215799d-sys-fs\") pod \"aws-ebs-csi-driver-node-qzh85\" (UID: \"445c0f3b-b186-4d9d-befd-0d1bb215799d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzh85"
Jun 08 11:48:01.122997 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.122940    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkmgr\" (UniqueName: \"kubernetes.io/projected/445c0f3b-b186-4d9d-befd-0d1bb215799d-kube-api-access-wkmgr\") pod \"aws-ebs-csi-driver-node-qzh85\" (UID: \"445c0f3b-b186-4d9d-befd-0d1bb215799d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzh85"
Jun 08 11:48:01.123192 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.123155    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad420f23-b7b2-45a6-ad9a-118f28203f03-etc-kubernetes\") pod \"tuned-pm229\" (UID: \"ad420f23-b7b2-45a6-ad9a-118f28203f03\") " pod="openshift-cluster-node-tuning-operator/tuned-pm229"
Jun 08 11:48:01.123256 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.123191    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/445c0f3b-b186-4d9d-befd-0d1bb215799d-socket-dir\") pod \"aws-ebs-csi-driver-node-qzh85\" (UID: \"445c0f3b-b186-4d9d-befd-0d1bb215799d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzh85"
Jun 08 11:48:01.123256 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.123219    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a447431c-750b-4ed2-b229-59acbc3534e8-ovnkube-config\") pod \"ovnkube-node-9x6v7\" (UID: \"a447431c-750b-4ed2-b229-59acbc3534e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7"
Jun 08 11:48:01.123256 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.123247    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a447431c-750b-4ed2-b229-59acbc3534e8-env-overrides\") pod \"ovnkube-node-9x6v7\" (UID: \"a447431c-750b-4ed2-b229-59acbc3534e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7"
Jun 08 11:48:01.123392 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.123274    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a447431c-750b-4ed2-b229-59acbc3534e8-ovn-node-metrics-cert\") pod \"ovnkube-node-9x6v7\" (UID: \"a447431c-750b-4ed2-b229-59acbc3534e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7"
Jun 08 11:48:01.123748 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.123565    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/445c0f3b-b186-4d9d-befd-0d1bb215799d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qzh85\" (UID: \"445c0f3b-b186-4d9d-befd-0d1bb215799d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzh85"
Jun 08 11:48:01.123748 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.123625    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/445c0f3b-b186-4d9d-befd-0d1bb215799d-registration-dir\") pod \"aws-ebs-csi-driver-node-qzh85\" (UID: \"445c0f3b-b186-4d9d-befd-0d1bb215799d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzh85"
Jun 08 11:48:01.123748 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.123706    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ad420f23-b7b2-45a6-ad9a-118f28203f03-host\") pod \"tuned-pm229\" (UID: \"ad420f23-b7b2-45a6-ad9a-118f28203f03\") " pod="openshift-cluster-node-tuning-operator/tuned-pm229"
Jun 08 11:48:01.123919 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.123815    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svf4l\" (UniqueName: \"kubernetes.io/projected/ad420f23-b7b2-45a6-ad9a-118f28203f03-kube-api-access-svf4l\") pod \"tuned-pm229\" (UID: \"ad420f23-b7b2-45a6-ad9a-118f28203f03\") " pod="openshift-cluster-node-tuning-operator/tuned-pm229"
Jun 08 11:48:01.123970 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.123921    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a447431c-750b-4ed2-b229-59acbc3534e8-systemd-units\") pod \"ovnkube-node-9x6v7\" (UID: \"a447431c-750b-4ed2-b229-59acbc3534e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7"
Jun 08 11:48:01.123970 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.123955    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a447431c-750b-4ed2-b229-59acbc3534e8-host-slash\") pod \"ovnkube-node-9x6v7\" (UID: \"a447431c-750b-4ed2-b229-59acbc3534e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7"
Jun 08 11:48:01.124080 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.123990    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a447431c-750b-4ed2-b229-59acbc3534e8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9x6v7\" (UID: \"a447431c-750b-4ed2-b229-59acbc3534e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7"
Jun 08 11:48:01.124080 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.124017    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ad420f23-b7b2-45a6-ad9a-118f28203f03-etc-modprobe-d\") pod \"tuned-pm229\" (UID: \"ad420f23-b7b2-45a6-ad9a-118f28203f03\") " pod="openshift-cluster-node-tuning-operator/tuned-pm229"
Jun 08 11:48:01.124186 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.124152    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ad420f23-b7b2-45a6-ad9a-118f28203f03-etc-sysctl-conf\") pod \"tuned-pm229\" (UID: \"ad420f23-b7b2-45a6-ad9a-118f28203f03\") " pod="openshift-cluster-node-tuning-operator/tuned-pm229"
Jun 08 11:48:01.124238 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.124218    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad420f23-b7b2-45a6-ad9a-118f28203f03-var-lib-kubelet\") pod \"tuned-pm229\" (UID: \"ad420f23-b7b2-45a6-ad9a-118f28203f03\") " pod="openshift-cluster-node-tuning-operator/tuned-pm229"
Jun 08 11:48:01.124283 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.124256    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b2281a3-722f-4113-b3e1-7f4b4614f599-metrics-certs\") pod \"network-metrics-daemon-6m4cb\" (UID: \"0b2281a3-722f-4113-b3e1-7f4b4614f599\") " pod="openshift-multus/network-metrics-daemon-6m4cb"
Jun 08 11:48:01.124435 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.124299    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btqw7\" (UniqueName: \"kubernetes.io/projected/0b2281a3-722f-4113-b3e1-7f4b4614f599-kube-api-access-btqw7\") pod \"network-metrics-daemon-6m4cb\" (UID: \"0b2281a3-722f-4113-b3e1-7f4b4614f599\") " pod="openshift-multus/network-metrics-daemon-6m4cb"
Jun 08 11:48:01.124495 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.124455    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62csw\" (UniqueName: \"kubernetes.io/projected/3b153dca-66ed-4681-b70b-6061158f6676-kube-api-access-62csw\") pod \"network-check-target-rx5rz\" (UID: \"3b153dca-66ed-4681-b70b-6061158f6676\") " pod="openshift-network-diagnostics/network-check-target-rx5rz"
Jun 08 11:48:01.124544 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.124490    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/445c0f3b-b186-4d9d-befd-0d1bb215799d-device-dir\") pod \"aws-ebs-csi-driver-node-qzh85\" (UID: \"445c0f3b-b186-4d9d-befd-0d1bb215799d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzh85"
Jun 08 11:48:01.124544 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.124527    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ad420f23-b7b2-45a6-ad9a-118f28203f03-etc-tuned\") pod \"tuned-pm229\" (UID: \"ad420f23-b7b2-45a6-ad9a-118f28203f03\") " pod="openshift-cluster-node-tuning-operator/tuned-pm229"
Jun 08 11:48:01.124631 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.124561    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f7cbbb77-d234-4a11-811c-26a8a21019df-hosts-file\") pod \"node-resolver-dmbw7\" (UID: \"f7cbbb77-d234-4a11-811c-26a8a21019df\") " pod="openshift-dns/node-resolver-dmbw7"
Jun 08 11:48:01.124732 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.124716    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-554rp\" (UniqueName: \"kubernetes.io/projected/f7cbbb77-d234-4a11-811c-26a8a21019df-kube-api-access-554rp\") pod \"node-resolver-dmbw7\" (UID: \"f7cbbb77-d234-4a11-811c-26a8a21019df\") " pod="openshift-dns/node-resolver-dmbw7"
Jun 08 11:48:01.124944 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.124925    2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 08 11:48:01.125454 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.125435    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jun 08 11:48:01.125958 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.125939    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jun 08 11:48:01.127410 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.127112    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vvdrj\""
Jun 08 11:48:01.127410 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.127160    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jun 08 11:48:01.127410 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.127184    2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 08 11:48:01.128022 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.127969    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bzgvn"
Jun 08 11:48:01.130900 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.130883    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-f4gdp"
Jun 08 11:48:01.131355 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.131337    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jun 08 11:48:01.131610 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.131591    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jun 08 11:48:01.131708 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.131614    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-4nm4g\""
Jun 08 11:48:01.131708 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.131681    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jun 08 11:48:01.133377 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.133359    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jun 08 11:48:01.133634 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.133619    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jun 08 11:48:01.133708 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.133625    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jun 08 11:48:01.133815 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.133783    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-tfv65\""
Jun 08 11:48:01.212423 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.212399    2583 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jun 08 11:48:01.225154 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.225124    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/40910c2e-803d-4cf1-9451-917a8d88f182-cni-binary-copy\") pod \"multus-additional-cni-plugins-bzgvn\" (UID: \"40910c2e-803d-4cf1-9451-917a8d88f182\") " pod="openshift-multus/multus-additional-cni-plugins-bzgvn"
Jun 08 11:48:01.225310 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.225175    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b2281a3-722f-4113-b3e1-7f4b4614f599-metrics-certs\") pod \"network-metrics-daemon-6m4cb\" (UID: \"0b2281a3-722f-4113-b3e1-7f4b4614f599\") " pod="openshift-multus/network-metrics-daemon-6m4cb"
Jun 08 11:48:01.225310 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.225211    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btqw7\" (UniqueName: \"kubernetes.io/projected/0b2281a3-722f-4113-b3e1-7f4b4614f599-kube-api-access-btqw7\") pod \"network-metrics-daemon-6m4cb\" (UID: \"0b2281a3-722f-4113-b3e1-7f4b4614f599\") " pod="openshift-multus/network-metrics-daemon-6m4cb"
Jun 08 11:48:01.225310 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.225236    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/445c0f3b-b186-4d9d-befd-0d1bb215799d-device-dir\") pod \"aws-ebs-csi-driver-node-qzh85\" (UID: \"445c0f3b-b186-4d9d-befd-0d1bb215799d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzh85"
Jun 08 11:48:01.225310 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.225264    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f7cbbb77-d234-4a11-811c-26a8a21019df-hosts-file\") pod \"node-resolver-dmbw7\" (UID: \"f7cbbb77-d234-4a11-811c-26a8a21019df\") " pod="openshift-dns/node-resolver-dmbw7"
Jun 08 11:48:01.225310 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:01.225267    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 08 11:48:01.225595 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.225333    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/445c0f3b-b186-4d9d-befd-0d1bb215799d-device-dir\") pod \"aws-ebs-csi-driver-node-qzh85\" (UID: \"445c0f3b-b186-4d9d-befd-0d1bb215799d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzh85"
Jun 08 11:48:01.225595 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:01.225395    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b2281a3-722f-4113-b3e1-7f4b4614f599-metrics-certs podName:0b2281a3-722f-4113-b3e1-7f4b4614f599 nodeName:}" failed. No retries permitted until 2026-06-08 11:48:01.725345462 +0000 UTC m=+2.996920636 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b2281a3-722f-4113-b3e1-7f4b4614f599-metrics-certs") pod "network-metrics-daemon-6m4cb" (UID: "0b2281a3-722f-4113-b3e1-7f4b4614f599") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 08 11:48:01.225595 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.225395    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f7cbbb77-d234-4a11-811c-26a8a21019df-hosts-file\") pod \"node-resolver-dmbw7\" (UID: \"f7cbbb77-d234-4a11-811c-26a8a21019df\") " pod="openshift-dns/node-resolver-dmbw7"
Jun 08 11:48:01.225595 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.225419    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-554rp\" (UniqueName: \"kubernetes.io/projected/f7cbbb77-d234-4a11-811c-26a8a21019df-kube-api-access-554rp\") pod \"node-resolver-dmbw7\" (UID: \"f7cbbb77-d234-4a11-811c-26a8a21019df\") " pod="openshift-dns/node-resolver-dmbw7"
Jun 08 11:48:01.225595 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.225451    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fe7bc26d-99a1-4168-996f-f3322e778ed5-system-cni-dir\") pod \"multus-f4gdp\" (UID: \"fe7bc26d-99a1-4168-996f-f3322e778ed5\") " pod="openshift-multus/multus-f4gdp"
Jun 08 11:48:01.225595 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.225480    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a447431c-750b-4ed2-b229-59acbc3534e8-host-run-netns\") pod \"ovnkube-node-9x6v7\" (UID: \"a447431c-750b-4ed2-b229-59acbc3534e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7"
Jun 08 11:48:01.225595 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.225508    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a447431c-750b-4ed2-b229-59acbc3534e8-run-systemd\") pod \"ovnkube-node-9x6v7\" (UID: \"a447431c-750b-4ed2-b229-59acbc3534e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7"
Jun 08 11:48:01.225595 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.225552    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzdxb\" (UniqueName: \"kubernetes.io/projected/a447431c-750b-4ed2-b229-59acbc3534e8-kube-api-access-jzdxb\") pod \"ovnkube-node-9x6v7\" (UID: \"a447431c-750b-4ed2-b229-59acbc3534e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7"
Jun 08 11:48:01.225595 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.225582    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fe7bc26d-99a1-4168-996f-f3322e778ed5-cnibin\") pod \"multus-f4gdp\" (UID: \"fe7bc26d-99a1-4168-996f-f3322e778ed5\") " pod="openshift-multus/multus-f4gdp"
Jun 08 11:48:01.225916 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.225600    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a447431c-750b-4ed2-b229-59acbc3534e8-run-systemd\") pod \"ovnkube-node-9x6v7\" (UID: \"a447431c-750b-4ed2-b229-59acbc3534e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7"
Jun 08 11:48:01.225916 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.225552    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a447431c-750b-4ed2-b229-59acbc3534e8-host-run-netns\") pod \"ovnkube-node-9x6v7\" (UID: \"a447431c-750b-4ed2-b229-59acbc3534e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7"
Jun 08 11:48:01.225916 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.225607    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fe7bc26d-99a1-4168-996f-f3322e778ed5-cni-binary-copy\") pod \"multus-f4gdp\" (UID: \"fe7bc26d-99a1-4168-996f-f3322e778ed5\") " pod="openshift-multus/multus-f4gdp"
Jun 08 11:48:01.225916 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.225686    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtmkg\" (UniqueName: \"kubernetes.io/projected/fe7bc26d-99a1-4168-996f-f3322e778ed5-kube-api-access-vtmkg\") pod \"multus-f4gdp\" (UID: \"fe7bc26d-99a1-4168-996f-f3322e778ed5\") " pod="openshift-multus/multus-f4gdp"
Jun 08 11:48:01.225916 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.225718    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/40910c2e-803d-4cf1-9451-917a8d88f182-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bzgvn\" (UID: \"40910c2e-803d-4cf1-9451-917a8d88f182\") " pod="openshift-multus/multus-additional-cni-plugins-bzgvn"
Jun 08 11:48:01.225916 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.225753    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a447431c-750b-4ed2-b229-59acbc3534e8-run-openvswitch\") pod \"ovnkube-node-9x6v7\" (UID: \"a447431c-750b-4ed2-b229-59acbc3534e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7"
Jun 08 11:48:01.225916 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.225799    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a447431c-750b-4ed2-b229-59acbc3534e8-log-socket\") pod \"ovnkube-node-9x6v7\" (UID: \"a447431c-750b-4ed2-b229-59acbc3534e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7"
Jun 08 11:48:01.225916 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.225825    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a447431c-750b-4ed2-b229-59acbc3534e8-run-openvswitch\") pod \"ovnkube-node-9x6v7\" (UID: \"a447431c-750b-4ed2-b229-59acbc3534e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7"
Jun 08 11:48:01.225916 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.225827    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a447431c-750b-4ed2-b229-59acbc3534e8-host-cni-netd\") pod \"ovnkube-node-9x6v7\" (UID: \"a447431c-750b-4ed2-b229-59acbc3534e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7"
Jun 08 11:48:01.225916 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.225854    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ad420f23-b7b2-45a6-ad9a-118f28203f03-etc-sysctl-d\") pod \"tuned-pm229\" (UID: \"ad420f23-b7b2-45a6-ad9a-118f28203f03\") " pod="openshift-cluster-node-tuning-operator/tuned-pm229"
Jun 08 11:48:01.225916 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.225875    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7cbbb77-d234-4a11-811c-26a8a21019df-tmp-dir\") pod \"node-resolver-dmbw7\" (UID: \"f7cbbb77-d234-4a11-811c-26a8a21019df\") " pod="openshift-dns/node-resolver-dmbw7"
Jun 08 11:48:01.225916 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.225879    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a447431c-750b-4ed2-b229-59acbc3534e8-log-socket\") pod \"ovnkube-node-9x6v7\" (UID: \"a447431c-750b-4ed2-b229-59acbc3534e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7"
Jun 08 11:48:01.225916 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.225898    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/42241258-7f82-4c8b-9862-4a32ddfcf5f2-host\") pod \"node-ca-ps66l\" (UID: \"42241258-7f82-4c8b-9862-4a32ddfcf5f2\") " pod="openshift-image-registry/node-ca-ps66l"
Jun 08 11:48:01.226377 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.225921    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2lsr\" (UniqueName: \"kubernetes.io/projected/4866962b-3c74-43c5-a2eb-fa8209ebeba3-kube-api-access-n2lsr\") pod \"iptables-alerter-dplqn\" (UID: \"4866962b-3c74-43c5-a2eb-fa8209ebeba3\") " pod="openshift-network-operator/iptables-alerter-dplqn"
Jun 08 11:48:01.226377 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.225924    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a447431c-750b-4ed2-b229-59acbc3534e8-host-cni-netd\") pod \"ovnkube-node-9x6v7\" (UID: \"a447431c-750b-4ed2-b229-59acbc3534e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7"
Jun 08 11:48:01.226377 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.225945    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a447431c-750b-4ed2-b229-59acbc3534e8-etc-openvswitch\") pod \"ovnkube-node-9x6v7\" (UID: \"a447431c-750b-4ed2-b229-59acbc3534e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7"
Jun 08 11:48:01.226377 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.225989    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a447431c-750b-4ed2-b229-59acbc3534e8-etc-openvswitch\") pod \"ovnkube-node-9x6v7\" (UID: \"a447431c-750b-4ed2-b229-59acbc3534e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7"
Jun 08 11:48:01.226377 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.225992    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ad420f23-b7b2-45a6-ad9a-118f28203f03-etc-sysctl-d\") pod \"tuned-pm229\" (UID: \"ad420f23-b7b2-45a6-ad9a-118f28203f03\") " pod="openshift-cluster-node-tuning-operator/tuned-pm229"
Jun 08 11:48:01.226377 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.226030    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/445c0f3b-b186-4d9d-befd-0d1bb215799d-etc-selinux\") pod \"aws-ebs-csi-driver-node-qzh85\" (UID: \"445c0f3b-b186-4d9d-befd-0d1bb215799d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzh85"
Jun 08 11:48:01.226377 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.226094    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad420f23-b7b2-45a6-ad9a-118f28203f03-tmp\") pod \"tuned-pm229\" (UID: \"ad420f23-b7b2-45a6-ad9a-118f28203f03\") " pod="openshift-cluster-node-tuning-operator/tuned-pm229"
Jun 08 11:48:01.226377 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.226120    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fe7bc26d-99a1-4168-996f-f3322e778ed5-etc-kubernetes\") pod \"multus-f4gdp\" (UID: \"fe7bc26d-99a1-4168-996f-f3322e778ed5\") " pod="openshift-multus/multus-f4gdp"
Jun 08 11:48:01.226377 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.226163    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a447431c-750b-4ed2-b229-59acbc3534e8-host-run-ovn-kubernetes\") pod \"ovnkube-node-9x6v7\" (UID: \"a447431c-750b-4ed2-b229-59acbc3534e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7"
Jun 08 11:48:01.226377 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.226184    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ad420f23-b7b2-45a6-ad9a-118f28203f03-run\") pod \"tuned-pm229\" (UID: \"ad420f23-b7b2-45a6-ad9a-118f28203f03\") " pod="openshift-cluster-node-tuning-operator/tuned-pm229"
Jun 08 11:48:01.226377 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.226205    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fe7bc26d-99a1-4168-996f-f3322e778ed5-multus-conf-dir\") pod \"multus-f4gdp\" (UID: \"fe7bc26d-99a1-4168-996f-f3322e778ed5\") " pod="openshift-multus/multus-f4gdp"
Jun 08 11:48:01.226377 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.226205    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/445c0f3b-b186-4d9d-befd-0d1bb215799d-etc-selinux\") pod \"aws-ebs-csi-driver-node-qzh85\" (UID: \"445c0f3b-b186-4d9d-befd-0d1bb215799d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzh85"
Jun 08 11:48:01.226377 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.226229    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/40910c2e-803d-4cf1-9451-917a8d88f182-system-cni-dir\") pod \"multus-additional-cni-plugins-bzgvn\" (UID: \"40910c2e-803d-4cf1-9451-917a8d88f182\") " pod="openshift-multus/multus-additional-cni-plugins-bzgvn"
Jun 08 11:48:01.226377 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.226243    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a447431c-750b-4ed2-b229-59acbc3534e8-host-run-ovn-kubernetes\") pod \"ovnkube-node-9x6v7\" (UID: \"a447431c-750b-4ed2-b229-59acbc3534e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7"
Jun 08 11:48:01.226377 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.226271    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/40910c2e-803d-4cf1-9451-917a8d88f182-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bzgvn\" (UID: \"40910c2e-803d-4cf1-9451-917a8d88f182\") " pod="openshift-multus/multus-additional-cni-plugins-bzgvn"
Jun 08 11:48:01.226377 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.226285    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ad420f23-b7b2-45a6-ad9a-118f28203f03-run\") pod \"tuned-pm229\" (UID: \"ad420f23-b7b2-45a6-ad9a-118f28203f03\") " pod="openshift-cluster-node-tuning-operator/tuned-pm229"
Jun 08 11:48:01.226377 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.226303    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a447431c-750b-4ed2-b229-59acbc3534e8-ovnkube-script-lib\") pod \"ovnkube-node-9x6v7\" (UID: \"a447431c-750b-4ed2-b229-59acbc3534e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7"
Jun 08 11:48:01.227136 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.226279    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7cbbb77-d234-4a11-811c-26a8a21019df-tmp-dir\") pod \"node-resolver-dmbw7\" (UID: \"f7cbbb77-d234-4a11-811c-26a8a21019df\") " pod="openshift-dns/node-resolver-dmbw7"
Jun 08 11:48:01.227136 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.226330    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/445c0f3b-b186-4d9d-befd-0d1bb215799d-sys-fs\") pod \"aws-ebs-csi-driver-node-qzh85\" (UID: \"445c0f3b-b186-4d9d-befd-0d1bb215799d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzh85"
Jun 08 11:48:01.227136 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.226380    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkmgr\" (UniqueName: \"kubernetes.io/projected/445c0f3b-b186-4d9d-befd-0d1bb215799d-kube-api-access-wkmgr\") pod \"aws-ebs-csi-driver-node-qzh85\" (UID: \"445c0f3b-b186-4d9d-befd-0d1bb215799d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzh85"
Jun 08 11:48:01.227136 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.226399    2583 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jun 08 11:48:01.227136 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.226409    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/445c0f3b-b186-4d9d-befd-0d1bb215799d-sys-fs\") pod \"aws-ebs-csi-driver-node-qzh85\" (UID: \"445c0f3b-b186-4d9d-befd-0d1bb215799d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzh85"
Jun 08 11:48:01.227136 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.226406    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad420f23-b7b2-45a6-ad9a-118f28203f03-etc-kubernetes\") pod \"tuned-pm229\" (UID: \"ad420f23-b7b2-45a6-ad9a-118f28203f03\") " pod="openshift-cluster-node-tuning-operator/tuned-pm229"
Jun 08 11:48:01.227136 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.226448    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad420f23-b7b2-45a6-ad9a-118f28203f03-etc-kubernetes\") pod \"tuned-pm229\" (UID: \"ad420f23-b7b2-45a6-ad9a-118f28203f03\") " pod="openshift-cluster-node-tuning-operator/tuned-pm229"
Jun 08 11:48:01.227136 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.226463    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/42241258-7f82-4c8b-9862-4a32ddfcf5f2-serviceca\") pod \"node-ca-ps66l\" (UID: \"42241258-7f82-4c8b-9862-4a32ddfcf5f2\") " pod="openshift-image-registry/node-ca-ps66l"
Jun 08 11:48:01.227136 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.226490    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4866962b-3c74-43c5-a2eb-fa8209ebeba3-host-slash\") pod \"iptables-alerter-dplqn\" (UID: \"4866962b-3c74-43c5-a2eb-fa8209ebeba3\") " pod="openshift-network-operator/iptables-alerter-dplqn"
Jun 08 11:48:01.227136 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.226511    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2579f4ef-e90c-4da0-9617-9ba892dba6ef-kubelet-config\") pod \"global-pull-secret-syncer-c6hh2\" (UID: \"2579f4ef-e90c-4da0-9617-9ba892dba6ef\") " pod="kube-system/global-pull-secret-syncer-c6hh2"
Jun 08 11:48:01.227136 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.226539    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/445c0f3b-b186-4d9d-befd-0d1bb215799d-socket-dir\") pod \"aws-ebs-csi-driver-node-qzh85\" (UID: \"445c0f3b-b186-4d9d-befd-0d1bb215799d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzh85"
Jun 08 11:48:01.227136 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.226563    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a447431c-750b-4ed2-b229-59acbc3534e8-env-overrides\") pod \"ovnkube-node-9x6v7\" (UID: \"a447431c-750b-4ed2-b229-59acbc3534e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7"
Jun 08 11:48:01.227136 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.226594    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svf4l\" (UniqueName: \"kubernetes.io/projected/ad420f23-b7b2-45a6-ad9a-118f28203f03-kube-api-access-svf4l\") pod \"tuned-pm229\" (UID: \"ad420f23-b7b2-45a6-ad9a-118f28203f03\") " pod="openshift-cluster-node-tuning-operator/tuned-pm229"
Jun 08 11:48:01.227136 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.226623    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fe7bc26d-99a1-4168-996f-f3322e778ed5-os-release\") pod \"multus-f4gdp\" (UID: \"fe7bc26d-99a1-4168-996f-f3322e778ed5\") " pod="openshift-multus/multus-f4gdp"
Jun 08 11:48:01.227136 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.226728    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/445c0f3b-b186-4d9d-befd-0d1bb215799d-socket-dir\") pod \"aws-ebs-csi-driver-node-qzh85\" (UID: \"445c0f3b-b186-4d9d-befd-0d1bb215799d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzh85"
Jun 08 11:48:01.227136 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.226741    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fe7bc26d-99a1-4168-996f-f3322e778ed5-multus-socket-dir-parent\") pod \"multus-f4gdp\" (UID: \"fe7bc26d-99a1-4168-996f-f3322e778ed5\") " pod="openshift-multus/multus-f4gdp"
Jun 08 11:48:01.227136 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.226788    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fe7bc26d-99a1-4168-996f-f3322e778ed5-hostroot\") pod \"multus-f4gdp\" (UID: \"fe7bc26d-99a1-4168-996f-f3322e778ed5\") " pod="openshift-multus/multus-f4gdp"
Jun 08 11:48:01.227848 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.226812    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/40910c2e-803d-4cf1-9451-917a8d88f182-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bzgvn\" (UID: \"40910c2e-803d-4cf1-9451-917a8d88f182\") " pod="openshift-multus/multus-additional-cni-plugins-bzgvn"
Jun 08 11:48:01.227848 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.226837    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a447431c-750b-4ed2-b229-59acbc3534e8-systemd-units\") pod \"ovnkube-node-9x6v7\" (UID: \"a447431c-750b-4ed2-b229-59acbc3534e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7"
Jun 08 11:48:01.227848 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.226863    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fe7bc26d-99a1-4168-996f-f3322e778ed5-multus-cni-dir\") pod \"multus-f4gdp\" (UID: \"fe7bc26d-99a1-4168-996f-f3322e778ed5\") " pod="openshift-multus/multus-f4gdp"
Jun 08 11:48:01.227848 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.226884    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a447431c-750b-4ed2-b229-59acbc3534e8-systemd-units\") pod \"ovnkube-node-9x6v7\" (UID: \"a447431c-750b-4ed2-b229-59acbc3534e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7"
Jun 08 11:48:01.227848 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.226891    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a447431c-750b-4ed2-b229-59acbc3534e8-ovnkube-script-lib\") pod \"ovnkube-node-9x6v7\" (UID: \"a447431c-750b-4ed2-b229-59acbc3534e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7"
Jun 08 11:48:01.227848 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.226888    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fe7bc26d-99a1-4168-996f-f3322e778ed5-host-var-lib-kubelet\") pod \"multus-f4gdp\" (UID: \"fe7bc26d-99a1-4168-996f-f3322e778ed5\") " pod="openshift-multus/multus-f4gdp"
Jun 08 11:48:01.227848 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.226929    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-969c6\" (UniqueName: \"kubernetes.io/projected/40910c2e-803d-4cf1-9451-917a8d88f182-kube-api-access-969c6\") pod \"multus-additional-cni-plugins-bzgvn\" (UID: \"40910c2e-803d-4cf1-9451-917a8d88f182\") " pod="openshift-multus/multus-additional-cni-plugins-bzgvn"
Jun 08 11:48:01.227848 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.226958    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62csw\" (UniqueName: \"kubernetes.io/projected/3b153dca-66ed-4681-b70b-6061158f6676-kube-api-access-62csw\") pod \"network-check-target-rx5rz\" (UID: \"3b153dca-66ed-4681-b70b-6061158f6676\") " pod="openshift-network-diagnostics/network-check-target-rx5rz"
Jun 08 11:48:01.227848 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.226989    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ad420f23-b7b2-45a6-ad9a-118f28203f03-etc-tuned\") pod \"tuned-pm229\" (UID: \"ad420f23-b7b2-45a6-ad9a-118f28203f03\") " pod="openshift-cluster-node-tuning-operator/tuned-pm229"
Jun 08 11:48:01.227848 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.226995    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a447431c-750b-4ed2-b229-59acbc3534e8-env-overrides\") pod \"ovnkube-node-9x6v7\" (UID: \"a447431c-750b-4ed2-b229-59acbc3534e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7"
Jun 08 11:48:01.227848 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.227088    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fe7bc26d-99a1-4168-996f-f3322e778ed5-multus-daemon-config\") pod \"multus-f4gdp\" (UID: \"fe7bc26d-99a1-4168-996f-f3322e778ed5\") " pod="openshift-multus/multus-f4gdp"
Jun 08 11:48:01.227848 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.227140    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2579f4ef-e90c-4da0-9617-9ba892dba6ef-dbus\") pod \"global-pull-secret-syncer-c6hh2\" (UID: \"2579f4ef-e90c-4da0-9617-9ba892dba6ef\") " pod="kube-system/global-pull-secret-syncer-c6hh2"
Jun 08 11:48:01.227848 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.227177    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2579f4ef-e90c-4da0-9617-9ba892dba6ef-original-pull-secret\") pod \"global-pull-secret-syncer-c6hh2\" (UID: \"2579f4ef-e90c-4da0-9617-9ba892dba6ef\") " pod="kube-system/global-pull-secret-syncer-c6hh2"
Jun 08 11:48:01.227848 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.227193    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4866962b-3c74-43c5-a2eb-fa8209ebeba3-iptables-alerter-script\") pod \"iptables-alerter-dplqn\" (UID: \"4866962b-3c74-43c5-a2eb-fa8209ebeba3\") " pod="openshift-network-operator/iptables-alerter-dplqn"
Jun 08 11:48:01.227848 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.227212    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a447431c-750b-4ed2-b229-59acbc3534e8-host-kubelet\") pod \"ovnkube-node-9x6v7\" (UID: \"a447431c-750b-4ed2-b229-59acbc3534e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7"
Jun 08 11:48:01.227848 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.227246    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ad420f23-b7b2-45a6-ad9a-118f28203f03-lib-modules\") pod \"tuned-pm229\" (UID: \"ad420f23-b7b2-45a6-ad9a-118f28203f03\") " pod="openshift-cluster-node-tuning-operator/tuned-pm229"
Jun 08 11:48:01.227848 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.227269    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a447431c-750b-4ed2-b229-59acbc3534e8-host-kubelet\") pod \"ovnkube-node-9x6v7\" (UID: \"a447431c-750b-4ed2-b229-59acbc3534e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7"
Jun 08 11:48:01.228651 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.227278    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5ba152b0-fb41-414a-a375-ae9ae8f60d2a-agent-certs\") pod \"konnectivity-agent-vxkpp\" (UID: \"5ba152b0-fb41-414a-a375-ae9ae8f60d2a\") " pod="kube-system/konnectivity-agent-vxkpp"
Jun 08 11:48:01.228651 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.227304    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a447431c-750b-4ed2-b229-59acbc3534e8-run-ovn\") pod \"ovnkube-node-9x6v7\" (UID: \"a447431c-750b-4ed2-b229-59acbc3534e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7"
Jun 08 11:48:01.228651 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.227330    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ad420f23-b7b2-45a6-ad9a-118f28203f03-etc-systemd\") pod \"tuned-pm229\" (UID: \"ad420f23-b7b2-45a6-ad9a-118f28203f03\") " pod="openshift-cluster-node-tuning-operator/tuned-pm229"
Jun 08 11:48:01.228651 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.227359    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ad420f23-b7b2-45a6-ad9a-118f28203f03-sys\") pod \"tuned-pm229\" (UID: \"ad420f23-b7b2-45a6-ad9a-118f28203f03\") " pod="openshift-cluster-node-tuning-operator/tuned-pm229"
Jun 08 11:48:01.228651 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.227381    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ad420f23-b7b2-45a6-ad9a-118f28203f03-lib-modules\") pod \"tuned-pm229\" (UID: \"ad420f23-b7b2-45a6-ad9a-118f28203f03\") " pod="openshift-cluster-node-tuning-operator/tuned-pm229"
Jun 08 11:48:01.228651 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.227394    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ad420f23-b7b2-45a6-ad9a-118f28203f03-etc-systemd\") pod \"tuned-pm229\" (UID: \"ad420f23-b7b2-45a6-ad9a-118f28203f03\") " pod="openshift-cluster-node-tuning-operator/tuned-pm229"
Jun 08 11:48:01.228651 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.227390    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a447431c-750b-4ed2-b229-59acbc3534e8-run-ovn\") pod \"ovnkube-node-9x6v7\" (UID: \"a447431c-750b-4ed2-b229-59acbc3534e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7"
Jun 08 11:48:01.228651 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.227394    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fe7bc26d-99a1-4168-996f-f3322e778ed5-host-run-netns\") pod \"multus-f4gdp\" (UID: \"fe7bc26d-99a1-4168-996f-f3322e778ed5\") " pod="openshift-multus/multus-f4gdp"
Jun 08 11:48:01.228651 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.227440    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ad420f23-b7b2-45a6-ad9a-118f28203f03-sys\") pod \"tuned-pm229\" (UID: \"ad420f23-b7b2-45a6-ad9a-118f28203f03\") " pod="openshift-cluster-node-tuning-operator/tuned-pm229"
Jun 08 11:48:01.228651 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.227449    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fe7bc26d-99a1-4168-996f-f3322e778ed5-host-var-lib-cni-bin\") pod \"multus-f4gdp\" (UID: \"fe7bc26d-99a1-4168-996f-f3322e778ed5\") " pod="openshift-multus/multus-f4gdp"
Jun 08 11:48:01.228651 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.227493    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a447431c-750b-4ed2-b229-59acbc3534e8-node-log\") pod \"ovnkube-node-9x6v7\" (UID: \"a447431c-750b-4ed2-b229-59acbc3534e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7"
Jun 08 11:48:01.228651 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.227531    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a447431c-750b-4ed2-b229-59acbc3534e8-host-cni-bin\") pod \"ovnkube-node-9x6v7\" (UID: \"a447431c-750b-4ed2-b229-59acbc3534e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7"
Jun 08 11:48:01.228651 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.227556    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ad420f23-b7b2-45a6-ad9a-118f28203f03-etc-sysconfig\") pod \"tuned-pm229\" (UID: \"ad420f23-b7b2-45a6-ad9a-118f28203f03\") " pod="openshift-cluster-node-tuning-operator/tuned-pm229"
Jun 08 11:48:01.228651 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.227566    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a447431c-750b-4ed2-b229-59acbc3534e8-host-cni-bin\") pod \"ovnkube-node-9x6v7\" (UID: \"a447431c-750b-4ed2-b229-59acbc3534e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7"
Jun 08 11:48:01.228651 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.227533    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a447431c-750b-4ed2-b229-59acbc3534e8-node-log\") pod \"ovnkube-node-9x6v7\" (UID: \"a447431c-750b-4ed2-b229-59acbc3534e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7"
Jun 08 11:48:01.228651 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.227579    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5ba152b0-fb41-414a-a375-ae9ae8f60d2a-konnectivity-ca\") pod \"konnectivity-agent-vxkpp\" (UID: \"5ba152b0-fb41-414a-a375-ae9ae8f60d2a\") " pod="kube-system/konnectivity-agent-vxkpp"
Jun 08 11:48:01.228651 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.227614    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a447431c-750b-4ed2-b229-59acbc3534e8-var-lib-openvswitch\") pod \"ovnkube-node-9x6v7\" (UID: \"a447431c-750b-4ed2-b229-59acbc3534e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7"
Jun 08 11:48:01.228651 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.227625    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ad420f23-b7b2-45a6-ad9a-118f28203f03-etc-sysconfig\") pod \"tuned-pm229\" (UID: \"ad420f23-b7b2-45a6-ad9a-118f28203f03\") " pod="openshift-cluster-node-tuning-operator/tuned-pm229"
Jun 08 11:48:01.229419 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.227659    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fe7bc26d-99a1-4168-996f-f3322e778ed5-host-run-k8s-cni-cncf-io\") pod \"multus-f4gdp\" (UID: \"fe7bc26d-99a1-4168-996f-f3322e778ed5\") " pod="openshift-multus/multus-f4gdp"
Jun 08 11:48:01.229419 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.227701    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/40910c2e-803d-4cf1-9451-917a8d88f182-cnibin\") pod \"multus-additional-cni-plugins-bzgvn\" (UID: \"40910c2e-803d-4cf1-9451-917a8d88f182\") " pod="openshift-multus/multus-additional-cni-plugins-bzgvn"
Jun 08 11:48:01.229419 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.227721    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a447431c-750b-4ed2-b229-59acbc3534e8-var-lib-openvswitch\") pod \"ovnkube-node-9x6v7\" (UID: \"a447431c-750b-4ed2-b229-59acbc3534e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7"
Jun 08 11:48:01.229419 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.227729    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ftjj\" (UniqueName: \"kubernetes.io/projected/42241258-7f82-4c8b-9862-4a32ddfcf5f2-kube-api-access-9ftjj\") pod \"node-ca-ps66l\" (UID: \"42241258-7f82-4c8b-9862-4a32ddfcf5f2\") " pod="openshift-image-registry/node-ca-ps66l"
Jun 08 11:48:01.229419 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.227774    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a447431c-750b-4ed2-b229-59acbc3534e8-ovnkube-config\") pod \"ovnkube-node-9x6v7\" (UID: \"a447431c-750b-4ed2-b229-59acbc3534e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7"
Jun 08 11:48:01.229419 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.227814    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a447431c-750b-4ed2-b229-59acbc3534e8-ovn-node-metrics-cert\") pod \"ovnkube-node-9x6v7\" (UID: \"a447431c-750b-4ed2-b229-59acbc3534e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7"
Jun 08 11:48:01.229419 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.227910    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/445c0f3b-b186-4d9d-befd-0d1bb215799d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qzh85\" (UID: \"445c0f3b-b186-4d9d-befd-0d1bb215799d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzh85"
Jun 08 11:48:01.229419 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.228040    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/445c0f3b-b186-4d9d-befd-0d1bb215799d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qzh85\" (UID: \"445c0f3b-b186-4d9d-befd-0d1bb215799d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzh85"
Jun 08 11:48:01.229419 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.228088    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/445c0f3b-b186-4d9d-befd-0d1bb215799d-registration-dir\") pod \"aws-ebs-csi-driver-node-qzh85\" (UID: \"445c0f3b-b186-4d9d-befd-0d1bb215799d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzh85"
Jun 08 11:48:01.229419 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.228118    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ad420f23-b7b2-45a6-ad9a-118f28203f03-host\") pod \"tuned-pm229\" (UID: \"ad420f23-b7b2-45a6-ad9a-118f28203f03\") " pod="openshift-cluster-node-tuning-operator/tuned-pm229"
Jun 08 11:48:01.229419 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.228143    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/40910c2e-803d-4cf1-9451-917a8d88f182-os-release\") pod \"multus-additional-cni-plugins-bzgvn\" (UID: \"40910c2e-803d-4cf1-9451-917a8d88f182\") " pod="openshift-multus/multus-additional-cni-plugins-bzgvn"
Jun 08 11:48:01.229419 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.228191    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ad420f23-b7b2-45a6-ad9a-118f28203f03-host\") pod \"tuned-pm229\" (UID: \"ad420f23-b7b2-45a6-ad9a-118f28203f03\") " pod="openshift-cluster-node-tuning-operator/tuned-pm229"
Jun 08 11:48:01.229419 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.228218    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a447431c-750b-4ed2-b229-59acbc3534e8-host-slash\") pod \"ovnkube-node-9x6v7\" (UID: \"a447431c-750b-4ed2-b229-59acbc3534e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7"
Jun 08 11:48:01.229419 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.228242    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a447431c-750b-4ed2-b229-59acbc3534e8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9x6v7\" (UID: \"a447431c-750b-4ed2-b229-59acbc3534e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7"
Jun 08 11:48:01.229419 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.228267    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ad420f23-b7b2-45a6-ad9a-118f28203f03-etc-modprobe-d\") pod \"tuned-pm229\" (UID: \"ad420f23-b7b2-45a6-ad9a-118f28203f03\") " pod="openshift-cluster-node-tuning-operator/tuned-pm229"
Jun 08 11:48:01.229419 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.228283    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a447431c-750b-4ed2-b229-59acbc3534e8-ovnkube-config\") pod \"ovnkube-node-9x6v7\" (UID: \"a447431c-750b-4ed2-b229-59acbc3534e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7"
Jun 08 11:48:01.229419 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.228307    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a447431c-750b-4ed2-b229-59acbc3534e8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9x6v7\" (UID: \"a447431c-750b-4ed2-b229-59acbc3534e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7"
Jun 08 11:48:01.230122 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.228347    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/445c0f3b-b186-4d9d-befd-0d1bb215799d-registration-dir\") pod \"aws-ebs-csi-driver-node-qzh85\" (UID: \"445c0f3b-b186-4d9d-befd-0d1bb215799d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzh85"
Jun 08 11:48:01.230122 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.228368    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ad420f23-b7b2-45a6-ad9a-118f28203f03-etc-sysctl-conf\") pod \"tuned-pm229\" (UID: \"ad420f23-b7b2-45a6-ad9a-118f28203f03\") " pod="openshift-cluster-node-tuning-operator/tuned-pm229"
Jun 08 11:48:01.230122 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.228392    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ad420f23-b7b2-45a6-ad9a-118f28203f03-etc-modprobe-d\") pod \"tuned-pm229\" (UID: \"ad420f23-b7b2-45a6-ad9a-118f28203f03\") " pod="openshift-cluster-node-tuning-operator/tuned-pm229"
Jun 08 11:48:01.230122 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.228394    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad420f23-b7b2-45a6-ad9a-118f28203f03-var-lib-kubelet\") pod \"tuned-pm229\" (UID: \"ad420f23-b7b2-45a6-ad9a-118f28203f03\") " pod="openshift-cluster-node-tuning-operator/tuned-pm229"
Jun 08 11:48:01.230122 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.228432    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fe7bc26d-99a1-4168-996f-f3322e778ed5-host-var-lib-cni-multus\") pod \"multus-f4gdp\" (UID: \"fe7bc26d-99a1-4168-996f-f3322e778ed5\") " pod="openshift-multus/multus-f4gdp"
Jun 08 11:48:01.230122 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.228437    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad420f23-b7b2-45a6-ad9a-118f28203f03-var-lib-kubelet\") pod \"tuned-pm229\" (UID: \"ad420f23-b7b2-45a6-ad9a-118f28203f03\") " pod="openshift-cluster-node-tuning-operator/tuned-pm229"
Jun 08 11:48:01.230122 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.228460    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a447431c-750b-4ed2-b229-59acbc3534e8-host-slash\") pod \"ovnkube-node-9x6v7\" (UID: \"a447431c-750b-4ed2-b229-59acbc3534e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7"
Jun 08 11:48:01.230122 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.228495    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fe7bc26d-99a1-4168-996f-f3322e778ed5-host-run-multus-certs\") pod \"multus-f4gdp\" (UID: \"fe7bc26d-99a1-4168-996f-f3322e778ed5\") " pod="openshift-multus/multus-f4gdp"
Jun 08 11:48:01.230122 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.228583    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ad420f23-b7b2-45a6-ad9a-118f28203f03-etc-sysctl-conf\") pod \"tuned-pm229\" (UID: \"ad420f23-b7b2-45a6-ad9a-118f28203f03\") " pod="openshift-cluster-node-tuning-operator/tuned-pm229"
Jun 08 11:48:01.230122 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.229693    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad420f23-b7b2-45a6-ad9a-118f28203f03-tmp\") pod \"tuned-pm229\" (UID: \"ad420f23-b7b2-45a6-ad9a-118f28203f03\") " pod="openshift-cluster-node-tuning-operator/tuned-pm229"
Jun 08 11:48:01.230122 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.229746    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ad420f23-b7b2-45a6-ad9a-118f28203f03-etc-tuned\") pod \"tuned-pm229\" (UID: \"ad420f23-b7b2-45a6-ad9a-118f28203f03\") " pod="openshift-cluster-node-tuning-operator/tuned-pm229"
Jun 08 11:48:01.230539 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.230315    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a447431c-750b-4ed2-b229-59acbc3534e8-ovn-node-metrics-cert\") pod \"ovnkube-node-9x6v7\" (UID: \"a447431c-750b-4ed2-b229-59acbc3534e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7"
Jun 08 11:48:01.233839 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.233560    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-btqw7\" (UniqueName: \"kubernetes.io/projected/0b2281a3-722f-4113-b3e1-7f4b4614f599-kube-api-access-btqw7\") pod \"network-metrics-daemon-6m4cb\" (UID: \"0b2281a3-722f-4113-b3e1-7f4b4614f599\") " pod="openshift-multus/network-metrics-daemon-6m4cb"
Jun 08 11:48:01.234460 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.234435    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzdxb\" (UniqueName: \"kubernetes.io/projected/a447431c-750b-4ed2-b229-59acbc3534e8-kube-api-access-jzdxb\") pod \"ovnkube-node-9x6v7\" (UID: \"a447431c-750b-4ed2-b229-59acbc3534e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7"
Jun 08 11:48:01.235012 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:01.234777    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 08 11:48:01.235012 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:01.234807    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 08 11:48:01.235012 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:01.234832    2583 projected.go:196] Error preparing data for projected volume kube-api-access-62csw for pod openshift-network-diagnostics/network-check-target-rx5rz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 08 11:48:01.235012 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:01.234897    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3b153dca-66ed-4681-b70b-6061158f6676-kube-api-access-62csw podName:3b153dca-66ed-4681-b70b-6061158f6676 nodeName:}" failed. No retries permitted until 2026-06-08 11:48:01.734872984 +0000 UTC m=+3.006448162 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-62csw" (UniqueName: "kubernetes.io/projected/3b153dca-66ed-4681-b70b-6061158f6676-kube-api-access-62csw") pod "network-check-target-rx5rz" (UID: "3b153dca-66ed-4681-b70b-6061158f6676") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 08 11:48:01.235393 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.235359    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkmgr\" (UniqueName: \"kubernetes.io/projected/445c0f3b-b186-4d9d-befd-0d1bb215799d-kube-api-access-wkmgr\") pod \"aws-ebs-csi-driver-node-qzh85\" (UID: \"445c0f3b-b186-4d9d-befd-0d1bb215799d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzh85"
Jun 08 11:48:01.238174 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.238129    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-svf4l\" (UniqueName: \"kubernetes.io/projected/ad420f23-b7b2-45a6-ad9a-118f28203f03-kube-api-access-svf4l\") pod \"tuned-pm229\" (UID: \"ad420f23-b7b2-45a6-ad9a-118f28203f03\") " pod="openshift-cluster-node-tuning-operator/tuned-pm229"
Jun 08 11:48:01.239060 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.239029    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-554rp\" (UniqueName: \"kubernetes.io/projected/f7cbbb77-d234-4a11-811c-26a8a21019df-kube-api-access-554rp\") pod \"node-resolver-dmbw7\" (UID: \"f7cbbb77-d234-4a11-811c-26a8a21019df\") " pod="openshift-dns/node-resolver-dmbw7"
Jun 08 11:48:01.239808 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.239786    2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-xcbrp"
Jun 08 11:48:01.247200 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.247184    2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-xcbrp"
Jun 08 11:48:01.329351 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.329311    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fe7bc26d-99a1-4168-996f-f3322e778ed5-host-run-netns\") pod \"multus-f4gdp\" (UID: \"fe7bc26d-99a1-4168-996f-f3322e778ed5\") " pod="openshift-multus/multus-f4gdp"
Jun 08 11:48:01.329351 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.329351    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fe7bc26d-99a1-4168-996f-f3322e778ed5-host-var-lib-cni-bin\") pod \"multus-f4gdp\" (UID: \"fe7bc26d-99a1-4168-996f-f3322e778ed5\") " pod="openshift-multus/multus-f4gdp"
Jun 08 11:48:01.329595 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.329377    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5ba152b0-fb41-414a-a375-ae9ae8f60d2a-konnectivity-ca\") pod \"konnectivity-agent-vxkpp\" (UID: \"5ba152b0-fb41-414a-a375-ae9ae8f60d2a\") " pod="kube-system/konnectivity-agent-vxkpp"
Jun 08 11:48:01.329595 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.329401    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fe7bc26d-99a1-4168-996f-f3322e778ed5-host-run-k8s-cni-cncf-io\") pod \"multus-f4gdp\" (UID: \"fe7bc26d-99a1-4168-996f-f3322e778ed5\") " pod="openshift-multus/multus-f4gdp"
Jun 08 11:48:01.329595 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.329422    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fe7bc26d-99a1-4168-996f-f3322e778ed5-host-run-netns\") pod \"multus-f4gdp\" (UID: \"fe7bc26d-99a1-4168-996f-f3322e778ed5\") " pod="openshift-multus/multus-f4gdp"
Jun 08 11:48:01.329595 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.329427    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/40910c2e-803d-4cf1-9451-917a8d88f182-cnibin\") pod \"multus-additional-cni-plugins-bzgvn\" (UID: \"40910c2e-803d-4cf1-9451-917a8d88f182\") " pod="openshift-multus/multus-additional-cni-plugins-bzgvn"
Jun 08 11:48:01.329595 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.329445    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fe7bc26d-99a1-4168-996f-f3322e778ed5-host-var-lib-cni-bin\") pod \"multus-f4gdp\" (UID: \"fe7bc26d-99a1-4168-996f-f3322e778ed5\") " pod="openshift-multus/multus-f4gdp"
Jun 08 11:48:01.329595 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.329463    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/40910c2e-803d-4cf1-9451-917a8d88f182-cnibin\") pod \"multus-additional-cni-plugins-bzgvn\" (UID: \"40910c2e-803d-4cf1-9451-917a8d88f182\") " pod="openshift-multus/multus-additional-cni-plugins-bzgvn"
Jun 08 11:48:01.329595 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.329475    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ftjj\" (UniqueName: \"kubernetes.io/projected/42241258-7f82-4c8b-9862-4a32ddfcf5f2-kube-api-access-9ftjj\") pod \"node-ca-ps66l\" (UID: \"42241258-7f82-4c8b-9862-4a32ddfcf5f2\") " pod="openshift-image-registry/node-ca-ps66l"
Jun 08 11:48:01.329595 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.329492    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fe7bc26d-99a1-4168-996f-f3322e778ed5-host-run-k8s-cni-cncf-io\") pod \"multus-f4gdp\" (UID: \"fe7bc26d-99a1-4168-996f-f3322e778ed5\") " pod="openshift-multus/multus-f4gdp"
Jun 08 11:48:01.329595 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.329506    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/40910c2e-803d-4cf1-9451-917a8d88f182-os-release\") pod \"multus-additional-cni-plugins-bzgvn\" (UID: \"40910c2e-803d-4cf1-9451-917a8d88f182\") " pod="openshift-multus/multus-additional-cni-plugins-bzgvn"
Jun 08 11:48:01.329595 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.329542    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fe7bc26d-99a1-4168-996f-f3322e778ed5-host-var-lib-cni-multus\") pod \"multus-f4gdp\" (UID: \"fe7bc26d-99a1-4168-996f-f3322e778ed5\") " pod="openshift-multus/multus-f4gdp"
Jun 08 11:48:01.329595 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.329571    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fe7bc26d-99a1-4168-996f-f3322e778ed5-host-run-multus-certs\") pod \"multus-f4gdp\" (UID: \"fe7bc26d-99a1-4168-996f-f3322e778ed5\") " pod="openshift-multus/multus-f4gdp"
Jun 08 11:48:01.329595 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.329594    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/40910c2e-803d-4cf1-9451-917a8d88f182-os-release\") pod \"multus-additional-cni-plugins-bzgvn\" (UID: \"40910c2e-803d-4cf1-9451-917a8d88f182\") " pod="openshift-multus/multus-additional-cni-plugins-bzgvn"
Jun 08 11:48:01.330204 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.329596    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/40910c2e-803d-4cf1-9451-917a8d88f182-cni-binary-copy\") pod \"multus-additional-cni-plugins-bzgvn\" (UID: \"40910c2e-803d-4cf1-9451-917a8d88f182\") " pod="openshift-multus/multus-additional-cni-plugins-bzgvn"
Jun 08 11:48:01.330204 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.329644    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fe7bc26d-99a1-4168-996f-f3322e778ed5-host-run-multus-certs\") pod \"multus-f4gdp\" (UID: \"fe7bc26d-99a1-4168-996f-f3322e778ed5\") " pod="openshift-multus/multus-f4gdp"
Jun 08 11:48:01.330204 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.329659    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fe7bc26d-99a1-4168-996f-f3322e778ed5-system-cni-dir\") pod \"multus-f4gdp\" (UID: \"fe7bc26d-99a1-4168-996f-f3322e778ed5\") " pod="openshift-multus/multus-f4gdp"
Jun 08 11:48:01.330204 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.329685    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fe7bc26d-99a1-4168-996f-f3322e778ed5-host-var-lib-cni-multus\") pod \"multus-f4gdp\" (UID: \"fe7bc26d-99a1-4168-996f-f3322e778ed5\") " pod="openshift-multus/multus-f4gdp"
Jun 08 11:48:01.330204 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.329688    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fe7bc26d-99a1-4168-996f-f3322e778ed5-cnibin\") pod \"multus-f4gdp\" (UID: \"fe7bc26d-99a1-4168-996f-f3322e778ed5\") " pod="openshift-multus/multus-f4gdp"
Jun 08 11:48:01.330204 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.329717    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fe7bc26d-99a1-4168-996f-f3322e778ed5-cni-binary-copy\") pod \"multus-f4gdp\" (UID: \"fe7bc26d-99a1-4168-996f-f3322e778ed5\") " pod="openshift-multus/multus-f4gdp"
Jun 08 11:48:01.330204 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.329730    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fe7bc26d-99a1-4168-996f-f3322e778ed5-cnibin\") pod \"multus-f4gdp\" (UID: \"fe7bc26d-99a1-4168-996f-f3322e778ed5\") " pod="openshift-multus/multus-f4gdp"
Jun 08 11:48:01.330204 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.329777    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fe7bc26d-99a1-4168-996f-f3322e778ed5-system-cni-dir\") pod \"multus-f4gdp\" (UID: \"fe7bc26d-99a1-4168-996f-f3322e778ed5\") " pod="openshift-multus/multus-f4gdp"
Jun 08 11:48:01.330204 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.329819    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtmkg\" (UniqueName: \"kubernetes.io/projected/fe7bc26d-99a1-4168-996f-f3322e778ed5-kube-api-access-vtmkg\") pod \"multus-f4gdp\" (UID: \"fe7bc26d-99a1-4168-996f-f3322e778ed5\") " pod="openshift-multus/multus-f4gdp"
Jun 08 11:48:01.330204 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.329848    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/40910c2e-803d-4cf1-9451-917a8d88f182-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bzgvn\" (UID: \"40910c2e-803d-4cf1-9451-917a8d88f182\") " pod="openshift-multus/multus-additional-cni-plugins-bzgvn"
Jun 08 11:48:01.330204 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.329879    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/42241258-7f82-4c8b-9862-4a32ddfcf5f2-host\") pod \"node-ca-ps66l\" (UID: \"42241258-7f82-4c8b-9862-4a32ddfcf5f2\") " pod="openshift-image-registry/node-ca-ps66l"
Jun 08 11:48:01.330204 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.329904    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2lsr\" (UniqueName: \"kubernetes.io/projected/4866962b-3c74-43c5-a2eb-fa8209ebeba3-kube-api-access-n2lsr\") pod \"iptables-alerter-dplqn\" (UID: \"4866962b-3c74-43c5-a2eb-fa8209ebeba3\") " pod="openshift-network-operator/iptables-alerter-dplqn"
Jun 08 11:48:01.330204 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.329929    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fe7bc26d-99a1-4168-996f-f3322e778ed5-etc-kubernetes\") pod \"multus-f4gdp\" (UID: \"fe7bc26d-99a1-4168-996f-f3322e778ed5\") " pod="openshift-multus/multus-f4gdp"
Jun 08 11:48:01.330204 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.329953    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fe7bc26d-99a1-4168-996f-f3322e778ed5-multus-conf-dir\") pod \"multus-f4gdp\" (UID: \"fe7bc26d-99a1-4168-996f-f3322e778ed5\") " pod="openshift-multus/multus-f4gdp"
Jun 08 11:48:01.330204 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.329977    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/40910c2e-803d-4cf1-9451-917a8d88f182-system-cni-dir\") pod \"multus-additional-cni-plugins-bzgvn\" (UID: \"40910c2e-803d-4cf1-9451-917a8d88f182\") " pod="openshift-multus/multus-additional-cni-plugins-bzgvn"
Jun 08 11:48:01.330204 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.330007    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5ba152b0-fb41-414a-a375-ae9ae8f60d2a-konnectivity-ca\") pod \"konnectivity-agent-vxkpp\" (UID: \"5ba152b0-fb41-414a-a375-ae9ae8f60d2a\") " pod="kube-system/konnectivity-agent-vxkpp"
Jun 08 11:48:01.330204 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.330009    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/40910c2e-803d-4cf1-9451-917a8d88f182-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bzgvn\" (UID: \"40910c2e-803d-4cf1-9451-917a8d88f182\") " pod="openshift-multus/multus-additional-cni-plugins-bzgvn"
Jun 08 11:48:01.330204 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.330073    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/42241258-7f82-4c8b-9862-4a32ddfcf5f2-serviceca\") pod \"node-ca-ps66l\" (UID: \"42241258-7f82-4c8b-9862-4a32ddfcf5f2\") " pod="openshift-image-registry/node-ca-ps66l"
Jun 08 11:48:01.330994 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.330099    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4866962b-3c74-43c5-a2eb-fa8209ebeba3-host-slash\") pod \"iptables-alerter-dplqn\" (UID: \"4866962b-3c74-43c5-a2eb-fa8209ebeba3\") " pod="openshift-network-operator/iptables-alerter-dplqn"
Jun 08 11:48:01.330994 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.330123    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2579f4ef-e90c-4da0-9617-9ba892dba6ef-kubelet-config\") pod \"global-pull-secret-syncer-c6hh2\" (UID: \"2579f4ef-e90c-4da0-9617-9ba892dba6ef\") " pod="kube-system/global-pull-secret-syncer-c6hh2"
Jun 08 11:48:01.330994 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.330151    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fe7bc26d-99a1-4168-996f-f3322e778ed5-os-release\") pod \"multus-f4gdp\" (UID: \"fe7bc26d-99a1-4168-996f-f3322e778ed5\") " pod="openshift-multus/multus-f4gdp"
Jun 08 11:48:01.330994 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.330174    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fe7bc26d-99a1-4168-996f-f3322e778ed5-multus-socket-dir-parent\") pod \"multus-f4gdp\" (UID: \"fe7bc26d-99a1-4168-996f-f3322e778ed5\") " pod="openshift-multus/multus-f4gdp"
Jun 08 11:48:01.330994 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.330195    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fe7bc26d-99a1-4168-996f-f3322e778ed5-hostroot\") pod \"multus-f4gdp\" (UID: \"fe7bc26d-99a1-4168-996f-f3322e778ed5\") " pod="openshift-multus/multus-f4gdp"
Jun 08 11:48:01.330994 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.330218    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/40910c2e-803d-4cf1-9451-917a8d88f182-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bzgvn\" (UID: \"40910c2e-803d-4cf1-9451-917a8d88f182\") " pod="openshift-multus/multus-additional-cni-plugins-bzgvn"
Jun 08 11:48:01.330994 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.330243    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fe7bc26d-99a1-4168-996f-f3322e778ed5-multus-cni-dir\") pod \"multus-f4gdp\" (UID: \"fe7bc26d-99a1-4168-996f-f3322e778ed5\") " pod="openshift-multus/multus-f4gdp"
Jun 08 11:48:01.330994 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.330265    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fe7bc26d-99a1-4168-996f-f3322e778ed5-host-var-lib-kubelet\") pod \"multus-f4gdp\" (UID: \"fe7bc26d-99a1-4168-996f-f3322e778ed5\") " pod="openshift-multus/multus-f4gdp"
Jun 08 11:48:01.330994 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.330275    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fe7bc26d-99a1-4168-996f-f3322e778ed5-cni-binary-copy\") pod \"multus-f4gdp\" (UID: \"fe7bc26d-99a1-4168-996f-f3322e778ed5\") " pod="openshift-multus/multus-f4gdp"
Jun 08 11:48:01.330994 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.330287    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-969c6\" (UniqueName: \"kubernetes.io/projected/40910c2e-803d-4cf1-9451-917a8d88f182-kube-api-access-969c6\") pod \"multus-additional-cni-plugins-bzgvn\" (UID: \"40910c2e-803d-4cf1-9451-917a8d88f182\") " pod="openshift-multus/multus-additional-cni-plugins-bzgvn"
Jun 08 11:48:01.330994 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.330324    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fe7bc26d-99a1-4168-996f-f3322e778ed5-multus-daemon-config\") pod \"multus-f4gdp\" (UID: \"fe7bc26d-99a1-4168-996f-f3322e778ed5\") " pod="openshift-multus/multus-f4gdp"
Jun 08 11:48:01.330994 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.330344    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fe7bc26d-99a1-4168-996f-f3322e778ed5-multus-socket-dir-parent\") pod \"multus-f4gdp\" (UID: \"fe7bc26d-99a1-4168-996f-f3322e778ed5\") " pod="openshift-multus/multus-f4gdp"
Jun 08 11:48:01.330994 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.330362    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2579f4ef-e90c-4da0-9617-9ba892dba6ef-dbus\") pod \"global-pull-secret-syncer-c6hh2\" (UID: \"2579f4ef-e90c-4da0-9617-9ba892dba6ef\") " pod="kube-system/global-pull-secret-syncer-c6hh2"
Jun 08 11:48:01.330994 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.330386    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2579f4ef-e90c-4da0-9617-9ba892dba6ef-original-pull-secret\") pod \"global-pull-secret-syncer-c6hh2\" (UID: \"2579f4ef-e90c-4da0-9617-9ba892dba6ef\") " pod="kube-system/global-pull-secret-syncer-c6hh2"
Jun 08 11:48:01.330994 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.330411    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4866962b-3c74-43c5-a2eb-fa8209ebeba3-iptables-alerter-script\") pod \"iptables-alerter-dplqn\" (UID: \"4866962b-3c74-43c5-a2eb-fa8209ebeba3\") " pod="openshift-network-operator/iptables-alerter-dplqn"
Jun 08 11:48:01.330994 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.330410    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/40910c2e-803d-4cf1-9451-917a8d88f182-cni-binary-copy\") pod \"multus-additional-cni-plugins-bzgvn\" (UID: \"40910c2e-803d-4cf1-9451-917a8d88f182\") " pod="openshift-multus/multus-additional-cni-plugins-bzgvn"
Jun 08 11:48:01.330994 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.330438    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5ba152b0-fb41-414a-a375-ae9ae8f60d2a-agent-certs\") pod \"konnectivity-agent-vxkpp\" (UID: \"5ba152b0-fb41-414a-a375-ae9ae8f60d2a\") " pod="kube-system/konnectivity-agent-vxkpp"
Jun 08 11:48:01.331703 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.330475    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fe7bc26d-99a1-4168-996f-f3322e778ed5-etc-kubernetes\") pod \"multus-f4gdp\" (UID: \"fe7bc26d-99a1-4168-996f-f3322e778ed5\") " pod="openshift-multus/multus-f4gdp"
Jun 08 11:48:01.331703 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.330519    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fe7bc26d-99a1-4168-996f-f3322e778ed5-hostroot\") pod \"multus-f4gdp\" (UID: \"fe7bc26d-99a1-4168-996f-f3322e778ed5\") " pod="openshift-multus/multus-f4gdp"
Jun 08 11:48:01.331703 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.330520    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/42241258-7f82-4c8b-9862-4a32ddfcf5f2-host\") pod \"node-ca-ps66l\" (UID: \"42241258-7f82-4c8b-9862-4a32ddfcf5f2\") " pod="openshift-image-registry/node-ca-ps66l"
Jun 08 11:48:01.331703 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.330597    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2579f4ef-e90c-4da0-9617-9ba892dba6ef-kubelet-config\") pod \"global-pull-secret-syncer-c6hh2\" (UID: \"2579f4ef-e90c-4da0-9617-9ba892dba6ef\") " pod="kube-system/global-pull-secret-syncer-c6hh2"
Jun 08 11:48:01.331703 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.330643    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4866962b-3c74-43c5-a2eb-fa8209ebeba3-host-slash\") pod \"iptables-alerter-dplqn\" (UID: \"4866962b-3c74-43c5-a2eb-fa8209ebeba3\") " pod="openshift-network-operator/iptables-alerter-dplqn"
Jun 08 11:48:01.331703 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.330652    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fe7bc26d-99a1-4168-996f-f3322e778ed5-multus-conf-dir\") pod \"multus-f4gdp\" (UID: \"fe7bc26d-99a1-4168-996f-f3322e778ed5\") " pod="openshift-multus/multus-f4gdp"
Jun 08 11:48:01.331703 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.330689    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/40910c2e-803d-4cf1-9451-917a8d88f182-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bzgvn\" (UID: \"40910c2e-803d-4cf1-9451-917a8d88f182\") " pod="openshift-multus/multus-additional-cni-plugins-bzgvn"
Jun 08 11:48:01.331703 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.330709    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/40910c2e-803d-4cf1-9451-917a8d88f182-system-cni-dir\") pod \"multus-additional-cni-plugins-bzgvn\" (UID: \"40910c2e-803d-4cf1-9451-917a8d88f182\") " pod="openshift-multus/multus-additional-cni-plugins-bzgvn"
Jun 08 11:48:01.331703 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.330713    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/42241258-7f82-4c8b-9862-4a32ddfcf5f2-serviceca\") pod \"node-ca-ps66l\" (UID: \"42241258-7f82-4c8b-9862-4a32ddfcf5f2\") " pod="openshift-image-registry/node-ca-ps66l"
Jun 08 11:48:01.331703 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.330410    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/40910c2e-803d-4cf1-9451-917a8d88f182-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bzgvn\" (UID: \"40910c2e-803d-4cf1-9451-917a8d88f182\") " pod="openshift-multus/multus-additional-cni-plugins-bzgvn"
Jun 08 11:48:01.331703 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.330803    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2579f4ef-e90c-4da0-9617-9ba892dba6ef-dbus\") pod \"global-pull-secret-syncer-c6hh2\" (UID: \"2579f4ef-e90c-4da0-9617-9ba892dba6ef\") " pod="kube-system/global-pull-secret-syncer-c6hh2"
Jun 08 11:48:01.331703 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.330819    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fe7bc26d-99a1-4168-996f-f3322e778ed5-os-release\") pod \"multus-f4gdp\" (UID: \"fe7bc26d-99a1-4168-996f-f3322e778ed5\") " pod="openshift-multus/multus-f4gdp"
Jun 08 11:48:01.331703 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:01.330807    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 08 11:48:01.331703 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.330839    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fe7bc26d-99a1-4168-996f-f3322e778ed5-multus-cni-dir\") pod \"multus-f4gdp\" (UID: \"fe7bc26d-99a1-4168-996f-f3322e778ed5\") " pod="openshift-multus/multus-f4gdp"
Jun 08 11:48:01.331703 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:01.330886    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2579f4ef-e90c-4da0-9617-9ba892dba6ef-original-pull-secret podName:2579f4ef-e90c-4da0-9617-9ba892dba6ef nodeName:}" failed. No retries permitted until 2026-06-08 11:48:01.830870823 +0000 UTC m=+3.102445985 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2579f4ef-e90c-4da0-9617-9ba892dba6ef-original-pull-secret") pod "global-pull-secret-syncer-c6hh2" (UID: "2579f4ef-e90c-4da0-9617-9ba892dba6ef") : object "kube-system"/"original-pull-secret" not registered
Jun 08 11:48:01.331703 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.330883    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fe7bc26d-99a1-4168-996f-f3322e778ed5-host-var-lib-kubelet\") pod \"multus-f4gdp\" (UID: \"fe7bc26d-99a1-4168-996f-f3322e778ed5\") " pod="openshift-multus/multus-f4gdp"
Jun 08 11:48:01.331703 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.331219    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/40910c2e-803d-4cf1-9451-917a8d88f182-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bzgvn\" (UID: \"40910c2e-803d-4cf1-9451-917a8d88f182\") " pod="openshift-multus/multus-additional-cni-plugins-bzgvn"
Jun 08 11:48:01.332305 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.331405    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fe7bc26d-99a1-4168-996f-f3322e778ed5-multus-daemon-config\") pod \"multus-f4gdp\" (UID: \"fe7bc26d-99a1-4168-996f-f3322e778ed5\") " pod="openshift-multus/multus-f4gdp"
Jun 08 11:48:01.332305 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.331450    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4866962b-3c74-43c5-a2eb-fa8209ebeba3-iptables-alerter-script\") pod \"iptables-alerter-dplqn\" (UID: \"4866962b-3c74-43c5-a2eb-fa8209ebeba3\") " pod="openshift-network-operator/iptables-alerter-dplqn"
Jun 08 11:48:01.333251 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.333229    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5ba152b0-fb41-414a-a375-ae9ae8f60d2a-agent-certs\") pod \"konnectivity-agent-vxkpp\" (UID: \"5ba152b0-fb41-414a-a375-ae9ae8f60d2a\") " pod="kube-system/konnectivity-agent-vxkpp"
Jun 08 11:48:01.339778 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.339742    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2lsr\" (UniqueName: \"kubernetes.io/projected/4866962b-3c74-43c5-a2eb-fa8209ebeba3-kube-api-access-n2lsr\") pod \"iptables-alerter-dplqn\" (UID: \"4866962b-3c74-43c5-a2eb-fa8209ebeba3\") " pod="openshift-network-operator/iptables-alerter-dplqn"
Jun 08 11:48:01.340002 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.339982    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ftjj\" (UniqueName: \"kubernetes.io/projected/42241258-7f82-4c8b-9862-4a32ddfcf5f2-kube-api-access-9ftjj\") pod \"node-ca-ps66l\" (UID: \"42241258-7f82-4c8b-9862-4a32ddfcf5f2\") " pod="openshift-image-registry/node-ca-ps66l"
Jun 08 11:48:01.340659 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.340619    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtmkg\" (UniqueName: \"kubernetes.io/projected/fe7bc26d-99a1-4168-996f-f3322e778ed5-kube-api-access-vtmkg\") pod \"multus-f4gdp\" (UID: \"fe7bc26d-99a1-4168-996f-f3322e778ed5\") " pod="openshift-multus/multus-f4gdp"
Jun 08 11:48:01.340871 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.340852    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-969c6\" (UniqueName: \"kubernetes.io/projected/40910c2e-803d-4cf1-9451-917a8d88f182-kube-api-access-969c6\") pod \"multus-additional-cni-plugins-bzgvn\" (UID: \"40910c2e-803d-4cf1-9451-917a8d88f182\") " pod="openshift-multus/multus-additional-cni-plugins-bzgvn"
Jun 08 11:48:01.416934 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.416853    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7"
Jun 08 11:48:01.425653 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.425627    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzh85"
Jun 08 11:48:01.435356 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.435336    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pm229"
Jun 08 11:48:01.439133 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.439110    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dmbw7"
Jun 08 11:48:01.445629 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.445612    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ps66l"
Jun 08 11:48:01.452164 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.452142    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vxkpp"
Jun 08 11:48:01.458727 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.458710    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dplqn"
Jun 08 11:48:01.465128 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.465112    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bzgvn"
Jun 08 11:48:01.470597 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.470581    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-f4gdp"
Jun 08 11:48:01.734365 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.734277    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b2281a3-722f-4113-b3e1-7f4b4614f599-metrics-certs\") pod \"network-metrics-daemon-6m4cb\" (UID: \"0b2281a3-722f-4113-b3e1-7f4b4614f599\") " pod="openshift-multus/network-metrics-daemon-6m4cb"
Jun 08 11:48:01.734508 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:01.734454    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 08 11:48:01.734559 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:01.734527    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b2281a3-722f-4113-b3e1-7f4b4614f599-metrics-certs podName:0b2281a3-722f-4113-b3e1-7f4b4614f599 nodeName:}" failed. No retries permitted until 2026-06-08 11:48:02.734512793 +0000 UTC m=+4.006087952 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b2281a3-722f-4113-b3e1-7f4b4614f599-metrics-certs") pod "network-metrics-daemon-6m4cb" (UID: "0b2281a3-722f-4113-b3e1-7f4b4614f599") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 08 11:48:01.835120 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.835081    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62csw\" (UniqueName: \"kubernetes.io/projected/3b153dca-66ed-4681-b70b-6061158f6676-kube-api-access-62csw\") pod \"network-check-target-rx5rz\" (UID: \"3b153dca-66ed-4681-b70b-6061158f6676\") " pod="openshift-network-diagnostics/network-check-target-rx5rz"
Jun 08 11:48:01.835120 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:01.835121    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2579f4ef-e90c-4da0-9617-9ba892dba6ef-original-pull-secret\") pod \"global-pull-secret-syncer-c6hh2\" (UID: \"2579f4ef-e90c-4da0-9617-9ba892dba6ef\") " pod="kube-system/global-pull-secret-syncer-c6hh2"
Jun 08 11:48:01.835345 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:01.835248    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 08 11:48:01.835345 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:01.835266    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 08 11:48:01.835345 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:01.835289    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 08 11:48:01.835345 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:01.835302    2583 projected.go:196] Error preparing data for projected volume kube-api-access-62csw for pod openshift-network-diagnostics/network-check-target-rx5rz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 08 11:48:01.835345 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:01.835310    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2579f4ef-e90c-4da0-9617-9ba892dba6ef-original-pull-secret podName:2579f4ef-e90c-4da0-9617-9ba892dba6ef nodeName:}" failed. No retries permitted until 2026-06-08 11:48:02.835291972 +0000 UTC m=+4.106867129 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2579f4ef-e90c-4da0-9617-9ba892dba6ef-original-pull-secret") pod "global-pull-secret-syncer-c6hh2" (UID: "2579f4ef-e90c-4da0-9617-9ba892dba6ef") : object "kube-system"/"original-pull-secret" not registered
Jun 08 11:48:01.835528 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:01.835351    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3b153dca-66ed-4681-b70b-6061158f6676-kube-api-access-62csw podName:3b153dca-66ed-4681-b70b-6061158f6676 nodeName:}" failed. No retries permitted until 2026-06-08 11:48:02.835334562 +0000 UTC m=+4.106909715 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-62csw" (UniqueName: "kubernetes.io/projected/3b153dca-66ed-4681-b70b-6061158f6676-kube-api-access-62csw") pod "network-check-target-rx5rz" (UID: "3b153dca-66ed-4681-b70b-6061158f6676") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 08 11:48:01.897416 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:48:01.897392    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42241258_7f82_4c8b_9862_4a32ddfcf5f2.slice/crio-e56d688bbde4c64d660c374ad4531af945c9422de5702b03eb047ba07720aa19 WatchSource:0}: Error finding container e56d688bbde4c64d660c374ad4531af945c9422de5702b03eb047ba07720aa19: Status 404 returned error can't find the container with id e56d688bbde4c64d660c374ad4531af945c9422de5702b03eb047ba07720aa19
Jun 08 11:48:01.899606 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:48:01.899580    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod445c0f3b_b186_4d9d_befd_0d1bb215799d.slice/crio-acfddcaa3a2c12c06daf38e6fe3d420a7bcf1171edf98243c8f1da6e17d0846f WatchSource:0}: Error finding container acfddcaa3a2c12c06daf38e6fe3d420a7bcf1171edf98243c8f1da6e17d0846f: Status 404 returned error can't find the container with id acfddcaa3a2c12c06daf38e6fe3d420a7bcf1171edf98243c8f1da6e17d0846f
Jun 08 11:48:01.902071 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:48:01.902038    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe7bc26d_99a1_4168_996f_f3322e778ed5.slice/crio-eaf016cf469b17f4af9b52c411c627f13c9ea05f5db05f59a3d9a7c0975b445a WatchSource:0}: Error finding container eaf016cf469b17f4af9b52c411c627f13c9ea05f5db05f59a3d9a7c0975b445a: Status 404 returned error can't find the container with id eaf016cf469b17f4af9b52c411c627f13c9ea05f5db05f59a3d9a7c0975b445a
Jun 08 11:48:01.903553 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:48:01.903535    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7cbbb77_d234_4a11_811c_26a8a21019df.slice/crio-072f0cd445dd0510acff8578b3f039672403cb4c4735ed381968f55d27eaf5d3 WatchSource:0}: Error finding container 072f0cd445dd0510acff8578b3f039672403cb4c4735ed381968f55d27eaf5d3: Status 404 returned error can't find the container with id 072f0cd445dd0510acff8578b3f039672403cb4c4735ed381968f55d27eaf5d3
Jun 08 11:48:01.905885 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:48:01.905862    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4866962b_3c74_43c5_a2eb_fa8209ebeba3.slice/crio-2edd4c79501f2d4c421a66aa34e24dfc4ddc0fd756e19d2ee294168edaf1c971 WatchSource:0}: Error finding container 2edd4c79501f2d4c421a66aa34e24dfc4ddc0fd756e19d2ee294168edaf1c971: Status 404 returned error can't find the container with id 2edd4c79501f2d4c421a66aa34e24dfc4ddc0fd756e19d2ee294168edaf1c971
Jun 08 11:48:01.908260 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:48:01.908239    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40910c2e_803d_4cf1_9451_917a8d88f182.slice/crio-47d420c1890be6d653a07ad1f0831fa5389258b6b8a906a1ad059ebfe7957df8 WatchSource:0}: Error finding container 47d420c1890be6d653a07ad1f0831fa5389258b6b8a906a1ad059ebfe7957df8: Status 404 returned error can't find the container with id 47d420c1890be6d653a07ad1f0831fa5389258b6b8a906a1ad059ebfe7957df8
Jun 08 11:48:01.909856 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:48:01.909835    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda447431c_750b_4ed2_b229_59acbc3534e8.slice/crio-45cc056bd591f9755c73cd85875e83b0bb7f02c9bfbf12ef91ebd6c6b0df2611 WatchSource:0}: Error finding container 45cc056bd591f9755c73cd85875e83b0bb7f02c9bfbf12ef91ebd6c6b0df2611: Status 404 returned error can't find the container with id 45cc056bd591f9755c73cd85875e83b0bb7f02c9bfbf12ef91ebd6c6b0df2611
Jun 08 11:48:01.932104 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:48:01.932083    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad420f23_b7b2_45a6_ad9a_118f28203f03.slice/crio-49e51127a871155d586e234cb23a62a4366a4d3346e6ad7aeb53cc9d1791b8ed WatchSource:0}: Error finding container 49e51127a871155d586e234cb23a62a4366a4d3346e6ad7aeb53cc9d1791b8ed: Status 404 returned error can't find the container with id 49e51127a871155d586e234cb23a62a4366a4d3346e6ad7aeb53cc9d1791b8ed
Jun 08 11:48:01.933476 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:48:01.933456    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ba152b0_fb41_414a_a375_ae9ae8f60d2a.slice/crio-ee7668b9b0ec689a53f6d1ee64a2136d76f67a25e5703586395a0e5893ff2c74 WatchSource:0}: Error finding container ee7668b9b0ec689a53f6d1ee64a2136d76f67a25e5703586395a0e5893ff2c74: Status 404 returned error can't find the container with id ee7668b9b0ec689a53f6d1ee64a2136d76f67a25e5703586395a0e5893ff2c74
Jun 08 11:48:02.170502 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:02.170330    2583 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 08 11:48:02.181528 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:02.181505    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rx5rz"
Jun 08 11:48:02.181639 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:02.181616    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rx5rz" podUID="3b153dca-66ed-4681-b70b-6061158f6676"
Jun 08 11:48:02.189739 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:02.189711    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzh85" event={"ID":"445c0f3b-b186-4d9d-befd-0d1bb215799d","Type":"ContainerStarted","Data":"acfddcaa3a2c12c06daf38e6fe3d420a7bcf1171edf98243c8f1da6e17d0846f"}
Jun 08 11:48:02.191600 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:02.191579    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-189.ec2.internal" event={"ID":"506ef425fb62c5dbd2433ce02355f53c","Type":"ContainerStarted","Data":"b2e1399222ef79f7cfa343add1c852921d41af55ee30e0fbfd05839af43fbbe1"}
Jun 08 11:48:02.192744 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:02.192723    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vxkpp" event={"ID":"5ba152b0-fb41-414a-a375-ae9ae8f60d2a","Type":"ContainerStarted","Data":"ee7668b9b0ec689a53f6d1ee64a2136d76f67a25e5703586395a0e5893ff2c74"}
Jun 08 11:48:02.193740 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:02.193717    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pm229" event={"ID":"ad420f23-b7b2-45a6-ad9a-118f28203f03","Type":"ContainerStarted","Data":"49e51127a871155d586e234cb23a62a4366a4d3346e6ad7aeb53cc9d1791b8ed"}
Jun 08 11:48:02.194774 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:02.194755    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzgvn" event={"ID":"40910c2e-803d-4cf1-9451-917a8d88f182","Type":"ContainerStarted","Data":"47d420c1890be6d653a07ad1f0831fa5389258b6b8a906a1ad059ebfe7957df8"}
Jun 08 11:48:02.195734 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:02.195715    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dplqn" event={"ID":"4866962b-3c74-43c5-a2eb-fa8209ebeba3","Type":"ContainerStarted","Data":"2edd4c79501f2d4c421a66aa34e24dfc4ddc0fd756e19d2ee294168edaf1c971"}
Jun 08 11:48:02.196755 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:02.196730    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dmbw7" event={"ID":"f7cbbb77-d234-4a11-811c-26a8a21019df","Type":"ContainerStarted","Data":"072f0cd445dd0510acff8578b3f039672403cb4c4735ed381968f55d27eaf5d3"}
Jun 08 11:48:02.197831 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:02.197813    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-f4gdp" event={"ID":"fe7bc26d-99a1-4168-996f-f3322e778ed5","Type":"ContainerStarted","Data":"eaf016cf469b17f4af9b52c411c627f13c9ea05f5db05f59a3d9a7c0975b445a"}
Jun 08 11:48:02.198975 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:02.198957    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ps66l" event={"ID":"42241258-7f82-4c8b-9862-4a32ddfcf5f2","Type":"ContainerStarted","Data":"e56d688bbde4c64d660c374ad4531af945c9422de5702b03eb047ba07720aa19"}
Jun 08 11:48:02.201744 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:02.201726    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7" event={"ID":"a447431c-750b-4ed2-b229-59acbc3534e8","Type":"ContainerStarted","Data":"45cc056bd591f9755c73cd85875e83b0bb7f02c9bfbf12ef91ebd6c6b0df2611"}
Jun 08 11:48:02.206997 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:02.206960    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-189.ec2.internal" podStartSLOduration=2.206950073 podStartE2EDuration="2.206950073s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 11:48:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 11:48:02.206699921 +0000 UTC m=+3.478275099" watchObservedRunningTime="2026-06-08 11:48:02.206950073 +0000 UTC m=+3.478525287"
Jun 08 11:48:02.249964 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:02.249938    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 11:43:01 +0000 UTC" deadline="2027-12-14 02:38:48.932256412 +0000 UTC"
Jun 08 11:48:02.249964 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:02.249962    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13286h50m46.68229708s"
Jun 08 11:48:02.740785 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:02.740746    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b2281a3-722f-4113-b3e1-7f4b4614f599-metrics-certs\") pod \"network-metrics-daemon-6m4cb\" (UID: \"0b2281a3-722f-4113-b3e1-7f4b4614f599\") " pod="openshift-multus/network-metrics-daemon-6m4cb"
Jun 08 11:48:02.740979 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:02.740956    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 08 11:48:02.741039 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:02.741026    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b2281a3-722f-4113-b3e1-7f4b4614f599-metrics-certs podName:0b2281a3-722f-4113-b3e1-7f4b4614f599 nodeName:}" failed. No retries permitted until 2026-06-08 11:48:04.741007112 +0000 UTC m=+6.012582280 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b2281a3-722f-4113-b3e1-7f4b4614f599-metrics-certs") pod "network-metrics-daemon-6m4cb" (UID: "0b2281a3-722f-4113-b3e1-7f4b4614f599") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 08 11:48:02.843036 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:02.842207    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62csw\" (UniqueName: \"kubernetes.io/projected/3b153dca-66ed-4681-b70b-6061158f6676-kube-api-access-62csw\") pod \"network-check-target-rx5rz\" (UID: \"3b153dca-66ed-4681-b70b-6061158f6676\") " pod="openshift-network-diagnostics/network-check-target-rx5rz"
Jun 08 11:48:02.843036 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:02.842259    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2579f4ef-e90c-4da0-9617-9ba892dba6ef-original-pull-secret\") pod \"global-pull-secret-syncer-c6hh2\" (UID: \"2579f4ef-e90c-4da0-9617-9ba892dba6ef\") " pod="kube-system/global-pull-secret-syncer-c6hh2"
Jun 08 11:48:02.843036 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:02.842428    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 08 11:48:02.843036 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:02.842495    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2579f4ef-e90c-4da0-9617-9ba892dba6ef-original-pull-secret podName:2579f4ef-e90c-4da0-9617-9ba892dba6ef nodeName:}" failed. No retries permitted until 2026-06-08 11:48:04.842477592 +0000 UTC m=+6.114052752 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2579f4ef-e90c-4da0-9617-9ba892dba6ef-original-pull-secret") pod "global-pull-secret-syncer-c6hh2" (UID: "2579f4ef-e90c-4da0-9617-9ba892dba6ef") : object "kube-system"/"original-pull-secret" not registered
Jun 08 11:48:02.843036 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:02.842917    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 08 11:48:02.843036 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:02.842940    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 08 11:48:02.843036 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:02.842953    2583 projected.go:196] Error preparing data for projected volume kube-api-access-62csw for pod openshift-network-diagnostics/network-check-target-rx5rz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 08 11:48:02.843036 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:02.842997    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3b153dca-66ed-4681-b70b-6061158f6676-kube-api-access-62csw podName:3b153dca-66ed-4681-b70b-6061158f6676 nodeName:}" failed. No retries permitted until 2026-06-08 11:48:04.842982573 +0000 UTC m=+6.114557733 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-62csw" (UniqueName: "kubernetes.io/projected/3b153dca-66ed-4681-b70b-6061158f6676-kube-api-access-62csw") pod "network-check-target-rx5rz" (UID: "3b153dca-66ed-4681-b70b-6061158f6676") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 08 11:48:03.181225 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:03.181195    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6m4cb"
Jun 08 11:48:03.181686 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:03.181337    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6m4cb" podUID="0b2281a3-722f-4113-b3e1-7f4b4614f599"
Jun 08 11:48:03.183312 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:03.183271    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c6hh2"
Jun 08 11:48:03.183447 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:03.183376    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c6hh2" podUID="2579f4ef-e90c-4da0-9617-9ba892dba6ef"
Jun 08 11:48:03.214098 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:03.213281    2583 generic.go:356] "Generic (PLEG): container finished" podID="47d87748d4fd6c5c566093e7f434c0bf" containerID="c6b609f20a1267b631ff99ed1ba0faa487147878dce76deccefc1110cd80ad84" exitCode=0
Jun 08 11:48:03.214098 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:03.213949    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-189.ec2.internal" event={"ID":"47d87748d4fd6c5c566093e7f434c0bf","Type":"ContainerDied","Data":"c6b609f20a1267b631ff99ed1ba0faa487147878dce76deccefc1110cd80ad84"}
Jun 08 11:48:03.250692 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:03.250630    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 11:43:01 +0000 UTC" deadline="2027-12-07 23:36:49.772782288 +0000 UTC"
Jun 08 11:48:03.250692 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:03.250663    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13139h48m46.522123435s"
Jun 08 11:48:04.182117 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:04.181482    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rx5rz"
Jun 08 11:48:04.182117 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:04.181658    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rx5rz" podUID="3b153dca-66ed-4681-b70b-6061158f6676"
Jun 08 11:48:04.241249 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:04.240456    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-189.ec2.internal" event={"ID":"47d87748d4fd6c5c566093e7f434c0bf","Type":"ContainerStarted","Data":"252b0b3a8c964c9fb7239342ba6778502ba7446443d80191b2ab7cc3b77df2a0"}
Jun 08 11:48:04.260994 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:04.260346    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-189.ec2.internal" podStartSLOduration=4.260327082 podStartE2EDuration="4.260327082s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 11:48:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 11:48:04.258971023 +0000 UTC m=+5.530546201" watchObservedRunningTime="2026-06-08 11:48:04.260327082 +0000 UTC m=+5.531902258"
Jun 08 11:48:04.757696 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:04.757658    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b2281a3-722f-4113-b3e1-7f4b4614f599-metrics-certs\") pod \"network-metrics-daemon-6m4cb\" (UID: \"0b2281a3-722f-4113-b3e1-7f4b4614f599\") " pod="openshift-multus/network-metrics-daemon-6m4cb"
Jun 08 11:48:04.757888 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:04.757795    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 08 11:48:04.757888 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:04.757859    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b2281a3-722f-4113-b3e1-7f4b4614f599-metrics-certs podName:0b2281a3-722f-4113-b3e1-7f4b4614f599 nodeName:}" failed. No retries permitted until 2026-06-08 11:48:08.757840954 +0000 UTC m=+10.029416112 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b2281a3-722f-4113-b3e1-7f4b4614f599-metrics-certs") pod "network-metrics-daemon-6m4cb" (UID: "0b2281a3-722f-4113-b3e1-7f4b4614f599") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 08 11:48:04.858919 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:04.858879    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62csw\" (UniqueName: \"kubernetes.io/projected/3b153dca-66ed-4681-b70b-6061158f6676-kube-api-access-62csw\") pod \"network-check-target-rx5rz\" (UID: \"3b153dca-66ed-4681-b70b-6061158f6676\") " pod="openshift-network-diagnostics/network-check-target-rx5rz"
Jun 08 11:48:04.859103 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:04.858935    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2579f4ef-e90c-4da0-9617-9ba892dba6ef-original-pull-secret\") pod \"global-pull-secret-syncer-c6hh2\" (UID: \"2579f4ef-e90c-4da0-9617-9ba892dba6ef\") " pod="kube-system/global-pull-secret-syncer-c6hh2"
Jun 08 11:48:04.859103 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:04.859081    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 08 11:48:04.859233 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:04.859143    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2579f4ef-e90c-4da0-9617-9ba892dba6ef-original-pull-secret podName:2579f4ef-e90c-4da0-9617-9ba892dba6ef nodeName:}" failed. No retries permitted until 2026-06-08 11:48:08.859125151 +0000 UTC m=+10.130700310 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2579f4ef-e90c-4da0-9617-9ba892dba6ef-original-pull-secret") pod "global-pull-secret-syncer-c6hh2" (UID: "2579f4ef-e90c-4da0-9617-9ba892dba6ef") : object "kube-system"/"original-pull-secret" not registered
Jun 08 11:48:04.859572 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:04.859551    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 08 11:48:04.859659 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:04.859579    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 08 11:48:04.859659 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:04.859592    2583 projected.go:196] Error preparing data for projected volume kube-api-access-62csw for pod openshift-network-diagnostics/network-check-target-rx5rz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 08 11:48:04.859659 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:04.859639    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3b153dca-66ed-4681-b70b-6061158f6676-kube-api-access-62csw podName:3b153dca-66ed-4681-b70b-6061158f6676 nodeName:}" failed. No retries permitted until 2026-06-08 11:48:08.859624117 +0000 UTC m=+10.131199272 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-62csw" (UniqueName: "kubernetes.io/projected/3b153dca-66ed-4681-b70b-6061158f6676-kube-api-access-62csw") pod "network-check-target-rx5rz" (UID: "3b153dca-66ed-4681-b70b-6061158f6676") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 08 11:48:05.183256 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:05.183164    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6m4cb"
Jun 08 11:48:05.183836 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:05.183307    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6m4cb" podUID="0b2281a3-722f-4113-b3e1-7f4b4614f599"
Jun 08 11:48:05.184396 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:05.184375    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c6hh2"
Jun 08 11:48:05.184539 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:05.184474    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c6hh2" podUID="2579f4ef-e90c-4da0-9617-9ba892dba6ef"
Jun 08 11:48:06.181023 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:06.180987    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rx5rz"
Jun 08 11:48:06.181213 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:06.181139    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rx5rz" podUID="3b153dca-66ed-4681-b70b-6061158f6676"
Jun 08 11:48:07.181114 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:07.181082    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6m4cb"
Jun 08 11:48:07.181627 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:07.181120    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c6hh2"
Jun 08 11:48:07.181627 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:07.181237    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6m4cb" podUID="0b2281a3-722f-4113-b3e1-7f4b4614f599"
Jun 08 11:48:07.181836 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:07.181676    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c6hh2" podUID="2579f4ef-e90c-4da0-9617-9ba892dba6ef"
Jun 08 11:48:08.180711 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:08.180674    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rx5rz"
Jun 08 11:48:08.180879 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:08.180813    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rx5rz" podUID="3b153dca-66ed-4681-b70b-6061158f6676"
Jun 08 11:48:08.792000 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:08.791848    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b2281a3-722f-4113-b3e1-7f4b4614f599-metrics-certs\") pod \"network-metrics-daemon-6m4cb\" (UID: \"0b2281a3-722f-4113-b3e1-7f4b4614f599\") " pod="openshift-multus/network-metrics-daemon-6m4cb"
Jun 08 11:48:08.792000 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:08.791985    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 08 11:48:08.792511 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:08.792043    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b2281a3-722f-4113-b3e1-7f4b4614f599-metrics-certs podName:0b2281a3-722f-4113-b3e1-7f4b4614f599 nodeName:}" failed. No retries permitted until 2026-06-08 11:48:16.792027704 +0000 UTC m=+18.063602859 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b2281a3-722f-4113-b3e1-7f4b4614f599-metrics-certs") pod "network-metrics-daemon-6m4cb" (UID: "0b2281a3-722f-4113-b3e1-7f4b4614f599") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 08 11:48:08.892584 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:08.892546    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62csw\" (UniqueName: \"kubernetes.io/projected/3b153dca-66ed-4681-b70b-6061158f6676-kube-api-access-62csw\") pod \"network-check-target-rx5rz\" (UID: \"3b153dca-66ed-4681-b70b-6061158f6676\") " pod="openshift-network-diagnostics/network-check-target-rx5rz"
Jun 08 11:48:08.892761 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:08.892594    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2579f4ef-e90c-4da0-9617-9ba892dba6ef-original-pull-secret\") pod \"global-pull-secret-syncer-c6hh2\" (UID: \"2579f4ef-e90c-4da0-9617-9ba892dba6ef\") " pod="kube-system/global-pull-secret-syncer-c6hh2"
Jun 08 11:48:08.892761 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:08.892728    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 08 11:48:08.892761 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:08.892751    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 08 11:48:08.892761 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:08.892750    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 08 11:48:08.892949 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:08.892765    2583 projected.go:196] Error preparing data for projected volume kube-api-access-62csw for pod openshift-network-diagnostics/network-check-target-rx5rz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 08 11:48:08.892949 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:08.892821    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3b153dca-66ed-4681-b70b-6061158f6676-kube-api-access-62csw podName:3b153dca-66ed-4681-b70b-6061158f6676 nodeName:}" failed. No retries permitted until 2026-06-08 11:48:16.892802039 +0000 UTC m=+18.164377196 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-62csw" (UniqueName: "kubernetes.io/projected/3b153dca-66ed-4681-b70b-6061158f6676-kube-api-access-62csw") pod "network-check-target-rx5rz" (UID: "3b153dca-66ed-4681-b70b-6061158f6676") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 08 11:48:08.892949 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:08.892841    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2579f4ef-e90c-4da0-9617-9ba892dba6ef-original-pull-secret podName:2579f4ef-e90c-4da0-9617-9ba892dba6ef nodeName:}" failed. No retries permitted until 2026-06-08 11:48:16.892831016 +0000 UTC m=+18.164406171 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2579f4ef-e90c-4da0-9617-9ba892dba6ef-original-pull-secret") pod "global-pull-secret-syncer-c6hh2" (UID: "2579f4ef-e90c-4da0-9617-9ba892dba6ef") : object "kube-system"/"original-pull-secret" not registered
Jun 08 11:48:09.181727 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:09.181694    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6m4cb"
Jun 08 11:48:09.182007 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:09.181799    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c6hh2"
Jun 08 11:48:09.182163 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:09.182131    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c6hh2" podUID="2579f4ef-e90c-4da0-9617-9ba892dba6ef"
Jun 08 11:48:09.182259 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:09.182157    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6m4cb" podUID="0b2281a3-722f-4113-b3e1-7f4b4614f599"
Jun 08 11:48:10.181382 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:10.181353    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rx5rz"
Jun 08 11:48:10.181813 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:10.181468    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rx5rz" podUID="3b153dca-66ed-4681-b70b-6061158f6676"
Jun 08 11:48:11.181163 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:11.181124    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6m4cb"
Jun 08 11:48:11.181387 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:11.181123    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c6hh2"
Jun 08 11:48:11.181387 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:11.181270    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6m4cb" podUID="0b2281a3-722f-4113-b3e1-7f4b4614f599"
Jun 08 11:48:11.181387 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:11.181289    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c6hh2" podUID="2579f4ef-e90c-4da0-9617-9ba892dba6ef"
Jun 08 11:48:12.181191 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:12.181150    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rx5rz"
Jun 08 11:48:12.181356 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:12.181269    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rx5rz" podUID="3b153dca-66ed-4681-b70b-6061158f6676"
Jun 08 11:48:13.181529 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:13.181489    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6m4cb"
Jun 08 11:48:13.181959 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:13.181494    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c6hh2"
Jun 08 11:48:13.181959 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:13.181634    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6m4cb" podUID="0b2281a3-722f-4113-b3e1-7f4b4614f599"
Jun 08 11:48:13.181959 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:13.181666    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c6hh2" podUID="2579f4ef-e90c-4da0-9617-9ba892dba6ef"
Jun 08 11:48:14.180760 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:14.180726    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rx5rz"
Jun 08 11:48:14.180939 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:14.180851    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rx5rz" podUID="3b153dca-66ed-4681-b70b-6061158f6676"
Jun 08 11:48:15.181382 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:15.181347    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c6hh2"
Jun 08 11:48:15.181841 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:15.181347    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6m4cb"
Jun 08 11:48:15.181841 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:15.181483    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c6hh2" podUID="2579f4ef-e90c-4da0-9617-9ba892dba6ef"
Jun 08 11:48:15.181841 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:15.181533    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6m4cb" podUID="0b2281a3-722f-4113-b3e1-7f4b4614f599"
Jun 08 11:48:16.180816 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:16.180714    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rx5rz"
Jun 08 11:48:16.181074 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:16.180860    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rx5rz" podUID="3b153dca-66ed-4681-b70b-6061158f6676"
Jun 08 11:48:16.852249 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:16.852210    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b2281a3-722f-4113-b3e1-7f4b4614f599-metrics-certs\") pod \"network-metrics-daemon-6m4cb\" (UID: \"0b2281a3-722f-4113-b3e1-7f4b4614f599\") " pod="openshift-multus/network-metrics-daemon-6m4cb"
Jun 08 11:48:16.852762 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:16.852375    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 08 11:48:16.852762 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:16.852452    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b2281a3-722f-4113-b3e1-7f4b4614f599-metrics-certs podName:0b2281a3-722f-4113-b3e1-7f4b4614f599 nodeName:}" failed. No retries permitted until 2026-06-08 11:48:32.852430443 +0000 UTC m=+34.124005613 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b2281a3-722f-4113-b3e1-7f4b4614f599-metrics-certs") pod "network-metrics-daemon-6m4cb" (UID: "0b2281a3-722f-4113-b3e1-7f4b4614f599") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 08 11:48:16.953142 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:16.953106    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62csw\" (UniqueName: \"kubernetes.io/projected/3b153dca-66ed-4681-b70b-6061158f6676-kube-api-access-62csw\") pod \"network-check-target-rx5rz\" (UID: \"3b153dca-66ed-4681-b70b-6061158f6676\") " pod="openshift-network-diagnostics/network-check-target-rx5rz"
Jun 08 11:48:16.953142 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:16.953146    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2579f4ef-e90c-4da0-9617-9ba892dba6ef-original-pull-secret\") pod \"global-pull-secret-syncer-c6hh2\" (UID: \"2579f4ef-e90c-4da0-9617-9ba892dba6ef\") " pod="kube-system/global-pull-secret-syncer-c6hh2"
Jun 08 11:48:16.953358 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:16.953287    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 08 11:48:16.953358 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:16.953305    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 08 11:48:16.953358 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:16.953323    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 08 11:48:16.953358 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:16.953336    2583 projected.go:196] Error preparing data for projected volume kube-api-access-62csw for pod openshift-network-diagnostics/network-check-target-rx5rz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 08 11:48:16.953358 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:16.953357    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2579f4ef-e90c-4da0-9617-9ba892dba6ef-original-pull-secret podName:2579f4ef-e90c-4da0-9617-9ba892dba6ef nodeName:}" failed. No retries permitted until 2026-06-08 11:48:32.953335541 +0000 UTC m=+34.224910700 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2579f4ef-e90c-4da0-9617-9ba892dba6ef-original-pull-secret") pod "global-pull-secret-syncer-c6hh2" (UID: "2579f4ef-e90c-4da0-9617-9ba892dba6ef") : object "kube-system"/"original-pull-secret" not registered
Jun 08 11:48:16.953549 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:16.953378    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3b153dca-66ed-4681-b70b-6061158f6676-kube-api-access-62csw podName:3b153dca-66ed-4681-b70b-6061158f6676 nodeName:}" failed. No retries permitted until 2026-06-08 11:48:32.953368616 +0000 UTC m=+34.224943786 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-62csw" (UniqueName: "kubernetes.io/projected/3b153dca-66ed-4681-b70b-6061158f6676-kube-api-access-62csw") pod "network-check-target-rx5rz" (UID: "3b153dca-66ed-4681-b70b-6061158f6676") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 08 11:48:17.181297 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:17.181206    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6m4cb"
Jun 08 11:48:17.181462 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:17.181215    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c6hh2"
Jun 08 11:48:17.181462 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:17.181375    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6m4cb" podUID="0b2281a3-722f-4113-b3e1-7f4b4614f599"
Jun 08 11:48:17.181462 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:17.181423    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c6hh2" podUID="2579f4ef-e90c-4da0-9617-9ba892dba6ef"
Jun 08 11:48:18.181136 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:18.181102    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rx5rz"
Jun 08 11:48:18.181536 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:18.181226    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rx5rz" podUID="3b153dca-66ed-4681-b70b-6061158f6676"
Jun 08 11:48:19.181436 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:19.181402    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6m4cb"
Jun 08 11:48:19.181899 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:19.181532    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6m4cb" podUID="0b2281a3-722f-4113-b3e1-7f4b4614f599"
Jun 08 11:48:19.181899 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:19.181581    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c6hh2"
Jun 08 11:48:19.181899 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:19.181690    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c6hh2" podUID="2579f4ef-e90c-4da0-9617-9ba892dba6ef"
Jun 08 11:48:20.180793 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:20.180579    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rx5rz"
Jun 08 11:48:20.180911 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:20.180887    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rx5rz" podUID="3b153dca-66ed-4681-b70b-6061158f6676"
Jun 08 11:48:20.274467 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:20.274285    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7" event={"ID":"a447431c-750b-4ed2-b229-59acbc3534e8","Type":"ContainerStarted","Data":"cb88beb6de3ee8272c1d083e2cfa6b7595a4ec7cd7b595e9db2c341d51e9c74f"}
Jun 08 11:48:20.275164 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:20.274507    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7" event={"ID":"a447431c-750b-4ed2-b229-59acbc3534e8","Type":"ContainerStarted","Data":"4b5e319f64299c79c97d09c4d0da949498c2dba95a1de0bad11930620541a535"}
Jun 08 11:48:20.275765 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:20.275738    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzh85" event={"ID":"445c0f3b-b186-4d9d-befd-0d1bb215799d","Type":"ContainerStarted","Data":"42477303446d485f39463e1824b730d6b42b26095b1d76407cba62dad05184ed"}
Jun 08 11:48:20.277088 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:20.277041    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vxkpp" event={"ID":"5ba152b0-fb41-414a-a375-ae9ae8f60d2a","Type":"ContainerStarted","Data":"bdd970d6c4c9368e4e78d87fb0af587be43b6c861339330bac3ccb7ee5d8e24d"}
Jun 08 11:48:20.278760 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:20.278555    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pm229" event={"ID":"ad420f23-b7b2-45a6-ad9a-118f28203f03","Type":"ContainerStarted","Data":"9e8d6d0073c993a56a100e52f57dd9372d0cb1a9a25d0c75d02c7dd193ebcbec"}
Jun 08 11:48:20.280236 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:20.280210    2583 generic.go:356] "Generic (PLEG): container finished" podID="40910c2e-803d-4cf1-9451-917a8d88f182" containerID="007334ceae247f8e6b82a2042cd254b6c1fd7c946bbef251b14c0656d18aad14" exitCode=0
Jun 08 11:48:20.280342 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:20.280290    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzgvn" event={"ID":"40910c2e-803d-4cf1-9451-917a8d88f182","Type":"ContainerDied","Data":"007334ceae247f8e6b82a2042cd254b6c1fd7c946bbef251b14c0656d18aad14"}
Jun 08 11:48:20.281966 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:20.281893    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dmbw7" event={"ID":"f7cbbb77-d234-4a11-811c-26a8a21019df","Type":"ContainerStarted","Data":"ca262def25b27be2f1085fa5e31141dfa09e145ad29420d24eac36a34c88f1ab"}
Jun 08 11:48:20.283600 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:20.283579    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-f4gdp" event={"ID":"fe7bc26d-99a1-4168-996f-f3322e778ed5","Type":"ContainerStarted","Data":"b0e1a8b7519bc5fbb767262e06a16aa8634ba72f73d442dac9a4fcbc28f8a47d"}
Jun 08 11:48:20.285021 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:20.284992    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ps66l" event={"ID":"42241258-7f82-4c8b-9862-4a32ddfcf5f2","Type":"ContainerStarted","Data":"51ef8a0d0118f2a5106c6954a90ea1ee6fd6e0cb40319ae6033647b9b1409537"}
Jun 08 11:48:20.293543 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:20.293491    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vxkpp" podStartSLOduration=3.275940619 podStartE2EDuration="21.29347386s" totalImagesPullingTime="18.017533241s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 11:47:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 11:48:20.292952661 +0000 UTC m=+21.564527836" watchObservedRunningTime="2026-06-08 11:48:20.29347386 +0000 UTC m=+21.565049036"
Jun 08 11:48:20.311259 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:20.311215    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ps66l" podStartSLOduration=3.258673163 podStartE2EDuration="21.311202341s" totalImagesPullingTime="18.052529178s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 11:47:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 11:48:20.310966144 +0000 UTC m=+21.582541321" watchObservedRunningTime="2026-06-08 11:48:20.311202341 +0000 UTC m=+21.582777515"
Jun 08 11:48:20.352437 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:20.352393    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-f4gdp" podStartSLOduration=3.24605619 podStartE2EDuration="21.352378298s" totalImagesPullingTime="18.106322108s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 11:47:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 11:48:20.352017569 +0000 UTC m=+21.623592744" watchObservedRunningTime="2026-06-08 11:48:20.352378298 +0000 UTC m=+21.623953474"
Jun 08 11:48:20.385709 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:20.385669    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-pm229" podStartSLOduration=3.3681318559999998 podStartE2EDuration="21.385655732s" totalImagesPullingTime="18.017523876s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 11:47:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 11:48:20.36925112 +0000 UTC m=+21.640826308" watchObservedRunningTime="2026-06-08 11:48:20.385655732 +0000 UTC m=+21.657230908"
Jun 08 11:48:20.385831 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:20.385784    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-dmbw7" podStartSLOduration=3.3377735250000002 podStartE2EDuration="21.385776831s" totalImagesPullingTime="18.048003306s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 11:47:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 11:48:20.385360983 +0000 UTC m=+21.656936161" watchObservedRunningTime="2026-06-08 11:48:20.385776831 +0000 UTC m=+21.657352019"
Jun 08 11:48:21.181089 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:21.181037    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6m4cb"
Jun 08 11:48:21.181281 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:21.181214    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6m4cb" podUID="0b2281a3-722f-4113-b3e1-7f4b4614f599"
Jun 08 11:48:21.181281 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:21.181227    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c6hh2"
Jun 08 11:48:21.181386 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:21.181313    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c6hh2" podUID="2579f4ef-e90c-4da0-9617-9ba892dba6ef"
Jun 08 11:48:21.291514 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:21.291469    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7" event={"ID":"a447431c-750b-4ed2-b229-59acbc3534e8","Type":"ContainerStarted","Data":"793772f3d2f4aa9aca0684d1d1d59d5403c9dc0391960e9784d2e6ad9cb633b0"}
Jun 08 11:48:21.291803 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:21.291576    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7" event={"ID":"a447431c-750b-4ed2-b229-59acbc3534e8","Type":"ContainerStarted","Data":"015be5ef7b4ec009cb8d936e2c84c4e181bac690716bf1d3ca49f86ddb675d0d"}
Jun 08 11:48:21.291803 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:21.291627    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7" event={"ID":"a447431c-750b-4ed2-b229-59acbc3534e8","Type":"ContainerStarted","Data":"7837d8f5506e47b34298651ddbefa7692683665a175a3edeeac8288ba1fbf0d1"}
Jun 08 11:48:21.291803 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:21.291678    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7" event={"ID":"a447431c-750b-4ed2-b229-59acbc3534e8","Type":"ContainerStarted","Data":"10a47bc7dccd1c22870464b310db696cfbe6ef2f85981ed38a16bd049bb64994"}
Jun 08 11:48:21.428019 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:21.427991    2583 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jun 08 11:48:22.180550 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:22.180518    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rx5rz"
Jun 08 11:48:22.180877 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:22.180649    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rx5rz" podUID="3b153dca-66ed-4681-b70b-6061158f6676"
Jun 08 11:48:22.185273 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:22.185173    2583 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-08T11:48:21.42801377Z","UUID":"2bd923f5-7b54-4a8a-b5ec-c86f6c1a2be2","Handler":null,"Name":"","Endpoint":""}
Jun 08 11:48:22.186831 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:22.186802    2583 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jun 08 11:48:22.186930 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:22.186845    2583 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jun 08 11:48:22.295820 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:22.295790    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dplqn" event={"ID":"4866962b-3c74-43c5-a2eb-fa8209ebeba3","Type":"ContainerStarted","Data":"212d7a0c9199d0c27f3b610f0d7f8473346f0d4de2864f304a545c1df7e8f40a"}
Jun 08 11:48:22.297986 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:22.297964    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzh85" event={"ID":"445c0f3b-b186-4d9d-befd-0d1bb215799d","Type":"ContainerStarted","Data":"fa7e608742e9b8650646acb08192c612135bc4d203fc62be1fbe3057641de46f"}
Jun 08 11:48:22.314499 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:22.314438    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-dplqn" podStartSLOduration=5.289787377 podStartE2EDuration="23.31442405s" totalImagesPullingTime="18.024636673s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 11:47:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 11:48:22.313798034 +0000 UTC m=+23.585373211" watchObservedRunningTime="2026-06-08 11:48:22.31442405 +0000 UTC m=+23.585999225"
Jun 08 11:48:22.582579 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:22.582532    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vxkpp"
Jun 08 11:48:22.583251 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:22.583227    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vxkpp"
Jun 08 11:48:23.181782 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:23.181690    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6m4cb"
Jun 08 11:48:23.181944 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:23.181690    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c6hh2"
Jun 08 11:48:23.181944 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:23.181844    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6m4cb" podUID="0b2281a3-722f-4113-b3e1-7f4b4614f599"
Jun 08 11:48:23.181944 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:23.181908    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c6hh2" podUID="2579f4ef-e90c-4da0-9617-9ba892dba6ef"
Jun 08 11:48:23.304173 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:23.304127    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7" event={"ID":"a447431c-750b-4ed2-b229-59acbc3534e8","Type":"ContainerStarted","Data":"bf86b43a3f63053295d7cde36f1f41e9aef4f2087666aebaf3d1466dc3b66c55"}
Jun 08 11:48:23.306435 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:23.306408    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzh85" event={"ID":"445c0f3b-b186-4d9d-befd-0d1bb215799d","Type":"ContainerStarted","Data":"f00594710371b45a062020d96d0c7343288412d324055bd4d5a48ea901c279a5"}
Jun 08 11:48:23.306954 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:23.306928    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vxkpp"
Jun 08 11:48:23.307199 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:23.307180    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vxkpp"
Jun 08 11:48:23.326380 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:23.326322    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzh85" podStartSLOduration=4.244526473 podStartE2EDuration="24.326304869s" totalImagesPullingTime="20.081778396s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 11:47:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 11:48:23.3262517 +0000 UTC m=+24.597826877" watchObservedRunningTime="2026-06-08 11:48:23.326304869 +0000 UTC m=+24.597880049"
Jun 08 11:48:24.181419 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:24.181212    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rx5rz"
Jun 08 11:48:24.181628 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:24.181519    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rx5rz" podUID="3b153dca-66ed-4681-b70b-6061158f6676"
Jun 08 11:48:25.180772 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:25.180696    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6m4cb"
Jun 08 11:48:25.181888 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:25.180822    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6m4cb" podUID="0b2281a3-722f-4113-b3e1-7f4b4614f599"
Jun 08 11:48:25.181888 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:25.180886    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c6hh2"
Jun 08 11:48:25.181888 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:25.180997    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c6hh2" podUID="2579f4ef-e90c-4da0-9617-9ba892dba6ef"
Jun 08 11:48:25.313550 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:25.313290    2583 generic.go:356] "Generic (PLEG): container finished" podID="40910c2e-803d-4cf1-9451-917a8d88f182" containerID="1f629ce8b8a7d9b1706e4074f846d567f2901c4410435032ac7f5f6b5048aed3" exitCode=0
Jun 08 11:48:25.313705 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:25.313378    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzgvn" event={"ID":"40910c2e-803d-4cf1-9451-917a8d88f182","Type":"ContainerDied","Data":"1f629ce8b8a7d9b1706e4074f846d567f2901c4410435032ac7f5f6b5048aed3"}
Jun 08 11:48:25.317406 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:25.317383    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7" event={"ID":"a447431c-750b-4ed2-b229-59acbc3534e8","Type":"ContainerStarted","Data":"c9ad931047421e6548e8e2b7de9067c782b6f0a4115e5e7f4337bc0c5b4b8bf4"}
Jun 08 11:48:25.317634 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:25.317621    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7"
Jun 08 11:48:25.333547 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:25.333529    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7"
Jun 08 11:48:25.370795 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:25.370750    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7" podStartSLOduration=8.282525467 podStartE2EDuration="26.370738795s" totalImagesPullingTime="18.088213328s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 11:47:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 11:48:25.370538755 +0000 UTC m=+26.642113933" watchObservedRunningTime="2026-06-08 11:48:25.370738795 +0000 UTC m=+26.642313970"
Jun 08 11:48:26.181412 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:26.181381    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rx5rz"
Jun 08 11:48:26.181767 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:26.181477    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rx5rz" podUID="3b153dca-66ed-4681-b70b-6061158f6676"
Jun 08 11:48:26.320086 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:26.320030    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7"
Jun 08 11:48:26.320290 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:26.320133    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7"
Jun 08 11:48:26.337212 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:26.336960    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7"
Jun 08 11:48:27.180627 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:27.180592    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c6hh2"
Jun 08 11:48:27.180942 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:27.180633    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6m4cb"
Jun 08 11:48:27.180942 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:27.180702    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c6hh2" podUID="2579f4ef-e90c-4da0-9617-9ba892dba6ef"
Jun 08 11:48:27.180942 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:27.180830    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6m4cb" podUID="0b2281a3-722f-4113-b3e1-7f4b4614f599"
Jun 08 11:48:27.276462 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:27.276428    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-c6hh2"]
Jun 08 11:48:27.279789 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:27.279760    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rx5rz"]
Jun 08 11:48:27.279929 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:27.279879    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rx5rz"
Jun 08 11:48:27.279980 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:27.279962    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rx5rz" podUID="3b153dca-66ed-4681-b70b-6061158f6676"
Jun 08 11:48:27.282433 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:27.282411    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6m4cb"]
Jun 08 11:48:27.323991 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:27.323966    2583 generic.go:356] "Generic (PLEG): container finished" podID="40910c2e-803d-4cf1-9451-917a8d88f182" containerID="f7b6019a9f34719fe5ef601f5ab8a26f20b19b38ba1d0eacdb02b66babe1b9d0" exitCode=0
Jun 08 11:48:27.324133 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:27.324106    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzgvn" event={"ID":"40910c2e-803d-4cf1-9451-917a8d88f182","Type":"ContainerDied","Data":"f7b6019a9f34719fe5ef601f5ab8a26f20b19b38ba1d0eacdb02b66babe1b9d0"}
Jun 08 11:48:27.324133 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:27.324122    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c6hh2"
Jun 08 11:48:27.324471 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:27.324456    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6m4cb"
Jun 08 11:48:27.324566 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:27.324446    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c6hh2" podUID="2579f4ef-e90c-4da0-9617-9ba892dba6ef"
Jun 08 11:48:27.324647 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:27.324542    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6m4cb" podUID="0b2281a3-722f-4113-b3e1-7f4b4614f599"
Jun 08 11:48:29.183741 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:29.183711    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6m4cb"
Jun 08 11:48:29.183741 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:29.183729    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rx5rz"
Jun 08 11:48:29.184201 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:29.183711    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c6hh2"
Jun 08 11:48:29.184201 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:29.183849    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rx5rz" podUID="3b153dca-66ed-4681-b70b-6061158f6676"
Jun 08 11:48:29.184201 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:29.183903    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c6hh2" podUID="2579f4ef-e90c-4da0-9617-9ba892dba6ef"
Jun 08 11:48:29.184201 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:29.183964    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6m4cb" podUID="0b2281a3-722f-4113-b3e1-7f4b4614f599"
Jun 08 11:48:29.330476 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:29.330437    2583 generic.go:356] "Generic (PLEG): container finished" podID="40910c2e-803d-4cf1-9451-917a8d88f182" containerID="0a23b39039ff896c6e9f7e1639003a9a0365433140a9f1a313b965387eaf903d" exitCode=0
Jun 08 11:48:29.330660 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:29.330492    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzgvn" event={"ID":"40910c2e-803d-4cf1-9451-917a8d88f182","Type":"ContainerDied","Data":"0a23b39039ff896c6e9f7e1639003a9a0365433140a9f1a313b965387eaf903d"}
Jun 08 11:48:31.184756 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:31.184519    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rx5rz"
Jun 08 11:48:31.185220 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:31.184529    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6m4cb"
Jun 08 11:48:31.185220 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:31.184847    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rx5rz" podUID="3b153dca-66ed-4681-b70b-6061158f6676"
Jun 08 11:48:31.185220 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:31.184934    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6m4cb" podUID="0b2281a3-722f-4113-b3e1-7f4b4614f599"
Jun 08 11:48:31.185220 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:31.184512    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c6hh2"
Jun 08 11:48:31.185220 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:31.185040    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c6hh2" podUID="2579f4ef-e90c-4da0-9617-9ba892dba6ef"
Jun 08 11:48:32.573561 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:32.573528    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-189.ec2.internal" event="NodeReady"
Jun 08 11:48:32.574084 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:32.573663    2583 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jun 08 11:48:32.614590 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:32.614559    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5877df4c8d-zkhq7"]
Jun 08 11:48:32.642297 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:32.642267    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5nvrq"]
Jun 08 11:48:32.642473 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:32.642378    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5877df4c8d-zkhq7"
Jun 08 11:48:32.646434 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:32.646384    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jun 08 11:48:32.646756 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:32.646740    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-r2n9k\""
Jun 08 11:48:32.647036 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:32.647019    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jun 08 11:48:32.647729 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:32.647707    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jun 08 11:48:32.655931 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:32.655887    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jun 08 11:48:32.658197 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:32.658166    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5877df4c8d-zkhq7"]
Jun 08 11:48:32.658314 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:32.658216    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-j82tx"]
Jun 08 11:48:32.659029 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:32.659006    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5nvrq"
Jun 08 11:48:32.663710 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:32.663692    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jun 08 11:48:32.663710 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:32.663699    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-s6fj9\""
Jun 08 11:48:32.663868 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:32.663745    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jun 08 11:48:32.680033 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:32.680011    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-j82tx"]
Jun 08 11:48:32.680149 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:32.680069    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5nvrq"]
Jun 08 11:48:32.680149 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:32.680134    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-j82tx"
Jun 08 11:48:32.690544 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:32.690510    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jun 08 11:48:32.690645 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:32.690509    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jun 08 11:48:32.690645 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:32.690605    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jun 08 11:48:32.690845 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:32.690831    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-q8jx4\""
Jun 08 11:48:32.775335 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:32.775258    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkn4q\" (UniqueName: \"kubernetes.io/projected/91c73bfb-0940-4926-8f4e-318c3f01d5c2-kube-api-access-lkn4q\") pod \"image-registry-5877df4c8d-zkhq7\" (UID: \"91c73bfb-0940-4926-8f4e-318c3f01d5c2\") " pod="openshift-image-registry/image-registry-5877df4c8d-zkhq7"
Jun 08 11:48:32.775335 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:32.775306    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/91c73bfb-0940-4926-8f4e-318c3f01d5c2-ca-trust-extracted\") pod \"image-registry-5877df4c8d-zkhq7\" (UID: \"91c73bfb-0940-4926-8f4e-318c3f01d5c2\") " pod="openshift-image-registry/image-registry-5877df4c8d-zkhq7"
Jun 08 11:48:32.775538 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:32.775337    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cjw6\" (UniqueName: \"kubernetes.io/projected/5853cb11-e926-49de-a93b-7b64dc90d574-kube-api-access-5cjw6\") pod \"dns-default-5nvrq\" (UID: \"5853cb11-e926-49de-a93b-7b64dc90d574\") " pod="openshift-dns/dns-default-5nvrq"
Jun 08 11:48:32.775538 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:32.775365    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9wf8\" (UniqueName: \"kubernetes.io/projected/97cb5e19-342d-49be-ad3a-346a649f83af-kube-api-access-n9wf8\") pod \"ingress-canary-j82tx\" (UID: \"97cb5e19-342d-49be-ad3a-346a649f83af\") " pod="openshift-ingress-canary/ingress-canary-j82tx"
Jun 08 11:48:32.775538 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:32.775396    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/91c73bfb-0940-4926-8f4e-318c3f01d5c2-image-registry-private-configuration\") pod \"image-registry-5877df4c8d-zkhq7\" (UID: \"91c73bfb-0940-4926-8f4e-318c3f01d5c2\") " pod="openshift-image-registry/image-registry-5877df4c8d-zkhq7"
Jun 08 11:48:32.775538 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:32.775450    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5853cb11-e926-49de-a93b-7b64dc90d574-metrics-tls\") pod \"dns-default-5nvrq\" (UID: \"5853cb11-e926-49de-a93b-7b64dc90d574\") " pod="openshift-dns/dns-default-5nvrq"
Jun 08 11:48:32.775538 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:32.775518    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/97cb5e19-342d-49be-ad3a-346a649f83af-cert\") pod \"ingress-canary-j82tx\" (UID: \"97cb5e19-342d-49be-ad3a-346a649f83af\") " pod="openshift-ingress-canary/ingress-canary-j82tx"
Jun 08 11:48:32.775733 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:32.775577    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/91c73bfb-0940-4926-8f4e-318c3f01d5c2-registry-certificates\") pod \"image-registry-5877df4c8d-zkhq7\" (UID: \"91c73bfb-0940-4926-8f4e-318c3f01d5c2\") " pod="openshift-image-registry/image-registry-5877df4c8d-zkhq7"
Jun 08 11:48:32.775733 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:32.775605    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/91c73bfb-0940-4926-8f4e-318c3f01d5c2-bound-sa-token\") pod \"image-registry-5877df4c8d-zkhq7\" (UID: \"91c73bfb-0940-4926-8f4e-318c3f01d5c2\") " pod="openshift-image-registry/image-registry-5877df4c8d-zkhq7"
Jun 08 11:48:32.775733 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:32.775631    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91c73bfb-0940-4926-8f4e-318c3f01d5c2-registry-tls\") pod \"image-registry-5877df4c8d-zkhq7\" (UID: \"91c73bfb-0940-4926-8f4e-318c3f01d5c2\") " pod="openshift-image-registry/image-registry-5877df4c8d-zkhq7"
Jun 08 11:48:32.775733 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:32.775655    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5853cb11-e926-49de-a93b-7b64dc90d574-tmp-dir\") pod \"dns-default-5nvrq\" (UID: \"5853cb11-e926-49de-a93b-7b64dc90d574\") " pod="openshift-dns/dns-default-5nvrq"
Jun 08 11:48:32.775733 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:32.775706    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/91c73bfb-0940-4926-8f4e-318c3f01d5c2-trusted-ca\") pod \"image-registry-5877df4c8d-zkhq7\" (UID: \"91c73bfb-0940-4926-8f4e-318c3f01d5c2\") " pod="openshift-image-registry/image-registry-5877df4c8d-zkhq7"
Jun 08 11:48:32.775733 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:32.775733    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5853cb11-e926-49de-a93b-7b64dc90d574-config-volume\") pod \"dns-default-5nvrq\" (UID: \"5853cb11-e926-49de-a93b-7b64dc90d574\") " pod="openshift-dns/dns-default-5nvrq"
Jun 08 11:48:32.775903 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:32.775769    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/91c73bfb-0940-4926-8f4e-318c3f01d5c2-installation-pull-secrets\") pod \"image-registry-5877df4c8d-zkhq7\" (UID: \"91c73bfb-0940-4926-8f4e-318c3f01d5c2\") " pod="openshift-image-registry/image-registry-5877df4c8d-zkhq7"
Jun 08 11:48:32.876572 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:32.876532    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cjw6\" (UniqueName: \"kubernetes.io/projected/5853cb11-e926-49de-a93b-7b64dc90d574-kube-api-access-5cjw6\") pod \"dns-default-5nvrq\" (UID: \"5853cb11-e926-49de-a93b-7b64dc90d574\") " pod="openshift-dns/dns-default-5nvrq"
Jun 08 11:48:32.876572 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:32.876576    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9wf8\" (UniqueName: \"kubernetes.io/projected/97cb5e19-342d-49be-ad3a-346a649f83af-kube-api-access-n9wf8\") pod \"ingress-canary-j82tx\" (UID: \"97cb5e19-342d-49be-ad3a-346a649f83af\") " pod="openshift-ingress-canary/ingress-canary-j82tx"
Jun 08 11:48:32.876818 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:32.876607    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/91c73bfb-0940-4926-8f4e-318c3f01d5c2-image-registry-private-configuration\") pod \"image-registry-5877df4c8d-zkhq7\" (UID: \"91c73bfb-0940-4926-8f4e-318c3f01d5c2\") " pod="openshift-image-registry/image-registry-5877df4c8d-zkhq7"
Jun 08 11:48:32.876818 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:32.876636    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5853cb11-e926-49de-a93b-7b64dc90d574-metrics-tls\") pod \"dns-default-5nvrq\" (UID: \"5853cb11-e926-49de-a93b-7b64dc90d574\") " pod="openshift-dns/dns-default-5nvrq"
Jun 08 11:48:32.876818 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:32.876655    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/97cb5e19-342d-49be-ad3a-346a649f83af-cert\") pod \"ingress-canary-j82tx\" (UID: \"97cb5e19-342d-49be-ad3a-346a649f83af\") " pod="openshift-ingress-canary/ingress-canary-j82tx"
Jun 08 11:48:32.876818 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:32.876708    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/91c73bfb-0940-4926-8f4e-318c3f01d5c2-registry-certificates\") pod \"image-registry-5877df4c8d-zkhq7\" (UID: \"91c73bfb-0940-4926-8f4e-318c3f01d5c2\") " pod="openshift-image-registry/image-registry-5877df4c8d-zkhq7"
Jun 08 11:48:32.876818 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:32.876741    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/91c73bfb-0940-4926-8f4e-318c3f01d5c2-bound-sa-token\") pod \"image-registry-5877df4c8d-zkhq7\" (UID: \"91c73bfb-0940-4926-8f4e-318c3f01d5c2\") " pod="openshift-image-registry/image-registry-5877df4c8d-zkhq7"
Jun 08 11:48:32.876818 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:32.876768    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91c73bfb-0940-4926-8f4e-318c3f01d5c2-registry-tls\") pod \"image-registry-5877df4c8d-zkhq7\" (UID: \"91c73bfb-0940-4926-8f4e-318c3f01d5c2\") " pod="openshift-image-registry/image-registry-5877df4c8d-zkhq7"
Jun 08 11:48:32.876818 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:32.876783    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 08 11:48:32.877182 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:32.876874    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5853cb11-e926-49de-a93b-7b64dc90d574-metrics-tls podName:5853cb11-e926-49de-a93b-7b64dc90d574 nodeName:}" failed. No retries permitted until 2026-06-08 11:48:33.376854914 +0000 UTC m=+34.648430081 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5853cb11-e926-49de-a93b-7b64dc90d574-metrics-tls") pod "dns-default-5nvrq" (UID: "5853cb11-e926-49de-a93b-7b64dc90d574") : secret "dns-default-metrics-tls" not found
Jun 08 11:48:32.877182 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:32.876791    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5853cb11-e926-49de-a93b-7b64dc90d574-tmp-dir\") pod \"dns-default-5nvrq\" (UID: \"5853cb11-e926-49de-a93b-7b64dc90d574\") " pod="openshift-dns/dns-default-5nvrq"
Jun 08 11:48:32.877182 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:32.876981    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/91c73bfb-0940-4926-8f4e-318c3f01d5c2-trusted-ca\") pod \"image-registry-5877df4c8d-zkhq7\" (UID: \"91c73bfb-0940-4926-8f4e-318c3f01d5c2\") " pod="openshift-image-registry/image-registry-5877df4c8d-zkhq7"
Jun 08 11:48:32.877182 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:32.877019    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5853cb11-e926-49de-a93b-7b64dc90d574-config-volume\") pod \"dns-default-5nvrq\" (UID: \"5853cb11-e926-49de-a93b-7b64dc90d574\") " pod="openshift-dns/dns-default-5nvrq"
Jun 08 11:48:32.877182 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:32.877042    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 08 11:48:32.877182 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:32.877076    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5877df4c8d-zkhq7: secret "image-registry-tls" not found
Jun 08 11:48:32.877182 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:32.877089    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5853cb11-e926-49de-a93b-7b64dc90d574-tmp-dir\") pod \"dns-default-5nvrq\" (UID: \"5853cb11-e926-49de-a93b-7b64dc90d574\") " pod="openshift-dns/dns-default-5nvrq"
Jun 08 11:48:32.877182 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:32.877143    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91c73bfb-0940-4926-8f4e-318c3f01d5c2-registry-tls podName:91c73bfb-0940-4926-8f4e-318c3f01d5c2 nodeName:}" failed. No retries permitted until 2026-06-08 11:48:33.377120585 +0000 UTC m=+34.648695759 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/91c73bfb-0940-4926-8f4e-318c3f01d5c2-registry-tls") pod "image-registry-5877df4c8d-zkhq7" (UID: "91c73bfb-0940-4926-8f4e-318c3f01d5c2") : secret "image-registry-tls" not found
Jun 08 11:48:32.877182 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:32.877073    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b2281a3-722f-4113-b3e1-7f4b4614f599-metrics-certs\") pod \"network-metrics-daemon-6m4cb\" (UID: \"0b2281a3-722f-4113-b3e1-7f4b4614f599\") " pod="openshift-multus/network-metrics-daemon-6m4cb"
Jun 08 11:48:32.877604 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:32.877190    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/91c73bfb-0940-4926-8f4e-318c3f01d5c2-installation-pull-secrets\") pod \"image-registry-5877df4c8d-zkhq7\" (UID: \"91c73bfb-0940-4926-8f4e-318c3f01d5c2\") " pod="openshift-image-registry/image-registry-5877df4c8d-zkhq7"
Jun 08 11:48:32.877604 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:32.877215    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkn4q\" (UniqueName: \"kubernetes.io/projected/91c73bfb-0940-4926-8f4e-318c3f01d5c2-kube-api-access-lkn4q\") pod \"image-registry-5877df4c8d-zkhq7\" (UID: \"91c73bfb-0940-4926-8f4e-318c3f01d5c2\") " pod="openshift-image-registry/image-registry-5877df4c8d-zkhq7"
Jun 08 11:48:32.877604 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:32.877256    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/91c73bfb-0940-4926-8f4e-318c3f01d5c2-ca-trust-extracted\") pod \"image-registry-5877df4c8d-zkhq7\" (UID: \"91c73bfb-0940-4926-8f4e-318c3f01d5c2\") " pod="openshift-image-registry/image-registry-5877df4c8d-zkhq7"
Jun 08 11:48:32.877754 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:32.877154    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 08 11:48:32.877754 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:32.877649    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/91c73bfb-0940-4926-8f4e-318c3f01d5c2-registry-certificates\") pod \"image-registry-5877df4c8d-zkhq7\" (UID: \"91c73bfb-0940-4926-8f4e-318c3f01d5c2\") " pod="openshift-image-registry/image-registry-5877df4c8d-zkhq7"
Jun 08 11:48:32.877754 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:32.877664    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5853cb11-e926-49de-a93b-7b64dc90d574-config-volume\") pod \"dns-default-5nvrq\" (UID: \"5853cb11-e926-49de-a93b-7b64dc90d574\") " pod="openshift-dns/dns-default-5nvrq"
Jun 08 11:48:32.877754 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:32.877713    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b2281a3-722f-4113-b3e1-7f4b4614f599-metrics-certs podName:0b2281a3-722f-4113-b3e1-7f4b4614f599 nodeName:}" failed. No retries permitted until 2026-06-08 11:49:04.877691446 +0000 UTC m=+66.149266606 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b2281a3-722f-4113-b3e1-7f4b4614f599-metrics-certs") pod "network-metrics-daemon-6m4cb" (UID: "0b2281a3-722f-4113-b3e1-7f4b4614f599") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 08 11:48:32.877970 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:32.877949    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/91c73bfb-0940-4926-8f4e-318c3f01d5c2-trusted-ca\") pod \"image-registry-5877df4c8d-zkhq7\" (UID: \"91c73bfb-0940-4926-8f4e-318c3f01d5c2\") " pod="openshift-image-registry/image-registry-5877df4c8d-zkhq7"
Jun 08 11:48:32.878224 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:32.878201    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/91c73bfb-0940-4926-8f4e-318c3f01d5c2-ca-trust-extracted\") pod \"image-registry-5877df4c8d-zkhq7\" (UID: \"91c73bfb-0940-4926-8f4e-318c3f01d5c2\") " pod="openshift-image-registry/image-registry-5877df4c8d-zkhq7"
Jun 08 11:48:32.881495 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:32.881466    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/91c73bfb-0940-4926-8f4e-318c3f01d5c2-image-registry-private-configuration\") pod \"image-registry-5877df4c8d-zkhq7\" (UID: \"91c73bfb-0940-4926-8f4e-318c3f01d5c2\") " pod="openshift-image-registry/image-registry-5877df4c8d-zkhq7"
Jun 08 11:48:32.881495 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:32.881471    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/91c73bfb-0940-4926-8f4e-318c3f01d5c2-installation-pull-secrets\") pod \"image-registry-5877df4c8d-zkhq7\" (UID: \"91c73bfb-0940-4926-8f4e-318c3f01d5c2\") " pod="openshift-image-registry/image-registry-5877df4c8d-zkhq7"
Jun 08 11:48:32.881495 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:32.881488    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/97cb5e19-342d-49be-ad3a-346a649f83af-cert\") pod \"ingress-canary-j82tx\" (UID: \"97cb5e19-342d-49be-ad3a-346a649f83af\") " pod="openshift-ingress-canary/ingress-canary-j82tx"
Jun 08 11:48:32.890145 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:32.889843    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/91c73bfb-0940-4926-8f4e-318c3f01d5c2-bound-sa-token\") pod \"image-registry-5877df4c8d-zkhq7\" (UID: \"91c73bfb-0940-4926-8f4e-318c3f01d5c2\") " pod="openshift-image-registry/image-registry-5877df4c8d-zkhq7"
Jun 08 11:48:32.890432 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:32.890404    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9wf8\" (UniqueName: \"kubernetes.io/projected/97cb5e19-342d-49be-ad3a-346a649f83af-kube-api-access-n9wf8\") pod \"ingress-canary-j82tx\" (UID: \"97cb5e19-342d-49be-ad3a-346a649f83af\") " pod="openshift-ingress-canary/ingress-canary-j82tx"
Jun 08 11:48:32.890432 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:32.890430    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkn4q\" (UniqueName: \"kubernetes.io/projected/91c73bfb-0940-4926-8f4e-318c3f01d5c2-kube-api-access-lkn4q\") pod \"image-registry-5877df4c8d-zkhq7\" (UID: \"91c73bfb-0940-4926-8f4e-318c3f01d5c2\") " pod="openshift-image-registry/image-registry-5877df4c8d-zkhq7"
Jun 08 11:48:32.891489 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:32.891468    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cjw6\" (UniqueName: \"kubernetes.io/projected/5853cb11-e926-49de-a93b-7b64dc90d574-kube-api-access-5cjw6\") pod \"dns-default-5nvrq\" (UID: \"5853cb11-e926-49de-a93b-7b64dc90d574\") " pod="openshift-dns/dns-default-5nvrq"
Jun 08 11:48:32.977992 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:32.977956    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62csw\" (UniqueName: \"kubernetes.io/projected/3b153dca-66ed-4681-b70b-6061158f6676-kube-api-access-62csw\") pod \"network-check-target-rx5rz\" (UID: \"3b153dca-66ed-4681-b70b-6061158f6676\") " pod="openshift-network-diagnostics/network-check-target-rx5rz"
Jun 08 11:48:32.977992 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:32.977999    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2579f4ef-e90c-4da0-9617-9ba892dba6ef-original-pull-secret\") pod \"global-pull-secret-syncer-c6hh2\" (UID: \"2579f4ef-e90c-4da0-9617-9ba892dba6ef\") " pod="kube-system/global-pull-secret-syncer-c6hh2"
Jun 08 11:48:32.978251 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:32.978107    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 08 11:48:32.978251 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:32.978129    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 08 11:48:32.978251 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:32.978155    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 08 11:48:32.978251 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:32.978166    2583 projected.go:196] Error preparing data for projected volume kube-api-access-62csw for pod openshift-network-diagnostics/network-check-target-rx5rz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 08 11:48:32.978251 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:32.978223    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2579f4ef-e90c-4da0-9617-9ba892dba6ef-original-pull-secret podName:2579f4ef-e90c-4da0-9617-9ba892dba6ef nodeName:}" failed. No retries permitted until 2026-06-08 11:49:04.97820576 +0000 UTC m=+66.249780942 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2579f4ef-e90c-4da0-9617-9ba892dba6ef-original-pull-secret") pod "global-pull-secret-syncer-c6hh2" (UID: "2579f4ef-e90c-4da0-9617-9ba892dba6ef") : object "kube-system"/"original-pull-secret" not registered
Jun 08 11:48:32.978251 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:32.978242    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3b153dca-66ed-4681-b70b-6061158f6676-kube-api-access-62csw podName:3b153dca-66ed-4681-b70b-6061158f6676 nodeName:}" failed. No retries permitted until 2026-06-08 11:49:04.978233867 +0000 UTC m=+66.249809022 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-62csw" (UniqueName: "kubernetes.io/projected/3b153dca-66ed-4681-b70b-6061158f6676-kube-api-access-62csw") pod "network-check-target-rx5rz" (UID: "3b153dca-66ed-4681-b70b-6061158f6676") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 08 11:48:32.988972 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:32.988946    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-j82tx"
Jun 08 11:48:33.181341 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:33.181305    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rx5rz"
Jun 08 11:48:33.181519 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:33.181305    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c6hh2"
Jun 08 11:48:33.181826 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:33.181305    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6m4cb"
Jun 08 11:48:33.184325 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:33.184299    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 08 11:48:33.184443 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:33.184372    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jun 08 11:48:33.185004 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:33.184731    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gntjz\""
Jun 08 11:48:33.185004 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:33.184768    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jun 08 11:48:33.185004 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:33.184773    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dzkjg\""
Jun 08 11:48:33.185004 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:33.184775    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jun 08 11:48:33.381840 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:33.381626    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5853cb11-e926-49de-a93b-7b64dc90d574-metrics-tls\") pod \"dns-default-5nvrq\" (UID: \"5853cb11-e926-49de-a93b-7b64dc90d574\") " pod="openshift-dns/dns-default-5nvrq"
Jun 08 11:48:33.381969 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:33.381771    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 08 11:48:33.381969 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:33.381901    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91c73bfb-0940-4926-8f4e-318c3f01d5c2-registry-tls\") pod \"image-registry-5877df4c8d-zkhq7\" (UID: \"91c73bfb-0940-4926-8f4e-318c3f01d5c2\") " pod="openshift-image-registry/image-registry-5877df4c8d-zkhq7"
Jun 08 11:48:33.382038 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:33.381992    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5853cb11-e926-49de-a93b-7b64dc90d574-metrics-tls podName:5853cb11-e926-49de-a93b-7b64dc90d574 nodeName:}" failed. No retries permitted until 2026-06-08 11:48:34.381972836 +0000 UTC m=+35.653547992 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5853cb11-e926-49de-a93b-7b64dc90d574-metrics-tls") pod "dns-default-5nvrq" (UID: "5853cb11-e926-49de-a93b-7b64dc90d574") : secret "dns-default-metrics-tls" not found
Jun 08 11:48:33.382091 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:33.382062    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 08 11:48:33.382091 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:33.382077    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5877df4c8d-zkhq7: secret "image-registry-tls" not found
Jun 08 11:48:33.382162 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:33.382124    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91c73bfb-0940-4926-8f4e-318c3f01d5c2-registry-tls podName:91c73bfb-0940-4926-8f4e-318c3f01d5c2 nodeName:}" failed. No retries permitted until 2026-06-08 11:48:34.38211016 +0000 UTC m=+35.653685314 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/91c73bfb-0940-4926-8f4e-318c3f01d5c2-registry-tls") pod "image-registry-5877df4c8d-zkhq7" (UID: "91c73bfb-0940-4926-8f4e-318c3f01d5c2") : secret "image-registry-tls" not found
Jun 08 11:48:33.501208 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:33.501173    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-j82tx"]
Jun 08 11:48:33.504377 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:48:33.504356    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97cb5e19_342d_49be_ad3a_346a649f83af.slice/crio-bfcf8fc500a2d5c753c7ba927c9b1e8a3e524090921364e12c202ff5d086a3e6 WatchSource:0}: Error finding container bfcf8fc500a2d5c753c7ba927c9b1e8a3e524090921364e12c202ff5d086a3e6: Status 404 returned error can't find the container with id bfcf8fc500a2d5c753c7ba927c9b1e8a3e524090921364e12c202ff5d086a3e6
Jun 08 11:48:34.345698 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:34.345661    2583 generic.go:356] "Generic (PLEG): container finished" podID="40910c2e-803d-4cf1-9451-917a8d88f182" containerID="91658e25ef628197bfad1f9820653a68a27aa31e19d62e898c7c9011d96170d0" exitCode=0
Jun 08 11:48:34.346334 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:34.345762    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzgvn" event={"ID":"40910c2e-803d-4cf1-9451-917a8d88f182","Type":"ContainerDied","Data":"91658e25ef628197bfad1f9820653a68a27aa31e19d62e898c7c9011d96170d0"}
Jun 08 11:48:34.346938 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:34.346913    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-j82tx" event={"ID":"97cb5e19-342d-49be-ad3a-346a649f83af","Type":"ContainerStarted","Data":"bfcf8fc500a2d5c753c7ba927c9b1e8a3e524090921364e12c202ff5d086a3e6"}
Jun 08 11:48:34.393159 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:34.393120    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5853cb11-e926-49de-a93b-7b64dc90d574-metrics-tls\") pod \"dns-default-5nvrq\" (UID: \"5853cb11-e926-49de-a93b-7b64dc90d574\") " pod="openshift-dns/dns-default-5nvrq"
Jun 08 11:48:34.393351 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:34.393205    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91c73bfb-0940-4926-8f4e-318c3f01d5c2-registry-tls\") pod \"image-registry-5877df4c8d-zkhq7\" (UID: \"91c73bfb-0940-4926-8f4e-318c3f01d5c2\") " pod="openshift-image-registry/image-registry-5877df4c8d-zkhq7"
Jun 08 11:48:34.393408 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:34.393361    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 08 11:48:34.393408 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:34.393375    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5877df4c8d-zkhq7: secret "image-registry-tls" not found
Jun 08 11:48:34.393506 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:34.393429    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91c73bfb-0940-4926-8f4e-318c3f01d5c2-registry-tls podName:91c73bfb-0940-4926-8f4e-318c3f01d5c2 nodeName:}" failed. No retries permitted until 2026-06-08 11:48:36.3934117 +0000 UTC m=+37.664986868 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/91c73bfb-0940-4926-8f4e-318c3f01d5c2-registry-tls") pod "image-registry-5877df4c8d-zkhq7" (UID: "91c73bfb-0940-4926-8f4e-318c3f01d5c2") : secret "image-registry-tls" not found
Jun 08 11:48:34.393721 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:34.393696    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 08 11:48:34.393845 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:34.393763    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5853cb11-e926-49de-a93b-7b64dc90d574-metrics-tls podName:5853cb11-e926-49de-a93b-7b64dc90d574 nodeName:}" failed. No retries permitted until 2026-06-08 11:48:36.393746207 +0000 UTC m=+37.665321366 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5853cb11-e926-49de-a93b-7b64dc90d574-metrics-tls") pod "dns-default-5nvrq" (UID: "5853cb11-e926-49de-a93b-7b64dc90d574") : secret "dns-default-metrics-tls" not found
Jun 08 11:48:35.353135 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:35.353098    2583 generic.go:356] "Generic (PLEG): container finished" podID="40910c2e-803d-4cf1-9451-917a8d88f182" containerID="7fa86d40d652dac6bee68ef9813d823f57afeb10f876ba658ecbe4a573856a3b" exitCode=0
Jun 08 11:48:35.353552 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:35.353170    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzgvn" event={"ID":"40910c2e-803d-4cf1-9451-917a8d88f182","Type":"ContainerDied","Data":"7fa86d40d652dac6bee68ef9813d823f57afeb10f876ba658ecbe4a573856a3b"}
Jun 08 11:48:36.358559 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:36.358298    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzgvn" event={"ID":"40910c2e-803d-4cf1-9451-917a8d88f182","Type":"ContainerStarted","Data":"5727b1ddb5f7a0e4682f9312c9fe7bcb669a9ae1dfd24065e8146ab7b06adbca"}
Jun 08 11:48:36.362651 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:36.362623    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-j82tx" event={"ID":"97cb5e19-342d-49be-ad3a-346a649f83af","Type":"ContainerStarted","Data":"2d3fb01b238a819ea4576611bfb66ffa5cf44fc4314a07830ce9bfac24fa73b4"}
Jun 08 11:48:36.380845 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:36.380789    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-bzgvn" podStartSLOduration=8.228367346 podStartE2EDuration="37.380771399s" totalImagesPullingTime="29.152404053s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 11:47:59 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 11:48:36.379716857 +0000 UTC m=+37.651292049" watchObservedRunningTime="2026-06-08 11:48:36.380771399 +0000 UTC m=+37.652346578"
Jun 08 11:48:36.394733 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:36.394692    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-j82tx" podStartSLOduration=2.417222703 podStartE2EDuration="4.394678414s" totalImagesPullingTime="1.977455711s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 11:48:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 11:48:36.394002578 +0000 UTC m=+37.665577754" watchObservedRunningTime="2026-06-08 11:48:36.394678414 +0000 UTC m=+37.666253588"
Jun 08 11:48:36.408314 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:36.408293    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5853cb11-e926-49de-a93b-7b64dc90d574-metrics-tls\") pod \"dns-default-5nvrq\" (UID: \"5853cb11-e926-49de-a93b-7b64dc90d574\") " pod="openshift-dns/dns-default-5nvrq"
Jun 08 11:48:36.408422 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:36.408338    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91c73bfb-0940-4926-8f4e-318c3f01d5c2-registry-tls\") pod \"image-registry-5877df4c8d-zkhq7\" (UID: \"91c73bfb-0940-4926-8f4e-318c3f01d5c2\") " pod="openshift-image-registry/image-registry-5877df4c8d-zkhq7"
Jun 08 11:48:36.408461 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:36.408443    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 08 11:48:36.408501 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:36.408491    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 08 11:48:36.408534 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:36.408503    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5877df4c8d-zkhq7: secret "image-registry-tls" not found
Jun 08 11:48:36.408534 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:36.408505    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5853cb11-e926-49de-a93b-7b64dc90d574-metrics-tls podName:5853cb11-e926-49de-a93b-7b64dc90d574 nodeName:}" failed. No retries permitted until 2026-06-08 11:48:40.408490402 +0000 UTC m=+41.680065560 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5853cb11-e926-49de-a93b-7b64dc90d574-metrics-tls") pod "dns-default-5nvrq" (UID: "5853cb11-e926-49de-a93b-7b64dc90d574") : secret "dns-default-metrics-tls" not found
Jun 08 11:48:36.408596 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:36.408537    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91c73bfb-0940-4926-8f4e-318c3f01d5c2-registry-tls podName:91c73bfb-0940-4926-8f4e-318c3f01d5c2 nodeName:}" failed. No retries permitted until 2026-06-08 11:48:40.408527419 +0000 UTC m=+41.680102573 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/91c73bfb-0940-4926-8f4e-318c3f01d5c2-registry-tls") pod "image-registry-5877df4c8d-zkhq7" (UID: "91c73bfb-0940-4926-8f4e-318c3f01d5c2") : secret "image-registry-tls" not found
Jun 08 11:48:40.440140 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:40.440096    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5853cb11-e926-49de-a93b-7b64dc90d574-metrics-tls\") pod \"dns-default-5nvrq\" (UID: \"5853cb11-e926-49de-a93b-7b64dc90d574\") " pod="openshift-dns/dns-default-5nvrq"
Jun 08 11:48:40.440581 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:40.440162    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91c73bfb-0940-4926-8f4e-318c3f01d5c2-registry-tls\") pod \"image-registry-5877df4c8d-zkhq7\" (UID: \"91c73bfb-0940-4926-8f4e-318c3f01d5c2\") " pod="openshift-image-registry/image-registry-5877df4c8d-zkhq7"
Jun 08 11:48:40.440581 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:40.440261    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 08 11:48:40.440581 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:40.440271    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5877df4c8d-zkhq7: secret "image-registry-tls" not found
Jun 08 11:48:40.440581 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:40.440269    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 08 11:48:40.440581 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:40.440318    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91c73bfb-0940-4926-8f4e-318c3f01d5c2-registry-tls podName:91c73bfb-0940-4926-8f4e-318c3f01d5c2 nodeName:}" failed. No retries permitted until 2026-06-08 11:48:48.440305321 +0000 UTC m=+49.711880475 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/91c73bfb-0940-4926-8f4e-318c3f01d5c2-registry-tls") pod "image-registry-5877df4c8d-zkhq7" (UID: "91c73bfb-0940-4926-8f4e-318c3f01d5c2") : secret "image-registry-tls" not found
Jun 08 11:48:40.440581 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:40.440348    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5853cb11-e926-49de-a93b-7b64dc90d574-metrics-tls podName:5853cb11-e926-49de-a93b-7b64dc90d574 nodeName:}" failed. No retries permitted until 2026-06-08 11:48:48.440330057 +0000 UTC m=+49.711905211 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5853cb11-e926-49de-a93b-7b64dc90d574-metrics-tls") pod "dns-default-5nvrq" (UID: "5853cb11-e926-49de-a93b-7b64dc90d574") : secret "dns-default-metrics-tls" not found
Jun 08 11:48:48.498708 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:48.498670    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91c73bfb-0940-4926-8f4e-318c3f01d5c2-registry-tls\") pod \"image-registry-5877df4c8d-zkhq7\" (UID: \"91c73bfb-0940-4926-8f4e-318c3f01d5c2\") " pod="openshift-image-registry/image-registry-5877df4c8d-zkhq7"
Jun 08 11:48:48.499125 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:48.498756    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5853cb11-e926-49de-a93b-7b64dc90d574-metrics-tls\") pod \"dns-default-5nvrq\" (UID: \"5853cb11-e926-49de-a93b-7b64dc90d574\") " pod="openshift-dns/dns-default-5nvrq"
Jun 08 11:48:48.499125 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:48.498841    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 08 11:48:48.499125 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:48.498858    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5877df4c8d-zkhq7: secret "image-registry-tls" not found
Jun 08 11:48:48.499125 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:48.498877    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 08 11:48:48.499125 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:48.498926    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91c73bfb-0940-4926-8f4e-318c3f01d5c2-registry-tls podName:91c73bfb-0940-4926-8f4e-318c3f01d5c2 nodeName:}" failed. No retries permitted until 2026-06-08 11:49:04.498905529 +0000 UTC m=+65.770480690 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/91c73bfb-0940-4926-8f4e-318c3f01d5c2-registry-tls") pod "image-registry-5877df4c8d-zkhq7" (UID: "91c73bfb-0940-4926-8f4e-318c3f01d5c2") : secret "image-registry-tls" not found
Jun 08 11:48:48.499125 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:48:48.498939    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5853cb11-e926-49de-a93b-7b64dc90d574-metrics-tls podName:5853cb11-e926-49de-a93b-7b64dc90d574 nodeName:}" failed. No retries permitted until 2026-06-08 11:49:04.498933329 +0000 UTC m=+65.770508487 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5853cb11-e926-49de-a93b-7b64dc90d574-metrics-tls") pod "dns-default-5nvrq" (UID: "5853cb11-e926-49de-a93b-7b64dc90d574") : secret "dns-default-metrics-tls" not found
Jun 08 11:48:58.336532 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:48:58.336497    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9x6v7"
Jun 08 11:49:04.509300 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:49:04.509249    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91c73bfb-0940-4926-8f4e-318c3f01d5c2-registry-tls\") pod \"image-registry-5877df4c8d-zkhq7\" (UID: \"91c73bfb-0940-4926-8f4e-318c3f01d5c2\") " pod="openshift-image-registry/image-registry-5877df4c8d-zkhq7"
Jun 08 11:49:04.509749 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:49:04.509356    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5853cb11-e926-49de-a93b-7b64dc90d574-metrics-tls\") pod \"dns-default-5nvrq\" (UID: \"5853cb11-e926-49de-a93b-7b64dc90d574\") " pod="openshift-dns/dns-default-5nvrq"
Jun 08 11:49:04.509749 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:49:04.509403    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 08 11:49:04.509749 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:49:04.509423    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5877df4c8d-zkhq7: secret "image-registry-tls" not found
Jun 08 11:49:04.509749 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:49:04.509474    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 08 11:49:04.509749 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:49:04.509490    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91c73bfb-0940-4926-8f4e-318c3f01d5c2-registry-tls podName:91c73bfb-0940-4926-8f4e-318c3f01d5c2 nodeName:}" failed. No retries permitted until 2026-06-08 11:49:36.509474013 +0000 UTC m=+97.781049170 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/91c73bfb-0940-4926-8f4e-318c3f01d5c2-registry-tls") pod "image-registry-5877df4c8d-zkhq7" (UID: "91c73bfb-0940-4926-8f4e-318c3f01d5c2") : secret "image-registry-tls" not found
Jun 08 11:49:04.509749 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:49:04.509524    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5853cb11-e926-49de-a93b-7b64dc90d574-metrics-tls podName:5853cb11-e926-49de-a93b-7b64dc90d574 nodeName:}" failed. No retries permitted until 2026-06-08 11:49:36.509508151 +0000 UTC m=+97.781083312 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5853cb11-e926-49de-a93b-7b64dc90d574-metrics-tls") pod "dns-default-5nvrq" (UID: "5853cb11-e926-49de-a93b-7b64dc90d574") : secret "dns-default-metrics-tls" not found
Jun 08 11:49:04.912578 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:49:04.912547    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b2281a3-722f-4113-b3e1-7f4b4614f599-metrics-certs\") pod \"network-metrics-daemon-6m4cb\" (UID: \"0b2281a3-722f-4113-b3e1-7f4b4614f599\") " pod="openshift-multus/network-metrics-daemon-6m4cb"
Jun 08 11:49:04.915267 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:49:04.915247    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 08 11:49:04.923345 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:49:04.923319    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jun 08 11:49:04.923416 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:49:04.923399    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b2281a3-722f-4113-b3e1-7f4b4614f599-metrics-certs podName:0b2281a3-722f-4113-b3e1-7f4b4614f599 nodeName:}" failed. No retries permitted until 2026-06-08 11:50:08.923383275 +0000 UTC m=+130.194958429 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b2281a3-722f-4113-b3e1-7f4b4614f599-metrics-certs") pod "network-metrics-daemon-6m4cb" (UID: "0b2281a3-722f-4113-b3e1-7f4b4614f599") : secret "metrics-daemon-secret" not found
Jun 08 11:49:05.013252 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:49:05.013217    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62csw\" (UniqueName: \"kubernetes.io/projected/3b153dca-66ed-4681-b70b-6061158f6676-kube-api-access-62csw\") pod \"network-check-target-rx5rz\" (UID: \"3b153dca-66ed-4681-b70b-6061158f6676\") " pod="openshift-network-diagnostics/network-check-target-rx5rz"
Jun 08 11:49:05.013252 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:49:05.013255    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2579f4ef-e90c-4da0-9617-9ba892dba6ef-original-pull-secret\") pod \"global-pull-secret-syncer-c6hh2\" (UID: \"2579f4ef-e90c-4da0-9617-9ba892dba6ef\") " pod="kube-system/global-pull-secret-syncer-c6hh2"
Jun 08 11:49:05.015573 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:49:05.015556    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jun 08 11:49:05.015681 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:49:05.015664    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jun 08 11:49:05.026393 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:49:05.026364    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jun 08 11:49:05.028117 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:49:05.028093    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2579f4ef-e90c-4da0-9617-9ba892dba6ef-original-pull-secret\") pod \"global-pull-secret-syncer-c6hh2\" (UID: \"2579f4ef-e90c-4da0-9617-9ba892dba6ef\") " pod="kube-system/global-pull-secret-syncer-c6hh2"
Jun 08 11:49:05.037139 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:49:05.037117    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62csw\" (UniqueName: \"kubernetes.io/projected/3b153dca-66ed-4681-b70b-6061158f6676-kube-api-access-62csw\") pod \"network-check-target-rx5rz\" (UID: \"3b153dca-66ed-4681-b70b-6061158f6676\") " pod="openshift-network-diagnostics/network-check-target-rx5rz"
Jun 08 11:49:05.295009 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:49:05.294924    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gntjz\""
Jun 08 11:49:05.299946 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:49:05.299927    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c6hh2"
Jun 08 11:49:05.302720 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:49:05.302702    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rx5rz"
Jun 08 11:49:05.434440 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:49:05.434410    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-c6hh2"]
Jun 08 11:49:05.450184 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:49:05.450160    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rx5rz"]
Jun 08 11:49:05.452884 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:49:05.452859    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b153dca_66ed_4681_b70b_6061158f6676.slice/crio-0689b073b062b5570707324431785b5032606d98967f8c82da75d5749ec191c9 WatchSource:0}: Error finding container 0689b073b062b5570707324431785b5032606d98967f8c82da75d5749ec191c9: Status 404 returned error can't find the container with id 0689b073b062b5570707324431785b5032606d98967f8c82da75d5749ec191c9
Jun 08 11:49:06.433539 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:49:06.433499    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rx5rz" event={"ID":"3b153dca-66ed-4681-b70b-6061158f6676","Type":"ContainerStarted","Data":"0689b073b062b5570707324431785b5032606d98967f8c82da75d5749ec191c9"}
Jun 08 11:49:06.434805 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:49:06.434771    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-c6hh2" event={"ID":"2579f4ef-e90c-4da0-9617-9ba892dba6ef","Type":"ContainerStarted","Data":"9174ad050a511627f036eb408320e0c8794625580943919b5afd75391b02b579"}
Jun 08 11:49:10.447770 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:49:10.447730    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rx5rz" event={"ID":"3b153dca-66ed-4681-b70b-6061158f6676","Type":"ContainerStarted","Data":"4eebd3d9bb0dd872bbaa8a07c9bab5c72c68080044addb163e413fe8ff567755"}
Jun 08 11:49:10.448241 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:49:10.447812    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rx5rz"
Jun 08 11:49:10.449162 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:49:10.449133    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-c6hh2" event={"ID":"2579f4ef-e90c-4da0-9617-9ba892dba6ef","Type":"ContainerStarted","Data":"5df342a0f6e20c22d55de5aa73eb115c512c605c749f157cad670cfe2990229c"}
Jun 08 11:49:10.467239 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:49:10.467193    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rx5rz" podStartSLOduration=67.236337921 podStartE2EDuration="1m11.467179517s" totalImagesPullingTime="4.230841596s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 11:47:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 11:49:10.465964104 +0000 UTC m=+71.737539280" watchObservedRunningTime="2026-06-08 11:49:10.467179517 +0000 UTC m=+71.738754692"
Jun 08 11:49:10.482797 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:49:10.482753    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-c6hh2" podStartSLOduration=67.234623699 podStartE2EDuration="1m11.482736145s" totalImagesPullingTime="4.248112446s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 11:47:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 11:49:10.482638609 +0000 UTC m=+71.754213792" watchObservedRunningTime="2026-06-08 11:49:10.482736145 +0000 UTC m=+71.754311325"
Jun 08 11:49:36.535977 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:49:36.535853    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5853cb11-e926-49de-a93b-7b64dc90d574-metrics-tls\") pod \"dns-default-5nvrq\" (UID: \"5853cb11-e926-49de-a93b-7b64dc90d574\") " pod="openshift-dns/dns-default-5nvrq"
Jun 08 11:49:36.535977 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:49:36.535904    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91c73bfb-0940-4926-8f4e-318c3f01d5c2-registry-tls\") pod \"image-registry-5877df4c8d-zkhq7\" (UID: \"91c73bfb-0940-4926-8f4e-318c3f01d5c2\") " pod="openshift-image-registry/image-registry-5877df4c8d-zkhq7"
Jun 08 11:49:36.536489 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:49:36.536007    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 08 11:49:36.536489 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:49:36.536097    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5853cb11-e926-49de-a93b-7b64dc90d574-metrics-tls podName:5853cb11-e926-49de-a93b-7b64dc90d574 nodeName:}" failed. No retries permitted until 2026-06-08 11:50:40.536076914 +0000 UTC m=+161.807652088 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5853cb11-e926-49de-a93b-7b64dc90d574-metrics-tls") pod "dns-default-5nvrq" (UID: "5853cb11-e926-49de-a93b-7b64dc90d574") : secret "dns-default-metrics-tls" not found
Jun 08 11:49:36.536489 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:49:36.536014    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 08 11:49:36.536489 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:49:36.536115    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5877df4c8d-zkhq7: secret "image-registry-tls" not found
Jun 08 11:49:36.536489 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:49:36.536144    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91c73bfb-0940-4926-8f4e-318c3f01d5c2-registry-tls podName:91c73bfb-0940-4926-8f4e-318c3f01d5c2 nodeName:}" failed. No retries permitted until 2026-06-08 11:50:40.536135986 +0000 UTC m=+161.807711144 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/91c73bfb-0940-4926-8f4e-318c3f01d5c2-registry-tls") pod "image-registry-5877df4c8d-zkhq7" (UID: "91c73bfb-0940-4926-8f4e-318c3f01d5c2") : secret "image-registry-tls" not found
Jun 08 11:49:41.453765 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:49:41.453731    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rx5rz"
Jun 08 11:50:08.957990 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:50:08.957955    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b2281a3-722f-4113-b3e1-7f4b4614f599-metrics-certs\") pod \"network-metrics-daemon-6m4cb\" (UID: \"0b2281a3-722f-4113-b3e1-7f4b4614f599\") " pod="openshift-multus/network-metrics-daemon-6m4cb"
Jun 08 11:50:08.958481 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:50:08.958094    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jun 08 11:50:08.958481 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:50:08.958162    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b2281a3-722f-4113-b3e1-7f4b4614f599-metrics-certs podName:0b2281a3-722f-4113-b3e1-7f4b4614f599 nodeName:}" failed. No retries permitted until 2026-06-08 11:52:10.958147159 +0000 UTC m=+252.229722313 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b2281a3-722f-4113-b3e1-7f4b4614f599-metrics-certs") pod "network-metrics-daemon-6m4cb" (UID: "0b2281a3-722f-4113-b3e1-7f4b4614f599") : secret "metrics-daemon-secret" not found
Jun 08 11:50:35.657235 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:50:35.657194    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5877df4c8d-zkhq7" podUID="91c73bfb-0940-4926-8f4e-318c3f01d5c2"
Jun 08 11:50:35.668350 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:50:35.668322    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-5nvrq" podUID="5853cb11-e926-49de-a93b-7b64dc90d574"
Jun 08 11:50:36.205935 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:50:36.205893    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-6m4cb" podUID="0b2281a3-722f-4113-b3e1-7f4b4614f599"
Jun 08 11:50:36.650093 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:50:36.650063    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5877df4c8d-zkhq7"
Jun 08 11:50:36.650258 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:50:36.650069    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5nvrq"
Jun 08 11:50:40.571020 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:50:40.570981    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5853cb11-e926-49de-a93b-7b64dc90d574-metrics-tls\") pod \"dns-default-5nvrq\" (UID: \"5853cb11-e926-49de-a93b-7b64dc90d574\") " pod="openshift-dns/dns-default-5nvrq"
Jun 08 11:50:40.571020 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:50:40.571026    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91c73bfb-0940-4926-8f4e-318c3f01d5c2-registry-tls\") pod \"image-registry-5877df4c8d-zkhq7\" (UID: \"91c73bfb-0940-4926-8f4e-318c3f01d5c2\") " pod="openshift-image-registry/image-registry-5877df4c8d-zkhq7"
Jun 08 11:50:40.571465 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:50:40.571142    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 08 11:50:40.571465 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:50:40.571213    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5853cb11-e926-49de-a93b-7b64dc90d574-metrics-tls podName:5853cb11-e926-49de-a93b-7b64dc90d574 nodeName:}" failed. No retries permitted until 2026-06-08 11:52:42.5711972 +0000 UTC m=+283.842772370 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5853cb11-e926-49de-a93b-7b64dc90d574-metrics-tls") pod "dns-default-5nvrq" (UID: "5853cb11-e926-49de-a93b-7b64dc90d574") : secret "dns-default-metrics-tls" not found
Jun 08 11:50:40.571465 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:50:40.571153    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 08 11:50:40.571465 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:50:40.571237    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5877df4c8d-zkhq7: secret "image-registry-tls" not found
Jun 08 11:50:40.571465 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:50:40.571292    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91c73bfb-0940-4926-8f4e-318c3f01d5c2-registry-tls podName:91c73bfb-0940-4926-8f4e-318c3f01d5c2 nodeName:}" failed. No retries permitted until 2026-06-08 11:52:42.571280825 +0000 UTC m=+283.842855979 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/91c73bfb-0940-4926-8f4e-318c3f01d5c2-registry-tls") pod "image-registry-5877df4c8d-zkhq7" (UID: "91c73bfb-0940-4926-8f4e-318c3f01d5c2") : secret "image-registry-tls" not found
Jun 08 11:50:50.181267 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:50:50.181169    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6m4cb"
Jun 08 11:52:11.008602 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:11.008560    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b2281a3-722f-4113-b3e1-7f4b4614f599-metrics-certs\") pod \"network-metrics-daemon-6m4cb\" (UID: \"0b2281a3-722f-4113-b3e1-7f4b4614f599\") " pod="openshift-multus/network-metrics-daemon-6m4cb"
Jun 08 11:52:11.009119 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:52:11.008685    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jun 08 11:52:11.009119 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:52:11.008754    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b2281a3-722f-4113-b3e1-7f4b4614f599-metrics-certs podName:0b2281a3-722f-4113-b3e1-7f4b4614f599 nodeName:}" failed. No retries permitted until 2026-06-08 11:54:13.008736165 +0000 UTC m=+374.280311322 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b2281a3-722f-4113-b3e1-7f4b4614f599-metrics-certs") pod "network-metrics-daemon-6m4cb" (UID: "0b2281a3-722f-4113-b3e1-7f4b4614f599") : secret "metrics-daemon-secret" not found
Jun 08 11:52:29.889203 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:29.889121    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-brrk6"]
Jun 08 11:52:29.891908 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:29.891888    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-brrk6"
Jun 08 11:52:29.891908 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:29.891902    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-mnnbj"]
Jun 08 11:52:29.894076 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:29.894044    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jun 08 11:52:29.894189 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:29.894063    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-lwqss\""
Jun 08 11:52:29.894674 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:29.894646    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-mnnbj"
Jun 08 11:52:29.895188 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:29.895166    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jun 08 11:52:29.895317 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:29.895171    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jun 08 11:52:29.895475 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:29.895446    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jun 08 11:52:29.896293 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:29.896277    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7fb545c65c-8k4dn"]
Jun 08 11:52:29.897792 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:29.897773    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jun 08 11:52:29.897889 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:29.897810    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jun 08 11:52:29.897889 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:29.897816    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jun 08 11:52:29.897889 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:29.897836    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-j7mn7\""
Jun 08 11:52:29.898098 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:29.898079    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jun 08 11:52:29.900428 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:29.900412    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7fb545c65c-8k4dn"
Jun 08 11:52:29.902891 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:29.902876    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jun 08 11:52:29.903173 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:29.903156    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jun 08 11:52:29.903273 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:29.903158    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jun 08 11:52:29.903332 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:29.903307    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jun 08 11:52:29.903696 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:29.903682    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jun 08 11:52:29.903853 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:29.903836    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jun 08 11:52:29.903928 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:29.903718    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jun 08 11:52:29.904224 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:29.904201    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-tjt7j\""
Jun 08 11:52:29.905639 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:29.905611    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-brrk6"]
Jun 08 11:52:29.910237 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:29.910215    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-mnnbj"]
Jun 08 11:52:29.915358 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:29.915333    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7fb545c65c-8k4dn"]
Jun 08 11:52:29.936822 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:29.936793    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cdf82c13-c30a-474a-a135-3d1dbcbb6046-serving-cert\") pod \"console-operator-668fdbf85c-mnnbj\" (UID: \"cdf82c13-c30a-474a-a135-3d1dbcbb6046\") " pod="openshift-console-operator/console-operator-668fdbf85c-mnnbj"
Jun 08 11:52:29.936979 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:29.936832    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cdf82c13-c30a-474a-a135-3d1dbcbb6046-config\") pod \"console-operator-668fdbf85c-mnnbj\" (UID: \"cdf82c13-c30a-474a-a135-3d1dbcbb6046\") " pod="openshift-console-operator/console-operator-668fdbf85c-mnnbj"
Jun 08 11:52:29.936979 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:29.936860    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cdf82c13-c30a-474a-a135-3d1dbcbb6046-trusted-ca\") pod \"console-operator-668fdbf85c-mnnbj\" (UID: \"cdf82c13-c30a-474a-a135-3d1dbcbb6046\") " pod="openshift-console-operator/console-operator-668fdbf85c-mnnbj"
Jun 08 11:52:29.936979 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:29.936930    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5ba6a777-a56b-4674-98c3-5d8fbaf2b4ca-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-brrk6\" (UID: \"5ba6a777-a56b-4674-98c3-5d8fbaf2b4ca\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-brrk6"
Jun 08 11:52:29.936979 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:29.936969    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5ba6a777-a56b-4674-98c3-5d8fbaf2b4ca-config\") pod \"service-ca-operator-6bc5ff68f5-brrk6\" (UID: \"5ba6a777-a56b-4674-98c3-5d8fbaf2b4ca\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-brrk6"
Jun 08 11:52:29.937162 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:29.936998    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/264c6dd1-c7ac-402c-af66-abda335100e1-service-ca-bundle\") pod \"router-default-7fb545c65c-8k4dn\" (UID: \"264c6dd1-c7ac-402c-af66-abda335100e1\") " pod="openshift-ingress/router-default-7fb545c65c-8k4dn"
Jun 08 11:52:29.937162 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:29.937028    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgmkb\" (UniqueName: \"kubernetes.io/projected/cdf82c13-c30a-474a-a135-3d1dbcbb6046-kube-api-access-cgmkb\") pod \"console-operator-668fdbf85c-mnnbj\" (UID: \"cdf82c13-c30a-474a-a135-3d1dbcbb6046\") " pod="openshift-console-operator/console-operator-668fdbf85c-mnnbj"
Jun 08 11:52:29.937162 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:29.937043    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/264c6dd1-c7ac-402c-af66-abda335100e1-metrics-certs\") pod \"router-default-7fb545c65c-8k4dn\" (UID: \"264c6dd1-c7ac-402c-af66-abda335100e1\") " pod="openshift-ingress/router-default-7fb545c65c-8k4dn"
Jun 08 11:52:29.937162 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:29.937076    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxkkr\" (UniqueName: \"kubernetes.io/projected/264c6dd1-c7ac-402c-af66-abda335100e1-kube-api-access-cxkkr\") pod \"router-default-7fb545c65c-8k4dn\" (UID: \"264c6dd1-c7ac-402c-af66-abda335100e1\") " pod="openshift-ingress/router-default-7fb545c65c-8k4dn"
Jun 08 11:52:29.937162 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:29.937093    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/264c6dd1-c7ac-402c-af66-abda335100e1-stats-auth\") pod \"router-default-7fb545c65c-8k4dn\" (UID: \"264c6dd1-c7ac-402c-af66-abda335100e1\") " pod="openshift-ingress/router-default-7fb545c65c-8k4dn"
Jun 08 11:52:29.937162 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:29.937131    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hvml\" (UniqueName: \"kubernetes.io/projected/5ba6a777-a56b-4674-98c3-5d8fbaf2b4ca-kube-api-access-8hvml\") pod \"service-ca-operator-6bc5ff68f5-brrk6\" (UID: \"5ba6a777-a56b-4674-98c3-5d8fbaf2b4ca\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-brrk6"
Jun 08 11:52:29.937162 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:29.937149    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/264c6dd1-c7ac-402c-af66-abda335100e1-default-certificate\") pod \"router-default-7fb545c65c-8k4dn\" (UID: \"264c6dd1-c7ac-402c-af66-abda335100e1\") " pod="openshift-ingress/router-default-7fb545c65c-8k4dn"
Jun 08 11:52:29.990444 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:29.990411    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-wrn8q"]
Jun 08 11:52:29.993426 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:29.993409    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-wrn8q"
Jun 08 11:52:29.997503 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:29.997484    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-f8t8z\""
Jun 08 11:52:29.999209 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:29.999187    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-7rkd5"]
Jun 08 11:52:30.002252 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:30.002237    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-7rkd5"
Jun 08 11:52:30.004797 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:30.004777    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-wrn8q"]
Jun 08 11:52:30.005185 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:30.005167    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jun 08 11:52:30.005686 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:30.005668    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jun 08 11:52:30.005936 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:30.005914    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jun 08 11:52:30.006020 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:30.005978    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jun 08 11:52:30.009474 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:30.009454    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-j92cc\""
Jun 08 11:52:30.013497 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:30.013478    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jun 08 11:52:30.015914 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:30.015894    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-7rkd5"]
Jun 08 11:52:30.038040 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:30.038009    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxhpf\" (UniqueName: \"kubernetes.io/projected/563dc1f2-5754-45d6-8b8e-02aab0908ef8-kube-api-access-zxhpf\") pod \"network-check-source-dbd9cf844-wrn8q\" (UID: \"563dc1f2-5754-45d6-8b8e-02aab0908ef8\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-wrn8q"
Jun 08 11:52:30.038190 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:30.038084    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/264c6dd1-c7ac-402c-af66-abda335100e1-default-certificate\") pod \"router-default-7fb545c65c-8k4dn\" (UID: \"264c6dd1-c7ac-402c-af66-abda335100e1\") " pod="openshift-ingress/router-default-7fb545c65c-8k4dn"
Jun 08 11:52:30.038190 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:30.038151    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgmkb\" (UniqueName: \"kubernetes.io/projected/cdf82c13-c30a-474a-a135-3d1dbcbb6046-kube-api-access-cgmkb\") pod \"console-operator-668fdbf85c-mnnbj\" (UID: \"cdf82c13-c30a-474a-a135-3d1dbcbb6046\") " pod="openshift-console-operator/console-operator-668fdbf85c-mnnbj"
Jun 08 11:52:30.038190 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:30.038188    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cdf82c13-c30a-474a-a135-3d1dbcbb6046-trusted-ca\") pod \"console-operator-668fdbf85c-mnnbj\" (UID: \"cdf82c13-c30a-474a-a135-3d1dbcbb6046\") " pod="openshift-console-operator/console-operator-668fdbf85c-mnnbj"
Jun 08 11:52:30.038340 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:30.038204    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5ba6a777-a56b-4674-98c3-5d8fbaf2b4ca-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-brrk6\" (UID: \"5ba6a777-a56b-4674-98c3-5d8fbaf2b4ca\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-brrk6"
Jun 08 11:52:30.038340 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:30.038219    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5ba6a777-a56b-4674-98c3-5d8fbaf2b4ca-config\") pod \"service-ca-operator-6bc5ff68f5-brrk6\" (UID: \"5ba6a777-a56b-4674-98c3-5d8fbaf2b4ca\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-brrk6"
Jun 08 11:52:30.038340 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:30.038234    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cdf82c13-c30a-474a-a135-3d1dbcbb6046-serving-cert\") pod \"console-operator-668fdbf85c-mnnbj\" (UID: \"cdf82c13-c30a-474a-a135-3d1dbcbb6046\") " pod="openshift-console-operator/console-operator-668fdbf85c-mnnbj"
Jun 08 11:52:30.038340 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:30.038253    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3214fd2f-d623-436b-b69a-579cf961f902-service-ca-bundle\") pod \"insights-operator-896549976-7rkd5\" (UID: \"3214fd2f-d623-436b-b69a-579cf961f902\") " pod="openshift-insights/insights-operator-896549976-7rkd5"
Jun 08 11:52:30.038340 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:30.038284    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3214fd2f-d623-436b-b69a-579cf961f902-snapshots\") pod \"insights-operator-896549976-7rkd5\" (UID: \"3214fd2f-d623-436b-b69a-579cf961f902\") " pod="openshift-insights/insights-operator-896549976-7rkd5"
Jun 08 11:52:30.038340 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:30.038321    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/264c6dd1-c7ac-402c-af66-abda335100e1-service-ca-bundle\") pod \"router-default-7fb545c65c-8k4dn\" (UID: \"264c6dd1-c7ac-402c-af66-abda335100e1\") " pod="openshift-ingress/router-default-7fb545c65c-8k4dn"
Jun 08 11:52:30.038637 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:30.038348    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/264c6dd1-c7ac-402c-af66-abda335100e1-metrics-certs\") pod \"router-default-7fb545c65c-8k4dn\" (UID: \"264c6dd1-c7ac-402c-af66-abda335100e1\") " pod="openshift-ingress/router-default-7fb545c65c-8k4dn"
Jun 08 11:52:30.038637 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:30.038375    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/264c6dd1-c7ac-402c-af66-abda335100e1-stats-auth\") pod \"router-default-7fb545c65c-8k4dn\" (UID: \"264c6dd1-c7ac-402c-af66-abda335100e1\") " pod="openshift-ingress/router-default-7fb545c65c-8k4dn"
Jun 08 11:52:30.038637 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:30.038402    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hvml\" (UniqueName: \"kubernetes.io/projected/5ba6a777-a56b-4674-98c3-5d8fbaf2b4ca-kube-api-access-8hvml\") pod \"service-ca-operator-6bc5ff68f5-brrk6\" (UID: \"5ba6a777-a56b-4674-98c3-5d8fbaf2b4ca\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-brrk6"
Jun 08 11:52:30.038637 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:30.038427    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwzfc\" (UniqueName: \"kubernetes.io/projected/3214fd2f-d623-436b-b69a-579cf961f902-kube-api-access-kwzfc\") pod \"insights-operator-896549976-7rkd5\" (UID: \"3214fd2f-d623-436b-b69a-579cf961f902\") " pod="openshift-insights/insights-operator-896549976-7rkd5"
Jun 08 11:52:30.038637 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:30.038452    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3214fd2f-d623-436b-b69a-579cf961f902-tmp\") pod \"insights-operator-896549976-7rkd5\" (UID: \"3214fd2f-d623-436b-b69a-579cf961f902\") " pod="openshift-insights/insights-operator-896549976-7rkd5"
Jun 08 11:52:30.038637 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:30.038491    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxkkr\" (UniqueName: \"kubernetes.io/projected/264c6dd1-c7ac-402c-af66-abda335100e1-kube-api-access-cxkkr\") pod \"router-default-7fb545c65c-8k4dn\" (UID: \"264c6dd1-c7ac-402c-af66-abda335100e1\") " pod="openshift-ingress/router-default-7fb545c65c-8k4dn"
Jun 08 11:52:30.038637 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:30.038588    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cdf82c13-c30a-474a-a135-3d1dbcbb6046-config\") pod \"console-operator-668fdbf85c-mnnbj\" (UID: \"cdf82c13-c30a-474a-a135-3d1dbcbb6046\") " pod="openshift-console-operator/console-operator-668fdbf85c-mnnbj"
Jun 08 11:52:30.038993 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:30.038899    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5ba6a777-a56b-4674-98c3-5d8fbaf2b4ca-config\") pod \"service-ca-operator-6bc5ff68f5-brrk6\" (UID: \"5ba6a777-a56b-4674-98c3-5d8fbaf2b4ca\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-brrk6"
Jun 08 11:52:30.038993 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:52:30.038937    2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 08 11:52:30.039118 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:52:30.039006    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/264c6dd1-c7ac-402c-af66-abda335100e1-metrics-certs podName:264c6dd1-c7ac-402c-af66-abda335100e1 nodeName:}" failed. No retries permitted until 2026-06-08 11:52:30.538988036 +0000 UTC m=+271.810563203 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/264c6dd1-c7ac-402c-af66-abda335100e1-metrics-certs") pod "router-default-7fb545c65c-8k4dn" (UID: "264c6dd1-c7ac-402c-af66-abda335100e1") : secret "router-metrics-certs-default" not found
Jun 08 11:52:30.039551 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:30.039069    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3214fd2f-d623-436b-b69a-579cf961f902-trusted-ca-bundle\") pod \"insights-operator-896549976-7rkd5\" (UID: \"3214fd2f-d623-436b-b69a-579cf961f902\") " pod="openshift-insights/insights-operator-896549976-7rkd5"
Jun 08 11:52:30.039551 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:52:30.039272    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/264c6dd1-c7ac-402c-af66-abda335100e1-service-ca-bundle podName:264c6dd1-c7ac-402c-af66-abda335100e1 nodeName:}" failed. No retries permitted until 2026-06-08 11:52:30.53925283 +0000 UTC m=+271.810827987 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/264c6dd1-c7ac-402c-af66-abda335100e1-service-ca-bundle") pod "router-default-7fb545c65c-8k4dn" (UID: "264c6dd1-c7ac-402c-af66-abda335100e1") : configmap references non-existent config key: service-ca.crt
Jun 08 11:52:30.039551 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:30.039296    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cdf82c13-c30a-474a-a135-3d1dbcbb6046-config\") pod \"console-operator-668fdbf85c-mnnbj\" (UID: \"cdf82c13-c30a-474a-a135-3d1dbcbb6046\") " pod="openshift-console-operator/console-operator-668fdbf85c-mnnbj"
Jun 08 11:52:30.039551 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:30.039324    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3214fd2f-d623-436b-b69a-579cf961f902-serving-cert\") pod \"insights-operator-896549976-7rkd5\" (UID: \"3214fd2f-d623-436b-b69a-579cf961f902\") " pod="openshift-insights/insights-operator-896549976-7rkd5"
Jun 08 11:52:30.039551 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:30.039402    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cdf82c13-c30a-474a-a135-3d1dbcbb6046-trusted-ca\") pod \"console-operator-668fdbf85c-mnnbj\" (UID: \"cdf82c13-c30a-474a-a135-3d1dbcbb6046\") " pod="openshift-console-operator/console-operator-668fdbf85c-mnnbj"
Jun 08 11:52:30.041073 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:30.041035    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/264c6dd1-c7ac-402c-af66-abda335100e1-stats-auth\") pod \"router-default-7fb545c65c-8k4dn\" (UID: \"264c6dd1-c7ac-402c-af66-abda335100e1\") " pod="openshift-ingress/router-default-7fb545c65c-8k4dn"
Jun 08 11:52:30.041156 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:30.041139    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/264c6dd1-c7ac-402c-af66-abda335100e1-default-certificate\") pod \"router-default-7fb545c65c-8k4dn\" (UID: \"264c6dd1-c7ac-402c-af66-abda335100e1\") " pod="openshift-ingress/router-default-7fb545c65c-8k4dn"
Jun 08 11:52:30.041219 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:30.041191    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cdf82c13-c30a-474a-a135-3d1dbcbb6046-serving-cert\") pod \"console-operator-668fdbf85c-mnnbj\" (UID: \"cdf82c13-c30a-474a-a135-3d1dbcbb6046\") " pod="openshift-console-operator/console-operator-668fdbf85c-mnnbj"
Jun 08 11:52:30.041315 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:30.041298    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5ba6a777-a56b-4674-98c3-5d8fbaf2b4ca-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-brrk6\" (UID: \"5ba6a777-a56b-4674-98c3-5d8fbaf2b4ca\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-brrk6"
Jun 08 11:52:30.069896 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:30.069865    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hvml\" (UniqueName: \"kubernetes.io/projected/5ba6a777-a56b-4674-98c3-5d8fbaf2b4ca-kube-api-access-8hvml\") pod \"service-ca-operator-6bc5ff68f5-brrk6\" (UID: \"5ba6a777-a56b-4674-98c3-5d8fbaf2b4ca\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-brrk6"
Jun 08 11:52:30.070489 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:30.070462    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgmkb\" (UniqueName: \"kubernetes.io/projected/cdf82c13-c30a-474a-a135-3d1dbcbb6046-kube-api-access-cgmkb\") pod \"console-operator-668fdbf85c-mnnbj\" (UID: \"cdf82c13-c30a-474a-a135-3d1dbcbb6046\") " pod="openshift-console-operator/console-operator-668fdbf85c-mnnbj"
Jun 08 11:52:30.070630 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:30.070613    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxkkr\" (UniqueName: \"kubernetes.io/projected/264c6dd1-c7ac-402c-af66-abda335100e1-kube-api-access-cxkkr\") pod \"router-default-7fb545c65c-8k4dn\" (UID: \"264c6dd1-c7ac-402c-af66-abda335100e1\") " pod="openshift-ingress/router-default-7fb545c65c-8k4dn"
Jun 08 11:52:30.140438 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:30.140343    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3214fd2f-d623-436b-b69a-579cf961f902-snapshots\") pod \"insights-operator-896549976-7rkd5\" (UID: \"3214fd2f-d623-436b-b69a-579cf961f902\") " pod="openshift-insights/insights-operator-896549976-7rkd5"
Jun 08 11:52:30.140438 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:30.140406    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwzfc\" (UniqueName: \"kubernetes.io/projected/3214fd2f-d623-436b-b69a-579cf961f902-kube-api-access-kwzfc\") pod \"insights-operator-896549976-7rkd5\" (UID: \"3214fd2f-d623-436b-b69a-579cf961f902\") " pod="openshift-insights/insights-operator-896549976-7rkd5"
Jun 08 11:52:30.140438 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:30.140426    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3214fd2f-d623-436b-b69a-579cf961f902-tmp\") pod \"insights-operator-896549976-7rkd5\" (UID: \"3214fd2f-d623-436b-b69a-579cf961f902\") " pod="openshift-insights/insights-operator-896549976-7rkd5"
Jun 08 11:52:30.140693 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:30.140451    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3214fd2f-d623-436b-b69a-579cf961f902-trusted-ca-bundle\") pod \"insights-operator-896549976-7rkd5\" (UID: \"3214fd2f-d623-436b-b69a-579cf961f902\") " pod="openshift-insights/insights-operator-896549976-7rkd5"
Jun 08 11:52:30.140693 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:30.140467    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3214fd2f-d623-436b-b69a-579cf961f902-serving-cert\") pod \"insights-operator-896549976-7rkd5\" (UID: \"3214fd2f-d623-436b-b69a-579cf961f902\") " pod="openshift-insights/insights-operator-896549976-7rkd5"
Jun 08 11:52:30.140693 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:30.140492    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxhpf\" (UniqueName: \"kubernetes.io/projected/563dc1f2-5754-45d6-8b8e-02aab0908ef8-kube-api-access-zxhpf\") pod \"network-check-source-dbd9cf844-wrn8q\" (UID: \"563dc1f2-5754-45d6-8b8e-02aab0908ef8\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-wrn8q"
Jun 08 11:52:30.140693 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:30.140622    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3214fd2f-d623-436b-b69a-579cf961f902-service-ca-bundle\") pod \"insights-operator-896549976-7rkd5\" (UID: \"3214fd2f-d623-436b-b69a-579cf961f902\") " pod="openshift-insights/insights-operator-896549976-7rkd5"
Jun 08 11:52:30.141094 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:30.141043    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3214fd2f-d623-436b-b69a-579cf961f902-tmp\") pod \"insights-operator-896549976-7rkd5\" (UID: \"3214fd2f-d623-436b-b69a-579cf961f902\") " pod="openshift-insights/insights-operator-896549976-7rkd5"
Jun 08 11:52:30.141208 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:30.141105    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3214fd2f-d623-436b-b69a-579cf961f902-snapshots\") pod \"insights-operator-896549976-7rkd5\" (UID: \"3214fd2f-d623-436b-b69a-579cf961f902\") " pod="openshift-insights/insights-operator-896549976-7rkd5"
Jun 08 11:52:30.141208 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:30.141140    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3214fd2f-d623-436b-b69a-579cf961f902-service-ca-bundle\") pod \"insights-operator-896549976-7rkd5\" (UID: \"3214fd2f-d623-436b-b69a-579cf961f902\") " pod="openshift-insights/insights-operator-896549976-7rkd5"
Jun 08 11:52:30.141462 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:30.141446    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3214fd2f-d623-436b-b69a-579cf961f902-trusted-ca-bundle\") pod \"insights-operator-896549976-7rkd5\" (UID: \"3214fd2f-d623-436b-b69a-579cf961f902\") " pod="openshift-insights/insights-operator-896549976-7rkd5"
Jun 08 11:52:30.142918 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:30.142902    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3214fd2f-d623-436b-b69a-579cf961f902-serving-cert\") pod \"insights-operator-896549976-7rkd5\" (UID: \"3214fd2f-d623-436b-b69a-579cf961f902\") " pod="openshift-insights/insights-operator-896549976-7rkd5"
Jun 08 11:52:30.151903 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:30.151879    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxhpf\" (UniqueName: \"kubernetes.io/projected/563dc1f2-5754-45d6-8b8e-02aab0908ef8-kube-api-access-zxhpf\") pod \"network-check-source-dbd9cf844-wrn8q\" (UID: \"563dc1f2-5754-45d6-8b8e-02aab0908ef8\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-wrn8q"
Jun 08 11:52:30.152009 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:30.151935    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwzfc\" (UniqueName: \"kubernetes.io/projected/3214fd2f-d623-436b-b69a-579cf961f902-kube-api-access-kwzfc\") pod \"insights-operator-896549976-7rkd5\" (UID: \"3214fd2f-d623-436b-b69a-579cf961f902\") " pod="openshift-insights/insights-operator-896549976-7rkd5"
Jun 08 11:52:30.201875 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:30.201854    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-brrk6"
Jun 08 11:52:30.212214 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:30.212198    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-mnnbj"
Jun 08 11:52:30.303350 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:30.303319    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-wrn8q"
Jun 08 11:52:30.311590 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:30.311520    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-7rkd5"
Jun 08 11:52:30.333486 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:30.333453    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-brrk6"]
Jun 08 11:52:30.336356 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:52:30.336327    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ba6a777_a56b_4674_98c3_5d8fbaf2b4ca.slice/crio-569c114d2cd20dbf108ae5990b0097eb1c7b458abc3dde213563b59bec4253d0 WatchSource:0}: Error finding container 569c114d2cd20dbf108ae5990b0097eb1c7b458abc3dde213563b59bec4253d0: Status 404 returned error can't find the container with id 569c114d2cd20dbf108ae5990b0097eb1c7b458abc3dde213563b59bec4253d0
Jun 08 11:52:30.349251 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:30.349188    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-mnnbj"]
Jun 08 11:52:30.356280 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:52:30.356257    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdf82c13_c30a_474a_a135_3d1dbcbb6046.slice/crio-66a027c78d5eae3189da210fd4815b4e4c76d8882e60ca06aa4e24692ae4bc13 WatchSource:0}: Error finding container 66a027c78d5eae3189da210fd4815b4e4c76d8882e60ca06aa4e24692ae4bc13: Status 404 returned error can't find the container with id 66a027c78d5eae3189da210fd4815b4e4c76d8882e60ca06aa4e24692ae4bc13
Jun 08 11:52:30.433317 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:30.433287    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-wrn8q"]
Jun 08 11:52:30.436583 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:52:30.436557    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod563dc1f2_5754_45d6_8b8e_02aab0908ef8.slice/crio-4c737fcf5633297ba4171c9d433fa7ce114d622d9f8dbb94f6f129d953a52421 WatchSource:0}: Error finding container 4c737fcf5633297ba4171c9d433fa7ce114d622d9f8dbb94f6f129d953a52421: Status 404 returned error can't find the container with id 4c737fcf5633297ba4171c9d433fa7ce114d622d9f8dbb94f6f129d953a52421
Jun 08 11:52:30.447315 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:30.447291    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-7rkd5"]
Jun 08 11:52:30.450179 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:52:30.450146    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3214fd2f_d623_436b_b69a_579cf961f902.slice/crio-19f218cff1f68fc566c3976f962ad6e2563dbfb7be0b41867aee931028aa6df5 WatchSource:0}: Error finding container 19f218cff1f68fc566c3976f962ad6e2563dbfb7be0b41867aee931028aa6df5: Status 404 returned error can't find the container with id 19f218cff1f68fc566c3976f962ad6e2563dbfb7be0b41867aee931028aa6df5
Jun 08 11:52:30.546637 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:30.546602    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/264c6dd1-c7ac-402c-af66-abda335100e1-service-ca-bundle\") pod \"router-default-7fb545c65c-8k4dn\" (UID: \"264c6dd1-c7ac-402c-af66-abda335100e1\") " pod="openshift-ingress/router-default-7fb545c65c-8k4dn"
Jun 08 11:52:30.546637 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:30.546638    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/264c6dd1-c7ac-402c-af66-abda335100e1-metrics-certs\") pod \"router-default-7fb545c65c-8k4dn\" (UID: \"264c6dd1-c7ac-402c-af66-abda335100e1\") " pod="openshift-ingress/router-default-7fb545c65c-8k4dn"
Jun 08 11:52:30.546820 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:52:30.546762    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/264c6dd1-c7ac-402c-af66-abda335100e1-service-ca-bundle podName:264c6dd1-c7ac-402c-af66-abda335100e1 nodeName:}" failed. No retries permitted until 2026-06-08 11:52:31.546745098 +0000 UTC m=+272.818320257 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/264c6dd1-c7ac-402c-af66-abda335100e1-service-ca-bundle") pod "router-default-7fb545c65c-8k4dn" (UID: "264c6dd1-c7ac-402c-af66-abda335100e1") : configmap references non-existent config key: service-ca.crt
Jun 08 11:52:30.546820 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:52:30.546778    2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 08 11:52:30.546899 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:52:30.546823    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/264c6dd1-c7ac-402c-af66-abda335100e1-metrics-certs podName:264c6dd1-c7ac-402c-af66-abda335100e1 nodeName:}" failed. No retries permitted until 2026-06-08 11:52:31.546808461 +0000 UTC m=+272.818383615 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/264c6dd1-c7ac-402c-af66-abda335100e1-metrics-certs") pod "router-default-7fb545c65c-8k4dn" (UID: "264c6dd1-c7ac-402c-af66-abda335100e1") : secret "router-metrics-certs-default" not found
Jun 08 11:52:30.923789 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:30.923746    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-wrn8q" event={"ID":"563dc1f2-5754-45d6-8b8e-02aab0908ef8","Type":"ContainerStarted","Data":"c50c555e64d8631d1aa1a03607d395a5fb85a1715f1a2e812b17c8a29c2a1ae5"}
Jun 08 11:52:30.924240 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:30.923811    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-wrn8q" event={"ID":"563dc1f2-5754-45d6-8b8e-02aab0908ef8","Type":"ContainerStarted","Data":"4c737fcf5633297ba4171c9d433fa7ce114d622d9f8dbb94f6f129d953a52421"}
Jun 08 11:52:30.926345 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:30.926273    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-brrk6" event={"ID":"5ba6a777-a56b-4674-98c3-5d8fbaf2b4ca","Type":"ContainerStarted","Data":"569c114d2cd20dbf108ae5990b0097eb1c7b458abc3dde213563b59bec4253d0"}
Jun 08 11:52:30.928342 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:30.928314    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-7rkd5" event={"ID":"3214fd2f-d623-436b-b69a-579cf961f902","Type":"ContainerStarted","Data":"19f218cff1f68fc566c3976f962ad6e2563dbfb7be0b41867aee931028aa6df5"}
Jun 08 11:52:30.930414 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:30.930355    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-mnnbj" event={"ID":"cdf82c13-c30a-474a-a135-3d1dbcbb6046","Type":"ContainerStarted","Data":"66a027c78d5eae3189da210fd4815b4e4c76d8882e60ca06aa4e24692ae4bc13"}
Jun 08 11:52:30.942828 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:30.942206    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-wrn8q" podStartSLOduration=1.9421888269999998 podStartE2EDuration="1.942188827s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 11:52:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 11:52:30.94112006 +0000 UTC m=+272.212695235" watchObservedRunningTime="2026-06-08 11:52:30.942188827 +0000 UTC m=+272.213764005"
Jun 08 11:52:31.555690 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:31.555647    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/264c6dd1-c7ac-402c-af66-abda335100e1-service-ca-bundle\") pod \"router-default-7fb545c65c-8k4dn\" (UID: \"264c6dd1-c7ac-402c-af66-abda335100e1\") " pod="openshift-ingress/router-default-7fb545c65c-8k4dn"
Jun 08 11:52:31.555690 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:31.555694    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/264c6dd1-c7ac-402c-af66-abda335100e1-metrics-certs\") pod \"router-default-7fb545c65c-8k4dn\" (UID: \"264c6dd1-c7ac-402c-af66-abda335100e1\") " pod="openshift-ingress/router-default-7fb545c65c-8k4dn"
Jun 08 11:52:31.555956 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:52:31.555883    2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 08 11:52:31.555956 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:52:31.555941    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/264c6dd1-c7ac-402c-af66-abda335100e1-metrics-certs podName:264c6dd1-c7ac-402c-af66-abda335100e1 nodeName:}" failed. No retries permitted until 2026-06-08 11:52:33.555922714 +0000 UTC m=+274.827497876 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/264c6dd1-c7ac-402c-af66-abda335100e1-metrics-certs") pod "router-default-7fb545c65c-8k4dn" (UID: "264c6dd1-c7ac-402c-af66-abda335100e1") : secret "router-metrics-certs-default" not found
Jun 08 11:52:31.556261 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:52:31.556190    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/264c6dd1-c7ac-402c-af66-abda335100e1-service-ca-bundle podName:264c6dd1-c7ac-402c-af66-abda335100e1 nodeName:}" failed. No retries permitted until 2026-06-08 11:52:33.556177563 +0000 UTC m=+274.827752722 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/264c6dd1-c7ac-402c-af66-abda335100e1-service-ca-bundle") pod "router-default-7fb545c65c-8k4dn" (UID: "264c6dd1-c7ac-402c-af66-abda335100e1") : configmap references non-existent config key: service-ca.crt
Jun 08 11:52:33.580034 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:33.579925    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/264c6dd1-c7ac-402c-af66-abda335100e1-service-ca-bundle\") pod \"router-default-7fb545c65c-8k4dn\" (UID: \"264c6dd1-c7ac-402c-af66-abda335100e1\") " pod="openshift-ingress/router-default-7fb545c65c-8k4dn"
Jun 08 11:52:33.580034 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:33.579969    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/264c6dd1-c7ac-402c-af66-abda335100e1-metrics-certs\") pod \"router-default-7fb545c65c-8k4dn\" (UID: \"264c6dd1-c7ac-402c-af66-abda335100e1\") " pod="openshift-ingress/router-default-7fb545c65c-8k4dn"
Jun 08 11:52:33.580593 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:52:33.580104    2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 08 11:52:33.580593 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:52:33.580135    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/264c6dd1-c7ac-402c-af66-abda335100e1-service-ca-bundle podName:264c6dd1-c7ac-402c-af66-abda335100e1 nodeName:}" failed. No retries permitted until 2026-06-08 11:52:37.580116554 +0000 UTC m=+278.851691722 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/264c6dd1-c7ac-402c-af66-abda335100e1-service-ca-bundle") pod "router-default-7fb545c65c-8k4dn" (UID: "264c6dd1-c7ac-402c-af66-abda335100e1") : configmap references non-existent config key: service-ca.crt
Jun 08 11:52:33.580593 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:52:33.580155    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/264c6dd1-c7ac-402c-af66-abda335100e1-metrics-certs podName:264c6dd1-c7ac-402c-af66-abda335100e1 nodeName:}" failed. No retries permitted until 2026-06-08 11:52:37.580147994 +0000 UTC m=+278.851723152 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/264c6dd1-c7ac-402c-af66-abda335100e1-metrics-certs") pod "router-default-7fb545c65c-8k4dn" (UID: "264c6dd1-c7ac-402c-af66-abda335100e1") : secret "router-metrics-certs-default" not found
Jun 08 11:52:33.940414 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:33.940380    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-brrk6" event={"ID":"5ba6a777-a56b-4674-98c3-5d8fbaf2b4ca","Type":"ContainerStarted","Data":"35d43a764a495a51722aaa7f67d1c1649bc5c083112134273d4327501864846c"}
Jun 08 11:52:33.941904 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:33.941877    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-7rkd5" event={"ID":"3214fd2f-d623-436b-b69a-579cf961f902","Type":"ContainerStarted","Data":"25f1926882847c57d69f48b082812940127433f97a8f30b0f77d3a7d578b63fc"}
Jun 08 11:52:33.943449 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:33.943431    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mnnbj_cdf82c13-c30a-474a-a135-3d1dbcbb6046/console-operator/0.log"
Jun 08 11:52:33.943555 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:33.943462    2583 generic.go:356] "Generic (PLEG): container finished" podID="cdf82c13-c30a-474a-a135-3d1dbcbb6046" containerID="299d920e6bf8bca967c8681f1eadfc3ad99e98a5371aae9f89f4cd01efcf45b4" exitCode=255
Jun 08 11:52:33.943555 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:33.943496    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-mnnbj" event={"ID":"cdf82c13-c30a-474a-a135-3d1dbcbb6046","Type":"ContainerDied","Data":"299d920e6bf8bca967c8681f1eadfc3ad99e98a5371aae9f89f4cd01efcf45b4"}
Jun 08 11:52:33.943748 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:33.943731    2583 scope.go:117] "RemoveContainer" containerID="299d920e6bf8bca967c8681f1eadfc3ad99e98a5371aae9f89f4cd01efcf45b4"
Jun 08 11:52:33.955557 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:33.955510    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-brrk6" podStartSLOduration=2.002286083 podStartE2EDuration="4.955495233s" totalImagesPullingTime="2.95320915s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 11:52:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 11:52:33.955272055 +0000 UTC m=+275.226847232" watchObservedRunningTime="2026-06-08 11:52:33.955495233 +0000 UTC m=+275.227070410"
Jun 08 11:52:33.987484 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:33.987409    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-7rkd5" podStartSLOduration=2.145491537 podStartE2EDuration="4.987388844s" totalImagesPullingTime="2.841897307s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 11:52:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 11:52:33.986281862 +0000 UTC m=+275.257857044" watchObservedRunningTime="2026-06-08 11:52:33.987388844 +0000 UTC m=+275.258964021"
Jun 08 11:52:34.268740 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:34.268657    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-xbsg8"]
Jun 08 11:52:34.271642 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:34.271626    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-xbsg8"
Jun 08 11:52:34.274305 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:34.274279    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-z6lk8\""
Jun 08 11:52:34.274427 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:34.274323    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jun 08 11:52:34.274427 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:34.274323    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jun 08 11:52:34.282482 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:34.282459    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-xbsg8"]
Jun 08 11:52:34.387272 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:34.387232    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzkkj\" (UniqueName: \"kubernetes.io/projected/17db10cc-af45-4ddc-9415-de45156683a9-kube-api-access-dzkkj\") pod \"migrator-955ffdf5f-xbsg8\" (UID: \"17db10cc-af45-4ddc-9415-de45156683a9\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-xbsg8"
Jun 08 11:52:34.488315 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:34.488274    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzkkj\" (UniqueName: \"kubernetes.io/projected/17db10cc-af45-4ddc-9415-de45156683a9-kube-api-access-dzkkj\") pod \"migrator-955ffdf5f-xbsg8\" (UID: \"17db10cc-af45-4ddc-9415-de45156683a9\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-xbsg8"
Jun 08 11:52:34.497999 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:34.497956    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzkkj\" (UniqueName: \"kubernetes.io/projected/17db10cc-af45-4ddc-9415-de45156683a9-kube-api-access-dzkkj\") pod \"migrator-955ffdf5f-xbsg8\" (UID: \"17db10cc-af45-4ddc-9415-de45156683a9\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-xbsg8"
Jun 08 11:52:34.580255 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:34.580159    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-xbsg8"
Jun 08 11:52:34.698214 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:34.698179    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-xbsg8"]
Jun 08 11:52:34.701154 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:52:34.701128    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17db10cc_af45_4ddc_9415_de45156683a9.slice/crio-da2aa6147144966906dec24dd008d2c81c0eb3ca7c57ea8ad4b5239c0451fb1d WatchSource:0}: Error finding container da2aa6147144966906dec24dd008d2c81c0eb3ca7c57ea8ad4b5239c0451fb1d: Status 404 returned error can't find the container with id da2aa6147144966906dec24dd008d2c81c0eb3ca7c57ea8ad4b5239c0451fb1d
Jun 08 11:52:34.948479 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:34.948453    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mnnbj_cdf82c13-c30a-474a-a135-3d1dbcbb6046/console-operator/1.log"
Jun 08 11:52:34.948829 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:34.948816    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mnnbj_cdf82c13-c30a-474a-a135-3d1dbcbb6046/console-operator/0.log"
Jun 08 11:52:34.948883 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:34.948850    2583 generic.go:356] "Generic (PLEG): container finished" podID="cdf82c13-c30a-474a-a135-3d1dbcbb6046" containerID="ddbee68245855b8960ce3e5567bb2cfea2dae7a6e6d373e3115e57532e99053f" exitCode=255
Jun 08 11:52:34.948969 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:34.948940    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-mnnbj" event={"ID":"cdf82c13-c30a-474a-a135-3d1dbcbb6046","Type":"ContainerDied","Data":"ddbee68245855b8960ce3e5567bb2cfea2dae7a6e6d373e3115e57532e99053f"}
Jun 08 11:52:34.949081 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:34.949029    2583 scope.go:117] "RemoveContainer" containerID="299d920e6bf8bca967c8681f1eadfc3ad99e98a5371aae9f89f4cd01efcf45b4"
Jun 08 11:52:34.949247 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:34.949212    2583 scope.go:117] "RemoveContainer" containerID="ddbee68245855b8960ce3e5567bb2cfea2dae7a6e6d373e3115e57532e99053f"
Jun 08 11:52:34.949403 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:52:34.949378    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-mnnbj_openshift-console-operator(cdf82c13-c30a-474a-a135-3d1dbcbb6046)\"" pod="openshift-console-operator/console-operator-668fdbf85c-mnnbj" podUID="cdf82c13-c30a-474a-a135-3d1dbcbb6046"
Jun 08 11:52:34.950179 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:34.950111    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-xbsg8" event={"ID":"17db10cc-af45-4ddc-9415-de45156683a9","Type":"ContainerStarted","Data":"da2aa6147144966906dec24dd008d2c81c0eb3ca7c57ea8ad4b5239c0451fb1d"}
Jun 08 11:52:35.954916 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:35.954832    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mnnbj_cdf82c13-c30a-474a-a135-3d1dbcbb6046/console-operator/1.log"
Jun 08 11:52:35.955345 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:35.955206    2583 scope.go:117] "RemoveContainer" containerID="ddbee68245855b8960ce3e5567bb2cfea2dae7a6e6d373e3115e57532e99053f"
Jun 08 11:52:35.955412 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:52:35.955387    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-mnnbj_openshift-console-operator(cdf82c13-c30a-474a-a135-3d1dbcbb6046)\"" pod="openshift-console-operator/console-operator-668fdbf85c-mnnbj" podUID="cdf82c13-c30a-474a-a135-3d1dbcbb6046"
Jun 08 11:52:35.956689 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:35.956659    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-xbsg8" event={"ID":"17db10cc-af45-4ddc-9415-de45156683a9","Type":"ContainerStarted","Data":"fa5a5897ec7da22c546a6bf0616af320be96c9fbb44f80d10a809381eabc365a"}
Jun 08 11:52:35.956783 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:35.956720    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-xbsg8" event={"ID":"17db10cc-af45-4ddc-9415-de45156683a9","Type":"ContainerStarted","Data":"ce0baf0dfb2cae4700bc76bbfa4d412d965b0d16e406a35582dda20a22c19fe5"}
Jun 08 11:52:35.984898 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:35.984856    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-xbsg8" podStartSLOduration=1.00854522 podStartE2EDuration="1.984842976s" totalImagesPullingTime="976.297756ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 11:52:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 11:52:35.98406972 +0000 UTC m=+277.255644894" watchObservedRunningTime="2026-06-08 11:52:35.984842976 +0000 UTC m=+277.256418151"
Jun 08 11:52:36.741367 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:36.741333    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-5wgrl"]
Jun 08 11:52:36.744372 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:36.744350    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-5wgrl"
Jun 08 11:52:36.746462 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:36.746442    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-fk9t2\""
Jun 08 11:52:36.746550 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:36.746446    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jun 08 11:52:36.747297 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:36.747282    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jun 08 11:52:36.747344 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:36.747286    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jun 08 11:52:36.747344 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:36.747335    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jun 08 11:52:36.751705 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:36.751687    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-5wgrl"]
Jun 08 11:52:36.808646 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:36.808619    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/fcb0445a-4b00-4afc-8095-cb6d486eb1c1-signing-cabundle\") pod \"service-ca-7d74d578b8-5wgrl\" (UID: \"fcb0445a-4b00-4afc-8095-cb6d486eb1c1\") " pod="openshift-service-ca/service-ca-7d74d578b8-5wgrl"
Jun 08 11:52:36.808810 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:36.808684    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pg7g\" (UniqueName: \"kubernetes.io/projected/fcb0445a-4b00-4afc-8095-cb6d486eb1c1-kube-api-access-4pg7g\") pod \"service-ca-7d74d578b8-5wgrl\" (UID: \"fcb0445a-4b00-4afc-8095-cb6d486eb1c1\") " pod="openshift-service-ca/service-ca-7d74d578b8-5wgrl"
Jun 08 11:52:36.808874 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:36.808824    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/fcb0445a-4b00-4afc-8095-cb6d486eb1c1-signing-key\") pod \"service-ca-7d74d578b8-5wgrl\" (UID: \"fcb0445a-4b00-4afc-8095-cb6d486eb1c1\") " pod="openshift-service-ca/service-ca-7d74d578b8-5wgrl"
Jun 08 11:52:36.909175 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:36.909140    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pg7g\" (UniqueName: \"kubernetes.io/projected/fcb0445a-4b00-4afc-8095-cb6d486eb1c1-kube-api-access-4pg7g\") pod \"service-ca-7d74d578b8-5wgrl\" (UID: \"fcb0445a-4b00-4afc-8095-cb6d486eb1c1\") " pod="openshift-service-ca/service-ca-7d74d578b8-5wgrl"
Jun 08 11:52:36.909345 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:36.909297    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/fcb0445a-4b00-4afc-8095-cb6d486eb1c1-signing-key\") pod \"service-ca-7d74d578b8-5wgrl\" (UID: \"fcb0445a-4b00-4afc-8095-cb6d486eb1c1\") " pod="openshift-service-ca/service-ca-7d74d578b8-5wgrl"
Jun 08 11:52:36.909345 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:36.909317    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/fcb0445a-4b00-4afc-8095-cb6d486eb1c1-signing-cabundle\") pod \"service-ca-7d74d578b8-5wgrl\" (UID: \"fcb0445a-4b00-4afc-8095-cb6d486eb1c1\") " pod="openshift-service-ca/service-ca-7d74d578b8-5wgrl"
Jun 08 11:52:36.909974 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:36.909955    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/fcb0445a-4b00-4afc-8095-cb6d486eb1c1-signing-cabundle\") pod \"service-ca-7d74d578b8-5wgrl\" (UID: \"fcb0445a-4b00-4afc-8095-cb6d486eb1c1\") " pod="openshift-service-ca/service-ca-7d74d578b8-5wgrl"
Jun 08 11:52:36.911760 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:36.911738    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/fcb0445a-4b00-4afc-8095-cb6d486eb1c1-signing-key\") pod \"service-ca-7d74d578b8-5wgrl\" (UID: \"fcb0445a-4b00-4afc-8095-cb6d486eb1c1\") " pod="openshift-service-ca/service-ca-7d74d578b8-5wgrl"
Jun 08 11:52:36.917042 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:36.917024    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pg7g\" (UniqueName: \"kubernetes.io/projected/fcb0445a-4b00-4afc-8095-cb6d486eb1c1-kube-api-access-4pg7g\") pod \"service-ca-7d74d578b8-5wgrl\" (UID: \"fcb0445a-4b00-4afc-8095-cb6d486eb1c1\") " pod="openshift-service-ca/service-ca-7d74d578b8-5wgrl"
Jun 08 11:52:37.053221 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:37.053125    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-5wgrl"
Jun 08 11:52:37.174907 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:37.174875    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-5wgrl"]
Jun 08 11:52:37.178267 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:52:37.178243    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcb0445a_4b00_4afc_8095_cb6d486eb1c1.slice/crio-8c018c2c39a94a757146f30ae1d4884775d7f0e118430734f43cfb4e769e284a WatchSource:0}: Error finding container 8c018c2c39a94a757146f30ae1d4884775d7f0e118430734f43cfb4e769e284a: Status 404 returned error can't find the container with id 8c018c2c39a94a757146f30ae1d4884775d7f0e118430734f43cfb4e769e284a
Jun 08 11:52:37.493392 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:37.493357    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dmbw7_f7cbbb77-d234-4a11-811c-26a8a21019df/dns-node-resolver/0.log"
Jun 08 11:52:37.614529 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:37.614486    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/264c6dd1-c7ac-402c-af66-abda335100e1-service-ca-bundle\") pod \"router-default-7fb545c65c-8k4dn\" (UID: \"264c6dd1-c7ac-402c-af66-abda335100e1\") " pod="openshift-ingress/router-default-7fb545c65c-8k4dn"
Jun 08 11:52:37.614529 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:37.614529    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/264c6dd1-c7ac-402c-af66-abda335100e1-metrics-certs\") pod \"router-default-7fb545c65c-8k4dn\" (UID: \"264c6dd1-c7ac-402c-af66-abda335100e1\") " pod="openshift-ingress/router-default-7fb545c65c-8k4dn"
Jun 08 11:52:37.614721 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:52:37.614633    2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 08 11:52:37.614721 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:52:37.614659    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/264c6dd1-c7ac-402c-af66-abda335100e1-service-ca-bundle podName:264c6dd1-c7ac-402c-af66-abda335100e1 nodeName:}" failed. No retries permitted until 2026-06-08 11:52:45.614641545 +0000 UTC m=+286.886216700 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/264c6dd1-c7ac-402c-af66-abda335100e1-service-ca-bundle") pod "router-default-7fb545c65c-8k4dn" (UID: "264c6dd1-c7ac-402c-af66-abda335100e1") : configmap references non-existent config key: service-ca.crt
Jun 08 11:52:37.614721 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:52:37.614683    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/264c6dd1-c7ac-402c-af66-abda335100e1-metrics-certs podName:264c6dd1-c7ac-402c-af66-abda335100e1 nodeName:}" failed. No retries permitted until 2026-06-08 11:52:45.614675736 +0000 UTC m=+286.886250891 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/264c6dd1-c7ac-402c-af66-abda335100e1-metrics-certs") pod "router-default-7fb545c65c-8k4dn" (UID: "264c6dd1-c7ac-402c-af66-abda335100e1") : secret "router-metrics-certs-default" not found
Jun 08 11:52:37.965494 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:37.965458    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-5wgrl" event={"ID":"fcb0445a-4b00-4afc-8095-cb6d486eb1c1","Type":"ContainerStarted","Data":"f7b9bfff505474e989acd1de7255e260f4cc33f9dc8fbb00f0ebcc436710dc16"}
Jun 08 11:52:37.965649 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:37.965507    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-5wgrl" event={"ID":"fcb0445a-4b00-4afc-8095-cb6d486eb1c1","Type":"ContainerStarted","Data":"8c018c2c39a94a757146f30ae1d4884775d7f0e118430734f43cfb4e769e284a"}
Jun 08 11:52:37.981898 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:37.981852    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-5wgrl" podStartSLOduration=1.9818366520000001 podStartE2EDuration="1.981836652s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 11:52:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 11:52:37.98116283 +0000 UTC m=+279.252738006" watchObservedRunningTime="2026-06-08 11:52:37.981836652 +0000 UTC m=+279.253411829"
Jun 08 11:52:38.294483 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:38.294399    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ps66l_42241258-7f82-4c8b-9862-4a32ddfcf5f2/node-ca/0.log"
Jun 08 11:52:39.093172 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:39.093138    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-j82tx_97cb5e19-342d-49be-ad3a-346a649f83af/serve-healthcheck-canary/0.log"
Jun 08 11:52:39.493587 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:39.493491    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-xbsg8_17db10cc-af45-4ddc-9415-de45156683a9/migrator/0.log"
Jun 08 11:52:39.651523 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:52:39.651484    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5877df4c8d-zkhq7" podUID="91c73bfb-0940-4926-8f4e-318c3f01d5c2"
Jun 08 11:52:39.651672 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:52:39.651498    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-5nvrq" podUID="5853cb11-e926-49de-a93b-7b64dc90d574"
Jun 08 11:52:39.693946 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:39.693922    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-xbsg8_17db10cc-af45-4ddc-9415-de45156683a9/graceful-termination/0.log"
Jun 08 11:52:39.975814 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:39.975787    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5877df4c8d-zkhq7"
Jun 08 11:52:39.975814 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:39.975811    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5nvrq"
Jun 08 11:52:40.212911 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:40.212829    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-mnnbj"
Jun 08 11:52:40.212911 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:40.212887    2583 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-mnnbj"
Jun 08 11:52:40.213204 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:40.213193    2583 scope.go:117] "RemoveContainer" containerID="ddbee68245855b8960ce3e5567bb2cfea2dae7a6e6d373e3115e57532e99053f"
Jun 08 11:52:40.213337 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:52:40.213321    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-mnnbj_openshift-console-operator(cdf82c13-c30a-474a-a135-3d1dbcbb6046)\"" pod="openshift-console-operator/console-operator-668fdbf85c-mnnbj" podUID="cdf82c13-c30a-474a-a135-3d1dbcbb6046"
Jun 08 11:52:42.655393 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:42.655350    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5853cb11-e926-49de-a93b-7b64dc90d574-metrics-tls\") pod \"dns-default-5nvrq\" (UID: \"5853cb11-e926-49de-a93b-7b64dc90d574\") " pod="openshift-dns/dns-default-5nvrq"
Jun 08 11:52:42.655894 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:42.655460    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91c73bfb-0940-4926-8f4e-318c3f01d5c2-registry-tls\") pod \"image-registry-5877df4c8d-zkhq7\" (UID: \"91c73bfb-0940-4926-8f4e-318c3f01d5c2\") " pod="openshift-image-registry/image-registry-5877df4c8d-zkhq7"
Jun 08 11:52:42.657675 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:42.657650    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5853cb11-e926-49de-a93b-7b64dc90d574-metrics-tls\") pod \"dns-default-5nvrq\" (UID: \"5853cb11-e926-49de-a93b-7b64dc90d574\") " pod="openshift-dns/dns-default-5nvrq"
Jun 08 11:52:42.657788 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:42.657712    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91c73bfb-0940-4926-8f4e-318c3f01d5c2-registry-tls\") pod \"image-registry-5877df4c8d-zkhq7\" (UID: \"91c73bfb-0940-4926-8f4e-318c3f01d5c2\") " pod="openshift-image-registry/image-registry-5877df4c8d-zkhq7"
Jun 08 11:52:42.679618 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:42.679593    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-s6fj9\""
Jun 08 11:52:42.679618 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:42.679592    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-r2n9k\""
Jun 08 11:52:42.687421 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:42.687399    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5877df4c8d-zkhq7"
Jun 08 11:52:42.687512 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:42.687420    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5nvrq"
Jun 08 11:52:42.822199 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:42.822168    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5nvrq"]
Jun 08 11:52:42.826014 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:52:42.825987    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5853cb11_e926_49de_a93b_7b64dc90d574.slice/crio-c7e41c41f6edb8306d694683d580430cf9befd0b0959abcbefc4dd6c26b108f2 WatchSource:0}: Error finding container c7e41c41f6edb8306d694683d580430cf9befd0b0959abcbefc4dd6c26b108f2: Status 404 returned error can't find the container with id c7e41c41f6edb8306d694683d580430cf9befd0b0959abcbefc4dd6c26b108f2
Jun 08 11:52:42.842578 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:42.842556    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5877df4c8d-zkhq7"]
Jun 08 11:52:42.845082 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:52:42.845059    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91c73bfb_0940_4926_8f4e_318c3f01d5c2.slice/crio-ee8440b9b2ef56c0f15f9aaae8c186179e71cc985ee1cd19929c483d152cf342 WatchSource:0}: Error finding container ee8440b9b2ef56c0f15f9aaae8c186179e71cc985ee1cd19929c483d152cf342: Status 404 returned error can't find the container with id ee8440b9b2ef56c0f15f9aaae8c186179e71cc985ee1cd19929c483d152cf342
Jun 08 11:52:42.985880 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:42.985794    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5877df4c8d-zkhq7" event={"ID":"91c73bfb-0940-4926-8f4e-318c3f01d5c2","Type":"ContainerStarted","Data":"20a15aad914f5d4a3c7f2138800e3f2e03fc8fd15a55b95c5300c9f01a428f2f"}
Jun 08 11:52:42.985880 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:42.985851    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5877df4c8d-zkhq7" event={"ID":"91c73bfb-0940-4926-8f4e-318c3f01d5c2","Type":"ContainerStarted","Data":"ee8440b9b2ef56c0f15f9aaae8c186179e71cc985ee1cd19929c483d152cf342"}
Jun 08 11:52:42.986092 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:42.985906    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5877df4c8d-zkhq7"
Jun 08 11:52:42.986959 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:42.986938    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5nvrq" event={"ID":"5853cb11-e926-49de-a93b-7b64dc90d574","Type":"ContainerStarted","Data":"c7e41c41f6edb8306d694683d580430cf9befd0b0959abcbefc4dd6c26b108f2"}
Jun 08 11:52:43.008658 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:43.008612    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5877df4c8d-zkhq7" podStartSLOduration=284.00859741 podStartE2EDuration="4m44.00859741s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 11:47:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 11:52:43.007656031 +0000 UTC m=+284.279231209" watchObservedRunningTime="2026-06-08 11:52:43.00859741 +0000 UTC m=+284.280172585"
Jun 08 11:52:44.995906 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:44.995868    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5nvrq" event={"ID":"5853cb11-e926-49de-a93b-7b64dc90d574","Type":"ContainerStarted","Data":"4dccbec1c5acfee57151f998625d27cf30cb6f0d1f281d54cace59951d21d0d6"}
Jun 08 11:52:44.996278 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:44.995959    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5nvrq" event={"ID":"5853cb11-e926-49de-a93b-7b64dc90d574","Type":"ContainerStarted","Data":"c7f2ba36104b3cf3ba0742138918beb067be03219bb33c329c78b6166262dca5"}
Jun 08 11:52:44.996278 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:44.995988    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5nvrq"
Jun 08 11:52:45.012479 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:45.012431    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-5nvrq" podStartSLOduration=251.376775457 podStartE2EDuration="4m13.012417817s" totalImagesPullingTime="1.63564236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 11:48:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 11:52:45.011987735 +0000 UTC m=+286.283562911" watchObservedRunningTime="2026-06-08 11:52:45.012417817 +0000 UTC m=+286.283993019"
Jun 08 11:52:45.679035 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:45.678993    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/264c6dd1-c7ac-402c-af66-abda335100e1-service-ca-bundle\") pod \"router-default-7fb545c65c-8k4dn\" (UID: \"264c6dd1-c7ac-402c-af66-abda335100e1\") " pod="openshift-ingress/router-default-7fb545c65c-8k4dn"
Jun 08 11:52:45.679035 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:45.679036    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/264c6dd1-c7ac-402c-af66-abda335100e1-metrics-certs\") pod \"router-default-7fb545c65c-8k4dn\" (UID: \"264c6dd1-c7ac-402c-af66-abda335100e1\") " pod="openshift-ingress/router-default-7fb545c65c-8k4dn"
Jun 08 11:52:45.679613 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:45.679593    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/264c6dd1-c7ac-402c-af66-abda335100e1-service-ca-bundle\") pod \"router-default-7fb545c65c-8k4dn\" (UID: \"264c6dd1-c7ac-402c-af66-abda335100e1\") " pod="openshift-ingress/router-default-7fb545c65c-8k4dn"
Jun 08 11:52:45.681254 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:45.681233    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/264c6dd1-c7ac-402c-af66-abda335100e1-metrics-certs\") pod \"router-default-7fb545c65c-8k4dn\" (UID: \"264c6dd1-c7ac-402c-af66-abda335100e1\") " pod="openshift-ingress/router-default-7fb545c65c-8k4dn"
Jun 08 11:52:45.819174 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:45.819138    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7fb545c65c-8k4dn"
Jun 08 11:52:45.956766 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:45.956697    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7fb545c65c-8k4dn"]
Jun 08 11:52:45.959746 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:52:45.959718    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod264c6dd1_c7ac_402c_af66_abda335100e1.slice/crio-added3f5c5318b3ecbf3157b11010207d2f5408b276554b242583c7ed382f331 WatchSource:0}: Error finding container added3f5c5318b3ecbf3157b11010207d2f5408b276554b242583c7ed382f331: Status 404 returned error can't find the container with id added3f5c5318b3ecbf3157b11010207d2f5408b276554b242583c7ed382f331
Jun 08 11:52:46.000326 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:46.000300    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7fb545c65c-8k4dn" event={"ID":"264c6dd1-c7ac-402c-af66-abda335100e1","Type":"ContainerStarted","Data":"added3f5c5318b3ecbf3157b11010207d2f5408b276554b242583c7ed382f331"}
Jun 08 11:52:47.005063 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:47.005010    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7fb545c65c-8k4dn" event={"ID":"264c6dd1-c7ac-402c-af66-abda335100e1","Type":"ContainerStarted","Data":"f539c3eeec204212cde20f6cc82a93ce3de012156b28ab9de4a7578f5ac257fb"}
Jun 08 11:52:47.027747 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:47.027703    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7fb545c65c-8k4dn" podStartSLOduration=18.027688674 podStartE2EDuration="18.027688674s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 11:52:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 11:52:47.025818524 +0000 UTC m=+288.297393701" watchObservedRunningTime="2026-06-08 11:52:47.027688674 +0000 UTC m=+288.299263849"
Jun 08 11:52:47.819718 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:47.819673    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7fb545c65c-8k4dn"
Jun 08 11:52:47.822006 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:47.821978    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7fb545c65c-8k4dn"
Jun 08 11:52:48.013281 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:48.013249    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7fb545c65c-8k4dn"
Jun 08 11:52:48.015539 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:48.015514    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7fb545c65c-8k4dn"
Jun 08 11:52:52.180966 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:52.180939    2583 scope.go:117] "RemoveContainer" containerID="ddbee68245855b8960ce3e5567bb2cfea2dae7a6e6d373e3115e57532e99053f"
Jun 08 11:52:53.028187 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:53.028157    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mnnbj_cdf82c13-c30a-474a-a135-3d1dbcbb6046/console-operator/2.log"
Jun 08 11:52:53.028560 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:53.028544    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mnnbj_cdf82c13-c30a-474a-a135-3d1dbcbb6046/console-operator/1.log"
Jun 08 11:52:53.028624 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:53.028577    2583 generic.go:356] "Generic (PLEG): container finished" podID="cdf82c13-c30a-474a-a135-3d1dbcbb6046" containerID="ddce2ca82341798a52abfe5e88f620ac5fd36ecb2fe73fd389ec7a2ad6e40941" exitCode=255
Jun 08 11:52:53.028658 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:53.028626    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-mnnbj" event={"ID":"cdf82c13-c30a-474a-a135-3d1dbcbb6046","Type":"ContainerDied","Data":"ddce2ca82341798a52abfe5e88f620ac5fd36ecb2fe73fd389ec7a2ad6e40941"}
Jun 08 11:52:53.028698 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:53.028668    2583 scope.go:117] "RemoveContainer" containerID="ddbee68245855b8960ce3e5567bb2cfea2dae7a6e6d373e3115e57532e99053f"
Jun 08 11:52:53.028976 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:53.028958    2583 scope.go:117] "RemoveContainer" containerID="ddce2ca82341798a52abfe5e88f620ac5fd36ecb2fe73fd389ec7a2ad6e40941"
Jun 08 11:52:53.029153 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:52:53.029134    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-mnnbj_openshift-console-operator(cdf82c13-c30a-474a-a135-3d1dbcbb6046)\"" pod="openshift-console-operator/console-operator-668fdbf85c-mnnbj" podUID="cdf82c13-c30a-474a-a135-3d1dbcbb6046"
Jun 08 11:52:53.182184 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:52:53.182143    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-6m4cb" podUID="0b2281a3-722f-4113-b3e1-7f4b4614f599"
Jun 08 11:52:54.032649 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:54.032622    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mnnbj_cdf82c13-c30a-474a-a135-3d1dbcbb6046/console-operator/2.log"
Jun 08 11:52:55.002300 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:55.002272    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5nvrq"
Jun 08 11:52:58.231393 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:58.231357    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-st8rr"]
Jun 08 11:52:58.253879 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:58.253850    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-st8rr"]
Jun 08 11:52:58.254036 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:58.254006    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-st8rr"
Jun 08 11:52:58.256571 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:58.256546    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jun 08 11:52:58.256884 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:58.256864    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jun 08 11:52:58.257451 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:58.257431    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kq98l\""
Jun 08 11:52:58.367137 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:58.367107    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/54a30869-0529-4e42-a111-f178894d4e91-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-st8rr\" (UID: \"54a30869-0529-4e42-a111-f178894d4e91\") " pod="openshift-insights/insights-runtime-extractor-st8rr"
Jun 08 11:52:58.367286 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:58.367149    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/54a30869-0529-4e42-a111-f178894d4e91-crio-socket\") pod \"insights-runtime-extractor-st8rr\" (UID: \"54a30869-0529-4e42-a111-f178894d4e91\") " pod="openshift-insights/insights-runtime-extractor-st8rr"
Jun 08 11:52:58.367286 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:58.367217    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/54a30869-0529-4e42-a111-f178894d4e91-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-st8rr\" (UID: \"54a30869-0529-4e42-a111-f178894d4e91\") " pod="openshift-insights/insights-runtime-extractor-st8rr"
Jun 08 11:52:58.367360 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:58.367301    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vl245\" (UniqueName: \"kubernetes.io/projected/54a30869-0529-4e42-a111-f178894d4e91-kube-api-access-vl245\") pod \"insights-runtime-extractor-st8rr\" (UID: \"54a30869-0529-4e42-a111-f178894d4e91\") " pod="openshift-insights/insights-runtime-extractor-st8rr"
Jun 08 11:52:58.367360 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:58.367335    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/54a30869-0529-4e42-a111-f178894d4e91-data-volume\") pod \"insights-runtime-extractor-st8rr\" (UID: \"54a30869-0529-4e42-a111-f178894d4e91\") " pod="openshift-insights/insights-runtime-extractor-st8rr"
Jun 08 11:52:58.468503 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:58.468466    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/54a30869-0529-4e42-a111-f178894d4e91-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-st8rr\" (UID: \"54a30869-0529-4e42-a111-f178894d4e91\") " pod="openshift-insights/insights-runtime-extractor-st8rr"
Jun 08 11:52:58.468685 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:58.468527    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vl245\" (UniqueName: \"kubernetes.io/projected/54a30869-0529-4e42-a111-f178894d4e91-kube-api-access-vl245\") pod \"insights-runtime-extractor-st8rr\" (UID: \"54a30869-0529-4e42-a111-f178894d4e91\") " pod="openshift-insights/insights-runtime-extractor-st8rr"
Jun 08 11:52:58.468685 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:58.468551    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/54a30869-0529-4e42-a111-f178894d4e91-data-volume\") pod \"insights-runtime-extractor-st8rr\" (UID: \"54a30869-0529-4e42-a111-f178894d4e91\") " pod="openshift-insights/insights-runtime-extractor-st8rr"
Jun 08 11:52:58.468685 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:58.468572    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/54a30869-0529-4e42-a111-f178894d4e91-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-st8rr\" (UID: \"54a30869-0529-4e42-a111-f178894d4e91\") " pod="openshift-insights/insights-runtime-extractor-st8rr"
Jun 08 11:52:58.468685 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:58.468601    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/54a30869-0529-4e42-a111-f178894d4e91-crio-socket\") pod \"insights-runtime-extractor-st8rr\" (UID: \"54a30869-0529-4e42-a111-f178894d4e91\") " pod="openshift-insights/insights-runtime-extractor-st8rr"
Jun 08 11:52:58.468884 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:58.468690    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/54a30869-0529-4e42-a111-f178894d4e91-crio-socket\") pod \"insights-runtime-extractor-st8rr\" (UID: \"54a30869-0529-4e42-a111-f178894d4e91\") " pod="openshift-insights/insights-runtime-extractor-st8rr"
Jun 08 11:52:58.468967 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:58.468948    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/54a30869-0529-4e42-a111-f178894d4e91-data-volume\") pod \"insights-runtime-extractor-st8rr\" (UID: \"54a30869-0529-4e42-a111-f178894d4e91\") " pod="openshift-insights/insights-runtime-extractor-st8rr"
Jun 08 11:52:58.469213 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:58.469192    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/54a30869-0529-4e42-a111-f178894d4e91-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-st8rr\" (UID: \"54a30869-0529-4e42-a111-f178894d4e91\") " pod="openshift-insights/insights-runtime-extractor-st8rr"
Jun 08 11:52:58.470699 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:58.470681    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/54a30869-0529-4e42-a111-f178894d4e91-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-st8rr\" (UID: \"54a30869-0529-4e42-a111-f178894d4e91\") " pod="openshift-insights/insights-runtime-extractor-st8rr"
Jun 08 11:52:58.482642 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:58.482583    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vl245\" (UniqueName: \"kubernetes.io/projected/54a30869-0529-4e42-a111-f178894d4e91-kube-api-access-vl245\") pod \"insights-runtime-extractor-st8rr\" (UID: \"54a30869-0529-4e42-a111-f178894d4e91\") " pod="openshift-insights/insights-runtime-extractor-st8rr"
Jun 08 11:52:58.563536 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:58.563500    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-st8rr"
Jun 08 11:52:58.716353 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:58.716327    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-st8rr"]
Jun 08 11:52:58.718800 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:52:58.718771    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54a30869_0529_4e42_a111_f178894d4e91.slice/crio-4fd1130e7683537c0afa98a31e0b317f077a40d1e29b7ebe5a022d5635cdefbd WatchSource:0}: Error finding container 4fd1130e7683537c0afa98a31e0b317f077a40d1e29b7ebe5a022d5635cdefbd: Status 404 returned error can't find the container with id 4fd1130e7683537c0afa98a31e0b317f077a40d1e29b7ebe5a022d5635cdefbd
Jun 08 11:52:59.048629 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:59.048551    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-st8rr" event={"ID":"54a30869-0529-4e42-a111-f178894d4e91","Type":"ContainerStarted","Data":"7b30cad9185a13ea16a0be94120acecfb2dd900f83f9d2a7aebdadc5591d969b"}
Jun 08 11:52:59.048629 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:59.048604    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-st8rr" event={"ID":"54a30869-0529-4e42-a111-f178894d4e91","Type":"ContainerStarted","Data":"4fd1130e7683537c0afa98a31e0b317f077a40d1e29b7ebe5a022d5635cdefbd"}
Jun 08 11:52:59.127043 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:59.127017    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mnnbj_cdf82c13-c30a-474a-a135-3d1dbcbb6046/console-operator/2.log"
Jun 08 11:52:59.127978 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:59.127950    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mnnbj_cdf82c13-c30a-474a-a135-3d1dbcbb6046/console-operator/2.log"
Jun 08 11:52:59.136732 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:52:59.136716    2583 kubelet.go:1648] "Image garbage collection succeeded"
Jun 08 11:53:00.054715 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:00.054679    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-st8rr" event={"ID":"54a30869-0529-4e42-a111-f178894d4e91","Type":"ContainerStarted","Data":"d3058dc570d3a6163d84c10d2b6d7786df4e722e498b85c4a45d82d148a60817"}
Jun 08 11:53:00.212540 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:00.212497    2583 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-mnnbj"
Jun 08 11:53:00.212719 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:00.212554    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-mnnbj"
Jun 08 11:53:00.212907 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:00.212881    2583 scope.go:117] "RemoveContainer" containerID="ddce2ca82341798a52abfe5e88f620ac5fd36ecb2fe73fd389ec7a2ad6e40941"
Jun 08 11:53:00.213100 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:53:00.213067    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-mnnbj_openshift-console-operator(cdf82c13-c30a-474a-a135-3d1dbcbb6046)\"" pod="openshift-console-operator/console-operator-668fdbf85c-mnnbj" podUID="cdf82c13-c30a-474a-a135-3d1dbcbb6046"
Jun 08 11:53:01.059422 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:01.059393    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-st8rr" event={"ID":"54a30869-0529-4e42-a111-f178894d4e91","Type":"ContainerStarted","Data":"4eabb68baee43440050c620236b3801689cd1e293943c0db0b2bb3cc2311accd"}
Jun 08 11:53:01.078220 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:01.078175    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-st8rr" podStartSLOduration=1.020111368 podStartE2EDuration="3.078160454s" totalImagesPullingTime="2.058049086s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 11:52:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 11:53:01.077656808 +0000 UTC m=+302.349231983" watchObservedRunningTime="2026-06-08 11:53:01.078160454 +0000 UTC m=+302.349735630"
Jun 08 11:53:02.692578 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:02.692546    2583 patch_prober.go:28] interesting pod/image-registry-5877df4c8d-zkhq7 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 08 11:53:02.692921 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:02.692606    2583 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5877df4c8d-zkhq7" podUID="91c73bfb-0940-4926-8f4e-318c3f01d5c2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 08 11:53:03.994861 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:03.994832    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5877df4c8d-zkhq7"
Jun 08 11:53:05.180929 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:05.180893    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6m4cb"
Jun 08 11:53:08.469707 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:08.469672    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-zxc2w"]
Jun 08 11:53:08.473069 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:08.473028    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-zxc2w"
Jun 08 11:53:08.475449 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:08.475429    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jun 08 11:53:08.475449 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:08.475438    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jun 08 11:53:08.476317 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:08.476301    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-4vchv\""
Jun 08 11:53:08.476509 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:08.476491    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jun 08 11:53:08.476597 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:08.476546    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jun 08 11:53:08.476658 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:08.476630    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jun 08 11:53:08.483966 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:08.483946    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-zxc2w"]
Jun 08 11:53:08.547300 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:08.547271    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/14f03648-781e-458c-8f1d-f4898e83e0a4-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-zxc2w\" (UID: \"14f03648-781e-458c-8f1d-f4898e83e0a4\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-zxc2w"
Jun 08 11:53:08.547429 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:08.547317    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/14f03648-781e-458c-8f1d-f4898e83e0a4-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-zxc2w\" (UID: \"14f03648-781e-458c-8f1d-f4898e83e0a4\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-zxc2w"
Jun 08 11:53:08.547429 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:08.547340    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9gq7\" (UniqueName: \"kubernetes.io/projected/14f03648-781e-458c-8f1d-f4898e83e0a4-kube-api-access-v9gq7\") pod \"prometheus-operator-7f7d445d84-zxc2w\" (UID: \"14f03648-781e-458c-8f1d-f4898e83e0a4\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-zxc2w"
Jun 08 11:53:08.547429 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:08.547396    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/14f03648-781e-458c-8f1d-f4898e83e0a4-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-zxc2w\" (UID: \"14f03648-781e-458c-8f1d-f4898e83e0a4\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-zxc2w"
Jun 08 11:53:08.648369 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:08.648344    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/14f03648-781e-458c-8f1d-f4898e83e0a4-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-zxc2w\" (UID: \"14f03648-781e-458c-8f1d-f4898e83e0a4\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-zxc2w"
Jun 08 11:53:08.648518 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:08.648390    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/14f03648-781e-458c-8f1d-f4898e83e0a4-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-zxc2w\" (UID: \"14f03648-781e-458c-8f1d-f4898e83e0a4\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-zxc2w"
Jun 08 11:53:08.648518 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:08.648409    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9gq7\" (UniqueName: \"kubernetes.io/projected/14f03648-781e-458c-8f1d-f4898e83e0a4-kube-api-access-v9gq7\") pod \"prometheus-operator-7f7d445d84-zxc2w\" (UID: \"14f03648-781e-458c-8f1d-f4898e83e0a4\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-zxc2w"
Jun 08 11:53:08.648518 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:08.648446    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/14f03648-781e-458c-8f1d-f4898e83e0a4-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-zxc2w\" (UID: \"14f03648-781e-458c-8f1d-f4898e83e0a4\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-zxc2w"
Jun 08 11:53:08.648675 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:53:08.648529    2583 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jun 08 11:53:08.648675 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:53:08.648579    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14f03648-781e-458c-8f1d-f4898e83e0a4-prometheus-operator-tls podName:14f03648-781e-458c-8f1d-f4898e83e0a4 nodeName:}" failed. No retries permitted until 2026-06-08 11:53:09.148563774 +0000 UTC m=+310.420138930 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/14f03648-781e-458c-8f1d-f4898e83e0a4-prometheus-operator-tls") pod "prometheus-operator-7f7d445d84-zxc2w" (UID: "14f03648-781e-458c-8f1d-f4898e83e0a4") : secret "prometheus-operator-tls" not found
Jun 08 11:53:08.649041 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:08.649023    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/14f03648-781e-458c-8f1d-f4898e83e0a4-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-zxc2w\" (UID: \"14f03648-781e-458c-8f1d-f4898e83e0a4\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-zxc2w"
Jun 08 11:53:08.650609 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:08.650587    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/14f03648-781e-458c-8f1d-f4898e83e0a4-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-zxc2w\" (UID: \"14f03648-781e-458c-8f1d-f4898e83e0a4\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-zxc2w"
Jun 08 11:53:08.656613 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:08.656593    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9gq7\" (UniqueName: \"kubernetes.io/projected/14f03648-781e-458c-8f1d-f4898e83e0a4-kube-api-access-v9gq7\") pod \"prometheus-operator-7f7d445d84-zxc2w\" (UID: \"14f03648-781e-458c-8f1d-f4898e83e0a4\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-zxc2w"
Jun 08 11:53:09.152421 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:09.152379    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/14f03648-781e-458c-8f1d-f4898e83e0a4-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-zxc2w\" (UID: \"14f03648-781e-458c-8f1d-f4898e83e0a4\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-zxc2w"
Jun 08 11:53:09.154715 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:09.154671    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/14f03648-781e-458c-8f1d-f4898e83e0a4-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-zxc2w\" (UID: \"14f03648-781e-458c-8f1d-f4898e83e0a4\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-zxc2w"
Jun 08 11:53:09.381692 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:09.381653    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-zxc2w"
Jun 08 11:53:09.503185 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:09.503152    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-zxc2w"]
Jun 08 11:53:09.506273 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:53:09.506247    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14f03648_781e_458c_8f1d_f4898e83e0a4.slice/crio-fc83202e4a5d25320452a0be3366c0e5e8d3385fb923ed35d66dc195af0886fc WatchSource:0}: Error finding container fc83202e4a5d25320452a0be3366c0e5e8d3385fb923ed35d66dc195af0886fc: Status 404 returned error can't find the container with id fc83202e4a5d25320452a0be3366c0e5e8d3385fb923ed35d66dc195af0886fc
Jun 08 11:53:09.508007 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:09.507990    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 08 11:53:10.094280 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:10.094240    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-zxc2w" event={"ID":"14f03648-781e-458c-8f1d-f4898e83e0a4","Type":"ContainerStarted","Data":"fc83202e4a5d25320452a0be3366c0e5e8d3385fb923ed35d66dc195af0886fc"}
Jun 08 11:53:11.099280 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:11.099244    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-zxc2w" event={"ID":"14f03648-781e-458c-8f1d-f4898e83e0a4","Type":"ContainerStarted","Data":"d86a2fbb2a43d26213821c490aed208e5ca86f74044f9aebaab71c10f10bba4f"}
Jun 08 11:53:11.099654 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:11.099297    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-zxc2w" event={"ID":"14f03648-781e-458c-8f1d-f4898e83e0a4","Type":"ContainerStarted","Data":"d59869eb84b13ad73b7173aef274c95076dd1e2742feda8d074fbaab9a8c6454"}
Jun 08 11:53:11.116515 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:11.116464    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-zxc2w" podStartSLOduration=1.9833737230000001 podStartE2EDuration="3.116447571s" totalImagesPullingTime="1.133073848s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 11:53:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 11:53:11.115177165 +0000 UTC m=+312.386752340" watchObservedRunningTime="2026-06-08 11:53:11.116447571 +0000 UTC m=+312.388022747"
Jun 08 11:53:11.181597 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:11.181568    2583 scope.go:117] "RemoveContainer" containerID="ddce2ca82341798a52abfe5e88f620ac5fd36ecb2fe73fd389ec7a2ad6e40941"
Jun 08 11:53:11.181786 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:53:11.181762    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-mnnbj_openshift-console-operator(cdf82c13-c30a-474a-a135-3d1dbcbb6046)\"" pod="openshift-console-operator/console-operator-668fdbf85c-mnnbj" podUID="cdf82c13-c30a-474a-a135-3d1dbcbb6046"
Jun 08 11:53:12.822042 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:12.822007    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-mtxvm"]
Jun 08 11:53:12.825908 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:12.825888    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mtxvm"
Jun 08 11:53:12.828248 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:12.828224    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jun 08 11:53:12.828357 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:12.828273    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-jv74d\""
Jun 08 11:53:12.828523 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:12.828508    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jun 08 11:53:12.828695 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:12.828677    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jun 08 11:53:12.979277 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:12.979229    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hc7sq\" (UniqueName: \"kubernetes.io/projected/d889c0cd-6ab9-4989-823e-b6f30b645fbb-kube-api-access-hc7sq\") pod \"node-exporter-mtxvm\" (UID: \"d889c0cd-6ab9-4989-823e-b6f30b645fbb\") " pod="openshift-monitoring/node-exporter-mtxvm"
Jun 08 11:53:12.979277 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:12.979281    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d889c0cd-6ab9-4989-823e-b6f30b645fbb-node-exporter-wtmp\") pod \"node-exporter-mtxvm\" (UID: \"d889c0cd-6ab9-4989-823e-b6f30b645fbb\") " pod="openshift-monitoring/node-exporter-mtxvm"
Jun 08 11:53:12.979485 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:12.979314    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d889c0cd-6ab9-4989-823e-b6f30b645fbb-sys\") pod \"node-exporter-mtxvm\" (UID: \"d889c0cd-6ab9-4989-823e-b6f30b645fbb\") " pod="openshift-monitoring/node-exporter-mtxvm"
Jun 08 11:53:12.979485 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:12.979379    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d889c0cd-6ab9-4989-823e-b6f30b645fbb-node-exporter-tls\") pod \"node-exporter-mtxvm\" (UID: \"d889c0cd-6ab9-4989-823e-b6f30b645fbb\") " pod="openshift-monitoring/node-exporter-mtxvm"
Jun 08 11:53:12.979485 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:12.979405    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d889c0cd-6ab9-4989-823e-b6f30b645fbb-metrics-client-ca\") pod \"node-exporter-mtxvm\" (UID: \"d889c0cd-6ab9-4989-823e-b6f30b645fbb\") " pod="openshift-monitoring/node-exporter-mtxvm"
Jun 08 11:53:12.979485 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:12.979439    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d889c0cd-6ab9-4989-823e-b6f30b645fbb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mtxvm\" (UID: \"d889c0cd-6ab9-4989-823e-b6f30b645fbb\") " pod="openshift-monitoring/node-exporter-mtxvm"
Jun 08 11:53:12.979677 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:12.979530    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d889c0cd-6ab9-4989-823e-b6f30b645fbb-node-exporter-accelerators-collector-config\") pod \"node-exporter-mtxvm\" (UID: \"d889c0cd-6ab9-4989-823e-b6f30b645fbb\") " pod="openshift-monitoring/node-exporter-mtxvm"
Jun 08 11:53:12.979677 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:12.979576    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d889c0cd-6ab9-4989-823e-b6f30b645fbb-root\") pod \"node-exporter-mtxvm\" (UID: \"d889c0cd-6ab9-4989-823e-b6f30b645fbb\") " pod="openshift-monitoring/node-exporter-mtxvm"
Jun 08 11:53:12.979677 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:12.979614    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d889c0cd-6ab9-4989-823e-b6f30b645fbb-node-exporter-textfile\") pod \"node-exporter-mtxvm\" (UID: \"d889c0cd-6ab9-4989-823e-b6f30b645fbb\") " pod="openshift-monitoring/node-exporter-mtxvm"
Jun 08 11:53:13.080772 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:13.080675    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hc7sq\" (UniqueName: \"kubernetes.io/projected/d889c0cd-6ab9-4989-823e-b6f30b645fbb-kube-api-access-hc7sq\") pod \"node-exporter-mtxvm\" (UID: \"d889c0cd-6ab9-4989-823e-b6f30b645fbb\") " pod="openshift-monitoring/node-exporter-mtxvm"
Jun 08 11:53:13.080772 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:13.080724    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d889c0cd-6ab9-4989-823e-b6f30b645fbb-node-exporter-wtmp\") pod \"node-exporter-mtxvm\" (UID: \"d889c0cd-6ab9-4989-823e-b6f30b645fbb\") " pod="openshift-monitoring/node-exporter-mtxvm"
Jun 08 11:53:13.080990 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:13.080826    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d889c0cd-6ab9-4989-823e-b6f30b645fbb-sys\") pod \"node-exporter-mtxvm\" (UID: \"d889c0cd-6ab9-4989-823e-b6f30b645fbb\") " pod="openshift-monitoring/node-exporter-mtxvm"
Jun 08 11:53:13.080990 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:13.080871    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d889c0cd-6ab9-4989-823e-b6f30b645fbb-node-exporter-tls\") pod \"node-exporter-mtxvm\" (UID: \"d889c0cd-6ab9-4989-823e-b6f30b645fbb\") " pod="openshift-monitoring/node-exporter-mtxvm"
Jun 08 11:53:13.080990 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:13.080871    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d889c0cd-6ab9-4989-823e-b6f30b645fbb-node-exporter-wtmp\") pod \"node-exporter-mtxvm\" (UID: \"d889c0cd-6ab9-4989-823e-b6f30b645fbb\") " pod="openshift-monitoring/node-exporter-mtxvm"
Jun 08 11:53:13.080990 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:13.080904    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d889c0cd-6ab9-4989-823e-b6f30b645fbb-metrics-client-ca\") pod \"node-exporter-mtxvm\" (UID: \"d889c0cd-6ab9-4989-823e-b6f30b645fbb\") " pod="openshift-monitoring/node-exporter-mtxvm"
Jun 08 11:53:13.081207 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:13.080904    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d889c0cd-6ab9-4989-823e-b6f30b645fbb-sys\") pod \"node-exporter-mtxvm\" (UID: \"d889c0cd-6ab9-4989-823e-b6f30b645fbb\") " pod="openshift-monitoring/node-exporter-mtxvm"
Jun 08 11:53:13.081207 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:13.080997    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d889c0cd-6ab9-4989-823e-b6f30b645fbb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mtxvm\" (UID: \"d889c0cd-6ab9-4989-823e-b6f30b645fbb\") " pod="openshift-monitoring/node-exporter-mtxvm"
Jun 08 11:53:13.081207 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:13.081041    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d889c0cd-6ab9-4989-823e-b6f30b645fbb-node-exporter-accelerators-collector-config\") pod \"node-exporter-mtxvm\" (UID: \"d889c0cd-6ab9-4989-823e-b6f30b645fbb\") " pod="openshift-monitoring/node-exporter-mtxvm"
Jun 08 11:53:13.081207 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:13.081094    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d889c0cd-6ab9-4989-823e-b6f30b645fbb-root\") pod \"node-exporter-mtxvm\" (UID: \"d889c0cd-6ab9-4989-823e-b6f30b645fbb\") " pod="openshift-monitoring/node-exporter-mtxvm"
Jun 08 11:53:13.081207 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:13.081123    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d889c0cd-6ab9-4989-823e-b6f30b645fbb-node-exporter-textfile\") pod \"node-exporter-mtxvm\" (UID: \"d889c0cd-6ab9-4989-823e-b6f30b645fbb\") " pod="openshift-monitoring/node-exporter-mtxvm"
Jun 08 11:53:13.081457 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:13.081431    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d889c0cd-6ab9-4989-823e-b6f30b645fbb-root\") pod \"node-exporter-mtxvm\" (UID: \"d889c0cd-6ab9-4989-823e-b6f30b645fbb\") " pod="openshift-monitoring/node-exporter-mtxvm"
Jun 08 11:53:13.081612 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:13.081585    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d889c0cd-6ab9-4989-823e-b6f30b645fbb-metrics-client-ca\") pod \"node-exporter-mtxvm\" (UID: \"d889c0cd-6ab9-4989-823e-b6f30b645fbb\") " pod="openshift-monitoring/node-exporter-mtxvm"
Jun 08 11:53:13.081763 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:13.081585    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d889c0cd-6ab9-4989-823e-b6f30b645fbb-node-exporter-accelerators-collector-config\") pod \"node-exporter-mtxvm\" (UID: \"d889c0cd-6ab9-4989-823e-b6f30b645fbb\") " pod="openshift-monitoring/node-exporter-mtxvm"
Jun 08 11:53:13.081763 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:13.081644    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d889c0cd-6ab9-4989-823e-b6f30b645fbb-node-exporter-textfile\") pod \"node-exporter-mtxvm\" (UID: \"d889c0cd-6ab9-4989-823e-b6f30b645fbb\") " pod="openshift-monitoring/node-exporter-mtxvm"
Jun 08 11:53:13.089098 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:13.083704    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d889c0cd-6ab9-4989-823e-b6f30b645fbb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mtxvm\" (UID: \"d889c0cd-6ab9-4989-823e-b6f30b645fbb\") " pod="openshift-monitoring/node-exporter-mtxvm"
Jun 08 11:53:13.089098 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:13.083714    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d889c0cd-6ab9-4989-823e-b6f30b645fbb-node-exporter-tls\") pod \"node-exporter-mtxvm\" (UID: \"d889c0cd-6ab9-4989-823e-b6f30b645fbb\") " pod="openshift-monitoring/node-exporter-mtxvm"
Jun 08 11:53:13.091927 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:13.091901    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hc7sq\" (UniqueName: \"kubernetes.io/projected/d889c0cd-6ab9-4989-823e-b6f30b645fbb-kube-api-access-hc7sq\") pod \"node-exporter-mtxvm\" (UID: \"d889c0cd-6ab9-4989-823e-b6f30b645fbb\") " pod="openshift-monitoring/node-exporter-mtxvm"
Jun 08 11:53:13.136158 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:13.136126    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mtxvm"
Jun 08 11:53:13.151912 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:53:13.151881    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd889c0cd_6ab9_4989_823e_b6f30b645fbb.slice/crio-f87caa8be3e3f8d8859548d78e9debeeba1621da2100d52d16e73b6bd53b88ed WatchSource:0}: Error finding container f87caa8be3e3f8d8859548d78e9debeeba1621da2100d52d16e73b6bd53b88ed: Status 404 returned error can't find the container with id f87caa8be3e3f8d8859548d78e9debeeba1621da2100d52d16e73b6bd53b88ed
Jun 08 11:53:13.863426 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:13.863392    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 08 11:53:13.868512 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:13.868487    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:53:13.870798 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:13.870770    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jun 08 11:53:13.871233 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:13.871042    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jun 08 11:53:13.871604 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:13.871385    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jun 08 11:53:13.871604 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:13.871404    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jun 08 11:53:13.871604 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:13.871496    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jun 08 11:53:13.871903 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:13.871881    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jun 08 11:53:13.871999 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:13.871982    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-spwqd\""
Jun 08 11:53:13.872114 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:13.872098    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jun 08 11:53:13.872240 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:13.872224    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jun 08 11:53:13.872378 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:13.872365    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jun 08 11:53:13.883066 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:13.883026    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 08 11:53:13.988419 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:13.988384    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:53:13.988576 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:13.988434    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpvwj\" (UniqueName: \"kubernetes.io/projected/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-kube-api-access-fpvwj\") pod \"alertmanager-main-0\" (UID: \"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:53:13.988576 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:13.988515    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:53:13.988576 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:13.988545    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-web-config\") pod \"alertmanager-main-0\" (UID: \"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:53:13.988576 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:13.988562    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:53:13.988790 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:13.988583    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:53:13.988790 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:13.988675    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:53:13.988790 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:13.988734    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-config-volume\") pod \"alertmanager-main-0\" (UID: \"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:53:13.988790 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:13.988763    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:53:13.988955 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:13.988788    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-config-out\") pod \"alertmanager-main-0\" (UID: \"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:53:13.988955 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:13.988814    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:53:13.988955 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:13.988839    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:53:13.988955 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:13.988877    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:53:14.089461 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:14.089427    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:53:14.089461 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:14.089466    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-web-config\") pod \"alertmanager-main-0\" (UID: \"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:53:14.089699 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:14.089497    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:53:14.089699 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:14.089527    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:53:14.089699 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:14.089572    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:53:14.089699 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:14.089623    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-config-volume\") pod \"alertmanager-main-0\" (UID: \"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:53:14.089897 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:14.089827    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:53:14.089897 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:14.089863    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-config-out\") pod \"alertmanager-main-0\" (UID: \"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:53:14.089897 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:14.089890    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:53:14.090072 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:14.089919    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:53:14.090072 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:14.089952    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:53:14.090072 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:14.090026    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:53:14.090230 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:14.090082    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpvwj\" (UniqueName: \"kubernetes.io/projected/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-kube-api-access-fpvwj\") pod \"alertmanager-main-0\" (UID: \"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:53:14.091361 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:14.090609    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:53:14.091361 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:14.090932    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:53:14.091361 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:14.091316    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:53:14.092937 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:14.092893    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:53:14.093037 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:14.092959    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:53:14.093130 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:14.093112    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:53:14.093195 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:14.093114    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:53:14.093791 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:14.093748    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:53:14.094388 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:14.094350    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-config-volume\") pod \"alertmanager-main-0\" (UID: \"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:53:14.094750 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:14.094720    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:53:14.094911 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:14.094889    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-config-out\") pod \"alertmanager-main-0\" (UID: \"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:53:14.095059 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:14.095028    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-web-config\") pod \"alertmanager-main-0\" (UID: \"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:53:14.098038 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:14.098016    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpvwj\" (UniqueName: \"kubernetes.io/projected/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-kube-api-access-fpvwj\") pod \"alertmanager-main-0\" (UID: \"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:53:14.110739 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:14.110712    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mtxvm" event={"ID":"d889c0cd-6ab9-4989-823e-b6f30b645fbb","Type":"ContainerStarted","Data":"f87caa8be3e3f8d8859548d78e9debeeba1621da2100d52d16e73b6bd53b88ed"}
Jun 08 11:53:14.180774 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:14.180754    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:53:14.327594 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:14.327566    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 08 11:53:14.369668 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:53:14.369644    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18414c6f_8d8f_4ee0_9d15_fe3a817a07f7.slice/crio-8ae39d772816266f7d584b2f0d74b1143efcc4734b9fbe210d15f68c65f0e0ce WatchSource:0}: Error finding container 8ae39d772816266f7d584b2f0d74b1143efcc4734b9fbe210d15f68c65f0e0ce: Status 404 returned error can't find the container with id 8ae39d772816266f7d584b2f0d74b1143efcc4734b9fbe210d15f68c65f0e0ce
Jun 08 11:53:15.116082 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:15.116029    2583 generic.go:356] "Generic (PLEG): container finished" podID="d889c0cd-6ab9-4989-823e-b6f30b645fbb" containerID="9bc462babf011abd347053aac817967fc5d4191f9ada180291d4fb7b63702b21" exitCode=0
Jun 08 11:53:15.116472 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:15.116092    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mtxvm" event={"ID":"d889c0cd-6ab9-4989-823e-b6f30b645fbb","Type":"ContainerDied","Data":"9bc462babf011abd347053aac817967fc5d4191f9ada180291d4fb7b63702b21"}
Jun 08 11:53:15.117712 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:15.117687    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7","Type":"ContainerStarted","Data":"8ae39d772816266f7d584b2f0d74b1143efcc4734b9fbe210d15f68c65f0e0ce"}
Jun 08 11:53:16.122283 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:16.122251    2583 generic.go:356] "Generic (PLEG): container finished" podID="18414c6f-8d8f-4ee0-9d15-fe3a817a07f7" containerID="643520df4077c8d93599df78db7271f76559ac548777cac4758ee755ab394dd0" exitCode=0
Jun 08 11:53:16.122680 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:16.122332    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7","Type":"ContainerDied","Data":"643520df4077c8d93599df78db7271f76559ac548777cac4758ee755ab394dd0"}
Jun 08 11:53:16.124552 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:16.124530    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mtxvm" event={"ID":"d889c0cd-6ab9-4989-823e-b6f30b645fbb","Type":"ContainerStarted","Data":"e6961cbde8258f54038e009121d41c422ae690ebeeb565572d7c6a4747279977"}
Jun 08 11:53:16.124643 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:16.124593    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mtxvm" event={"ID":"d889c0cd-6ab9-4989-823e-b6f30b645fbb","Type":"ContainerStarted","Data":"fef654e65e392388c692d805e011df185be966a77b448edc07d4f48e8a5747cc"}
Jun 08 11:53:16.178223 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:16.178180    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-mtxvm" podStartSLOduration=3.091492741 podStartE2EDuration="4.178166309s" totalImagesPullingTime="1.015493826s" totalInitContainerRuntime="71.179742ms" isStatefulPod=true podCreationTimestamp="2026-06-08 11:53:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 11:53:16.177413638 +0000 UTC m=+317.448988840" watchObservedRunningTime="2026-06-08 11:53:16.178166309 +0000 UTC m=+317.449741507"
Jun 08 11:53:17.277438 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:17.277402    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6685959c65-lh79s"]
Jun 08 11:53:17.280997 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:17.280972    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6685959c65-lh79s"
Jun 08 11:53:17.284468 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:17.284390    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jun 08 11:53:17.285201 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:17.285177    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jun 08 11:53:17.285201 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:17.285177    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jun 08 11:53:17.285373 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:17.285178    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jun 08 11:53:17.285373 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:17.285311    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-20aip12aqqau4\""
Jun 08 11:53:17.285373 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:17.285178    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-j8g2c\""
Jun 08 11:53:17.290004 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:17.289830    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6685959c65-lh79s"]
Jun 08 11:53:17.417905 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:17.417860    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3551e56b-be4b-4455-b0bc-20b38830c9c8-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6685959c65-lh79s\" (UID: \"3551e56b-be4b-4455-b0bc-20b38830c9c8\") " pod="openshift-monitoring/metrics-server-6685959c65-lh79s"
Jun 08 11:53:17.418110 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:17.417913    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3551e56b-be4b-4455-b0bc-20b38830c9c8-secret-metrics-server-tls\") pod \"metrics-server-6685959c65-lh79s\" (UID: \"3551e56b-be4b-4455-b0bc-20b38830c9c8\") " pod="openshift-monitoring/metrics-server-6685959c65-lh79s"
Jun 08 11:53:17.418110 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:17.417948    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b54jl\" (UniqueName: \"kubernetes.io/projected/3551e56b-be4b-4455-b0bc-20b38830c9c8-kube-api-access-b54jl\") pod \"metrics-server-6685959c65-lh79s\" (UID: \"3551e56b-be4b-4455-b0bc-20b38830c9c8\") " pod="openshift-monitoring/metrics-server-6685959c65-lh79s"
Jun 08 11:53:17.418110 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:17.418030    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3551e56b-be4b-4455-b0bc-20b38830c9c8-audit-log\") pod \"metrics-server-6685959c65-lh79s\" (UID: \"3551e56b-be4b-4455-b0bc-20b38830c9c8\") " pod="openshift-monitoring/metrics-server-6685959c65-lh79s"
Jun 08 11:53:17.418110 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:17.418098    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3551e56b-be4b-4455-b0bc-20b38830c9c8-secret-metrics-server-client-certs\") pod \"metrics-server-6685959c65-lh79s\" (UID: \"3551e56b-be4b-4455-b0bc-20b38830c9c8\") " pod="openshift-monitoring/metrics-server-6685959c65-lh79s"
Jun 08 11:53:17.418309 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:17.418152    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3551e56b-be4b-4455-b0bc-20b38830c9c8-client-ca-bundle\") pod \"metrics-server-6685959c65-lh79s\" (UID: \"3551e56b-be4b-4455-b0bc-20b38830c9c8\") " pod="openshift-monitoring/metrics-server-6685959c65-lh79s"
Jun 08 11:53:17.418309 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:17.418201    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3551e56b-be4b-4455-b0bc-20b38830c9c8-metrics-server-audit-profiles\") pod \"metrics-server-6685959c65-lh79s\" (UID: \"3551e56b-be4b-4455-b0bc-20b38830c9c8\") " pod="openshift-monitoring/metrics-server-6685959c65-lh79s"
Jun 08 11:53:17.518616 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:17.518591    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3551e56b-be4b-4455-b0bc-20b38830c9c8-client-ca-bundle\") pod \"metrics-server-6685959c65-lh79s\" (UID: \"3551e56b-be4b-4455-b0bc-20b38830c9c8\") " pod="openshift-monitoring/metrics-server-6685959c65-lh79s"
Jun 08 11:53:17.518752 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:17.518626    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3551e56b-be4b-4455-b0bc-20b38830c9c8-metrics-server-audit-profiles\") pod \"metrics-server-6685959c65-lh79s\" (UID: \"3551e56b-be4b-4455-b0bc-20b38830c9c8\") " pod="openshift-monitoring/metrics-server-6685959c65-lh79s"
Jun 08 11:53:17.518752 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:17.518652    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3551e56b-be4b-4455-b0bc-20b38830c9c8-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6685959c65-lh79s\" (UID: \"3551e56b-be4b-4455-b0bc-20b38830c9c8\") " pod="openshift-monitoring/metrics-server-6685959c65-lh79s"
Jun 08 11:53:17.518752 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:17.518688    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3551e56b-be4b-4455-b0bc-20b38830c9c8-secret-metrics-server-tls\") pod \"metrics-server-6685959c65-lh79s\" (UID: \"3551e56b-be4b-4455-b0bc-20b38830c9c8\") " pod="openshift-monitoring/metrics-server-6685959c65-lh79s"
Jun 08 11:53:17.518752 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:17.518712    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b54jl\" (UniqueName: \"kubernetes.io/projected/3551e56b-be4b-4455-b0bc-20b38830c9c8-kube-api-access-b54jl\") pod \"metrics-server-6685959c65-lh79s\" (UID: \"3551e56b-be4b-4455-b0bc-20b38830c9c8\") " pod="openshift-monitoring/metrics-server-6685959c65-lh79s"
Jun 08 11:53:17.518752 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:17.518748    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3551e56b-be4b-4455-b0bc-20b38830c9c8-audit-log\") pod \"metrics-server-6685959c65-lh79s\" (UID: \"3551e56b-be4b-4455-b0bc-20b38830c9c8\") " pod="openshift-monitoring/metrics-server-6685959c65-lh79s"
Jun 08 11:53:17.519006 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:17.518793    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3551e56b-be4b-4455-b0bc-20b38830c9c8-secret-metrics-server-client-certs\") pod \"metrics-server-6685959c65-lh79s\" (UID: \"3551e56b-be4b-4455-b0bc-20b38830c9c8\") " pod="openshift-monitoring/metrics-server-6685959c65-lh79s"
Jun 08 11:53:17.519329 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:17.519300    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3551e56b-be4b-4455-b0bc-20b38830c9c8-audit-log\") pod \"metrics-server-6685959c65-lh79s\" (UID: \"3551e56b-be4b-4455-b0bc-20b38830c9c8\") " pod="openshift-monitoring/metrics-server-6685959c65-lh79s"
Jun 08 11:53:17.519427 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:17.519400    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3551e56b-be4b-4455-b0bc-20b38830c9c8-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6685959c65-lh79s\" (UID: \"3551e56b-be4b-4455-b0bc-20b38830c9c8\") " pod="openshift-monitoring/metrics-server-6685959c65-lh79s"
Jun 08 11:53:17.519729 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:17.519705    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3551e56b-be4b-4455-b0bc-20b38830c9c8-metrics-server-audit-profiles\") pod \"metrics-server-6685959c65-lh79s\" (UID: \"3551e56b-be4b-4455-b0bc-20b38830c9c8\") " pod="openshift-monitoring/metrics-server-6685959c65-lh79s"
Jun 08 11:53:17.520993 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:17.520964    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3551e56b-be4b-4455-b0bc-20b38830c9c8-client-ca-bundle\") pod \"metrics-server-6685959c65-lh79s\" (UID: \"3551e56b-be4b-4455-b0bc-20b38830c9c8\") " pod="openshift-monitoring/metrics-server-6685959c65-lh79s"
Jun 08 11:53:17.521093 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:17.520970    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3551e56b-be4b-4455-b0bc-20b38830c9c8-secret-metrics-server-tls\") pod \"metrics-server-6685959c65-lh79s\" (UID: \"3551e56b-be4b-4455-b0bc-20b38830c9c8\") " pod="openshift-monitoring/metrics-server-6685959c65-lh79s"
Jun 08 11:53:17.521251 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:17.521234    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3551e56b-be4b-4455-b0bc-20b38830c9c8-secret-metrics-server-client-certs\") pod \"metrics-server-6685959c65-lh79s\" (UID: \"3551e56b-be4b-4455-b0bc-20b38830c9c8\") " pod="openshift-monitoring/metrics-server-6685959c65-lh79s"
Jun 08 11:53:17.526999 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:17.526978    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b54jl\" (UniqueName: \"kubernetes.io/projected/3551e56b-be4b-4455-b0bc-20b38830c9c8-kube-api-access-b54jl\") pod \"metrics-server-6685959c65-lh79s\" (UID: \"3551e56b-be4b-4455-b0bc-20b38830c9c8\") " pod="openshift-monitoring/metrics-server-6685959c65-lh79s"
Jun 08 11:53:17.593337 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:17.593153    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6685959c65-lh79s"
Jun 08 11:53:17.737737 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:17.737708    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6685959c65-lh79s"]
Jun 08 11:53:17.739545 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:53:17.739516    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3551e56b_be4b_4455_b0bc_20b38830c9c8.slice/crio-1808b00a4392ad3483533428079b417ce49f3ffe9342750d64322ac975743271 WatchSource:0}: Error finding container 1808b00a4392ad3483533428079b417ce49f3ffe9342750d64322ac975743271: Status 404 returned error can't find the container with id 1808b00a4392ad3483533428079b417ce49f3ffe9342750d64322ac975743271
Jun 08 11:53:18.137401 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:18.137369    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7","Type":"ContainerStarted","Data":"b1086211e15324f9c472bef45f2821459ae350be2179a300d31c14c05f66e931"}
Jun 08 11:53:18.137654 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:18.137443    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7","Type":"ContainerStarted","Data":"50ef9d68b12565cd11a8c3adc94662dba47427a49b16461061b57fbc805f3205"}
Jun 08 11:53:18.137654 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:18.137483    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7","Type":"ContainerStarted","Data":"4df81b0150da49327abf01c6565a0f2f61908882fe18b89ab01e20f1150768ba"}
Jun 08 11:53:18.137654 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:18.137515    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7","Type":"ContainerStarted","Data":"ff8e63d96d66520ea8a37d21afda658ea9200d82db3240732f2f4770d1d047aa"}
Jun 08 11:53:18.137654 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:18.137539    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7","Type":"ContainerStarted","Data":"e191a6f786c44145de9a86261a1ef301d689efa6741b3104379c66c9f88c3d8b"}
Jun 08 11:53:18.138592 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:18.138567    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6685959c65-lh79s" event={"ID":"3551e56b-be4b-4455-b0bc-20b38830c9c8","Type":"ContainerStarted","Data":"1808b00a4392ad3483533428079b417ce49f3ffe9342750d64322ac975743271"}
Jun 08 11:53:19.149963 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:19.149927    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7","Type":"ContainerStarted","Data":"3df4f150fc5cca8bf04694a814e46c1087f8379b8c91f7d6702203437d2facbd"}
Jun 08 11:53:19.176564 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:19.176500    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.906518108 podStartE2EDuration="6.176481003s" totalImagesPullingTime="3.255065102s" totalInitContainerRuntime="14.897793ms" isStatefulPod=false podCreationTimestamp="2026-06-08 11:53:13 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 11:53:19.175148579 +0000 UTC m=+320.446723758" watchObservedRunningTime="2026-06-08 11:53:19.176481003 +0000 UTC m=+320.448056180"
Jun 08 11:53:19.982098 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:19.982062    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5877df4c8d-zkhq7"]
Jun 08 11:53:20.155087 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:20.155028    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6685959c65-lh79s" event={"ID":"3551e56b-be4b-4455-b0bc-20b38830c9c8","Type":"ContainerStarted","Data":"69321b53ea01a5f8ed8f5fb05f5d9fca6378de3259bdfb1eccce19bb9c2cf13b"}
Jun 08 11:53:20.176982 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:20.176928    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6685959c65-lh79s" podStartSLOduration=1.653161958 podStartE2EDuration="3.176910239s" totalImagesPullingTime="1.523748281s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 11:53:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 11:53:20.175910917 +0000 UTC m=+321.447486094" watchObservedRunningTime="2026-06-08 11:53:20.176910239 +0000 UTC m=+321.448485415"
Jun 08 11:53:25.181220 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:25.181190    2583 scope.go:117] "RemoveContainer" containerID="ddce2ca82341798a52abfe5e88f620ac5fd36ecb2fe73fd389ec7a2ad6e40941"
Jun 08 11:53:26.178900 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:26.178873    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mnnbj_cdf82c13-c30a-474a-a135-3d1dbcbb6046/console-operator/2.log"
Jun 08 11:53:26.179079 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:26.178926    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-mnnbj" event={"ID":"cdf82c13-c30a-474a-a135-3d1dbcbb6046","Type":"ContainerStarted","Data":"42e26d197c9fa8c671a754e5b652f11a35485b6bd45bab6e56ba40db6375896b"}
Jun 08 11:53:26.179263 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:26.179239    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-mnnbj"
Jun 08 11:53:26.184111 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:26.184089    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-mnnbj"
Jun 08 11:53:26.199691 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:26.199650    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-mnnbj" podStartSLOduration=54.261583484 podStartE2EDuration="57.199637243s" totalImagesPullingTime="2.938053759s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 11:52:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 11:53:26.197909962 +0000 UTC m=+327.469485129" watchObservedRunningTime="2026-06-08 11:53:26.199637243 +0000 UTC m=+327.471212418"
Jun 08 11:53:31.471702 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:31.471656    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d6bdc5fb4-mhd8g"]
Jun 08 11:53:31.477041 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:31.477022    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d6bdc5fb4-mhd8g"
Jun 08 11:53:31.479930 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:31.479904    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jun 08 11:53:31.480425 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:31.480405    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jun 08 11:53:31.480493 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:31.480430    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jun 08 11:53:31.480545 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:31.480412    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jun 08 11:53:31.481370 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:31.481347    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jun 08 11:53:31.481489 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:31.481401    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jun 08 11:53:31.481489 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:31.481350    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jun 08 11:53:31.481753 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:31.481734    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-pccqj\""
Jun 08 11:53:31.491659 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:31.489733    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d6bdc5fb4-mhd8g"]
Jun 08 11:53:31.529828 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:31.529796    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a5e31f3-fd4d-4480-9dd4-3449c04833b6-console-config\") pod \"console-7d6bdc5fb4-mhd8g\" (UID: \"9a5e31f3-fd4d-4480-9dd4-3449c04833b6\") " pod="openshift-console/console-7d6bdc5fb4-mhd8g"
Jun 08 11:53:31.529828 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:31.529830    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a5e31f3-fd4d-4480-9dd4-3449c04833b6-service-ca\") pod \"console-7d6bdc5fb4-mhd8g\" (UID: \"9a5e31f3-fd4d-4480-9dd4-3449c04833b6\") " pod="openshift-console/console-7d6bdc5fb4-mhd8g"
Jun 08 11:53:31.530085 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:31.529894    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a5e31f3-fd4d-4480-9dd4-3449c04833b6-oauth-serving-cert\") pod \"console-7d6bdc5fb4-mhd8g\" (UID: \"9a5e31f3-fd4d-4480-9dd4-3449c04833b6\") " pod="openshift-console/console-7d6bdc5fb4-mhd8g"
Jun 08 11:53:31.530085 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:31.529911    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a5e31f3-fd4d-4480-9dd4-3449c04833b6-console-serving-cert\") pod \"console-7d6bdc5fb4-mhd8g\" (UID: \"9a5e31f3-fd4d-4480-9dd4-3449c04833b6\") " pod="openshift-console/console-7d6bdc5fb4-mhd8g"
Jun 08 11:53:31.530085 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:31.529940    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a5e31f3-fd4d-4480-9dd4-3449c04833b6-console-oauth-config\") pod \"console-7d6bdc5fb4-mhd8g\" (UID: \"9a5e31f3-fd4d-4480-9dd4-3449c04833b6\") " pod="openshift-console/console-7d6bdc5fb4-mhd8g"
Jun 08 11:53:31.530206 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:31.530082    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xc2vc\" (UniqueName: \"kubernetes.io/projected/9a5e31f3-fd4d-4480-9dd4-3449c04833b6-kube-api-access-xc2vc\") pod \"console-7d6bdc5fb4-mhd8g\" (UID: \"9a5e31f3-fd4d-4480-9dd4-3449c04833b6\") " pod="openshift-console/console-7d6bdc5fb4-mhd8g"
Jun 08 11:53:31.630960 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:31.630916    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a5e31f3-fd4d-4480-9dd4-3449c04833b6-oauth-serving-cert\") pod \"console-7d6bdc5fb4-mhd8g\" (UID: \"9a5e31f3-fd4d-4480-9dd4-3449c04833b6\") " pod="openshift-console/console-7d6bdc5fb4-mhd8g"
Jun 08 11:53:31.631169 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:31.630967    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a5e31f3-fd4d-4480-9dd4-3449c04833b6-console-serving-cert\") pod \"console-7d6bdc5fb4-mhd8g\" (UID: \"9a5e31f3-fd4d-4480-9dd4-3449c04833b6\") " pod="openshift-console/console-7d6bdc5fb4-mhd8g"
Jun 08 11:53:31.631169 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:31.631030    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a5e31f3-fd4d-4480-9dd4-3449c04833b6-console-oauth-config\") pod \"console-7d6bdc5fb4-mhd8g\" (UID: \"9a5e31f3-fd4d-4480-9dd4-3449c04833b6\") " pod="openshift-console/console-7d6bdc5fb4-mhd8g"
Jun 08 11:53:31.631169 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:31.631111    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xc2vc\" (UniqueName: \"kubernetes.io/projected/9a5e31f3-fd4d-4480-9dd4-3449c04833b6-kube-api-access-xc2vc\") pod \"console-7d6bdc5fb4-mhd8g\" (UID: \"9a5e31f3-fd4d-4480-9dd4-3449c04833b6\") " pod="openshift-console/console-7d6bdc5fb4-mhd8g"
Jun 08 11:53:31.631344 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:31.631295    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a5e31f3-fd4d-4480-9dd4-3449c04833b6-console-config\") pod \"console-7d6bdc5fb4-mhd8g\" (UID: \"9a5e31f3-fd4d-4480-9dd4-3449c04833b6\") " pod="openshift-console/console-7d6bdc5fb4-mhd8g"
Jun 08 11:53:31.631344 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:31.631322    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a5e31f3-fd4d-4480-9dd4-3449c04833b6-service-ca\") pod \"console-7d6bdc5fb4-mhd8g\" (UID: \"9a5e31f3-fd4d-4480-9dd4-3449c04833b6\") " pod="openshift-console/console-7d6bdc5fb4-mhd8g"
Jun 08 11:53:31.631709 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:31.631678    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a5e31f3-fd4d-4480-9dd4-3449c04833b6-oauth-serving-cert\") pod \"console-7d6bdc5fb4-mhd8g\" (UID: \"9a5e31f3-fd4d-4480-9dd4-3449c04833b6\") " pod="openshift-console/console-7d6bdc5fb4-mhd8g"
Jun 08 11:53:31.631923 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:31.631902    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a5e31f3-fd4d-4480-9dd4-3449c04833b6-console-config\") pod \"console-7d6bdc5fb4-mhd8g\" (UID: \"9a5e31f3-fd4d-4480-9dd4-3449c04833b6\") " pod="openshift-console/console-7d6bdc5fb4-mhd8g"
Jun 08 11:53:31.632002 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:31.631961    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a5e31f3-fd4d-4480-9dd4-3449c04833b6-service-ca\") pod \"console-7d6bdc5fb4-mhd8g\" (UID: \"9a5e31f3-fd4d-4480-9dd4-3449c04833b6\") " pod="openshift-console/console-7d6bdc5fb4-mhd8g"
Jun 08 11:53:31.633386 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:31.633356    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a5e31f3-fd4d-4480-9dd4-3449c04833b6-console-oauth-config\") pod \"console-7d6bdc5fb4-mhd8g\" (UID: \"9a5e31f3-fd4d-4480-9dd4-3449c04833b6\") " pod="openshift-console/console-7d6bdc5fb4-mhd8g"
Jun 08 11:53:31.633485 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:31.633443    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a5e31f3-fd4d-4480-9dd4-3449c04833b6-console-serving-cert\") pod \"console-7d6bdc5fb4-mhd8g\" (UID: \"9a5e31f3-fd4d-4480-9dd4-3449c04833b6\") " pod="openshift-console/console-7d6bdc5fb4-mhd8g"
Jun 08 11:53:31.643644 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:31.643620    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xc2vc\" (UniqueName: \"kubernetes.io/projected/9a5e31f3-fd4d-4480-9dd4-3449c04833b6-kube-api-access-xc2vc\") pod \"console-7d6bdc5fb4-mhd8g\" (UID: \"9a5e31f3-fd4d-4480-9dd4-3449c04833b6\") " pod="openshift-console/console-7d6bdc5fb4-mhd8g"
Jun 08 11:53:31.787404 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:31.787327    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d6bdc5fb4-mhd8g"
Jun 08 11:53:31.915150 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:31.915116    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d6bdc5fb4-mhd8g"]
Jun 08 11:53:31.917756 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:53:31.917727    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a5e31f3_fd4d_4480_9dd4_3449c04833b6.slice/crio-be6142e11ef2631a2fda10c1d770f306636b89f7f654d569946305f3d4a1c4c9 WatchSource:0}: Error finding container be6142e11ef2631a2fda10c1d770f306636b89f7f654d569946305f3d4a1c4c9: Status 404 returned error can't find the container with id be6142e11ef2631a2fda10c1d770f306636b89f7f654d569946305f3d4a1c4c9
Jun 08 11:53:32.200458 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:32.200422    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d6bdc5fb4-mhd8g" event={"ID":"9a5e31f3-fd4d-4480-9dd4-3449c04833b6","Type":"ContainerStarted","Data":"be6142e11ef2631a2fda10c1d770f306636b89f7f654d569946305f3d4a1c4c9"}
Jun 08 11:53:35.212699 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:35.212620    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d6bdc5fb4-mhd8g" event={"ID":"9a5e31f3-fd4d-4480-9dd4-3449c04833b6","Type":"ContainerStarted","Data":"9032409846cf8cce0bcde7c45aad71e67402557a756b9091dfc97c7718d0a4a6"}
Jun 08 11:53:35.231131 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:35.231087    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7d6bdc5fb4-mhd8g" podStartSLOduration=1.241802011 podStartE2EDuration="4.231072694s" totalImagesPullingTime="2.989270683s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 11:53:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 11:53:35.229350723 +0000 UTC m=+336.500925902" watchObservedRunningTime="2026-06-08 11:53:35.231072694 +0000 UTC m=+336.502647864"
Jun 08 11:53:37.593755 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:37.593719    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6685959c65-lh79s"
Jun 08 11:53:37.594163 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:37.593787    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6685959c65-lh79s"
Jun 08 11:53:41.788430 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:41.788401    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d6bdc5fb4-mhd8g"
Jun 08 11:53:41.788884 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:41.788481    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7d6bdc5fb4-mhd8g"
Jun 08 11:53:41.793367 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:41.793346    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7d6bdc5fb4-mhd8g"
Jun 08 11:53:42.240931 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:42.240895    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7d6bdc5fb4-mhd8g"
Jun 08 11:53:45.007193 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:45.007141    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5877df4c8d-zkhq7" podUID="91c73bfb-0940-4926-8f4e-318c3f01d5c2" containerName="registry" containerID="cri-o://20a15aad914f5d4a3c7f2138800e3f2e03fc8fd15a55b95c5300c9f01a428f2f" gracePeriod=30
Jun 08 11:53:45.248742 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:45.248714    2583 generic.go:356] "Generic (PLEG): container finished" podID="91c73bfb-0940-4926-8f4e-318c3f01d5c2" containerID="20a15aad914f5d4a3c7f2138800e3f2e03fc8fd15a55b95c5300c9f01a428f2f" exitCode=0
Jun 08 11:53:45.248870 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:45.248840    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5877df4c8d-zkhq7" event={"ID":"91c73bfb-0940-4926-8f4e-318c3f01d5c2","Type":"ContainerDied","Data":"20a15aad914f5d4a3c7f2138800e3f2e03fc8fd15a55b95c5300c9f01a428f2f"}
Jun 08 11:53:45.248920 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:45.248906    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5877df4c8d-zkhq7" event={"ID":"91c73bfb-0940-4926-8f4e-318c3f01d5c2","Type":"ContainerDied","Data":"ee8440b9b2ef56c0f15f9aaae8c186179e71cc985ee1cd19929c483d152cf342"}
Jun 08 11:53:45.248974 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:45.248930    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ee8440b9b2ef56c0f15f9aaae8c186179e71cc985ee1cd19929c483d152cf342"
Jun 08 11:53:45.261438 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:45.261395    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5877df4c8d-zkhq7"
Jun 08 11:53:45.335747 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:45.335724    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91c73bfb-0940-4926-8f4e-318c3f01d5c2-registry-tls\") pod \"91c73bfb-0940-4926-8f4e-318c3f01d5c2\" (UID: \"91c73bfb-0940-4926-8f4e-318c3f01d5c2\") "
Jun 08 11:53:45.335866 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:45.335767    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/91c73bfb-0940-4926-8f4e-318c3f01d5c2-image-registry-private-configuration\") pod \"91c73bfb-0940-4926-8f4e-318c3f01d5c2\" (UID: \"91c73bfb-0940-4926-8f4e-318c3f01d5c2\") "
Jun 08 11:53:45.335866 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:45.335798    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lkn4q\" (UniqueName: \"kubernetes.io/projected/91c73bfb-0940-4926-8f4e-318c3f01d5c2-kube-api-access-lkn4q\") pod \"91c73bfb-0940-4926-8f4e-318c3f01d5c2\" (UID: \"91c73bfb-0940-4926-8f4e-318c3f01d5c2\") "
Jun 08 11:53:45.335866 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:45.335832    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/91c73bfb-0940-4926-8f4e-318c3f01d5c2-registry-certificates\") pod \"91c73bfb-0940-4926-8f4e-318c3f01d5c2\" (UID: \"91c73bfb-0940-4926-8f4e-318c3f01d5c2\") "
Jun 08 11:53:45.336024 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:45.335886    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/91c73bfb-0940-4926-8f4e-318c3f01d5c2-installation-pull-secrets\") pod \"91c73bfb-0940-4926-8f4e-318c3f01d5c2\" (UID: \"91c73bfb-0940-4926-8f4e-318c3f01d5c2\") "
Jun 08 11:53:45.336024 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:45.335918    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/91c73bfb-0940-4926-8f4e-318c3f01d5c2-bound-sa-token\") pod \"91c73bfb-0940-4926-8f4e-318c3f01d5c2\" (UID: \"91c73bfb-0940-4926-8f4e-318c3f01d5c2\") "
Jun 08 11:53:45.336024 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:45.335959    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/91c73bfb-0940-4926-8f4e-318c3f01d5c2-ca-trust-extracted\") pod \"91c73bfb-0940-4926-8f4e-318c3f01d5c2\" (UID: \"91c73bfb-0940-4926-8f4e-318c3f01d5c2\") "
Jun 08 11:53:45.336024 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:45.335983    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/91c73bfb-0940-4926-8f4e-318c3f01d5c2-trusted-ca\") pod \"91c73bfb-0940-4926-8f4e-318c3f01d5c2\" (UID: \"91c73bfb-0940-4926-8f4e-318c3f01d5c2\") "
Jun 08 11:53:45.336365 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:45.336313    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91c73bfb-0940-4926-8f4e-318c3f01d5c2-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "91c73bfb-0940-4926-8f4e-318c3f01d5c2" (UID: "91c73bfb-0940-4926-8f4e-318c3f01d5c2"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 08 11:53:45.336602 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:45.336577    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91c73bfb-0940-4926-8f4e-318c3f01d5c2-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "91c73bfb-0940-4926-8f4e-318c3f01d5c2" (UID: "91c73bfb-0940-4926-8f4e-318c3f01d5c2"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 08 11:53:45.338145 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:45.338115    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91c73bfb-0940-4926-8f4e-318c3f01d5c2-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "91c73bfb-0940-4926-8f4e-318c3f01d5c2" (UID: "91c73bfb-0940-4926-8f4e-318c3f01d5c2"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 08 11:53:45.338324 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:45.338298    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91c73bfb-0940-4926-8f4e-318c3f01d5c2-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "91c73bfb-0940-4926-8f4e-318c3f01d5c2" (UID: "91c73bfb-0940-4926-8f4e-318c3f01d5c2"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 08 11:53:45.338415 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:45.338320    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91c73bfb-0940-4926-8f4e-318c3f01d5c2-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "91c73bfb-0940-4926-8f4e-318c3f01d5c2" (UID: "91c73bfb-0940-4926-8f4e-318c3f01d5c2"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 08 11:53:45.338415 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:45.338387    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91c73bfb-0940-4926-8f4e-318c3f01d5c2-kube-api-access-lkn4q" (OuterVolumeSpecName: "kube-api-access-lkn4q") pod "91c73bfb-0940-4926-8f4e-318c3f01d5c2" (UID: "91c73bfb-0940-4926-8f4e-318c3f01d5c2"). InnerVolumeSpecName "kube-api-access-lkn4q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 08 11:53:45.338573 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:45.338555    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91c73bfb-0940-4926-8f4e-318c3f01d5c2-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "91c73bfb-0940-4926-8f4e-318c3f01d5c2" (UID: "91c73bfb-0940-4926-8f4e-318c3f01d5c2"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 08 11:53:45.346410 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:45.346383    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91c73bfb-0940-4926-8f4e-318c3f01d5c2-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "91c73bfb-0940-4926-8f4e-318c3f01d5c2" (UID: "91c73bfb-0940-4926-8f4e-318c3f01d5c2"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 08 11:53:45.437292 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:45.437258    2583 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91c73bfb-0940-4926-8f4e-318c3f01d5c2-registry-tls\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 11:53:45.437292 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:45.437293    2583 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/91c73bfb-0940-4926-8f4e-318c3f01d5c2-image-registry-private-configuration\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 11:53:45.437425 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:45.437307    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lkn4q\" (UniqueName: \"kubernetes.io/projected/91c73bfb-0940-4926-8f4e-318c3f01d5c2-kube-api-access-lkn4q\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 11:53:45.437425 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:45.437320    2583 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/91c73bfb-0940-4926-8f4e-318c3f01d5c2-registry-certificates\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 11:53:45.437425 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:45.437332    2583 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/91c73bfb-0940-4926-8f4e-318c3f01d5c2-installation-pull-secrets\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 11:53:45.437425 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:45.437344    2583 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/91c73bfb-0940-4926-8f4e-318c3f01d5c2-bound-sa-token\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 11:53:45.437425 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:45.437357    2583 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/91c73bfb-0940-4926-8f4e-318c3f01d5c2-ca-trust-extracted\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 11:53:45.437425 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:45.437368    2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/91c73bfb-0940-4926-8f4e-318c3f01d5c2-trusted-ca\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 11:53:46.252213 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:46.252176    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5877df4c8d-zkhq7"
Jun 08 11:53:46.272690 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:46.272664    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5877df4c8d-zkhq7"]
Jun 08 11:53:46.277422 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:46.277401    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5877df4c8d-zkhq7"]
Jun 08 11:53:47.189255 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:47.187290    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91c73bfb-0940-4926-8f4e-318c3f01d5c2" path="/var/lib/kubelet/pods/91c73bfb-0940-4926-8f4e-318c3f01d5c2/volumes"
Jun 08 11:53:50.687033 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:50.686936    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d6bdc5fb4-mhd8g"]
Jun 08 11:53:54.281455 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:54.281421    2583 generic.go:356] "Generic (PLEG): container finished" podID="3214fd2f-d623-436b-b69a-579cf961f902" containerID="25f1926882847c57d69f48b082812940127433f97a8f30b0f77d3a7d578b63fc" exitCode=0
Jun 08 11:53:54.281845 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:54.281493    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-7rkd5" event={"ID":"3214fd2f-d623-436b-b69a-579cf961f902","Type":"ContainerDied","Data":"25f1926882847c57d69f48b082812940127433f97a8f30b0f77d3a7d578b63fc"}
Jun 08 11:53:54.281914 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:54.281848    2583 scope.go:117] "RemoveContainer" containerID="25f1926882847c57d69f48b082812940127433f97a8f30b0f77d3a7d578b63fc"
Jun 08 11:53:54.283037 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:54.283013    2583 generic.go:356] "Generic (PLEG): container finished" podID="5ba6a777-a56b-4674-98c3-5d8fbaf2b4ca" containerID="35d43a764a495a51722aaa7f67d1c1649bc5c083112134273d4327501864846c" exitCode=0
Jun 08 11:53:54.283153 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:54.283037    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-brrk6" event={"ID":"5ba6a777-a56b-4674-98c3-5d8fbaf2b4ca","Type":"ContainerDied","Data":"35d43a764a495a51722aaa7f67d1c1649bc5c083112134273d4327501864846c"}
Jun 08 11:53:54.283325 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:54.283310    2583 scope.go:117] "RemoveContainer" containerID="35d43a764a495a51722aaa7f67d1c1649bc5c083112134273d4327501864846c"
Jun 08 11:53:55.288666 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:55.288630    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-7rkd5" event={"ID":"3214fd2f-d623-436b-b69a-579cf961f902","Type":"ContainerStarted","Data":"88590b0436ee4acccf7291c5decdda68264ef2835d7ac56e929170939c3cb4e0"}
Jun 08 11:53:55.290275 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:55.290253    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-brrk6" event={"ID":"5ba6a777-a56b-4674-98c3-5d8fbaf2b4ca","Type":"ContainerStarted","Data":"c9ba106c6b0fd9f6c3c38d660e24ef2cf0824276a1a3cb23c57b73df12cd4286"}
Jun 08 11:53:57.598204 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:57.598175    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6685959c65-lh79s"
Jun 08 11:53:57.601758 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:53:57.601736    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6685959c65-lh79s"
Jun 08 11:54:13.054753 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:13.054706    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b2281a3-722f-4113-b3e1-7f4b4614f599-metrics-certs\") pod \"network-metrics-daemon-6m4cb\" (UID: \"0b2281a3-722f-4113-b3e1-7f4b4614f599\") " pod="openshift-multus/network-metrics-daemon-6m4cb"
Jun 08 11:54:13.056959 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:13.056941    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b2281a3-722f-4113-b3e1-7f4b4614f599-metrics-certs\") pod \"network-metrics-daemon-6m4cb\" (UID: \"0b2281a3-722f-4113-b3e1-7f4b4614f599\") " pod="openshift-multus/network-metrics-daemon-6m4cb"
Jun 08 11:54:13.284687 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:13.284657    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dzkjg\""
Jun 08 11:54:13.292658 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:13.292635    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6m4cb"
Jun 08 11:54:13.421994 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:13.421898    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6m4cb"]
Jun 08 11:54:13.424706 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:54:13.424678    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b2281a3_722f_4113_b3e1_7f4b4614f599.slice/crio-607486d0af2c2319e3ab99b87aba9b71a2d359506a41453e3a8ffe10b9f72e7a WatchSource:0}: Error finding container 607486d0af2c2319e3ab99b87aba9b71a2d359506a41453e3a8ffe10b9f72e7a: Status 404 returned error can't find the container with id 607486d0af2c2319e3ab99b87aba9b71a2d359506a41453e3a8ffe10b9f72e7a
Jun 08 11:54:14.366454 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:14.366414    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6m4cb" event={"ID":"0b2281a3-722f-4113-b3e1-7f4b4614f599","Type":"ContainerStarted","Data":"607486d0af2c2319e3ab99b87aba9b71a2d359506a41453e3a8ffe10b9f72e7a"}
Jun 08 11:54:15.372467 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:15.372428    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6m4cb" event={"ID":"0b2281a3-722f-4113-b3e1-7f4b4614f599","Type":"ContainerStarted","Data":"5d424a39207b9f8418b1a22f0238975cf7a38e641f2172ff0ea8920630a1d3c0"}
Jun 08 11:54:15.372912 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:15.372479    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6m4cb" event={"ID":"0b2281a3-722f-4113-b3e1-7f4b4614f599","Type":"ContainerStarted","Data":"816f602d91a099e1bbf23300a91d9b41a8923c2edab70ceb169cb5dfd7638e2a"}
Jun 08 11:54:15.388336 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:15.388289    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6m4cb" podStartSLOduration=375.350625851 podStartE2EDuration="6m16.388274113s" totalImagesPullingTime="1.037648262s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 11:47:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 11:54:15.38688659 +0000 UTC m=+376.658461768" watchObservedRunningTime="2026-06-08 11:54:15.388274113 +0000 UTC m=+376.659849288"
Jun 08 11:54:15.707429 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:15.707333    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7d6bdc5fb4-mhd8g" podUID="9a5e31f3-fd4d-4480-9dd4-3449c04833b6" containerName="console" containerID="cri-o://9032409846cf8cce0bcde7c45aad71e67402557a756b9091dfc97c7718d0a4a6" gracePeriod=15
Jun 08 11:54:15.955718 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:15.955697    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d6bdc5fb4-mhd8g"
Jun 08 11:54:16.076147 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:16.076068    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a5e31f3-fd4d-4480-9dd4-3449c04833b6-console-serving-cert\") pod \"9a5e31f3-fd4d-4480-9dd4-3449c04833b6\" (UID: \"9a5e31f3-fd4d-4480-9dd4-3449c04833b6\") "
Jun 08 11:54:16.076147 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:16.076145    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a5e31f3-fd4d-4480-9dd4-3449c04833b6-oauth-serving-cert\") pod \"9a5e31f3-fd4d-4480-9dd4-3449c04833b6\" (UID: \"9a5e31f3-fd4d-4480-9dd4-3449c04833b6\") "
Jun 08 11:54:16.076334 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:16.076187    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a5e31f3-fd4d-4480-9dd4-3449c04833b6-service-ca\") pod \"9a5e31f3-fd4d-4480-9dd4-3449c04833b6\" (UID: \"9a5e31f3-fd4d-4480-9dd4-3449c04833b6\") "
Jun 08 11:54:16.076334 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:16.076211    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a5e31f3-fd4d-4480-9dd4-3449c04833b6-console-oauth-config\") pod \"9a5e31f3-fd4d-4480-9dd4-3449c04833b6\" (UID: \"9a5e31f3-fd4d-4480-9dd4-3449c04833b6\") "
Jun 08 11:54:16.076334 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:16.076248    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a5e31f3-fd4d-4480-9dd4-3449c04833b6-console-config\") pod \"9a5e31f3-fd4d-4480-9dd4-3449c04833b6\" (UID: \"9a5e31f3-fd4d-4480-9dd4-3449c04833b6\") "
Jun 08 11:54:16.076334 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:16.076282    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xc2vc\" (UniqueName: \"kubernetes.io/projected/9a5e31f3-fd4d-4480-9dd4-3449c04833b6-kube-api-access-xc2vc\") pod \"9a5e31f3-fd4d-4480-9dd4-3449c04833b6\" (UID: \"9a5e31f3-fd4d-4480-9dd4-3449c04833b6\") "
Jun 08 11:54:16.076612 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:16.076569    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a5e31f3-fd4d-4480-9dd4-3449c04833b6-service-ca" (OuterVolumeSpecName: "service-ca") pod "9a5e31f3-fd4d-4480-9dd4-3449c04833b6" (UID: "9a5e31f3-fd4d-4480-9dd4-3449c04833b6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 08 11:54:16.076612 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:16.076579    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a5e31f3-fd4d-4480-9dd4-3449c04833b6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9a5e31f3-fd4d-4480-9dd4-3449c04833b6" (UID: "9a5e31f3-fd4d-4480-9dd4-3449c04833b6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 08 11:54:16.076744 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:16.076623    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a5e31f3-fd4d-4480-9dd4-3449c04833b6-console-config" (OuterVolumeSpecName: "console-config") pod "9a5e31f3-fd4d-4480-9dd4-3449c04833b6" (UID: "9a5e31f3-fd4d-4480-9dd4-3449c04833b6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 08 11:54:16.078367 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:16.078340    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a5e31f3-fd4d-4480-9dd4-3449c04833b6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9a5e31f3-fd4d-4480-9dd4-3449c04833b6" (UID: "9a5e31f3-fd4d-4480-9dd4-3449c04833b6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 08 11:54:16.078468 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:16.078428    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a5e31f3-fd4d-4480-9dd4-3449c04833b6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9a5e31f3-fd4d-4480-9dd4-3449c04833b6" (UID: "9a5e31f3-fd4d-4480-9dd4-3449c04833b6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 08 11:54:16.078558 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:16.078537    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a5e31f3-fd4d-4480-9dd4-3449c04833b6-kube-api-access-xc2vc" (OuterVolumeSpecName: "kube-api-access-xc2vc") pod "9a5e31f3-fd4d-4480-9dd4-3449c04833b6" (UID: "9a5e31f3-fd4d-4480-9dd4-3449c04833b6"). InnerVolumeSpecName "kube-api-access-xc2vc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 08 11:54:16.177722 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:16.177695    2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a5e31f3-fd4d-4480-9dd4-3449c04833b6-oauth-serving-cert\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 11:54:16.177722 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:16.177721    2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a5e31f3-fd4d-4480-9dd4-3449c04833b6-service-ca\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 11:54:16.177866 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:16.177734    2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a5e31f3-fd4d-4480-9dd4-3449c04833b6-console-oauth-config\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 11:54:16.177866 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:16.177748    2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a5e31f3-fd4d-4480-9dd4-3449c04833b6-console-config\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 11:54:16.177866 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:16.177760    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xc2vc\" (UniqueName: \"kubernetes.io/projected/9a5e31f3-fd4d-4480-9dd4-3449c04833b6-kube-api-access-xc2vc\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 11:54:16.177866 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:16.177773    2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a5e31f3-fd4d-4480-9dd4-3449c04833b6-console-serving-cert\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 11:54:16.377348 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:16.377317    2583 generic.go:356] "Generic (PLEG): container finished" podID="9a5e31f3-fd4d-4480-9dd4-3449c04833b6" containerID="9032409846cf8cce0bcde7c45aad71e67402557a756b9091dfc97c7718d0a4a6" exitCode=0
Jun 08 11:54:16.377744 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:16.377362    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d6bdc5fb4-mhd8g"
Jun 08 11:54:16.377744 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:16.377394    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d6bdc5fb4-mhd8g" event={"ID":"9a5e31f3-fd4d-4480-9dd4-3449c04833b6","Type":"ContainerDied","Data":"9032409846cf8cce0bcde7c45aad71e67402557a756b9091dfc97c7718d0a4a6"}
Jun 08 11:54:16.377744 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:16.377445    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d6bdc5fb4-mhd8g" event={"ID":"9a5e31f3-fd4d-4480-9dd4-3449c04833b6","Type":"ContainerDied","Data":"be6142e11ef2631a2fda10c1d770f306636b89f7f654d569946305f3d4a1c4c9"}
Jun 08 11:54:16.377744 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:16.377465    2583 scope.go:117] "RemoveContainer" containerID="9032409846cf8cce0bcde7c45aad71e67402557a756b9091dfc97c7718d0a4a6"
Jun 08 11:54:16.388351 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:16.388329    2583 scope.go:117] "RemoveContainer" containerID="9032409846cf8cce0bcde7c45aad71e67402557a756b9091dfc97c7718d0a4a6"
Jun 08 11:54:16.388625 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:54:16.388603    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9032409846cf8cce0bcde7c45aad71e67402557a756b9091dfc97c7718d0a4a6\": container with ID starting with 9032409846cf8cce0bcde7c45aad71e67402557a756b9091dfc97c7718d0a4a6 not found: ID does not exist" containerID="9032409846cf8cce0bcde7c45aad71e67402557a756b9091dfc97c7718d0a4a6"
Jun 08 11:54:16.388688 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:16.388636    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9032409846cf8cce0bcde7c45aad71e67402557a756b9091dfc97c7718d0a4a6"} err="failed to get container status \"9032409846cf8cce0bcde7c45aad71e67402557a756b9091dfc97c7718d0a4a6\": rpc error: code = NotFound desc = could not find container \"9032409846cf8cce0bcde7c45aad71e67402557a756b9091dfc97c7718d0a4a6\": container with ID starting with 9032409846cf8cce0bcde7c45aad71e67402557a756b9091dfc97c7718d0a4a6 not found: ID does not exist"
Jun 08 11:54:16.398774 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:16.398752    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d6bdc5fb4-mhd8g"]
Jun 08 11:54:16.402441 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:16.402422    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7d6bdc5fb4-mhd8g"]
Jun 08 11:54:17.186026 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:17.185996    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a5e31f3-fd4d-4480-9dd4-3449c04833b6" path="/var/lib/kubelet/pods/9a5e31f3-fd4d-4480-9dd4-3449c04833b6/volumes"
Jun 08 11:54:33.139261 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:33.139225    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 08 11:54:33.139748 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:33.139485    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="18414c6f-8d8f-4ee0-9d15-fe3a817a07f7" containerName="alertmanager" containerID="cri-o://e191a6f786c44145de9a86261a1ef301d689efa6741b3104379c66c9f88c3d8b" gracePeriod=120
Jun 08 11:54:33.139748 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:33.139553    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="18414c6f-8d8f-4ee0-9d15-fe3a817a07f7" containerName="kube-rbac-proxy-metric" containerID="cri-o://b1086211e15324f9c472bef45f2821459ae350be2179a300d31c14c05f66e931" gracePeriod=120
Jun 08 11:54:33.139748 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:33.139580    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="18414c6f-8d8f-4ee0-9d15-fe3a817a07f7" containerName="kube-rbac-proxy-web" containerID="cri-o://4df81b0150da49327abf01c6565a0f2f61908882fe18b89ab01e20f1150768ba" gracePeriod=120
Jun 08 11:54:33.139748 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:33.139605    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="18414c6f-8d8f-4ee0-9d15-fe3a817a07f7" containerName="kube-rbac-proxy" containerID="cri-o://50ef9d68b12565cd11a8c3adc94662dba47427a49b16461061b57fbc805f3205" gracePeriod=120
Jun 08 11:54:33.139748 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:33.139637    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="18414c6f-8d8f-4ee0-9d15-fe3a817a07f7" containerName="prom-label-proxy" containerID="cri-o://3df4f150fc5cca8bf04694a814e46c1087f8379b8c91f7d6702203437d2facbd" gracePeriod=120
Jun 08 11:54:33.139748 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:33.139666    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="18414c6f-8d8f-4ee0-9d15-fe3a817a07f7" containerName="config-reloader" containerID="cri-o://ff8e63d96d66520ea8a37d21afda658ea9200d82db3240732f2f4770d1d047aa" gracePeriod=120
Jun 08 11:54:33.445854 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:33.445769    2583 generic.go:356] "Generic (PLEG): container finished" podID="18414c6f-8d8f-4ee0-9d15-fe3a817a07f7" containerID="3df4f150fc5cca8bf04694a814e46c1087f8379b8c91f7d6702203437d2facbd" exitCode=0
Jun 08 11:54:33.445854 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:33.445793    2583 generic.go:356] "Generic (PLEG): container finished" podID="18414c6f-8d8f-4ee0-9d15-fe3a817a07f7" containerID="50ef9d68b12565cd11a8c3adc94662dba47427a49b16461061b57fbc805f3205" exitCode=0
Jun 08 11:54:33.445854 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:33.445801    2583 generic.go:356] "Generic (PLEG): container finished" podID="18414c6f-8d8f-4ee0-9d15-fe3a817a07f7" containerID="ff8e63d96d66520ea8a37d21afda658ea9200d82db3240732f2f4770d1d047aa" exitCode=0
Jun 08 11:54:33.445854 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:33.445807    2583 generic.go:356] "Generic (PLEG): container finished" podID="18414c6f-8d8f-4ee0-9d15-fe3a817a07f7" containerID="e191a6f786c44145de9a86261a1ef301d689efa6741b3104379c66c9f88c3d8b" exitCode=0
Jun 08 11:54:33.445854 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:33.445838    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7","Type":"ContainerDied","Data":"3df4f150fc5cca8bf04694a814e46c1087f8379b8c91f7d6702203437d2facbd"}
Jun 08 11:54:33.446137 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:33.445910    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7","Type":"ContainerDied","Data":"50ef9d68b12565cd11a8c3adc94662dba47427a49b16461061b57fbc805f3205"}
Jun 08 11:54:33.446137 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:33.445937    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7","Type":"ContainerDied","Data":"ff8e63d96d66520ea8a37d21afda658ea9200d82db3240732f2f4770d1d047aa"}
Jun 08 11:54:33.446137 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:33.445971    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7","Type":"ContainerDied","Data":"e191a6f786c44145de9a86261a1ef301d689efa6741b3104379c66c9f88c3d8b"}
Jun 08 11:54:34.382425 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.382400    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:54:34.453506 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.453423    2583 generic.go:356] "Generic (PLEG): container finished" podID="18414c6f-8d8f-4ee0-9d15-fe3a817a07f7" containerID="b1086211e15324f9c472bef45f2821459ae350be2179a300d31c14c05f66e931" exitCode=0
Jun 08 11:54:34.453506 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.453450    2583 generic.go:356] "Generic (PLEG): container finished" podID="18414c6f-8d8f-4ee0-9d15-fe3a817a07f7" containerID="4df81b0150da49327abf01c6565a0f2f61908882fe18b89ab01e20f1150768ba" exitCode=0
Jun 08 11:54:34.453506 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.453470    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7","Type":"ContainerDied","Data":"b1086211e15324f9c472bef45f2821459ae350be2179a300d31c14c05f66e931"}
Jun 08 11:54:34.453744 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.453533    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:54:34.453744 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.453589    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7","Type":"ContainerDied","Data":"4df81b0150da49327abf01c6565a0f2f61908882fe18b89ab01e20f1150768ba"}
Jun 08 11:54:34.453744 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.453632    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7","Type":"ContainerDied","Data":"8ae39d772816266f7d584b2f0d74b1143efcc4734b9fbe210d15f68c65f0e0ce"}
Jun 08 11:54:34.453744 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.453654    2583 scope.go:117] "RemoveContainer" containerID="3df4f150fc5cca8bf04694a814e46c1087f8379b8c91f7d6702203437d2facbd"
Jun 08 11:54:34.462431 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.462413    2583 scope.go:117] "RemoveContainer" containerID="b1086211e15324f9c472bef45f2821459ae350be2179a300d31c14c05f66e931"
Jun 08 11:54:34.468906 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.468891    2583 scope.go:117] "RemoveContainer" containerID="50ef9d68b12565cd11a8c3adc94662dba47427a49b16461061b57fbc805f3205"
Jun 08 11:54:34.474898 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.474881    2583 scope.go:117] "RemoveContainer" containerID="4df81b0150da49327abf01c6565a0f2f61908882fe18b89ab01e20f1150768ba"
Jun 08 11:54:34.481017 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.481002    2583 scope.go:117] "RemoveContainer" containerID="ff8e63d96d66520ea8a37d21afda658ea9200d82db3240732f2f4770d1d047aa"
Jun 08 11:54:34.487353 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.487338    2583 scope.go:117] "RemoveContainer" containerID="e191a6f786c44145de9a86261a1ef301d689efa6741b3104379c66c9f88c3d8b"
Jun 08 11:54:34.493712 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.493696    2583 scope.go:117] "RemoveContainer" containerID="643520df4077c8d93599df78db7271f76559ac548777cac4758ee755ab394dd0"
Jun 08 11:54:34.499628 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.499613    2583 scope.go:117] "RemoveContainer" containerID="3df4f150fc5cca8bf04694a814e46c1087f8379b8c91f7d6702203437d2facbd"
Jun 08 11:54:34.499834 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:54:34.499817    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3df4f150fc5cca8bf04694a814e46c1087f8379b8c91f7d6702203437d2facbd\": container with ID starting with 3df4f150fc5cca8bf04694a814e46c1087f8379b8c91f7d6702203437d2facbd not found: ID does not exist" containerID="3df4f150fc5cca8bf04694a814e46c1087f8379b8c91f7d6702203437d2facbd"
Jun 08 11:54:34.499889 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.499839    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3df4f150fc5cca8bf04694a814e46c1087f8379b8c91f7d6702203437d2facbd"} err="failed to get container status \"3df4f150fc5cca8bf04694a814e46c1087f8379b8c91f7d6702203437d2facbd\": rpc error: code = NotFound desc = could not find container \"3df4f150fc5cca8bf04694a814e46c1087f8379b8c91f7d6702203437d2facbd\": container with ID starting with 3df4f150fc5cca8bf04694a814e46c1087f8379b8c91f7d6702203437d2facbd not found: ID does not exist"
Jun 08 11:54:34.499889 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.499855    2583 scope.go:117] "RemoveContainer" containerID="b1086211e15324f9c472bef45f2821459ae350be2179a300d31c14c05f66e931"
Jun 08 11:54:34.500090 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:54:34.500071    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1086211e15324f9c472bef45f2821459ae350be2179a300d31c14c05f66e931\": container with ID starting with b1086211e15324f9c472bef45f2821459ae350be2179a300d31c14c05f66e931 not found: ID does not exist" containerID="b1086211e15324f9c472bef45f2821459ae350be2179a300d31c14c05f66e931"
Jun 08 11:54:34.500134 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.500096    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1086211e15324f9c472bef45f2821459ae350be2179a300d31c14c05f66e931"} err="failed to get container status \"b1086211e15324f9c472bef45f2821459ae350be2179a300d31c14c05f66e931\": rpc error: code = NotFound desc = could not find container \"b1086211e15324f9c472bef45f2821459ae350be2179a300d31c14c05f66e931\": container with ID starting with b1086211e15324f9c472bef45f2821459ae350be2179a300d31c14c05f66e931 not found: ID does not exist"
Jun 08 11:54:34.500134 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.500111    2583 scope.go:117] "RemoveContainer" containerID="50ef9d68b12565cd11a8c3adc94662dba47427a49b16461061b57fbc805f3205"
Jun 08 11:54:34.500337 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:54:34.500323    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50ef9d68b12565cd11a8c3adc94662dba47427a49b16461061b57fbc805f3205\": container with ID starting with 50ef9d68b12565cd11a8c3adc94662dba47427a49b16461061b57fbc805f3205 not found: ID does not exist" containerID="50ef9d68b12565cd11a8c3adc94662dba47427a49b16461061b57fbc805f3205"
Jun 08 11:54:34.500375 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.500340    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50ef9d68b12565cd11a8c3adc94662dba47427a49b16461061b57fbc805f3205"} err="failed to get container status \"50ef9d68b12565cd11a8c3adc94662dba47427a49b16461061b57fbc805f3205\": rpc error: code = NotFound desc = could not find container \"50ef9d68b12565cd11a8c3adc94662dba47427a49b16461061b57fbc805f3205\": container with ID starting with 50ef9d68b12565cd11a8c3adc94662dba47427a49b16461061b57fbc805f3205 not found: ID does not exist"
Jun 08 11:54:34.500375 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.500351    2583 scope.go:117] "RemoveContainer" containerID="4df81b0150da49327abf01c6565a0f2f61908882fe18b89ab01e20f1150768ba"
Jun 08 11:54:34.500560 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:54:34.500542    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4df81b0150da49327abf01c6565a0f2f61908882fe18b89ab01e20f1150768ba\": container with ID starting with 4df81b0150da49327abf01c6565a0f2f61908882fe18b89ab01e20f1150768ba not found: ID does not exist" containerID="4df81b0150da49327abf01c6565a0f2f61908882fe18b89ab01e20f1150768ba"
Jun 08 11:54:34.500600 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.500566    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4df81b0150da49327abf01c6565a0f2f61908882fe18b89ab01e20f1150768ba"} err="failed to get container status \"4df81b0150da49327abf01c6565a0f2f61908882fe18b89ab01e20f1150768ba\": rpc error: code = NotFound desc = could not find container \"4df81b0150da49327abf01c6565a0f2f61908882fe18b89ab01e20f1150768ba\": container with ID starting with 4df81b0150da49327abf01c6565a0f2f61908882fe18b89ab01e20f1150768ba not found: ID does not exist"
Jun 08 11:54:34.500600 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.500582    2583 scope.go:117] "RemoveContainer" containerID="ff8e63d96d66520ea8a37d21afda658ea9200d82db3240732f2f4770d1d047aa"
Jun 08 11:54:34.500779 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:54:34.500765    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff8e63d96d66520ea8a37d21afda658ea9200d82db3240732f2f4770d1d047aa\": container with ID starting with ff8e63d96d66520ea8a37d21afda658ea9200d82db3240732f2f4770d1d047aa not found: ID does not exist" containerID="ff8e63d96d66520ea8a37d21afda658ea9200d82db3240732f2f4770d1d047aa"
Jun 08 11:54:34.500815 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.500782    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff8e63d96d66520ea8a37d21afda658ea9200d82db3240732f2f4770d1d047aa"} err="failed to get container status \"ff8e63d96d66520ea8a37d21afda658ea9200d82db3240732f2f4770d1d047aa\": rpc error: code = NotFound desc = could not find container \"ff8e63d96d66520ea8a37d21afda658ea9200d82db3240732f2f4770d1d047aa\": container with ID starting with ff8e63d96d66520ea8a37d21afda658ea9200d82db3240732f2f4770d1d047aa not found: ID does not exist"
Jun 08 11:54:34.500815 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.500794    2583 scope.go:117] "RemoveContainer" containerID="e191a6f786c44145de9a86261a1ef301d689efa6741b3104379c66c9f88c3d8b"
Jun 08 11:54:34.501014 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:54:34.500983    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e191a6f786c44145de9a86261a1ef301d689efa6741b3104379c66c9f88c3d8b\": container with ID starting with e191a6f786c44145de9a86261a1ef301d689efa6741b3104379c66c9f88c3d8b not found: ID does not exist" containerID="e191a6f786c44145de9a86261a1ef301d689efa6741b3104379c66c9f88c3d8b"
Jun 08 11:54:34.501099 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.501018    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e191a6f786c44145de9a86261a1ef301d689efa6741b3104379c66c9f88c3d8b"} err="failed to get container status \"e191a6f786c44145de9a86261a1ef301d689efa6741b3104379c66c9f88c3d8b\": rpc error: code = NotFound desc = could not find container \"e191a6f786c44145de9a86261a1ef301d689efa6741b3104379c66c9f88c3d8b\": container with ID starting with e191a6f786c44145de9a86261a1ef301d689efa6741b3104379c66c9f88c3d8b not found: ID does not exist"
Jun 08 11:54:34.501099 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.501030    2583 scope.go:117] "RemoveContainer" containerID="643520df4077c8d93599df78db7271f76559ac548777cac4758ee755ab394dd0"
Jun 08 11:54:34.501295 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:54:34.501271    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"643520df4077c8d93599df78db7271f76559ac548777cac4758ee755ab394dd0\": container with ID starting with 643520df4077c8d93599df78db7271f76559ac548777cac4758ee755ab394dd0 not found: ID does not exist" containerID="643520df4077c8d93599df78db7271f76559ac548777cac4758ee755ab394dd0"
Jun 08 11:54:34.501341 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.501307    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"643520df4077c8d93599df78db7271f76559ac548777cac4758ee755ab394dd0"} err="failed to get container status \"643520df4077c8d93599df78db7271f76559ac548777cac4758ee755ab394dd0\": rpc error: code = NotFound desc = could not find container \"643520df4077c8d93599df78db7271f76559ac548777cac4758ee755ab394dd0\": container with ID starting with 643520df4077c8d93599df78db7271f76559ac548777cac4758ee755ab394dd0 not found: ID does not exist"
Jun 08 11:54:34.501341 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.501326    2583 scope.go:117] "RemoveContainer" containerID="3df4f150fc5cca8bf04694a814e46c1087f8379b8c91f7d6702203437d2facbd"
Jun 08 11:54:34.501556 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.501539    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3df4f150fc5cca8bf04694a814e46c1087f8379b8c91f7d6702203437d2facbd"} err="failed to get container status \"3df4f150fc5cca8bf04694a814e46c1087f8379b8c91f7d6702203437d2facbd\": rpc error: code = NotFound desc = could not find container \"3df4f150fc5cca8bf04694a814e46c1087f8379b8c91f7d6702203437d2facbd\": container with ID starting with 3df4f150fc5cca8bf04694a814e46c1087f8379b8c91f7d6702203437d2facbd not found: ID does not exist"
Jun 08 11:54:34.501594 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.501557    2583 scope.go:117] "RemoveContainer" containerID="b1086211e15324f9c472bef45f2821459ae350be2179a300d31c14c05f66e931"
Jun 08 11:54:34.501737 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.501722    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1086211e15324f9c472bef45f2821459ae350be2179a300d31c14c05f66e931"} err="failed to get container status \"b1086211e15324f9c472bef45f2821459ae350be2179a300d31c14c05f66e931\": rpc error: code = NotFound desc = could not find container \"b1086211e15324f9c472bef45f2821459ae350be2179a300d31c14c05f66e931\": container with ID starting with b1086211e15324f9c472bef45f2821459ae350be2179a300d31c14c05f66e931 not found: ID does not exist"
Jun 08 11:54:34.501777 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.501737    2583 scope.go:117] "RemoveContainer" containerID="50ef9d68b12565cd11a8c3adc94662dba47427a49b16461061b57fbc805f3205"
Jun 08 11:54:34.501946 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.501928    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50ef9d68b12565cd11a8c3adc94662dba47427a49b16461061b57fbc805f3205"} err="failed to get container status \"50ef9d68b12565cd11a8c3adc94662dba47427a49b16461061b57fbc805f3205\": rpc error: code = NotFound desc = could not find container \"50ef9d68b12565cd11a8c3adc94662dba47427a49b16461061b57fbc805f3205\": container with ID starting with 50ef9d68b12565cd11a8c3adc94662dba47427a49b16461061b57fbc805f3205 not found: ID does not exist"
Jun 08 11:54:34.501946 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.501946    2583 scope.go:117] "RemoveContainer" containerID="4df81b0150da49327abf01c6565a0f2f61908882fe18b89ab01e20f1150768ba"
Jun 08 11:54:34.502206 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.502191    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4df81b0150da49327abf01c6565a0f2f61908882fe18b89ab01e20f1150768ba"} err="failed to get container status \"4df81b0150da49327abf01c6565a0f2f61908882fe18b89ab01e20f1150768ba\": rpc error: code = NotFound desc = could not find container \"4df81b0150da49327abf01c6565a0f2f61908882fe18b89ab01e20f1150768ba\": container with ID starting with 4df81b0150da49327abf01c6565a0f2f61908882fe18b89ab01e20f1150768ba not found: ID does not exist"
Jun 08 11:54:34.502265 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.502206    2583 scope.go:117] "RemoveContainer" containerID="ff8e63d96d66520ea8a37d21afda658ea9200d82db3240732f2f4770d1d047aa"
Jun 08 11:54:34.502424 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.502409    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff8e63d96d66520ea8a37d21afda658ea9200d82db3240732f2f4770d1d047aa"} err="failed to get container status \"ff8e63d96d66520ea8a37d21afda658ea9200d82db3240732f2f4770d1d047aa\": rpc error: code = NotFound desc = could not find container \"ff8e63d96d66520ea8a37d21afda658ea9200d82db3240732f2f4770d1d047aa\": container with ID starting with ff8e63d96d66520ea8a37d21afda658ea9200d82db3240732f2f4770d1d047aa not found: ID does not exist"
Jun 08 11:54:34.502475 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.502425    2583 scope.go:117] "RemoveContainer" containerID="e191a6f786c44145de9a86261a1ef301d689efa6741b3104379c66c9f88c3d8b"
Jun 08 11:54:34.502630 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.502605    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e191a6f786c44145de9a86261a1ef301d689efa6741b3104379c66c9f88c3d8b"} err="failed to get container status \"e191a6f786c44145de9a86261a1ef301d689efa6741b3104379c66c9f88c3d8b\": rpc error: code = NotFound desc = could not find container \"e191a6f786c44145de9a86261a1ef301d689efa6741b3104379c66c9f88c3d8b\": container with ID starting with e191a6f786c44145de9a86261a1ef301d689efa6741b3104379c66c9f88c3d8b not found: ID does not exist"
Jun 08 11:54:34.502630 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.502628    2583 scope.go:117] "RemoveContainer" containerID="643520df4077c8d93599df78db7271f76559ac548777cac4758ee755ab394dd0"
Jun 08 11:54:34.502823 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.502807    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"643520df4077c8d93599df78db7271f76559ac548777cac4758ee755ab394dd0"} err="failed to get container status \"643520df4077c8d93599df78db7271f76559ac548777cac4758ee755ab394dd0\": rpc error: code = NotFound desc = could not find container \"643520df4077c8d93599df78db7271f76559ac548777cac4758ee755ab394dd0\": container with ID starting with 643520df4077c8d93599df78db7271f76559ac548777cac4758ee755ab394dd0 not found: ID does not exist"
Jun 08 11:54:34.508110 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.508090    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-secret-alertmanager-kube-rbac-proxy-web\") pod \"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7\" (UID: \"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7\") "
Jun 08 11:54:34.508198 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.508131    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-config-out\") pod \"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7\" (UID: \"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7\") "
Jun 08 11:54:34.508198 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.508158    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-secret-alertmanager-main-tls\") pod \"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7\" (UID: \"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7\") "
Jun 08 11:54:34.508294 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.508199    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-cluster-tls-config\") pod \"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7\" (UID: \"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7\") "
Jun 08 11:54:34.508294 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.508225    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-alertmanager-trusted-ca-bundle\") pod \"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7\" (UID: \"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7\") "
Jun 08 11:54:34.508294 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.508265    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-config-volume\") pod \"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7\" (UID: \"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7\") "
Jun 08 11:54:34.508435 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.508298    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-alertmanager-main-db\") pod \"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7\" (UID: \"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7\") "
Jun 08 11:54:34.508435 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.508330    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-metrics-client-ca\") pod \"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7\" (UID: \"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7\") "
Jun 08 11:54:34.508435 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.508376    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-tls-assets\") pod \"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7\" (UID: \"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7\") "
Jun 08 11:54:34.508435 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.508420    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-web-config\") pod \"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7\" (UID: \"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7\") "
Jun 08 11:54:34.508612 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.508450    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7\" (UID: \"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7\") "
Jun 08 11:54:34.508612 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.508492    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-secret-alertmanager-kube-rbac-proxy\") pod \"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7\" (UID: \"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7\") "
Jun 08 11:54:34.508612 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.508523    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fpvwj\" (UniqueName: \"kubernetes.io/projected/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-kube-api-access-fpvwj\") pod \"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7\" (UID: \"18414c6f-8d8f-4ee0-9d15-fe3a817a07f7\") "
Jun 08 11:54:34.508750 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.508634    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "18414c6f-8d8f-4ee0-9d15-fe3a817a07f7" (UID: "18414c6f-8d8f-4ee0-9d15-fe3a817a07f7"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 08 11:54:34.508802 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.508760    2583 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 11:54:34.509259 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.509186    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "18414c6f-8d8f-4ee0-9d15-fe3a817a07f7" (UID: "18414c6f-8d8f-4ee0-9d15-fe3a817a07f7"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 08 11:54:34.509357 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.509331    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "18414c6f-8d8f-4ee0-9d15-fe3a817a07f7" (UID: "18414c6f-8d8f-4ee0-9d15-fe3a817a07f7"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 08 11:54:34.510905 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.510874    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-config-volume" (OuterVolumeSpecName: "config-volume") pod "18414c6f-8d8f-4ee0-9d15-fe3a817a07f7" (UID: "18414c6f-8d8f-4ee0-9d15-fe3a817a07f7"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 08 11:54:34.511273 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.511249    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-kube-api-access-fpvwj" (OuterVolumeSpecName: "kube-api-access-fpvwj") pod "18414c6f-8d8f-4ee0-9d15-fe3a817a07f7" (UID: "18414c6f-8d8f-4ee0-9d15-fe3a817a07f7"). InnerVolumeSpecName "kube-api-access-fpvwj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 08 11:54:34.511512 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.511474    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "18414c6f-8d8f-4ee0-9d15-fe3a817a07f7" (UID: "18414c6f-8d8f-4ee0-9d15-fe3a817a07f7"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 08 11:54:34.511751 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.511716    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-config-out" (OuterVolumeSpecName: "config-out") pod "18414c6f-8d8f-4ee0-9d15-fe3a817a07f7" (UID: "18414c6f-8d8f-4ee0-9d15-fe3a817a07f7"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 08 11:54:34.511844 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.511767    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "18414c6f-8d8f-4ee0-9d15-fe3a817a07f7" (UID: "18414c6f-8d8f-4ee0-9d15-fe3a817a07f7"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 08 11:54:34.511906 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.511867    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "18414c6f-8d8f-4ee0-9d15-fe3a817a07f7" (UID: "18414c6f-8d8f-4ee0-9d15-fe3a817a07f7"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 08 11:54:34.512013 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.511993    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "18414c6f-8d8f-4ee0-9d15-fe3a817a07f7" (UID: "18414c6f-8d8f-4ee0-9d15-fe3a817a07f7"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 08 11:54:34.512131 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.512104    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "18414c6f-8d8f-4ee0-9d15-fe3a817a07f7" (UID: "18414c6f-8d8f-4ee0-9d15-fe3a817a07f7"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 08 11:54:34.514769 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.514741    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "18414c6f-8d8f-4ee0-9d15-fe3a817a07f7" (UID: "18414c6f-8d8f-4ee0-9d15-fe3a817a07f7"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 08 11:54:34.520961 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.520940    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-web-config" (OuterVolumeSpecName: "web-config") pod "18414c6f-8d8f-4ee0-9d15-fe3a817a07f7" (UID: "18414c6f-8d8f-4ee0-9d15-fe3a817a07f7"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 08 11:54:34.609681 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.609647    2583 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-cluster-tls-config\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 11:54:34.609681 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.609680    2583 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-config-volume\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 11:54:34.609681 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.609690    2583 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-alertmanager-main-db\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 11:54:34.609871 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.609700    2583 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-metrics-client-ca\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 11:54:34.609871 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.609708    2583 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-tls-assets\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 11:54:34.609871 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.609734    2583 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-web-config\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 11:54:34.609871 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.609743    2583 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 11:54:34.609871 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.609752    2583 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 11:54:34.609871 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.609761    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fpvwj\" (UniqueName: \"kubernetes.io/projected/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-kube-api-access-fpvwj\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 11:54:34.609871 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.609769    2583 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 11:54:34.609871 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.609779    2583 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-config-out\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 11:54:34.609871 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.609788    2583 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7-secret-alertmanager-main-tls\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 11:54:34.776843 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.776818    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 08 11:54:34.780850 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.780828    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 08 11:54:34.805579 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.805558    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 08 11:54:34.805800 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.805789    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a5e31f3-fd4d-4480-9dd4-3449c04833b6" containerName="console"
Jun 08 11:54:34.805845 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.805801    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a5e31f3-fd4d-4480-9dd4-3449c04833b6" containerName="console"
Jun 08 11:54:34.805845 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.805810    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18414c6f-8d8f-4ee0-9d15-fe3a817a07f7" containerName="kube-rbac-proxy"
Jun 08 11:54:34.805845 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.805816    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="18414c6f-8d8f-4ee0-9d15-fe3a817a07f7" containerName="kube-rbac-proxy"
Jun 08 11:54:34.805845 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.805829    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18414c6f-8d8f-4ee0-9d15-fe3a817a07f7" containerName="init-config-reloader"
Jun 08 11:54:34.805845 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.805834    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="18414c6f-8d8f-4ee0-9d15-fe3a817a07f7" containerName="init-config-reloader"
Jun 08 11:54:34.805845 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.805841    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91c73bfb-0940-4926-8f4e-318c3f01d5c2" containerName="registry"
Jun 08 11:54:34.805845 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.805846    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="91c73bfb-0940-4926-8f4e-318c3f01d5c2" containerName="registry"
Jun 08 11:54:34.806040 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.805855    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18414c6f-8d8f-4ee0-9d15-fe3a817a07f7" containerName="alertmanager"
Jun 08 11:54:34.806040 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.805860    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="18414c6f-8d8f-4ee0-9d15-fe3a817a07f7" containerName="alertmanager"
Jun 08 11:54:34.806040 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.805865    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18414c6f-8d8f-4ee0-9d15-fe3a817a07f7" containerName="kube-rbac-proxy-web"
Jun 08 11:54:34.806040 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.805870    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="18414c6f-8d8f-4ee0-9d15-fe3a817a07f7" containerName="kube-rbac-proxy-web"
Jun 08 11:54:34.806040 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.805876    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18414c6f-8d8f-4ee0-9d15-fe3a817a07f7" containerName="kube-rbac-proxy-metric"
Jun 08 11:54:34.806040 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.805881    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="18414c6f-8d8f-4ee0-9d15-fe3a817a07f7" containerName="kube-rbac-proxy-metric"
Jun 08 11:54:34.806040 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.805886    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18414c6f-8d8f-4ee0-9d15-fe3a817a07f7" containerName="prom-label-proxy"
Jun 08 11:54:34.806040 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.805891    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="18414c6f-8d8f-4ee0-9d15-fe3a817a07f7" containerName="prom-label-proxy"
Jun 08 11:54:34.806040 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.805900    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18414c6f-8d8f-4ee0-9d15-fe3a817a07f7" containerName="config-reloader"
Jun 08 11:54:34.806040 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.805905    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="18414c6f-8d8f-4ee0-9d15-fe3a817a07f7" containerName="config-reloader"
Jun 08 11:54:34.806040 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.805943    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="18414c6f-8d8f-4ee0-9d15-fe3a817a07f7" containerName="kube-rbac-proxy-web"
Jun 08 11:54:34.806040 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.805950    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="18414c6f-8d8f-4ee0-9d15-fe3a817a07f7" containerName="kube-rbac-proxy-metric"
Jun 08 11:54:34.806040 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.805956    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="91c73bfb-0940-4926-8f4e-318c3f01d5c2" containerName="registry"
Jun 08 11:54:34.806040 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.805962    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="18414c6f-8d8f-4ee0-9d15-fe3a817a07f7" containerName="alertmanager"
Jun 08 11:54:34.806040 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.805967    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a5e31f3-fd4d-4480-9dd4-3449c04833b6" containerName="console"
Jun 08 11:54:34.806040 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.805972    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="18414c6f-8d8f-4ee0-9d15-fe3a817a07f7" containerName="config-reloader"
Jun 08 11:54:34.806040 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.805976    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="18414c6f-8d8f-4ee0-9d15-fe3a817a07f7" containerName="kube-rbac-proxy"
Jun 08 11:54:34.806040 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.805981    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="18414c6f-8d8f-4ee0-9d15-fe3a817a07f7" containerName="prom-label-proxy"
Jun 08 11:54:34.810939 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.810924    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:54:34.813468 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.813449    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jun 08 11:54:34.813606 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.813450    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jun 08 11:54:34.813606 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.813502    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jun 08 11:54:34.813786 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.813768    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jun 08 11:54:34.813877 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.813858    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jun 08 11:54:34.814008 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.813982    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-spwqd\""
Jun 08 11:54:34.814227 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.814210    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jun 08 11:54:34.814301 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.814210    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jun 08 11:54:34.814301 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.814273    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jun 08 11:54:34.818978 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.818959    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jun 08 11:54:34.823568 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.823550    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 08 11:54:34.911921 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.911888    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a7dd2ec1-d2c0-43fb-aa0f-16186d21689d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a7dd2ec1-d2c0-43fb-aa0f-16186d21689d\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:54:34.911921 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.911926    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a7dd2ec1-d2c0-43fb-aa0f-16186d21689d-config-volume\") pod \"alertmanager-main-0\" (UID: \"a7dd2ec1-d2c0-43fb-aa0f-16186d21689d\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:54:34.912184 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.911945    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7dd2ec1-d2c0-43fb-aa0f-16186d21689d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a7dd2ec1-d2c0-43fb-aa0f-16186d21689d\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:54:34.912184 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.911962    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7dd2ec1-d2c0-43fb-aa0f-16186d21689d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a7dd2ec1-d2c0-43fb-aa0f-16186d21689d\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:54:34.912184 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.912078    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a7dd2ec1-d2c0-43fb-aa0f-16186d21689d-config-out\") pod \"alertmanager-main-0\" (UID: \"a7dd2ec1-d2c0-43fb-aa0f-16186d21689d\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:54:34.912184 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.912115    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a7dd2ec1-d2c0-43fb-aa0f-16186d21689d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a7dd2ec1-d2c0-43fb-aa0f-16186d21689d\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:54:34.912184 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.912167    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a7dd2ec1-d2c0-43fb-aa0f-16186d21689d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a7dd2ec1-d2c0-43fb-aa0f-16186d21689d\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:54:34.912401 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.912197    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a7dd2ec1-d2c0-43fb-aa0f-16186d21689d-web-config\") pod \"alertmanager-main-0\" (UID: \"a7dd2ec1-d2c0-43fb-aa0f-16186d21689d\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:54:34.912401 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.912230    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b67m2\" (UniqueName: \"kubernetes.io/projected/a7dd2ec1-d2c0-43fb-aa0f-16186d21689d-kube-api-access-b67m2\") pod \"alertmanager-main-0\" (UID: \"a7dd2ec1-d2c0-43fb-aa0f-16186d21689d\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:54:34.912401 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.912297    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a7dd2ec1-d2c0-43fb-aa0f-16186d21689d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a7dd2ec1-d2c0-43fb-aa0f-16186d21689d\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:54:34.912401 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.912337    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a7dd2ec1-d2c0-43fb-aa0f-16186d21689d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a7dd2ec1-d2c0-43fb-aa0f-16186d21689d\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:54:34.912401 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.912360    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a7dd2ec1-d2c0-43fb-aa0f-16186d21689d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a7dd2ec1-d2c0-43fb-aa0f-16186d21689d\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:54:34.912401 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:34.912379    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a7dd2ec1-d2c0-43fb-aa0f-16186d21689d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a7dd2ec1-d2c0-43fb-aa0f-16186d21689d\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:54:35.013597 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:35.013513    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a7dd2ec1-d2c0-43fb-aa0f-16186d21689d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a7dd2ec1-d2c0-43fb-aa0f-16186d21689d\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:54:35.013597 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:35.013547    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a7dd2ec1-d2c0-43fb-aa0f-16186d21689d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a7dd2ec1-d2c0-43fb-aa0f-16186d21689d\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:54:35.013597 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:35.013566    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a7dd2ec1-d2c0-43fb-aa0f-16186d21689d-web-config\") pod \"alertmanager-main-0\" (UID: \"a7dd2ec1-d2c0-43fb-aa0f-16186d21689d\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:54:35.013597 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:35.013588    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b67m2\" (UniqueName: \"kubernetes.io/projected/a7dd2ec1-d2c0-43fb-aa0f-16186d21689d-kube-api-access-b67m2\") pod \"alertmanager-main-0\" (UID: \"a7dd2ec1-d2c0-43fb-aa0f-16186d21689d\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:54:35.013964 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:35.013615    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a7dd2ec1-d2c0-43fb-aa0f-16186d21689d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a7dd2ec1-d2c0-43fb-aa0f-16186d21689d\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:54:35.013964 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:35.013636    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a7dd2ec1-d2c0-43fb-aa0f-16186d21689d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a7dd2ec1-d2c0-43fb-aa0f-16186d21689d\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:54:35.013964 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:35.013668    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a7dd2ec1-d2c0-43fb-aa0f-16186d21689d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a7dd2ec1-d2c0-43fb-aa0f-16186d21689d\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:54:35.013964 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:35.013694    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a7dd2ec1-d2c0-43fb-aa0f-16186d21689d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a7dd2ec1-d2c0-43fb-aa0f-16186d21689d\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:54:35.013964 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:35.013731    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a7dd2ec1-d2c0-43fb-aa0f-16186d21689d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a7dd2ec1-d2c0-43fb-aa0f-16186d21689d\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:54:35.013964 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:35.013752    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a7dd2ec1-d2c0-43fb-aa0f-16186d21689d-config-volume\") pod \"alertmanager-main-0\" (UID: \"a7dd2ec1-d2c0-43fb-aa0f-16186d21689d\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:54:35.013964 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:35.013779    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7dd2ec1-d2c0-43fb-aa0f-16186d21689d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a7dd2ec1-d2c0-43fb-aa0f-16186d21689d\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:54:35.013964 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:35.013802    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7dd2ec1-d2c0-43fb-aa0f-16186d21689d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a7dd2ec1-d2c0-43fb-aa0f-16186d21689d\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:54:35.013964 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:35.013841    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a7dd2ec1-d2c0-43fb-aa0f-16186d21689d-config-out\") pod \"alertmanager-main-0\" (UID: \"a7dd2ec1-d2c0-43fb-aa0f-16186d21689d\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:54:35.014488 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:35.014044    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a7dd2ec1-d2c0-43fb-aa0f-16186d21689d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a7dd2ec1-d2c0-43fb-aa0f-16186d21689d\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:54:35.014792 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:35.014762    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7dd2ec1-d2c0-43fb-aa0f-16186d21689d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a7dd2ec1-d2c0-43fb-aa0f-16186d21689d\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:54:35.015634 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:35.015604    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7dd2ec1-d2c0-43fb-aa0f-16186d21689d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a7dd2ec1-d2c0-43fb-aa0f-16186d21689d\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:54:35.016688 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:35.016643    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a7dd2ec1-d2c0-43fb-aa0f-16186d21689d-config-out\") pod \"alertmanager-main-0\" (UID: \"a7dd2ec1-d2c0-43fb-aa0f-16186d21689d\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:54:35.016953 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:35.016930    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a7dd2ec1-d2c0-43fb-aa0f-16186d21689d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a7dd2ec1-d2c0-43fb-aa0f-16186d21689d\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:54:35.017025 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:35.016955    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a7dd2ec1-d2c0-43fb-aa0f-16186d21689d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a7dd2ec1-d2c0-43fb-aa0f-16186d21689d\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:54:35.017114 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:35.017077    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a7dd2ec1-d2c0-43fb-aa0f-16186d21689d-web-config\") pod \"alertmanager-main-0\" (UID: \"a7dd2ec1-d2c0-43fb-aa0f-16186d21689d\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:54:35.017448 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:35.017425    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a7dd2ec1-d2c0-43fb-aa0f-16186d21689d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a7dd2ec1-d2c0-43fb-aa0f-16186d21689d\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:54:35.017568 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:35.017542    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a7dd2ec1-d2c0-43fb-aa0f-16186d21689d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a7dd2ec1-d2c0-43fb-aa0f-16186d21689d\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:54:35.017623 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:35.017569    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a7dd2ec1-d2c0-43fb-aa0f-16186d21689d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a7dd2ec1-d2c0-43fb-aa0f-16186d21689d\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:54:35.018039 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:35.018015    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a7dd2ec1-d2c0-43fb-aa0f-16186d21689d-config-volume\") pod \"alertmanager-main-0\" (UID: \"a7dd2ec1-d2c0-43fb-aa0f-16186d21689d\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:54:35.018279 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:35.018263    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a7dd2ec1-d2c0-43fb-aa0f-16186d21689d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a7dd2ec1-d2c0-43fb-aa0f-16186d21689d\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:54:35.020722 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:35.020704    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b67m2\" (UniqueName: \"kubernetes.io/projected/a7dd2ec1-d2c0-43fb-aa0f-16186d21689d-kube-api-access-b67m2\") pod \"alertmanager-main-0\" (UID: \"a7dd2ec1-d2c0-43fb-aa0f-16186d21689d\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:54:35.121303 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:35.121252    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 08 11:54:35.186425 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:35.186396    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18414c6f-8d8f-4ee0-9d15-fe3a817a07f7" path="/var/lib/kubelet/pods/18414c6f-8d8f-4ee0-9d15-fe3a817a07f7/volumes"
Jun 08 11:54:35.253231 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:35.253207    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 08 11:54:35.255198 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:54:35.255171    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7dd2ec1_d2c0_43fb_aa0f_16186d21689d.slice/crio-75091a0b4078612d28e4f61cbeafa3e2d4429a8dc6b4a84ed979dc1bd9d4271d WatchSource:0}: Error finding container 75091a0b4078612d28e4f61cbeafa3e2d4429a8dc6b4a84ed979dc1bd9d4271d: Status 404 returned error can't find the container with id 75091a0b4078612d28e4f61cbeafa3e2d4429a8dc6b4a84ed979dc1bd9d4271d
Jun 08 11:54:35.458999 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:35.458965    2583 generic.go:356] "Generic (PLEG): container finished" podID="a7dd2ec1-d2c0-43fb-aa0f-16186d21689d" containerID="3066eb647b6353ee43aaee8539f9c20a0bb0e3b7d0f4fce3ddc14b25d54c5649" exitCode=0
Jun 08 11:54:35.459338 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:35.459073    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a7dd2ec1-d2c0-43fb-aa0f-16186d21689d","Type":"ContainerDied","Data":"3066eb647b6353ee43aaee8539f9c20a0bb0e3b7d0f4fce3ddc14b25d54c5649"}
Jun 08 11:54:35.459338 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:35.459149    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a7dd2ec1-d2c0-43fb-aa0f-16186d21689d","Type":"ContainerStarted","Data":"75091a0b4078612d28e4f61cbeafa3e2d4429a8dc6b4a84ed979dc1bd9d4271d"}
Jun 08 11:54:36.465938 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:36.465857    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a7dd2ec1-d2c0-43fb-aa0f-16186d21689d","Type":"ContainerStarted","Data":"187dcbb7bb557d6253a9d80b2846613c5d3a27068c192e9c70b61132e64da28b"}
Jun 08 11:54:36.465938 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:36.465923    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a7dd2ec1-d2c0-43fb-aa0f-16186d21689d","Type":"ContainerStarted","Data":"a1fa4d147a38f5ffd9714ce465de5dae8ea51e0c852f82694e2a70c82481a0fb"}
Jun 08 11:54:36.466373 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:36.465948    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a7dd2ec1-d2c0-43fb-aa0f-16186d21689d","Type":"ContainerStarted","Data":"ae5a3edf13bdecc0c65933d91bc9096a54bacfae32e170e816bf299996a08221"}
Jun 08 11:54:36.466373 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:36.465972    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a7dd2ec1-d2c0-43fb-aa0f-16186d21689d","Type":"ContainerStarted","Data":"85d733b02d16067df1789a9595f8b8ea91c1031ebd49ccd8133ee1906d21bcb5"}
Jun 08 11:54:36.466485 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:36.466424    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a7dd2ec1-d2c0-43fb-aa0f-16186d21689d","Type":"ContainerStarted","Data":"59953dc2539dff9cf636a992f3da52d806f88c4abdcae48c4c2730f9de3fdfc2"}
Jun 08 11:54:36.466581 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:36.466555    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a7dd2ec1-d2c0-43fb-aa0f-16186d21689d","Type":"ContainerStarted","Data":"80e8f00d5a59f5bec87735703d98a8b06c521c385678683a1d6348790f9dceed"}
Jun 08 11:54:36.493877 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:36.493830    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.478618936 podStartE2EDuration="2.49381903s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.200094ms" isStatefulPod=false podCreationTimestamp="2026-06-08 11:54:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 11:54:36.492837628 +0000 UTC m=+397.764412828" watchObservedRunningTime="2026-06-08 11:54:36.49381903 +0000 UTC m=+397.765394205"
Jun 08 11:54:37.163356 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:37.163323    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5dc4cd8bbc-k9qbn"]
Jun 08 11:54:37.166749 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:37.166729    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5dc4cd8bbc-k9qbn"
Jun 08 11:54:37.169276 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:37.169253    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-csgtb\""
Jun 08 11:54:37.169403 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:37.169341    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jun 08 11:54:37.169403 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:37.169321    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jun 08 11:54:37.169522 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:37.169428    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jun 08 11:54:37.169522 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:37.169313    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jun 08 11:54:37.170291 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:37.170265    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jun 08 11:54:37.174947 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:37.174923    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jun 08 11:54:37.187473 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:37.187445    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5dc4cd8bbc-k9qbn"]
Jun 08 11:54:37.332800 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:37.332756    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be7626e5-4c6f-4c17-b00d-c5a0db40cb11-serving-certs-ca-bundle\") pod \"telemeter-client-5dc4cd8bbc-k9qbn\" (UID: \"be7626e5-4c6f-4c17-b00d-c5a0db40cb11\") " pod="openshift-monitoring/telemeter-client-5dc4cd8bbc-k9qbn"
Jun 08 11:54:37.332985 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:37.332813    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/be7626e5-4c6f-4c17-b00d-c5a0db40cb11-telemeter-client-tls\") pod \"telemeter-client-5dc4cd8bbc-k9qbn\" (UID: \"be7626e5-4c6f-4c17-b00d-c5a0db40cb11\") " pod="openshift-monitoring/telemeter-client-5dc4cd8bbc-k9qbn"
Jun 08 11:54:37.332985 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:37.332850    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/be7626e5-4c6f-4c17-b00d-c5a0db40cb11-secret-telemeter-client\") pod \"telemeter-client-5dc4cd8bbc-k9qbn\" (UID: \"be7626e5-4c6f-4c17-b00d-c5a0db40cb11\") " pod="openshift-monitoring/telemeter-client-5dc4cd8bbc-k9qbn"
Jun 08 11:54:37.332985 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:37.332877    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be7626e5-4c6f-4c17-b00d-c5a0db40cb11-metrics-client-ca\") pod \"telemeter-client-5dc4cd8bbc-k9qbn\" (UID: \"be7626e5-4c6f-4c17-b00d-c5a0db40cb11\") " pod="openshift-monitoring/telemeter-client-5dc4cd8bbc-k9qbn"
Jun 08 11:54:37.332985 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:37.332969    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/be7626e5-4c6f-4c17-b00d-c5a0db40cb11-federate-client-tls\") pod \"telemeter-client-5dc4cd8bbc-k9qbn\" (UID: \"be7626e5-4c6f-4c17-b00d-c5a0db40cb11\") " pod="openshift-monitoring/telemeter-client-5dc4cd8bbc-k9qbn"
Jun 08 11:54:37.333211 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:37.333005    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mhl2\" (UniqueName: \"kubernetes.io/projected/be7626e5-4c6f-4c17-b00d-c5a0db40cb11-kube-api-access-4mhl2\") pod \"telemeter-client-5dc4cd8bbc-k9qbn\" (UID: \"be7626e5-4c6f-4c17-b00d-c5a0db40cb11\") " pod="openshift-monitoring/telemeter-client-5dc4cd8bbc-k9qbn"
Jun 08 11:54:37.333211 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:37.333071    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/be7626e5-4c6f-4c17-b00d-c5a0db40cb11-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5dc4cd8bbc-k9qbn\" (UID: \"be7626e5-4c6f-4c17-b00d-c5a0db40cb11\") " pod="openshift-monitoring/telemeter-client-5dc4cd8bbc-k9qbn"
Jun 08 11:54:37.333211 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:37.333102    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be7626e5-4c6f-4c17-b00d-c5a0db40cb11-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5dc4cd8bbc-k9qbn\" (UID: \"be7626e5-4c6f-4c17-b00d-c5a0db40cb11\") " pod="openshift-monitoring/telemeter-client-5dc4cd8bbc-k9qbn"
Jun 08 11:54:37.433970 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:37.433883    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mhl2\" (UniqueName: \"kubernetes.io/projected/be7626e5-4c6f-4c17-b00d-c5a0db40cb11-kube-api-access-4mhl2\") pod \"telemeter-client-5dc4cd8bbc-k9qbn\" (UID: \"be7626e5-4c6f-4c17-b00d-c5a0db40cb11\") " pod="openshift-monitoring/telemeter-client-5dc4cd8bbc-k9qbn"
Jun 08 11:54:37.433970 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:37.433934    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/be7626e5-4c6f-4c17-b00d-c5a0db40cb11-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5dc4cd8bbc-k9qbn\" (UID: \"be7626e5-4c6f-4c17-b00d-c5a0db40cb11\") " pod="openshift-monitoring/telemeter-client-5dc4cd8bbc-k9qbn"
Jun 08 11:54:37.434233 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:37.434087    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be7626e5-4c6f-4c17-b00d-c5a0db40cb11-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5dc4cd8bbc-k9qbn\" (UID: \"be7626e5-4c6f-4c17-b00d-c5a0db40cb11\") " pod="openshift-monitoring/telemeter-client-5dc4cd8bbc-k9qbn"
Jun 08 11:54:37.434233 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:37.434147    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be7626e5-4c6f-4c17-b00d-c5a0db40cb11-serving-certs-ca-bundle\") pod \"telemeter-client-5dc4cd8bbc-k9qbn\" (UID: \"be7626e5-4c6f-4c17-b00d-c5a0db40cb11\") " pod="openshift-monitoring/telemeter-client-5dc4cd8bbc-k9qbn"
Jun 08 11:54:37.434233 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:37.434179    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/be7626e5-4c6f-4c17-b00d-c5a0db40cb11-telemeter-client-tls\") pod \"telemeter-client-5dc4cd8bbc-k9qbn\" (UID: \"be7626e5-4c6f-4c17-b00d-c5a0db40cb11\") " pod="openshift-monitoring/telemeter-client-5dc4cd8bbc-k9qbn"
Jun 08 11:54:37.434233 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:37.434218    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/be7626e5-4c6f-4c17-b00d-c5a0db40cb11-secret-telemeter-client\") pod \"telemeter-client-5dc4cd8bbc-k9qbn\" (UID: \"be7626e5-4c6f-4c17-b00d-c5a0db40cb11\") " pod="openshift-monitoring/telemeter-client-5dc4cd8bbc-k9qbn"
Jun 08 11:54:37.434435 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:37.434257    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be7626e5-4c6f-4c17-b00d-c5a0db40cb11-metrics-client-ca\") pod \"telemeter-client-5dc4cd8bbc-k9qbn\" (UID: \"be7626e5-4c6f-4c17-b00d-c5a0db40cb11\") " pod="openshift-monitoring/telemeter-client-5dc4cd8bbc-k9qbn"
Jun 08 11:54:37.434435 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:37.434337    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/be7626e5-4c6f-4c17-b00d-c5a0db40cb11-federate-client-tls\") pod \"telemeter-client-5dc4cd8bbc-k9qbn\" (UID: \"be7626e5-4c6f-4c17-b00d-c5a0db40cb11\") " pod="openshift-monitoring/telemeter-client-5dc4cd8bbc-k9qbn"
Jun 08 11:54:37.434962 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:37.434933    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be7626e5-4c6f-4c17-b00d-c5a0db40cb11-serving-certs-ca-bundle\") pod \"telemeter-client-5dc4cd8bbc-k9qbn\" (UID: \"be7626e5-4c6f-4c17-b00d-c5a0db40cb11\") " pod="openshift-monitoring/telemeter-client-5dc4cd8bbc-k9qbn"
Jun 08 11:54:37.435088 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:37.434968    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be7626e5-4c6f-4c17-b00d-c5a0db40cb11-metrics-client-ca\") pod \"telemeter-client-5dc4cd8bbc-k9qbn\" (UID: \"be7626e5-4c6f-4c17-b00d-c5a0db40cb11\") " pod="openshift-monitoring/telemeter-client-5dc4cd8bbc-k9qbn"
Jun 08 11:54:37.435088 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:37.434997    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be7626e5-4c6f-4c17-b00d-c5a0db40cb11-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5dc4cd8bbc-k9qbn\" (UID: \"be7626e5-4c6f-4c17-b00d-c5a0db40cb11\") " pod="openshift-monitoring/telemeter-client-5dc4cd8bbc-k9qbn"
Jun 08 11:54:37.436722 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:37.436691    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/be7626e5-4c6f-4c17-b00d-c5a0db40cb11-telemeter-client-tls\") pod \"telemeter-client-5dc4cd8bbc-k9qbn\" (UID: \"be7626e5-4c6f-4c17-b00d-c5a0db40cb11\") " pod="openshift-monitoring/telemeter-client-5dc4cd8bbc-k9qbn"
Jun 08 11:54:37.436722 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:37.436709    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/be7626e5-4c6f-4c17-b00d-c5a0db40cb11-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5dc4cd8bbc-k9qbn\" (UID: \"be7626e5-4c6f-4c17-b00d-c5a0db40cb11\") " pod="openshift-monitoring/telemeter-client-5dc4cd8bbc-k9qbn"
Jun 08 11:54:37.436978 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:37.436956    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/be7626e5-4c6f-4c17-b00d-c5a0db40cb11-federate-client-tls\") pod \"telemeter-client-5dc4cd8bbc-k9qbn\" (UID: \"be7626e5-4c6f-4c17-b00d-c5a0db40cb11\") " pod="openshift-monitoring/telemeter-client-5dc4cd8bbc-k9qbn"
Jun 08 11:54:37.437084 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:37.437067    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/be7626e5-4c6f-4c17-b00d-c5a0db40cb11-secret-telemeter-client\") pod \"telemeter-client-5dc4cd8bbc-k9qbn\" (UID: \"be7626e5-4c6f-4c17-b00d-c5a0db40cb11\") " pod="openshift-monitoring/telemeter-client-5dc4cd8bbc-k9qbn"
Jun 08 11:54:37.443298 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:37.443277    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mhl2\" (UniqueName: \"kubernetes.io/projected/be7626e5-4c6f-4c17-b00d-c5a0db40cb11-kube-api-access-4mhl2\") pod \"telemeter-client-5dc4cd8bbc-k9qbn\" (UID: \"be7626e5-4c6f-4c17-b00d-c5a0db40cb11\") " pod="openshift-monitoring/telemeter-client-5dc4cd8bbc-k9qbn"
Jun 08 11:54:37.477436 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:37.477406    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5dc4cd8bbc-k9qbn"
Jun 08 11:54:37.657841 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:37.657808    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5dc4cd8bbc-k9qbn"]
Jun 08 11:54:37.661618 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:54:37.661591    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe7626e5_4c6f_4c17_b00d_c5a0db40cb11.slice/crio-29b98b6557f1594f58f1a99e5e147adcf233d1e36eaa5cf014d7580df29e7b64 WatchSource:0}: Error finding container 29b98b6557f1594f58f1a99e5e147adcf233d1e36eaa5cf014d7580df29e7b64: Status 404 returned error can't find the container with id 29b98b6557f1594f58f1a99e5e147adcf233d1e36eaa5cf014d7580df29e7b64
Jun 08 11:54:38.475534 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:38.475494    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5dc4cd8bbc-k9qbn" event={"ID":"be7626e5-4c6f-4c17-b00d-c5a0db40cb11","Type":"ContainerStarted","Data":"29b98b6557f1594f58f1a99e5e147adcf233d1e36eaa5cf014d7580df29e7b64"}
Jun 08 11:54:39.481844 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:39.481807    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5dc4cd8bbc-k9qbn" event={"ID":"be7626e5-4c6f-4c17-b00d-c5a0db40cb11","Type":"ContainerStarted","Data":"2ef26ebb4ffa5286a8e32ea6cba32471538034f7da209111d37d93c34159d7f3"}
Jun 08 11:54:39.482269 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:39.481863    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5dc4cd8bbc-k9qbn" event={"ID":"be7626e5-4c6f-4c17-b00d-c5a0db40cb11","Type":"ContainerStarted","Data":"222e5240db69bf777def78df587bc002db5e2f3dd78cf6149644a0bc5178256c"}
Jun 08 11:54:39.482269 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:39.481883    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5dc4cd8bbc-k9qbn" event={"ID":"be7626e5-4c6f-4c17-b00d-c5a0db40cb11","Type":"ContainerStarted","Data":"fbd0dd635b5aff6a08aa47ff36a93e0fb5e274efcefc280ebe04cc56bf497a83"}
Jun 08 11:54:39.505825 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:39.505777    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5dc4cd8bbc-k9qbn" podStartSLOduration=1.0812659629999999 podStartE2EDuration="2.505761842s" totalImagesPullingTime="1.424495879s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 11:54:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 11:54:39.504930819 +0000 UTC m=+400.776505996" watchObservedRunningTime="2026-06-08 11:54:39.505761842 +0000 UTC m=+400.777337045"
Jun 08 11:54:40.043360 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:40.043317    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-684b6d4b8c-rqgwv"]
Jun 08 11:54:40.047094 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:40.047065    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-684b6d4b8c-rqgwv"
Jun 08 11:54:40.049645 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:40.049617    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jun 08 11:54:40.049779 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:40.049688    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jun 08 11:54:40.049779 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:40.049717    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jun 08 11:54:40.049932 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:40.049803    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jun 08 11:54:40.049932 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:40.049829    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-pccqj\""
Jun 08 11:54:40.050037 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:40.049939    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jun 08 11:54:40.050256 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:40.050233    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jun 08 11:54:40.050361 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:40.050272    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jun 08 11:54:40.055566 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:40.055546    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jun 08 11:54:40.060069 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:40.060029    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-684b6d4b8c-rqgwv"]
Jun 08 11:54:40.157722 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:40.157688    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d138b71b-cf95-4fb8-888c-e0ba87afd97f-trusted-ca-bundle\") pod \"console-684b6d4b8c-rqgwv\" (UID: \"d138b71b-cf95-4fb8-888c-e0ba87afd97f\") " pod="openshift-console/console-684b6d4b8c-rqgwv"
Jun 08 11:54:40.157722 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:40.157724    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d138b71b-cf95-4fb8-888c-e0ba87afd97f-oauth-serving-cert\") pod \"console-684b6d4b8c-rqgwv\" (UID: \"d138b71b-cf95-4fb8-888c-e0ba87afd97f\") " pod="openshift-console/console-684b6d4b8c-rqgwv"
Jun 08 11:54:40.157904 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:40.157825    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d138b71b-cf95-4fb8-888c-e0ba87afd97f-service-ca\") pod \"console-684b6d4b8c-rqgwv\" (UID: \"d138b71b-cf95-4fb8-888c-e0ba87afd97f\") " pod="openshift-console/console-684b6d4b8c-rqgwv"
Jun 08 11:54:40.157904 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:40.157882    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d138b71b-cf95-4fb8-888c-e0ba87afd97f-console-serving-cert\") pod \"console-684b6d4b8c-rqgwv\" (UID: \"d138b71b-cf95-4fb8-888c-e0ba87afd97f\") " pod="openshift-console/console-684b6d4b8c-rqgwv"
Jun 08 11:54:40.158003 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:40.157936    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d138b71b-cf95-4fb8-888c-e0ba87afd97f-console-oauth-config\") pod \"console-684b6d4b8c-rqgwv\" (UID: \"d138b71b-cf95-4fb8-888c-e0ba87afd97f\") " pod="openshift-console/console-684b6d4b8c-rqgwv"
Jun 08 11:54:40.158003 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:40.157986    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d138b71b-cf95-4fb8-888c-e0ba87afd97f-console-config\") pod \"console-684b6d4b8c-rqgwv\" (UID: \"d138b71b-cf95-4fb8-888c-e0ba87afd97f\") " pod="openshift-console/console-684b6d4b8c-rqgwv"
Jun 08 11:54:40.158098 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:40.158011    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sppp8\" (UniqueName: \"kubernetes.io/projected/d138b71b-cf95-4fb8-888c-e0ba87afd97f-kube-api-access-sppp8\") pod \"console-684b6d4b8c-rqgwv\" (UID: \"d138b71b-cf95-4fb8-888c-e0ba87afd97f\") " pod="openshift-console/console-684b6d4b8c-rqgwv"
Jun 08 11:54:40.258938 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:40.258839    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d138b71b-cf95-4fb8-888c-e0ba87afd97f-service-ca\") pod \"console-684b6d4b8c-rqgwv\" (UID: \"d138b71b-cf95-4fb8-888c-e0ba87afd97f\") " pod="openshift-console/console-684b6d4b8c-rqgwv"
Jun 08 11:54:40.258938 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:40.258905    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d138b71b-cf95-4fb8-888c-e0ba87afd97f-console-serving-cert\") pod \"console-684b6d4b8c-rqgwv\" (UID: \"d138b71b-cf95-4fb8-888c-e0ba87afd97f\") " pod="openshift-console/console-684b6d4b8c-rqgwv"
Jun 08 11:54:40.259194 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:40.258958    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d138b71b-cf95-4fb8-888c-e0ba87afd97f-console-oauth-config\") pod \"console-684b6d4b8c-rqgwv\" (UID: \"d138b71b-cf95-4fb8-888c-e0ba87afd97f\") " pod="openshift-console/console-684b6d4b8c-rqgwv"
Jun 08 11:54:40.259194 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:40.258989    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d138b71b-cf95-4fb8-888c-e0ba87afd97f-console-config\") pod \"console-684b6d4b8c-rqgwv\" (UID: \"d138b71b-cf95-4fb8-888c-e0ba87afd97f\") " pod="openshift-console/console-684b6d4b8c-rqgwv"
Jun 08 11:54:40.259194 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:40.259017    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sppp8\" (UniqueName: \"kubernetes.io/projected/d138b71b-cf95-4fb8-888c-e0ba87afd97f-kube-api-access-sppp8\") pod \"console-684b6d4b8c-rqgwv\" (UID: \"d138b71b-cf95-4fb8-888c-e0ba87afd97f\") " pod="openshift-console/console-684b6d4b8c-rqgwv"
Jun 08 11:54:40.259194 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:40.259082    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d138b71b-cf95-4fb8-888c-e0ba87afd97f-trusted-ca-bundle\") pod \"console-684b6d4b8c-rqgwv\" (UID: \"d138b71b-cf95-4fb8-888c-e0ba87afd97f\") " pod="openshift-console/console-684b6d4b8c-rqgwv"
Jun 08 11:54:40.259194 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:40.259105    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d138b71b-cf95-4fb8-888c-e0ba87afd97f-oauth-serving-cert\") pod \"console-684b6d4b8c-rqgwv\" (UID: \"d138b71b-cf95-4fb8-888c-e0ba87afd97f\") " pod="openshift-console/console-684b6d4b8c-rqgwv"
Jun 08 11:54:40.259868 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:40.259839    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d138b71b-cf95-4fb8-888c-e0ba87afd97f-oauth-serving-cert\") pod \"console-684b6d4b8c-rqgwv\" (UID: \"d138b71b-cf95-4fb8-888c-e0ba87afd97f\") " pod="openshift-console/console-684b6d4b8c-rqgwv"
Jun 08 11:54:40.260077 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:40.260030    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d138b71b-cf95-4fb8-888c-e0ba87afd97f-trusted-ca-bundle\") pod \"console-684b6d4b8c-rqgwv\" (UID: \"d138b71b-cf95-4fb8-888c-e0ba87afd97f\") " pod="openshift-console/console-684b6d4b8c-rqgwv"
Jun 08 11:54:40.260148 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:40.260074    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d138b71b-cf95-4fb8-888c-e0ba87afd97f-service-ca\") pod \"console-684b6d4b8c-rqgwv\" (UID: \"d138b71b-cf95-4fb8-888c-e0ba87afd97f\") " pod="openshift-console/console-684b6d4b8c-rqgwv"
Jun 08 11:54:40.260148 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:40.260095    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d138b71b-cf95-4fb8-888c-e0ba87afd97f-console-config\") pod \"console-684b6d4b8c-rqgwv\" (UID: \"d138b71b-cf95-4fb8-888c-e0ba87afd97f\") " pod="openshift-console/console-684b6d4b8c-rqgwv"
Jun 08 11:54:40.261706 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:40.261683    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d138b71b-cf95-4fb8-888c-e0ba87afd97f-console-serving-cert\") pod \"console-684b6d4b8c-rqgwv\" (UID: \"d138b71b-cf95-4fb8-888c-e0ba87afd97f\") " pod="openshift-console/console-684b6d4b8c-rqgwv"
Jun 08 11:54:40.261773 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:40.261722    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d138b71b-cf95-4fb8-888c-e0ba87afd97f-console-oauth-config\") pod \"console-684b6d4b8c-rqgwv\" (UID: \"d138b71b-cf95-4fb8-888c-e0ba87afd97f\") " pod="openshift-console/console-684b6d4b8c-rqgwv"
Jun 08 11:54:40.268198 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:40.268173    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sppp8\" (UniqueName: \"kubernetes.io/projected/d138b71b-cf95-4fb8-888c-e0ba87afd97f-kube-api-access-sppp8\") pod \"console-684b6d4b8c-rqgwv\" (UID: \"d138b71b-cf95-4fb8-888c-e0ba87afd97f\") " pod="openshift-console/console-684b6d4b8c-rqgwv"
Jun 08 11:54:40.358946 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:40.358904    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-684b6d4b8c-rqgwv"
Jun 08 11:54:40.500321 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:40.500271    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-684b6d4b8c-rqgwv"]
Jun 08 11:54:40.504167 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:54:40.504137    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd138b71b_cf95_4fb8_888c_e0ba87afd97f.slice/crio-0e1cda82e3b92d49ab594cdb6a6103d496688bb7d610634c5469496beadb4fac WatchSource:0}: Error finding container 0e1cda82e3b92d49ab594cdb6a6103d496688bb7d610634c5469496beadb4fac: Status 404 returned error can't find the container with id 0e1cda82e3b92d49ab594cdb6a6103d496688bb7d610634c5469496beadb4fac
Jun 08 11:54:41.491510 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:41.491470    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-684b6d4b8c-rqgwv" event={"ID":"d138b71b-cf95-4fb8-888c-e0ba87afd97f","Type":"ContainerStarted","Data":"6b01a6f685da5179340dd1f92e802e087a3912b950e791d88eff9d07eabd7f95"}
Jun 08 11:54:41.491653 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:41.491525    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-684b6d4b8c-rqgwv" event={"ID":"d138b71b-cf95-4fb8-888c-e0ba87afd97f","Type":"ContainerStarted","Data":"0e1cda82e3b92d49ab594cdb6a6103d496688bb7d610634c5469496beadb4fac"}
Jun 08 11:54:50.359619 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:50.359570    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-684b6d4b8c-rqgwv"
Jun 08 11:54:50.360025 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:50.359669    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-684b6d4b8c-rqgwv"
Jun 08 11:54:50.364256 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:50.364236    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-684b6d4b8c-rqgwv"
Jun 08 11:54:50.384062 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:50.384007    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-684b6d4b8c-rqgwv" podStartSLOduration=10.383991469 podStartE2EDuration="10.383991469s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 11:54:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 11:54:41.536641429 +0000 UTC m=+402.808216604" watchObservedRunningTime="2026-06-08 11:54:50.383991469 +0000 UTC m=+411.655566685"
Jun 08 11:54:50.530545 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:54:50.530522    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-684b6d4b8c-rqgwv"
Jun 08 11:56:09.186524 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:56:09.186487    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-76f5858998-ftz2h"]
Jun 08 11:56:09.189855 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:56:09.189830    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76f5858998-ftz2h"
Jun 08 11:56:09.196095 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:56:09.196067    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76f5858998-ftz2h"]
Jun 08 11:56:09.296308 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:56:09.296277    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16ec8664-c53a-4c53-97d2-250e66766b98-trusted-ca-bundle\") pod \"console-76f5858998-ftz2h\" (UID: \"16ec8664-c53a-4c53-97d2-250e66766b98\") " pod="openshift-console/console-76f5858998-ftz2h"
Jun 08 11:56:09.296308 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:56:09.296309    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkcmm\" (UniqueName: \"kubernetes.io/projected/16ec8664-c53a-4c53-97d2-250e66766b98-kube-api-access-vkcmm\") pod \"console-76f5858998-ftz2h\" (UID: \"16ec8664-c53a-4c53-97d2-250e66766b98\") " pod="openshift-console/console-76f5858998-ftz2h"
Jun 08 11:56:09.296509 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:56:09.296345    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/16ec8664-c53a-4c53-97d2-250e66766b98-console-config\") pod \"console-76f5858998-ftz2h\" (UID: \"16ec8664-c53a-4c53-97d2-250e66766b98\") " pod="openshift-console/console-76f5858998-ftz2h"
Jun 08 11:56:09.296509 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:56:09.296447    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/16ec8664-c53a-4c53-97d2-250e66766b98-console-oauth-config\") pod \"console-76f5858998-ftz2h\" (UID: \"16ec8664-c53a-4c53-97d2-250e66766b98\") " pod="openshift-console/console-76f5858998-ftz2h"
Jun 08 11:56:09.296509 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:56:09.296495    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/16ec8664-c53a-4c53-97d2-250e66766b98-service-ca\") pod \"console-76f5858998-ftz2h\" (UID: \"16ec8664-c53a-4c53-97d2-250e66766b98\") " pod="openshift-console/console-76f5858998-ftz2h"
Jun 08 11:56:09.296618 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:56:09.296556    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/16ec8664-c53a-4c53-97d2-250e66766b98-oauth-serving-cert\") pod \"console-76f5858998-ftz2h\" (UID: \"16ec8664-c53a-4c53-97d2-250e66766b98\") " pod="openshift-console/console-76f5858998-ftz2h"
Jun 08 11:56:09.296618 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:56:09.296585    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/16ec8664-c53a-4c53-97d2-250e66766b98-console-serving-cert\") pod \"console-76f5858998-ftz2h\" (UID: \"16ec8664-c53a-4c53-97d2-250e66766b98\") " pod="openshift-console/console-76f5858998-ftz2h"
Jun 08 11:56:09.397597 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:56:09.397563    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16ec8664-c53a-4c53-97d2-250e66766b98-trusted-ca-bundle\") pod \"console-76f5858998-ftz2h\" (UID: \"16ec8664-c53a-4c53-97d2-250e66766b98\") " pod="openshift-console/console-76f5858998-ftz2h"
Jun 08 11:56:09.397597 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:56:09.397598    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkcmm\" (UniqueName: \"kubernetes.io/projected/16ec8664-c53a-4c53-97d2-250e66766b98-kube-api-access-vkcmm\") pod \"console-76f5858998-ftz2h\" (UID: \"16ec8664-c53a-4c53-97d2-250e66766b98\") " pod="openshift-console/console-76f5858998-ftz2h"
Jun 08 11:56:09.397856 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:56:09.397621    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/16ec8664-c53a-4c53-97d2-250e66766b98-console-config\") pod \"console-76f5858998-ftz2h\" (UID: \"16ec8664-c53a-4c53-97d2-250e66766b98\") " pod="openshift-console/console-76f5858998-ftz2h"
Jun 08 11:56:09.397856 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:56:09.397653    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/16ec8664-c53a-4c53-97d2-250e66766b98-console-oauth-config\") pod \"console-76f5858998-ftz2h\" (UID: \"16ec8664-c53a-4c53-97d2-250e66766b98\") " pod="openshift-console/console-76f5858998-ftz2h"
Jun 08 11:56:09.397856 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:56:09.397690    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/16ec8664-c53a-4c53-97d2-250e66766b98-service-ca\") pod \"console-76f5858998-ftz2h\" (UID: \"16ec8664-c53a-4c53-97d2-250e66766b98\") " pod="openshift-console/console-76f5858998-ftz2h"
Jun 08 11:56:09.397856 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:56:09.397722    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/16ec8664-c53a-4c53-97d2-250e66766b98-oauth-serving-cert\") pod \"console-76f5858998-ftz2h\" (UID: \"16ec8664-c53a-4c53-97d2-250e66766b98\") " pod="openshift-console/console-76f5858998-ftz2h"
Jun 08 11:56:09.397856 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:56:09.397748    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/16ec8664-c53a-4c53-97d2-250e66766b98-console-serving-cert\") pod \"console-76f5858998-ftz2h\" (UID: \"16ec8664-c53a-4c53-97d2-250e66766b98\") " pod="openshift-console/console-76f5858998-ftz2h"
Jun 08 11:56:09.398479 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:56:09.398453    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/16ec8664-c53a-4c53-97d2-250e66766b98-console-config\") pod \"console-76f5858998-ftz2h\" (UID: \"16ec8664-c53a-4c53-97d2-250e66766b98\") " pod="openshift-console/console-76f5858998-ftz2h"
Jun 08 11:56:09.398665 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:56:09.398522    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/16ec8664-c53a-4c53-97d2-250e66766b98-service-ca\") pod \"console-76f5858998-ftz2h\" (UID: \"16ec8664-c53a-4c53-97d2-250e66766b98\") " pod="openshift-console/console-76f5858998-ftz2h"
Jun 08 11:56:09.398665 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:56:09.398542    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/16ec8664-c53a-4c53-97d2-250e66766b98-oauth-serving-cert\") pod \"console-76f5858998-ftz2h\" (UID: \"16ec8664-c53a-4c53-97d2-250e66766b98\") " pod="openshift-console/console-76f5858998-ftz2h"
Jun 08 11:56:09.398865 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:56:09.398699    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16ec8664-c53a-4c53-97d2-250e66766b98-trusted-ca-bundle\") pod \"console-76f5858998-ftz2h\" (UID: \"16ec8664-c53a-4c53-97d2-250e66766b98\") " pod="openshift-console/console-76f5858998-ftz2h"
Jun 08 11:56:09.400114 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:56:09.400093    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/16ec8664-c53a-4c53-97d2-250e66766b98-console-oauth-config\") pod \"console-76f5858998-ftz2h\" (UID: \"16ec8664-c53a-4c53-97d2-250e66766b98\") " pod="openshift-console/console-76f5858998-ftz2h"
Jun 08 11:56:09.400311 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:56:09.400292    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/16ec8664-c53a-4c53-97d2-250e66766b98-console-serving-cert\") pod \"console-76f5858998-ftz2h\" (UID: \"16ec8664-c53a-4c53-97d2-250e66766b98\") " pod="openshift-console/console-76f5858998-ftz2h"
Jun 08 11:56:09.407854 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:56:09.407832    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkcmm\" (UniqueName: \"kubernetes.io/projected/16ec8664-c53a-4c53-97d2-250e66766b98-kube-api-access-vkcmm\") pod \"console-76f5858998-ftz2h\" (UID: \"16ec8664-c53a-4c53-97d2-250e66766b98\") " pod="openshift-console/console-76f5858998-ftz2h"
Jun 08 11:56:09.502017 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:56:09.501948    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76f5858998-ftz2h"
Jun 08 11:56:09.628769 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:56:09.628732    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76f5858998-ftz2h"]
Jun 08 11:56:09.631484 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:56:09.631456    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16ec8664_c53a_4c53_97d2_250e66766b98.slice/crio-2328d04b4428da3fb7b736364b0363ee0d661f648a8cb738b3c2651c1f82d0c0 WatchSource:0}: Error finding container 2328d04b4428da3fb7b736364b0363ee0d661f648a8cb738b3c2651c1f82d0c0: Status 404 returned error can't find the container with id 2328d04b4428da3fb7b736364b0363ee0d661f648a8cb738b3c2651c1f82d0c0
Jun 08 11:56:09.828985 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:56:09.828892    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76f5858998-ftz2h" event={"ID":"16ec8664-c53a-4c53-97d2-250e66766b98","Type":"ContainerStarted","Data":"5f51bd7ac954e43ce677b514fe6505cb79fee95975625b446db9622ebd482392"}
Jun 08 11:56:09.828985 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:56:09.828960    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76f5858998-ftz2h" event={"ID":"16ec8664-c53a-4c53-97d2-250e66766b98","Type":"ContainerStarted","Data":"2328d04b4428da3fb7b736364b0363ee0d661f648a8cb738b3c2651c1f82d0c0"}
Jun 08 11:56:09.847732 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:56:09.847682    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-76f5858998-ftz2h" podStartSLOduration=0.847665061 podStartE2EDuration="847.665061ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 11:56:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 11:56:09.8463481 +0000 UTC m=+491.117923278" watchObservedRunningTime="2026-06-08 11:56:09.847665061 +0000 UTC m=+491.119240238"
Jun 08 11:56:19.502859 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:56:19.502820    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-76f5858998-ftz2h"
Jun 08 11:56:19.503450 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:56:19.502887    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-76f5858998-ftz2h"
Jun 08 11:56:19.507778 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:56:19.507758    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-76f5858998-ftz2h"
Jun 08 11:56:19.874784 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:56:19.874752    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-76f5858998-ftz2h"
Jun 08 11:56:19.919168 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:56:19.919136    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-684b6d4b8c-rqgwv"]
Jun 08 11:56:44.943072 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:56:44.943013    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-684b6d4b8c-rqgwv" podUID="d138b71b-cf95-4fb8-888c-e0ba87afd97f" containerName="console" containerID="cri-o://6b01a6f685da5179340dd1f92e802e087a3912b950e791d88eff9d07eabd7f95" gracePeriod=15
Jun 08 11:56:45.183845 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:56:45.183821    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-684b6d4b8c-rqgwv"
Jun 08 11:56:45.296181 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:56:45.296099    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d138b71b-cf95-4fb8-888c-e0ba87afd97f-console-oauth-config\") pod \"d138b71b-cf95-4fb8-888c-e0ba87afd97f\" (UID: \"d138b71b-cf95-4fb8-888c-e0ba87afd97f\") "
Jun 08 11:56:45.296181 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:56:45.296147    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d138b71b-cf95-4fb8-888c-e0ba87afd97f-trusted-ca-bundle\") pod \"d138b71b-cf95-4fb8-888c-e0ba87afd97f\" (UID: \"d138b71b-cf95-4fb8-888c-e0ba87afd97f\") "
Jun 08 11:56:45.296181 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:56:45.296176    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d138b71b-cf95-4fb8-888c-e0ba87afd97f-console-config\") pod \"d138b71b-cf95-4fb8-888c-e0ba87afd97f\" (UID: \"d138b71b-cf95-4fb8-888c-e0ba87afd97f\") "
Jun 08 11:56:45.296399 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:56:45.296311    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d138b71b-cf95-4fb8-888c-e0ba87afd97f-console-serving-cert\") pod \"d138b71b-cf95-4fb8-888c-e0ba87afd97f\" (UID: \"d138b71b-cf95-4fb8-888c-e0ba87afd97f\") "
Jun 08 11:56:45.296399 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:56:45.296356    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d138b71b-cf95-4fb8-888c-e0ba87afd97f-oauth-serving-cert\") pod \"d138b71b-cf95-4fb8-888c-e0ba87afd97f\" (UID: \"d138b71b-cf95-4fb8-888c-e0ba87afd97f\") "
Jun 08 11:56:45.296399 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:56:45.296381    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d138b71b-cf95-4fb8-888c-e0ba87afd97f-service-ca\") pod \"d138b71b-cf95-4fb8-888c-e0ba87afd97f\" (UID: \"d138b71b-cf95-4fb8-888c-e0ba87afd97f\") "
Jun 08 11:56:45.296399 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:56:45.296397    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sppp8\" (UniqueName: \"kubernetes.io/projected/d138b71b-cf95-4fb8-888c-e0ba87afd97f-kube-api-access-sppp8\") pod \"d138b71b-cf95-4fb8-888c-e0ba87afd97f\" (UID: \"d138b71b-cf95-4fb8-888c-e0ba87afd97f\") "
Jun 08 11:56:45.296693 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:56:45.296586    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d138b71b-cf95-4fb8-888c-e0ba87afd97f-console-config" (OuterVolumeSpecName: "console-config") pod "d138b71b-cf95-4fb8-888c-e0ba87afd97f" (UID: "d138b71b-cf95-4fb8-888c-e0ba87afd97f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 08 11:56:45.296785 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:56:45.296706    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d138b71b-cf95-4fb8-888c-e0ba87afd97f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d138b71b-cf95-4fb8-888c-e0ba87afd97f" (UID: "d138b71b-cf95-4fb8-888c-e0ba87afd97f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 08 11:56:45.296847 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:56:45.296823    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d138b71b-cf95-4fb8-888c-e0ba87afd97f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d138b71b-cf95-4fb8-888c-e0ba87afd97f" (UID: "d138b71b-cf95-4fb8-888c-e0ba87afd97f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 08 11:56:45.296904 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:56:45.296850    2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d138b71b-cf95-4fb8-888c-e0ba87afd97f-console-config\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 11:56:45.297008 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:56:45.296987    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d138b71b-cf95-4fb8-888c-e0ba87afd97f-service-ca" (OuterVolumeSpecName: "service-ca") pod "d138b71b-cf95-4fb8-888c-e0ba87afd97f" (UID: "d138b71b-cf95-4fb8-888c-e0ba87afd97f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 08 11:56:45.298441 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:56:45.298411    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d138b71b-cf95-4fb8-888c-e0ba87afd97f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d138b71b-cf95-4fb8-888c-e0ba87afd97f" (UID: "d138b71b-cf95-4fb8-888c-e0ba87afd97f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 08 11:56:45.298534 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:56:45.298458    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d138b71b-cf95-4fb8-888c-e0ba87afd97f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d138b71b-cf95-4fb8-888c-e0ba87afd97f" (UID: "d138b71b-cf95-4fb8-888c-e0ba87afd97f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 08 11:56:45.298534 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:56:45.298508    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d138b71b-cf95-4fb8-888c-e0ba87afd97f-kube-api-access-sppp8" (OuterVolumeSpecName: "kube-api-access-sppp8") pod "d138b71b-cf95-4fb8-888c-e0ba87afd97f" (UID: "d138b71b-cf95-4fb8-888c-e0ba87afd97f"). InnerVolumeSpecName "kube-api-access-sppp8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 08 11:56:45.397388 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:56:45.397344    2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d138b71b-cf95-4fb8-888c-e0ba87afd97f-console-oauth-config\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 11:56:45.397388 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:56:45.397379    2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d138b71b-cf95-4fb8-888c-e0ba87afd97f-trusted-ca-bundle\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 11:56:45.397388 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:56:45.397392    2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d138b71b-cf95-4fb8-888c-e0ba87afd97f-console-serving-cert\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 11:56:45.397639 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:56:45.397406    2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d138b71b-cf95-4fb8-888c-e0ba87afd97f-oauth-serving-cert\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 11:56:45.397639 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:56:45.397419    2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d138b71b-cf95-4fb8-888c-e0ba87afd97f-service-ca\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 11:56:45.397639 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:56:45.397430    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sppp8\" (UniqueName: \"kubernetes.io/projected/d138b71b-cf95-4fb8-888c-e0ba87afd97f-kube-api-access-sppp8\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 11:56:45.973609 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:56:45.973571    2583 generic.go:356] "Generic (PLEG): container finished" podID="d138b71b-cf95-4fb8-888c-e0ba87afd97f" containerID="6b01a6f685da5179340dd1f92e802e087a3912b950e791d88eff9d07eabd7f95" exitCode=0
Jun 08 11:56:45.973609 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:56:45.973611    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-684b6d4b8c-rqgwv"
Jun 08 11:56:45.974164 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:56:45.973638    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-684b6d4b8c-rqgwv" event={"ID":"d138b71b-cf95-4fb8-888c-e0ba87afd97f","Type":"ContainerDied","Data":"6b01a6f685da5179340dd1f92e802e087a3912b950e791d88eff9d07eabd7f95"}
Jun 08 11:56:45.974164 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:56:45.973689    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-684b6d4b8c-rqgwv" event={"ID":"d138b71b-cf95-4fb8-888c-e0ba87afd97f","Type":"ContainerDied","Data":"0e1cda82e3b92d49ab594cdb6a6103d496688bb7d610634c5469496beadb4fac"}
Jun 08 11:56:45.974164 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:56:45.973719    2583 scope.go:117] "RemoveContainer" containerID="6b01a6f685da5179340dd1f92e802e087a3912b950e791d88eff9d07eabd7f95"
Jun 08 11:56:45.982302 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:56:45.982285    2583 scope.go:117] "RemoveContainer" containerID="6b01a6f685da5179340dd1f92e802e087a3912b950e791d88eff9d07eabd7f95"
Jun 08 11:56:45.982546 ip-10-0-136-189 kubenswrapper[2583]: E0608 11:56:45.982526    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b01a6f685da5179340dd1f92e802e087a3912b950e791d88eff9d07eabd7f95\": container with ID starting with 6b01a6f685da5179340dd1f92e802e087a3912b950e791d88eff9d07eabd7f95 not found: ID does not exist" containerID="6b01a6f685da5179340dd1f92e802e087a3912b950e791d88eff9d07eabd7f95"
Jun 08 11:56:45.982613 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:56:45.982558    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b01a6f685da5179340dd1f92e802e087a3912b950e791d88eff9d07eabd7f95"} err="failed to get container status \"6b01a6f685da5179340dd1f92e802e087a3912b950e791d88eff9d07eabd7f95\": rpc error: code = NotFound desc = could not find container \"6b01a6f685da5179340dd1f92e802e087a3912b950e791d88eff9d07eabd7f95\": container with ID starting with 6b01a6f685da5179340dd1f92e802e087a3912b950e791d88eff9d07eabd7f95 not found: ID does not exist"
Jun 08 11:56:45.993168 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:56:45.993140    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-684b6d4b8c-rqgwv"]
Jun 08 11:56:45.996668 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:56:45.996645    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-684b6d4b8c-rqgwv"]
Jun 08 11:56:47.189922 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:56:47.189885    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d138b71b-cf95-4fb8-888c-e0ba87afd97f" path="/var/lib/kubelet/pods/d138b71b-cf95-4fb8-888c-e0ba87afd97f/volumes"
Jun 08 11:57:59.151273 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:57:59.151244    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mnnbj_cdf82c13-c30a-474a-a135-3d1dbcbb6046/console-operator/2.log"
Jun 08 11:57:59.151902 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:57:59.151880    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mnnbj_cdf82c13-c30a-474a-a135-3d1dbcbb6046/console-operator/2.log"
Jun 08 11:58:59.165831 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:58:59.165745    2583 scope.go:117] "RemoveContainer" containerID="20a15aad914f5d4a3c7f2138800e3f2e03fc8fd15a55b95c5300c9f01a428f2f"
Jun 08 11:59:18.131396 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:59:18.131361    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-f8c94dc54-zw6mb"]
Jun 08 11:59:18.131754 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:59:18.131653    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d138b71b-cf95-4fb8-888c-e0ba87afd97f" containerName="console"
Jun 08 11:59:18.131754 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:59:18.131664    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d138b71b-cf95-4fb8-888c-e0ba87afd97f" containerName="console"
Jun 08 11:59:18.131754 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:59:18.131726    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="d138b71b-cf95-4fb8-888c-e0ba87afd97f" containerName="console"
Jun 08 11:59:18.135934 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:59:18.135916    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-f8c94dc54-zw6mb"
Jun 08 11:59:18.138784 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:59:18.138763    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\""
Jun 08 11:59:18.138892 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:59:18.138841    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-g8j6m\""
Jun 08 11:59:18.139651 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:59:18.139634    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\""
Jun 08 11:59:18.157794 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:59:18.157768    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-f8c94dc54-zw6mb"]
Jun 08 11:59:18.176325 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:59:18.176285    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pr8j8\" (UniqueName: \"kubernetes.io/projected/38573e22-185b-436b-92f6-dabc5a72eb65-kube-api-access-pr8j8\") pod \"feast-operator-controller-manager-f8c94dc54-zw6mb\" (UID: \"38573e22-185b-436b-92f6-dabc5a72eb65\") " pod="feast-operator-system/feast-operator-controller-manager-f8c94dc54-zw6mb"
Jun 08 11:59:18.277376 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:59:18.277329    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pr8j8\" (UniqueName: \"kubernetes.io/projected/38573e22-185b-436b-92f6-dabc5a72eb65-kube-api-access-pr8j8\") pod \"feast-operator-controller-manager-f8c94dc54-zw6mb\" (UID: \"38573e22-185b-436b-92f6-dabc5a72eb65\") " pod="feast-operator-system/feast-operator-controller-manager-f8c94dc54-zw6mb"
Jun 08 11:59:18.295438 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:59:18.295412    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pr8j8\" (UniqueName: \"kubernetes.io/projected/38573e22-185b-436b-92f6-dabc5a72eb65-kube-api-access-pr8j8\") pod \"feast-operator-controller-manager-f8c94dc54-zw6mb\" (UID: \"38573e22-185b-436b-92f6-dabc5a72eb65\") " pod="feast-operator-system/feast-operator-controller-manager-f8c94dc54-zw6mb"
Jun 08 11:59:18.446241 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:59:18.446143    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-f8c94dc54-zw6mb"
Jun 08 11:59:18.580478 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:59:18.580443    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-f8c94dc54-zw6mb"]
Jun 08 11:59:18.580833 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:59:18.580807    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38573e22_185b_436b_92f6_dabc5a72eb65.slice/crio-417b87484bd65aecee86546a9239236d5b27834e236b510abc8a473d1a21a0f0 WatchSource:0}: Error finding container 417b87484bd65aecee86546a9239236d5b27834e236b510abc8a473d1a21a0f0: Status 404 returned error can't find the container with id 417b87484bd65aecee86546a9239236d5b27834e236b510abc8a473d1a21a0f0
Jun 08 11:59:18.582860 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:59:18.582838    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 08 11:59:19.553409 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:59:19.553342    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-f8c94dc54-zw6mb" event={"ID":"38573e22-185b-436b-92f6-dabc5a72eb65","Type":"ContainerStarted","Data":"417b87484bd65aecee86546a9239236d5b27834e236b510abc8a473d1a21a0f0"}
Jun 08 11:59:21.563526 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:59:21.563491    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-f8c94dc54-zw6mb" event={"ID":"38573e22-185b-436b-92f6-dabc5a72eb65","Type":"ContainerStarted","Data":"7c63629a19f870504d890be64d900d1a2e91e9681aeafa0a436bbe25cea2c363"}
Jun 08 11:59:21.563900 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:59:21.563581    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-f8c94dc54-zw6mb"
Jun 08 11:59:21.585167 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:59:21.585123    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-f8c94dc54-zw6mb" podStartSLOduration=1.180258693 podStartE2EDuration="3.585109228s" totalImagesPullingTime="2.404850535s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 11:59:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 11:59:21.583866231 +0000 UTC m=+682.855441409" watchObservedRunningTime="2026-06-08 11:59:21.585109228 +0000 UTC m=+682.856684403"
Jun 08 11:59:32.569369 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:59:32.569336    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-f8c94dc54-zw6mb"
Jun 08 11:59:57.522810 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:59:57.522701    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7bcf5c7bb5-29rdw"]
Jun 08 11:59:57.531489 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:59:57.531464    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bcf5c7bb5-29rdw"
Jun 08 11:59:57.545036 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:59:57.545007    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bcf5c7bb5-29rdw"]
Jun 08 11:59:57.716121 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:59:57.716081    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e9bf4ba0-a132-4b07-8a41-de89849a05db-console-config\") pod \"console-7bcf5c7bb5-29rdw\" (UID: \"e9bf4ba0-a132-4b07-8a41-de89849a05db\") " pod="openshift-console/console-7bcf5c7bb5-29rdw"
Jun 08 11:59:57.716295 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:59:57.716136    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e9bf4ba0-a132-4b07-8a41-de89849a05db-service-ca\") pod \"console-7bcf5c7bb5-29rdw\" (UID: \"e9bf4ba0-a132-4b07-8a41-de89849a05db\") " pod="openshift-console/console-7bcf5c7bb5-29rdw"
Jun 08 11:59:57.716295 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:59:57.716165    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9bf4ba0-a132-4b07-8a41-de89849a05db-trusted-ca-bundle\") pod \"console-7bcf5c7bb5-29rdw\" (UID: \"e9bf4ba0-a132-4b07-8a41-de89849a05db\") " pod="openshift-console/console-7bcf5c7bb5-29rdw"
Jun 08 11:59:57.716295 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:59:57.716201    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbrk9\" (UniqueName: \"kubernetes.io/projected/e9bf4ba0-a132-4b07-8a41-de89849a05db-kube-api-access-vbrk9\") pod \"console-7bcf5c7bb5-29rdw\" (UID: \"e9bf4ba0-a132-4b07-8a41-de89849a05db\") " pod="openshift-console/console-7bcf5c7bb5-29rdw"
Jun 08 11:59:57.716295 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:59:57.716269    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9bf4ba0-a132-4b07-8a41-de89849a05db-console-serving-cert\") pod \"console-7bcf5c7bb5-29rdw\" (UID: \"e9bf4ba0-a132-4b07-8a41-de89849a05db\") " pod="openshift-console/console-7bcf5c7bb5-29rdw"
Jun 08 11:59:57.716444 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:59:57.716305    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e9bf4ba0-a132-4b07-8a41-de89849a05db-console-oauth-config\") pod \"console-7bcf5c7bb5-29rdw\" (UID: \"e9bf4ba0-a132-4b07-8a41-de89849a05db\") " pod="openshift-console/console-7bcf5c7bb5-29rdw"
Jun 08 11:59:57.716444 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:59:57.716356    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e9bf4ba0-a132-4b07-8a41-de89849a05db-oauth-serving-cert\") pod \"console-7bcf5c7bb5-29rdw\" (UID: \"e9bf4ba0-a132-4b07-8a41-de89849a05db\") " pod="openshift-console/console-7bcf5c7bb5-29rdw"
Jun 08 11:59:57.817407 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:59:57.817314    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e9bf4ba0-a132-4b07-8a41-de89849a05db-oauth-serving-cert\") pod \"console-7bcf5c7bb5-29rdw\" (UID: \"e9bf4ba0-a132-4b07-8a41-de89849a05db\") " pod="openshift-console/console-7bcf5c7bb5-29rdw"
Jun 08 11:59:57.817407 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:59:57.817357    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e9bf4ba0-a132-4b07-8a41-de89849a05db-console-config\") pod \"console-7bcf5c7bb5-29rdw\" (UID: \"e9bf4ba0-a132-4b07-8a41-de89849a05db\") " pod="openshift-console/console-7bcf5c7bb5-29rdw"
Jun 08 11:59:57.817407 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:59:57.817385    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e9bf4ba0-a132-4b07-8a41-de89849a05db-service-ca\") pod \"console-7bcf5c7bb5-29rdw\" (UID: \"e9bf4ba0-a132-4b07-8a41-de89849a05db\") " pod="openshift-console/console-7bcf5c7bb5-29rdw"
Jun 08 11:59:57.817407 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:59:57.817399    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9bf4ba0-a132-4b07-8a41-de89849a05db-trusted-ca-bundle\") pod \"console-7bcf5c7bb5-29rdw\" (UID: \"e9bf4ba0-a132-4b07-8a41-de89849a05db\") " pod="openshift-console/console-7bcf5c7bb5-29rdw"
Jun 08 11:59:57.817715 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:59:57.817430    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbrk9\" (UniqueName: \"kubernetes.io/projected/e9bf4ba0-a132-4b07-8a41-de89849a05db-kube-api-access-vbrk9\") pod \"console-7bcf5c7bb5-29rdw\" (UID: \"e9bf4ba0-a132-4b07-8a41-de89849a05db\") " pod="openshift-console/console-7bcf5c7bb5-29rdw"
Jun 08 11:59:57.817715 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:59:57.817465    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9bf4ba0-a132-4b07-8a41-de89849a05db-console-serving-cert\") pod \"console-7bcf5c7bb5-29rdw\" (UID: \"e9bf4ba0-a132-4b07-8a41-de89849a05db\") " pod="openshift-console/console-7bcf5c7bb5-29rdw"
Jun 08 11:59:57.817715 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:59:57.817494    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e9bf4ba0-a132-4b07-8a41-de89849a05db-console-oauth-config\") pod \"console-7bcf5c7bb5-29rdw\" (UID: \"e9bf4ba0-a132-4b07-8a41-de89849a05db\") " pod="openshift-console/console-7bcf5c7bb5-29rdw"
Jun 08 11:59:57.818189 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:59:57.818163    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e9bf4ba0-a132-4b07-8a41-de89849a05db-service-ca\") pod \"console-7bcf5c7bb5-29rdw\" (UID: \"e9bf4ba0-a132-4b07-8a41-de89849a05db\") " pod="openshift-console/console-7bcf5c7bb5-29rdw"
Jun 08 11:59:57.818317 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:59:57.818221    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e9bf4ba0-a132-4b07-8a41-de89849a05db-console-config\") pod \"console-7bcf5c7bb5-29rdw\" (UID: \"e9bf4ba0-a132-4b07-8a41-de89849a05db\") " pod="openshift-console/console-7bcf5c7bb5-29rdw"
Jun 08 11:59:57.818317 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:59:57.818223    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e9bf4ba0-a132-4b07-8a41-de89849a05db-oauth-serving-cert\") pod \"console-7bcf5c7bb5-29rdw\" (UID: \"e9bf4ba0-a132-4b07-8a41-de89849a05db\") " pod="openshift-console/console-7bcf5c7bb5-29rdw"
Jun 08 11:59:57.818431 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:59:57.818324    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9bf4ba0-a132-4b07-8a41-de89849a05db-trusted-ca-bundle\") pod \"console-7bcf5c7bb5-29rdw\" (UID: \"e9bf4ba0-a132-4b07-8a41-de89849a05db\") " pod="openshift-console/console-7bcf5c7bb5-29rdw"
Jun 08 11:59:57.819896 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:59:57.819873    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9bf4ba0-a132-4b07-8a41-de89849a05db-console-serving-cert\") pod \"console-7bcf5c7bb5-29rdw\" (UID: \"e9bf4ba0-a132-4b07-8a41-de89849a05db\") " pod="openshift-console/console-7bcf5c7bb5-29rdw"
Jun 08 11:59:57.820111 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:59:57.820091    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e9bf4ba0-a132-4b07-8a41-de89849a05db-console-oauth-config\") pod \"console-7bcf5c7bb5-29rdw\" (UID: \"e9bf4ba0-a132-4b07-8a41-de89849a05db\") " pod="openshift-console/console-7bcf5c7bb5-29rdw"
Jun 08 11:59:57.827497 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:59:57.827473    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbrk9\" (UniqueName: \"kubernetes.io/projected/e9bf4ba0-a132-4b07-8a41-de89849a05db-kube-api-access-vbrk9\") pod \"console-7bcf5c7bb5-29rdw\" (UID: \"e9bf4ba0-a132-4b07-8a41-de89849a05db\") " pod="openshift-console/console-7bcf5c7bb5-29rdw"
Jun 08 11:59:57.841385 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:59:57.841362    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bcf5c7bb5-29rdw"
Jun 08 11:59:57.975327 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:59:57.975289    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bcf5c7bb5-29rdw"]
Jun 08 11:59:57.979461 ip-10-0-136-189 kubenswrapper[2583]: W0608 11:59:57.979428    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9bf4ba0_a132_4b07_8a41_de89849a05db.slice/crio-c7289b42a5339bd6774717ee7e1b4be82b7c925bc4da7c967f42ebc2fca39b37 WatchSource:0}: Error finding container c7289b42a5339bd6774717ee7e1b4be82b7c925bc4da7c967f42ebc2fca39b37: Status 404 returned error can't find the container with id c7289b42a5339bd6774717ee7e1b4be82b7c925bc4da7c967f42ebc2fca39b37
Jun 08 11:59:58.707294 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:59:58.707253    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bcf5c7bb5-29rdw" event={"ID":"e9bf4ba0-a132-4b07-8a41-de89849a05db","Type":"ContainerStarted","Data":"3841fa772e2dae21e3edf07de78dc7be722d4240cdc4b3715911ae391b9df5fc"}
Jun 08 11:59:58.707679 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:59:58.707310    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bcf5c7bb5-29rdw" event={"ID":"e9bf4ba0-a132-4b07-8a41-de89849a05db","Type":"ContainerStarted","Data":"c7289b42a5339bd6774717ee7e1b4be82b7c925bc4da7c967f42ebc2fca39b37"}
Jun 08 11:59:58.729173 ip-10-0-136-189 kubenswrapper[2583]: I0608 11:59:58.729127    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7bcf5c7bb5-29rdw" podStartSLOduration=1.7291131690000001 podStartE2EDuration="1.729113169s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 11:59:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 11:59:58.728101184 +0000 UTC m=+719.999676371" watchObservedRunningTime="2026-06-08 11:59:58.729113169 +0000 UTC m=+720.000688344"
Jun 08 12:00:01.268493 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:01.268448    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h"]
Jun 08 12:00:01.273229 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:01.273209    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h"
Jun 08 12:00:01.276274 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:01.275897    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
Jun 08 12:00:01.276274 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:01.275958    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Jun 08 12:00:01.276274 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:01.275968    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-q5bw6\""
Jun 08 12:00:01.276274 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:01.275899    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
Jun 08 12:00:01.276274 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:01.276162    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
Jun 08 12:00:01.276564 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:01.276314    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Jun 08 12:00:01.276564 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:01.276341    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
Jun 08 12:00:01.276564 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:01.276498    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\""
Jun 08 12:00:01.288290 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:01.288265    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h"]
Jun 08 12:00:01.344923 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:01.344892    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/01bd2399-e54f-49b7-8c2b-295f097cd98c-registry-tls\") pod \"feast-simple-feast-setup-658bf58f5b-dst8h\" (UID: \"01bd2399-e54f-49b7-8c2b-295f097cd98c\") " pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h"
Jun 08 12:00:01.344923 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:01.344923    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/01bd2399-e54f-49b7-8c2b-295f097cd98c-offline-tls\") pod \"feast-simple-feast-setup-658bf58f5b-dst8h\" (UID: \"01bd2399-e54f-49b7-8c2b-295f097cd98c\") " pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h"
Jun 08 12:00:01.345183 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:01.344939    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/01bd2399-e54f-49b7-8c2b-295f097cd98c-ui-tls\") pod \"feast-simple-feast-setup-658bf58f5b-dst8h\" (UID: \"01bd2399-e54f-49b7-8c2b-295f097cd98c\") " pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h"
Jun 08 12:00:01.345183 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:01.344998    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/01bd2399-e54f-49b7-8c2b-295f097cd98c-online-tls\") pod \"feast-simple-feast-setup-658bf58f5b-dst8h\" (UID: \"01bd2399-e54f-49b7-8c2b-295f097cd98c\") " pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h"
Jun 08 12:00:01.345183 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:01.345065    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lx6ql\" (UniqueName: \"kubernetes.io/projected/01bd2399-e54f-49b7-8c2b-295f097cd98c-kube-api-access-lx6ql\") pod \"feast-simple-feast-setup-658bf58f5b-dst8h\" (UID: \"01bd2399-e54f-49b7-8c2b-295f097cd98c\") " pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h"
Jun 08 12:00:01.345183 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:01.345122    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/01bd2399-e54f-49b7-8c2b-295f097cd98c-feast-data\") pod \"feast-simple-feast-setup-658bf58f5b-dst8h\" (UID: \"01bd2399-e54f-49b7-8c2b-295f097cd98c\") " pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h"
Jun 08 12:00:01.445914 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:01.445876    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/01bd2399-e54f-49b7-8c2b-295f097cd98c-registry-tls\") pod \"feast-simple-feast-setup-658bf58f5b-dst8h\" (UID: \"01bd2399-e54f-49b7-8c2b-295f097cd98c\") " pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h"
Jun 08 12:00:01.446118 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:01.445925    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/01bd2399-e54f-49b7-8c2b-295f097cd98c-offline-tls\") pod \"feast-simple-feast-setup-658bf58f5b-dst8h\" (UID: \"01bd2399-e54f-49b7-8c2b-295f097cd98c\") " pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h"
Jun 08 12:00:01.446118 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:01.445954    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/01bd2399-e54f-49b7-8c2b-295f097cd98c-ui-tls\") pod \"feast-simple-feast-setup-658bf58f5b-dst8h\" (UID: \"01bd2399-e54f-49b7-8c2b-295f097cd98c\") " pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h"
Jun 08 12:00:01.446118 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:01.445995    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/01bd2399-e54f-49b7-8c2b-295f097cd98c-online-tls\") pod \"feast-simple-feast-setup-658bf58f5b-dst8h\" (UID: \"01bd2399-e54f-49b7-8c2b-295f097cd98c\") " pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h"
Jun 08 12:00:01.446118 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:00:01.446035    2583 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
Jun 08 12:00:01.446118 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:00:01.446091    2583 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found
Jun 08 12:00:01.446395 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:01.446037    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lx6ql\" (UniqueName: \"kubernetes.io/projected/01bd2399-e54f-49b7-8c2b-295f097cd98c-kube-api-access-lx6ql\") pod \"feast-simple-feast-setup-658bf58f5b-dst8h\" (UID: \"01bd2399-e54f-49b7-8c2b-295f097cd98c\") " pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h"
Jun 08 12:00:01.446395 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:00:01.446138    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01bd2399-e54f-49b7-8c2b-295f097cd98c-registry-tls podName:01bd2399-e54f-49b7-8c2b-295f097cd98c nodeName:}" failed. No retries permitted until 2026-06-08 12:00:01.9461146 +0000 UTC m=+723.217689762 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/01bd2399-e54f-49b7-8c2b-295f097cd98c-registry-tls") pod "feast-simple-feast-setup-658bf58f5b-dst8h" (UID: "01bd2399-e54f-49b7-8c2b-295f097cd98c") : secret "feast-simple-feast-setup-registry-tls" not found
Jun 08 12:00:01.446395 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:00:01.446190    2583 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
Jun 08 12:00:01.446395 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:00:01.446259    2583 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
Jun 08 12:00:01.446395 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:00:01.446302    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01bd2399-e54f-49b7-8c2b-295f097cd98c-offline-tls podName:01bd2399-e54f-49b7-8c2b-295f097cd98c nodeName:}" failed. No retries permitted until 2026-06-08 12:00:01.946285533 +0000 UTC m=+723.217860702 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/01bd2399-e54f-49b7-8c2b-295f097cd98c-offline-tls") pod "feast-simple-feast-setup-658bf58f5b-dst8h" (UID: "01bd2399-e54f-49b7-8c2b-295f097cd98c") : secret "feast-simple-feast-setup-offline-tls" not found
Jun 08 12:00:01.446395 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:00:01.446321    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01bd2399-e54f-49b7-8c2b-295f097cd98c-ui-tls podName:01bd2399-e54f-49b7-8c2b-295f097cd98c nodeName:}" failed. No retries permitted until 2026-06-08 12:00:01.946311443 +0000 UTC m=+723.217886597 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/01bd2399-e54f-49b7-8c2b-295f097cd98c-ui-tls") pod "feast-simple-feast-setup-658bf58f5b-dst8h" (UID: "01bd2399-e54f-49b7-8c2b-295f097cd98c") : secret "feast-simple-feast-setup-ui-tls" not found
Jun 08 12:00:01.446395 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:00:01.446339    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01bd2399-e54f-49b7-8c2b-295f097cd98c-online-tls podName:01bd2399-e54f-49b7-8c2b-295f097cd98c nodeName:}" failed. No retries permitted until 2026-06-08 12:00:01.946329206 +0000 UTC m=+723.217904363 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/01bd2399-e54f-49b7-8c2b-295f097cd98c-online-tls") pod "feast-simple-feast-setup-658bf58f5b-dst8h" (UID: "01bd2399-e54f-49b7-8c2b-295f097cd98c") : secret "feast-simple-feast-setup-online-tls" not found
Jun 08 12:00:01.446689 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:01.446428    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/01bd2399-e54f-49b7-8c2b-295f097cd98c-feast-data\") pod \"feast-simple-feast-setup-658bf58f5b-dst8h\" (UID: \"01bd2399-e54f-49b7-8c2b-295f097cd98c\") " pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h"
Jun 08 12:00:01.446898 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:01.446877    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/01bd2399-e54f-49b7-8c2b-295f097cd98c-feast-data\") pod \"feast-simple-feast-setup-658bf58f5b-dst8h\" (UID: \"01bd2399-e54f-49b7-8c2b-295f097cd98c\") " pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h"
Jun 08 12:00:01.455586 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:01.455561    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lx6ql\" (UniqueName: \"kubernetes.io/projected/01bd2399-e54f-49b7-8c2b-295f097cd98c-kube-api-access-lx6ql\") pod \"feast-simple-feast-setup-658bf58f5b-dst8h\" (UID: \"01bd2399-e54f-49b7-8c2b-295f097cd98c\") " pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h"
Jun 08 12:00:01.951992 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:01.951950    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/01bd2399-e54f-49b7-8c2b-295f097cd98c-registry-tls\") pod \"feast-simple-feast-setup-658bf58f5b-dst8h\" (UID: \"01bd2399-e54f-49b7-8c2b-295f097cd98c\") " pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h"
Jun 08 12:00:01.952200 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:01.952000    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/01bd2399-e54f-49b7-8c2b-295f097cd98c-offline-tls\") pod \"feast-simple-feast-setup-658bf58f5b-dst8h\" (UID: \"01bd2399-e54f-49b7-8c2b-295f097cd98c\") " pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h"
Jun 08 12:00:01.952200 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:01.952027    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/01bd2399-e54f-49b7-8c2b-295f097cd98c-ui-tls\") pod \"feast-simple-feast-setup-658bf58f5b-dst8h\" (UID: \"01bd2399-e54f-49b7-8c2b-295f097cd98c\") " pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h"
Jun 08 12:00:01.952323 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:01.952196    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/01bd2399-e54f-49b7-8c2b-295f097cd98c-online-tls\") pod \"feast-simple-feast-setup-658bf58f5b-dst8h\" (UID: \"01bd2399-e54f-49b7-8c2b-295f097cd98c\") " pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h"
Jun 08 12:00:01.955105 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:01.955079    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/01bd2399-e54f-49b7-8c2b-295f097cd98c-registry-tls\") pod \"feast-simple-feast-setup-658bf58f5b-dst8h\" (UID: \"01bd2399-e54f-49b7-8c2b-295f097cd98c\") " pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h"
Jun 08 12:00:01.955224 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:01.955209    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/01bd2399-e54f-49b7-8c2b-295f097cd98c-offline-tls\") pod \"feast-simple-feast-setup-658bf58f5b-dst8h\" (UID: \"01bd2399-e54f-49b7-8c2b-295f097cd98c\") " pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h"
Jun 08 12:00:01.955270 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:01.955219    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/01bd2399-e54f-49b7-8c2b-295f097cd98c-online-tls\") pod \"feast-simple-feast-setup-658bf58f5b-dst8h\" (UID: \"01bd2399-e54f-49b7-8c2b-295f097cd98c\") " pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h"
Jun 08 12:00:01.955323 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:01.955303    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/01bd2399-e54f-49b7-8c2b-295f097cd98c-ui-tls\") pod \"feast-simple-feast-setup-658bf58f5b-dst8h\" (UID: \"01bd2399-e54f-49b7-8c2b-295f097cd98c\") " pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h"
Jun 08 12:00:02.192712 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:02.192676    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h"
Jun 08 12:00:02.329340 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:02.329309    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h"]
Jun 08 12:00:02.330110 ip-10-0-136-189 kubenswrapper[2583]: W0608 12:00:02.330081    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod01bd2399_e54f_49b7_8c2b_295f097cd98c.slice/crio-7612358ddbbe53d282c9a1dbaf8b51b55e5bcbf7dc7d3151feae29bdedf6eac6 WatchSource:0}: Error finding container 7612358ddbbe53d282c9a1dbaf8b51b55e5bcbf7dc7d3151feae29bdedf6eac6: Status 404 returned error can't find the container with id 7612358ddbbe53d282c9a1dbaf8b51b55e5bcbf7dc7d3151feae29bdedf6eac6
Jun 08 12:00:02.724020 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:02.723975    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h" event={"ID":"01bd2399-e54f-49b7-8c2b-295f097cd98c","Type":"ContainerStarted","Data":"7612358ddbbe53d282c9a1dbaf8b51b55e5bcbf7dc7d3151feae29bdedf6eac6"}
Jun 08 12:00:07.841986 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:07.841946    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7bcf5c7bb5-29rdw"
Jun 08 12:00:07.842540 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:07.842012    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7bcf5c7bb5-29rdw"
Jun 08 12:00:07.847382 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:07.847356    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7bcf5c7bb5-29rdw"
Jun 08 12:00:08.755592 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:08.755561    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7bcf5c7bb5-29rdw"
Jun 08 12:00:08.800341 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:08.800310    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76f5858998-ftz2h"]
Jun 08 12:00:33.823188 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:33.823136    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-76f5858998-ftz2h" podUID="16ec8664-c53a-4c53-97d2-250e66766b98" containerName="console" containerID="cri-o://5f51bd7ac954e43ce677b514fe6505cb79fee95975625b446db9622ebd482392" gracePeriod=15
Jun 08 12:00:33.861730 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:33.861693    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h" event={"ID":"01bd2399-e54f-49b7-8c2b-295f097cd98c","Type":"ContainerStarted","Data":"00129e887792dcb0be5bc7d9a21d8c6b8456a5cbd1432941dea887dd02ae7cd5"}
Jun 08 12:00:34.068622 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:34.068594    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76f5858998-ftz2h"
Jun 08 12:00:34.250520 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:34.250479    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/16ec8664-c53a-4c53-97d2-250e66766b98-console-oauth-config\") pod \"16ec8664-c53a-4c53-97d2-250e66766b98\" (UID: \"16ec8664-c53a-4c53-97d2-250e66766b98\") "
Jun 08 12:00:34.250729 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:34.250583    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16ec8664-c53a-4c53-97d2-250e66766b98-trusted-ca-bundle\") pod \"16ec8664-c53a-4c53-97d2-250e66766b98\" (UID: \"16ec8664-c53a-4c53-97d2-250e66766b98\") "
Jun 08 12:00:34.250729 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:34.250608    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/16ec8664-c53a-4c53-97d2-250e66766b98-console-config\") pod \"16ec8664-c53a-4c53-97d2-250e66766b98\" (UID: \"16ec8664-c53a-4c53-97d2-250e66766b98\") "
Jun 08 12:00:34.250729 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:34.250633    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/16ec8664-c53a-4c53-97d2-250e66766b98-console-serving-cert\") pod \"16ec8664-c53a-4c53-97d2-250e66766b98\" (UID: \"16ec8664-c53a-4c53-97d2-250e66766b98\") "
Jun 08 12:00:34.250729 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:34.250694    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vkcmm\" (UniqueName: \"kubernetes.io/projected/16ec8664-c53a-4c53-97d2-250e66766b98-kube-api-access-vkcmm\") pod \"16ec8664-c53a-4c53-97d2-250e66766b98\" (UID: \"16ec8664-c53a-4c53-97d2-250e66766b98\") "
Jun 08 12:00:34.250940 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:34.250737    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/16ec8664-c53a-4c53-97d2-250e66766b98-service-ca\") pod \"16ec8664-c53a-4c53-97d2-250e66766b98\" (UID: \"16ec8664-c53a-4c53-97d2-250e66766b98\") "
Jun 08 12:00:34.250940 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:34.250763    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/16ec8664-c53a-4c53-97d2-250e66766b98-oauth-serving-cert\") pod \"16ec8664-c53a-4c53-97d2-250e66766b98\" (UID: \"16ec8664-c53a-4c53-97d2-250e66766b98\") "
Jun 08 12:00:34.251073 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:34.251003    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16ec8664-c53a-4c53-97d2-250e66766b98-console-config" (OuterVolumeSpecName: "console-config") pod "16ec8664-c53a-4c53-97d2-250e66766b98" (UID: "16ec8664-c53a-4c53-97d2-250e66766b98"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 08 12:00:34.251152 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:34.251042    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16ec8664-c53a-4c53-97d2-250e66766b98-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "16ec8664-c53a-4c53-97d2-250e66766b98" (UID: "16ec8664-c53a-4c53-97d2-250e66766b98"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 08 12:00:34.251329 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:34.251301    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16ec8664-c53a-4c53-97d2-250e66766b98-service-ca" (OuterVolumeSpecName: "service-ca") pod "16ec8664-c53a-4c53-97d2-250e66766b98" (UID: "16ec8664-c53a-4c53-97d2-250e66766b98"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 08 12:00:34.251454 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:34.251328    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16ec8664-c53a-4c53-97d2-250e66766b98-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "16ec8664-c53a-4c53-97d2-250e66766b98" (UID: "16ec8664-c53a-4c53-97d2-250e66766b98"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 08 12:00:34.252688 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:34.252665    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16ec8664-c53a-4c53-97d2-250e66766b98-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "16ec8664-c53a-4c53-97d2-250e66766b98" (UID: "16ec8664-c53a-4c53-97d2-250e66766b98"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 08 12:00:34.252822 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:34.252800    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16ec8664-c53a-4c53-97d2-250e66766b98-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "16ec8664-c53a-4c53-97d2-250e66766b98" (UID: "16ec8664-c53a-4c53-97d2-250e66766b98"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 08 12:00:34.252907 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:34.252889    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16ec8664-c53a-4c53-97d2-250e66766b98-kube-api-access-vkcmm" (OuterVolumeSpecName: "kube-api-access-vkcmm") pod "16ec8664-c53a-4c53-97d2-250e66766b98" (UID: "16ec8664-c53a-4c53-97d2-250e66766b98"). InnerVolumeSpecName "kube-api-access-vkcmm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 08 12:00:34.351768 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:34.351731    2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/16ec8664-c53a-4c53-97d2-250e66766b98-service-ca\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:00:34.351768 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:34.351758    2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/16ec8664-c53a-4c53-97d2-250e66766b98-oauth-serving-cert\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:00:34.351768 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:34.351768    2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/16ec8664-c53a-4c53-97d2-250e66766b98-console-oauth-config\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:00:34.351768 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:34.351776    2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16ec8664-c53a-4c53-97d2-250e66766b98-trusted-ca-bundle\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:00:34.352144 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:34.351785    2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/16ec8664-c53a-4c53-97d2-250e66766b98-console-config\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:00:34.352144 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:34.351793    2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/16ec8664-c53a-4c53-97d2-250e66766b98-console-serving-cert\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:00:34.352144 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:34.351802    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vkcmm\" (UniqueName: \"kubernetes.io/projected/16ec8664-c53a-4c53-97d2-250e66766b98-kube-api-access-vkcmm\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:00:34.867779 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:34.867738    2583 generic.go:356] "Generic (PLEG): container finished" podID="16ec8664-c53a-4c53-97d2-250e66766b98" containerID="5f51bd7ac954e43ce677b514fe6505cb79fee95975625b446db9622ebd482392" exitCode=0
Jun 08 12:00:34.868232 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:34.867798    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76f5858998-ftz2h"
Jun 08 12:00:34.868232 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:34.867808    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76f5858998-ftz2h" event={"ID":"16ec8664-c53a-4c53-97d2-250e66766b98","Type":"ContainerDied","Data":"5f51bd7ac954e43ce677b514fe6505cb79fee95975625b446db9622ebd482392"}
Jun 08 12:00:34.868232 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:34.867861    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76f5858998-ftz2h" event={"ID":"16ec8664-c53a-4c53-97d2-250e66766b98","Type":"ContainerDied","Data":"2328d04b4428da3fb7b736364b0363ee0d661f648a8cb738b3c2651c1f82d0c0"}
Jun 08 12:00:34.868232 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:34.867884    2583 scope.go:117] "RemoveContainer" containerID="5f51bd7ac954e43ce677b514fe6505cb79fee95975625b446db9622ebd482392"
Jun 08 12:00:34.876481 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:34.876463    2583 scope.go:117] "RemoveContainer" containerID="5f51bd7ac954e43ce677b514fe6505cb79fee95975625b446db9622ebd482392"
Jun 08 12:00:34.876756 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:00:34.876738    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f51bd7ac954e43ce677b514fe6505cb79fee95975625b446db9622ebd482392\": container with ID starting with 5f51bd7ac954e43ce677b514fe6505cb79fee95975625b446db9622ebd482392 not found: ID does not exist" containerID="5f51bd7ac954e43ce677b514fe6505cb79fee95975625b446db9622ebd482392"
Jun 08 12:00:34.876807 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:34.876764    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f51bd7ac954e43ce677b514fe6505cb79fee95975625b446db9622ebd482392"} err="failed to get container status \"5f51bd7ac954e43ce677b514fe6505cb79fee95975625b446db9622ebd482392\": rpc error: code = NotFound desc = could not find container \"5f51bd7ac954e43ce677b514fe6505cb79fee95975625b446db9622ebd482392\": container with ID starting with 5f51bd7ac954e43ce677b514fe6505cb79fee95975625b446db9622ebd482392 not found: ID does not exist"
Jun 08 12:00:34.891150 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:34.891120    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76f5858998-ftz2h"]
Jun 08 12:00:34.895521 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:34.895501    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-76f5858998-ftz2h"]
Jun 08 12:00:35.186621 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:35.186545    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16ec8664-c53a-4c53-97d2-250e66766b98" path="/var/lib/kubelet/pods/16ec8664-c53a-4c53-97d2-250e66766b98/volumes"
Jun 08 12:00:37.881489 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:37.881453    2583 generic.go:356] "Generic (PLEG): container finished" podID="01bd2399-e54f-49b7-8c2b-295f097cd98c" containerID="00129e887792dcb0be5bc7d9a21d8c6b8456a5cbd1432941dea887dd02ae7cd5" exitCode=0
Jun 08 12:00:37.881862 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:37.881498    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h" event={"ID":"01bd2399-e54f-49b7-8c2b-295f097cd98c","Type":"ContainerDied","Data":"00129e887792dcb0be5bc7d9a21d8c6b8456a5cbd1432941dea887dd02ae7cd5"}
Jun 08 12:00:38.888829 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:38.888787    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h" event={"ID":"01bd2399-e54f-49b7-8c2b-295f097cd98c","Type":"ContainerStarted","Data":"b84893546258d4592bb1311d8e2938eb61c9bba7a1c8655741ee7cc7ef17f846"}
Jun 08 12:00:43.910833 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:43.910795    2583 generic.go:356] "Generic (PLEG): container finished" podID="01bd2399-e54f-49b7-8c2b-295f097cd98c" containerID="b84893546258d4592bb1311d8e2938eb61c9bba7a1c8655741ee7cc7ef17f846" exitCode=0
Jun 08 12:00:43.911235 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:43.910866    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h" event={"ID":"01bd2399-e54f-49b7-8c2b-295f097cd98c","Type":"ContainerDied","Data":"b84893546258d4592bb1311d8e2938eb61c9bba7a1c8655741ee7cc7ef17f846"}
Jun 08 12:00:44.921023 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:44.920981    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h" event={"ID":"01bd2399-e54f-49b7-8c2b-295f097cd98c","Type":"ContainerStarted","Data":"24b45931a217c10fcde2d79e9440ec0839edb7db915978d776c47da65fdacbf5"}
Jun 08 12:00:44.921700 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:44.921041    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h" event={"ID":"01bd2399-e54f-49b7-8c2b-295f097cd98c","Type":"ContainerStarted","Data":"21d46c9d2fdbf5d4f89a1b49b3ddc3ac48cfbb6dcf71cdea1dabfe17b2a7fc04"}
Jun 08 12:00:44.921700 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:44.921092    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h" event={"ID":"01bd2399-e54f-49b7-8c2b-295f097cd98c","Type":"ContainerStarted","Data":"68435236229b18c96f3c68f153c8bee74ab8b11d265994934c55e6357d5ef95f"}
Jun 08 12:00:44.921700 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:44.921110    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h" event={"ID":"01bd2399-e54f-49b7-8c2b-295f097cd98c","Type":"ContainerStarted","Data":"9ffcaf398a15055cc093b1ce6d7e976f2c78f8fdf5c861831c1ccdbe435dc6b4"}
Jun 08 12:00:44.945999 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:44.945921    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h" podStartSLOduration=13.429704726 podStartE2EDuration="43.945898515s" totalImagesPullingTime="30.516193789s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:00:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:00:44.944392295 +0000 UTC m=+766.215967490" watchObservedRunningTime="2026-06-08 12:00:44.945898515 +0000 UTC m=+766.217473696"
Jun 08 12:00:47.193999 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:47.193850    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h"
Jun 08 12:00:47.193999 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:47.193906    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h"
Jun 08 12:00:47.193999 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:47.193924    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h"
Jun 08 12:00:47.193999 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:47.193941    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h"
Jun 08 12:00:47.195861 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:47.195824    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h" podUID="01bd2399-e54f-49b7-8c2b-295f097cd98c" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.27:8443: connect: connection refused"
Jun 08 12:00:47.196110 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:47.195830    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h" podUID="01bd2399-e54f-49b7-8c2b-295f097cd98c" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.27:6571: connect: connection refused"
Jun 08 12:00:47.196201 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:47.195846    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h" podUID="01bd2399-e54f-49b7-8c2b-295f097cd98c" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.27:8816: connect: connection refused"
Jun 08 12:00:47.196201 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:47.195921    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h" podUID="01bd2399-e54f-49b7-8c2b-295f097cd98c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused"
Jun 08 12:00:50.194222 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:50.194187    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h"
Jun 08 12:00:50.194715 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:50.194482    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h"
Jun 08 12:00:50.194715 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:50.194600    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h"
Jun 08 12:00:50.194996 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:50.194973    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h"
Jun 08 12:00:50.195165 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:50.195040    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h"
Jun 08 12:00:50.195165 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:50.195095    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h"
Jun 08 12:00:50.195245 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:50.195198    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h"
Jun 08 12:00:50.195285 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:50.195263    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h"
Jun 08 12:00:50.195450 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:50.195432    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h"
Jun 08 12:00:50.198885 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:50.198870    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h"
Jun 08 12:00:50.954308 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:50.954276    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h"
Jun 08 12:00:50.957188 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:00:50.957168    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h"
Jun 08 12:01:52.488566 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:01:52.488532    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h"]
Jun 08 12:01:52.489070 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:01:52.488765    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h" podUID="01bd2399-e54f-49b7-8c2b-295f097cd98c" containerName="registry" containerID="cri-o://9ffcaf398a15055cc093b1ce6d7e976f2c78f8fdf5c861831c1ccdbe435dc6b4" gracePeriod=30
Jun 08 12:01:52.489070 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:01:52.488965    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h" podUID="01bd2399-e54f-49b7-8c2b-295f097cd98c" containerName="online" containerID="cri-o://68435236229b18c96f3c68f153c8bee74ab8b11d265994934c55e6357d5ef95f" gracePeriod=30
Jun 08 12:01:52.489070 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:01:52.489004    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h" podUID="01bd2399-e54f-49b7-8c2b-295f097cd98c" containerName="ui" containerID="cri-o://24b45931a217c10fcde2d79e9440ec0839edb7db915978d776c47da65fdacbf5" gracePeriod=30
Jun 08 12:01:52.489263 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:01:52.489169    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h" podUID="01bd2399-e54f-49b7-8c2b-295f097cd98c" containerName="offline" containerID="cri-o://21d46c9d2fdbf5d4f89a1b49b3ddc3ac48cfbb6dcf71cdea1dabfe17b2a7fc04" gracePeriod=30
Jun 08 12:01:52.813231 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:01:52.813138    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9"]
Jun 08 12:01:52.813934 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:01:52.813904    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16ec8664-c53a-4c53-97d2-250e66766b98" containerName="console"
Jun 08 12:01:52.814091 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:01:52.814079    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="16ec8664-c53a-4c53-97d2-250e66766b98" containerName="console"
Jun 08 12:01:52.814344 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:01:52.814327    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="16ec8664-c53a-4c53-97d2-250e66766b98" containerName="console"
Jun 08 12:01:52.826309 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:01:52.826283    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9"
Jun 08 12:01:52.831584 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:01:52.830581    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-xvhvk\""
Jun 08 12:01:52.832653 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:01:52.832630    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9"]
Jun 08 12:01:52.923790 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:01:52.923752    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/509bdef3-f716-43da-bd88-30046c3006fd-ui-tls\") pod \"feast-simple-feast-setup-658bf58f5b-fnch9\" (UID: \"509bdef3-f716-43da-bd88-30046c3006fd\") " pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9"
Jun 08 12:01:52.923978 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:01:52.923837    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/509bdef3-f716-43da-bd88-30046c3006fd-registry-tls\") pod \"feast-simple-feast-setup-658bf58f5b-fnch9\" (UID: \"509bdef3-f716-43da-bd88-30046c3006fd\") " pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9"
Jun 08 12:01:52.923978 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:01:52.923865    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dq4hj\" (UniqueName: \"kubernetes.io/projected/509bdef3-f716-43da-bd88-30046c3006fd-kube-api-access-dq4hj\") pod \"feast-simple-feast-setup-658bf58f5b-fnch9\" (UID: \"509bdef3-f716-43da-bd88-30046c3006fd\") " pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9"
Jun 08 12:01:52.923978 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:01:52.923895    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/509bdef3-f716-43da-bd88-30046c3006fd-offline-tls\") pod \"feast-simple-feast-setup-658bf58f5b-fnch9\" (UID: \"509bdef3-f716-43da-bd88-30046c3006fd\") " pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9"
Jun 08 12:01:52.923978 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:01:52.923925    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/509bdef3-f716-43da-bd88-30046c3006fd-online-tls\") pod \"feast-simple-feast-setup-658bf58f5b-fnch9\" (UID: \"509bdef3-f716-43da-bd88-30046c3006fd\") " pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9"
Jun 08 12:01:52.923978 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:01:52.923964    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/509bdef3-f716-43da-bd88-30046c3006fd-feast-data\") pod \"feast-simple-feast-setup-658bf58f5b-fnch9\" (UID: \"509bdef3-f716-43da-bd88-30046c3006fd\") " pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9"
Jun 08 12:01:53.025285 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:01:53.025250    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/509bdef3-f716-43da-bd88-30046c3006fd-feast-data\") pod \"feast-simple-feast-setup-658bf58f5b-fnch9\" (UID: \"509bdef3-f716-43da-bd88-30046c3006fd\") " pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9"
Jun 08 12:01:53.025285 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:01:53.025298    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/509bdef3-f716-43da-bd88-30046c3006fd-ui-tls\") pod \"feast-simple-feast-setup-658bf58f5b-fnch9\" (UID: \"509bdef3-f716-43da-bd88-30046c3006fd\") " pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9"
Jun 08 12:01:53.025533 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:01:53.025375    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/509bdef3-f716-43da-bd88-30046c3006fd-registry-tls\") pod \"feast-simple-feast-setup-658bf58f5b-fnch9\" (UID: \"509bdef3-f716-43da-bd88-30046c3006fd\") " pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9"
Jun 08 12:01:53.025533 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:01:53.025403    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq4hj\" (UniqueName: \"kubernetes.io/projected/509bdef3-f716-43da-bd88-30046c3006fd-kube-api-access-dq4hj\") pod \"feast-simple-feast-setup-658bf58f5b-fnch9\" (UID: \"509bdef3-f716-43da-bd88-30046c3006fd\") " pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9"
Jun 08 12:01:53.025533 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:01:53.025440    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/509bdef3-f716-43da-bd88-30046c3006fd-offline-tls\") pod \"feast-simple-feast-setup-658bf58f5b-fnch9\" (UID: \"509bdef3-f716-43da-bd88-30046c3006fd\") " pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9"
Jun 08 12:01:53.025533 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:01:53.025470    2583 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
Jun 08 12:01:53.025533 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:01:53.025535    2583 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found
Jun 08 12:01:53.025768 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:01:53.025545    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/509bdef3-f716-43da-bd88-30046c3006fd-ui-tls podName:509bdef3-f716-43da-bd88-30046c3006fd nodeName:}" failed. No retries permitted until 2026-06-08 12:01:53.525523279 +0000 UTC m=+834.797098444 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/509bdef3-f716-43da-bd88-30046c3006fd-ui-tls") pod "feast-simple-feast-setup-658bf58f5b-fnch9" (UID: "509bdef3-f716-43da-bd88-30046c3006fd") : secret "feast-simple-feast-setup-ui-tls" not found
Jun 08 12:01:53.025768 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:01:53.025570    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/509bdef3-f716-43da-bd88-30046c3006fd-online-tls\") pod \"feast-simple-feast-setup-658bf58f5b-fnch9\" (UID: \"509bdef3-f716-43da-bd88-30046c3006fd\") " pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9"
Jun 08 12:01:53.025768 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:01:53.025585    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/509bdef3-f716-43da-bd88-30046c3006fd-offline-tls podName:509bdef3-f716-43da-bd88-30046c3006fd nodeName:}" failed. No retries permitted until 2026-06-08 12:01:53.52556746 +0000 UTC m=+834.797142618 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/509bdef3-f716-43da-bd88-30046c3006fd-offline-tls") pod "feast-simple-feast-setup-658bf58f5b-fnch9" (UID: "509bdef3-f716-43da-bd88-30046c3006fd") : secret "feast-simple-feast-setup-offline-tls" not found
Jun 08 12:01:53.025768 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:01:53.025536    2583 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
Jun 08 12:01:53.025768 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:01:53.025651    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/509bdef3-f716-43da-bd88-30046c3006fd-registry-tls podName:509bdef3-f716-43da-bd88-30046c3006fd nodeName:}" failed. No retries permitted until 2026-06-08 12:01:53.52564251 +0000 UTC m=+834.797217673 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/509bdef3-f716-43da-bd88-30046c3006fd-registry-tls") pod "feast-simple-feast-setup-658bf58f5b-fnch9" (UID: "509bdef3-f716-43da-bd88-30046c3006fd") : secret "feast-simple-feast-setup-registry-tls" not found
Jun 08 12:01:53.025768 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:01:53.025666    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/509bdef3-f716-43da-bd88-30046c3006fd-feast-data\") pod \"feast-simple-feast-setup-658bf58f5b-fnch9\" (UID: \"509bdef3-f716-43da-bd88-30046c3006fd\") " pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9"
Jun 08 12:01:53.028114 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:01:53.028083    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/509bdef3-f716-43da-bd88-30046c3006fd-online-tls\") pod \"feast-simple-feast-setup-658bf58f5b-fnch9\" (UID: \"509bdef3-f716-43da-bd88-30046c3006fd\") " pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9"
Jun 08 12:01:53.036456 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:01:53.036429    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dq4hj\" (UniqueName: \"kubernetes.io/projected/509bdef3-f716-43da-bd88-30046c3006fd-kube-api-access-dq4hj\") pod \"feast-simple-feast-setup-658bf58f5b-fnch9\" (UID: \"509bdef3-f716-43da-bd88-30046c3006fd\") " pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9"
Jun 08 12:01:53.207162 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:01:53.207134    2583 generic.go:356] "Generic (PLEG): container finished" podID="01bd2399-e54f-49b7-8c2b-295f097cd98c" containerID="24b45931a217c10fcde2d79e9440ec0839edb7db915978d776c47da65fdacbf5" exitCode=0
Jun 08 12:01:53.207162 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:01:53.207158    2583 generic.go:356] "Generic (PLEG): container finished" podID="01bd2399-e54f-49b7-8c2b-295f097cd98c" containerID="68435236229b18c96f3c68f153c8bee74ab8b11d265994934c55e6357d5ef95f" exitCode=0
Jun 08 12:01:53.207310 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:01:53.207190    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h" event={"ID":"01bd2399-e54f-49b7-8c2b-295f097cd98c","Type":"ContainerDied","Data":"24b45931a217c10fcde2d79e9440ec0839edb7db915978d776c47da65fdacbf5"}
Jun 08 12:01:53.207310 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:01:53.207218    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h" event={"ID":"01bd2399-e54f-49b7-8c2b-295f097cd98c","Type":"ContainerDied","Data":"68435236229b18c96f3c68f153c8bee74ab8b11d265994934c55e6357d5ef95f"}
Jun 08 12:01:53.531489 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:01:53.531417    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/509bdef3-f716-43da-bd88-30046c3006fd-registry-tls\") pod \"feast-simple-feast-setup-658bf58f5b-fnch9\" (UID: \"509bdef3-f716-43da-bd88-30046c3006fd\") " pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9"
Jun 08 12:01:53.531489 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:01:53.531458    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/509bdef3-f716-43da-bd88-30046c3006fd-offline-tls\") pod \"feast-simple-feast-setup-658bf58f5b-fnch9\" (UID: \"509bdef3-f716-43da-bd88-30046c3006fd\") " pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9"
Jun 08 12:01:53.531905 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:01:53.531493    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/509bdef3-f716-43da-bd88-30046c3006fd-ui-tls\") pod \"feast-simple-feast-setup-658bf58f5b-fnch9\" (UID: \"509bdef3-f716-43da-bd88-30046c3006fd\") " pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9"
Jun 08 12:01:53.533773 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:01:53.533741    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/509bdef3-f716-43da-bd88-30046c3006fd-ui-tls\") pod \"feast-simple-feast-setup-658bf58f5b-fnch9\" (UID: \"509bdef3-f716-43da-bd88-30046c3006fd\") " pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9"
Jun 08 12:01:53.533927 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:01:53.533776    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/509bdef3-f716-43da-bd88-30046c3006fd-registry-tls\") pod \"feast-simple-feast-setup-658bf58f5b-fnch9\" (UID: \"509bdef3-f716-43da-bd88-30046c3006fd\") " pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9"
Jun 08 12:01:53.533927 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:01:53.533815    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/509bdef3-f716-43da-bd88-30046c3006fd-offline-tls\") pod \"feast-simple-feast-setup-658bf58f5b-fnch9\" (UID: \"509bdef3-f716-43da-bd88-30046c3006fd\") " pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9"
Jun 08 12:01:53.742764 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:01:53.742737    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9"
Jun 08 12:01:53.871754 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:01:53.871731    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9"]
Jun 08 12:01:53.873457 ip-10-0-136-189 kubenswrapper[2583]: W0608 12:01:53.873431    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod509bdef3_f716_43da_bd88_30046c3006fd.slice/crio-78bf00c064bd935326fbec65f03cd91f4586c93dc072c41fb2b4a94a0f1bd526 WatchSource:0}: Error finding container 78bf00c064bd935326fbec65f03cd91f4586c93dc072c41fb2b4a94a0f1bd526: Status 404 returned error can't find the container with id 78bf00c064bd935326fbec65f03cd91f4586c93dc072c41fb2b4a94a0f1bd526
Jun 08 12:01:54.213130 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:01:54.213085    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9" event={"ID":"509bdef3-f716-43da-bd88-30046c3006fd","Type":"ContainerStarted","Data":"e699a7e5f361c49677a9afb725d25a4020a2c9306fc5a76458d7efc88a0ddc1d"}
Jun 08 12:01:54.213301 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:01:54.213143    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9" event={"ID":"509bdef3-f716-43da-bd88-30046c3006fd","Type":"ContainerStarted","Data":"78bf00c064bd935326fbec65f03cd91f4586c93dc072c41fb2b4a94a0f1bd526"}
Jun 08 12:01:59.235695 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:01:59.235659    2583 generic.go:356] "Generic (PLEG): container finished" podID="509bdef3-f716-43da-bd88-30046c3006fd" containerID="e699a7e5f361c49677a9afb725d25a4020a2c9306fc5a76458d7efc88a0ddc1d" exitCode=0
Jun 08 12:01:59.236220 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:01:59.235734    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9" event={"ID":"509bdef3-f716-43da-bd88-30046c3006fd","Type":"ContainerDied","Data":"e699a7e5f361c49677a9afb725d25a4020a2c9306fc5a76458d7efc88a0ddc1d"}
Jun 08 12:02:00.195925 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:00.195881    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h" podUID="01bd2399-e54f-49b7-8c2b-295f097cd98c" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.27:8443: connect: connection refused"
Jun 08 12:02:00.242092 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:00.242038    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9" event={"ID":"509bdef3-f716-43da-bd88-30046c3006fd","Type":"ContainerStarted","Data":"cd48cca7cc747076a584a3fdcfb462b2eda70ca37d36abf3001f0d8c28493a41"}
Jun 08 12:02:00.955134 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:00.955093    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h" podUID="01bd2399-e54f-49b7-8c2b-295f097cd98c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused"
Jun 08 12:02:05.264418 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:05.264383    2583 generic.go:356] "Generic (PLEG): container finished" podID="509bdef3-f716-43da-bd88-30046c3006fd" containerID="cd48cca7cc747076a584a3fdcfb462b2eda70ca37d36abf3001f0d8c28493a41" exitCode=0
Jun 08 12:02:05.264870 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:05.264459    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9" event={"ID":"509bdef3-f716-43da-bd88-30046c3006fd","Type":"ContainerDied","Data":"cd48cca7cc747076a584a3fdcfb462b2eda70ca37d36abf3001f0d8c28493a41"}
Jun 08 12:02:06.274896 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:06.274859    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9" event={"ID":"509bdef3-f716-43da-bd88-30046c3006fd","Type":"ContainerStarted","Data":"963d8e404cf9a2403153f21b4ba4d87976306ef5496683a40c2f622c1d304d90"}
Jun 08 12:02:06.275366 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:06.274921    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9" event={"ID":"509bdef3-f716-43da-bd88-30046c3006fd","Type":"ContainerStarted","Data":"12a9f6e43641d2faed4417632025e25549b96fdb9b521187c756d82f7c93e0a3"}
Jun 08 12:02:06.275366 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:06.274945    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9" event={"ID":"509bdef3-f716-43da-bd88-30046c3006fd","Type":"ContainerStarted","Data":"336ba12f2612c0031ebdf79f5f08b539f13a74c4f82c632f226c3d72162d02d2"}
Jun 08 12:02:06.275366 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:06.274963    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9" event={"ID":"509bdef3-f716-43da-bd88-30046c3006fd","Type":"ContainerStarted","Data":"75ca0e3fb7c2299cc80746909e607128a6433bc1fa9354d842bb4a5526021e97"}
Jun 08 12:02:06.315409 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:06.315348    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9" podStartSLOduration=14.315327149 podStartE2EDuration="14.315327149s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:01:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:02:06.313477749 +0000 UTC m=+847.585052927" watchObservedRunningTime="2026-06-08 12:02:06.315327149 +0000 UTC m=+847.586902327"
Jun 08 12:02:08.743730 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:08.743683    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9"
Jun 08 12:02:08.744234 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:08.743754    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9"
Jun 08 12:02:08.744234 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:08.743775    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9"
Jun 08 12:02:08.744234 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:08.743792    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9"
Jun 08 12:02:08.746007 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:08.745969    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9" podUID="509bdef3-f716-43da-bd88-30046c3006fd" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.28:8816: connect: connection refused"
Jun 08 12:02:08.746257 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:08.746018    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9" podUID="509bdef3-f716-43da-bd88-30046c3006fd" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.28:6571: connect: connection refused"
Jun 08 12:02:08.746352 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:08.746017    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9" podUID="509bdef3-f716-43da-bd88-30046c3006fd" containerName="online" probeResult="failure" output="Get \"https://10.132.0.28:6567/health\": dial tcp 10.132.0.28:6567: connect: connection refused"
Jun 08 12:02:08.746352 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:08.746085    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9" podUID="509bdef3-f716-43da-bd88-30046c3006fd" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.28:8443: connect: connection refused"
Jun 08 12:02:10.195440 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:10.195392    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h" podUID="01bd2399-e54f-49b7-8c2b-295f097cd98c" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.27:8443: connect: connection refused"
Jun 08 12:02:10.955236 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:10.955197    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h" podUID="01bd2399-e54f-49b7-8c2b-295f097cd98c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused"
Jun 08 12:02:11.743955 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:11.743922    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9"
Jun 08 12:02:11.744440 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:11.744123    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9"
Jun 08 12:02:11.744440 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:11.744273    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9"
Jun 08 12:02:11.744607 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:11.744583    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9"
Jun 08 12:02:11.744666 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:11.744629    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9"
Jun 08 12:02:11.744666 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:11.744648    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9"
Jun 08 12:02:11.745067 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:11.745032    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9"
Jun 08 12:02:11.745172 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:11.745102    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9"
Jun 08 12:02:11.745172 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:11.745133    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9"
Jun 08 12:02:11.748736 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:11.748713    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9"
Jun 08 12:02:12.306504 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:12.306475    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9"
Jun 08 12:02:12.309456 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:12.309435    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9"
Jun 08 12:02:20.195520 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:20.195474    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h" podUID="01bd2399-e54f-49b7-8c2b-295f097cd98c" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.27:8443: connect: connection refused"
Jun 08 12:02:20.195949 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:20.195650    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h"
Jun 08 12:02:20.954898 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:20.954852    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h" podUID="01bd2399-e54f-49b7-8c2b-295f097cd98c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused"
Jun 08 12:02:20.955093 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:20.954979    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h"
Jun 08 12:02:23.134912 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:23.134889    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h"
Jun 08 12:02:23.189444 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:23.189422    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/01bd2399-e54f-49b7-8c2b-295f097cd98c-offline-tls\") pod \"01bd2399-e54f-49b7-8c2b-295f097cd98c\" (UID: \"01bd2399-e54f-49b7-8c2b-295f097cd98c\") "
Jun 08 12:02:23.189577 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:23.189460    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/01bd2399-e54f-49b7-8c2b-295f097cd98c-ui-tls\") pod \"01bd2399-e54f-49b7-8c2b-295f097cd98c\" (UID: \"01bd2399-e54f-49b7-8c2b-295f097cd98c\") "
Jun 08 12:02:23.189577 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:23.189499    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/01bd2399-e54f-49b7-8c2b-295f097cd98c-feast-data\") pod \"01bd2399-e54f-49b7-8c2b-295f097cd98c\" (UID: \"01bd2399-e54f-49b7-8c2b-295f097cd98c\") "
Jun 08 12:02:23.189577 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:23.189519    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/01bd2399-e54f-49b7-8c2b-295f097cd98c-registry-tls\") pod \"01bd2399-e54f-49b7-8c2b-295f097cd98c\" (UID: \"01bd2399-e54f-49b7-8c2b-295f097cd98c\") "
Jun 08 12:02:23.189577 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:23.189551    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lx6ql\" (UniqueName: \"kubernetes.io/projected/01bd2399-e54f-49b7-8c2b-295f097cd98c-kube-api-access-lx6ql\") pod \"01bd2399-e54f-49b7-8c2b-295f097cd98c\" (UID: \"01bd2399-e54f-49b7-8c2b-295f097cd98c\") "
Jun 08 12:02:23.189763 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:23.189602    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/01bd2399-e54f-49b7-8c2b-295f097cd98c-online-tls\") pod \"01bd2399-e54f-49b7-8c2b-295f097cd98c\" (UID: \"01bd2399-e54f-49b7-8c2b-295f097cd98c\") "
Jun 08 12:02:23.190116 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:23.190083    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01bd2399-e54f-49b7-8c2b-295f097cd98c-feast-data" (OuterVolumeSpecName: "feast-data") pod "01bd2399-e54f-49b7-8c2b-295f097cd98c" (UID: "01bd2399-e54f-49b7-8c2b-295f097cd98c"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 08 12:02:23.191790 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:23.191753    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01bd2399-e54f-49b7-8c2b-295f097cd98c-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "01bd2399-e54f-49b7-8c2b-295f097cd98c" (UID: "01bd2399-e54f-49b7-8c2b-295f097cd98c"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 08 12:02:23.191893 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:23.191833    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01bd2399-e54f-49b7-8c2b-295f097cd98c-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "01bd2399-e54f-49b7-8c2b-295f097cd98c" (UID: "01bd2399-e54f-49b7-8c2b-295f097cd98c"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 08 12:02:23.191893 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:23.191860    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01bd2399-e54f-49b7-8c2b-295f097cd98c-online-tls" (OuterVolumeSpecName: "online-tls") pod "01bd2399-e54f-49b7-8c2b-295f097cd98c" (UID: "01bd2399-e54f-49b7-8c2b-295f097cd98c"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 08 12:02:23.192000 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:23.191984    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01bd2399-e54f-49b7-8c2b-295f097cd98c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "01bd2399-e54f-49b7-8c2b-295f097cd98c" (UID: "01bd2399-e54f-49b7-8c2b-295f097cd98c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 08 12:02:23.192036 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:23.191985    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01bd2399-e54f-49b7-8c2b-295f097cd98c-kube-api-access-lx6ql" (OuterVolumeSpecName: "kube-api-access-lx6ql") pod "01bd2399-e54f-49b7-8c2b-295f097cd98c" (UID: "01bd2399-e54f-49b7-8c2b-295f097cd98c"). InnerVolumeSpecName "kube-api-access-lx6ql". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 08 12:02:23.291098 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:23.291001    2583 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/01bd2399-e54f-49b7-8c2b-295f097cd98c-feast-data\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:02:23.291098 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:23.291026    2583 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/01bd2399-e54f-49b7-8c2b-295f097cd98c-registry-tls\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:02:23.291098 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:23.291035    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lx6ql\" (UniqueName: \"kubernetes.io/projected/01bd2399-e54f-49b7-8c2b-295f097cd98c-kube-api-access-lx6ql\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:02:23.291098 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:23.291044    2583 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/01bd2399-e54f-49b7-8c2b-295f097cd98c-online-tls\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:02:23.291098 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:23.291072    2583 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/01bd2399-e54f-49b7-8c2b-295f097cd98c-offline-tls\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:02:23.291098 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:23.291085    2583 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/01bd2399-e54f-49b7-8c2b-295f097cd98c-ui-tls\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:02:23.354701 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:23.354669    2583 generic.go:356] "Generic (PLEG): container finished" podID="01bd2399-e54f-49b7-8c2b-295f097cd98c" containerID="21d46c9d2fdbf5d4f89a1b49b3ddc3ac48cfbb6dcf71cdea1dabfe17b2a7fc04" exitCode=137
Jun 08 12:02:23.354701 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:23.354694    2583 generic.go:356] "Generic (PLEG): container finished" podID="01bd2399-e54f-49b7-8c2b-295f097cd98c" containerID="9ffcaf398a15055cc093b1ce6d7e976f2c78f8fdf5c861831c1ccdbe435dc6b4" exitCode=137
Jun 08 12:02:23.354898 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:23.354715    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h" event={"ID":"01bd2399-e54f-49b7-8c2b-295f097cd98c","Type":"ContainerDied","Data":"21d46c9d2fdbf5d4f89a1b49b3ddc3ac48cfbb6dcf71cdea1dabfe17b2a7fc04"}
Jun 08 12:02:23.354898 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:23.354756    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h"
Jun 08 12:02:23.354898 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:23.354767    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h" event={"ID":"01bd2399-e54f-49b7-8c2b-295f097cd98c","Type":"ContainerDied","Data":"9ffcaf398a15055cc093b1ce6d7e976f2c78f8fdf5c861831c1ccdbe435dc6b4"}
Jun 08 12:02:23.354898 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:23.354782    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h" event={"ID":"01bd2399-e54f-49b7-8c2b-295f097cd98c","Type":"ContainerDied","Data":"7612358ddbbe53d282c9a1dbaf8b51b55e5bcbf7dc7d3151feae29bdedf6eac6"}
Jun 08 12:02:23.354898 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:23.354799    2583 scope.go:117] "RemoveContainer" containerID="24b45931a217c10fcde2d79e9440ec0839edb7db915978d776c47da65fdacbf5"
Jun 08 12:02:23.364176 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:23.364159    2583 scope.go:117] "RemoveContainer" containerID="21d46c9d2fdbf5d4f89a1b49b3ddc3ac48cfbb6dcf71cdea1dabfe17b2a7fc04"
Jun 08 12:02:23.371481 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:23.371465    2583 scope.go:117] "RemoveContainer" containerID="68435236229b18c96f3c68f153c8bee74ab8b11d265994934c55e6357d5ef95f"
Jun 08 12:02:23.378011 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:23.377987    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h"]
Jun 08 12:02:23.379480 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:23.379462    2583 scope.go:117] "RemoveContainer" containerID="9ffcaf398a15055cc093b1ce6d7e976f2c78f8fdf5c861831c1ccdbe435dc6b4"
Jun 08 12:02:23.381629 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:23.381612    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-658bf58f5b-dst8h"]
Jun 08 12:02:23.386782 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:23.386768    2583 scope.go:117] "RemoveContainer" containerID="b84893546258d4592bb1311d8e2938eb61c9bba7a1c8655741ee7cc7ef17f846"
Jun 08 12:02:23.393545 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:23.393530    2583 scope.go:117] "RemoveContainer" containerID="00129e887792dcb0be5bc7d9a21d8c6b8456a5cbd1432941dea887dd02ae7cd5"
Jun 08 12:02:23.400326 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:23.400294    2583 scope.go:117] "RemoveContainer" containerID="24b45931a217c10fcde2d79e9440ec0839edb7db915978d776c47da65fdacbf5"
Jun 08 12:02:23.400551 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:02:23.400533    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24b45931a217c10fcde2d79e9440ec0839edb7db915978d776c47da65fdacbf5\": container with ID starting with 24b45931a217c10fcde2d79e9440ec0839edb7db915978d776c47da65fdacbf5 not found: ID does not exist" containerID="24b45931a217c10fcde2d79e9440ec0839edb7db915978d776c47da65fdacbf5"
Jun 08 12:02:23.400611 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:23.400564    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24b45931a217c10fcde2d79e9440ec0839edb7db915978d776c47da65fdacbf5"} err="failed to get container status \"24b45931a217c10fcde2d79e9440ec0839edb7db915978d776c47da65fdacbf5\": rpc error: code = NotFound desc = could not find container \"24b45931a217c10fcde2d79e9440ec0839edb7db915978d776c47da65fdacbf5\": container with ID starting with 24b45931a217c10fcde2d79e9440ec0839edb7db915978d776c47da65fdacbf5 not found: ID does not exist"
Jun 08 12:02:23.400611 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:23.400589    2583 scope.go:117] "RemoveContainer" containerID="21d46c9d2fdbf5d4f89a1b49b3ddc3ac48cfbb6dcf71cdea1dabfe17b2a7fc04"
Jun 08 12:02:23.400814 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:02:23.400799    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21d46c9d2fdbf5d4f89a1b49b3ddc3ac48cfbb6dcf71cdea1dabfe17b2a7fc04\": container with ID starting with 21d46c9d2fdbf5d4f89a1b49b3ddc3ac48cfbb6dcf71cdea1dabfe17b2a7fc04 not found: ID does not exist" containerID="21d46c9d2fdbf5d4f89a1b49b3ddc3ac48cfbb6dcf71cdea1dabfe17b2a7fc04"
Jun 08 12:02:23.400870 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:23.400822    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21d46c9d2fdbf5d4f89a1b49b3ddc3ac48cfbb6dcf71cdea1dabfe17b2a7fc04"} err="failed to get container status \"21d46c9d2fdbf5d4f89a1b49b3ddc3ac48cfbb6dcf71cdea1dabfe17b2a7fc04\": rpc error: code = NotFound desc = could not find container \"21d46c9d2fdbf5d4f89a1b49b3ddc3ac48cfbb6dcf71cdea1dabfe17b2a7fc04\": container with ID starting with 21d46c9d2fdbf5d4f89a1b49b3ddc3ac48cfbb6dcf71cdea1dabfe17b2a7fc04 not found: ID does not exist"
Jun 08 12:02:23.400870 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:23.400840    2583 scope.go:117] "RemoveContainer" containerID="68435236229b18c96f3c68f153c8bee74ab8b11d265994934c55e6357d5ef95f"
Jun 08 12:02:23.401088 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:02:23.401069    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68435236229b18c96f3c68f153c8bee74ab8b11d265994934c55e6357d5ef95f\": container with ID starting with 68435236229b18c96f3c68f153c8bee74ab8b11d265994934c55e6357d5ef95f not found: ID does not exist" containerID="68435236229b18c96f3c68f153c8bee74ab8b11d265994934c55e6357d5ef95f"
Jun 08 12:02:23.401162 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:23.401094    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68435236229b18c96f3c68f153c8bee74ab8b11d265994934c55e6357d5ef95f"} err="failed to get container status \"68435236229b18c96f3c68f153c8bee74ab8b11d265994934c55e6357d5ef95f\": rpc error: code = NotFound desc = could not find container \"68435236229b18c96f3c68f153c8bee74ab8b11d265994934c55e6357d5ef95f\": container with ID starting with 68435236229b18c96f3c68f153c8bee74ab8b11d265994934c55e6357d5ef95f not found: ID does not exist"
Jun 08 12:02:23.401162 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:23.401112    2583 scope.go:117] "RemoveContainer" containerID="9ffcaf398a15055cc093b1ce6d7e976f2c78f8fdf5c861831c1ccdbe435dc6b4"
Jun 08 12:02:23.401340 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:02:23.401325    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ffcaf398a15055cc093b1ce6d7e976f2c78f8fdf5c861831c1ccdbe435dc6b4\": container with ID starting with 9ffcaf398a15055cc093b1ce6d7e976f2c78f8fdf5c861831c1ccdbe435dc6b4 not found: ID does not exist" containerID="9ffcaf398a15055cc093b1ce6d7e976f2c78f8fdf5c861831c1ccdbe435dc6b4"
Jun 08 12:02:23.401419 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:23.401345    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ffcaf398a15055cc093b1ce6d7e976f2c78f8fdf5c861831c1ccdbe435dc6b4"} err="failed to get container status \"9ffcaf398a15055cc093b1ce6d7e976f2c78f8fdf5c861831c1ccdbe435dc6b4\": rpc error: code = NotFound desc = could not find container \"9ffcaf398a15055cc093b1ce6d7e976f2c78f8fdf5c861831c1ccdbe435dc6b4\": container with ID starting with 9ffcaf398a15055cc093b1ce6d7e976f2c78f8fdf5c861831c1ccdbe435dc6b4 not found: ID does not exist"
Jun 08 12:02:23.401419 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:23.401358    2583 scope.go:117] "RemoveContainer" containerID="b84893546258d4592bb1311d8e2938eb61c9bba7a1c8655741ee7cc7ef17f846"
Jun 08 12:02:23.401557 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:02:23.401541    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b84893546258d4592bb1311d8e2938eb61c9bba7a1c8655741ee7cc7ef17f846\": container with ID starting with b84893546258d4592bb1311d8e2938eb61c9bba7a1c8655741ee7cc7ef17f846 not found: ID does not exist" containerID="b84893546258d4592bb1311d8e2938eb61c9bba7a1c8655741ee7cc7ef17f846"
Jun 08 12:02:23.401616 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:23.401564    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b84893546258d4592bb1311d8e2938eb61c9bba7a1c8655741ee7cc7ef17f846"} err="failed to get container status \"b84893546258d4592bb1311d8e2938eb61c9bba7a1c8655741ee7cc7ef17f846\": rpc error: code = NotFound desc = could not find container \"b84893546258d4592bb1311d8e2938eb61c9bba7a1c8655741ee7cc7ef17f846\": container with ID starting with b84893546258d4592bb1311d8e2938eb61c9bba7a1c8655741ee7cc7ef17f846 not found: ID does not exist"
Jun 08 12:02:23.401616 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:23.401582    2583 scope.go:117] "RemoveContainer" containerID="00129e887792dcb0be5bc7d9a21d8c6b8456a5cbd1432941dea887dd02ae7cd5"
Jun 08 12:02:23.401789 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:02:23.401775    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00129e887792dcb0be5bc7d9a21d8c6b8456a5cbd1432941dea887dd02ae7cd5\": container with ID starting with 00129e887792dcb0be5bc7d9a21d8c6b8456a5cbd1432941dea887dd02ae7cd5 not found: ID does not exist" containerID="00129e887792dcb0be5bc7d9a21d8c6b8456a5cbd1432941dea887dd02ae7cd5"
Jun 08 12:02:23.401824 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:23.401793    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00129e887792dcb0be5bc7d9a21d8c6b8456a5cbd1432941dea887dd02ae7cd5"} err="failed to get container status \"00129e887792dcb0be5bc7d9a21d8c6b8456a5cbd1432941dea887dd02ae7cd5\": rpc error: code = NotFound desc = could not find container \"00129e887792dcb0be5bc7d9a21d8c6b8456a5cbd1432941dea887dd02ae7cd5\": container with ID starting with 00129e887792dcb0be5bc7d9a21d8c6b8456a5cbd1432941dea887dd02ae7cd5 not found: ID does not exist"
Jun 08 12:02:23.401824 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:23.401805    2583 scope.go:117] "RemoveContainer" containerID="24b45931a217c10fcde2d79e9440ec0839edb7db915978d776c47da65fdacbf5"
Jun 08 12:02:23.402015 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:23.401996    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24b45931a217c10fcde2d79e9440ec0839edb7db915978d776c47da65fdacbf5"} err="failed to get container status \"24b45931a217c10fcde2d79e9440ec0839edb7db915978d776c47da65fdacbf5\": rpc error: code = NotFound desc = could not find container \"24b45931a217c10fcde2d79e9440ec0839edb7db915978d776c47da65fdacbf5\": container with ID starting with 24b45931a217c10fcde2d79e9440ec0839edb7db915978d776c47da65fdacbf5 not found: ID does not exist"
Jun 08 12:02:23.402094 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:23.402018    2583 scope.go:117] "RemoveContainer" containerID="21d46c9d2fdbf5d4f89a1b49b3ddc3ac48cfbb6dcf71cdea1dabfe17b2a7fc04"
Jun 08 12:02:23.402314 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:23.402297    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21d46c9d2fdbf5d4f89a1b49b3ddc3ac48cfbb6dcf71cdea1dabfe17b2a7fc04"} err="failed to get container status \"21d46c9d2fdbf5d4f89a1b49b3ddc3ac48cfbb6dcf71cdea1dabfe17b2a7fc04\": rpc error: code = NotFound desc = could not find container \"21d46c9d2fdbf5d4f89a1b49b3ddc3ac48cfbb6dcf71cdea1dabfe17b2a7fc04\": container with ID starting with 21d46c9d2fdbf5d4f89a1b49b3ddc3ac48cfbb6dcf71cdea1dabfe17b2a7fc04 not found: ID does not exist"
Jun 08 12:02:23.402375 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:23.402315    2583 scope.go:117] "RemoveContainer" containerID="68435236229b18c96f3c68f153c8bee74ab8b11d265994934c55e6357d5ef95f"
Jun 08 12:02:23.402523 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:23.402505    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68435236229b18c96f3c68f153c8bee74ab8b11d265994934c55e6357d5ef95f"} err="failed to get container status \"68435236229b18c96f3c68f153c8bee74ab8b11d265994934c55e6357d5ef95f\": rpc error: code = NotFound desc = could not find container \"68435236229b18c96f3c68f153c8bee74ab8b11d265994934c55e6357d5ef95f\": container with ID starting with 68435236229b18c96f3c68f153c8bee74ab8b11d265994934c55e6357d5ef95f not found: ID does not exist"
Jun 08 12:02:23.402563 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:23.402524    2583 scope.go:117] "RemoveContainer" containerID="9ffcaf398a15055cc093b1ce6d7e976f2c78f8fdf5c861831c1ccdbe435dc6b4"
Jun 08 12:02:23.402750 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:23.402733    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ffcaf398a15055cc093b1ce6d7e976f2c78f8fdf5c861831c1ccdbe435dc6b4"} err="failed to get container status \"9ffcaf398a15055cc093b1ce6d7e976f2c78f8fdf5c861831c1ccdbe435dc6b4\": rpc error: code = NotFound desc = could not find container \"9ffcaf398a15055cc093b1ce6d7e976f2c78f8fdf5c861831c1ccdbe435dc6b4\": container with ID starting with 9ffcaf398a15055cc093b1ce6d7e976f2c78f8fdf5c861831c1ccdbe435dc6b4 not found: ID does not exist"
Jun 08 12:02:23.402816 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:23.402752    2583 scope.go:117] "RemoveContainer" containerID="b84893546258d4592bb1311d8e2938eb61c9bba7a1c8655741ee7cc7ef17f846"
Jun 08 12:02:23.402977 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:23.402961    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b84893546258d4592bb1311d8e2938eb61c9bba7a1c8655741ee7cc7ef17f846"} err="failed to get container status \"b84893546258d4592bb1311d8e2938eb61c9bba7a1c8655741ee7cc7ef17f846\": rpc error: code = NotFound desc = could not find container \"b84893546258d4592bb1311d8e2938eb61c9bba7a1c8655741ee7cc7ef17f846\": container with ID starting with b84893546258d4592bb1311d8e2938eb61c9bba7a1c8655741ee7cc7ef17f846 not found: ID does not exist"
Jun 08 12:02:23.403020 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:23.402977    2583 scope.go:117] "RemoveContainer" containerID="00129e887792dcb0be5bc7d9a21d8c6b8456a5cbd1432941dea887dd02ae7cd5"
Jun 08 12:02:23.403158 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:23.403144    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00129e887792dcb0be5bc7d9a21d8c6b8456a5cbd1432941dea887dd02ae7cd5"} err="failed to get container status \"00129e887792dcb0be5bc7d9a21d8c6b8456a5cbd1432941dea887dd02ae7cd5\": rpc error: code = NotFound desc = could not find container \"00129e887792dcb0be5bc7d9a21d8c6b8456a5cbd1432941dea887dd02ae7cd5\": container with ID starting with 00129e887792dcb0be5bc7d9a21d8c6b8456a5cbd1432941dea887dd02ae7cd5 not found: ID does not exist"
Jun 08 12:02:25.191647 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:25.187130    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01bd2399-e54f-49b7-8c2b-295f097cd98c" path="/var/lib/kubelet/pods/01bd2399-e54f-49b7-8c2b-295f097cd98c/volumes"
Jun 08 12:02:59.177378 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:59.177299    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mnnbj_cdf82c13-c30a-474a-a135-3d1dbcbb6046/console-operator/2.log"
Jun 08 12:02:59.179013 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:02:59.178989    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mnnbj_cdf82c13-c30a-474a-a135-3d1dbcbb6046/console-operator/2.log"
Jun 08 12:03:14.848732 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:14.848693    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl"]
Jun 08 12:03:14.849315 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:14.849015    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01bd2399-e54f-49b7-8c2b-295f097cd98c" containerName="registry"
Jun 08 12:03:14.849315 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:14.849027    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="01bd2399-e54f-49b7-8c2b-295f097cd98c" containerName="registry"
Jun 08 12:03:14.849315 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:14.849039    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01bd2399-e54f-49b7-8c2b-295f097cd98c" containerName="online"
Jun 08 12:03:14.849315 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:14.849059    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="01bd2399-e54f-49b7-8c2b-295f097cd98c" containerName="online"
Jun 08 12:03:14.849315 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:14.849066    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01bd2399-e54f-49b7-8c2b-295f097cd98c" containerName="offline"
Jun 08 12:03:14.849315 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:14.849072    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="01bd2399-e54f-49b7-8c2b-295f097cd98c" containerName="offline"
Jun 08 12:03:14.849315 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:14.849082    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01bd2399-e54f-49b7-8c2b-295f097cd98c" containerName="feast-init"
Jun 08 12:03:14.849315 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:14.849088    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="01bd2399-e54f-49b7-8c2b-295f097cd98c" containerName="feast-init"
Jun 08 12:03:14.849315 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:14.849096    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01bd2399-e54f-49b7-8c2b-295f097cd98c" containerName="feast-apply"
Jun 08 12:03:14.849315 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:14.849101    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="01bd2399-e54f-49b7-8c2b-295f097cd98c" containerName="feast-apply"
Jun 08 12:03:14.849315 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:14.849110    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01bd2399-e54f-49b7-8c2b-295f097cd98c" containerName="ui"
Jun 08 12:03:14.849315 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:14.849118    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="01bd2399-e54f-49b7-8c2b-295f097cd98c" containerName="ui"
Jun 08 12:03:14.849315 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:14.849174    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="01bd2399-e54f-49b7-8c2b-295f097cd98c" containerName="online"
Jun 08 12:03:14.849315 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:14.849181    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="01bd2399-e54f-49b7-8c2b-295f097cd98c" containerName="ui"
Jun 08 12:03:14.849315 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:14.849193    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="01bd2399-e54f-49b7-8c2b-295f097cd98c" containerName="offline"
Jun 08 12:03:14.849315 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:14.849201    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="01bd2399-e54f-49b7-8c2b-295f097cd98c" containerName="registry"
Jun 08 12:03:14.853942 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:14.853923    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl"
Jun 08 12:03:14.870752 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:14.870725    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
Jun 08 12:03:14.870961 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:14.870946    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
Jun 08 12:03:14.871470 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:14.871452    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-mgqmz\""
Jun 08 12:03:14.871556 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:14.871458    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
Jun 08 12:03:14.871879 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:14.871859    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
Jun 08 12:03:14.881739 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:14.881710    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl"]
Jun 08 12:03:14.882181 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:14.882162    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
Jun 08 12:03:14.882977 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:14.882944    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
Jun 08 12:03:14.883446 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:14.883427    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-intra-comm\""
Jun 08 12:03:15.007098 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:15.007060    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2a64e782-fb35-4773-9ea5-d7aa0c0817cf-offline-tls\") pod \"feast-simple-feast-remote-setup-747fb7f855-l59nl\" (UID: \"2a64e782-fb35-4773-9ea5-d7aa0c0817cf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl"
Jun 08 12:03:15.007264 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:15.007120    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/2a64e782-fb35-4773-9ea5-d7aa0c0817cf-registry-tls\") pod \"feast-simple-feast-remote-setup-747fb7f855-l59nl\" (UID: \"2a64e782-fb35-4773-9ea5-d7aa0c0817cf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl"
Jun 08 12:03:15.007264 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:15.007173    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2a64e782-fb35-4773-9ea5-d7aa0c0817cf-online-tls\") pod \"feast-simple-feast-remote-setup-747fb7f855-l59nl\" (UID: \"2a64e782-fb35-4773-9ea5-d7aa0c0817cf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl"
Jun 08 12:03:15.007264 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:15.007226    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qpsd\" (UniqueName: \"kubernetes.io/projected/2a64e782-fb35-4773-9ea5-d7aa0c0817cf-kube-api-access-7qpsd\") pod \"feast-simple-feast-remote-setup-747fb7f855-l59nl\" (UID: \"2a64e782-fb35-4773-9ea5-d7aa0c0817cf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl"
Jun 08 12:03:15.007374 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:15.007326    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2a64e782-fb35-4773-9ea5-d7aa0c0817cf-ui-tls\") pod \"feast-simple-feast-remote-setup-747fb7f855-l59nl\" (UID: \"2a64e782-fb35-4773-9ea5-d7aa0c0817cf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl"
Jun 08 12:03:15.007374 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:15.007368    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2a64e782-fb35-4773-9ea5-d7aa0c0817cf-feast-data\") pod \"feast-simple-feast-remote-setup-747fb7f855-l59nl\" (UID: \"2a64e782-fb35-4773-9ea5-d7aa0c0817cf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl"
Jun 08 12:03:15.108446 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:15.108354    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2a64e782-fb35-4773-9ea5-d7aa0c0817cf-offline-tls\") pod \"feast-simple-feast-remote-setup-747fb7f855-l59nl\" (UID: \"2a64e782-fb35-4773-9ea5-d7aa0c0817cf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl"
Jun 08 12:03:15.108446 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:15.108395    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/2a64e782-fb35-4773-9ea5-d7aa0c0817cf-registry-tls\") pod \"feast-simple-feast-remote-setup-747fb7f855-l59nl\" (UID: \"2a64e782-fb35-4773-9ea5-d7aa0c0817cf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl"
Jun 08 12:03:15.108446 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:15.108440    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2a64e782-fb35-4773-9ea5-d7aa0c0817cf-online-tls\") pod \"feast-simple-feast-remote-setup-747fb7f855-l59nl\" (UID: \"2a64e782-fb35-4773-9ea5-d7aa0c0817cf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl"
Jun 08 12:03:15.108720 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:15.108457    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qpsd\" (UniqueName: \"kubernetes.io/projected/2a64e782-fb35-4773-9ea5-d7aa0c0817cf-kube-api-access-7qpsd\") pod \"feast-simple-feast-remote-setup-747fb7f855-l59nl\" (UID: \"2a64e782-fb35-4773-9ea5-d7aa0c0817cf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl"
Jun 08 12:03:15.108720 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:15.108502    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2a64e782-fb35-4773-9ea5-d7aa0c0817cf-ui-tls\") pod \"feast-simple-feast-remote-setup-747fb7f855-l59nl\" (UID: \"2a64e782-fb35-4773-9ea5-d7aa0c0817cf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl"
Jun 08 12:03:15.108720 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:03:15.108505    2583 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-offline-tls: secret "feast-simple-feast-remote-setup-offline-tls" not found
Jun 08 12:03:15.108720 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:03:15.108582    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a64e782-fb35-4773-9ea5-d7aa0c0817cf-offline-tls podName:2a64e782-fb35-4773-9ea5-d7aa0c0817cf nodeName:}" failed. No retries permitted until 2026-06-08 12:03:15.608563275 +0000 UTC m=+916.880138432 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/2a64e782-fb35-4773-9ea5-d7aa0c0817cf-offline-tls") pod "feast-simple-feast-remote-setup-747fb7f855-l59nl" (UID: "2a64e782-fb35-4773-9ea5-d7aa0c0817cf") : secret "feast-simple-feast-remote-setup-offline-tls" not found
Jun 08 12:03:15.108720 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:15.108638    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2a64e782-fb35-4773-9ea5-d7aa0c0817cf-feast-data\") pod \"feast-simple-feast-remote-setup-747fb7f855-l59nl\" (UID: \"2a64e782-fb35-4773-9ea5-d7aa0c0817cf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl"
Jun 08 12:03:15.109044 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:15.109013    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2a64e782-fb35-4773-9ea5-d7aa0c0817cf-feast-data\") pod \"feast-simple-feast-remote-setup-747fb7f855-l59nl\" (UID: \"2a64e782-fb35-4773-9ea5-d7aa0c0817cf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl"
Jun 08 12:03:15.109360 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:15.109338    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/2a64e782-fb35-4773-9ea5-d7aa0c0817cf-registry-tls\") pod \"feast-simple-feast-remote-setup-747fb7f855-l59nl\" (UID: \"2a64e782-fb35-4773-9ea5-d7aa0c0817cf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl"
Jun 08 12:03:15.110932 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:15.110914    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2a64e782-fb35-4773-9ea5-d7aa0c0817cf-online-tls\") pod \"feast-simple-feast-remote-setup-747fb7f855-l59nl\" (UID: \"2a64e782-fb35-4773-9ea5-d7aa0c0817cf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl"
Jun 08 12:03:15.111005 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:15.110950    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2a64e782-fb35-4773-9ea5-d7aa0c0817cf-ui-tls\") pod \"feast-simple-feast-remote-setup-747fb7f855-l59nl\" (UID: \"2a64e782-fb35-4773-9ea5-d7aa0c0817cf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl"
Jun 08 12:03:15.121512 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:15.121489    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qpsd\" (UniqueName: \"kubernetes.io/projected/2a64e782-fb35-4773-9ea5-d7aa0c0817cf-kube-api-access-7qpsd\") pod \"feast-simple-feast-remote-setup-747fb7f855-l59nl\" (UID: \"2a64e782-fb35-4773-9ea5-d7aa0c0817cf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl"
Jun 08 12:03:15.612351 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:15.612316    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2a64e782-fb35-4773-9ea5-d7aa0c0817cf-offline-tls\") pod \"feast-simple-feast-remote-setup-747fb7f855-l59nl\" (UID: \"2a64e782-fb35-4773-9ea5-d7aa0c0817cf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl"
Jun 08 12:03:15.614523 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:15.614500    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2a64e782-fb35-4773-9ea5-d7aa0c0817cf-offline-tls\") pod \"feast-simple-feast-remote-setup-747fb7f855-l59nl\" (UID: \"2a64e782-fb35-4773-9ea5-d7aa0c0817cf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl"
Jun 08 12:03:15.762939 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:15.762899    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl"
Jun 08 12:03:15.919786 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:15.919764    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl"]
Jun 08 12:03:15.921326 ip-10-0-136-189 kubenswrapper[2583]: W0608 12:03:15.921301    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2a64e782_fb35_4773_9ea5_d7aa0c0817cf.slice/crio-cba93eb71892881596a226c7af1729c518239c05ee9893e057c0aebe598a02a0 WatchSource:0}: Error finding container cba93eb71892881596a226c7af1729c518239c05ee9893e057c0aebe598a02a0: Status 404 returned error can't find the container with id cba93eb71892881596a226c7af1729c518239c05ee9893e057c0aebe598a02a0
Jun 08 12:03:16.551593 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:16.551553    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl" event={"ID":"2a64e782-fb35-4773-9ea5-d7aa0c0817cf","Type":"ContainerStarted","Data":"4d13a19ada340636334cea5b6be4c5d174e3a4048527cc3ec91d5c35cac5803a"}
Jun 08 12:03:16.551755 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:16.551608    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl" event={"ID":"2a64e782-fb35-4773-9ea5-d7aa0c0817cf","Type":"ContainerStarted","Data":"cba93eb71892881596a226c7af1729c518239c05ee9893e057c0aebe598a02a0"}
Jun 08 12:03:20.569093 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:20.569028    2583 generic.go:356] "Generic (PLEG): container finished" podID="2a64e782-fb35-4773-9ea5-d7aa0c0817cf" containerID="4d13a19ada340636334cea5b6be4c5d174e3a4048527cc3ec91d5c35cac5803a" exitCode=0
Jun 08 12:03:20.569453 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:20.569104    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl" event={"ID":"2a64e782-fb35-4773-9ea5-d7aa0c0817cf","Type":"ContainerDied","Data":"4d13a19ada340636334cea5b6be4c5d174e3a4048527cc3ec91d5c35cac5803a"}
Jun 08 12:03:21.574503 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:21.574462    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl" event={"ID":"2a64e782-fb35-4773-9ea5-d7aa0c0817cf","Type":"ContainerStarted","Data":"c9cc53eac83bb325720a3dc5a92906a2f2ea3a0e744322aefc16a0231938c2bc"}
Jun 08 12:03:26.598429 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:26.598398    2583 generic.go:356] "Generic (PLEG): container finished" podID="2a64e782-fb35-4773-9ea5-d7aa0c0817cf" containerID="c9cc53eac83bb325720a3dc5a92906a2f2ea3a0e744322aefc16a0231938c2bc" exitCode=0
Jun 08 12:03:26.598811 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:26.598463    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl" event={"ID":"2a64e782-fb35-4773-9ea5-d7aa0c0817cf","Type":"ContainerDied","Data":"c9cc53eac83bb325720a3dc5a92906a2f2ea3a0e744322aefc16a0231938c2bc"}
Jun 08 12:03:27.616513 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:27.616467    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl" event={"ID":"2a64e782-fb35-4773-9ea5-d7aa0c0817cf","Type":"ContainerStarted","Data":"a19ac834bdda1cfa3b601f9f641cdccbf6d8e70bd9ad7fe3d7dad99e3ce45bf3"}
Jun 08 12:03:27.616891 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:27.616535    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl" event={"ID":"2a64e782-fb35-4773-9ea5-d7aa0c0817cf","Type":"ContainerStarted","Data":"d8c43a0cd9a2d760f66319e64ba7fc35db337e8fbd4d4f2164e25590cecdfca4"}
Jun 08 12:03:27.616891 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:27.616556    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl" event={"ID":"2a64e782-fb35-4773-9ea5-d7aa0c0817cf","Type":"ContainerStarted","Data":"428eb34d1834b142c92a6d781ad7a66f4c048f670dcfbbe4b85c9041db66e27d"}
Jun 08 12:03:27.642392 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:27.642325    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl" podStartSLOduration=13.642305694000001 podStartE2EDuration="13.642305694s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:03:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:03:27.640674337 +0000 UTC m=+928.912249514" watchObservedRunningTime="2026-06-08 12:03:27.642305694 +0000 UTC m=+928.913880872"
Jun 08 12:03:27.763367 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:27.763320    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl"
Jun 08 12:03:27.763566 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:27.763385    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl"
Jun 08 12:03:27.763566 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:27.763399    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl"
Jun 08 12:03:27.765477 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:27.765428    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl" podUID="2a64e782-fb35-4773-9ea5-d7aa0c0817cf" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.29:8443: connect: connection refused"
Jun 08 12:03:27.765601 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:27.765476    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl" podUID="2a64e782-fb35-4773-9ea5-d7aa0c0817cf" containerName="online" probeResult="failure" output="Get \"https://10.132.0.29:6567/health\": dial tcp 10.132.0.29:6567: connect: connection refused"
Jun 08 12:03:27.765601 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:27.765439    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl" podUID="2a64e782-fb35-4773-9ea5-d7aa0c0817cf" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.29:8816: connect: connection refused"
Jun 08 12:03:30.763609 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:30.763557    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl" podUID="2a64e782-fb35-4773-9ea5-d7aa0c0817cf" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.29:8816: connect: connection refused"
Jun 08 12:03:30.764073 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:30.763629    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl" podUID="2a64e782-fb35-4773-9ea5-d7aa0c0817cf" containerName="online" probeResult="failure" output="Get \"https://10.132.0.29:6567/health\": dial tcp 10.132.0.29:6567: connect: connection refused"
Jun 08 12:03:30.764073 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:30.763558    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl" podUID="2a64e782-fb35-4773-9ea5-d7aa0c0817cf" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.29:8443: connect: connection refused"
Jun 08 12:03:33.764867 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:33.764831    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl"
Jun 08 12:03:33.765274 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:33.764952    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl"
Jun 08 12:03:33.765373 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:33.765357    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl"
Jun 08 12:03:33.765440 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:33.765385    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl"
Jun 08 12:03:33.765816 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:33.765795    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl"
Jun 08 12:03:33.765908 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:33.765858    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl"
Jun 08 12:03:33.768561 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:33.768545    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl"
Jun 08 12:03:34.649341 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:34.649307    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl"
Jun 08 12:03:34.652112 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:03:34.652096    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl"
Jun 08 12:04:35.964262 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:04:35.964224    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl"]
Jun 08 12:04:35.964914 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:04:35.964880    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl" podUID="2a64e782-fb35-4773-9ea5-d7aa0c0817cf" containerName="ui" containerID="cri-o://a19ac834bdda1cfa3b601f9f641cdccbf6d8e70bd9ad7fe3d7dad99e3ce45bf3" gracePeriod=30
Jun 08 12:04:35.965036 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:04:35.964975    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl" podUID="2a64e782-fb35-4773-9ea5-d7aa0c0817cf" containerName="offline" containerID="cri-o://d8c43a0cd9a2d760f66319e64ba7fc35db337e8fbd4d4f2164e25590cecdfca4" gracePeriod=30
Jun 08 12:04:35.965154 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:04:35.965129    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl" podUID="2a64e782-fb35-4773-9ea5-d7aa0c0817cf" containerName="online" containerID="cri-o://428eb34d1834b142c92a6d781ad7a66f4c048f670dcfbbe4b85c9041db66e27d" gracePeriod=30
Jun 08 12:04:36.110878 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:04:36.110836    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9"]
Jun 08 12:04:36.111232 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:04:36.111178    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9" podUID="509bdef3-f716-43da-bd88-30046c3006fd" containerName="registry" containerID="cri-o://75ca0e3fb7c2299cc80746909e607128a6433bc1fa9354d842bb4a5526021e97" gracePeriod=30
Jun 08 12:04:36.111363 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:04:36.111239    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9" podUID="509bdef3-f716-43da-bd88-30046c3006fd" containerName="online" containerID="cri-o://336ba12f2612c0031ebdf79f5f08b539f13a74c4f82c632f226c3d72162d02d2" gracePeriod=30
Jun 08 12:04:36.111363 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:04:36.111209    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9" podUID="509bdef3-f716-43da-bd88-30046c3006fd" containerName="offline" containerID="cri-o://12a9f6e43641d2faed4417632025e25549b96fdb9b521187c756d82f7c93e0a3" gracePeriod=30
Jun 08 12:04:36.111363 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:04:36.111205    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9" podUID="509bdef3-f716-43da-bd88-30046c3006fd" containerName="ui" containerID="cri-o://963d8e404cf9a2403153f21b4ba4d87976306ef5496683a40c2f622c1d304d90" gracePeriod=30
Jun 08 12:04:36.904196 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:04:36.904120    2583 generic.go:356] "Generic (PLEG): container finished" podID="509bdef3-f716-43da-bd88-30046c3006fd" containerID="963d8e404cf9a2403153f21b4ba4d87976306ef5496683a40c2f622c1d304d90" exitCode=0
Jun 08 12:04:36.904196 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:04:36.904146    2583 generic.go:356] "Generic (PLEG): container finished" podID="509bdef3-f716-43da-bd88-30046c3006fd" containerID="336ba12f2612c0031ebdf79f5f08b539f13a74c4f82c632f226c3d72162d02d2" exitCode=0
Jun 08 12:04:36.904362 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:04:36.904189    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9" event={"ID":"509bdef3-f716-43da-bd88-30046c3006fd","Type":"ContainerDied","Data":"963d8e404cf9a2403153f21b4ba4d87976306ef5496683a40c2f622c1d304d90"}
Jun 08 12:04:36.904362 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:04:36.904231    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9" event={"ID":"509bdef3-f716-43da-bd88-30046c3006fd","Type":"ContainerDied","Data":"336ba12f2612c0031ebdf79f5f08b539f13a74c4f82c632f226c3d72162d02d2"}
Jun 08 12:04:36.906439 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:04:36.906420    2583 generic.go:356] "Generic (PLEG): container finished" podID="2a64e782-fb35-4773-9ea5-d7aa0c0817cf" containerID="a19ac834bdda1cfa3b601f9f641cdccbf6d8e70bd9ad7fe3d7dad99e3ce45bf3" exitCode=0
Jun 08 12:04:36.906439 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:04:36.906436    2583 generic.go:356] "Generic (PLEG): container finished" podID="2a64e782-fb35-4773-9ea5-d7aa0c0817cf" containerID="428eb34d1834b142c92a6d781ad7a66f4c048f670dcfbbe4b85c9041db66e27d" exitCode=0
Jun 08 12:04:36.906573 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:04:36.906475    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl" event={"ID":"2a64e782-fb35-4773-9ea5-d7aa0c0817cf","Type":"ContainerDied","Data":"a19ac834bdda1cfa3b601f9f641cdccbf6d8e70bd9ad7fe3d7dad99e3ce45bf3"}
Jun 08 12:04:36.906573 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:04:36.906499    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl" event={"ID":"2a64e782-fb35-4773-9ea5-d7aa0c0817cf","Type":"ContainerDied","Data":"428eb34d1834b142c92a6d781ad7a66f4c048f670dcfbbe4b85c9041db66e27d"}
Jun 08 12:04:41.744774 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:04:41.744724    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9" podUID="509bdef3-f716-43da-bd88-30046c3006fd" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.28:8443: connect: connection refused"
Jun 08 12:04:42.307543 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:04:42.307508    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9" podUID="509bdef3-f716-43da-bd88-30046c3006fd" containerName="online" probeResult="failure" output="Get \"https://10.132.0.28:6567/health\": dial tcp 10.132.0.28:6567: connect: connection refused"
Jun 08 12:04:43.765838 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:04:43.765796    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl" podUID="2a64e782-fb35-4773-9ea5-d7aa0c0817cf" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.29:8443: connect: connection refused"
Jun 08 12:04:44.650386 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:04:44.650347    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl" podUID="2a64e782-fb35-4773-9ea5-d7aa0c0817cf" containerName="online" probeResult="failure" output="Get \"https://10.132.0.29:6567/health\": dial tcp 10.132.0.29:6567: connect: connection refused"
Jun 08 12:04:51.745425 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:04:51.745371    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9" podUID="509bdef3-f716-43da-bd88-30046c3006fd" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.28:8443: connect: connection refused"
Jun 08 12:04:52.307308 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:04:52.307261    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9" podUID="509bdef3-f716-43da-bd88-30046c3006fd" containerName="online" probeResult="failure" output="Get \"https://10.132.0.28:6567/health\": dial tcp 10.132.0.28:6567: connect: connection refused"
Jun 08 12:04:53.766196 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:04:53.766152    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl" podUID="2a64e782-fb35-4773-9ea5-d7aa0c0817cf" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.29:8443: connect: connection refused"
Jun 08 12:04:54.650169 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:04:54.650127    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl" podUID="2a64e782-fb35-4773-9ea5-d7aa0c0817cf" containerName="online" probeResult="failure" output="Get \"https://10.132.0.29:6567/health\": dial tcp 10.132.0.29:6567: connect: connection refused"
Jun 08 12:05:01.744741 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:01.744676    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9" podUID="509bdef3-f716-43da-bd88-30046c3006fd" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.28:8443: connect: connection refused"
Jun 08 12:05:01.745282 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:01.744812    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9"
Jun 08 12:05:02.307064 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:02.307018    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9" podUID="509bdef3-f716-43da-bd88-30046c3006fd" containerName="online" probeResult="failure" output="Get \"https://10.132.0.28:6567/health\": dial tcp 10.132.0.28:6567: connect: connection refused"
Jun 08 12:05:02.307234 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:02.307181    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9"
Jun 08 12:05:03.765622 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:03.765582    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl" podUID="2a64e782-fb35-4773-9ea5-d7aa0c0817cf" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.29:8443: connect: connection refused"
Jun 08 12:05:03.765993 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:03.765725    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl"
Jun 08 12:05:04.649909 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:04.649867    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl" podUID="2a64e782-fb35-4773-9ea5-d7aa0c0817cf" containerName="online" probeResult="failure" output="Get \"https://10.132.0.29:6567/health\": dial tcp 10.132.0.29:6567: connect: connection refused"
Jun 08 12:05:04.650095 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:04.649996    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl"
Jun 08 12:05:06.024882 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:06.024852    2583 generic.go:356] "Generic (PLEG): container finished" podID="2a64e782-fb35-4773-9ea5-d7aa0c0817cf" containerID="d8c43a0cd9a2d760f66319e64ba7fc35db337e8fbd4d4f2164e25590cecdfca4" exitCode=137
Jun 08 12:05:06.025188 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:06.024896    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl" event={"ID":"2a64e782-fb35-4773-9ea5-d7aa0c0817cf","Type":"ContainerDied","Data":"d8c43a0cd9a2d760f66319e64ba7fc35db337e8fbd4d4f2164e25590cecdfca4"}
Jun 08 12:05:06.237332 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:06.237279    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl"
Jun 08 12:05:06.299955 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:06.299926    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2a64e782-fb35-4773-9ea5-d7aa0c0817cf-online-tls\") pod \"2a64e782-fb35-4773-9ea5-d7aa0c0817cf\" (UID: \"2a64e782-fb35-4773-9ea5-d7aa0c0817cf\") "
Jun 08 12:05:06.300136 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:06.300014    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7qpsd\" (UniqueName: \"kubernetes.io/projected/2a64e782-fb35-4773-9ea5-d7aa0c0817cf-kube-api-access-7qpsd\") pod \"2a64e782-fb35-4773-9ea5-d7aa0c0817cf\" (UID: \"2a64e782-fb35-4773-9ea5-d7aa0c0817cf\") "
Jun 08 12:05:06.300136 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:06.300113    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2a64e782-fb35-4773-9ea5-d7aa0c0817cf-feast-data\") pod \"2a64e782-fb35-4773-9ea5-d7aa0c0817cf\" (UID: \"2a64e782-fb35-4773-9ea5-d7aa0c0817cf\") "
Jun 08 12:05:06.300228 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:06.300162    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/2a64e782-fb35-4773-9ea5-d7aa0c0817cf-registry-tls\") pod \"2a64e782-fb35-4773-9ea5-d7aa0c0817cf\" (UID: \"2a64e782-fb35-4773-9ea5-d7aa0c0817cf\") "
Jun 08 12:05:06.300228 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:06.300186    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2a64e782-fb35-4773-9ea5-d7aa0c0817cf-ui-tls\") pod \"2a64e782-fb35-4773-9ea5-d7aa0c0817cf\" (UID: \"2a64e782-fb35-4773-9ea5-d7aa0c0817cf\") "
Jun 08 12:05:06.300308 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:06.300238    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2a64e782-fb35-4773-9ea5-d7aa0c0817cf-offline-tls\") pod \"2a64e782-fb35-4773-9ea5-d7aa0c0817cf\" (UID: \"2a64e782-fb35-4773-9ea5-d7aa0c0817cf\") "
Jun 08 12:05:06.300549 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:06.300510    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a64e782-fb35-4773-9ea5-d7aa0c0817cf-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "2a64e782-fb35-4773-9ea5-d7aa0c0817cf" (UID: "2a64e782-fb35-4773-9ea5-d7aa0c0817cf"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 08 12:05:06.300674 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:06.300637    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a64e782-fb35-4773-9ea5-d7aa0c0817cf-feast-data" (OuterVolumeSpecName: "feast-data") pod "2a64e782-fb35-4773-9ea5-d7aa0c0817cf" (UID: "2a64e782-fb35-4773-9ea5-d7aa0c0817cf"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 08 12:05:06.302331 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:06.302307    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a64e782-fb35-4773-9ea5-d7aa0c0817cf-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "2a64e782-fb35-4773-9ea5-d7aa0c0817cf" (UID: "2a64e782-fb35-4773-9ea5-d7aa0c0817cf"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 08 12:05:06.302415 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:06.302355    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a64e782-fb35-4773-9ea5-d7aa0c0817cf-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "2a64e782-fb35-4773-9ea5-d7aa0c0817cf" (UID: "2a64e782-fb35-4773-9ea5-d7aa0c0817cf"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 08 12:05:06.302460 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:06.302431    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a64e782-fb35-4773-9ea5-d7aa0c0817cf-online-tls" (OuterVolumeSpecName: "online-tls") pod "2a64e782-fb35-4773-9ea5-d7aa0c0817cf" (UID: "2a64e782-fb35-4773-9ea5-d7aa0c0817cf"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 08 12:05:06.302497 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:06.302453    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a64e782-fb35-4773-9ea5-d7aa0c0817cf-kube-api-access-7qpsd" (OuterVolumeSpecName: "kube-api-access-7qpsd") pod "2a64e782-fb35-4773-9ea5-d7aa0c0817cf" (UID: "2a64e782-fb35-4773-9ea5-d7aa0c0817cf"). InnerVolumeSpecName "kube-api-access-7qpsd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 08 12:05:06.400984 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:06.400955    2583 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2a64e782-fb35-4773-9ea5-d7aa0c0817cf-offline-tls\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:05:06.400984 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:06.400978    2583 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2a64e782-fb35-4773-9ea5-d7aa0c0817cf-online-tls\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:05:06.400984 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:06.400988    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7qpsd\" (UniqueName: \"kubernetes.io/projected/2a64e782-fb35-4773-9ea5-d7aa0c0817cf-kube-api-access-7qpsd\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:05:06.401224 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:06.400997    2583 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2a64e782-fb35-4773-9ea5-d7aa0c0817cf-feast-data\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:05:06.401224 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:06.401005    2583 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/2a64e782-fb35-4773-9ea5-d7aa0c0817cf-registry-tls\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:05:06.401224 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:06.401014    2583 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2a64e782-fb35-4773-9ea5-d7aa0c0817cf-ui-tls\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:05:06.767450 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:06.767422    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9"
Jun 08 12:05:06.905438 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:06.905368    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/509bdef3-f716-43da-bd88-30046c3006fd-offline-tls\") pod \"509bdef3-f716-43da-bd88-30046c3006fd\" (UID: \"509bdef3-f716-43da-bd88-30046c3006fd\") "
Jun 08 12:05:06.905438 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:06.905428    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/509bdef3-f716-43da-bd88-30046c3006fd-registry-tls\") pod \"509bdef3-f716-43da-bd88-30046c3006fd\" (UID: \"509bdef3-f716-43da-bd88-30046c3006fd\") "
Jun 08 12:05:06.905736 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:06.905450    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/509bdef3-f716-43da-bd88-30046c3006fd-feast-data\") pod \"509bdef3-f716-43da-bd88-30046c3006fd\" (UID: \"509bdef3-f716-43da-bd88-30046c3006fd\") "
Jun 08 12:05:06.905736 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:06.905472    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/509bdef3-f716-43da-bd88-30046c3006fd-ui-tls\") pod \"509bdef3-f716-43da-bd88-30046c3006fd\" (UID: \"509bdef3-f716-43da-bd88-30046c3006fd\") "
Jun 08 12:05:06.905736 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:06.905512    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dq4hj\" (UniqueName: \"kubernetes.io/projected/509bdef3-f716-43da-bd88-30046c3006fd-kube-api-access-dq4hj\") pod \"509bdef3-f716-43da-bd88-30046c3006fd\" (UID: \"509bdef3-f716-43da-bd88-30046c3006fd\") "
Jun 08 12:05:06.905736 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:06.905570    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/509bdef3-f716-43da-bd88-30046c3006fd-online-tls\") pod \"509bdef3-f716-43da-bd88-30046c3006fd\" (UID: \"509bdef3-f716-43da-bd88-30046c3006fd\") "
Jun 08 12:05:06.906040 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:06.906017    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/509bdef3-f716-43da-bd88-30046c3006fd-feast-data" (OuterVolumeSpecName: "feast-data") pod "509bdef3-f716-43da-bd88-30046c3006fd" (UID: "509bdef3-f716-43da-bd88-30046c3006fd"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 08 12:05:06.907466 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:06.907441    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/509bdef3-f716-43da-bd88-30046c3006fd-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "509bdef3-f716-43da-bd88-30046c3006fd" (UID: "509bdef3-f716-43da-bd88-30046c3006fd"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 08 12:05:06.907992 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:06.907972    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/509bdef3-f716-43da-bd88-30046c3006fd-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "509bdef3-f716-43da-bd88-30046c3006fd" (UID: "509bdef3-f716-43da-bd88-30046c3006fd"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 08 12:05:06.908090 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:06.907999    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/509bdef3-f716-43da-bd88-30046c3006fd-kube-api-access-dq4hj" (OuterVolumeSpecName: "kube-api-access-dq4hj") pod "509bdef3-f716-43da-bd88-30046c3006fd" (UID: "509bdef3-f716-43da-bd88-30046c3006fd"). InnerVolumeSpecName "kube-api-access-dq4hj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 08 12:05:06.908090 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:06.908016    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/509bdef3-f716-43da-bd88-30046c3006fd-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "509bdef3-f716-43da-bd88-30046c3006fd" (UID: "509bdef3-f716-43da-bd88-30046c3006fd"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 08 12:05:06.908090 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:06.908034    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/509bdef3-f716-43da-bd88-30046c3006fd-online-tls" (OuterVolumeSpecName: "online-tls") pod "509bdef3-f716-43da-bd88-30046c3006fd" (UID: "509bdef3-f716-43da-bd88-30046c3006fd"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 08 12:05:07.006670 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:07.006638    2583 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/509bdef3-f716-43da-bd88-30046c3006fd-online-tls\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:05:07.006670 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:07.006667    2583 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/509bdef3-f716-43da-bd88-30046c3006fd-offline-tls\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:05:07.006820 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:07.006676    2583 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/509bdef3-f716-43da-bd88-30046c3006fd-registry-tls\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:05:07.006820 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:07.006683    2583 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/509bdef3-f716-43da-bd88-30046c3006fd-feast-data\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:05:07.006820 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:07.006711    2583 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/509bdef3-f716-43da-bd88-30046c3006fd-ui-tls\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:05:07.006820 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:07.006720    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dq4hj\" (UniqueName: \"kubernetes.io/projected/509bdef3-f716-43da-bd88-30046c3006fd-kube-api-access-dq4hj\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:05:07.032237 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:07.032211    2583 generic.go:356] "Generic (PLEG): container finished" podID="509bdef3-f716-43da-bd88-30046c3006fd" containerID="12a9f6e43641d2faed4417632025e25549b96fdb9b521187c756d82f7c93e0a3" exitCode=137
Jun 08 12:05:07.032237 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:07.032232    2583 generic.go:356] "Generic (PLEG): container finished" podID="509bdef3-f716-43da-bd88-30046c3006fd" containerID="75ca0e3fb7c2299cc80746909e607128a6433bc1fa9354d842bb4a5526021e97" exitCode=137
Jun 08 12:05:07.032575 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:07.032282    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9"
Jun 08 12:05:07.032575 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:07.032293    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9" event={"ID":"509bdef3-f716-43da-bd88-30046c3006fd","Type":"ContainerDied","Data":"12a9f6e43641d2faed4417632025e25549b96fdb9b521187c756d82f7c93e0a3"}
Jun 08 12:05:07.032575 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:07.032343    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9" event={"ID":"509bdef3-f716-43da-bd88-30046c3006fd","Type":"ContainerDied","Data":"75ca0e3fb7c2299cc80746909e607128a6433bc1fa9354d842bb4a5526021e97"}
Jun 08 12:05:07.032575 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:07.032365    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9" event={"ID":"509bdef3-f716-43da-bd88-30046c3006fd","Type":"ContainerDied","Data":"78bf00c064bd935326fbec65f03cd91f4586c93dc072c41fb2b4a94a0f1bd526"}
Jun 08 12:05:07.032575 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:07.032394    2583 scope.go:117] "RemoveContainer" containerID="963d8e404cf9a2403153f21b4ba4d87976306ef5496683a40c2f622c1d304d90"
Jun 08 12:05:07.034854 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:07.034834    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl"
Jun 08 12:05:07.034947 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:07.034836    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl" event={"ID":"2a64e782-fb35-4773-9ea5-d7aa0c0817cf","Type":"ContainerDied","Data":"cba93eb71892881596a226c7af1729c518239c05ee9893e057c0aebe598a02a0"}
Jun 08 12:05:07.041538 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:07.041405    2583 scope.go:117] "RemoveContainer" containerID="12a9f6e43641d2faed4417632025e25549b96fdb9b521187c756d82f7c93e0a3"
Jun 08 12:05:07.048997 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:07.048980    2583 scope.go:117] "RemoveContainer" containerID="336ba12f2612c0031ebdf79f5f08b539f13a74c4f82c632f226c3d72162d02d2"
Jun 08 12:05:07.056221 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:07.056201    2583 scope.go:117] "RemoveContainer" containerID="75ca0e3fb7c2299cc80746909e607128a6433bc1fa9354d842bb4a5526021e97"
Jun 08 12:05:07.057068 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:07.056976    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9"]
Jun 08 12:05:07.061495 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:07.061475    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-658bf58f5b-fnch9"]
Jun 08 12:05:07.064673 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:07.064657    2583 scope.go:117] "RemoveContainer" containerID="cd48cca7cc747076a584a3fdcfb462b2eda70ca37d36abf3001f0d8c28493a41"
Jun 08 12:05:07.071444 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:07.071387    2583 scope.go:117] "RemoveContainer" containerID="e699a7e5f361c49677a9afb725d25a4020a2c9306fc5a76458d7efc88a0ddc1d"
Jun 08 12:05:07.073527 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:07.073511    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl"]
Jun 08 12:05:07.077094 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:07.077076    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-747fb7f855-l59nl"]
Jun 08 12:05:07.079417 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:07.079399    2583 scope.go:117] "RemoveContainer" containerID="963d8e404cf9a2403153f21b4ba4d87976306ef5496683a40c2f622c1d304d90"
Jun 08 12:05:07.079646 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:05:07.079628    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"963d8e404cf9a2403153f21b4ba4d87976306ef5496683a40c2f622c1d304d90\": container with ID starting with 963d8e404cf9a2403153f21b4ba4d87976306ef5496683a40c2f622c1d304d90 not found: ID does not exist" containerID="963d8e404cf9a2403153f21b4ba4d87976306ef5496683a40c2f622c1d304d90"
Jun 08 12:05:07.079699 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:07.079652    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"963d8e404cf9a2403153f21b4ba4d87976306ef5496683a40c2f622c1d304d90"} err="failed to get container status \"963d8e404cf9a2403153f21b4ba4d87976306ef5496683a40c2f622c1d304d90\": rpc error: code = NotFound desc = could not find container \"963d8e404cf9a2403153f21b4ba4d87976306ef5496683a40c2f622c1d304d90\": container with ID starting with 963d8e404cf9a2403153f21b4ba4d87976306ef5496683a40c2f622c1d304d90 not found: ID does not exist"
Jun 08 12:05:07.079699 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:07.079668    2583 scope.go:117] "RemoveContainer" containerID="12a9f6e43641d2faed4417632025e25549b96fdb9b521187c756d82f7c93e0a3"
Jun 08 12:05:07.079899 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:05:07.079880    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12a9f6e43641d2faed4417632025e25549b96fdb9b521187c756d82f7c93e0a3\": container with ID starting with 12a9f6e43641d2faed4417632025e25549b96fdb9b521187c756d82f7c93e0a3 not found: ID does not exist" containerID="12a9f6e43641d2faed4417632025e25549b96fdb9b521187c756d82f7c93e0a3"
Jun 08 12:05:07.079950 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:07.079905    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12a9f6e43641d2faed4417632025e25549b96fdb9b521187c756d82f7c93e0a3"} err="failed to get container status \"12a9f6e43641d2faed4417632025e25549b96fdb9b521187c756d82f7c93e0a3\": rpc error: code = NotFound desc = could not find container \"12a9f6e43641d2faed4417632025e25549b96fdb9b521187c756d82f7c93e0a3\": container with ID starting with 12a9f6e43641d2faed4417632025e25549b96fdb9b521187c756d82f7c93e0a3 not found: ID does not exist"
Jun 08 12:05:07.079950 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:07.079933    2583 scope.go:117] "RemoveContainer" containerID="336ba12f2612c0031ebdf79f5f08b539f13a74c4f82c632f226c3d72162d02d2"
Jun 08 12:05:07.080197 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:05:07.080180    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"336ba12f2612c0031ebdf79f5f08b539f13a74c4f82c632f226c3d72162d02d2\": container with ID starting with 336ba12f2612c0031ebdf79f5f08b539f13a74c4f82c632f226c3d72162d02d2 not found: ID does not exist" containerID="336ba12f2612c0031ebdf79f5f08b539f13a74c4f82c632f226c3d72162d02d2"
Jun 08 12:05:07.080261 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:07.080202    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"336ba12f2612c0031ebdf79f5f08b539f13a74c4f82c632f226c3d72162d02d2"} err="failed to get container status \"336ba12f2612c0031ebdf79f5f08b539f13a74c4f82c632f226c3d72162d02d2\": rpc error: code = NotFound desc = could not find container \"336ba12f2612c0031ebdf79f5f08b539f13a74c4f82c632f226c3d72162d02d2\": container with ID starting with 336ba12f2612c0031ebdf79f5f08b539f13a74c4f82c632f226c3d72162d02d2 not found: ID does not exist"
Jun 08 12:05:07.080261 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:07.080217    2583 scope.go:117] "RemoveContainer" containerID="75ca0e3fb7c2299cc80746909e607128a6433bc1fa9354d842bb4a5526021e97"
Jun 08 12:05:07.080444 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:05:07.080428    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75ca0e3fb7c2299cc80746909e607128a6433bc1fa9354d842bb4a5526021e97\": container with ID starting with 75ca0e3fb7c2299cc80746909e607128a6433bc1fa9354d842bb4a5526021e97 not found: ID does not exist" containerID="75ca0e3fb7c2299cc80746909e607128a6433bc1fa9354d842bb4a5526021e97"
Jun 08 12:05:07.080483 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:07.080447    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75ca0e3fb7c2299cc80746909e607128a6433bc1fa9354d842bb4a5526021e97"} err="failed to get container status \"75ca0e3fb7c2299cc80746909e607128a6433bc1fa9354d842bb4a5526021e97\": rpc error: code = NotFound desc = could not find container \"75ca0e3fb7c2299cc80746909e607128a6433bc1fa9354d842bb4a5526021e97\": container with ID starting with 75ca0e3fb7c2299cc80746909e607128a6433bc1fa9354d842bb4a5526021e97 not found: ID does not exist"
Jun 08 12:05:07.080483 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:07.080463    2583 scope.go:117] "RemoveContainer" containerID="cd48cca7cc747076a584a3fdcfb462b2eda70ca37d36abf3001f0d8c28493a41"
Jun 08 12:05:07.080663 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:05:07.080644    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd48cca7cc747076a584a3fdcfb462b2eda70ca37d36abf3001f0d8c28493a41\": container with ID starting with cd48cca7cc747076a584a3fdcfb462b2eda70ca37d36abf3001f0d8c28493a41 not found: ID does not exist" containerID="cd48cca7cc747076a584a3fdcfb462b2eda70ca37d36abf3001f0d8c28493a41"
Jun 08 12:05:07.080704 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:07.080667    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd48cca7cc747076a584a3fdcfb462b2eda70ca37d36abf3001f0d8c28493a41"} err="failed to get container status \"cd48cca7cc747076a584a3fdcfb462b2eda70ca37d36abf3001f0d8c28493a41\": rpc error: code = NotFound desc = could not find container \"cd48cca7cc747076a584a3fdcfb462b2eda70ca37d36abf3001f0d8c28493a41\": container with ID starting with cd48cca7cc747076a584a3fdcfb462b2eda70ca37d36abf3001f0d8c28493a41 not found: ID does not exist"
Jun 08 12:05:07.080704 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:07.080681    2583 scope.go:117] "RemoveContainer" containerID="e699a7e5f361c49677a9afb725d25a4020a2c9306fc5a76458d7efc88a0ddc1d"
Jun 08 12:05:07.080897 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:05:07.080880    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e699a7e5f361c49677a9afb725d25a4020a2c9306fc5a76458d7efc88a0ddc1d\": container with ID starting with e699a7e5f361c49677a9afb725d25a4020a2c9306fc5a76458d7efc88a0ddc1d not found: ID does not exist" containerID="e699a7e5f361c49677a9afb725d25a4020a2c9306fc5a76458d7efc88a0ddc1d"
Jun 08 12:05:07.080935 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:07.080900    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e699a7e5f361c49677a9afb725d25a4020a2c9306fc5a76458d7efc88a0ddc1d"} err="failed to get container status \"e699a7e5f361c49677a9afb725d25a4020a2c9306fc5a76458d7efc88a0ddc1d\": rpc error: code = NotFound desc = could not find container \"e699a7e5f361c49677a9afb725d25a4020a2c9306fc5a76458d7efc88a0ddc1d\": container with ID starting with e699a7e5f361c49677a9afb725d25a4020a2c9306fc5a76458d7efc88a0ddc1d not found: ID does not exist"
Jun 08 12:05:07.080935 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:07.080913    2583 scope.go:117] "RemoveContainer" containerID="963d8e404cf9a2403153f21b4ba4d87976306ef5496683a40c2f622c1d304d90"
Jun 08 12:05:07.081184 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:07.081162    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"963d8e404cf9a2403153f21b4ba4d87976306ef5496683a40c2f622c1d304d90"} err="failed to get container status \"963d8e404cf9a2403153f21b4ba4d87976306ef5496683a40c2f622c1d304d90\": rpc error: code = NotFound desc = could not find container \"963d8e404cf9a2403153f21b4ba4d87976306ef5496683a40c2f622c1d304d90\": container with ID starting with 963d8e404cf9a2403153f21b4ba4d87976306ef5496683a40c2f622c1d304d90 not found: ID does not exist"
Jun 08 12:05:07.081184 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:07.081183    2583 scope.go:117] "RemoveContainer" containerID="12a9f6e43641d2faed4417632025e25549b96fdb9b521187c756d82f7c93e0a3"
Jun 08 12:05:07.081373 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:07.081356    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12a9f6e43641d2faed4417632025e25549b96fdb9b521187c756d82f7c93e0a3"} err="failed to get container status \"12a9f6e43641d2faed4417632025e25549b96fdb9b521187c756d82f7c93e0a3\": rpc error: code = NotFound desc = could not find container \"12a9f6e43641d2faed4417632025e25549b96fdb9b521187c756d82f7c93e0a3\": container with ID starting with 12a9f6e43641d2faed4417632025e25549b96fdb9b521187c756d82f7c93e0a3 not found: ID does not exist"
Jun 08 12:05:07.081593 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:07.081374    2583 scope.go:117] "RemoveContainer" containerID="336ba12f2612c0031ebdf79f5f08b539f13a74c4f82c632f226c3d72162d02d2"
Jun 08 12:05:07.081593 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:07.081577    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"336ba12f2612c0031ebdf79f5f08b539f13a74c4f82c632f226c3d72162d02d2"} err="failed to get container status \"336ba12f2612c0031ebdf79f5f08b539f13a74c4f82c632f226c3d72162d02d2\": rpc error: code = NotFound desc = could not find container \"336ba12f2612c0031ebdf79f5f08b539f13a74c4f82c632f226c3d72162d02d2\": container with ID starting with 336ba12f2612c0031ebdf79f5f08b539f13a74c4f82c632f226c3d72162d02d2 not found: ID does not exist"
Jun 08 12:05:07.081593 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:07.081592    2583 scope.go:117] "RemoveContainer" containerID="75ca0e3fb7c2299cc80746909e607128a6433bc1fa9354d842bb4a5526021e97"
Jun 08 12:05:07.081800 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:07.081770    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75ca0e3fb7c2299cc80746909e607128a6433bc1fa9354d842bb4a5526021e97"} err="failed to get container status \"75ca0e3fb7c2299cc80746909e607128a6433bc1fa9354d842bb4a5526021e97\": rpc error: code = NotFound desc = could not find container \"75ca0e3fb7c2299cc80746909e607128a6433bc1fa9354d842bb4a5526021e97\": container with ID starting with 75ca0e3fb7c2299cc80746909e607128a6433bc1fa9354d842bb4a5526021e97 not found: ID does not exist"
Jun 08 12:05:07.081800 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:07.081783    2583 scope.go:117] "RemoveContainer" containerID="cd48cca7cc747076a584a3fdcfb462b2eda70ca37d36abf3001f0d8c28493a41"
Jun 08 12:05:07.081991 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:07.081974    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd48cca7cc747076a584a3fdcfb462b2eda70ca37d36abf3001f0d8c28493a41"} err="failed to get container status \"cd48cca7cc747076a584a3fdcfb462b2eda70ca37d36abf3001f0d8c28493a41\": rpc error: code = NotFound desc = could not find container \"cd48cca7cc747076a584a3fdcfb462b2eda70ca37d36abf3001f0d8c28493a41\": container with ID starting with cd48cca7cc747076a584a3fdcfb462b2eda70ca37d36abf3001f0d8c28493a41 not found: ID does not exist"
Jun 08 12:05:07.082074 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:07.081993    2583 scope.go:117] "RemoveContainer" containerID="e699a7e5f361c49677a9afb725d25a4020a2c9306fc5a76458d7efc88a0ddc1d"
Jun 08 12:05:07.082231 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:07.082214    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e699a7e5f361c49677a9afb725d25a4020a2c9306fc5a76458d7efc88a0ddc1d"} err="failed to get container status \"e699a7e5f361c49677a9afb725d25a4020a2c9306fc5a76458d7efc88a0ddc1d\": rpc error: code = NotFound desc = could not find container \"e699a7e5f361c49677a9afb725d25a4020a2c9306fc5a76458d7efc88a0ddc1d\": container with ID starting with e699a7e5f361c49677a9afb725d25a4020a2c9306fc5a76458d7efc88a0ddc1d not found: ID does not exist"
Jun 08 12:05:07.082292 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:07.082233    2583 scope.go:117] "RemoveContainer" containerID="a19ac834bdda1cfa3b601f9f641cdccbf6d8e70bd9ad7fe3d7dad99e3ce45bf3"
Jun 08 12:05:07.089869 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:07.089854    2583 scope.go:117] "RemoveContainer" containerID="d8c43a0cd9a2d760f66319e64ba7fc35db337e8fbd4d4f2164e25590cecdfca4"
Jun 08 12:05:07.096853 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:07.096835    2583 scope.go:117] "RemoveContainer" containerID="428eb34d1834b142c92a6d781ad7a66f4c048f670dcfbbe4b85c9041db66e27d"
Jun 08 12:05:07.103535 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:07.103516    2583 scope.go:117] "RemoveContainer" containerID="c9cc53eac83bb325720a3dc5a92906a2f2ea3a0e744322aefc16a0231938c2bc"
Jun 08 12:05:07.110314 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:07.110295    2583 scope.go:117] "RemoveContainer" containerID="4d13a19ada340636334cea5b6be4c5d174e3a4048527cc3ec91d5c35cac5803a"
Jun 08 12:05:07.186041 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:07.185993    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a64e782-fb35-4773-9ea5-d7aa0c0817cf" path="/var/lib/kubelet/pods/2a64e782-fb35-4773-9ea5-d7aa0c0817cf/volumes"
Jun 08 12:05:07.186524 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:07.186511    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="509bdef3-f716-43da-bd88-30046c3006fd" path="/var/lib/kubelet/pods/509bdef3-f716-43da-bd88-30046c3006fd/volumes"
Jun 08 12:05:19.132769 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:19.132731    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/postgres-864846d4f5-lm9wl"]
Jun 08 12:05:19.133226 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:19.133028    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a64e782-fb35-4773-9ea5-d7aa0c0817cf" containerName="ui"
Jun 08 12:05:19.133226 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:19.133040    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a64e782-fb35-4773-9ea5-d7aa0c0817cf" containerName="ui"
Jun 08 12:05:19.133226 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:19.133066    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="509bdef3-f716-43da-bd88-30046c3006fd" containerName="online"
Jun 08 12:05:19.133226 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:19.133073    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="509bdef3-f716-43da-bd88-30046c3006fd" containerName="online"
Jun 08 12:05:19.133226 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:19.133087    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="509bdef3-f716-43da-bd88-30046c3006fd" containerName="registry"
Jun 08 12:05:19.133226 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:19.133094    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="509bdef3-f716-43da-bd88-30046c3006fd" containerName="registry"
Jun 08 12:05:19.133226 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:19.133101    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="509bdef3-f716-43da-bd88-30046c3006fd" containerName="feast-apply"
Jun 08 12:05:19.133226 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:19.133107    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="509bdef3-f716-43da-bd88-30046c3006fd" containerName="feast-apply"
Jun 08 12:05:19.133226 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:19.133114    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a64e782-fb35-4773-9ea5-d7aa0c0817cf" containerName="feast-init"
Jun 08 12:05:19.133226 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:19.133121    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a64e782-fb35-4773-9ea5-d7aa0c0817cf" containerName="feast-init"
Jun 08 12:05:19.133226 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:19.133128    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a64e782-fb35-4773-9ea5-d7aa0c0817cf" containerName="online"
Jun 08 12:05:19.133226 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:19.133132    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a64e782-fb35-4773-9ea5-d7aa0c0817cf" containerName="online"
Jun 08 12:05:19.133226 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:19.133140    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a64e782-fb35-4773-9ea5-d7aa0c0817cf" containerName="offline"
Jun 08 12:05:19.133226 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:19.133145    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a64e782-fb35-4773-9ea5-d7aa0c0817cf" containerName="offline"
Jun 08 12:05:19.133226 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:19.133152    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="509bdef3-f716-43da-bd88-30046c3006fd" containerName="ui"
Jun 08 12:05:19.133226 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:19.133157    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="509bdef3-f716-43da-bd88-30046c3006fd" containerName="ui"
Jun 08 12:05:19.133226 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:19.133164    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a64e782-fb35-4773-9ea5-d7aa0c0817cf" containerName="feast-apply"
Jun 08 12:05:19.133226 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:19.133169    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a64e782-fb35-4773-9ea5-d7aa0c0817cf" containerName="feast-apply"
Jun 08 12:05:19.133226 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:19.133179    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="509bdef3-f716-43da-bd88-30046c3006fd" containerName="feast-init"
Jun 08 12:05:19.133226 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:19.133183    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="509bdef3-f716-43da-bd88-30046c3006fd" containerName="feast-init"
Jun 08 12:05:19.133226 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:19.133190    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="509bdef3-f716-43da-bd88-30046c3006fd" containerName="offline"
Jun 08 12:05:19.133226 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:19.133195    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="509bdef3-f716-43da-bd88-30046c3006fd" containerName="offline"
Jun 08 12:05:19.133911 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:19.133240    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="509bdef3-f716-43da-bd88-30046c3006fd" containerName="ui"
Jun 08 12:05:19.133911 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:19.133247    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a64e782-fb35-4773-9ea5-d7aa0c0817cf" containerName="ui"
Jun 08 12:05:19.133911 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:19.133255    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="509bdef3-f716-43da-bd88-30046c3006fd" containerName="online"
Jun 08 12:05:19.133911 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:19.133260    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a64e782-fb35-4773-9ea5-d7aa0c0817cf" containerName="offline"
Jun 08 12:05:19.133911 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:19.133265    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="509bdef3-f716-43da-bd88-30046c3006fd" containerName="offline"
Jun 08 12:05:19.133911 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:19.133271    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="509bdef3-f716-43da-bd88-30046c3006fd" containerName="registry"
Jun 08 12:05:19.133911 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:19.133276    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a64e782-fb35-4773-9ea5-d7aa0c0817cf" containerName="online"
Jun 08 12:05:19.138041 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:19.138022    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-lm9wl"
Jun 08 12:05:19.140460 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:19.140429    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Jun 08 12:05:19.140460 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:19.140448    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"default-dockercfg-bpmzq\""
Jun 08 12:05:19.140653 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:19.140485    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"postgres-secret\""
Jun 08 12:05:19.140653 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:19.140485    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Jun 08 12:05:19.145037 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:19.144837    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-lm9wl"]
Jun 08 12:05:19.159775 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:19.159749    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/redis-69bbd798b6-qcpln"]
Jun 08 12:05:19.163439 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:19.163417    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-qcpln"
Jun 08 12:05:19.170697 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:19.170679    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-69bbd798b6-qcpln"]
Jun 08 12:05:19.309647 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:19.309600    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwsq8\" (UniqueName: \"kubernetes.io/projected/214233d3-8861-43ea-8d89-dbc904516273-kube-api-access-zwsq8\") pod \"postgres-864846d4f5-lm9wl\" (UID: \"214233d3-8861-43ea-8d89-dbc904516273\") " pod="test-ns-feast/postgres-864846d4f5-lm9wl"
Jun 08 12:05:19.309647 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:19.309658    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpc88\" (UniqueName: \"kubernetes.io/projected/c72e81d1-a0e3-44d6-8ae3-1ecfc64717c2-kube-api-access-jpc88\") pod \"redis-69bbd798b6-qcpln\" (UID: \"c72e81d1-a0e3-44d6-8ae3-1ecfc64717c2\") " pod="test-ns-feast/redis-69bbd798b6-qcpln"
Jun 08 12:05:19.309865 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:19.309689    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/214233d3-8861-43ea-8d89-dbc904516273-postgresdata\") pod \"postgres-864846d4f5-lm9wl\" (UID: \"214233d3-8861-43ea-8d89-dbc904516273\") " pod="test-ns-feast/postgres-864846d4f5-lm9wl"
Jun 08 12:05:19.410168 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:19.410080    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwsq8\" (UniqueName: \"kubernetes.io/projected/214233d3-8861-43ea-8d89-dbc904516273-kube-api-access-zwsq8\") pod \"postgres-864846d4f5-lm9wl\" (UID: \"214233d3-8861-43ea-8d89-dbc904516273\") " pod="test-ns-feast/postgres-864846d4f5-lm9wl"
Jun 08 12:05:19.410168 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:19.410142    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpc88\" (UniqueName: \"kubernetes.io/projected/c72e81d1-a0e3-44d6-8ae3-1ecfc64717c2-kube-api-access-jpc88\") pod \"redis-69bbd798b6-qcpln\" (UID: \"c72e81d1-a0e3-44d6-8ae3-1ecfc64717c2\") " pod="test-ns-feast/redis-69bbd798b6-qcpln"
Jun 08 12:05:19.410168 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:19.410167    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/214233d3-8861-43ea-8d89-dbc904516273-postgresdata\") pod \"postgres-864846d4f5-lm9wl\" (UID: \"214233d3-8861-43ea-8d89-dbc904516273\") " pod="test-ns-feast/postgres-864846d4f5-lm9wl"
Jun 08 12:05:19.410519 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:19.410499    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/214233d3-8861-43ea-8d89-dbc904516273-postgresdata\") pod \"postgres-864846d4f5-lm9wl\" (UID: \"214233d3-8861-43ea-8d89-dbc904516273\") " pod="test-ns-feast/postgres-864846d4f5-lm9wl"
Jun 08 12:05:19.418121 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:19.418096    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwsq8\" (UniqueName: \"kubernetes.io/projected/214233d3-8861-43ea-8d89-dbc904516273-kube-api-access-zwsq8\") pod \"postgres-864846d4f5-lm9wl\" (UID: \"214233d3-8861-43ea-8d89-dbc904516273\") " pod="test-ns-feast/postgres-864846d4f5-lm9wl"
Jun 08 12:05:19.418254 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:19.418103    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpc88\" (UniqueName: \"kubernetes.io/projected/c72e81d1-a0e3-44d6-8ae3-1ecfc64717c2-kube-api-access-jpc88\") pod \"redis-69bbd798b6-qcpln\" (UID: \"c72e81d1-a0e3-44d6-8ae3-1ecfc64717c2\") " pod="test-ns-feast/redis-69bbd798b6-qcpln"
Jun 08 12:05:19.455893 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:19.455856    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-lm9wl"
Jun 08 12:05:19.475125 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:19.475096    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-qcpln"
Jun 08 12:05:19.593934 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:19.593904    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-lm9wl"]
Jun 08 12:05:19.596006 ip-10-0-136-189 kubenswrapper[2583]: W0608 12:05:19.595961    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod214233d3_8861_43ea_8d89_dbc904516273.slice/crio-c1f4872d400feaa4618d274bc671857a890d8ce399b4f2ae378c7b1888616e4b WatchSource:0}: Error finding container c1f4872d400feaa4618d274bc671857a890d8ce399b4f2ae378c7b1888616e4b: Status 404 returned error can't find the container with id c1f4872d400feaa4618d274bc671857a890d8ce399b4f2ae378c7b1888616e4b
Jun 08 12:05:19.597922 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:19.597904    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 08 12:05:19.614185 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:19.614130    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-69bbd798b6-qcpln"]
Jun 08 12:05:19.616453 ip-10-0-136-189 kubenswrapper[2583]: W0608 12:05:19.616432    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc72e81d1_a0e3_44d6_8ae3_1ecfc64717c2.slice/crio-3f59a9b928d297ca320cade7f9e6c7f2e2482a91ae1f157777e925589af7e79f WatchSource:0}: Error finding container 3f59a9b928d297ca320cade7f9e6c7f2e2482a91ae1f157777e925589af7e79f: Status 404 returned error can't find the container with id 3f59a9b928d297ca320cade7f9e6c7f2e2482a91ae1f157777e925589af7e79f
Jun 08 12:05:20.085552 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:20.085510    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-qcpln" event={"ID":"c72e81d1-a0e3-44d6-8ae3-1ecfc64717c2","Type":"ContainerStarted","Data":"3f59a9b928d297ca320cade7f9e6c7f2e2482a91ae1f157777e925589af7e79f"}
Jun 08 12:05:20.086526 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:20.086499    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-lm9wl" event={"ID":"214233d3-8861-43ea-8d89-dbc904516273","Type":"ContainerStarted","Data":"c1f4872d400feaa4618d274bc671857a890d8ce399b4f2ae378c7b1888616e4b"}
Jun 08 12:05:22.096149 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:22.096109    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-qcpln" event={"ID":"c72e81d1-a0e3-44d6-8ae3-1ecfc64717c2","Type":"ContainerStarted","Data":"395663d9c3aae6ae9c58dfb89cd03ad16c90307e0823561897cad3c5b34b6ea5"}
Jun 08 12:05:22.109851 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:22.109747    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/redis-69bbd798b6-qcpln" podStartSLOduration=1.48221118 podStartE2EDuration="3.10973078s" totalImagesPullingTime="1.6275196s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:05:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:05:22.109579044 +0000 UTC m=+1043.381154221" watchObservedRunningTime="2026-06-08 12:05:22.10973078 +0000 UTC m=+1043.381305956"
Jun 08 12:05:26.116926 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:26.116883    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-lm9wl" event={"ID":"214233d3-8861-43ea-8d89-dbc904516273","Type":"ContainerStarted","Data":"3ae58c9960560445d830d69d0a5882f6729db3cb3185676da1acf525e7dba648"}
Jun 08 12:05:26.133329 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:26.133276    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/postgres-864846d4f5-lm9wl" podStartSLOduration=1.373781899 podStartE2EDuration="7.133261893s" totalImagesPullingTime="5.759479994s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:05:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:05:26.131764679 +0000 UTC m=+1047.403339856" watchObservedRunningTime="2026-06-08 12:05:26.133261893 +0000 UTC m=+1047.404837068"
Jun 08 12:05:29.825448 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:29.825411    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-credit-scoring-6b6f97cc7d-r5x6x"]
Jun 08 12:05:29.831304 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:29.831283    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-6b6f97cc7d-r5x6x"
Jun 08 12:05:29.835102 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:29.835079    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-online-tls\""
Jun 08 12:05:29.835208 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:29.835114    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-p5pwg\""
Jun 08 12:05:29.835208 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:29.835112    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\""
Jun 08 12:05:29.836006 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:29.835991    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-offline-tls\""
Jun 08 12:05:29.836215 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:29.836200    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-registry-tls\""
Jun 08 12:05:29.853611 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:29.853591    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-6b6f97cc7d-r5x6x"]
Jun 08 12:05:29.893418 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:29.893394    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/6e9a8baa-6435-4a4f-ba71-c9a46b82c17c-online-tls\") pod \"feast-credit-scoring-6b6f97cc7d-r5x6x\" (UID: \"6e9a8baa-6435-4a4f-ba71-c9a46b82c17c\") " pod="test-ns-feast/feast-credit-scoring-6b6f97cc7d-r5x6x"
Jun 08 12:05:29.893515 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:29.893462    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/6e9a8baa-6435-4a4f-ba71-c9a46b82c17c-offline-tls\") pod \"feast-credit-scoring-6b6f97cc7d-r5x6x\" (UID: \"6e9a8baa-6435-4a4f-ba71-c9a46b82c17c\") " pod="test-ns-feast/feast-credit-scoring-6b6f97cc7d-r5x6x"
Jun 08 12:05:29.893573 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:29.893513    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rblg7\" (UniqueName: \"kubernetes.io/projected/6e9a8baa-6435-4a4f-ba71-c9a46b82c17c-kube-api-access-rblg7\") pod \"feast-credit-scoring-6b6f97cc7d-r5x6x\" (UID: \"6e9a8baa-6435-4a4f-ba71-c9a46b82c17c\") " pod="test-ns-feast/feast-credit-scoring-6b6f97cc7d-r5x6x"
Jun 08 12:05:29.893573 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:29.893552    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/6e9a8baa-6435-4a4f-ba71-c9a46b82c17c-feast-data\") pod \"feast-credit-scoring-6b6f97cc7d-r5x6x\" (UID: \"6e9a8baa-6435-4a4f-ba71-c9a46b82c17c\") " pod="test-ns-feast/feast-credit-scoring-6b6f97cc7d-r5x6x"
Jun 08 12:05:29.893573 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:29.893568    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/6e9a8baa-6435-4a4f-ba71-c9a46b82c17c-registry-tls\") pod \"feast-credit-scoring-6b6f97cc7d-r5x6x\" (UID: \"6e9a8baa-6435-4a4f-ba71-c9a46b82c17c\") " pod="test-ns-feast/feast-credit-scoring-6b6f97cc7d-r5x6x"
Jun 08 12:05:29.994210 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:29.994184    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/6e9a8baa-6435-4a4f-ba71-c9a46b82c17c-offline-tls\") pod \"feast-credit-scoring-6b6f97cc7d-r5x6x\" (UID: \"6e9a8baa-6435-4a4f-ba71-c9a46b82c17c\") " pod="test-ns-feast/feast-credit-scoring-6b6f97cc7d-r5x6x"
Jun 08 12:05:29.994308 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:29.994220    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rblg7\" (UniqueName: \"kubernetes.io/projected/6e9a8baa-6435-4a4f-ba71-c9a46b82c17c-kube-api-access-rblg7\") pod \"feast-credit-scoring-6b6f97cc7d-r5x6x\" (UID: \"6e9a8baa-6435-4a4f-ba71-c9a46b82c17c\") " pod="test-ns-feast/feast-credit-scoring-6b6f97cc7d-r5x6x"
Jun 08 12:05:29.994308 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:29.994243    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/6e9a8baa-6435-4a4f-ba71-c9a46b82c17c-feast-data\") pod \"feast-credit-scoring-6b6f97cc7d-r5x6x\" (UID: \"6e9a8baa-6435-4a4f-ba71-c9a46b82c17c\") " pod="test-ns-feast/feast-credit-scoring-6b6f97cc7d-r5x6x"
Jun 08 12:05:29.994308 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:29.994264    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/6e9a8baa-6435-4a4f-ba71-c9a46b82c17c-registry-tls\") pod \"feast-credit-scoring-6b6f97cc7d-r5x6x\" (UID: \"6e9a8baa-6435-4a4f-ba71-c9a46b82c17c\") " pod="test-ns-feast/feast-credit-scoring-6b6f97cc7d-r5x6x"
Jun 08 12:05:29.994485 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:29.994314    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/6e9a8baa-6435-4a4f-ba71-c9a46b82c17c-online-tls\") pod \"feast-credit-scoring-6b6f97cc7d-r5x6x\" (UID: \"6e9a8baa-6435-4a4f-ba71-c9a46b82c17c\") " pod="test-ns-feast/feast-credit-scoring-6b6f97cc7d-r5x6x"
Jun 08 12:05:29.994649 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:29.994620    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/6e9a8baa-6435-4a4f-ba71-c9a46b82c17c-feast-data\") pod \"feast-credit-scoring-6b6f97cc7d-r5x6x\" (UID: \"6e9a8baa-6435-4a4f-ba71-c9a46b82c17c\") " pod="test-ns-feast/feast-credit-scoring-6b6f97cc7d-r5x6x"
Jun 08 12:05:29.996547 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:29.996528    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/6e9a8baa-6435-4a4f-ba71-c9a46b82c17c-offline-tls\") pod \"feast-credit-scoring-6b6f97cc7d-r5x6x\" (UID: \"6e9a8baa-6435-4a4f-ba71-c9a46b82c17c\") " pod="test-ns-feast/feast-credit-scoring-6b6f97cc7d-r5x6x"
Jun 08 12:05:29.996654 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:29.996596    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/6e9a8baa-6435-4a4f-ba71-c9a46b82c17c-registry-tls\") pod \"feast-credit-scoring-6b6f97cc7d-r5x6x\" (UID: \"6e9a8baa-6435-4a4f-ba71-c9a46b82c17c\") " pod="test-ns-feast/feast-credit-scoring-6b6f97cc7d-r5x6x"
Jun 08 12:05:29.996654 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:29.996642    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/6e9a8baa-6435-4a4f-ba71-c9a46b82c17c-online-tls\") pod \"feast-credit-scoring-6b6f97cc7d-r5x6x\" (UID: \"6e9a8baa-6435-4a4f-ba71-c9a46b82c17c\") " pod="test-ns-feast/feast-credit-scoring-6b6f97cc7d-r5x6x"
Jun 08 12:05:30.002631 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:30.002611    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rblg7\" (UniqueName: \"kubernetes.io/projected/6e9a8baa-6435-4a4f-ba71-c9a46b82c17c-kube-api-access-rblg7\") pod \"feast-credit-scoring-6b6f97cc7d-r5x6x\" (UID: \"6e9a8baa-6435-4a4f-ba71-c9a46b82c17c\") " pod="test-ns-feast/feast-credit-scoring-6b6f97cc7d-r5x6x"
Jun 08 12:05:30.140229 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:30.140212    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-6b6f97cc7d-r5x6x"
Jun 08 12:05:30.268575 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:30.268550    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-6b6f97cc7d-r5x6x"]
Jun 08 12:05:30.270674 ip-10-0-136-189 kubenswrapper[2583]: W0608 12:05:30.270641    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e9a8baa_6435_4a4f_ba71_c9a46b82c17c.slice/crio-95d749b9134cdfc2aa1a45062afc5f694ad245ae0405f445a617363e52127c64 WatchSource:0}: Error finding container 95d749b9134cdfc2aa1a45062afc5f694ad245ae0405f445a617363e52127c64: Status 404 returned error can't find the container with id 95d749b9134cdfc2aa1a45062afc5f694ad245ae0405f445a617363e52127c64
Jun 08 12:05:31.138708 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:31.138674    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6b6f97cc7d-r5x6x" event={"ID":"6e9a8baa-6435-4a4f-ba71-c9a46b82c17c","Type":"ContainerStarted","Data":"b669ac039e5878538da62f5d5db3ae1f139f1024d7035becaab754427d4fd95c"}
Jun 08 12:05:31.139069 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:31.138736    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6b6f97cc7d-r5x6x" event={"ID":"6e9a8baa-6435-4a4f-ba71-c9a46b82c17c","Type":"ContainerStarted","Data":"95d749b9134cdfc2aa1a45062afc5f694ad245ae0405f445a617363e52127c64"}
Jun 08 12:05:32.143895 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:32.143853    2583 generic.go:356] "Generic (PLEG): container finished" podID="6e9a8baa-6435-4a4f-ba71-c9a46b82c17c" containerID="b669ac039e5878538da62f5d5db3ae1f139f1024d7035becaab754427d4fd95c" exitCode=0
Jun 08 12:05:32.144413 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:32.143913    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6b6f97cc7d-r5x6x" event={"ID":"6e9a8baa-6435-4a4f-ba71-c9a46b82c17c","Type":"ContainerDied","Data":"b669ac039e5878538da62f5d5db3ae1f139f1024d7035becaab754427d4fd95c"}
Jun 08 12:05:33.150247 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:33.150213    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6b6f97cc7d-r5x6x" event={"ID":"6e9a8baa-6435-4a4f-ba71-c9a46b82c17c","Type":"ContainerStarted","Data":"d79c2f3c306440245ea3c87499ecbd57019df4411b3f95380c7878d096c20e99"}
Jun 08 12:05:39.175096 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:39.175043    2583 generic.go:356] "Generic (PLEG): container finished" podID="6e9a8baa-6435-4a4f-ba71-c9a46b82c17c" containerID="d79c2f3c306440245ea3c87499ecbd57019df4411b3f95380c7878d096c20e99" exitCode=0
Jun 08 12:05:39.175493 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:39.175119    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6b6f97cc7d-r5x6x" event={"ID":"6e9a8baa-6435-4a4f-ba71-c9a46b82c17c","Type":"ContainerDied","Data":"d79c2f3c306440245ea3c87499ecbd57019df4411b3f95380c7878d096c20e99"}
Jun 08 12:05:40.184061 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:40.184013    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6b6f97cc7d-r5x6x" event={"ID":"6e9a8baa-6435-4a4f-ba71-c9a46b82c17c","Type":"ContainerStarted","Data":"a541eccb8c3ac6ae2ec13dba5174f653d73222fc92b30bd7a4f1ed2bd70351f9"}
Jun 08 12:05:40.184560 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:40.184079    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6b6f97cc7d-r5x6x" event={"ID":"6e9a8baa-6435-4a4f-ba71-c9a46b82c17c","Type":"ContainerStarted","Data":"0be752a9f02603b50b13d4eb0cb2916a1437194f0e431f9149a18226b2ad2763"}
Jun 08 12:05:40.184560 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:40.184099    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6b6f97cc7d-r5x6x" event={"ID":"6e9a8baa-6435-4a4f-ba71-c9a46b82c17c","Type":"ContainerStarted","Data":"4f478768495612679eeb586fe5a349162b9fefef4df8bae9bdab7fed7d6b7e3e"}
Jun 08 12:05:40.209849 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:40.209751    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-credit-scoring-6b6f97cc7d-r5x6x" podStartSLOduration=11.209733485 podStartE2EDuration="11.209733485s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:05:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:05:40.20839682 +0000 UTC m=+1061.479971998" watchObservedRunningTime="2026-06-08 12:05:40.209733485 +0000 UTC m=+1061.481308661"
Jun 08 12:05:42.141157 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:42.141112    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-6b6f97cc7d-r5x6x"
Jun 08 12:05:42.141660 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:42.141225    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-6b6f97cc7d-r5x6x"
Jun 08 12:05:42.141660 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:42.141245    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-6b6f97cc7d-r5x6x"
Jun 08 12:05:42.143337 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:42.143296    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-6b6f97cc7d-r5x6x" podUID="6e9a8baa-6435-4a4f-ba71-c9a46b82c17c" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.32:6571: connect: connection refused"
Jun 08 12:05:42.143337 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:42.143316    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-6b6f97cc7d-r5x6x" podUID="6e9a8baa-6435-4a4f-ba71-c9a46b82c17c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.32:6567/health\": dial tcp 10.132.0.32:6567: connect: connection refused"
Jun 08 12:05:42.143528 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:42.143328    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-6b6f97cc7d-r5x6x" podUID="6e9a8baa-6435-4a4f-ba71-c9a46b82c17c" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.32:8816: connect: connection refused"
Jun 08 12:05:45.141376 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:45.141328    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-6b6f97cc7d-r5x6x" podUID="6e9a8baa-6435-4a4f-ba71-c9a46b82c17c" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.32:6571: connect: connection refused"
Jun 08 12:05:45.142271 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:45.142245    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-6b6f97cc7d-r5x6x"
Jun 08 12:05:45.142729 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:45.142685    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-6b6f97cc7d-r5x6x"
Jun 08 12:05:45.143188 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:45.143167    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-6b6f97cc7d-r5x6x"
Jun 08 12:05:45.146530 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:45.146512    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-6b6f97cc7d-r5x6x"
Jun 08 12:05:45.209175 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:45.209144    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-6b6f97cc7d-r5x6x"
Jun 08 12:05:45.212757 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:45.212731    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-6b6f97cc7d-r5x6x"
Jun 08 12:05:48.140852 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:48.140805    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-6b6f97cc7d-r5x6x" podUID="6e9a8baa-6435-4a4f-ba71-c9a46b82c17c" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.32:6571: connect: connection refused"
Jun 08 12:05:50.140866 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:50.140827    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-6b6f97cc7d-r5x6x"
Jun 08 12:05:51.141634 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:51.141607    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-6b6f97cc7d-r5x6x"
Jun 08 12:05:51.142321 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:05:51.142299    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-6b6f97cc7d-r5x6x"
Jun 08 12:06:50.750447 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:06:50.750412    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-6b6f97cc7d-r5x6x"]
Jun 08 12:06:50.751080 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:06:50.750666    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-6b6f97cc7d-r5x6x" podUID="6e9a8baa-6435-4a4f-ba71-c9a46b82c17c" containerName="registry" containerID="cri-o://4f478768495612679eeb586fe5a349162b9fefef4df8bae9bdab7fed7d6b7e3e" gracePeriod=30
Jun 08 12:06:50.751080 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:06:50.750724    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-6b6f97cc7d-r5x6x" podUID="6e9a8baa-6435-4a4f-ba71-c9a46b82c17c" containerName="online" containerID="cri-o://0be752a9f02603b50b13d4eb0cb2916a1437194f0e431f9149a18226b2ad2763" gracePeriod=30
Jun 08 12:06:50.751080 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:06:50.750724    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-6b6f97cc7d-r5x6x" podUID="6e9a8baa-6435-4a4f-ba71-c9a46b82c17c" containerName="offline" containerID="cri-o://a541eccb8c3ac6ae2ec13dba5174f653d73222fc92b30bd7a4f1ed2bd70351f9" gracePeriod=30
Jun 08 12:06:50.773643 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:06:50.773613    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-lm9wl"]
Jun 08 12:06:50.773797 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:06:50.773777    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/postgres-864846d4f5-lm9wl" podUID="214233d3-8861-43ea-8d89-dbc904516273" containerName="postgres" containerID="cri-o://3ae58c9960560445d830d69d0a5882f6729db3cb3185676da1acf525e7dba648" gracePeriod=30
Jun 08 12:06:50.784244 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:06:50.784204    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-69bbd798b6-qcpln"]
Jun 08 12:06:50.784433 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:06:50.784395    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/redis-69bbd798b6-qcpln" podUID="c72e81d1-a0e3-44d6-8ae3-1ecfc64717c2" containerName="redis" containerID="cri-o://395663d9c3aae6ae9c58dfb89cd03ad16c90307e0823561897cad3c5b34b6ea5" gracePeriod=30
Jun 08 12:06:51.019093 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:06:51.019042    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-lm9wl"
Jun 08 12:06:51.048773 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:06:51.048748    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-qcpln"
Jun 08 12:06:51.098290 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:06:51.098257    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zwsq8\" (UniqueName: \"kubernetes.io/projected/214233d3-8861-43ea-8d89-dbc904516273-kube-api-access-zwsq8\") pod \"214233d3-8861-43ea-8d89-dbc904516273\" (UID: \"214233d3-8861-43ea-8d89-dbc904516273\") "
Jun 08 12:06:51.098441 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:06:51.098359    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/214233d3-8861-43ea-8d89-dbc904516273-postgresdata\") pod \"214233d3-8861-43ea-8d89-dbc904516273\" (UID: \"214233d3-8861-43ea-8d89-dbc904516273\") "
Jun 08 12:06:51.100238 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:06:51.100209    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/214233d3-8861-43ea-8d89-dbc904516273-kube-api-access-zwsq8" (OuterVolumeSpecName: "kube-api-access-zwsq8") pod "214233d3-8861-43ea-8d89-dbc904516273" (UID: "214233d3-8861-43ea-8d89-dbc904516273"). InnerVolumeSpecName "kube-api-access-zwsq8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 08 12:06:51.131640 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:06:51.131602    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/214233d3-8861-43ea-8d89-dbc904516273-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "214233d3-8861-43ea-8d89-dbc904516273" (UID: "214233d3-8861-43ea-8d89-dbc904516273"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 08 12:06:51.199333 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:06:51.199302    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jpc88\" (UniqueName: \"kubernetes.io/projected/c72e81d1-a0e3-44d6-8ae3-1ecfc64717c2-kube-api-access-jpc88\") pod \"c72e81d1-a0e3-44d6-8ae3-1ecfc64717c2\" (UID: \"c72e81d1-a0e3-44d6-8ae3-1ecfc64717c2\") "
Jun 08 12:06:51.199594 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:06:51.199578    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zwsq8\" (UniqueName: \"kubernetes.io/projected/214233d3-8861-43ea-8d89-dbc904516273-kube-api-access-zwsq8\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:06:51.199646 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:06:51.199601    2583 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/214233d3-8861-43ea-8d89-dbc904516273-postgresdata\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:06:51.201365 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:06:51.201341    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c72e81d1-a0e3-44d6-8ae3-1ecfc64717c2-kube-api-access-jpc88" (OuterVolumeSpecName: "kube-api-access-jpc88") pod "c72e81d1-a0e3-44d6-8ae3-1ecfc64717c2" (UID: "c72e81d1-a0e3-44d6-8ae3-1ecfc64717c2"). InnerVolumeSpecName "kube-api-access-jpc88". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 08 12:06:51.300353 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:06:51.300262    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jpc88\" (UniqueName: \"kubernetes.io/projected/c72e81d1-a0e3-44d6-8ae3-1ecfc64717c2-kube-api-access-jpc88\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:06:51.492330 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:06:51.492300    2583 generic.go:356] "Generic (PLEG): container finished" podID="c72e81d1-a0e3-44d6-8ae3-1ecfc64717c2" containerID="395663d9c3aae6ae9c58dfb89cd03ad16c90307e0823561897cad3c5b34b6ea5" exitCode=0
Jun 08 12:06:51.492469 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:06:51.492342    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-qcpln"
Jun 08 12:06:51.492469 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:06:51.492388    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-qcpln" event={"ID":"c72e81d1-a0e3-44d6-8ae3-1ecfc64717c2","Type":"ContainerDied","Data":"395663d9c3aae6ae9c58dfb89cd03ad16c90307e0823561897cad3c5b34b6ea5"}
Jun 08 12:06:51.492469 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:06:51.492433    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-qcpln" event={"ID":"c72e81d1-a0e3-44d6-8ae3-1ecfc64717c2","Type":"ContainerDied","Data":"3f59a9b928d297ca320cade7f9e6c7f2e2482a91ae1f157777e925589af7e79f"}
Jun 08 12:06:51.492469 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:06:51.492455    2583 scope.go:117] "RemoveContainer" containerID="395663d9c3aae6ae9c58dfb89cd03ad16c90307e0823561897cad3c5b34b6ea5"
Jun 08 12:06:51.493694 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:06:51.493671    2583 generic.go:356] "Generic (PLEG): container finished" podID="214233d3-8861-43ea-8d89-dbc904516273" containerID="3ae58c9960560445d830d69d0a5882f6729db3cb3185676da1acf525e7dba648" exitCode=0
Jun 08 12:06:51.493801 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:06:51.493714    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-lm9wl"
Jun 08 12:06:51.493801 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:06:51.493760    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-lm9wl" event={"ID":"214233d3-8861-43ea-8d89-dbc904516273","Type":"ContainerDied","Data":"3ae58c9960560445d830d69d0a5882f6729db3cb3185676da1acf525e7dba648"}
Jun 08 12:06:51.493801 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:06:51.493796    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-lm9wl" event={"ID":"214233d3-8861-43ea-8d89-dbc904516273","Type":"ContainerDied","Data":"c1f4872d400feaa4618d274bc671857a890d8ce399b4f2ae378c7b1888616e4b"}
Jun 08 12:06:51.497685 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:06:51.497667    2583 generic.go:356] "Generic (PLEG): container finished" podID="6e9a8baa-6435-4a4f-ba71-c9a46b82c17c" containerID="0be752a9f02603b50b13d4eb0cb2916a1437194f0e431f9149a18226b2ad2763" exitCode=0
Jun 08 12:06:51.497773 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:06:51.497711    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6b6f97cc7d-r5x6x" event={"ID":"6e9a8baa-6435-4a4f-ba71-c9a46b82c17c","Type":"ContainerDied","Data":"0be752a9f02603b50b13d4eb0cb2916a1437194f0e431f9149a18226b2ad2763"}
Jun 08 12:06:51.500739 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:06:51.500715    2583 scope.go:117] "RemoveContainer" containerID="395663d9c3aae6ae9c58dfb89cd03ad16c90307e0823561897cad3c5b34b6ea5"
Jun 08 12:06:51.501013 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:06:51.500987    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"395663d9c3aae6ae9c58dfb89cd03ad16c90307e0823561897cad3c5b34b6ea5\": container with ID starting with 395663d9c3aae6ae9c58dfb89cd03ad16c90307e0823561897cad3c5b34b6ea5 not found: ID does not exist" containerID="395663d9c3aae6ae9c58dfb89cd03ad16c90307e0823561897cad3c5b34b6ea5"
Jun 08 12:06:51.501099 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:06:51.501026    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"395663d9c3aae6ae9c58dfb89cd03ad16c90307e0823561897cad3c5b34b6ea5"} err="failed to get container status \"395663d9c3aae6ae9c58dfb89cd03ad16c90307e0823561897cad3c5b34b6ea5\": rpc error: code = NotFound desc = could not find container \"395663d9c3aae6ae9c58dfb89cd03ad16c90307e0823561897cad3c5b34b6ea5\": container with ID starting with 395663d9c3aae6ae9c58dfb89cd03ad16c90307e0823561897cad3c5b34b6ea5 not found: ID does not exist"
Jun 08 12:06:51.501099 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:06:51.501066    2583 scope.go:117] "RemoveContainer" containerID="3ae58c9960560445d830d69d0a5882f6729db3cb3185676da1acf525e7dba648"
Jun 08 12:06:51.507901 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:06:51.507882    2583 scope.go:117] "RemoveContainer" containerID="3ae58c9960560445d830d69d0a5882f6729db3cb3185676da1acf525e7dba648"
Jun 08 12:06:51.508303 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:06:51.508251    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ae58c9960560445d830d69d0a5882f6729db3cb3185676da1acf525e7dba648\": container with ID starting with 3ae58c9960560445d830d69d0a5882f6729db3cb3185676da1acf525e7dba648 not found: ID does not exist" containerID="3ae58c9960560445d830d69d0a5882f6729db3cb3185676da1acf525e7dba648"
Jun 08 12:06:51.508303 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:06:51.508286    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ae58c9960560445d830d69d0a5882f6729db3cb3185676da1acf525e7dba648"} err="failed to get container status \"3ae58c9960560445d830d69d0a5882f6729db3cb3185676da1acf525e7dba648\": rpc error: code = NotFound desc = could not find container \"3ae58c9960560445d830d69d0a5882f6729db3cb3185676da1acf525e7dba648\": container with ID starting with 3ae58c9960560445d830d69d0a5882f6729db3cb3185676da1acf525e7dba648 not found: ID does not exist"
Jun 08 12:06:51.510039 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:06:51.509995    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-lm9wl"]
Jun 08 12:06:51.511858 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:06:51.511840    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/postgres-864846d4f5-lm9wl"]
Jun 08 12:06:51.523467 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:06:51.523446    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-69bbd798b6-qcpln"]
Jun 08 12:06:51.529622 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:06:51.529603    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/redis-69bbd798b6-qcpln"]
Jun 08 12:06:53.186474 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:06:53.186443    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="214233d3-8861-43ea-8d89-dbc904516273" path="/var/lib/kubelet/pods/214233d3-8861-43ea-8d89-dbc904516273/volumes"
Jun 08 12:06:53.186850 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:06:53.186775    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c72e81d1-a0e3-44d6-8ae3-1ecfc64717c2" path="/var/lib/kubelet/pods/c72e81d1-a0e3-44d6-8ae3-1ecfc64717c2/volumes"
Jun 08 12:06:55.209759 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:06:55.209716    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-6b6f97cc7d-r5x6x" podUID="6e9a8baa-6435-4a4f-ba71-c9a46b82c17c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.32:6567/health\": dial tcp 10.132.0.32:6567: connect: connection refused"
Jun 08 12:07:05.209399 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:07:05.209348    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-6b6f97cc7d-r5x6x" podUID="6e9a8baa-6435-4a4f-ba71-c9a46b82c17c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.32:6567/health\": dial tcp 10.132.0.32:6567: connect: connection refused"
Jun 08 12:07:15.209574 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:07:15.209533    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-6b6f97cc7d-r5x6x" podUID="6e9a8baa-6435-4a4f-ba71-c9a46b82c17c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.32:6567/health\": dial tcp 10.132.0.32:6567: connect: connection refused"
Jun 08 12:07:15.209940 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:07:15.209653    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-6b6f97cc7d-r5x6x"
Jun 08 12:07:21.143033 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:07:21.142994    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-6b6f97cc7d-r5x6x" podUID="6e9a8baa-6435-4a4f-ba71-c9a46b82c17c" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.32:6571: connect: connection refused"
Jun 08 12:07:21.407241 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:07:21.407181    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-6b6f97cc7d-r5x6x"
Jun 08 12:07:21.458250 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:07:21.458221    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rblg7\" (UniqueName: \"kubernetes.io/projected/6e9a8baa-6435-4a4f-ba71-c9a46b82c17c-kube-api-access-rblg7\") pod \"6e9a8baa-6435-4a4f-ba71-c9a46b82c17c\" (UID: \"6e9a8baa-6435-4a4f-ba71-c9a46b82c17c\") "
Jun 08 12:07:21.458551 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:07:21.458299    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/6e9a8baa-6435-4a4f-ba71-c9a46b82c17c-offline-tls\") pod \"6e9a8baa-6435-4a4f-ba71-c9a46b82c17c\" (UID: \"6e9a8baa-6435-4a4f-ba71-c9a46b82c17c\") "
Jun 08 12:07:21.458551 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:07:21.458322    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/6e9a8baa-6435-4a4f-ba71-c9a46b82c17c-online-tls\") pod \"6e9a8baa-6435-4a4f-ba71-c9a46b82c17c\" (UID: \"6e9a8baa-6435-4a4f-ba71-c9a46b82c17c\") "
Jun 08 12:07:21.458551 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:07:21.458369    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/6e9a8baa-6435-4a4f-ba71-c9a46b82c17c-feast-data\") pod \"6e9a8baa-6435-4a4f-ba71-c9a46b82c17c\" (UID: \"6e9a8baa-6435-4a4f-ba71-c9a46b82c17c\") "
Jun 08 12:07:21.458551 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:07:21.458387    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/6e9a8baa-6435-4a4f-ba71-c9a46b82c17c-registry-tls\") pod \"6e9a8baa-6435-4a4f-ba71-c9a46b82c17c\" (UID: \"6e9a8baa-6435-4a4f-ba71-c9a46b82c17c\") "
Jun 08 12:07:21.460511 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:07:21.460483    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e9a8baa-6435-4a4f-ba71-c9a46b82c17c-online-tls" (OuterVolumeSpecName: "online-tls") pod "6e9a8baa-6435-4a4f-ba71-c9a46b82c17c" (UID: "6e9a8baa-6435-4a4f-ba71-c9a46b82c17c"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 08 12:07:21.460603 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:07:21.460547    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e9a8baa-6435-4a4f-ba71-c9a46b82c17c-kube-api-access-rblg7" (OuterVolumeSpecName: "kube-api-access-rblg7") pod "6e9a8baa-6435-4a4f-ba71-c9a46b82c17c" (UID: "6e9a8baa-6435-4a4f-ba71-c9a46b82c17c"). InnerVolumeSpecName "kube-api-access-rblg7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 08 12:07:21.460791 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:07:21.460768    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e9a8baa-6435-4a4f-ba71-c9a46b82c17c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "6e9a8baa-6435-4a4f-ba71-c9a46b82c17c" (UID: "6e9a8baa-6435-4a4f-ba71-c9a46b82c17c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 08 12:07:21.460853 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:07:21.460798    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e9a8baa-6435-4a4f-ba71-c9a46b82c17c-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "6e9a8baa-6435-4a4f-ba71-c9a46b82c17c" (UID: "6e9a8baa-6435-4a4f-ba71-c9a46b82c17c"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 08 12:07:21.466623 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:07:21.466597    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e9a8baa-6435-4a4f-ba71-c9a46b82c17c-feast-data" (OuterVolumeSpecName: "feast-data") pod "6e9a8baa-6435-4a4f-ba71-c9a46b82c17c" (UID: "6e9a8baa-6435-4a4f-ba71-c9a46b82c17c"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 08 12:07:21.559762 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:07:21.559729    2583 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/6e9a8baa-6435-4a4f-ba71-c9a46b82c17c-online-tls\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:07:21.559762 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:07:21.559758    2583 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/6e9a8baa-6435-4a4f-ba71-c9a46b82c17c-feast-data\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:07:21.559762 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:07:21.559767    2583 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/6e9a8baa-6435-4a4f-ba71-c9a46b82c17c-registry-tls\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:07:21.559990 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:07:21.559776    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rblg7\" (UniqueName: \"kubernetes.io/projected/6e9a8baa-6435-4a4f-ba71-c9a46b82c17c-kube-api-access-rblg7\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:07:21.559990 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:07:21.559786    2583 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/6e9a8baa-6435-4a4f-ba71-c9a46b82c17c-offline-tls\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:07:21.623361 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:07:21.623322    2583 generic.go:356] "Generic (PLEG): container finished" podID="6e9a8baa-6435-4a4f-ba71-c9a46b82c17c" containerID="a541eccb8c3ac6ae2ec13dba5174f653d73222fc92b30bd7a4f1ed2bd70351f9" exitCode=137
Jun 08 12:07:21.623361 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:07:21.623350    2583 generic.go:356] "Generic (PLEG): container finished" podID="6e9a8baa-6435-4a4f-ba71-c9a46b82c17c" containerID="4f478768495612679eeb586fe5a349162b9fefef4df8bae9bdab7fed7d6b7e3e" exitCode=137
Jun 08 12:07:21.623597 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:07:21.623399    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-6b6f97cc7d-r5x6x"
Jun 08 12:07:21.623597 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:07:21.623417    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6b6f97cc7d-r5x6x" event={"ID":"6e9a8baa-6435-4a4f-ba71-c9a46b82c17c","Type":"ContainerDied","Data":"a541eccb8c3ac6ae2ec13dba5174f653d73222fc92b30bd7a4f1ed2bd70351f9"}
Jun 08 12:07:21.623597 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:07:21.623513    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6b6f97cc7d-r5x6x" event={"ID":"6e9a8baa-6435-4a4f-ba71-c9a46b82c17c","Type":"ContainerDied","Data":"4f478768495612679eeb586fe5a349162b9fefef4df8bae9bdab7fed7d6b7e3e"}
Jun 08 12:07:21.623597 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:07:21.623541    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6b6f97cc7d-r5x6x" event={"ID":"6e9a8baa-6435-4a4f-ba71-c9a46b82c17c","Type":"ContainerDied","Data":"95d749b9134cdfc2aa1a45062afc5f694ad245ae0405f445a617363e52127c64"}
Jun 08 12:07:21.623597 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:07:21.623578    2583 scope.go:117] "RemoveContainer" containerID="a541eccb8c3ac6ae2ec13dba5174f653d73222fc92b30bd7a4f1ed2bd70351f9"
Jun 08 12:07:21.633063 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:07:21.633024    2583 scope.go:117] "RemoveContainer" containerID="0be752a9f02603b50b13d4eb0cb2916a1437194f0e431f9149a18226b2ad2763"
Jun 08 12:07:21.641704 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:07:21.641687    2583 scope.go:117] "RemoveContainer" containerID="4f478768495612679eeb586fe5a349162b9fefef4df8bae9bdab7fed7d6b7e3e"
Jun 08 12:07:21.648368 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:07:21.648348    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-6b6f97cc7d-r5x6x"]
Jun 08 12:07:21.649823 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:07:21.649799    2583 scope.go:117] "RemoveContainer" containerID="d79c2f3c306440245ea3c87499ecbd57019df4411b3f95380c7878d096c20e99"
Jun 08 12:07:21.651680 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:07:21.651659    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-credit-scoring-6b6f97cc7d-r5x6x"]
Jun 08 12:07:21.657297 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:07:21.657253    2583 scope.go:117] "RemoveContainer" containerID="b669ac039e5878538da62f5d5db3ae1f139f1024d7035becaab754427d4fd95c"
Jun 08 12:07:21.664594 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:07:21.664578    2583 scope.go:117] "RemoveContainer" containerID="a541eccb8c3ac6ae2ec13dba5174f653d73222fc92b30bd7a4f1ed2bd70351f9"
Jun 08 12:07:21.664883 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:07:21.664864    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a541eccb8c3ac6ae2ec13dba5174f653d73222fc92b30bd7a4f1ed2bd70351f9\": container with ID starting with a541eccb8c3ac6ae2ec13dba5174f653d73222fc92b30bd7a4f1ed2bd70351f9 not found: ID does not exist" containerID="a541eccb8c3ac6ae2ec13dba5174f653d73222fc92b30bd7a4f1ed2bd70351f9"
Jun 08 12:07:21.664931 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:07:21.664893    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a541eccb8c3ac6ae2ec13dba5174f653d73222fc92b30bd7a4f1ed2bd70351f9"} err="failed to get container status \"a541eccb8c3ac6ae2ec13dba5174f653d73222fc92b30bd7a4f1ed2bd70351f9\": rpc error: code = NotFound desc = could not find container \"a541eccb8c3ac6ae2ec13dba5174f653d73222fc92b30bd7a4f1ed2bd70351f9\": container with ID starting with a541eccb8c3ac6ae2ec13dba5174f653d73222fc92b30bd7a4f1ed2bd70351f9 not found: ID does not exist"
Jun 08 12:07:21.664931 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:07:21.664912    2583 scope.go:117] "RemoveContainer" containerID="0be752a9f02603b50b13d4eb0cb2916a1437194f0e431f9149a18226b2ad2763"
Jun 08 12:07:21.665164 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:07:21.665144    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0be752a9f02603b50b13d4eb0cb2916a1437194f0e431f9149a18226b2ad2763\": container with ID starting with 0be752a9f02603b50b13d4eb0cb2916a1437194f0e431f9149a18226b2ad2763 not found: ID does not exist" containerID="0be752a9f02603b50b13d4eb0cb2916a1437194f0e431f9149a18226b2ad2763"
Jun 08 12:07:21.665214 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:07:21.665177    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0be752a9f02603b50b13d4eb0cb2916a1437194f0e431f9149a18226b2ad2763"} err="failed to get container status \"0be752a9f02603b50b13d4eb0cb2916a1437194f0e431f9149a18226b2ad2763\": rpc error: code = NotFound desc = could not find container \"0be752a9f02603b50b13d4eb0cb2916a1437194f0e431f9149a18226b2ad2763\": container with ID starting with 0be752a9f02603b50b13d4eb0cb2916a1437194f0e431f9149a18226b2ad2763 not found: ID does not exist"
Jun 08 12:07:21.665214 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:07:21.665195    2583 scope.go:117] "RemoveContainer" containerID="4f478768495612679eeb586fe5a349162b9fefef4df8bae9bdab7fed7d6b7e3e"
Jun 08 12:07:21.665431 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:07:21.665414    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f478768495612679eeb586fe5a349162b9fefef4df8bae9bdab7fed7d6b7e3e\": container with ID starting with 4f478768495612679eeb586fe5a349162b9fefef4df8bae9bdab7fed7d6b7e3e not found: ID does not exist" containerID="4f478768495612679eeb586fe5a349162b9fefef4df8bae9bdab7fed7d6b7e3e"
Jun 08 12:07:21.665473 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:07:21.665436    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f478768495612679eeb586fe5a349162b9fefef4df8bae9bdab7fed7d6b7e3e"} err="failed to get container status \"4f478768495612679eeb586fe5a349162b9fefef4df8bae9bdab7fed7d6b7e3e\": rpc error: code = NotFound desc = could not find container \"4f478768495612679eeb586fe5a349162b9fefef4df8bae9bdab7fed7d6b7e3e\": container with ID starting with 4f478768495612679eeb586fe5a349162b9fefef4df8bae9bdab7fed7d6b7e3e not found: ID does not exist"
Jun 08 12:07:21.665473 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:07:21.665452    2583 scope.go:117] "RemoveContainer" containerID="d79c2f3c306440245ea3c87499ecbd57019df4411b3f95380c7878d096c20e99"
Jun 08 12:07:21.665645 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:07:21.665629    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d79c2f3c306440245ea3c87499ecbd57019df4411b3f95380c7878d096c20e99\": container with ID starting with d79c2f3c306440245ea3c87499ecbd57019df4411b3f95380c7878d096c20e99 not found: ID does not exist" containerID="d79c2f3c306440245ea3c87499ecbd57019df4411b3f95380c7878d096c20e99"
Jun 08 12:07:21.665691 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:07:21.665648    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d79c2f3c306440245ea3c87499ecbd57019df4411b3f95380c7878d096c20e99"} err="failed to get container status \"d79c2f3c306440245ea3c87499ecbd57019df4411b3f95380c7878d096c20e99\": rpc error: code = NotFound desc = could not find container \"d79c2f3c306440245ea3c87499ecbd57019df4411b3f95380c7878d096c20e99\": container with ID starting with d79c2f3c306440245ea3c87499ecbd57019df4411b3f95380c7878d096c20e99 not found: ID does not exist"
Jun 08 12:07:21.665691 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:07:21.665659    2583 scope.go:117] "RemoveContainer" containerID="b669ac039e5878538da62f5d5db3ae1f139f1024d7035becaab754427d4fd95c"
Jun 08 12:07:21.665840 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:07:21.665824    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b669ac039e5878538da62f5d5db3ae1f139f1024d7035becaab754427d4fd95c\": container with ID starting with b669ac039e5878538da62f5d5db3ae1f139f1024d7035becaab754427d4fd95c not found: ID does not exist" containerID="b669ac039e5878538da62f5d5db3ae1f139f1024d7035becaab754427d4fd95c"
Jun 08 12:07:21.665882 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:07:21.665843    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b669ac039e5878538da62f5d5db3ae1f139f1024d7035becaab754427d4fd95c"} err="failed to get container status \"b669ac039e5878538da62f5d5db3ae1f139f1024d7035becaab754427d4fd95c\": rpc error: code = NotFound desc = could not find container \"b669ac039e5878538da62f5d5db3ae1f139f1024d7035becaab754427d4fd95c\": container with ID starting with b669ac039e5878538da62f5d5db3ae1f139f1024d7035becaab754427d4fd95c not found: ID does not exist"
Jun 08 12:07:21.665882 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:07:21.665855    2583 scope.go:117] "RemoveContainer" containerID="a541eccb8c3ac6ae2ec13dba5174f653d73222fc92b30bd7a4f1ed2bd70351f9"
Jun 08 12:07:21.666035 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:07:21.666015    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a541eccb8c3ac6ae2ec13dba5174f653d73222fc92b30bd7a4f1ed2bd70351f9"} err="failed to get container status \"a541eccb8c3ac6ae2ec13dba5174f653d73222fc92b30bd7a4f1ed2bd70351f9\": rpc error: code = NotFound desc = could not find container \"a541eccb8c3ac6ae2ec13dba5174f653d73222fc92b30bd7a4f1ed2bd70351f9\": container with ID starting with a541eccb8c3ac6ae2ec13dba5174f653d73222fc92b30bd7a4f1ed2bd70351f9 not found: ID does not exist"
Jun 08 12:07:21.666091 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:07:21.666035    2583 scope.go:117] "RemoveContainer" containerID="0be752a9f02603b50b13d4eb0cb2916a1437194f0e431f9149a18226b2ad2763"
Jun 08 12:07:21.666256 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:07:21.666239    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0be752a9f02603b50b13d4eb0cb2916a1437194f0e431f9149a18226b2ad2763"} err="failed to get container status \"0be752a9f02603b50b13d4eb0cb2916a1437194f0e431f9149a18226b2ad2763\": rpc error: code = NotFound desc = could not find container \"0be752a9f02603b50b13d4eb0cb2916a1437194f0e431f9149a18226b2ad2763\": container with ID starting with 0be752a9f02603b50b13d4eb0cb2916a1437194f0e431f9149a18226b2ad2763 not found: ID does not exist"
Jun 08 12:07:21.666300 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:07:21.666255    2583 scope.go:117] "RemoveContainer" containerID="4f478768495612679eeb586fe5a349162b9fefef4df8bae9bdab7fed7d6b7e3e"
Jun 08 12:07:21.666462 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:07:21.666445    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f478768495612679eeb586fe5a349162b9fefef4df8bae9bdab7fed7d6b7e3e"} err="failed to get container status \"4f478768495612679eeb586fe5a349162b9fefef4df8bae9bdab7fed7d6b7e3e\": rpc error: code = NotFound desc = could not find container \"4f478768495612679eeb586fe5a349162b9fefef4df8bae9bdab7fed7d6b7e3e\": container with ID starting with 4f478768495612679eeb586fe5a349162b9fefef4df8bae9bdab7fed7d6b7e3e not found: ID does not exist"
Jun 08 12:07:21.666508 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:07:21.666463    2583 scope.go:117] "RemoveContainer" containerID="d79c2f3c306440245ea3c87499ecbd57019df4411b3f95380c7878d096c20e99"
Jun 08 12:07:21.666658 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:07:21.666632    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d79c2f3c306440245ea3c87499ecbd57019df4411b3f95380c7878d096c20e99"} err="failed to get container status \"d79c2f3c306440245ea3c87499ecbd57019df4411b3f95380c7878d096c20e99\": rpc error: code = NotFound desc = could not find container \"d79c2f3c306440245ea3c87499ecbd57019df4411b3f95380c7878d096c20e99\": container with ID starting with d79c2f3c306440245ea3c87499ecbd57019df4411b3f95380c7878d096c20e99 not found: ID does not exist"
Jun 08 12:07:21.666714 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:07:21.666658    2583 scope.go:117] "RemoveContainer" containerID="b669ac039e5878538da62f5d5db3ae1f139f1024d7035becaab754427d4fd95c"
Jun 08 12:07:21.666867 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:07:21.666848    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b669ac039e5878538da62f5d5db3ae1f139f1024d7035becaab754427d4fd95c"} err="failed to get container status \"b669ac039e5878538da62f5d5db3ae1f139f1024d7035becaab754427d4fd95c\": rpc error: code = NotFound desc = could not find container \"b669ac039e5878538da62f5d5db3ae1f139f1024d7035becaab754427d4fd95c\": container with ID starting with b669ac039e5878538da62f5d5db3ae1f139f1024d7035becaab754427d4fd95c not found: ID does not exist"
Jun 08 12:07:23.186003 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:07:23.185964    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e9a8baa-6435-4a4f-ba71-c9a46b82c17c" path="/var/lib/kubelet/pods/6e9a8baa-6435-4a4f-ba71-c9a46b82c17c/volumes"
Jun 08 12:07:59.208009 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:07:59.207975    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mnnbj_cdf82c13-c30a-474a-a135-3d1dbcbb6046/console-operator/2.log"
Jun 08 12:07:59.211682 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:07:59.211658    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mnnbj_cdf82c13-c30a-474a-a135-3d1dbcbb6046/console-operator/2.log"
Jun 08 12:09:20.455412 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:20.455380    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-fdrc9"]
Jun 08 12:09:20.455857 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:20.455673    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c72e81d1-a0e3-44d6-8ae3-1ecfc64717c2" containerName="redis"
Jun 08 12:09:20.455857 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:20.455684    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="c72e81d1-a0e3-44d6-8ae3-1ecfc64717c2" containerName="redis"
Jun 08 12:09:20.455857 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:20.455695    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e9a8baa-6435-4a4f-ba71-c9a46b82c17c" containerName="registry"
Jun 08 12:09:20.455857 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:20.455701    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e9a8baa-6435-4a4f-ba71-c9a46b82c17c" containerName="registry"
Jun 08 12:09:20.455857 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:20.455709    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e9a8baa-6435-4a4f-ba71-c9a46b82c17c" containerName="feast-init"
Jun 08 12:09:20.455857 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:20.455715    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e9a8baa-6435-4a4f-ba71-c9a46b82c17c" containerName="feast-init"
Jun 08 12:09:20.455857 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:20.455722    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e9a8baa-6435-4a4f-ba71-c9a46b82c17c" containerName="feast-apply"
Jun 08 12:09:20.455857 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:20.455728    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e9a8baa-6435-4a4f-ba71-c9a46b82c17c" containerName="feast-apply"
Jun 08 12:09:20.455857 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:20.455735    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e9a8baa-6435-4a4f-ba71-c9a46b82c17c" containerName="offline"
Jun 08 12:09:20.455857 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:20.455740    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e9a8baa-6435-4a4f-ba71-c9a46b82c17c" containerName="offline"
Jun 08 12:09:20.455857 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:20.455749    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="214233d3-8861-43ea-8d89-dbc904516273" containerName="postgres"
Jun 08 12:09:20.455857 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:20.455754    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="214233d3-8861-43ea-8d89-dbc904516273" containerName="postgres"
Jun 08 12:09:20.455857 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:20.455762    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e9a8baa-6435-4a4f-ba71-c9a46b82c17c" containerName="online"
Jun 08 12:09:20.455857 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:20.455766    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e9a8baa-6435-4a4f-ba71-c9a46b82c17c" containerName="online"
Jun 08 12:09:20.455857 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:20.455815    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="214233d3-8861-43ea-8d89-dbc904516273" containerName="postgres"
Jun 08 12:09:20.455857 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:20.455822    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e9a8baa-6435-4a4f-ba71-c9a46b82c17c" containerName="offline"
Jun 08 12:09:20.455857 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:20.455832    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="c72e81d1-a0e3-44d6-8ae3-1ecfc64717c2" containerName="redis"
Jun 08 12:09:20.455857 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:20.455838    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e9a8baa-6435-4a4f-ba71-c9a46b82c17c" containerName="online"
Jun 08 12:09:20.455857 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:20.455844    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e9a8baa-6435-4a4f-ba71-c9a46b82c17c" containerName="registry"
Jun 08 12:09:20.458935 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:20.458905    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-fdrc9"
Jun 08 12:09:20.461565 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:20.461542    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"kube-root-ca.crt\""
Jun 08 12:09:20.461850 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:20.461830    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"openshift-service-ca.crt\""
Jun 08 12:09:20.462407 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:20.462389    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"default-dockercfg-wc2br\""
Jun 08 12:09:20.477126 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:20.477099    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-fdrc9"]
Jun 08 12:09:20.626999 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:20.626963    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-www4p\" (UniqueName: \"kubernetes.io/projected/39e0b3b3-3dbd-4899-9bba-9d1e8cf0516a-kube-api-access-www4p\") pod \"redis-69bbd798b6-fdrc9\" (UID: \"39e0b3b3-3dbd-4899-9bba-9d1e8cf0516a\") " pod="test-ns-feast-rest/redis-69bbd798b6-fdrc9"
Jun 08 12:09:20.727474 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:20.727381    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-www4p\" (UniqueName: \"kubernetes.io/projected/39e0b3b3-3dbd-4899-9bba-9d1e8cf0516a-kube-api-access-www4p\") pod \"redis-69bbd798b6-fdrc9\" (UID: \"39e0b3b3-3dbd-4899-9bba-9d1e8cf0516a\") " pod="test-ns-feast-rest/redis-69bbd798b6-fdrc9"
Jun 08 12:09:20.736993 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:20.736967    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-www4p\" (UniqueName: \"kubernetes.io/projected/39e0b3b3-3dbd-4899-9bba-9d1e8cf0516a-kube-api-access-www4p\") pod \"redis-69bbd798b6-fdrc9\" (UID: \"39e0b3b3-3dbd-4899-9bba-9d1e8cf0516a\") " pod="test-ns-feast-rest/redis-69bbd798b6-fdrc9"
Jun 08 12:09:20.780545 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:20.780511    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-fdrc9"
Jun 08 12:09:20.903913 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:20.903874    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-fdrc9"]
Jun 08 12:09:20.908527 ip-10-0-136-189 kubenswrapper[2583]: W0608 12:09:20.908486    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod39e0b3b3_3dbd_4899_9bba_9d1e8cf0516a.slice/crio-01f58c6b3df482660016183e8d93636944269baac1f40a12b229eda13151fd3c WatchSource:0}: Error finding container 01f58c6b3df482660016183e8d93636944269baac1f40a12b229eda13151fd3c: Status 404 returned error can't find the container with id 01f58c6b3df482660016183e8d93636944269baac1f40a12b229eda13151fd3c
Jun 08 12:09:21.085415 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:21.085327    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-fdrc9" event={"ID":"39e0b3b3-3dbd-4899-9bba-9d1e8cf0516a","Type":"ContainerStarted","Data":"a8643d7ee21b93bbbfb9b2c5ca2839283e6e3a1e28de19fd2c91a370b6fc5ffe"}
Jun 08 12:09:21.085415 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:21.085368    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-fdrc9" event={"ID":"39e0b3b3-3dbd-4899-9bba-9d1e8cf0516a","Type":"ContainerStarted","Data":"01f58c6b3df482660016183e8d93636944269baac1f40a12b229eda13151fd3c"}
Jun 08 12:09:21.102970 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:21.102909    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/redis-69bbd798b6-fdrc9" podStartSLOduration=1.102892942 podStartE2EDuration="1.102892942s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:09:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:09:21.101529228 +0000 UTC m=+1282.373104421" watchObservedRunningTime="2026-06-08 12:09:21.102892942 +0000 UTC m=+1282.374468118"
Jun 08 12:09:25.871569 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:25.871530    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-xbfvg"]
Jun 08 12:09:25.874585 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:25.874566    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-xbfvg"
Jun 08 12:09:25.877368 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:25.877327    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"postgres-secret\""
Jun 08 12:09:25.879893 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:25.879858    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-xbfvg"]
Jun 08 12:09:25.972408 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:25.972379    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ql98r\" (UniqueName: \"kubernetes.io/projected/1edf77ba-c975-48fa-9472-b43847c0607f-kube-api-access-ql98r\") pod \"postgres-864846d4f5-xbfvg\" (UID: \"1edf77ba-c975-48fa-9472-b43847c0607f\") " pod="test-ns-feast-rest/postgres-864846d4f5-xbfvg"
Jun 08 12:09:25.972516 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:25.972419    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/1edf77ba-c975-48fa-9472-b43847c0607f-postgresdata\") pod \"postgres-864846d4f5-xbfvg\" (UID: \"1edf77ba-c975-48fa-9472-b43847c0607f\") " pod="test-ns-feast-rest/postgres-864846d4f5-xbfvg"
Jun 08 12:09:26.073589 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:26.073563    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ql98r\" (UniqueName: \"kubernetes.io/projected/1edf77ba-c975-48fa-9472-b43847c0607f-kube-api-access-ql98r\") pod \"postgres-864846d4f5-xbfvg\" (UID: \"1edf77ba-c975-48fa-9472-b43847c0607f\") " pod="test-ns-feast-rest/postgres-864846d4f5-xbfvg"
Jun 08 12:09:26.073687 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:26.073622    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/1edf77ba-c975-48fa-9472-b43847c0607f-postgresdata\") pod \"postgres-864846d4f5-xbfvg\" (UID: \"1edf77ba-c975-48fa-9472-b43847c0607f\") " pod="test-ns-feast-rest/postgres-864846d4f5-xbfvg"
Jun 08 12:09:26.078894 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:26.074567    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/1edf77ba-c975-48fa-9472-b43847c0607f-postgresdata\") pod \"postgres-864846d4f5-xbfvg\" (UID: \"1edf77ba-c975-48fa-9472-b43847c0607f\") " pod="test-ns-feast-rest/postgres-864846d4f5-xbfvg"
Jun 08 12:09:26.083915 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:26.083885    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ql98r\" (UniqueName: \"kubernetes.io/projected/1edf77ba-c975-48fa-9472-b43847c0607f-kube-api-access-ql98r\") pod \"postgres-864846d4f5-xbfvg\" (UID: \"1edf77ba-c975-48fa-9472-b43847c0607f\") " pod="test-ns-feast-rest/postgres-864846d4f5-xbfvg"
Jun 08 12:09:26.185749 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:26.185685    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-xbfvg"
Jun 08 12:09:26.308993 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:26.308966    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-xbfvg"]
Jun 08 12:09:26.311707 ip-10-0-136-189 kubenswrapper[2583]: W0608 12:09:26.311680    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1edf77ba_c975_48fa_9472_b43847c0607f.slice/crio-9a6ff37aa32cd6a31d554a1da6407829ba8ef8791fe645d1f6947b250a1993d3 WatchSource:0}: Error finding container 9a6ff37aa32cd6a31d554a1da6407829ba8ef8791fe645d1f6947b250a1993d3: Status 404 returned error can't find the container with id 9a6ff37aa32cd6a31d554a1da6407829ba8ef8791fe645d1f6947b250a1993d3
Jun 08 12:09:27.110387 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:27.110346    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-xbfvg" event={"ID":"1edf77ba-c975-48fa-9472-b43847c0607f","Type":"ContainerStarted","Data":"db61e6495535beb888737c64a15cfc3abdbb800ab7cc6fe6cca19f859cd721bf"}
Jun 08 12:09:27.110777 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:27.110396    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-xbfvg" event={"ID":"1edf77ba-c975-48fa-9472-b43847c0607f","Type":"ContainerStarted","Data":"9a6ff37aa32cd6a31d554a1da6407829ba8ef8791fe645d1f6947b250a1993d3"}
Jun 08 12:09:27.125313 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:27.125122    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/postgres-864846d4f5-xbfvg" podStartSLOduration=2.125103395 podStartE2EDuration="2.125103395s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:09:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:09:27.124447492 +0000 UTC m=+1288.396022670" watchObservedRunningTime="2026-06-08 12:09:27.125103395 +0000 UTC m=+1288.396678573"
Jun 08 12:09:31.508479 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:31.508446    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-cb9459fc7-j2748"]
Jun 08 12:09:31.512258 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:31.512234    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-cb9459fc7-j2748"
Jun 08 12:09:31.514891 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:31.514872    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-online-tls\""
Jun 08 12:09:31.515420 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:31.515403    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-registry-tls\""
Jun 08 12:09:31.515518 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:31.515430    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-intra-comm\""
Jun 08 12:09:31.515518 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:31.515406    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-dockercfg-s2wmn\""
Jun 08 12:09:31.518726 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:31.518706    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a09f9a25-915c-423b-9b98-bf709dfb964a-online-tls\") pod \"feast-credit-scoring-cb9459fc7-j2748\" (UID: \"a09f9a25-915c-423b-9b98-bf709dfb964a\") " pod="test-ns-feast-rest/feast-credit-scoring-cb9459fc7-j2748"
Jun 08 12:09:31.518820 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:31.518781    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a09f9a25-915c-423b-9b98-bf709dfb964a-registry-tls\") pod \"feast-credit-scoring-cb9459fc7-j2748\" (UID: \"a09f9a25-915c-423b-9b98-bf709dfb964a\") " pod="test-ns-feast-rest/feast-credit-scoring-cb9459fc7-j2748"
Jun 08 12:09:31.518884 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:31.518818    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vffmb\" (UniqueName: \"kubernetes.io/projected/a09f9a25-915c-423b-9b98-bf709dfb964a-kube-api-access-vffmb\") pod \"feast-credit-scoring-cb9459fc7-j2748\" (UID: \"a09f9a25-915c-423b-9b98-bf709dfb964a\") " pod="test-ns-feast-rest/feast-credit-scoring-cb9459fc7-j2748"
Jun 08 12:09:31.519282 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:31.518884    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a09f9a25-915c-423b-9b98-bf709dfb964a-feast-data\") pod \"feast-credit-scoring-cb9459fc7-j2748\" (UID: \"a09f9a25-915c-423b-9b98-bf709dfb964a\") " pod="test-ns-feast-rest/feast-credit-scoring-cb9459fc7-j2748"
Jun 08 12:09:31.525621 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:31.525599    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-cb9459fc7-j2748"]
Jun 08 12:09:31.619827 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:31.619802    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a09f9a25-915c-423b-9b98-bf709dfb964a-registry-tls\") pod \"feast-credit-scoring-cb9459fc7-j2748\" (UID: \"a09f9a25-915c-423b-9b98-bf709dfb964a\") " pod="test-ns-feast-rest/feast-credit-scoring-cb9459fc7-j2748"
Jun 08 12:09:31.619938 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:31.619837    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vffmb\" (UniqueName: \"kubernetes.io/projected/a09f9a25-915c-423b-9b98-bf709dfb964a-kube-api-access-vffmb\") pod \"feast-credit-scoring-cb9459fc7-j2748\" (UID: \"a09f9a25-915c-423b-9b98-bf709dfb964a\") " pod="test-ns-feast-rest/feast-credit-scoring-cb9459fc7-j2748"
Jun 08 12:09:31.619938 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:31.619858    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a09f9a25-915c-423b-9b98-bf709dfb964a-feast-data\") pod \"feast-credit-scoring-cb9459fc7-j2748\" (UID: \"a09f9a25-915c-423b-9b98-bf709dfb964a\") " pod="test-ns-feast-rest/feast-credit-scoring-cb9459fc7-j2748"
Jun 08 12:09:31.619938 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:31.619882    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a09f9a25-915c-423b-9b98-bf709dfb964a-online-tls\") pod \"feast-credit-scoring-cb9459fc7-j2748\" (UID: \"a09f9a25-915c-423b-9b98-bf709dfb964a\") " pod="test-ns-feast-rest/feast-credit-scoring-cb9459fc7-j2748"
Jun 08 12:09:31.620126 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:09:31.619966    2583 secret.go:189] Couldn't get secret test-ns-feast-rest/feast-credit-scoring-online-tls: secret "feast-credit-scoring-online-tls" not found
Jun 08 12:09:31.620126 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:09:31.620012    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a09f9a25-915c-423b-9b98-bf709dfb964a-online-tls podName:a09f9a25-915c-423b-9b98-bf709dfb964a nodeName:}" failed. No retries permitted until 2026-06-08 12:09:32.119998237 +0000 UTC m=+1293.391573391 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/a09f9a25-915c-423b-9b98-bf709dfb964a-online-tls") pod "feast-credit-scoring-cb9459fc7-j2748" (UID: "a09f9a25-915c-423b-9b98-bf709dfb964a") : secret "feast-credit-scoring-online-tls" not found
Jun 08 12:09:31.620334 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:31.620313    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a09f9a25-915c-423b-9b98-bf709dfb964a-feast-data\") pod \"feast-credit-scoring-cb9459fc7-j2748\" (UID: \"a09f9a25-915c-423b-9b98-bf709dfb964a\") " pod="test-ns-feast-rest/feast-credit-scoring-cb9459fc7-j2748"
Jun 08 12:09:31.622132 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:31.622114    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a09f9a25-915c-423b-9b98-bf709dfb964a-registry-tls\") pod \"feast-credit-scoring-cb9459fc7-j2748\" (UID: \"a09f9a25-915c-423b-9b98-bf709dfb964a\") " pod="test-ns-feast-rest/feast-credit-scoring-cb9459fc7-j2748"
Jun 08 12:09:31.628994 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:31.628971    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vffmb\" (UniqueName: \"kubernetes.io/projected/a09f9a25-915c-423b-9b98-bf709dfb964a-kube-api-access-vffmb\") pod \"feast-credit-scoring-cb9459fc7-j2748\" (UID: \"a09f9a25-915c-423b-9b98-bf709dfb964a\") " pod="test-ns-feast-rest/feast-credit-scoring-cb9459fc7-j2748"
Jun 08 12:09:32.123952 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:32.123915    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a09f9a25-915c-423b-9b98-bf709dfb964a-online-tls\") pod \"feast-credit-scoring-cb9459fc7-j2748\" (UID: \"a09f9a25-915c-423b-9b98-bf709dfb964a\") " pod="test-ns-feast-rest/feast-credit-scoring-cb9459fc7-j2748"
Jun 08 12:09:32.126359 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:32.126334    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a09f9a25-915c-423b-9b98-bf709dfb964a-online-tls\") pod \"feast-credit-scoring-cb9459fc7-j2748\" (UID: \"a09f9a25-915c-423b-9b98-bf709dfb964a\") " pod="test-ns-feast-rest/feast-credit-scoring-cb9459fc7-j2748"
Jun 08 12:09:32.421357 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:32.421262    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-cb9459fc7-j2748"
Jun 08 12:09:32.563408 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:32.563377    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-cb9459fc7-j2748"]
Jun 08 12:09:32.564546 ip-10-0-136-189 kubenswrapper[2583]: W0608 12:09:32.564522    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda09f9a25_915c_423b_9b98_bf709dfb964a.slice/crio-96b74b2c659f3868ae89d4bbf996fffad6cbff481b60ac0414915b47cc315b89 WatchSource:0}: Error finding container 96b74b2c659f3868ae89d4bbf996fffad6cbff481b60ac0414915b47cc315b89: Status 404 returned error can't find the container with id 96b74b2c659f3868ae89d4bbf996fffad6cbff481b60ac0414915b47cc315b89
Jun 08 12:09:33.135340 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:33.135297    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-cb9459fc7-j2748" event={"ID":"a09f9a25-915c-423b-9b98-bf709dfb964a","Type":"ContainerStarted","Data":"6dfcd0b6c131831d3369e7f7a9c677485579f0f5ec760da8ae6b32f438b16e0d"}
Jun 08 12:09:33.135502 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:33.135350    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-cb9459fc7-j2748" event={"ID":"a09f9a25-915c-423b-9b98-bf709dfb964a","Type":"ContainerStarted","Data":"96b74b2c659f3868ae89d4bbf996fffad6cbff481b60ac0414915b47cc315b89"}
Jun 08 12:09:34.140482 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:34.140445    2583 generic.go:356] "Generic (PLEG): container finished" podID="a09f9a25-915c-423b-9b98-bf709dfb964a" containerID="6dfcd0b6c131831d3369e7f7a9c677485579f0f5ec760da8ae6b32f438b16e0d" exitCode=0
Jun 08 12:09:34.140938 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:34.140501    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-cb9459fc7-j2748" event={"ID":"a09f9a25-915c-423b-9b98-bf709dfb964a","Type":"ContainerDied","Data":"6dfcd0b6c131831d3369e7f7a9c677485579f0f5ec760da8ae6b32f438b16e0d"}
Jun 08 12:09:35.146922 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:35.146887    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-cb9459fc7-j2748" event={"ID":"a09f9a25-915c-423b-9b98-bf709dfb964a","Type":"ContainerStarted","Data":"b5dfa2efea562db141867a9644b520d7ca1aabe5884d169ce7d952b3e642e545"}
Jun 08 12:09:41.173206 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:41.173173    2583 generic.go:356] "Generic (PLEG): container finished" podID="a09f9a25-915c-423b-9b98-bf709dfb964a" containerID="b5dfa2efea562db141867a9644b520d7ca1aabe5884d169ce7d952b3e642e545" exitCode=0
Jun 08 12:09:41.173562 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:41.173221    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-cb9459fc7-j2748" event={"ID":"a09f9a25-915c-423b-9b98-bf709dfb964a","Type":"ContainerDied","Data":"b5dfa2efea562db141867a9644b520d7ca1aabe5884d169ce7d952b3e642e545"}
Jun 08 12:09:42.180640 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:42.180601    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-cb9459fc7-j2748" event={"ID":"a09f9a25-915c-423b-9b98-bf709dfb964a","Type":"ContainerStarted","Data":"77667c0b980aa72c0e863d7882c26682ea7482b27eecd6c357003e889b3851ec"}
Jun 08 12:09:42.181009 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:42.180682    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-cb9459fc7-j2748" event={"ID":"a09f9a25-915c-423b-9b98-bf709dfb964a","Type":"ContainerStarted","Data":"5163e1c72a8a6aa43936179b12c62c9012f6ed2aab05cf588a9f8f381892210f"}
Jun 08 12:09:42.204927 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:42.204864    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-credit-scoring-cb9459fc7-j2748" podStartSLOduration=11.204847779 podStartE2EDuration="11.204847779s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:09:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:09:42.20369826 +0000 UTC m=+1303.475273431" watchObservedRunningTime="2026-06-08 12:09:42.204847779 +0000 UTC m=+1303.476422958"
Jun 08 12:09:42.422259 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:42.422221    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-cb9459fc7-j2748"
Jun 08 12:09:42.422434 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:42.422297    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-cb9459fc7-j2748"
Jun 08 12:09:44.421875 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:44.421834    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-cb9459fc7-j2748"
Jun 08 12:09:44.422337 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:44.421913    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-cb9459fc7-j2748"
Jun 08 12:09:44.423582 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:44.423554    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-cb9459fc7-j2748" podUID="a09f9a25-915c-423b-9b98-bf709dfb964a" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.35:6571: connect: connection refused"
Jun 08 12:09:44.423711 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:44.423592    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-cb9459fc7-j2748" podUID="a09f9a25-915c-423b-9b98-bf709dfb964a" containerName="online" probeResult="failure" output="Get \"https://10.132.0.35:6567/health\": dial tcp 10.132.0.35:6567: connect: connection refused"
Jun 08 12:09:47.422608 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:47.422558    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-cb9459fc7-j2748" podUID="a09f9a25-915c-423b-9b98-bf709dfb964a" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.35:6571: connect: connection refused"
Jun 08 12:09:47.427981 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:47.427948    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-cb9459fc7-j2748"
Jun 08 12:09:47.431346 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:47.431325    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-cb9459fc7-j2748"
Jun 08 12:09:50.422544 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:50.422499    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-cb9459fc7-j2748" podUID="a09f9a25-915c-423b-9b98-bf709dfb964a" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.35:6571: connect: connection refused"
Jun 08 12:09:53.422693 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:53.422657    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-cb9459fc7-j2748"
Jun 08 12:09:53.423371 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:53.423350    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-cb9459fc7-j2748"
Jun 08 12:09:57.217947 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:57.217911    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-6894b75f6b-xqwcm"]
Jun 08 12:09:57.222106 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:57.222088    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-6894b75f6b-xqwcm"
Jun 08 12:09:57.224873 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:57.224848    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-online-tls\""
Jun 08 12:09:57.225003 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:57.224848    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-registry-tls\""
Jun 08 12:09:57.225003 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:57.224944    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-intra-comm\""
Jun 08 12:09:57.225219 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:57.225203    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-dockercfg-j5q6n\""
Jun 08 12:09:57.233194 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:57.233165    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-6894b75f6b-xqwcm"]
Jun 08 12:09:57.343433 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:57.343404    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ba22acd9-5197-42aa-97a9-a48ce2c27e7c-online-tls\") pod \"feast-driver-ranking-6894b75f6b-xqwcm\" (UID: \"ba22acd9-5197-42aa-97a9-a48ce2c27e7c\") " pod="test-ns-feast-rest/feast-driver-ranking-6894b75f6b-xqwcm"
Jun 08 12:09:57.343565 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:57.343441    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ba22acd9-5197-42aa-97a9-a48ce2c27e7c-feast-data\") pod \"feast-driver-ranking-6894b75f6b-xqwcm\" (UID: \"ba22acd9-5197-42aa-97a9-a48ce2c27e7c\") " pod="test-ns-feast-rest/feast-driver-ranking-6894b75f6b-xqwcm"
Jun 08 12:09:57.343565 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:57.343468    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqhj8\" (UniqueName: \"kubernetes.io/projected/ba22acd9-5197-42aa-97a9-a48ce2c27e7c-kube-api-access-sqhj8\") pod \"feast-driver-ranking-6894b75f6b-xqwcm\" (UID: \"ba22acd9-5197-42aa-97a9-a48ce2c27e7c\") " pod="test-ns-feast-rest/feast-driver-ranking-6894b75f6b-xqwcm"
Jun 08 12:09:57.343743 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:57.343582    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ba22acd9-5197-42aa-97a9-a48ce2c27e7c-registry-tls\") pod \"feast-driver-ranking-6894b75f6b-xqwcm\" (UID: \"ba22acd9-5197-42aa-97a9-a48ce2c27e7c\") " pod="test-ns-feast-rest/feast-driver-ranking-6894b75f6b-xqwcm"
Jun 08 12:09:57.444979 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:57.444949    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ba22acd9-5197-42aa-97a9-a48ce2c27e7c-registry-tls\") pod \"feast-driver-ranking-6894b75f6b-xqwcm\" (UID: \"ba22acd9-5197-42aa-97a9-a48ce2c27e7c\") " pod="test-ns-feast-rest/feast-driver-ranking-6894b75f6b-xqwcm"
Jun 08 12:09:57.445131 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:57.444990    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ba22acd9-5197-42aa-97a9-a48ce2c27e7c-online-tls\") pod \"feast-driver-ranking-6894b75f6b-xqwcm\" (UID: \"ba22acd9-5197-42aa-97a9-a48ce2c27e7c\") " pod="test-ns-feast-rest/feast-driver-ranking-6894b75f6b-xqwcm"
Jun 08 12:09:57.445131 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:57.445015    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ba22acd9-5197-42aa-97a9-a48ce2c27e7c-feast-data\") pod \"feast-driver-ranking-6894b75f6b-xqwcm\" (UID: \"ba22acd9-5197-42aa-97a9-a48ce2c27e7c\") " pod="test-ns-feast-rest/feast-driver-ranking-6894b75f6b-xqwcm"
Jun 08 12:09:57.445131 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:57.445038    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqhj8\" (UniqueName: \"kubernetes.io/projected/ba22acd9-5197-42aa-97a9-a48ce2c27e7c-kube-api-access-sqhj8\") pod \"feast-driver-ranking-6894b75f6b-xqwcm\" (UID: \"ba22acd9-5197-42aa-97a9-a48ce2c27e7c\") " pod="test-ns-feast-rest/feast-driver-ranking-6894b75f6b-xqwcm"
Jun 08 12:09:57.445384 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:57.445367    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ba22acd9-5197-42aa-97a9-a48ce2c27e7c-feast-data\") pod \"feast-driver-ranking-6894b75f6b-xqwcm\" (UID: \"ba22acd9-5197-42aa-97a9-a48ce2c27e7c\") " pod="test-ns-feast-rest/feast-driver-ranking-6894b75f6b-xqwcm"
Jun 08 12:09:57.447522 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:57.447504    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ba22acd9-5197-42aa-97a9-a48ce2c27e7c-registry-tls\") pod \"feast-driver-ranking-6894b75f6b-xqwcm\" (UID: \"ba22acd9-5197-42aa-97a9-a48ce2c27e7c\") " pod="test-ns-feast-rest/feast-driver-ranking-6894b75f6b-xqwcm"
Jun 08 12:09:57.447588 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:57.447553    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ba22acd9-5197-42aa-97a9-a48ce2c27e7c-online-tls\") pod \"feast-driver-ranking-6894b75f6b-xqwcm\" (UID: \"ba22acd9-5197-42aa-97a9-a48ce2c27e7c\") " pod="test-ns-feast-rest/feast-driver-ranking-6894b75f6b-xqwcm"
Jun 08 12:09:57.453086 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:57.453041    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqhj8\" (UniqueName: \"kubernetes.io/projected/ba22acd9-5197-42aa-97a9-a48ce2c27e7c-kube-api-access-sqhj8\") pod \"feast-driver-ranking-6894b75f6b-xqwcm\" (UID: \"ba22acd9-5197-42aa-97a9-a48ce2c27e7c\") " pod="test-ns-feast-rest/feast-driver-ranking-6894b75f6b-xqwcm"
Jun 08 12:09:57.532556 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:57.532495    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-6894b75f6b-xqwcm"
Jun 08 12:09:57.678481 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:57.678455    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-6894b75f6b-xqwcm"]
Jun 08 12:09:57.680512 ip-10-0-136-189 kubenswrapper[2583]: W0608 12:09:57.680485    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba22acd9_5197_42aa_97a9_a48ce2c27e7c.slice/crio-010a34af8abaac08e4971d9a0b60793c0d77522c5ec284ef6dcbe71843d4fdb0 WatchSource:0}: Error finding container 010a34af8abaac08e4971d9a0b60793c0d77522c5ec284ef6dcbe71843d4fdb0: Status 404 returned error can't find the container with id 010a34af8abaac08e4971d9a0b60793c0d77522c5ec284ef6dcbe71843d4fdb0
Jun 08 12:09:58.250203 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:58.250163    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6894b75f6b-xqwcm" event={"ID":"ba22acd9-5197-42aa-97a9-a48ce2c27e7c","Type":"ContainerStarted","Data":"619efeb322819b0aa1f8022232ef526162ef10ed83bf905da2efcd77f4e62681"}
Jun 08 12:09:58.250674 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:09:58.250217    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6894b75f6b-xqwcm" event={"ID":"ba22acd9-5197-42aa-97a9-a48ce2c27e7c","Type":"ContainerStarted","Data":"010a34af8abaac08e4971d9a0b60793c0d77522c5ec284ef6dcbe71843d4fdb0"}
Jun 08 12:10:02.274575 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:10:02.274540    2583 generic.go:356] "Generic (PLEG): container finished" podID="ba22acd9-5197-42aa-97a9-a48ce2c27e7c" containerID="619efeb322819b0aa1f8022232ef526162ef10ed83bf905da2efcd77f4e62681" exitCode=0
Jun 08 12:10:02.274974 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:10:02.274610    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6894b75f6b-xqwcm" event={"ID":"ba22acd9-5197-42aa-97a9-a48ce2c27e7c","Type":"ContainerDied","Data":"619efeb322819b0aa1f8022232ef526162ef10ed83bf905da2efcd77f4e62681"}
Jun 08 12:10:03.281644 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:10:03.281609    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6894b75f6b-xqwcm" event={"ID":"ba22acd9-5197-42aa-97a9-a48ce2c27e7c","Type":"ContainerStarted","Data":"b084343fd9ce44dccd2132a8aa761514ba7a5d8fbf6144659097a56f6855817c"}
Jun 08 12:10:09.308371 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:10:09.308284    2583 generic.go:356] "Generic (PLEG): container finished" podID="ba22acd9-5197-42aa-97a9-a48ce2c27e7c" containerID="b084343fd9ce44dccd2132a8aa761514ba7a5d8fbf6144659097a56f6855817c" exitCode=0
Jun 08 12:10:09.308371 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:10:09.308332    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6894b75f6b-xqwcm" event={"ID":"ba22acd9-5197-42aa-97a9-a48ce2c27e7c","Type":"ContainerDied","Data":"b084343fd9ce44dccd2132a8aa761514ba7a5d8fbf6144659097a56f6855817c"}
Jun 08 12:10:09.311902 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:10:09.311881    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-intra-comm\""
Jun 08 12:10:10.315711 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:10:10.315671    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6894b75f6b-xqwcm" event={"ID":"ba22acd9-5197-42aa-97a9-a48ce2c27e7c","Type":"ContainerStarted","Data":"8739062dfeb53ddc5a3e16328b7cd50aa344b66df9dd74b6e16a90e9d8af8c2c"}
Jun 08 12:10:10.316156 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:10:10.315736    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6894b75f6b-xqwcm" event={"ID":"ba22acd9-5197-42aa-97a9-a48ce2c27e7c","Type":"ContainerStarted","Data":"e1bbf2c0b3d5d34bc70667282dd89b574436e4e0e427e33c98454f0839a8cc4b"}
Jun 08 12:10:10.351068 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:10:10.345776    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-driver-ranking-6894b75f6b-xqwcm" podStartSLOduration=13.345755236 podStartE2EDuration="13.345755236s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:09:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:10:10.341659769 +0000 UTC m=+1331.613234956" watchObservedRunningTime="2026-06-08 12:10:10.345755236 +0000 UTC m=+1331.617330414"
Jun 08 12:10:12.532656 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:10:12.532623    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-6894b75f6b-xqwcm"
Jun 08 12:10:12.533159 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:10:12.532685    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-6894b75f6b-xqwcm"
Jun 08 12:10:12.534409 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:10:12.534375    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-6894b75f6b-xqwcm" podUID="ba22acd9-5197-42aa-97a9-a48ce2c27e7c" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.36:6571: connect: connection refused"
Jun 08 12:10:12.534527 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:10:12.534410    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-6894b75f6b-xqwcm" podUID="ba22acd9-5197-42aa-97a9-a48ce2c27e7c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.36:6567/health\": dial tcp 10.132.0.36:6567: connect: connection refused"
Jun 08 12:10:15.532759 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:10:15.532722    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-6894b75f6b-xqwcm" podUID="ba22acd9-5197-42aa-97a9-a48ce2c27e7c" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.36:6571: connect: connection refused"
Jun 08 12:10:15.537893 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:10:15.537863    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-6894b75f6b-xqwcm"
Jun 08 12:10:15.538382 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:10:15.538353    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-6894b75f6b-xqwcm"
Jun 08 12:10:15.541169 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:10:15.541147    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-6894b75f6b-xqwcm"
Jun 08 12:10:17.533164 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:10:17.533127    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-6894b75f6b-xqwcm"
Jun 08 12:10:18.533426 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:10:18.533339    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-6894b75f6b-xqwcm" podUID="ba22acd9-5197-42aa-97a9-a48ce2c27e7c" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.36:6571: connect: connection refused"
Jun 08 12:10:21.533753 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:10:21.533721    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-6894b75f6b-xqwcm"
Jun 08 12:10:21.534416 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:10:21.534399    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-6894b75f6b-xqwcm"
Jun 08 12:11:35.387899 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:11:35.387859    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-f8c94dc54-zw6mb"]
Jun 08 12:11:35.388359 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:11:35.388079    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-f8c94dc54-zw6mb" podUID="38573e22-185b-436b-92f6-dabc5a72eb65" containerName="manager" containerID="cri-o://7c63629a19f870504d890be64d900d1a2e91e9681aeafa0a436bbe25cea2c363" gracePeriod=10
Jun 08 12:11:35.683427 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:11:35.683389    2583 generic.go:356] "Generic (PLEG): container finished" podID="38573e22-185b-436b-92f6-dabc5a72eb65" containerID="7c63629a19f870504d890be64d900d1a2e91e9681aeafa0a436bbe25cea2c363" exitCode=0
Jun 08 12:11:35.683576 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:11:35.683471    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-f8c94dc54-zw6mb" event={"ID":"38573e22-185b-436b-92f6-dabc5a72eb65","Type":"ContainerDied","Data":"7c63629a19f870504d890be64d900d1a2e91e9681aeafa0a436bbe25cea2c363"}
Jun 08 12:11:35.683646 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:11:35.683592    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-f8c94dc54-zw6mb" event={"ID":"38573e22-185b-436b-92f6-dabc5a72eb65","Type":"ContainerDied","Data":"417b87484bd65aecee86546a9239236d5b27834e236b510abc8a473d1a21a0f0"}
Jun 08 12:11:35.683646 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:11:35.683621    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="417b87484bd65aecee86546a9239236d5b27834e236b510abc8a473d1a21a0f0"
Jun 08 12:11:35.692612 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:11:35.692583    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-f8c94dc54-zw6mb"
Jun 08 12:11:35.704889 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:11:35.704845    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-6894b75f6b-xqwcm"]
Jun 08 12:11:35.705176 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:11:35.705148    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-6894b75f6b-xqwcm" podUID="ba22acd9-5197-42aa-97a9-a48ce2c27e7c" containerName="registry" containerID="cri-o://e1bbf2c0b3d5d34bc70667282dd89b574436e4e0e427e33c98454f0839a8cc4b" gracePeriod=30
Jun 08 12:11:35.705298 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:11:35.705176    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-6894b75f6b-xqwcm" podUID="ba22acd9-5197-42aa-97a9-a48ce2c27e7c" containerName="online" containerID="cri-o://8739062dfeb53ddc5a3e16328b7cd50aa344b66df9dd74b6e16a90e9d8af8c2c" gracePeriod=30
Jun 08 12:11:35.706562 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:11:35.706539    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-cb9459fc7-j2748"]
Jun 08 12:11:35.706774 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:11:35.706749    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-cb9459fc7-j2748" podUID="a09f9a25-915c-423b-9b98-bf709dfb964a" containerName="registry" containerID="cri-o://5163e1c72a8a6aa43936179b12c62c9012f6ed2aab05cf588a9f8f381892210f" gracePeriod=30
Jun 08 12:11:35.706870 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:11:35.706770    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-cb9459fc7-j2748" podUID="a09f9a25-915c-423b-9b98-bf709dfb964a" containerName="online" containerID="cri-o://77667c0b980aa72c0e863d7882c26682ea7482b27eecd6c357003e889b3851ec" gracePeriod=30
Jun 08 12:11:35.800322 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:11:35.800286    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pr8j8\" (UniqueName: \"kubernetes.io/projected/38573e22-185b-436b-92f6-dabc5a72eb65-kube-api-access-pr8j8\") pod \"38573e22-185b-436b-92f6-dabc5a72eb65\" (UID: \"38573e22-185b-436b-92f6-dabc5a72eb65\") "
Jun 08 12:11:35.802516 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:11:35.802476    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38573e22-185b-436b-92f6-dabc5a72eb65-kube-api-access-pr8j8" (OuterVolumeSpecName: "kube-api-access-pr8j8") pod "38573e22-185b-436b-92f6-dabc5a72eb65" (UID: "38573e22-185b-436b-92f6-dabc5a72eb65"). InnerVolumeSpecName "kube-api-access-pr8j8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 08 12:11:35.901533 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:11:35.901483    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pr8j8\" (UniqueName: \"kubernetes.io/projected/38573e22-185b-436b-92f6-dabc5a72eb65-kube-api-access-pr8j8\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:11:36.689599 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:11:36.689566    2583 generic.go:356] "Generic (PLEG): container finished" podID="ba22acd9-5197-42aa-97a9-a48ce2c27e7c" containerID="8739062dfeb53ddc5a3e16328b7cd50aa344b66df9dd74b6e16a90e9d8af8c2c" exitCode=0
Jun 08 12:11:36.690036 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:11:36.689638    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6894b75f6b-xqwcm" event={"ID":"ba22acd9-5197-42aa-97a9-a48ce2c27e7c","Type":"ContainerDied","Data":"8739062dfeb53ddc5a3e16328b7cd50aa344b66df9dd74b6e16a90e9d8af8c2c"}
Jun 08 12:11:36.691922 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:11:36.691901    2583 generic.go:356] "Generic (PLEG): container finished" podID="a09f9a25-915c-423b-9b98-bf709dfb964a" containerID="77667c0b980aa72c0e863d7882c26682ea7482b27eecd6c357003e889b3851ec" exitCode=0
Jun 08 12:11:36.692017 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:11:36.691977    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-cb9459fc7-j2748" event={"ID":"a09f9a25-915c-423b-9b98-bf709dfb964a","Type":"ContainerDied","Data":"77667c0b980aa72c0e863d7882c26682ea7482b27eecd6c357003e889b3851ec"}
Jun 08 12:11:36.692017 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:11:36.692003    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-f8c94dc54-zw6mb"
Jun 08 12:11:36.717392 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:11:36.717317    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-f8c94dc54-zw6mb"]
Jun 08 12:11:36.725660 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:11:36.725636    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-f8c94dc54-zw6mb"]
Jun 08 12:11:37.185869 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:11:37.185837    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38573e22-185b-436b-92f6-dabc5a72eb65" path="/var/lib/kubelet/pods/38573e22-185b-436b-92f6-dabc5a72eb65/volumes"
Jun 08 12:11:37.429205 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:11:37.429163    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-cb9459fc7-j2748" podUID="a09f9a25-915c-423b-9b98-bf709dfb964a" containerName="online" probeResult="failure" output="Get \"https://10.132.0.35:6567/health\": dial tcp 10.132.0.35:6567: connect: connection refused"
Jun 08 12:11:37.631244 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:11:37.631208    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-xbfvg"]
Jun 08 12:11:37.631445 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:11:37.631402    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast-rest/postgres-864846d4f5-xbfvg" podUID="1edf77ba-c975-48fa-9472-b43847c0607f" containerName="postgres" containerID="cri-o://db61e6495535beb888737c64a15cfc3abdbb800ab7cc6fe6cca19f859cd721bf" gracePeriod=30
Jun 08 12:11:37.635750 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:11:37.635726    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-fdrc9"]
Jun 08 12:11:37.635888 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:11:37.635869    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast-rest/redis-69bbd798b6-fdrc9" podUID="39e0b3b3-3dbd-4899-9bba-9d1e8cf0516a" containerName="redis" containerID="cri-o://a8643d7ee21b93bbbfb9b2c5ca2839283e6e3a1e28de19fd2c91a370b6fc5ffe" gracePeriod=30
Jun 08 12:11:37.877821 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:11:37.877790    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-xbfvg"
Jun 08 12:11:37.907820 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:11:37.907785    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-fdrc9"
Jun 08 12:11:37.918423 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:11:37.918398    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/1edf77ba-c975-48fa-9472-b43847c0607f-postgresdata\") pod \"1edf77ba-c975-48fa-9472-b43847c0607f\" (UID: \"1edf77ba-c975-48fa-9472-b43847c0607f\") "
Jun 08 12:11:37.918565 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:11:37.918515    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ql98r\" (UniqueName: \"kubernetes.io/projected/1edf77ba-c975-48fa-9472-b43847c0607f-kube-api-access-ql98r\") pod \"1edf77ba-c975-48fa-9472-b43847c0607f\" (UID: \"1edf77ba-c975-48fa-9472-b43847c0607f\") "
Jun 08 12:11:37.920593 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:11:37.920566    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1edf77ba-c975-48fa-9472-b43847c0607f-kube-api-access-ql98r" (OuterVolumeSpecName: "kube-api-access-ql98r") pod "1edf77ba-c975-48fa-9472-b43847c0607f" (UID: "1edf77ba-c975-48fa-9472-b43847c0607f"). InnerVolumeSpecName "kube-api-access-ql98r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 08 12:11:37.954153 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:11:37.954104    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1edf77ba-c975-48fa-9472-b43847c0607f-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "1edf77ba-c975-48fa-9472-b43847c0607f" (UID: "1edf77ba-c975-48fa-9472-b43847c0607f"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 08 12:11:38.019939 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:11:38.019910    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-www4p\" (UniqueName: \"kubernetes.io/projected/39e0b3b3-3dbd-4899-9bba-9d1e8cf0516a-kube-api-access-www4p\") pod \"39e0b3b3-3dbd-4899-9bba-9d1e8cf0516a\" (UID: \"39e0b3b3-3dbd-4899-9bba-9d1e8cf0516a\") "
Jun 08 12:11:38.020114 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:11:38.020064    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ql98r\" (UniqueName: \"kubernetes.io/projected/1edf77ba-c975-48fa-9472-b43847c0607f-kube-api-access-ql98r\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:11:38.020114 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:11:38.020076    2583 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/1edf77ba-c975-48fa-9472-b43847c0607f-postgresdata\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:11:38.021874 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:11:38.021849    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39e0b3b3-3dbd-4899-9bba-9d1e8cf0516a-kube-api-access-www4p" (OuterVolumeSpecName: "kube-api-access-www4p") pod "39e0b3b3-3dbd-4899-9bba-9d1e8cf0516a" (UID: "39e0b3b3-3dbd-4899-9bba-9d1e8cf0516a"). InnerVolumeSpecName "kube-api-access-www4p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 08 12:11:38.121122 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:11:38.121083    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-www4p\" (UniqueName: \"kubernetes.io/projected/39e0b3b3-3dbd-4899-9bba-9d1e8cf0516a-kube-api-access-www4p\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:11:38.701287 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:11:38.701248    2583 generic.go:356] "Generic (PLEG): container finished" podID="39e0b3b3-3dbd-4899-9bba-9d1e8cf0516a" containerID="a8643d7ee21b93bbbfb9b2c5ca2839283e6e3a1e28de19fd2c91a370b6fc5ffe" exitCode=0
Jun 08 12:11:38.701469 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:11:38.701293    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-fdrc9"
Jun 08 12:11:38.701469 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:11:38.701333    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-fdrc9" event={"ID":"39e0b3b3-3dbd-4899-9bba-9d1e8cf0516a","Type":"ContainerDied","Data":"a8643d7ee21b93bbbfb9b2c5ca2839283e6e3a1e28de19fd2c91a370b6fc5ffe"}
Jun 08 12:11:38.701469 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:11:38.701373    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-fdrc9" event={"ID":"39e0b3b3-3dbd-4899-9bba-9d1e8cf0516a","Type":"ContainerDied","Data":"01f58c6b3df482660016183e8d93636944269baac1f40a12b229eda13151fd3c"}
Jun 08 12:11:38.701469 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:11:38.701392    2583 scope.go:117] "RemoveContainer" containerID="a8643d7ee21b93bbbfb9b2c5ca2839283e6e3a1e28de19fd2c91a370b6fc5ffe"
Jun 08 12:11:38.702789 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:11:38.702714    2583 generic.go:356] "Generic (PLEG): container finished" podID="1edf77ba-c975-48fa-9472-b43847c0607f" containerID="db61e6495535beb888737c64a15cfc3abdbb800ab7cc6fe6cca19f859cd721bf" exitCode=0
Jun 08 12:11:38.702789 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:11:38.702750    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-xbfvg" event={"ID":"1edf77ba-c975-48fa-9472-b43847c0607f","Type":"ContainerDied","Data":"db61e6495535beb888737c64a15cfc3abdbb800ab7cc6fe6cca19f859cd721bf"}
Jun 08 12:11:38.702789 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:11:38.702764    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-xbfvg"
Jun 08 12:11:38.702789 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:11:38.702778    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-xbfvg" event={"ID":"1edf77ba-c975-48fa-9472-b43847c0607f","Type":"ContainerDied","Data":"9a6ff37aa32cd6a31d554a1da6407829ba8ef8791fe645d1f6947b250a1993d3"}
Jun 08 12:11:38.710742 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:11:38.710681    2583 scope.go:117] "RemoveContainer" containerID="a8643d7ee21b93bbbfb9b2c5ca2839283e6e3a1e28de19fd2c91a370b6fc5ffe"
Jun 08 12:11:38.711068 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:11:38.711027    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8643d7ee21b93bbbfb9b2c5ca2839283e6e3a1e28de19fd2c91a370b6fc5ffe\": container with ID starting with a8643d7ee21b93bbbfb9b2c5ca2839283e6e3a1e28de19fd2c91a370b6fc5ffe not found: ID does not exist" containerID="a8643d7ee21b93bbbfb9b2c5ca2839283e6e3a1e28de19fd2c91a370b6fc5ffe"
Jun 08 12:11:38.711167 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:11:38.711074    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8643d7ee21b93bbbfb9b2c5ca2839283e6e3a1e28de19fd2c91a370b6fc5ffe"} err="failed to get container status \"a8643d7ee21b93bbbfb9b2c5ca2839283e6e3a1e28de19fd2c91a370b6fc5ffe\": rpc error: code = NotFound desc = could not find container \"a8643d7ee21b93bbbfb9b2c5ca2839283e6e3a1e28de19fd2c91a370b6fc5ffe\": container with ID starting with a8643d7ee21b93bbbfb9b2c5ca2839283e6e3a1e28de19fd2c91a370b6fc5ffe not found: ID does not exist"
Jun 08 12:11:38.711167 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:11:38.711091    2583 scope.go:117] "RemoveContainer" containerID="db61e6495535beb888737c64a15cfc3abdbb800ab7cc6fe6cca19f859cd721bf"
Jun 08 12:11:38.718631 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:11:38.718611    2583 scope.go:117] "RemoveContainer" containerID="db61e6495535beb888737c64a15cfc3abdbb800ab7cc6fe6cca19f859cd721bf"
Jun 08 12:11:38.718881 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:11:38.718862    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db61e6495535beb888737c64a15cfc3abdbb800ab7cc6fe6cca19f859cd721bf\": container with ID starting with db61e6495535beb888737c64a15cfc3abdbb800ab7cc6fe6cca19f859cd721bf not found: ID does not exist" containerID="db61e6495535beb888737c64a15cfc3abdbb800ab7cc6fe6cca19f859cd721bf"
Jun 08 12:11:38.718932 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:11:38.718889    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db61e6495535beb888737c64a15cfc3abdbb800ab7cc6fe6cca19f859cd721bf"} err="failed to get container status \"db61e6495535beb888737c64a15cfc3abdbb800ab7cc6fe6cca19f859cd721bf\": rpc error: code = NotFound desc = could not find container \"db61e6495535beb888737c64a15cfc3abdbb800ab7cc6fe6cca19f859cd721bf\": container with ID starting with db61e6495535beb888737c64a15cfc3abdbb800ab7cc6fe6cca19f859cd721bf not found: ID does not exist"
Jun 08 12:11:38.732244 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:11:38.732216    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-fdrc9"]
Jun 08 12:11:38.735478 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:11:38.735458    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-fdrc9"]
Jun 08 12:11:38.752529 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:11:38.752507    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-xbfvg"]
Jun 08 12:11:38.757625 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:11:38.757605    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-xbfvg"]
Jun 08 12:11:39.185587 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:11:39.185553    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1edf77ba-c975-48fa-9472-b43847c0607f" path="/var/lib/kubelet/pods/1edf77ba-c975-48fa-9472-b43847c0607f/volumes"
Jun 08 12:11:39.185958 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:11:39.185866    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39e0b3b3-3dbd-4899-9bba-9d1e8cf0516a" path="/var/lib/kubelet/pods/39e0b3b3-3dbd-4899-9bba-9d1e8cf0516a/volumes"
Jun 08 12:11:45.539032 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:11:45.538986    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-6894b75f6b-xqwcm" podUID="ba22acd9-5197-42aa-97a9-a48ce2c27e7c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.36:6567/health\": dial tcp 10.132.0.36:6567: connect: connection refused"
Jun 08 12:11:47.428699 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:11:47.428647    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-cb9459fc7-j2748" podUID="a09f9a25-915c-423b-9b98-bf709dfb964a" containerName="online" probeResult="failure" output="Get \"https://10.132.0.35:6567/health\": dial tcp 10.132.0.35:6567: connect: connection refused"
Jun 08 12:11:55.538799 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:11:55.538695    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-6894b75f6b-xqwcm" podUID="ba22acd9-5197-42aa-97a9-a48ce2c27e7c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.36:6567/health\": dial tcp 10.132.0.36:6567: connect: connection refused"
Jun 08 12:11:57.429072 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:11:57.429017    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-cb9459fc7-j2748" podUID="a09f9a25-915c-423b-9b98-bf709dfb964a" containerName="online" probeResult="failure" output="Get \"https://10.132.0.35:6567/health\": dial tcp 10.132.0.35:6567: connect: connection refused"
Jun 08 12:11:57.429500 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:11:57.429194    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-cb9459fc7-j2748"
Jun 08 12:11:59.280062 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:11:59.280018    2583 scope.go:117] "RemoveContainer" containerID="7c63629a19f870504d890be64d900d1a2e91e9681aeafa0a436bbe25cea2c363"
Jun 08 12:12:05.539427 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:05.539383    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-6894b75f6b-xqwcm" podUID="ba22acd9-5197-42aa-97a9-a48ce2c27e7c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.36:6567/health\": dial tcp 10.132.0.36:6567: connect: connection refused"
Jun 08 12:12:05.540035 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:05.539523    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-6894b75f6b-xqwcm"
Jun 08 12:12:05.816835 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:05.816805    2583 generic.go:356] "Generic (PLEG): container finished" podID="ba22acd9-5197-42aa-97a9-a48ce2c27e7c" containerID="e1bbf2c0b3d5d34bc70667282dd89b574436e4e0e427e33c98454f0839a8cc4b" exitCode=137
Jun 08 12:12:05.816944 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:05.816881    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6894b75f6b-xqwcm" event={"ID":"ba22acd9-5197-42aa-97a9-a48ce2c27e7c","Type":"ContainerDied","Data":"e1bbf2c0b3d5d34bc70667282dd89b574436e4e0e427e33c98454f0839a8cc4b"}
Jun 08 12:12:05.819128 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:05.819107    2583 generic.go:356] "Generic (PLEG): container finished" podID="a09f9a25-915c-423b-9b98-bf709dfb964a" containerID="5163e1c72a8a6aa43936179b12c62c9012f6ed2aab05cf588a9f8f381892210f" exitCode=137
Jun 08 12:12:05.819230 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:05.819149    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-cb9459fc7-j2748" event={"ID":"a09f9a25-915c-423b-9b98-bf709dfb964a","Type":"ContainerDied","Data":"5163e1c72a8a6aa43936179b12c62c9012f6ed2aab05cf588a9f8f381892210f"}
Jun 08 12:12:06.361263 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:06.361235    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-6894b75f6b-xqwcm"
Jun 08 12:12:06.365142 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:06.365121    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-cb9459fc7-j2748"
Jun 08 12:12:06.466175 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:06.466148    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ba22acd9-5197-42aa-97a9-a48ce2c27e7c-registry-tls\") pod \"ba22acd9-5197-42aa-97a9-a48ce2c27e7c\" (UID: \"ba22acd9-5197-42aa-97a9-a48ce2c27e7c\") "
Jun 08 12:12:06.466175 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:06.466178    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a09f9a25-915c-423b-9b98-bf709dfb964a-online-tls\") pod \"a09f9a25-915c-423b-9b98-bf709dfb964a\" (UID: \"a09f9a25-915c-423b-9b98-bf709dfb964a\") "
Jun 08 12:12:06.466344 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:06.466291    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a09f9a25-915c-423b-9b98-bf709dfb964a-registry-tls\") pod \"a09f9a25-915c-423b-9b98-bf709dfb964a\" (UID: \"a09f9a25-915c-423b-9b98-bf709dfb964a\") "
Jun 08 12:12:06.466392 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:06.466377    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ba22acd9-5197-42aa-97a9-a48ce2c27e7c-feast-data\") pod \"ba22acd9-5197-42aa-97a9-a48ce2c27e7c\" (UID: \"ba22acd9-5197-42aa-97a9-a48ce2c27e7c\") "
Jun 08 12:12:06.466445 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:06.466424    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ba22acd9-5197-42aa-97a9-a48ce2c27e7c-online-tls\") pod \"ba22acd9-5197-42aa-97a9-a48ce2c27e7c\" (UID: \"ba22acd9-5197-42aa-97a9-a48ce2c27e7c\") "
Jun 08 12:12:06.466499 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:06.466454    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sqhj8\" (UniqueName: \"kubernetes.io/projected/ba22acd9-5197-42aa-97a9-a48ce2c27e7c-kube-api-access-sqhj8\") pod \"ba22acd9-5197-42aa-97a9-a48ce2c27e7c\" (UID: \"ba22acd9-5197-42aa-97a9-a48ce2c27e7c\") "
Jun 08 12:12:06.466499 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:06.466491    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vffmb\" (UniqueName: \"kubernetes.io/projected/a09f9a25-915c-423b-9b98-bf709dfb964a-kube-api-access-vffmb\") pod \"a09f9a25-915c-423b-9b98-bf709dfb964a\" (UID: \"a09f9a25-915c-423b-9b98-bf709dfb964a\") "
Jun 08 12:12:06.466610 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:06.466519    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a09f9a25-915c-423b-9b98-bf709dfb964a-feast-data\") pod \"a09f9a25-915c-423b-9b98-bf709dfb964a\" (UID: \"a09f9a25-915c-423b-9b98-bf709dfb964a\") "
Jun 08 12:12:06.466921 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:06.466871    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba22acd9-5197-42aa-97a9-a48ce2c27e7c-feast-data" (OuterVolumeSpecName: "feast-data") pod "ba22acd9-5197-42aa-97a9-a48ce2c27e7c" (UID: "ba22acd9-5197-42aa-97a9-a48ce2c27e7c"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 08 12:12:06.468702 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:06.468672    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba22acd9-5197-42aa-97a9-a48ce2c27e7c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ba22acd9-5197-42aa-97a9-a48ce2c27e7c" (UID: "ba22acd9-5197-42aa-97a9-a48ce2c27e7c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 08 12:12:06.468815 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:06.468765    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a09f9a25-915c-423b-9b98-bf709dfb964a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a09f9a25-915c-423b-9b98-bf709dfb964a" (UID: "a09f9a25-915c-423b-9b98-bf709dfb964a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 08 12:12:06.468815 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:06.468791    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a09f9a25-915c-423b-9b98-bf709dfb964a-online-tls" (OuterVolumeSpecName: "online-tls") pod "a09f9a25-915c-423b-9b98-bf709dfb964a" (UID: "a09f9a25-915c-423b-9b98-bf709dfb964a"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 08 12:12:06.468907 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:06.468826    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba22acd9-5197-42aa-97a9-a48ce2c27e7c-online-tls" (OuterVolumeSpecName: "online-tls") pod "ba22acd9-5197-42aa-97a9-a48ce2c27e7c" (UID: "ba22acd9-5197-42aa-97a9-a48ce2c27e7c"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 08 12:12:06.468907 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:06.468867    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba22acd9-5197-42aa-97a9-a48ce2c27e7c-kube-api-access-sqhj8" (OuterVolumeSpecName: "kube-api-access-sqhj8") pod "ba22acd9-5197-42aa-97a9-a48ce2c27e7c" (UID: "ba22acd9-5197-42aa-97a9-a48ce2c27e7c"). InnerVolumeSpecName "kube-api-access-sqhj8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 08 12:12:06.468980 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:06.468929    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a09f9a25-915c-423b-9b98-bf709dfb964a-kube-api-access-vffmb" (OuterVolumeSpecName: "kube-api-access-vffmb") pod "a09f9a25-915c-423b-9b98-bf709dfb964a" (UID: "a09f9a25-915c-423b-9b98-bf709dfb964a"). InnerVolumeSpecName "kube-api-access-vffmb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 08 12:12:06.476498 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:06.476451    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a09f9a25-915c-423b-9b98-bf709dfb964a-feast-data" (OuterVolumeSpecName: "feast-data") pod "a09f9a25-915c-423b-9b98-bf709dfb964a" (UID: "a09f9a25-915c-423b-9b98-bf709dfb964a"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 08 12:12:06.567322 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:06.567288    2583 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ba22acd9-5197-42aa-97a9-a48ce2c27e7c-registry-tls\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:12:06.567685 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:06.567341    2583 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a09f9a25-915c-423b-9b98-bf709dfb964a-online-tls\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:12:06.567685 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:06.567354    2583 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a09f9a25-915c-423b-9b98-bf709dfb964a-registry-tls\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:12:06.567685 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:06.567365    2583 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ba22acd9-5197-42aa-97a9-a48ce2c27e7c-feast-data\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:12:06.567685 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:06.567377    2583 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ba22acd9-5197-42aa-97a9-a48ce2c27e7c-online-tls\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:12:06.567685 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:06.567389    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sqhj8\" (UniqueName: \"kubernetes.io/projected/ba22acd9-5197-42aa-97a9-a48ce2c27e7c-kube-api-access-sqhj8\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:12:06.567685 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:06.567407    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vffmb\" (UniqueName: \"kubernetes.io/projected/a09f9a25-915c-423b-9b98-bf709dfb964a-kube-api-access-vffmb\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:12:06.567685 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:06.567420    2583 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a09f9a25-915c-423b-9b98-bf709dfb964a-feast-data\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:12:06.825360 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:06.825289    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-6894b75f6b-xqwcm"
Jun 08 12:12:06.825360 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:06.825290    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6894b75f6b-xqwcm" event={"ID":"ba22acd9-5197-42aa-97a9-a48ce2c27e7c","Type":"ContainerDied","Data":"010a34af8abaac08e4971d9a0b60793c0d77522c5ec284ef6dcbe71843d4fdb0"}
Jun 08 12:12:06.825578 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:06.825392    2583 scope.go:117] "RemoveContainer" containerID="8739062dfeb53ddc5a3e16328b7cd50aa344b66df9dd74b6e16a90e9d8af8c2c"
Jun 08 12:12:06.827691 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:06.827667    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-cb9459fc7-j2748"
Jun 08 12:12:06.827801 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:06.827666    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-cb9459fc7-j2748" event={"ID":"a09f9a25-915c-423b-9b98-bf709dfb964a","Type":"ContainerDied","Data":"96b74b2c659f3868ae89d4bbf996fffad6cbff481b60ac0414915b47cc315b89"}
Jun 08 12:12:06.834281 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:06.834260    2583 scope.go:117] "RemoveContainer" containerID="e1bbf2c0b3d5d34bc70667282dd89b574436e4e0e427e33c98454f0839a8cc4b"
Jun 08 12:12:06.842724 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:06.842708    2583 scope.go:117] "RemoveContainer" containerID="b084343fd9ce44dccd2132a8aa761514ba7a5d8fbf6144659097a56f6855817c"
Jun 08 12:12:06.849445 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:06.849426    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-6894b75f6b-xqwcm"]
Jun 08 12:12:06.850126 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:06.850102    2583 scope.go:117] "RemoveContainer" containerID="619efeb322819b0aa1f8022232ef526162ef10ed83bf905da2efcd77f4e62681"
Jun 08 12:12:06.853744 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:06.853720    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-6894b75f6b-xqwcm"]
Jun 08 12:12:06.857035 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:06.857020    2583 scope.go:117] "RemoveContainer" containerID="77667c0b980aa72c0e863d7882c26682ea7482b27eecd6c357003e889b3851ec"
Jun 08 12:12:06.864337 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:06.864320    2583 scope.go:117] "RemoveContainer" containerID="5163e1c72a8a6aa43936179b12c62c9012f6ed2aab05cf588a9f8f381892210f"
Jun 08 12:12:06.865244 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:06.865175    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-cb9459fc7-j2748"]
Jun 08 12:12:06.871153 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:06.871132    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-cb9459fc7-j2748"]
Jun 08 12:12:06.872340 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:06.872323    2583 scope.go:117] "RemoveContainer" containerID="b5dfa2efea562db141867a9644b520d7ca1aabe5884d169ce7d952b3e642e545"
Jun 08 12:12:06.878973 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:06.878957    2583 scope.go:117] "RemoveContainer" containerID="6dfcd0b6c131831d3369e7f7a9c677485579f0f5ec760da8ae6b32f438b16e0d"
Jun 08 12:12:07.185877 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:07.185844    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a09f9a25-915c-423b-9b98-bf709dfb964a" path="/var/lib/kubelet/pods/a09f9a25-915c-423b-9b98-bf709dfb964a/volumes"
Jun 08 12:12:07.186361 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:07.186346    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba22acd9-5197-42aa-97a9-a48ce2c27e7c" path="/var/lib/kubelet/pods/ba22acd9-5197-42aa-97a9-a48ce2c27e7c/volumes"
Jun 08 12:12:13.543667 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:13.543634    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn"]
Jun 08 12:12:13.544082 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:13.543946    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a09f9a25-915c-423b-9b98-bf709dfb964a" containerName="registry"
Jun 08 12:12:13.544082 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:13.543960    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a09f9a25-915c-423b-9b98-bf709dfb964a" containerName="registry"
Jun 08 12:12:13.544082 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:13.543971    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38573e22-185b-436b-92f6-dabc5a72eb65" containerName="manager"
Jun 08 12:12:13.544082 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:13.543977    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="38573e22-185b-436b-92f6-dabc5a72eb65" containerName="manager"
Jun 08 12:12:13.544082 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:13.543984    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39e0b3b3-3dbd-4899-9bba-9d1e8cf0516a" containerName="redis"
Jun 08 12:12:13.544082 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:13.543990    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="39e0b3b3-3dbd-4899-9bba-9d1e8cf0516a" containerName="redis"
Jun 08 12:12:13.544082 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:13.543996    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba22acd9-5197-42aa-97a9-a48ce2c27e7c" containerName="online"
Jun 08 12:12:13.544082 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:13.544001    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba22acd9-5197-42aa-97a9-a48ce2c27e7c" containerName="online"
Jun 08 12:12:13.544082 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:13.544008    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a09f9a25-915c-423b-9b98-bf709dfb964a" containerName="feast-init"
Jun 08 12:12:13.544082 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:13.544013    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a09f9a25-915c-423b-9b98-bf709dfb964a" containerName="feast-init"
Jun 08 12:12:13.544082 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:13.544025    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba22acd9-5197-42aa-97a9-a48ce2c27e7c" containerName="feast-apply"
Jun 08 12:12:13.544082 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:13.544035    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba22acd9-5197-42aa-97a9-a48ce2c27e7c" containerName="feast-apply"
Jun 08 12:12:13.544082 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:13.544057    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a09f9a25-915c-423b-9b98-bf709dfb964a" containerName="feast-apply"
Jun 08 12:12:13.544082 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:13.544063    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a09f9a25-915c-423b-9b98-bf709dfb964a" containerName="feast-apply"
Jun 08 12:12:13.544082 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:13.544070    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba22acd9-5197-42aa-97a9-a48ce2c27e7c" containerName="feast-init"
Jun 08 12:12:13.544082 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:13.544077    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba22acd9-5197-42aa-97a9-a48ce2c27e7c" containerName="feast-init"
Jun 08 12:12:13.544082 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:13.544092    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1edf77ba-c975-48fa-9472-b43847c0607f" containerName="postgres"
Jun 08 12:12:13.544593 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:13.544098    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="1edf77ba-c975-48fa-9472-b43847c0607f" containerName="postgres"
Jun 08 12:12:13.544593 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:13.544107    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a09f9a25-915c-423b-9b98-bf709dfb964a" containerName="online"
Jun 08 12:12:13.544593 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:13.544115    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a09f9a25-915c-423b-9b98-bf709dfb964a" containerName="online"
Jun 08 12:12:13.544593 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:13.544126    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba22acd9-5197-42aa-97a9-a48ce2c27e7c" containerName="registry"
Jun 08 12:12:13.544593 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:13.544132    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba22acd9-5197-42aa-97a9-a48ce2c27e7c" containerName="registry"
Jun 08 12:12:13.544593 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:13.544179    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="a09f9a25-915c-423b-9b98-bf709dfb964a" containerName="online"
Jun 08 12:12:13.544593 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:13.544191    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="a09f9a25-915c-423b-9b98-bf709dfb964a" containerName="registry"
Jun 08 12:12:13.544593 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:13.544201    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba22acd9-5197-42aa-97a9-a48ce2c27e7c" containerName="registry"
Jun 08 12:12:13.544593 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:13.544208    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba22acd9-5197-42aa-97a9-a48ce2c27e7c" containerName="online"
Jun 08 12:12:13.544593 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:13.544214    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="39e0b3b3-3dbd-4899-9bba-9d1e8cf0516a" containerName="redis"
Jun 08 12:12:13.544593 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:13.544220    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="38573e22-185b-436b-92f6-dabc5a72eb65" containerName="manager"
Jun 08 12:12:13.544593 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:13.544225    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="1edf77ba-c975-48fa-9472-b43847c0607f" containerName="postgres"
Jun 08 12:12:13.549565 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:13.549546    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn"
Jun 08 12:12:13.551817 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:13.551792    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
Jun 08 12:12:13.551955 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:13.551898    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-cxz9s\""
Jun 08 12:12:13.552027 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:13.551792    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
Jun 08 12:12:13.552156 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:13.552135    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
Jun 08 12:12:13.552271 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:13.552249    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Jun 08 12:12:13.552397 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:13.552227    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
Jun 08 12:12:13.552469 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:13.552176    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Jun 08 12:12:13.559899 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:13.559838    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn"]
Jun 08 12:12:13.626188 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:13.626156    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/dc34537b-e7c7-4c6b-88c5-7e127298abd1-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-qfgbn\" (UID: \"dc34537b-e7c7-4c6b-88c5-7e127298abd1\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn"
Jun 08 12:12:13.626341 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:13.626241    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ft6bw\" (UniqueName: \"kubernetes.io/projected/dc34537b-e7c7-4c6b-88c5-7e127298abd1-kube-api-access-ft6bw\") pod \"feast-simple-feast-setup-75c64c888b-qfgbn\" (UID: \"dc34537b-e7c7-4c6b-88c5-7e127298abd1\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn"
Jun 08 12:12:13.626341 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:13.626280    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/dc34537b-e7c7-4c6b-88c5-7e127298abd1-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-qfgbn\" (UID: \"dc34537b-e7c7-4c6b-88c5-7e127298abd1\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn"
Jun 08 12:12:13.626341 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:13.626320    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/dc34537b-e7c7-4c6b-88c5-7e127298abd1-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-qfgbn\" (UID: \"dc34537b-e7c7-4c6b-88c5-7e127298abd1\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn"
Jun 08 12:12:13.626504 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:13.626342    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/dc34537b-e7c7-4c6b-88c5-7e127298abd1-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-qfgbn\" (UID: \"dc34537b-e7c7-4c6b-88c5-7e127298abd1\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn"
Jun 08 12:12:13.626504 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:13.626403    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/dc34537b-e7c7-4c6b-88c5-7e127298abd1-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-qfgbn\" (UID: \"dc34537b-e7c7-4c6b-88c5-7e127298abd1\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn"
Jun 08 12:12:13.726705 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:13.726679    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/dc34537b-e7c7-4c6b-88c5-7e127298abd1-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-qfgbn\" (UID: \"dc34537b-e7c7-4c6b-88c5-7e127298abd1\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn"
Jun 08 12:12:13.726870 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:13.726717    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/dc34537b-e7c7-4c6b-88c5-7e127298abd1-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-qfgbn\" (UID: \"dc34537b-e7c7-4c6b-88c5-7e127298abd1\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn"
Jun 08 12:12:13.726870 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:13.726738    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/dc34537b-e7c7-4c6b-88c5-7e127298abd1-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-qfgbn\" (UID: \"dc34537b-e7c7-4c6b-88c5-7e127298abd1\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn"
Jun 08 12:12:13.726870 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:12:13.726820    2583 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
Jun 08 12:12:13.726870 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:12:13.726850    2583 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
Jun 08 12:12:13.727124 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:13.726870    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/dc34537b-e7c7-4c6b-88c5-7e127298abd1-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-qfgbn\" (UID: \"dc34537b-e7c7-4c6b-88c5-7e127298abd1\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn"
Jun 08 12:12:13.727124 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:12:13.726891    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc34537b-e7c7-4c6b-88c5-7e127298abd1-registry-tls podName:dc34537b-e7c7-4c6b-88c5-7e127298abd1 nodeName:}" failed. No retries permitted until 2026-06-08 12:12:14.226869495 +0000 UTC m=+1455.498444660 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/dc34537b-e7c7-4c6b-88c5-7e127298abd1-registry-tls") pod "feast-simple-feast-setup-75c64c888b-qfgbn" (UID: "dc34537b-e7c7-4c6b-88c5-7e127298abd1") : secret "feast-simple-feast-setup-registry-tls" not found
Jun 08 12:12:13.727124 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:12:13.726922    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc34537b-e7c7-4c6b-88c5-7e127298abd1-online-tls podName:dc34537b-e7c7-4c6b-88c5-7e127298abd1 nodeName:}" failed. No retries permitted until 2026-06-08 12:12:14.226903176 +0000 UTC m=+1455.498478346 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/dc34537b-e7c7-4c6b-88c5-7e127298abd1-online-tls") pod "feast-simple-feast-setup-75c64c888b-qfgbn" (UID: "dc34537b-e7c7-4c6b-88c5-7e127298abd1") : secret "feast-simple-feast-setup-online-tls" not found
Jun 08 12:12:13.727124 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:13.726986    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/dc34537b-e7c7-4c6b-88c5-7e127298abd1-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-qfgbn\" (UID: \"dc34537b-e7c7-4c6b-88c5-7e127298abd1\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn"
Jun 08 12:12:13.727124 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:13.727096    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft6bw\" (UniqueName: \"kubernetes.io/projected/dc34537b-e7c7-4c6b-88c5-7e127298abd1-kube-api-access-ft6bw\") pod \"feast-simple-feast-setup-75c64c888b-qfgbn\" (UID: \"dc34537b-e7c7-4c6b-88c5-7e127298abd1\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn"
Jun 08 12:12:13.727668 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:13.727645    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/dc34537b-e7c7-4c6b-88c5-7e127298abd1-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-qfgbn\" (UID: \"dc34537b-e7c7-4c6b-88c5-7e127298abd1\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn"
Jun 08 12:12:13.729120 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:13.729095    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/dc34537b-e7c7-4c6b-88c5-7e127298abd1-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-qfgbn\" (UID: \"dc34537b-e7c7-4c6b-88c5-7e127298abd1\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn"
Jun 08 12:12:13.729479 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:13.729462    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/dc34537b-e7c7-4c6b-88c5-7e127298abd1-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-qfgbn\" (UID: \"dc34537b-e7c7-4c6b-88c5-7e127298abd1\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn"
Jun 08 12:12:13.735524 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:13.735500    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ft6bw\" (UniqueName: \"kubernetes.io/projected/dc34537b-e7c7-4c6b-88c5-7e127298abd1-kube-api-access-ft6bw\") pod \"feast-simple-feast-setup-75c64c888b-qfgbn\" (UID: \"dc34537b-e7c7-4c6b-88c5-7e127298abd1\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn"
Jun 08 12:12:14.232279 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:14.232239    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/dc34537b-e7c7-4c6b-88c5-7e127298abd1-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-qfgbn\" (UID: \"dc34537b-e7c7-4c6b-88c5-7e127298abd1\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn"
Jun 08 12:12:14.232473 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:14.232288    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/dc34537b-e7c7-4c6b-88c5-7e127298abd1-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-qfgbn\" (UID: \"dc34537b-e7c7-4c6b-88c5-7e127298abd1\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn"
Jun 08 12:12:14.234656 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:14.234628    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/dc34537b-e7c7-4c6b-88c5-7e127298abd1-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-qfgbn\" (UID: \"dc34537b-e7c7-4c6b-88c5-7e127298abd1\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn"
Jun 08 12:12:14.234802 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:14.234779    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/dc34537b-e7c7-4c6b-88c5-7e127298abd1-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-qfgbn\" (UID: \"dc34537b-e7c7-4c6b-88c5-7e127298abd1\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn"
Jun 08 12:12:14.470121 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:14.470087    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn"
Jun 08 12:12:14.607820 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:14.607791    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn"]
Jun 08 12:12:14.610441 ip-10-0-136-189 kubenswrapper[2583]: W0608 12:12:14.610417    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddc34537b_e7c7_4c6b_88c5_7e127298abd1.slice/crio-da574cf8818f6d27ba82d87d1facc7bf06e8327dfd20f71b495df5718f5dcdef WatchSource:0}: Error finding container da574cf8818f6d27ba82d87d1facc7bf06e8327dfd20f71b495df5718f5dcdef: Status 404 returned error can't find the container with id da574cf8818f6d27ba82d87d1facc7bf06e8327dfd20f71b495df5718f5dcdef
Jun 08 12:12:14.612252 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:14.612234    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 08 12:12:14.861607 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:14.861574    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn" event={"ID":"dc34537b-e7c7-4c6b-88c5-7e127298abd1","Type":"ContainerStarted","Data":"da574cf8818f6d27ba82d87d1facc7bf06e8327dfd20f71b495df5718f5dcdef"}
Jun 08 12:12:29.934876 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:29.934841    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn" event={"ID":"dc34537b-e7c7-4c6b-88c5-7e127298abd1","Type":"ContainerStarted","Data":"bc883472262cbdb4c30733b5bc95d98676dffff7f211d56e25164d00ad4270f4"}
Jun 08 12:12:33.951781 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:33.951743    2583 generic.go:356] "Generic (PLEG): container finished" podID="dc34537b-e7c7-4c6b-88c5-7e127298abd1" containerID="bc883472262cbdb4c30733b5bc95d98676dffff7f211d56e25164d00ad4270f4" exitCode=0
Jun 08 12:12:33.952202 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:33.951807    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn" event={"ID":"dc34537b-e7c7-4c6b-88c5-7e127298abd1","Type":"ContainerDied","Data":"bc883472262cbdb4c30733b5bc95d98676dffff7f211d56e25164d00ad4270f4"}
Jun 08 12:12:34.957790 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:34.957754    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn" event={"ID":"dc34537b-e7c7-4c6b-88c5-7e127298abd1","Type":"ContainerStarted","Data":"daab075555f66e19038253b742c4775947f9ed679c9d77dcf9f131ee2cff7557"}
Jun 08 12:12:39.982563 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:39.982527    2583 generic.go:356] "Generic (PLEG): container finished" podID="dc34537b-e7c7-4c6b-88c5-7e127298abd1" containerID="daab075555f66e19038253b742c4775947f9ed679c9d77dcf9f131ee2cff7557" exitCode=0
Jun 08 12:12:39.982982 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:39.982579    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn" event={"ID":"dc34537b-e7c7-4c6b-88c5-7e127298abd1","Type":"ContainerDied","Data":"daab075555f66e19038253b742c4775947f9ed679c9d77dcf9f131ee2cff7557"}
Jun 08 12:12:40.998363 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:40.998321    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn" event={"ID":"dc34537b-e7c7-4c6b-88c5-7e127298abd1","Type":"ContainerStarted","Data":"8c3442e9a061ecc7629e8acf4f329a897377a2e01aa386c03ac3e0feacd13791"}
Jun 08 12:12:40.998856 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:40.998387    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn" event={"ID":"dc34537b-e7c7-4c6b-88c5-7e127298abd1","Type":"ContainerStarted","Data":"e955455ebde24e687c6e2905d7ba80a9aacd185414b884f9a4656d93d3d29e77"}
Jun 08 12:12:40.998856 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:40.998409    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn" event={"ID":"dc34537b-e7c7-4c6b-88c5-7e127298abd1","Type":"ContainerStarted","Data":"89933b49363a77e5726968a9169032ccc8bb59363400f3aa75fb12e1db098521"}
Jun 08 12:12:40.998856 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:40.998430    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn" event={"ID":"dc34537b-e7c7-4c6b-88c5-7e127298abd1","Type":"ContainerStarted","Data":"d67a2ab96c3a14548e360d01be900015129e25e8e05c0d532923121c7706c2d9"}
Jun 08 12:12:41.027336 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:41.027261    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn" podStartSLOduration=13.622592901 podStartE2EDuration="28.02723876s" totalImagesPullingTime="14.404645859s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:12:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:12:41.025350443 +0000 UTC m=+1482.296925661" watchObservedRunningTime="2026-06-08 12:12:41.02723876 +0000 UTC m=+1482.298813939"
Jun 08 12:12:41.470578 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:41.470366    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn"
Jun 08 12:12:41.470792 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:41.470610    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn"
Jun 08 12:12:41.470792 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:41.470706    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn"
Jun 08 12:12:41.470792 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:41.470728    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn"
Jun 08 12:12:41.472822 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:41.472479    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn" podUID="dc34537b-e7c7-4c6b-88c5-7e127298abd1" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.37:8816: connect: connection refused"
Jun 08 12:12:41.472822 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:41.472547    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn" podUID="dc34537b-e7c7-4c6b-88c5-7e127298abd1" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.37:6571: connect: connection refused"
Jun 08 12:12:41.472822 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:41.472575    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn" podUID="dc34537b-e7c7-4c6b-88c5-7e127298abd1" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.37:8443: connect: connection refused"
Jun 08 12:12:41.472822 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:41.472771    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn" podUID="dc34537b-e7c7-4c6b-88c5-7e127298abd1" containerName="online" probeResult="failure" output="Get \"https://10.132.0.37:6567/health\": dial tcp 10.132.0.37:6567: connect: connection refused"
Jun 08 12:12:44.471028 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:44.470984    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn"
Jun 08 12:12:44.471689 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:44.471667    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn"
Jun 08 12:12:44.471689 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:44.471340    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn" podUID="dc34537b-e7c7-4c6b-88c5-7e127298abd1" containerName="online" probeResult="failure" output="Get \"https://10.132.0.37:6567/health\": dial tcp 10.132.0.37:6567: connect: connection refused"
Jun 08 12:12:44.471841 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:44.471699    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn"
Jun 08 12:12:44.471841 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:44.471717    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn"
Jun 08 12:12:44.471841 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:44.471574    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn" podUID="dc34537b-e7c7-4c6b-88c5-7e127298abd1" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.37:8443: connect: connection refused"
Jun 08 12:12:44.472150 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:44.471342    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn" podUID="dc34537b-e7c7-4c6b-88c5-7e127298abd1" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.37:8816: connect: connection refused"
Jun 08 12:12:44.472262 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:44.471343    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn" podUID="dc34537b-e7c7-4c6b-88c5-7e127298abd1" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.37:6571: connect: connection refused"
Jun 08 12:12:47.471731 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:47.471680    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn"
Jun 08 12:12:47.472160 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:47.471858    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn"
Jun 08 12:12:47.472223 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:47.472191    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn"
Jun 08 12:12:47.472674 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:47.472649    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn"
Jun 08 12:12:47.472770 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:47.472746    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn"
Jun 08 12:12:47.472840 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:47.472793    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn"
Jun 08 12:12:47.476406 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:47.476383    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn"
Jun 08 12:12:48.036697 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:48.036657    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn"
Jun 08 12:12:59.236016 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:59.235982    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mnnbj_cdf82c13-c30a-474a-a135-3d1dbcbb6046/console-operator/2.log"
Jun 08 12:12:59.240243 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:12:59.240216    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mnnbj_cdf82c13-c30a-474a-a135-3d1dbcbb6046/console-operator/2.log"
Jun 08 12:13:50.948099 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:13:50.948033    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn"]
Jun 08 12:13:50.948591 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:13:50.948308    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn" podUID="dc34537b-e7c7-4c6b-88c5-7e127298abd1" containerName="registry" containerID="cri-o://d67a2ab96c3a14548e360d01be900015129e25e8e05c0d532923121c7706c2d9" gracePeriod=30
Jun 08 12:13:50.948591 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:13:50.948397    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn" podUID="dc34537b-e7c7-4c6b-88c5-7e127298abd1" containerName="offline" containerID="cri-o://e955455ebde24e687c6e2905d7ba80a9aacd185414b884f9a4656d93d3d29e77" gracePeriod=30
Jun 08 12:13:50.948591 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:13:50.948450    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn" podUID="dc34537b-e7c7-4c6b-88c5-7e127298abd1" containerName="online" containerID="cri-o://89933b49363a77e5726968a9169032ccc8bb59363400f3aa75fb12e1db098521" gracePeriod=30
Jun 08 12:13:50.948591 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:13:50.948390    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn" podUID="dc34537b-e7c7-4c6b-88c5-7e127298abd1" containerName="ui" containerID="cri-o://8c3442e9a061ecc7629e8acf4f329a897377a2e01aa386c03ac3e0feacd13791" gracePeriod=30
Jun 08 12:13:51.249490 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:13:51.249403    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55"]
Jun 08 12:13:51.254149 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:13:51.254116    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55"
Jun 08 12:13:51.259596 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:13:51.259574    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-5h9zd\""
Jun 08 12:13:51.273984 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:13:51.273958    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55"]
Jun 08 12:13:51.355991 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:13:51.355955    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e762e92b-3e83-477a-8e99-2df158361d45-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-wlw55\" (UID: \"e762e92b-3e83-477a-8e99-2df158361d45\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55"
Jun 08 12:13:51.356181 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:13:51.356038    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e762e92b-3e83-477a-8e99-2df158361d45-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-wlw55\" (UID: \"e762e92b-3e83-477a-8e99-2df158361d45\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55"
Jun 08 12:13:51.356181 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:13:51.356091    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e762e92b-3e83-477a-8e99-2df158361d45-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-wlw55\" (UID: \"e762e92b-3e83-477a-8e99-2df158361d45\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55"
Jun 08 12:13:51.356181 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:13:51.356119    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clg7w\" (UniqueName: \"kubernetes.io/projected/e762e92b-3e83-477a-8e99-2df158361d45-kube-api-access-clg7w\") pod \"feast-simple-feast-setup-75c64c888b-wlw55\" (UID: \"e762e92b-3e83-477a-8e99-2df158361d45\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55"
Jun 08 12:13:51.356318 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:13:51.356230    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e762e92b-3e83-477a-8e99-2df158361d45-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-wlw55\" (UID: \"e762e92b-3e83-477a-8e99-2df158361d45\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55"
Jun 08 12:13:51.356318 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:13:51.356291    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e762e92b-3e83-477a-8e99-2df158361d45-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-wlw55\" (UID: \"e762e92b-3e83-477a-8e99-2df158361d45\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55"
Jun 08 12:13:51.457214 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:13:51.457169    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e762e92b-3e83-477a-8e99-2df158361d45-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-wlw55\" (UID: \"e762e92b-3e83-477a-8e99-2df158361d45\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55"
Jun 08 12:13:51.457375 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:13:51.457302    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e762e92b-3e83-477a-8e99-2df158361d45-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-wlw55\" (UID: \"e762e92b-3e83-477a-8e99-2df158361d45\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55"
Jun 08 12:13:51.457375 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:13:51.457347    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e762e92b-3e83-477a-8e99-2df158361d45-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-wlw55\" (UID: \"e762e92b-3e83-477a-8e99-2df158361d45\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55"
Jun 08 12:13:51.457492 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:13:51.457373    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e762e92b-3e83-477a-8e99-2df158361d45-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-wlw55\" (UID: \"e762e92b-3e83-477a-8e99-2df158361d45\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55"
Jun 08 12:13:51.457492 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:13:51.457398    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clg7w\" (UniqueName: \"kubernetes.io/projected/e762e92b-3e83-477a-8e99-2df158361d45-kube-api-access-clg7w\") pod \"feast-simple-feast-setup-75c64c888b-wlw55\" (UID: \"e762e92b-3e83-477a-8e99-2df158361d45\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55"
Jun 08 12:13:51.457492 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:13:51.457448    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e762e92b-3e83-477a-8e99-2df158361d45-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-wlw55\" (UID: \"e762e92b-3e83-477a-8e99-2df158361d45\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55"
Jun 08 12:13:51.457662 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:13:51.457594    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e762e92b-3e83-477a-8e99-2df158361d45-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-wlw55\" (UID: \"e762e92b-3e83-477a-8e99-2df158361d45\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55"
Jun 08 12:13:51.457662 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:13:51.457611    2583 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
Jun 08 12:13:51.457773 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:13:51.457680    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e762e92b-3e83-477a-8e99-2df158361d45-ui-tls podName:e762e92b-3e83-477a-8e99-2df158361d45 nodeName:}" failed. No retries permitted until 2026-06-08 12:13:51.95765966 +0000 UTC m=+1553.229234841 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/e762e92b-3e83-477a-8e99-2df158361d45-ui-tls") pod "feast-simple-feast-setup-75c64c888b-wlw55" (UID: "e762e92b-3e83-477a-8e99-2df158361d45") : secret "feast-simple-feast-setup-ui-tls" not found
Jun 08 12:13:51.460195 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:13:51.460163    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e762e92b-3e83-477a-8e99-2df158361d45-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-wlw55\" (UID: \"e762e92b-3e83-477a-8e99-2df158361d45\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55"
Jun 08 12:13:51.460424 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:13:51.460397    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e762e92b-3e83-477a-8e99-2df158361d45-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-wlw55\" (UID: \"e762e92b-3e83-477a-8e99-2df158361d45\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55"
Jun 08 12:13:51.460556 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:13:51.460519    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e762e92b-3e83-477a-8e99-2df158361d45-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-wlw55\" (UID: \"e762e92b-3e83-477a-8e99-2df158361d45\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55"
Jun 08 12:13:51.474713 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:13:51.474682    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clg7w\" (UniqueName: \"kubernetes.io/projected/e762e92b-3e83-477a-8e99-2df158361d45-kube-api-access-clg7w\") pod \"feast-simple-feast-setup-75c64c888b-wlw55\" (UID: \"e762e92b-3e83-477a-8e99-2df158361d45\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55"
Jun 08 12:13:51.961243 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:13:51.961154    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e762e92b-3e83-477a-8e99-2df158361d45-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-wlw55\" (UID: \"e762e92b-3e83-477a-8e99-2df158361d45\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55"
Jun 08 12:13:51.963488 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:13:51.963468    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e762e92b-3e83-477a-8e99-2df158361d45-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-wlw55\" (UID: \"e762e92b-3e83-477a-8e99-2df158361d45\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55"
Jun 08 12:13:52.166855 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:13:52.166818    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55"
Jun 08 12:13:52.284230 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:13:52.284199    2583 generic.go:356] "Generic (PLEG): container finished" podID="dc34537b-e7c7-4c6b-88c5-7e127298abd1" containerID="8c3442e9a061ecc7629e8acf4f329a897377a2e01aa386c03ac3e0feacd13791" exitCode=0
Jun 08 12:13:52.284230 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:13:52.284224    2583 generic.go:356] "Generic (PLEG): container finished" podID="dc34537b-e7c7-4c6b-88c5-7e127298abd1" containerID="89933b49363a77e5726968a9169032ccc8bb59363400f3aa75fb12e1db098521" exitCode=0
Jun 08 12:13:52.284450 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:13:52.284272    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn" event={"ID":"dc34537b-e7c7-4c6b-88c5-7e127298abd1","Type":"ContainerDied","Data":"8c3442e9a061ecc7629e8acf4f329a897377a2e01aa386c03ac3e0feacd13791"}
Jun 08 12:13:52.284450 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:13:52.284325    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn" event={"ID":"dc34537b-e7c7-4c6b-88c5-7e127298abd1","Type":"ContainerDied","Data":"89933b49363a77e5726968a9169032ccc8bb59363400f3aa75fb12e1db098521"}
Jun 08 12:13:52.300968 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:13:52.300865    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55"]
Jun 08 12:13:52.303730 ip-10-0-136-189 kubenswrapper[2583]: W0608 12:13:52.303701    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode762e92b_3e83_477a_8e99_2df158361d45.slice/crio-e93c2b37610b258ae0d237782f12537b36d7c63dd6e4f96efdcfdae4c296ab1d WatchSource:0}: Error finding container e93c2b37610b258ae0d237782f12537b36d7c63dd6e4f96efdcfdae4c296ab1d: Status 404 returned error can't find the container with id e93c2b37610b258ae0d237782f12537b36d7c63dd6e4f96efdcfdae4c296ab1d
Jun 08 12:13:53.290121 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:13:53.290085    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55" event={"ID":"e762e92b-3e83-477a-8e99-2df158361d45","Type":"ContainerStarted","Data":"2f23f995db4700096919dc297a2f47898782ad33755bc2fd79b969ee9cbb81f7"}
Jun 08 12:13:53.290121 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:13:53.290126    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55" event={"ID":"e762e92b-3e83-477a-8e99-2df158361d45","Type":"ContainerStarted","Data":"e93c2b37610b258ae0d237782f12537b36d7c63dd6e4f96efdcfdae4c296ab1d"}
Jun 08 12:13:57.308821 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:13:57.308732    2583 generic.go:356] "Generic (PLEG): container finished" podID="e762e92b-3e83-477a-8e99-2df158361d45" containerID="2f23f995db4700096919dc297a2f47898782ad33755bc2fd79b969ee9cbb81f7" exitCode=0
Jun 08 12:13:57.308821 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:13:57.308808    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55" event={"ID":"e762e92b-3e83-477a-8e99-2df158361d45","Type":"ContainerDied","Data":"2f23f995db4700096919dc297a2f47898782ad33755bc2fd79b969ee9cbb81f7"}
Jun 08 12:13:57.473121 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:13:57.473076    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn" podUID="dc34537b-e7c7-4c6b-88c5-7e127298abd1" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.37:8443: connect: connection refused"
Jun 08 12:13:58.034123 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:13:58.034078    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn" podUID="dc34537b-e7c7-4c6b-88c5-7e127298abd1" containerName="online" probeResult="failure" output="Get \"https://10.132.0.37:6567/health\": dial tcp 10.132.0.37:6567: connect: connection refused"
Jun 08 12:13:58.314213 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:13:58.314120    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55" event={"ID":"e762e92b-3e83-477a-8e99-2df158361d45","Type":"ContainerStarted","Data":"7f8d9aac76260a6f9eec383f7fec123bffc8e60b3d1926f48a0710760c874158"}
Jun 08 12:14:03.337419 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:14:03.337384    2583 generic.go:356] "Generic (PLEG): container finished" podID="e762e92b-3e83-477a-8e99-2df158361d45" containerID="7f8d9aac76260a6f9eec383f7fec123bffc8e60b3d1926f48a0710760c874158" exitCode=0
Jun 08 12:14:03.337901 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:14:03.337431    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55" event={"ID":"e762e92b-3e83-477a-8e99-2df158361d45","Type":"ContainerDied","Data":"7f8d9aac76260a6f9eec383f7fec123bffc8e60b3d1926f48a0710760c874158"}
Jun 08 12:14:04.347244 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:14:04.347195    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55" event={"ID":"e762e92b-3e83-477a-8e99-2df158361d45","Type":"ContainerStarted","Data":"3302632431e236414e2904de90d74b98aa79b50438b202d7891b78e082e6f9f8"}
Jun 08 12:14:04.347873 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:14:04.347261    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55" event={"ID":"e762e92b-3e83-477a-8e99-2df158361d45","Type":"ContainerStarted","Data":"9cc25cb6c5fb554eceee8a3cf2cc47c6f73541447a93763d9585b4200ae8d7f0"}
Jun 08 12:14:04.347873 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:14:04.347284    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55" event={"ID":"e762e92b-3e83-477a-8e99-2df158361d45","Type":"ContainerStarted","Data":"9a79da9926bac03128550b6bd31cb6313c64183a663a1e3e800b6c2e2e7b8705"}
Jun 08 12:14:04.347873 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:14:04.347303    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55" event={"ID":"e762e92b-3e83-477a-8e99-2df158361d45","Type":"ContainerStarted","Data":"21a392a9bbfd093bf489d0d2e49f3ccb76bffe9b589f786cf060621926fd7d2c"}
Jun 08 12:14:04.373802 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:14:04.373734    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55" podStartSLOduration=13.373711905 podStartE2EDuration="13.373711905s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:13:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:14:04.371311134 +0000 UTC m=+1565.642886312" watchObservedRunningTime="2026-06-08 12:14:04.373711905 +0000 UTC m=+1565.645287084"
Jun 08 12:14:07.167736 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:14:07.167692    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55"
Jun 08 12:14:07.168226 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:14:07.167752    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55"
Jun 08 12:14:07.168226 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:14:07.167772    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55"
Jun 08 12:14:07.168508 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:14:07.168486    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55"
Jun 08 12:14:07.169411 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:14:07.169371    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55" podUID="e762e92b-3e83-477a-8e99-2df158361d45" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.38:8816: connect: connection refused"
Jun 08 12:14:07.169538 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:14:07.169400    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55" podUID="e762e92b-3e83-477a-8e99-2df158361d45" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.38:8443: connect: connection refused"
Jun 08 12:14:07.169538 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:14:07.169408    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55" podUID="e762e92b-3e83-477a-8e99-2df158361d45" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.38:6571: connect: connection refused"
Jun 08 12:14:07.169538 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:14:07.169461    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55" podUID="e762e92b-3e83-477a-8e99-2df158361d45" containerName="online" probeResult="failure" output="Get \"https://10.132.0.38:6567/health\": dial tcp 10.132.0.38:6567: connect: connection refused"
Jun 08 12:14:07.472532 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:14:07.472417    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn" podUID="dc34537b-e7c7-4c6b-88c5-7e127298abd1" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.37:8443: connect: connection refused"
Jun 08 12:14:08.034775 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:14:08.034733    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn" podUID="dc34537b-e7c7-4c6b-88c5-7e127298abd1" containerName="online" probeResult="failure" output="Get \"https://10.132.0.37:6567/health\": dial tcp 10.132.0.37:6567: connect: connection refused"
Jun 08 12:14:10.168305 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:14:10.168269    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55"
Jun 08 12:14:10.168821 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:14:10.168519    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55"
Jun 08 12:14:10.168891 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:14:10.168853    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55"
Jun 08 12:14:10.168972 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:14:10.168953    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55"
Jun 08 12:14:10.169033 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:14:10.168990    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55"
Jun 08 12:14:10.169033 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:14:10.169007    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55"
Jun 08 12:14:10.169391 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:14:10.169372    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55"
Jun 08 12:14:10.169475 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:14:10.169423    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55"
Jun 08 12:14:10.169475 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:14:10.169456    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55"
Jun 08 12:14:10.172961 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:14:10.172942    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55"
Jun 08 12:14:10.378803 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:14:10.378773    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55"
Jun 08 12:14:10.381836 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:14:10.381812    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55"
Jun 08 12:14:17.472868 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:14:17.472825    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn" podUID="dc34537b-e7c7-4c6b-88c5-7e127298abd1" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.37:8443: connect: connection refused"
Jun 08 12:14:17.473293 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:14:17.472957    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn"
Jun 08 12:14:18.034149 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:14:18.034107    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn" podUID="dc34537b-e7c7-4c6b-88c5-7e127298abd1" containerName="online" probeResult="failure" output="Get \"https://10.132.0.37:6567/health\": dial tcp 10.132.0.37:6567: connect: connection refused"
Jun 08 12:14:18.034354 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:14:18.034254    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn"
Jun 08 12:14:21.427211 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:14:21.427176    2583 generic.go:356] "Generic (PLEG): container finished" podID="dc34537b-e7c7-4c6b-88c5-7e127298abd1" containerID="e955455ebde24e687c6e2905d7ba80a9aacd185414b884f9a4656d93d3d29e77" exitCode=137
Jun 08 12:14:21.427211 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:14:21.427206    2583 generic.go:356] "Generic (PLEG): container finished" podID="dc34537b-e7c7-4c6b-88c5-7e127298abd1" containerID="d67a2ab96c3a14548e360d01be900015129e25e8e05c0d532923121c7706c2d9" exitCode=137
Jun 08 12:14:21.427610 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:14:21.427244    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn" event={"ID":"dc34537b-e7c7-4c6b-88c5-7e127298abd1","Type":"ContainerDied","Data":"e955455ebde24e687c6e2905d7ba80a9aacd185414b884f9a4656d93d3d29e77"}
Jun 08 12:14:21.427610 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:14:21.427286    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn" event={"ID":"dc34537b-e7c7-4c6b-88c5-7e127298abd1","Type":"ContainerDied","Data":"d67a2ab96c3a14548e360d01be900015129e25e8e05c0d532923121c7706c2d9"}
Jun 08 12:14:21.595113 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:14:21.595089    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn"
Jun 08 12:14:21.715720 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:14:21.715634    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/dc34537b-e7c7-4c6b-88c5-7e127298abd1-offline-tls\") pod \"dc34537b-e7c7-4c6b-88c5-7e127298abd1\" (UID: \"dc34537b-e7c7-4c6b-88c5-7e127298abd1\") "
Jun 08 12:14:21.715720 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:14:21.715675    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ft6bw\" (UniqueName: \"kubernetes.io/projected/dc34537b-e7c7-4c6b-88c5-7e127298abd1-kube-api-access-ft6bw\") pod \"dc34537b-e7c7-4c6b-88c5-7e127298abd1\" (UID: \"dc34537b-e7c7-4c6b-88c5-7e127298abd1\") "
Jun 08 12:14:21.715914 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:14:21.715810    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/dc34537b-e7c7-4c6b-88c5-7e127298abd1-feast-data\") pod \"dc34537b-e7c7-4c6b-88c5-7e127298abd1\" (UID: \"dc34537b-e7c7-4c6b-88c5-7e127298abd1\") "
Jun 08 12:14:21.715914 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:14:21.715856    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/dc34537b-e7c7-4c6b-88c5-7e127298abd1-online-tls\") pod \"dc34537b-e7c7-4c6b-88c5-7e127298abd1\" (UID: \"dc34537b-e7c7-4c6b-88c5-7e127298abd1\") "
Jun 08 12:14:21.715914 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:14:21.715896    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/dc34537b-e7c7-4c6b-88c5-7e127298abd1-ui-tls\") pod \"dc34537b-e7c7-4c6b-88c5-7e127298abd1\" (UID: \"dc34537b-e7c7-4c6b-88c5-7e127298abd1\") "
Jun 08 12:14:21.716080 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:14:21.715931    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/dc34537b-e7c7-4c6b-88c5-7e127298abd1-registry-tls\") pod \"dc34537b-e7c7-4c6b-88c5-7e127298abd1\" (UID: \"dc34537b-e7c7-4c6b-88c5-7e127298abd1\") "
Jun 08 12:14:21.716412 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:14:21.716383    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc34537b-e7c7-4c6b-88c5-7e127298abd1-feast-data" (OuterVolumeSpecName: "feast-data") pod "dc34537b-e7c7-4c6b-88c5-7e127298abd1" (UID: "dc34537b-e7c7-4c6b-88c5-7e127298abd1"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 08 12:14:21.718114 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:14:21.718009    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc34537b-e7c7-4c6b-88c5-7e127298abd1-online-tls" (OuterVolumeSpecName: "online-tls") pod "dc34537b-e7c7-4c6b-88c5-7e127298abd1" (UID: "dc34537b-e7c7-4c6b-88c5-7e127298abd1"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 08 12:14:21.718114 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:14:21.718080    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc34537b-e7c7-4c6b-88c5-7e127298abd1-kube-api-access-ft6bw" (OuterVolumeSpecName: "kube-api-access-ft6bw") pod "dc34537b-e7c7-4c6b-88c5-7e127298abd1" (UID: "dc34537b-e7c7-4c6b-88c5-7e127298abd1"). InnerVolumeSpecName "kube-api-access-ft6bw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 08 12:14:21.718114 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:14:21.718088    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc34537b-e7c7-4c6b-88c5-7e127298abd1-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "dc34537b-e7c7-4c6b-88c5-7e127298abd1" (UID: "dc34537b-e7c7-4c6b-88c5-7e127298abd1"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 08 12:14:21.718350 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:14:21.718198    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc34537b-e7c7-4c6b-88c5-7e127298abd1-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "dc34537b-e7c7-4c6b-88c5-7e127298abd1" (UID: "dc34537b-e7c7-4c6b-88c5-7e127298abd1"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 08 12:14:21.718350 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:14:21.718273    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc34537b-e7c7-4c6b-88c5-7e127298abd1-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "dc34537b-e7c7-4c6b-88c5-7e127298abd1" (UID: "dc34537b-e7c7-4c6b-88c5-7e127298abd1"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 08 12:14:21.817545 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:14:21.817518    2583 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/dc34537b-e7c7-4c6b-88c5-7e127298abd1-feast-data\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:14:21.817661 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:14:21.817559    2583 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/dc34537b-e7c7-4c6b-88c5-7e127298abd1-online-tls\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:14:21.817661 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:14:21.817569    2583 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/dc34537b-e7c7-4c6b-88c5-7e127298abd1-ui-tls\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:14:21.817661 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:14:21.817578    2583 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/dc34537b-e7c7-4c6b-88c5-7e127298abd1-registry-tls\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:14:21.817661 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:14:21.817585    2583 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/dc34537b-e7c7-4c6b-88c5-7e127298abd1-offline-tls\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:14:21.817661 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:14:21.817593    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ft6bw\" (UniqueName: \"kubernetes.io/projected/dc34537b-e7c7-4c6b-88c5-7e127298abd1-kube-api-access-ft6bw\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:14:22.434330 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:14:22.434297    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn" event={"ID":"dc34537b-e7c7-4c6b-88c5-7e127298abd1","Type":"ContainerDied","Data":"da574cf8818f6d27ba82d87d1facc7bf06e8327dfd20f71b495df5718f5dcdef"}
Jun 08 12:14:22.434747 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:14:22.434349    2583 scope.go:117] "RemoveContainer" containerID="8c3442e9a061ecc7629e8acf4f329a897377a2e01aa386c03ac3e0feacd13791"
Jun 08 12:14:22.434747 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:14:22.434310    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn"
Jun 08 12:14:22.443421 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:14:22.443402    2583 scope.go:117] "RemoveContainer" containerID="e955455ebde24e687c6e2905d7ba80a9aacd185414b884f9a4656d93d3d29e77"
Jun 08 12:14:22.450917 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:14:22.450897    2583 scope.go:117] "RemoveContainer" containerID="89933b49363a77e5726968a9169032ccc8bb59363400f3aa75fb12e1db098521"
Jun 08 12:14:22.458322 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:14:22.458295    2583 scope.go:117] "RemoveContainer" containerID="d67a2ab96c3a14548e360d01be900015129e25e8e05c0d532923121c7706c2d9"
Jun 08 12:14:22.465358 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:14:22.465315    2583 scope.go:117] "RemoveContainer" containerID="daab075555f66e19038253b742c4775947f9ed679c9d77dcf9f131ee2cff7557"
Jun 08 12:14:22.468074 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:14:22.468037    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn"]
Jun 08 12:14:22.470827 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:14:22.470803    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-qfgbn"]
Jun 08 12:14:22.473033 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:14:22.473017    2583 scope.go:117] "RemoveContainer" containerID="bc883472262cbdb4c30733b5bc95d98676dffff7f211d56e25164d00ad4270f4"
Jun 08 12:14:23.186148 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:14:23.186117    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc34537b-e7c7-4c6b-88c5-7e127298abd1" path="/var/lib/kubelet/pods/dc34537b-e7c7-4c6b-88c5-7e127298abd1/volumes"
Jun 08 12:15:12.928379 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:12.928338    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn"]
Jun 08 12:15:12.928885 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:12.928651    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc34537b-e7c7-4c6b-88c5-7e127298abd1" containerName="ui"
Jun 08 12:15:12.928885 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:12.928663    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc34537b-e7c7-4c6b-88c5-7e127298abd1" containerName="ui"
Jun 08 12:15:12.928885 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:12.928674    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc34537b-e7c7-4c6b-88c5-7e127298abd1" containerName="feast-apply"
Jun 08 12:15:12.928885 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:12.928679    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc34537b-e7c7-4c6b-88c5-7e127298abd1" containerName="feast-apply"
Jun 08 12:15:12.928885 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:12.928685    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc34537b-e7c7-4c6b-88c5-7e127298abd1" containerName="offline"
Jun 08 12:15:12.928885 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:12.928690    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc34537b-e7c7-4c6b-88c5-7e127298abd1" containerName="offline"
Jun 08 12:15:12.928885 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:12.928699    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc34537b-e7c7-4c6b-88c5-7e127298abd1" containerName="feast-init"
Jun 08 12:15:12.928885 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:12.928704    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc34537b-e7c7-4c6b-88c5-7e127298abd1" containerName="feast-init"
Jun 08 12:15:12.928885 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:12.928709    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc34537b-e7c7-4c6b-88c5-7e127298abd1" containerName="online"
Jun 08 12:15:12.928885 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:12.928715    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc34537b-e7c7-4c6b-88c5-7e127298abd1" containerName="online"
Jun 08 12:15:12.928885 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:12.928725    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc34537b-e7c7-4c6b-88c5-7e127298abd1" containerName="registry"
Jun 08 12:15:12.928885 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:12.928730    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc34537b-e7c7-4c6b-88c5-7e127298abd1" containerName="registry"
Jun 08 12:15:12.928885 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:12.928787    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc34537b-e7c7-4c6b-88c5-7e127298abd1" containerName="registry"
Jun 08 12:15:12.928885 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:12.928793    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc34537b-e7c7-4c6b-88c5-7e127298abd1" containerName="ui"
Jun 08 12:15:12.928885 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:12.928801    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc34537b-e7c7-4c6b-88c5-7e127298abd1" containerName="online"
Jun 08 12:15:12.928885 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:12.928809    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc34537b-e7c7-4c6b-88c5-7e127298abd1" containerName="offline"
Jun 08 12:15:12.933357 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:12.933339    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn"
Jun 08 12:15:12.935881 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:12.935850    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
Jun 08 12:15:12.935881 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:12.935852    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
Jun 08 12:15:12.936104 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:12.935891    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-2mlh2\""
Jun 08 12:15:12.936212 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:12.936194    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
Jun 08 12:15:12.936272 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:12.936223    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
Jun 08 12:15:12.936332 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:12.936322    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
Jun 08 12:15:12.936390 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:12.936372    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
Jun 08 12:15:12.943730 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:12.943597    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn"]
Jun 08 12:15:13.039917 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:13.039883    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e50bc24a-7da9-48a9-82d3-05aa1e856f81-ui-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-sjxmn\" (UID: \"e50bc24a-7da9-48a9-82d3-05aa1e856f81\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn"
Jun 08 12:15:13.040124 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:13.039947    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e50bc24a-7da9-48a9-82d3-05aa1e856f81-online-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-sjxmn\" (UID: \"e50bc24a-7da9-48a9-82d3-05aa1e856f81\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn"
Jun 08 12:15:13.040124 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:13.039985    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e50bc24a-7da9-48a9-82d3-05aa1e856f81-offline-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-sjxmn\" (UID: \"e50bc24a-7da9-48a9-82d3-05aa1e856f81\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn"
Jun 08 12:15:13.040124 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:13.040010    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e50bc24a-7da9-48a9-82d3-05aa1e856f81-feast-data\") pod \"feast-simple-feast-remote-setup-669bcf45fc-sjxmn\" (UID: \"e50bc24a-7da9-48a9-82d3-05aa1e856f81\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn"
Jun 08 12:15:13.040124 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:13.040093    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcdzx\" (UniqueName: \"kubernetes.io/projected/e50bc24a-7da9-48a9-82d3-05aa1e856f81-kube-api-access-mcdzx\") pod \"feast-simple-feast-remote-setup-669bcf45fc-sjxmn\" (UID: \"e50bc24a-7da9-48a9-82d3-05aa1e856f81\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn"
Jun 08 12:15:13.040370 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:13.040138    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/e50bc24a-7da9-48a9-82d3-05aa1e856f81-registry-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-sjxmn\" (UID: \"e50bc24a-7da9-48a9-82d3-05aa1e856f81\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn"
Jun 08 12:15:13.141608 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:13.141566    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/e50bc24a-7da9-48a9-82d3-05aa1e856f81-registry-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-sjxmn\" (UID: \"e50bc24a-7da9-48a9-82d3-05aa1e856f81\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn"
Jun 08 12:15:13.141810 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:13.141671    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e50bc24a-7da9-48a9-82d3-05aa1e856f81-ui-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-sjxmn\" (UID: \"e50bc24a-7da9-48a9-82d3-05aa1e856f81\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn"
Jun 08 12:15:13.141810 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:13.141725    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e50bc24a-7da9-48a9-82d3-05aa1e856f81-online-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-sjxmn\" (UID: \"e50bc24a-7da9-48a9-82d3-05aa1e856f81\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn"
Jun 08 12:15:13.141810 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:13.141758    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e50bc24a-7da9-48a9-82d3-05aa1e856f81-offline-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-sjxmn\" (UID: \"e50bc24a-7da9-48a9-82d3-05aa1e856f81\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn"
Jun 08 12:15:13.141810 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:13.141780    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e50bc24a-7da9-48a9-82d3-05aa1e856f81-feast-data\") pod \"feast-simple-feast-remote-setup-669bcf45fc-sjxmn\" (UID: \"e50bc24a-7da9-48a9-82d3-05aa1e856f81\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn"
Jun 08 12:15:13.142019 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:13.141815    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcdzx\" (UniqueName: \"kubernetes.io/projected/e50bc24a-7da9-48a9-82d3-05aa1e856f81-kube-api-access-mcdzx\") pod \"feast-simple-feast-remote-setup-669bcf45fc-sjxmn\" (UID: \"e50bc24a-7da9-48a9-82d3-05aa1e856f81\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn"
Jun 08 12:15:13.142019 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:15:13.141844    2583 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-ui-tls: secret "feast-simple-feast-remote-setup-ui-tls" not found
Jun 08 12:15:13.142019 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:15:13.141903    2583 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-offline-tls: secret "feast-simple-feast-remote-setup-offline-tls" not found
Jun 08 12:15:13.142019 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:15:13.141921    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e50bc24a-7da9-48a9-82d3-05aa1e856f81-ui-tls podName:e50bc24a-7da9-48a9-82d3-05aa1e856f81 nodeName:}" failed. No retries permitted until 2026-06-08 12:15:13.641899785 +0000 UTC m=+1634.913474942 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/e50bc24a-7da9-48a9-82d3-05aa1e856f81-ui-tls") pod "feast-simple-feast-remote-setup-669bcf45fc-sjxmn" (UID: "e50bc24a-7da9-48a9-82d3-05aa1e856f81") : secret "feast-simple-feast-remote-setup-ui-tls" not found
Jun 08 12:15:13.142019 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:15:13.141977    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e50bc24a-7da9-48a9-82d3-05aa1e856f81-offline-tls podName:e50bc24a-7da9-48a9-82d3-05aa1e856f81 nodeName:}" failed. No retries permitted until 2026-06-08 12:15:13.641957772 +0000 UTC m=+1634.913532929 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/e50bc24a-7da9-48a9-82d3-05aa1e856f81-offline-tls") pod "feast-simple-feast-remote-setup-669bcf45fc-sjxmn" (UID: "e50bc24a-7da9-48a9-82d3-05aa1e856f81") : secret "feast-simple-feast-remote-setup-offline-tls" not found
Jun 08 12:15:13.142317 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:15:13.142033    2583 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-online-tls: secret "feast-simple-feast-remote-setup-online-tls" not found
Jun 08 12:15:13.142317 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:15:13.142099    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e50bc24a-7da9-48a9-82d3-05aa1e856f81-online-tls podName:e50bc24a-7da9-48a9-82d3-05aa1e856f81 nodeName:}" failed. No retries permitted until 2026-06-08 12:15:13.642088103 +0000 UTC m=+1634.913663263 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/e50bc24a-7da9-48a9-82d3-05aa1e856f81-online-tls") pod "feast-simple-feast-remote-setup-669bcf45fc-sjxmn" (UID: "e50bc24a-7da9-48a9-82d3-05aa1e856f81") : secret "feast-simple-feast-remote-setup-online-tls" not found
Jun 08 12:15:13.142430 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:13.142374    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e50bc24a-7da9-48a9-82d3-05aa1e856f81-feast-data\") pod \"feast-simple-feast-remote-setup-669bcf45fc-sjxmn\" (UID: \"e50bc24a-7da9-48a9-82d3-05aa1e856f81\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn"
Jun 08 12:15:13.142430 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:13.142398    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/e50bc24a-7da9-48a9-82d3-05aa1e856f81-registry-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-sjxmn\" (UID: \"e50bc24a-7da9-48a9-82d3-05aa1e856f81\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn"
Jun 08 12:15:13.152957 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:13.152935    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcdzx\" (UniqueName: \"kubernetes.io/projected/e50bc24a-7da9-48a9-82d3-05aa1e856f81-kube-api-access-mcdzx\") pod \"feast-simple-feast-remote-setup-669bcf45fc-sjxmn\" (UID: \"e50bc24a-7da9-48a9-82d3-05aa1e856f81\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn"
Jun 08 12:15:13.646757 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:13.646727    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e50bc24a-7da9-48a9-82d3-05aa1e856f81-ui-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-sjxmn\" (UID: \"e50bc24a-7da9-48a9-82d3-05aa1e856f81\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn"
Jun 08 12:15:13.646939 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:13.646779    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e50bc24a-7da9-48a9-82d3-05aa1e856f81-online-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-sjxmn\" (UID: \"e50bc24a-7da9-48a9-82d3-05aa1e856f81\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn"
Jun 08 12:15:13.646939 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:13.646802    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e50bc24a-7da9-48a9-82d3-05aa1e856f81-offline-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-sjxmn\" (UID: \"e50bc24a-7da9-48a9-82d3-05aa1e856f81\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn"
Jun 08 12:15:13.649304 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:13.649274    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e50bc24a-7da9-48a9-82d3-05aa1e856f81-offline-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-sjxmn\" (UID: \"e50bc24a-7da9-48a9-82d3-05aa1e856f81\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn"
Jun 08 12:15:13.649304 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:13.649300    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e50bc24a-7da9-48a9-82d3-05aa1e856f81-online-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-sjxmn\" (UID: \"e50bc24a-7da9-48a9-82d3-05aa1e856f81\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn"
Jun 08 12:15:13.649448 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:13.649415    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e50bc24a-7da9-48a9-82d3-05aa1e856f81-ui-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-sjxmn\" (UID: \"e50bc24a-7da9-48a9-82d3-05aa1e856f81\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn"
Jun 08 12:15:13.845576 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:13.845538    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn"
Jun 08 12:15:13.980672 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:13.980641    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn"]
Jun 08 12:15:13.981630 ip-10-0-136-189 kubenswrapper[2583]: W0608 12:15:13.981602    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode50bc24a_7da9_48a9_82d3_05aa1e856f81.slice/crio-00adf7685881bd1e26141dbe078e8f7edd678e559f6f0e6588389ea1273da251 WatchSource:0}: Error finding container 00adf7685881bd1e26141dbe078e8f7edd678e559f6f0e6588389ea1273da251: Status 404 returned error can't find the container with id 00adf7685881bd1e26141dbe078e8f7edd678e559f6f0e6588389ea1273da251
Jun 08 12:15:14.644117 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:14.644082    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn" event={"ID":"e50bc24a-7da9-48a9-82d3-05aa1e856f81","Type":"ContainerStarted","Data":"a70e401e9dc743bf0a27a2893ce628f513ec2fc4f25befa844caeac30643ce94"}
Jun 08 12:15:14.644290 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:14.644129    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn" event={"ID":"e50bc24a-7da9-48a9-82d3-05aa1e856f81","Type":"ContainerStarted","Data":"00adf7685881bd1e26141dbe078e8f7edd678e559f6f0e6588389ea1273da251"}
Jun 08 12:15:18.669574 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:18.669540    2583 generic.go:356] "Generic (PLEG): container finished" podID="e50bc24a-7da9-48a9-82d3-05aa1e856f81" containerID="a70e401e9dc743bf0a27a2893ce628f513ec2fc4f25befa844caeac30643ce94" exitCode=0
Jun 08 12:15:18.669920 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:18.669615    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn" event={"ID":"e50bc24a-7da9-48a9-82d3-05aa1e856f81","Type":"ContainerDied","Data":"a70e401e9dc743bf0a27a2893ce628f513ec2fc4f25befa844caeac30643ce94"}
Jun 08 12:15:19.675584 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:19.675545    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn" event={"ID":"e50bc24a-7da9-48a9-82d3-05aa1e856f81","Type":"ContainerStarted","Data":"5b54e7e1320dc3c03f4f290e815a124d1b7c8dfe64294a9f54dceb0285512565"}
Jun 08 12:15:24.699304 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:24.699268    2583 generic.go:356] "Generic (PLEG): container finished" podID="e50bc24a-7da9-48a9-82d3-05aa1e856f81" containerID="5b54e7e1320dc3c03f4f290e815a124d1b7c8dfe64294a9f54dceb0285512565" exitCode=0
Jun 08 12:15:24.699696 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:24.699322    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn" event={"ID":"e50bc24a-7da9-48a9-82d3-05aa1e856f81","Type":"ContainerDied","Data":"5b54e7e1320dc3c03f4f290e815a124d1b7c8dfe64294a9f54dceb0285512565"}
Jun 08 12:15:25.708507 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:25.708472    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn" event={"ID":"e50bc24a-7da9-48a9-82d3-05aa1e856f81","Type":"ContainerStarted","Data":"21c56c3dab451fff19414e856a7e775ed328ef85c48bd149f4763244208be76d"}
Jun 08 12:15:25.708994 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:25.708525    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn" event={"ID":"e50bc24a-7da9-48a9-82d3-05aa1e856f81","Type":"ContainerStarted","Data":"d42a1950d65c2bd90884d926f84c0445f5842c1b20b2a8fbb79a657618154a19"}
Jun 08 12:15:25.708994 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:25.708544    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn" event={"ID":"e50bc24a-7da9-48a9-82d3-05aa1e856f81","Type":"ContainerStarted","Data":"93f727ada60e2cf746f7c2688fbce7cc0a6e57d0fc70a177773b3b38c0d272bb"}
Jun 08 12:15:25.732737 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:25.732678    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn" podStartSLOduration=13.732657342 podStartE2EDuration="13.732657342s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:15:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:15:25.731208379 +0000 UTC m=+1647.002783559" watchObservedRunningTime="2026-06-08 12:15:25.732657342 +0000 UTC m=+1647.004232524"
Jun 08 12:15:25.846289 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:25.846253    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn"
Jun 08 12:15:25.846488 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:25.846311    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn"
Jun 08 12:15:25.846488 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:25.846333    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn"
Jun 08 12:15:25.848432 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:25.848391    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn" podUID="e50bc24a-7da9-48a9-82d3-05aa1e856f81" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.39:8443: connect: connection refused"
Jun 08 12:15:25.848569 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:25.848421    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn" podUID="e50bc24a-7da9-48a9-82d3-05aa1e856f81" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.39:8816: connect: connection refused"
Jun 08 12:15:25.848569 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:25.848431    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn" podUID="e50bc24a-7da9-48a9-82d3-05aa1e856f81" containerName="online" probeResult="failure" output="Get \"https://10.132.0.39:6567/health\": dial tcp 10.132.0.39:6567: connect: connection refused"
Jun 08 12:15:28.845866 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:28.845813    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn" podUID="e50bc24a-7da9-48a9-82d3-05aa1e856f81" containerName="online" probeResult="failure" output="Get \"https://10.132.0.39:6567/health\": dial tcp 10.132.0.39:6567: connect: connection refused"
Jun 08 12:15:28.846387 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:28.845815    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn" podUID="e50bc24a-7da9-48a9-82d3-05aa1e856f81" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.39:8816: connect: connection refused"
Jun 08 12:15:28.846387 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:28.845817    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn" podUID="e50bc24a-7da9-48a9-82d3-05aa1e856f81" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.39:8443: connect: connection refused"
Jun 08 12:15:31.847333 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:31.847304    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn"
Jun 08 12:15:31.847843 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:31.847398    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn"
Jun 08 12:15:31.847843 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:31.847702    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn"
Jun 08 12:15:31.847843 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:31.847740    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn"
Jun 08 12:15:31.848020 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:31.848005    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn"
Jun 08 12:15:31.848146 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:31.848131    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn"
Jun 08 12:15:31.851409 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:31.851394    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn"
Jun 08 12:15:32.742014 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:32.741985    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn"
Jun 08 12:15:32.744774 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:15:32.744752    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn"
Jun 08 12:16:34.237667 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:16:34.237632    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn"]
Jun 08 12:16:34.238201 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:16:34.237852    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn" podUID="e50bc24a-7da9-48a9-82d3-05aa1e856f81" containerName="online" containerID="cri-o://93f727ada60e2cf746f7c2688fbce7cc0a6e57d0fc70a177773b3b38c0d272bb" gracePeriod=30
Jun 08 12:16:34.238201 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:16:34.237979    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn" podUID="e50bc24a-7da9-48a9-82d3-05aa1e856f81" containerName="offline" containerID="cri-o://d42a1950d65c2bd90884d926f84c0445f5842c1b20b2a8fbb79a657618154a19" gracePeriod=30
Jun 08 12:16:34.238201 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:16:34.237986    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn" podUID="e50bc24a-7da9-48a9-82d3-05aa1e856f81" containerName="ui" containerID="cri-o://21c56c3dab451fff19414e856a7e775ed328ef85c48bd149f4763244208be76d" gracePeriod=30
Jun 08 12:16:34.362621 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:16:34.362577    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55"]
Jun 08 12:16:34.362937 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:16:34.362882    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55" podUID="e762e92b-3e83-477a-8e99-2df158361d45" containerName="registry" containerID="cri-o://21a392a9bbfd093bf489d0d2e49f3ccb76bffe9b589f786cf060621926fd7d2c" gracePeriod=30
Jun 08 12:16:34.363200 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:16:34.362935    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55" podUID="e762e92b-3e83-477a-8e99-2df158361d45" containerName="offline" containerID="cri-o://9cc25cb6c5fb554eceee8a3cf2cc47c6f73541447a93763d9585b4200ae8d7f0" gracePeriod=30
Jun 08 12:16:34.363331 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:16:34.362938    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55" podUID="e762e92b-3e83-477a-8e99-2df158361d45" containerName="online" containerID="cri-o://9a79da9926bac03128550b6bd31cb6313c64183a663a1e3e800b6c2e2e7b8705" gracePeriod=30
Jun 08 12:16:34.363407 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:16:34.362965    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55" podUID="e762e92b-3e83-477a-8e99-2df158361d45" containerName="ui" containerID="cri-o://3302632431e236414e2904de90d74b98aa79b50438b202d7891b78e082e6f9f8" gracePeriod=30
Jun 08 12:16:35.000770 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:16:35.000733    2583 generic.go:356] "Generic (PLEG): container finished" podID="e762e92b-3e83-477a-8e99-2df158361d45" containerID="3302632431e236414e2904de90d74b98aa79b50438b202d7891b78e082e6f9f8" exitCode=0
Jun 08 12:16:35.000957 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:16:35.000806    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55" event={"ID":"e762e92b-3e83-477a-8e99-2df158361d45","Type":"ContainerDied","Data":"3302632431e236414e2904de90d74b98aa79b50438b202d7891b78e082e6f9f8"}
Jun 08 12:16:35.003579 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:16:35.003552    2583 generic.go:356] "Generic (PLEG): container finished" podID="e50bc24a-7da9-48a9-82d3-05aa1e856f81" containerID="21c56c3dab451fff19414e856a7e775ed328ef85c48bd149f4763244208be76d" exitCode=0
Jun 08 12:16:35.003715 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:16:35.003634    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn" event={"ID":"e50bc24a-7da9-48a9-82d3-05aa1e856f81","Type":"ContainerDied","Data":"21c56c3dab451fff19414e856a7e775ed328ef85c48bd149f4763244208be76d"}
Jun 08 12:16:36.011795 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:16:36.011765    2583 generic.go:356] "Generic (PLEG): container finished" podID="e762e92b-3e83-477a-8e99-2df158361d45" containerID="9a79da9926bac03128550b6bd31cb6313c64183a663a1e3e800b6c2e2e7b8705" exitCode=0
Jun 08 12:16:36.012240 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:16:36.011833    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55" event={"ID":"e762e92b-3e83-477a-8e99-2df158361d45","Type":"ContainerDied","Data":"9a79da9926bac03128550b6bd31cb6313c64183a663a1e3e800b6c2e2e7b8705"}
Jun 08 12:16:36.014294 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:16:36.014268    2583 generic.go:356] "Generic (PLEG): container finished" podID="e50bc24a-7da9-48a9-82d3-05aa1e856f81" containerID="93f727ada60e2cf746f7c2688fbce7cc0a6e57d0fc70a177773b3b38c0d272bb" exitCode=0
Jun 08 12:16:36.014408 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:16:36.014337    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn" event={"ID":"e50bc24a-7da9-48a9-82d3-05aa1e856f81","Type":"ContainerDied","Data":"93f727ada60e2cf746f7c2688fbce7cc0a6e57d0fc70a177773b3b38c0d272bb"}
Jun 08 12:16:40.169577 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:16:40.169523    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55" podUID="e762e92b-3e83-477a-8e99-2df158361d45" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.38:8443: connect: connection refused"
Jun 08 12:16:40.379808 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:16:40.379761    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55" podUID="e762e92b-3e83-477a-8e99-2df158361d45" containerName="online" probeResult="failure" output="Get \"https://10.132.0.38:6567/health\": dial tcp 10.132.0.38:6567: connect: connection refused"
Jun 08 12:16:41.848809 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:16:41.848763    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn" podUID="e50bc24a-7da9-48a9-82d3-05aa1e856f81" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.39:8443: connect: connection refused"
Jun 08 12:16:42.743044 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:16:42.742999    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn" podUID="e50bc24a-7da9-48a9-82d3-05aa1e856f81" containerName="online" probeResult="failure" output="Get \"https://10.132.0.39:6567/health\": dial tcp 10.132.0.39:6567: connect: connection refused"
Jun 08 12:16:50.169271 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:16:50.169218    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55" podUID="e762e92b-3e83-477a-8e99-2df158361d45" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.38:8443: connect: connection refused"
Jun 08 12:16:50.379519 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:16:50.379476    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55" podUID="e762e92b-3e83-477a-8e99-2df158361d45" containerName="online" probeResult="failure" output="Get \"https://10.132.0.38:6567/health\": dial tcp 10.132.0.38:6567: connect: connection refused"
Jun 08 12:16:51.848452 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:16:51.848395    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn" podUID="e50bc24a-7da9-48a9-82d3-05aa1e856f81" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.39:8443: connect: connection refused"
Jun 08 12:16:52.742216 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:16:52.742172    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn" podUID="e50bc24a-7da9-48a9-82d3-05aa1e856f81" containerName="online" probeResult="failure" output="Get \"https://10.132.0.39:6567/health\": dial tcp 10.132.0.39:6567: connect: connection refused"
Jun 08 12:17:00.169426 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:00.169370    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55" podUID="e762e92b-3e83-477a-8e99-2df158361d45" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.38:8443: connect: connection refused"
Jun 08 12:17:00.169905 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:00.169580    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55"
Jun 08 12:17:00.379514 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:00.379472    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55" podUID="e762e92b-3e83-477a-8e99-2df158361d45" containerName="online" probeResult="failure" output="Get \"https://10.132.0.38:6567/health\": dial tcp 10.132.0.38:6567: connect: connection refused"
Jun 08 12:17:00.379701 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:00.379603    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55"
Jun 08 12:17:01.848299 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:01.848257    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn" podUID="e50bc24a-7da9-48a9-82d3-05aa1e856f81" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.39:8443: connect: connection refused"
Jun 08 12:17:01.848767 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:01.848373    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn"
Jun 08 12:17:02.742571 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:02.742534    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn" podUID="e50bc24a-7da9-48a9-82d3-05aa1e856f81" containerName="online" probeResult="failure" output="Get \"https://10.132.0.39:6567/health\": dial tcp 10.132.0.39:6567: connect: connection refused"
Jun 08 12:17:02.742784 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:02.742638    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn"
Jun 08 12:17:04.886289 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:04.886258    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn"
Jun 08 12:17:04.979564 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:04.979526    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mcdzx\" (UniqueName: \"kubernetes.io/projected/e50bc24a-7da9-48a9-82d3-05aa1e856f81-kube-api-access-mcdzx\") pod \"e50bc24a-7da9-48a9-82d3-05aa1e856f81\" (UID: \"e50bc24a-7da9-48a9-82d3-05aa1e856f81\") "
Jun 08 12:17:04.979766 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:04.979633    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/e50bc24a-7da9-48a9-82d3-05aa1e856f81-registry-tls\") pod \"e50bc24a-7da9-48a9-82d3-05aa1e856f81\" (UID: \"e50bc24a-7da9-48a9-82d3-05aa1e856f81\") "
Jun 08 12:17:04.979766 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:04.979680    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e50bc24a-7da9-48a9-82d3-05aa1e856f81-offline-tls\") pod \"e50bc24a-7da9-48a9-82d3-05aa1e856f81\" (UID: \"e50bc24a-7da9-48a9-82d3-05aa1e856f81\") "
Jun 08 12:17:04.979766 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:04.979722    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e50bc24a-7da9-48a9-82d3-05aa1e856f81-feast-data\") pod \"e50bc24a-7da9-48a9-82d3-05aa1e856f81\" (UID: \"e50bc24a-7da9-48a9-82d3-05aa1e856f81\") "
Jun 08 12:17:04.979766 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:04.979753    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e50bc24a-7da9-48a9-82d3-05aa1e856f81-online-tls\") pod \"e50bc24a-7da9-48a9-82d3-05aa1e856f81\" (UID: \"e50bc24a-7da9-48a9-82d3-05aa1e856f81\") "
Jun 08 12:17:04.980074 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:04.979799    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e50bc24a-7da9-48a9-82d3-05aa1e856f81-ui-tls\") pod \"e50bc24a-7da9-48a9-82d3-05aa1e856f81\" (UID: \"e50bc24a-7da9-48a9-82d3-05aa1e856f81\") "
Jun 08 12:17:04.980138 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:04.980109    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e50bc24a-7da9-48a9-82d3-05aa1e856f81-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e50bc24a-7da9-48a9-82d3-05aa1e856f81" (UID: "e50bc24a-7da9-48a9-82d3-05aa1e856f81"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 08 12:17:04.980348 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:04.980314    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e50bc24a-7da9-48a9-82d3-05aa1e856f81-feast-data" (OuterVolumeSpecName: "feast-data") pod "e50bc24a-7da9-48a9-82d3-05aa1e856f81" (UID: "e50bc24a-7da9-48a9-82d3-05aa1e856f81"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 08 12:17:04.982245 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:04.982207    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e50bc24a-7da9-48a9-82d3-05aa1e856f81-online-tls" (OuterVolumeSpecName: "online-tls") pod "e50bc24a-7da9-48a9-82d3-05aa1e856f81" (UID: "e50bc24a-7da9-48a9-82d3-05aa1e856f81"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 08 12:17:04.982387 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:04.982352    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e50bc24a-7da9-48a9-82d3-05aa1e856f81-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "e50bc24a-7da9-48a9-82d3-05aa1e856f81" (UID: "e50bc24a-7da9-48a9-82d3-05aa1e856f81"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 08 12:17:04.982387 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:04.982368    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e50bc24a-7da9-48a9-82d3-05aa1e856f81-kube-api-access-mcdzx" (OuterVolumeSpecName: "kube-api-access-mcdzx") pod "e50bc24a-7da9-48a9-82d3-05aa1e856f81" (UID: "e50bc24a-7da9-48a9-82d3-05aa1e856f81"). InnerVolumeSpecName "kube-api-access-mcdzx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 08 12:17:04.982532 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:04.982442    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e50bc24a-7da9-48a9-82d3-05aa1e856f81-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "e50bc24a-7da9-48a9-82d3-05aa1e856f81" (UID: "e50bc24a-7da9-48a9-82d3-05aa1e856f81"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 08 12:17:05.005013 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.004950    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55"
Jun 08 12:17:05.080475 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.080436    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-clg7w\" (UniqueName: \"kubernetes.io/projected/e762e92b-3e83-477a-8e99-2df158361d45-kube-api-access-clg7w\") pod \"e762e92b-3e83-477a-8e99-2df158361d45\" (UID: \"e762e92b-3e83-477a-8e99-2df158361d45\") "
Jun 08 12:17:05.080475 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.080482    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e762e92b-3e83-477a-8e99-2df158361d45-registry-tls\") pod \"e762e92b-3e83-477a-8e99-2df158361d45\" (UID: \"e762e92b-3e83-477a-8e99-2df158361d45\") "
Jun 08 12:17:05.080734 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.080540    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e762e92b-3e83-477a-8e99-2df158361d45-feast-data\") pod \"e762e92b-3e83-477a-8e99-2df158361d45\" (UID: \"e762e92b-3e83-477a-8e99-2df158361d45\") "
Jun 08 12:17:05.080734 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.080568    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e762e92b-3e83-477a-8e99-2df158361d45-online-tls\") pod \"e762e92b-3e83-477a-8e99-2df158361d45\" (UID: \"e762e92b-3e83-477a-8e99-2df158361d45\") "
Jun 08 12:17:05.080734 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.080585    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e762e92b-3e83-477a-8e99-2df158361d45-offline-tls\") pod \"e762e92b-3e83-477a-8e99-2df158361d45\" (UID: \"e762e92b-3e83-477a-8e99-2df158361d45\") "
Jun 08 12:17:05.080734 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.080614    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e762e92b-3e83-477a-8e99-2df158361d45-ui-tls\") pod \"e762e92b-3e83-477a-8e99-2df158361d45\" (UID: \"e762e92b-3e83-477a-8e99-2df158361d45\") "
Jun 08 12:17:05.081075 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.080856    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mcdzx\" (UniqueName: \"kubernetes.io/projected/e50bc24a-7da9-48a9-82d3-05aa1e856f81-kube-api-access-mcdzx\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:17:05.081075 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.080875    2583 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/e50bc24a-7da9-48a9-82d3-05aa1e856f81-registry-tls\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:17:05.081075 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.080888    2583 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e50bc24a-7da9-48a9-82d3-05aa1e856f81-offline-tls\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:17:05.081075 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.080901    2583 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e50bc24a-7da9-48a9-82d3-05aa1e856f81-feast-data\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:17:05.081075 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.080914    2583 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e50bc24a-7da9-48a9-82d3-05aa1e856f81-online-tls\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:17:05.081075 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.080926    2583 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e50bc24a-7da9-48a9-82d3-05aa1e856f81-ui-tls\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:17:05.081410 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.081129    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e762e92b-3e83-477a-8e99-2df158361d45-feast-data" (OuterVolumeSpecName: "feast-data") pod "e762e92b-3e83-477a-8e99-2df158361d45" (UID: "e762e92b-3e83-477a-8e99-2df158361d45"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 08 12:17:05.082736 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.082705    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e762e92b-3e83-477a-8e99-2df158361d45-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e762e92b-3e83-477a-8e99-2df158361d45" (UID: "e762e92b-3e83-477a-8e99-2df158361d45"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 08 12:17:05.082851 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.082771    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e762e92b-3e83-477a-8e99-2df158361d45-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "e762e92b-3e83-477a-8e99-2df158361d45" (UID: "e762e92b-3e83-477a-8e99-2df158361d45"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 08 12:17:05.082851 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.082774    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e762e92b-3e83-477a-8e99-2df158361d45-kube-api-access-clg7w" (OuterVolumeSpecName: "kube-api-access-clg7w") pod "e762e92b-3e83-477a-8e99-2df158361d45" (UID: "e762e92b-3e83-477a-8e99-2df158361d45"). InnerVolumeSpecName "kube-api-access-clg7w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 08 12:17:05.083074 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.083037    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e762e92b-3e83-477a-8e99-2df158361d45-online-tls" (OuterVolumeSpecName: "online-tls") pod "e762e92b-3e83-477a-8e99-2df158361d45" (UID: "e762e92b-3e83-477a-8e99-2df158361d45"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 08 12:17:05.083156 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.083120    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e762e92b-3e83-477a-8e99-2df158361d45-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "e762e92b-3e83-477a-8e99-2df158361d45" (UID: "e762e92b-3e83-477a-8e99-2df158361d45"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 08 12:17:05.129980 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.129945    2583 generic.go:356] "Generic (PLEG): container finished" podID="e762e92b-3e83-477a-8e99-2df158361d45" containerID="9cc25cb6c5fb554eceee8a3cf2cc47c6f73541447a93763d9585b4200ae8d7f0" exitCode=137
Jun 08 12:17:05.129980 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.129973    2583 generic.go:356] "Generic (PLEG): container finished" podID="e762e92b-3e83-477a-8e99-2df158361d45" containerID="21a392a9bbfd093bf489d0d2e49f3ccb76bffe9b589f786cf060621926fd7d2c" exitCode=137
Jun 08 12:17:05.130223 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.130020    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55"
Jun 08 12:17:05.130223 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.130032    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55" event={"ID":"e762e92b-3e83-477a-8e99-2df158361d45","Type":"ContainerDied","Data":"9cc25cb6c5fb554eceee8a3cf2cc47c6f73541447a93763d9585b4200ae8d7f0"}
Jun 08 12:17:05.130223 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.130104    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55" event={"ID":"e762e92b-3e83-477a-8e99-2df158361d45","Type":"ContainerDied","Data":"21a392a9bbfd093bf489d0d2e49f3ccb76bffe9b589f786cf060621926fd7d2c"}
Jun 08 12:17:05.130223 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.130125    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55" event={"ID":"e762e92b-3e83-477a-8e99-2df158361d45","Type":"ContainerDied","Data":"e93c2b37610b258ae0d237782f12537b36d7c63dd6e4f96efdcfdae4c296ab1d"}
Jun 08 12:17:05.130223 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.130151    2583 scope.go:117] "RemoveContainer" containerID="3302632431e236414e2904de90d74b98aa79b50438b202d7891b78e082e6f9f8"
Jun 08 12:17:05.132886 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.132858    2583 generic.go:356] "Generic (PLEG): container finished" podID="e50bc24a-7da9-48a9-82d3-05aa1e856f81" containerID="d42a1950d65c2bd90884d926f84c0445f5842c1b20b2a8fbb79a657618154a19" exitCode=137
Jun 08 12:17:05.133007 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.132889    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn" event={"ID":"e50bc24a-7da9-48a9-82d3-05aa1e856f81","Type":"ContainerDied","Data":"d42a1950d65c2bd90884d926f84c0445f5842c1b20b2a8fbb79a657618154a19"}
Jun 08 12:17:05.133007 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.132921    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn"
Jun 08 12:17:05.133007 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.132942    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn" event={"ID":"e50bc24a-7da9-48a9-82d3-05aa1e856f81","Type":"ContainerDied","Data":"00adf7685881bd1e26141dbe078e8f7edd678e559f6f0e6588389ea1273da251"}
Jun 08 12:17:05.139535 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.139410    2583 scope.go:117] "RemoveContainer" containerID="9cc25cb6c5fb554eceee8a3cf2cc47c6f73541447a93763d9585b4200ae8d7f0"
Jun 08 12:17:05.147397 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.147380    2583 scope.go:117] "RemoveContainer" containerID="9a79da9926bac03128550b6bd31cb6313c64183a663a1e3e800b6c2e2e7b8705"
Jun 08 12:17:05.153460 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.153439    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55"]
Jun 08 12:17:05.156667 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.156573    2583 scope.go:117] "RemoveContainer" containerID="21a392a9bbfd093bf489d0d2e49f3ccb76bffe9b589f786cf060621926fd7d2c"
Jun 08 12:17:05.158552 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.158532    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-wlw55"]
Jun 08 12:17:05.164403 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.164385    2583 scope.go:117] "RemoveContainer" containerID="7f8d9aac76260a6f9eec383f7fec123bffc8e60b3d1926f48a0710760c874158"
Jun 08 12:17:05.169688 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.169666    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn"]
Jun 08 12:17:05.172017 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.171997    2583 scope.go:117] "RemoveContainer" containerID="2f23f995db4700096919dc297a2f47898782ad33755bc2fd79b969ee9cbb81f7"
Jun 08 12:17:05.173314 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.173294    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-sjxmn"]
Jun 08 12:17:05.178892 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.178876    2583 scope.go:117] "RemoveContainer" containerID="3302632431e236414e2904de90d74b98aa79b50438b202d7891b78e082e6f9f8"
Jun 08 12:17:05.179196 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:17:05.179176    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3302632431e236414e2904de90d74b98aa79b50438b202d7891b78e082e6f9f8\": container with ID starting with 3302632431e236414e2904de90d74b98aa79b50438b202d7891b78e082e6f9f8 not found: ID does not exist" containerID="3302632431e236414e2904de90d74b98aa79b50438b202d7891b78e082e6f9f8"
Jun 08 12:17:05.179256 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.179203    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3302632431e236414e2904de90d74b98aa79b50438b202d7891b78e082e6f9f8"} err="failed to get container status \"3302632431e236414e2904de90d74b98aa79b50438b202d7891b78e082e6f9f8\": rpc error: code = NotFound desc = could not find container \"3302632431e236414e2904de90d74b98aa79b50438b202d7891b78e082e6f9f8\": container with ID starting with 3302632431e236414e2904de90d74b98aa79b50438b202d7891b78e082e6f9f8 not found: ID does not exist"
Jun 08 12:17:05.179256 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.179219    2583 scope.go:117] "RemoveContainer" containerID="9cc25cb6c5fb554eceee8a3cf2cc47c6f73541447a93763d9585b4200ae8d7f0"
Jun 08 12:17:05.179479 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:17:05.179461    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9cc25cb6c5fb554eceee8a3cf2cc47c6f73541447a93763d9585b4200ae8d7f0\": container with ID starting with 9cc25cb6c5fb554eceee8a3cf2cc47c6f73541447a93763d9585b4200ae8d7f0 not found: ID does not exist" containerID="9cc25cb6c5fb554eceee8a3cf2cc47c6f73541447a93763d9585b4200ae8d7f0"
Jun 08 12:17:05.179525 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.179486    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cc25cb6c5fb554eceee8a3cf2cc47c6f73541447a93763d9585b4200ae8d7f0"} err="failed to get container status \"9cc25cb6c5fb554eceee8a3cf2cc47c6f73541447a93763d9585b4200ae8d7f0\": rpc error: code = NotFound desc = could not find container \"9cc25cb6c5fb554eceee8a3cf2cc47c6f73541447a93763d9585b4200ae8d7f0\": container with ID starting with 9cc25cb6c5fb554eceee8a3cf2cc47c6f73541447a93763d9585b4200ae8d7f0 not found: ID does not exist"
Jun 08 12:17:05.179525 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.179510    2583 scope.go:117] "RemoveContainer" containerID="9a79da9926bac03128550b6bd31cb6313c64183a663a1e3e800b6c2e2e7b8705"
Jun 08 12:17:05.179727 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:17:05.179712    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a79da9926bac03128550b6bd31cb6313c64183a663a1e3e800b6c2e2e7b8705\": container with ID starting with 9a79da9926bac03128550b6bd31cb6313c64183a663a1e3e800b6c2e2e7b8705 not found: ID does not exist" containerID="9a79da9926bac03128550b6bd31cb6313c64183a663a1e3e800b6c2e2e7b8705"
Jun 08 12:17:05.179772 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.179729    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a79da9926bac03128550b6bd31cb6313c64183a663a1e3e800b6c2e2e7b8705"} err="failed to get container status \"9a79da9926bac03128550b6bd31cb6313c64183a663a1e3e800b6c2e2e7b8705\": rpc error: code = NotFound desc = could not find container \"9a79da9926bac03128550b6bd31cb6313c64183a663a1e3e800b6c2e2e7b8705\": container with ID starting with 9a79da9926bac03128550b6bd31cb6313c64183a663a1e3e800b6c2e2e7b8705 not found: ID does not exist"
Jun 08 12:17:05.179772 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.179741    2583 scope.go:117] "RemoveContainer" containerID="21a392a9bbfd093bf489d0d2e49f3ccb76bffe9b589f786cf060621926fd7d2c"
Jun 08 12:17:05.179991 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:17:05.179971    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21a392a9bbfd093bf489d0d2e49f3ccb76bffe9b589f786cf060621926fd7d2c\": container with ID starting with 21a392a9bbfd093bf489d0d2e49f3ccb76bffe9b589f786cf060621926fd7d2c not found: ID does not exist" containerID="21a392a9bbfd093bf489d0d2e49f3ccb76bffe9b589f786cf060621926fd7d2c"
Jun 08 12:17:05.180035 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.179997    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21a392a9bbfd093bf489d0d2e49f3ccb76bffe9b589f786cf060621926fd7d2c"} err="failed to get container status \"21a392a9bbfd093bf489d0d2e49f3ccb76bffe9b589f786cf060621926fd7d2c\": rpc error: code = NotFound desc = could not find container \"21a392a9bbfd093bf489d0d2e49f3ccb76bffe9b589f786cf060621926fd7d2c\": container with ID starting with 21a392a9bbfd093bf489d0d2e49f3ccb76bffe9b589f786cf060621926fd7d2c not found: ID does not exist"
Jun 08 12:17:05.180035 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.180011    2583 scope.go:117] "RemoveContainer" containerID="7f8d9aac76260a6f9eec383f7fec123bffc8e60b3d1926f48a0710760c874158"
Jun 08 12:17:05.180237 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:17:05.180223    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f8d9aac76260a6f9eec383f7fec123bffc8e60b3d1926f48a0710760c874158\": container with ID starting with 7f8d9aac76260a6f9eec383f7fec123bffc8e60b3d1926f48a0710760c874158 not found: ID does not exist" containerID="7f8d9aac76260a6f9eec383f7fec123bffc8e60b3d1926f48a0710760c874158"
Jun 08 12:17:05.180291 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.180241    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f8d9aac76260a6f9eec383f7fec123bffc8e60b3d1926f48a0710760c874158"} err="failed to get container status \"7f8d9aac76260a6f9eec383f7fec123bffc8e60b3d1926f48a0710760c874158\": rpc error: code = NotFound desc = could not find container \"7f8d9aac76260a6f9eec383f7fec123bffc8e60b3d1926f48a0710760c874158\": container with ID starting with 7f8d9aac76260a6f9eec383f7fec123bffc8e60b3d1926f48a0710760c874158 not found: ID does not exist"
Jun 08 12:17:05.180291 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.180254    2583 scope.go:117] "RemoveContainer" containerID="2f23f995db4700096919dc297a2f47898782ad33755bc2fd79b969ee9cbb81f7"
Jun 08 12:17:05.180503 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:17:05.180485    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f23f995db4700096919dc297a2f47898782ad33755bc2fd79b969ee9cbb81f7\": container with ID starting with 2f23f995db4700096919dc297a2f47898782ad33755bc2fd79b969ee9cbb81f7 not found: ID does not exist" containerID="2f23f995db4700096919dc297a2f47898782ad33755bc2fd79b969ee9cbb81f7"
Jun 08 12:17:05.180570 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.180508    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f23f995db4700096919dc297a2f47898782ad33755bc2fd79b969ee9cbb81f7"} err="failed to get container status \"2f23f995db4700096919dc297a2f47898782ad33755bc2fd79b969ee9cbb81f7\": rpc error: code = NotFound desc = could not find container \"2f23f995db4700096919dc297a2f47898782ad33755bc2fd79b969ee9cbb81f7\": container with ID starting with 2f23f995db4700096919dc297a2f47898782ad33755bc2fd79b969ee9cbb81f7 not found: ID does not exist"
Jun 08 12:17:05.180570 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.180521    2583 scope.go:117] "RemoveContainer" containerID="3302632431e236414e2904de90d74b98aa79b50438b202d7891b78e082e6f9f8"
Jun 08 12:17:05.180769 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.180745    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3302632431e236414e2904de90d74b98aa79b50438b202d7891b78e082e6f9f8"} err="failed to get container status \"3302632431e236414e2904de90d74b98aa79b50438b202d7891b78e082e6f9f8\": rpc error: code = NotFound desc = could not find container \"3302632431e236414e2904de90d74b98aa79b50438b202d7891b78e082e6f9f8\": container with ID starting with 3302632431e236414e2904de90d74b98aa79b50438b202d7891b78e082e6f9f8 not found: ID does not exist"
Jun 08 12:17:05.180832 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.180770    2583 scope.go:117] "RemoveContainer" containerID="9cc25cb6c5fb554eceee8a3cf2cc47c6f73541447a93763d9585b4200ae8d7f0"
Jun 08 12:17:05.181014 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.180993    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cc25cb6c5fb554eceee8a3cf2cc47c6f73541447a93763d9585b4200ae8d7f0"} err="failed to get container status \"9cc25cb6c5fb554eceee8a3cf2cc47c6f73541447a93763d9585b4200ae8d7f0\": rpc error: code = NotFound desc = could not find container \"9cc25cb6c5fb554eceee8a3cf2cc47c6f73541447a93763d9585b4200ae8d7f0\": container with ID starting with 9cc25cb6c5fb554eceee8a3cf2cc47c6f73541447a93763d9585b4200ae8d7f0 not found: ID does not exist"
Jun 08 12:17:05.181104 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.181015    2583 scope.go:117] "RemoveContainer" containerID="9a79da9926bac03128550b6bd31cb6313c64183a663a1e3e800b6c2e2e7b8705"
Jun 08 12:17:05.181288 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.181268    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a79da9926bac03128550b6bd31cb6313c64183a663a1e3e800b6c2e2e7b8705"} err="failed to get container status \"9a79da9926bac03128550b6bd31cb6313c64183a663a1e3e800b6c2e2e7b8705\": rpc error: code = NotFound desc = could not find container \"9a79da9926bac03128550b6bd31cb6313c64183a663a1e3e800b6c2e2e7b8705\": container with ID starting with 9a79da9926bac03128550b6bd31cb6313c64183a663a1e3e800b6c2e2e7b8705 not found: ID does not exist"
Jun 08 12:17:05.181365 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.181291    2583 scope.go:117] "RemoveContainer" containerID="21a392a9bbfd093bf489d0d2e49f3ccb76bffe9b589f786cf060621926fd7d2c"
Jun 08 12:17:05.181365 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.181348    2583 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e762e92b-3e83-477a-8e99-2df158361d45-feast-data\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:17:05.181461 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.181369    2583 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e762e92b-3e83-477a-8e99-2df158361d45-online-tls\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:17:05.181461 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.181382    2583 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e762e92b-3e83-477a-8e99-2df158361d45-offline-tls\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:17:05.181461 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.181394    2583 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e762e92b-3e83-477a-8e99-2df158361d45-ui-tls\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:17:05.181461 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.181407    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-clg7w\" (UniqueName: \"kubernetes.io/projected/e762e92b-3e83-477a-8e99-2df158361d45-kube-api-access-clg7w\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:17:05.181461 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.181420    2583 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e762e92b-3e83-477a-8e99-2df158361d45-registry-tls\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:17:05.181635 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.181519    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21a392a9bbfd093bf489d0d2e49f3ccb76bffe9b589f786cf060621926fd7d2c"} err="failed to get container status \"21a392a9bbfd093bf489d0d2e49f3ccb76bffe9b589f786cf060621926fd7d2c\": rpc error: code = NotFound desc = could not find container \"21a392a9bbfd093bf489d0d2e49f3ccb76bffe9b589f786cf060621926fd7d2c\": container with ID starting with 21a392a9bbfd093bf489d0d2e49f3ccb76bffe9b589f786cf060621926fd7d2c not found: ID does not exist"
Jun 08 12:17:05.181635 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.181537    2583 scope.go:117] "RemoveContainer" containerID="7f8d9aac76260a6f9eec383f7fec123bffc8e60b3d1926f48a0710760c874158"
Jun 08 12:17:05.181758 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.181735    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f8d9aac76260a6f9eec383f7fec123bffc8e60b3d1926f48a0710760c874158"} err="failed to get container status \"7f8d9aac76260a6f9eec383f7fec123bffc8e60b3d1926f48a0710760c874158\": rpc error: code = NotFound desc = could not find container \"7f8d9aac76260a6f9eec383f7fec123bffc8e60b3d1926f48a0710760c874158\": container with ID starting with 7f8d9aac76260a6f9eec383f7fec123bffc8e60b3d1926f48a0710760c874158 not found: ID does not exist"
Jun 08 12:17:05.181826 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.181770    2583 scope.go:117] "RemoveContainer" containerID="2f23f995db4700096919dc297a2f47898782ad33755bc2fd79b969ee9cbb81f7"
Jun 08 12:17:05.181990 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.181971    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f23f995db4700096919dc297a2f47898782ad33755bc2fd79b969ee9cbb81f7"} err="failed to get container status \"2f23f995db4700096919dc297a2f47898782ad33755bc2fd79b969ee9cbb81f7\": rpc error: code = NotFound desc = could not find container \"2f23f995db4700096919dc297a2f47898782ad33755bc2fd79b969ee9cbb81f7\": container with ID starting with 2f23f995db4700096919dc297a2f47898782ad33755bc2fd79b969ee9cbb81f7 not found: ID does not exist"
Jun 08 12:17:05.182040 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.181990    2583 scope.go:117] "RemoveContainer" containerID="21c56c3dab451fff19414e856a7e775ed328ef85c48bd149f4763244208be76d"
Jun 08 12:17:05.185982 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.185964    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e50bc24a-7da9-48a9-82d3-05aa1e856f81" path="/var/lib/kubelet/pods/e50bc24a-7da9-48a9-82d3-05aa1e856f81/volumes"
Jun 08 12:17:05.186662 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.186643    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e762e92b-3e83-477a-8e99-2df158361d45" path="/var/lib/kubelet/pods/e762e92b-3e83-477a-8e99-2df158361d45/volumes"
Jun 08 12:17:05.189983 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.189969    2583 scope.go:117] "RemoveContainer" containerID="d42a1950d65c2bd90884d926f84c0445f5842c1b20b2a8fbb79a657618154a19"
Jun 08 12:17:05.196930 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.196914    2583 scope.go:117] "RemoveContainer" containerID="93f727ada60e2cf746f7c2688fbce7cc0a6e57d0fc70a177773b3b38c0d272bb"
Jun 08 12:17:05.203941 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.203925    2583 scope.go:117] "RemoveContainer" containerID="5b54e7e1320dc3c03f4f290e815a124d1b7c8dfe64294a9f54dceb0285512565"
Jun 08 12:17:05.210474 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.210458    2583 scope.go:117] "RemoveContainer" containerID="a70e401e9dc743bf0a27a2893ce628f513ec2fc4f25befa844caeac30643ce94"
Jun 08 12:17:05.217177 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.217159    2583 scope.go:117] "RemoveContainer" containerID="21c56c3dab451fff19414e856a7e775ed328ef85c48bd149f4763244208be76d"
Jun 08 12:17:05.217448 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:17:05.217431    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21c56c3dab451fff19414e856a7e775ed328ef85c48bd149f4763244208be76d\": container with ID starting with 21c56c3dab451fff19414e856a7e775ed328ef85c48bd149f4763244208be76d not found: ID does not exist" containerID="21c56c3dab451fff19414e856a7e775ed328ef85c48bd149f4763244208be76d"
Jun 08 12:17:05.217487 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.217456    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21c56c3dab451fff19414e856a7e775ed328ef85c48bd149f4763244208be76d"} err="failed to get container status \"21c56c3dab451fff19414e856a7e775ed328ef85c48bd149f4763244208be76d\": rpc error: code = NotFound desc = could not find container \"21c56c3dab451fff19414e856a7e775ed328ef85c48bd149f4763244208be76d\": container with ID starting with 21c56c3dab451fff19414e856a7e775ed328ef85c48bd149f4763244208be76d not found: ID does not exist"
Jun 08 12:17:05.217487 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.217473    2583 scope.go:117] "RemoveContainer" containerID="d42a1950d65c2bd90884d926f84c0445f5842c1b20b2a8fbb79a657618154a19"
Jun 08 12:17:05.217700 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:17:05.217685    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d42a1950d65c2bd90884d926f84c0445f5842c1b20b2a8fbb79a657618154a19\": container with ID starting with d42a1950d65c2bd90884d926f84c0445f5842c1b20b2a8fbb79a657618154a19 not found: ID does not exist" containerID="d42a1950d65c2bd90884d926f84c0445f5842c1b20b2a8fbb79a657618154a19"
Jun 08 12:17:05.217789 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.217702    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d42a1950d65c2bd90884d926f84c0445f5842c1b20b2a8fbb79a657618154a19"} err="failed to get container status \"d42a1950d65c2bd90884d926f84c0445f5842c1b20b2a8fbb79a657618154a19\": rpc error: code = NotFound desc = could not find container \"d42a1950d65c2bd90884d926f84c0445f5842c1b20b2a8fbb79a657618154a19\": container with ID starting with d42a1950d65c2bd90884d926f84c0445f5842c1b20b2a8fbb79a657618154a19 not found: ID does not exist"
Jun 08 12:17:05.217789 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.217715    2583 scope.go:117] "RemoveContainer" containerID="93f727ada60e2cf746f7c2688fbce7cc0a6e57d0fc70a177773b3b38c0d272bb"
Jun 08 12:17:05.217909 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:17:05.217893    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93f727ada60e2cf746f7c2688fbce7cc0a6e57d0fc70a177773b3b38c0d272bb\": container with ID starting with 93f727ada60e2cf746f7c2688fbce7cc0a6e57d0fc70a177773b3b38c0d272bb not found: ID does not exist" containerID="93f727ada60e2cf746f7c2688fbce7cc0a6e57d0fc70a177773b3b38c0d272bb"
Jun 08 12:17:05.217949 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.217913    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93f727ada60e2cf746f7c2688fbce7cc0a6e57d0fc70a177773b3b38c0d272bb"} err="failed to get container status \"93f727ada60e2cf746f7c2688fbce7cc0a6e57d0fc70a177773b3b38c0d272bb\": rpc error: code = NotFound desc = could not find container \"93f727ada60e2cf746f7c2688fbce7cc0a6e57d0fc70a177773b3b38c0d272bb\": container with ID starting with 93f727ada60e2cf746f7c2688fbce7cc0a6e57d0fc70a177773b3b38c0d272bb not found: ID does not exist"
Jun 08 12:17:05.217949 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.217926    2583 scope.go:117] "RemoveContainer" containerID="5b54e7e1320dc3c03f4f290e815a124d1b7c8dfe64294a9f54dceb0285512565"
Jun 08 12:17:05.218153 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:17:05.218138    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b54e7e1320dc3c03f4f290e815a124d1b7c8dfe64294a9f54dceb0285512565\": container with ID starting with 5b54e7e1320dc3c03f4f290e815a124d1b7c8dfe64294a9f54dceb0285512565 not found: ID does not exist" containerID="5b54e7e1320dc3c03f4f290e815a124d1b7c8dfe64294a9f54dceb0285512565"
Jun 08 12:17:05.218203 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.218156    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b54e7e1320dc3c03f4f290e815a124d1b7c8dfe64294a9f54dceb0285512565"} err="failed to get container status \"5b54e7e1320dc3c03f4f290e815a124d1b7c8dfe64294a9f54dceb0285512565\": rpc error: code = NotFound desc = could not find container \"5b54e7e1320dc3c03f4f290e815a124d1b7c8dfe64294a9f54dceb0285512565\": container with ID starting with 5b54e7e1320dc3c03f4f290e815a124d1b7c8dfe64294a9f54dceb0285512565 not found: ID does not exist"
Jun 08 12:17:05.218203 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.218169    2583 scope.go:117] "RemoveContainer" containerID="a70e401e9dc743bf0a27a2893ce628f513ec2fc4f25befa844caeac30643ce94"
Jun 08 12:17:05.218380 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:17:05.218356    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a70e401e9dc743bf0a27a2893ce628f513ec2fc4f25befa844caeac30643ce94\": container with ID starting with a70e401e9dc743bf0a27a2893ce628f513ec2fc4f25befa844caeac30643ce94 not found: ID does not exist" containerID="a70e401e9dc743bf0a27a2893ce628f513ec2fc4f25befa844caeac30643ce94"
Jun 08 12:17:05.218427 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:05.218386    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a70e401e9dc743bf0a27a2893ce628f513ec2fc4f25befa844caeac30643ce94"} err="failed to get container status \"a70e401e9dc743bf0a27a2893ce628f513ec2fc4f25befa844caeac30643ce94\": rpc error: code = NotFound desc = could not find container \"a70e401e9dc743bf0a27a2893ce628f513ec2fc4f25befa844caeac30643ce94\": container with ID starting with a70e401e9dc743bf0a27a2893ce628f513ec2fc4f25befa844caeac30643ce94 not found: ID does not exist"
Jun 08 12:17:47.453292 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:47.453249    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d"]
Jun 08 12:17:47.453897 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:47.453577    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e50bc24a-7da9-48a9-82d3-05aa1e856f81" containerName="online"
Jun 08 12:17:47.453897 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:47.453589    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e50bc24a-7da9-48a9-82d3-05aa1e856f81" containerName="online"
Jun 08 12:17:47.453897 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:47.453598    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e762e92b-3e83-477a-8e99-2df158361d45" containerName="online"
Jun 08 12:17:47.453897 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:47.453604    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e762e92b-3e83-477a-8e99-2df158361d45" containerName="online"
Jun 08 12:17:47.453897 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:47.453610    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e762e92b-3e83-477a-8e99-2df158361d45" containerName="offline"
Jun 08 12:17:47.453897 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:47.453620    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e762e92b-3e83-477a-8e99-2df158361d45" containerName="offline"
Jun 08 12:17:47.453897 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:47.453633    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e50bc24a-7da9-48a9-82d3-05aa1e856f81" containerName="offline"
Jun 08 12:17:47.453897 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:47.453638    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e50bc24a-7da9-48a9-82d3-05aa1e856f81" containerName="offline"
Jun 08 12:17:47.453897 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:47.453644    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e762e92b-3e83-477a-8e99-2df158361d45" containerName="feast-apply"
Jun 08 12:17:47.453897 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:47.453649    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e762e92b-3e83-477a-8e99-2df158361d45" containerName="feast-apply"
Jun 08 12:17:47.453897 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:47.453657    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e762e92b-3e83-477a-8e99-2df158361d45" containerName="ui"
Jun 08 12:17:47.453897 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:47.453665    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e762e92b-3e83-477a-8e99-2df158361d45" containerName="ui"
Jun 08 12:17:47.453897 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:47.453671    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e50bc24a-7da9-48a9-82d3-05aa1e856f81" containerName="feast-apply"
Jun 08 12:17:47.453897 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:47.453677    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e50bc24a-7da9-48a9-82d3-05aa1e856f81" containerName="feast-apply"
Jun 08 12:17:47.453897 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:47.453684    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e762e92b-3e83-477a-8e99-2df158361d45" containerName="registry"
Jun 08 12:17:47.453897 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:47.453689    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e762e92b-3e83-477a-8e99-2df158361d45" containerName="registry"
Jun 08 12:17:47.453897 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:47.453703    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e762e92b-3e83-477a-8e99-2df158361d45" containerName="feast-init"
Jun 08 12:17:47.453897 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:47.453711    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e762e92b-3e83-477a-8e99-2df158361d45" containerName="feast-init"
Jun 08 12:17:47.453897 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:47.453723    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e50bc24a-7da9-48a9-82d3-05aa1e856f81" containerName="feast-init"
Jun 08 12:17:47.453897 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:47.453728    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e50bc24a-7da9-48a9-82d3-05aa1e856f81" containerName="feast-init"
Jun 08 12:17:47.453897 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:47.453735    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e50bc24a-7da9-48a9-82d3-05aa1e856f81" containerName="ui"
Jun 08 12:17:47.453897 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:47.453741    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e50bc24a-7da9-48a9-82d3-05aa1e856f81" containerName="ui"
Jun 08 12:17:47.453897 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:47.453796    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="e762e92b-3e83-477a-8e99-2df158361d45" containerName="ui"
Jun 08 12:17:47.453897 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:47.453805    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="e762e92b-3e83-477a-8e99-2df158361d45" containerName="registry"
Jun 08 12:17:47.453897 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:47.453811    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="e762e92b-3e83-477a-8e99-2df158361d45" containerName="online"
Jun 08 12:17:47.453897 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:47.453817    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="e50bc24a-7da9-48a9-82d3-05aa1e856f81" containerName="online"
Jun 08 12:17:47.453897 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:47.453823    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="e50bc24a-7da9-48a9-82d3-05aa1e856f81" containerName="offline"
Jun 08 12:17:47.453897 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:47.453829    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="e50bc24a-7da9-48a9-82d3-05aa1e856f81" containerName="ui"
Jun 08 12:17:47.453897 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:47.453834    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="e762e92b-3e83-477a-8e99-2df158361d45" containerName="offline"
Jun 08 12:17:47.457376 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:47.457356    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d"
Jun 08 12:17:47.460010 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:47.459985    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
Jun 08 12:17:47.460620 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:47.460602    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
Jun 08 12:17:47.460769 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:47.460666    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
Jun 08 12:17:47.460835 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:47.460678    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
Jun 08 12:17:47.460890 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:47.460685    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-m8svp\""
Jun 08 12:17:47.460890 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:47.460721    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Jun 08 12:17:47.460987 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:47.460753    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Jun 08 12:17:47.468750 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:47.468726    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d"]
Jun 08 12:17:47.521354 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:47.521320    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8dbfe80e-acb5-4694-8288-caff4be668d1-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-7hz8d\" (UID: \"8dbfe80e-acb5-4694-8288-caff4be668d1\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d"
Jun 08 12:17:47.521547 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:47.521389    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8dbfe80e-acb5-4694-8288-caff4be668d1-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-7hz8d\" (UID: \"8dbfe80e-acb5-4694-8288-caff4be668d1\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d"
Jun 08 12:17:47.521547 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:47.521459    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8dbfe80e-acb5-4694-8288-caff4be668d1-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-7hz8d\" (UID: \"8dbfe80e-acb5-4694-8288-caff4be668d1\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d"
Jun 08 12:17:47.521547 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:47.521493    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8dbfe80e-acb5-4694-8288-caff4be668d1-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-7hz8d\" (UID: \"8dbfe80e-acb5-4694-8288-caff4be668d1\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d"
Jun 08 12:17:47.521547 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:47.521524    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8dbfe80e-acb5-4694-8288-caff4be668d1-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-7hz8d\" (UID: \"8dbfe80e-acb5-4694-8288-caff4be668d1\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d"
Jun 08 12:17:47.521727 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:47.521550    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvfcj\" (UniqueName: \"kubernetes.io/projected/8dbfe80e-acb5-4694-8288-caff4be668d1-kube-api-access-mvfcj\") pod \"feast-simple-feast-setup-75c64c888b-7hz8d\" (UID: \"8dbfe80e-acb5-4694-8288-caff4be668d1\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d"
Jun 08 12:17:47.623001 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:47.622961    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8dbfe80e-acb5-4694-8288-caff4be668d1-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-7hz8d\" (UID: \"8dbfe80e-acb5-4694-8288-caff4be668d1\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d"
Jun 08 12:17:47.623001 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:47.623006    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8dbfe80e-acb5-4694-8288-caff4be668d1-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-7hz8d\" (UID: \"8dbfe80e-acb5-4694-8288-caff4be668d1\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d"
Jun 08 12:17:47.623300 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:47.623033    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8dbfe80e-acb5-4694-8288-caff4be668d1-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-7hz8d\" (UID: \"8dbfe80e-acb5-4694-8288-caff4be668d1\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d"
Jun 08 12:17:47.623300 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:47.623102    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvfcj\" (UniqueName: \"kubernetes.io/projected/8dbfe80e-acb5-4694-8288-caff4be668d1-kube-api-access-mvfcj\") pod \"feast-simple-feast-setup-75c64c888b-7hz8d\" (UID: \"8dbfe80e-acb5-4694-8288-caff4be668d1\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d"
Jun 08 12:17:47.623300 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:47.623164    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8dbfe80e-acb5-4694-8288-caff4be668d1-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-7hz8d\" (UID: \"8dbfe80e-acb5-4694-8288-caff4be668d1\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d"
Jun 08 12:17:47.623300 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:17:47.623215    2583 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
Jun 08 12:17:47.623300 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:47.623239    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8dbfe80e-acb5-4694-8288-caff4be668d1-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-7hz8d\" (UID: \"8dbfe80e-acb5-4694-8288-caff4be668d1\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d"
Jun 08 12:17:47.623300 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:17:47.623300    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8dbfe80e-acb5-4694-8288-caff4be668d1-online-tls podName:8dbfe80e-acb5-4694-8288-caff4be668d1 nodeName:}" failed. No retries permitted until 2026-06-08 12:17:48.123276221 +0000 UTC m=+1789.394851385 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/8dbfe80e-acb5-4694-8288-caff4be668d1-online-tls") pod "feast-simple-feast-setup-75c64c888b-7hz8d" (UID: "8dbfe80e-acb5-4694-8288-caff4be668d1") : secret "feast-simple-feast-setup-online-tls" not found
Jun 08 12:17:47.623646 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:17:47.623337    2583 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
Jun 08 12:17:47.623646 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:17:47.623396    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8dbfe80e-acb5-4694-8288-caff4be668d1-registry-tls podName:8dbfe80e-acb5-4694-8288-caff4be668d1 nodeName:}" failed. No retries permitted until 2026-06-08 12:17:48.123379504 +0000 UTC m=+1789.394954664 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/8dbfe80e-acb5-4694-8288-caff4be668d1-registry-tls") pod "feast-simple-feast-setup-75c64c888b-7hz8d" (UID: "8dbfe80e-acb5-4694-8288-caff4be668d1") : secret "feast-simple-feast-setup-registry-tls" not found
Jun 08 12:17:47.623761 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:47.623700    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8dbfe80e-acb5-4694-8288-caff4be668d1-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-7hz8d\" (UID: \"8dbfe80e-acb5-4694-8288-caff4be668d1\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d"
Jun 08 12:17:47.625550 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:47.625516    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8dbfe80e-acb5-4694-8288-caff4be668d1-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-7hz8d\" (UID: \"8dbfe80e-acb5-4694-8288-caff4be668d1\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d"
Jun 08 12:17:47.625747 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:47.625727    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8dbfe80e-acb5-4694-8288-caff4be668d1-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-7hz8d\" (UID: \"8dbfe80e-acb5-4694-8288-caff4be668d1\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d"
Jun 08 12:17:47.633805 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:47.633779    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvfcj\" (UniqueName: \"kubernetes.io/projected/8dbfe80e-acb5-4694-8288-caff4be668d1-kube-api-access-mvfcj\") pod \"feast-simple-feast-setup-75c64c888b-7hz8d\" (UID: \"8dbfe80e-acb5-4694-8288-caff4be668d1\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d"
Jun 08 12:17:48.127767 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:48.127704    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8dbfe80e-acb5-4694-8288-caff4be668d1-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-7hz8d\" (UID: \"8dbfe80e-acb5-4694-8288-caff4be668d1\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d"
Jun 08 12:17:48.127996 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:48.127824    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8dbfe80e-acb5-4694-8288-caff4be668d1-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-7hz8d\" (UID: \"8dbfe80e-acb5-4694-8288-caff4be668d1\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d"
Jun 08 12:17:48.130167 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:48.130138    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8dbfe80e-acb5-4694-8288-caff4be668d1-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-7hz8d\" (UID: \"8dbfe80e-acb5-4694-8288-caff4be668d1\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d"
Jun 08 12:17:48.130267 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:48.130216    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8dbfe80e-acb5-4694-8288-caff4be668d1-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-7hz8d\" (UID: \"8dbfe80e-acb5-4694-8288-caff4be668d1\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d"
Jun 08 12:17:48.374106 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:48.373997    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d"
Jun 08 12:17:48.512107 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:48.512081    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d"]
Jun 08 12:17:48.514749 ip-10-0-136-189 kubenswrapper[2583]: W0608 12:17:48.514714    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8dbfe80e_acb5_4694_8288_caff4be668d1.slice/crio-2325cdde92b8463e331be2a34e0e3da3ab638484711bc62d212c55f8f6dd6844 WatchSource:0}: Error finding container 2325cdde92b8463e331be2a34e0e3da3ab638484711bc62d212c55f8f6dd6844: Status 404 returned error can't find the container with id 2325cdde92b8463e331be2a34e0e3da3ab638484711bc62d212c55f8f6dd6844
Jun 08 12:17:49.307651 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:49.307610    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d" event={"ID":"8dbfe80e-acb5-4694-8288-caff4be668d1","Type":"ContainerStarted","Data":"02f30d63ae350d37f3497e2ea9dde48d8aa62817d2b7b960b2646e5bd80abd8c"}
Jun 08 12:17:49.307832 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:49.307663    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d" event={"ID":"8dbfe80e-acb5-4694-8288-caff4be668d1","Type":"ContainerStarted","Data":"2325cdde92b8463e331be2a34e0e3da3ab638484711bc62d212c55f8f6dd6844"}
Jun 08 12:17:53.328423 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:53.328329    2583 generic.go:356] "Generic (PLEG): container finished" podID="8dbfe80e-acb5-4694-8288-caff4be668d1" containerID="02f30d63ae350d37f3497e2ea9dde48d8aa62817d2b7b960b2646e5bd80abd8c" exitCode=0
Jun 08 12:17:53.328423 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:53.328401    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d" event={"ID":"8dbfe80e-acb5-4694-8288-caff4be668d1","Type":"ContainerDied","Data":"02f30d63ae350d37f3497e2ea9dde48d8aa62817d2b7b960b2646e5bd80abd8c"}
Jun 08 12:17:54.334103 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:54.333982    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d" event={"ID":"8dbfe80e-acb5-4694-8288-caff4be668d1","Type":"ContainerStarted","Data":"c2c6ffd1617e827410a1df030f8f08469efe94d8dcd78a430d64f91f95dcfb55"}
Jun 08 12:17:59.260664 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:59.260632    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mnnbj_cdf82c13-c30a-474a-a135-3d1dbcbb6046/console-operator/2.log"
Jun 08 12:17:59.264718 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:59.264697    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mnnbj_cdf82c13-c30a-474a-a135-3d1dbcbb6046/console-operator/2.log"
Jun 08 12:17:59.359027 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:59.359000    2583 generic.go:356] "Generic (PLEG): container finished" podID="8dbfe80e-acb5-4694-8288-caff4be668d1" containerID="c2c6ffd1617e827410a1df030f8f08469efe94d8dcd78a430d64f91f95dcfb55" exitCode=0
Jun 08 12:17:59.359139 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:17:59.359041    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d" event={"ID":"8dbfe80e-acb5-4694-8288-caff4be668d1","Type":"ContainerDied","Data":"c2c6ffd1617e827410a1df030f8f08469efe94d8dcd78a430d64f91f95dcfb55"}
Jun 08 12:18:00.369100 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:18:00.369030    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d" event={"ID":"8dbfe80e-acb5-4694-8288-caff4be668d1","Type":"ContainerStarted","Data":"94737ad2eca704c260857a15c790bb05c62d2c8f8672f625ce0ddea2a280332e"}
Jun 08 12:18:00.369589 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:18:00.369128    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d" event={"ID":"8dbfe80e-acb5-4694-8288-caff4be668d1","Type":"ContainerStarted","Data":"9049fb684cf76354de4cf5300da4ef07e8f16f5f63a3ad7e1ba8af7db8f60356"}
Jun 08 12:18:00.369589 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:18:00.369163    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d" event={"ID":"8dbfe80e-acb5-4694-8288-caff4be668d1","Type":"ContainerStarted","Data":"fca4a311a192ee3a22cadf5e283e4ef6ad882d7eeed33b3894d5017dacb0882c"}
Jun 08 12:18:00.369589 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:18:00.369188    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d" event={"ID":"8dbfe80e-acb5-4694-8288-caff4be668d1","Type":"ContainerStarted","Data":"1d540fb8c6a4e28c58ade0f2cc19bef0dc6a73385fbf63ed151211dd8612bb87"}
Jun 08 12:18:00.374969 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:18:00.374931    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d"
Jun 08 12:18:00.375221 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:18:00.375195    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d"
Jun 08 12:18:00.375344 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:18:00.375227    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d"
Jun 08 12:18:00.375344 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:18:00.375245    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d"
Jun 08 12:18:00.377633 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:18:00.377440    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d" podUID="8dbfe80e-acb5-4694-8288-caff4be668d1" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.40:8443: connect: connection refused"
Jun 08 12:18:00.377633 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:18:00.377477    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d" podUID="8dbfe80e-acb5-4694-8288-caff4be668d1" containerName="online" probeResult="failure" output="Get \"https://10.132.0.40:6567/health\": dial tcp 10.132.0.40:6567: connect: connection refused"
Jun 08 12:18:00.377633 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:18:00.377507    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d" podUID="8dbfe80e-acb5-4694-8288-caff4be668d1" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.40:6571: connect: connection refused"
Jun 08 12:18:00.377633 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:18:00.377563    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d" podUID="8dbfe80e-acb5-4694-8288-caff4be668d1" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.40:8816: connect: connection refused"
Jun 08 12:18:00.396528 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:18:00.396467    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d" podStartSLOduration=13.396445268 podStartE2EDuration="13.396445268s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:17:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:18:00.394190864 +0000 UTC m=+1801.665766073" watchObservedRunningTime="2026-06-08 12:18:00.396445268 +0000 UTC m=+1801.668020450"
Jun 08 12:18:03.375130 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:18:03.375085    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d" podUID="8dbfe80e-acb5-4694-8288-caff4be668d1" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.40:6571: connect: connection refused"
Jun 08 12:18:03.375676 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:18:03.375093    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d" podUID="8dbfe80e-acb5-4694-8288-caff4be668d1" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.40:8816: connect: connection refused"
Jun 08 12:18:03.375800 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:18:03.375149    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d" podUID="8dbfe80e-acb5-4694-8288-caff4be668d1" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.40:8443: connect: connection refused"
Jun 08 12:18:03.375800 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:18:03.375157    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d" podUID="8dbfe80e-acb5-4694-8288-caff4be668d1" containerName="online" probeResult="failure" output="Get \"https://10.132.0.40:6567/health\": dial tcp 10.132.0.40:6567: connect: connection refused"
Jun 08 12:18:06.375418 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:18:06.375386    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d"
Jun 08 12:18:06.375916 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:18:06.375897    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d"
Jun 08 12:18:06.376102 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:18:06.376086    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d"
Jun 08 12:18:06.376144 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:18:06.376120    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d"
Jun 08 12:18:06.376257 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:18:06.376238    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d"
Jun 08 12:18:06.380107 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:18:06.380086    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d"
Jun 08 12:18:06.399275 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:18:06.399244    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d"
Jun 08 12:18:06.399417 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:18:06.399316    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d"
Jun 08 12:18:06.399417 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:18:06.399334    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d"
Jun 08 12:18:06.399676 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:18:06.399655    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d"
Jun 08 12:18:06.399844 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:18:06.399828    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d"
Jun 08 12:18:06.401968 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:18:06.401953    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d"
Jun 08 12:19:07.955375 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:07.955338    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d"]
Jun 08 12:19:07.955973 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:07.955635    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d" podUID="8dbfe80e-acb5-4694-8288-caff4be668d1" containerName="registry" containerID="cri-o://1d540fb8c6a4e28c58ade0f2cc19bef0dc6a73385fbf63ed151211dd8612bb87" gracePeriod=30
Jun 08 12:19:07.955973 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:07.955714    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d" podUID="8dbfe80e-acb5-4694-8288-caff4be668d1" containerName="ui" containerID="cri-o://94737ad2eca704c260857a15c790bb05c62d2c8f8672f625ce0ddea2a280332e" gracePeriod=30
Jun 08 12:19:07.955973 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:07.955769    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d" podUID="8dbfe80e-acb5-4694-8288-caff4be668d1" containerName="online" containerID="cri-o://fca4a311a192ee3a22cadf5e283e4ef6ad882d7eeed33b3894d5017dacb0882c" gracePeriod=30
Jun 08 12:19:07.955973 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:07.955841    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d" podUID="8dbfe80e-acb5-4694-8288-caff4be668d1" containerName="offline" containerID="cri-o://9049fb684cf76354de4cf5300da4ef07e8f16f5f63a3ad7e1ba8af7db8f60356" gracePeriod=30
Jun 08 12:19:08.311592 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:08.311496    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z"]
Jun 08 12:19:08.317631 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:08.317597    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z"
Jun 08 12:19:08.320966 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:08.320934    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-kkdnq\""
Jun 08 12:19:08.337226 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:08.337188    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z"]
Jun 08 12:19:08.414635 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:08.414587    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2e15ac4d-1865-406b-8e34-95e83a91cc61-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-vcx4z\" (UID: \"2e15ac4d-1865-406b-8e34-95e83a91cc61\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z"
Jun 08 12:19:08.414847 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:08.414647    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2e15ac4d-1865-406b-8e34-95e83a91cc61-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-vcx4z\" (UID: \"2e15ac4d-1865-406b-8e34-95e83a91cc61\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z"
Jun 08 12:19:08.414847 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:08.414728    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2e15ac4d-1865-406b-8e34-95e83a91cc61-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-vcx4z\" (UID: \"2e15ac4d-1865-406b-8e34-95e83a91cc61\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z"
Jun 08 12:19:08.414847 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:08.414831    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2e15ac4d-1865-406b-8e34-95e83a91cc61-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-vcx4z\" (UID: \"2e15ac4d-1865-406b-8e34-95e83a91cc61\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z"
Jun 08 12:19:08.415031 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:08.414870    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r266j\" (UniqueName: \"kubernetes.io/projected/2e15ac4d-1865-406b-8e34-95e83a91cc61-kube-api-access-r266j\") pod \"feast-simple-feast-setup-75c64c888b-vcx4z\" (UID: \"2e15ac4d-1865-406b-8e34-95e83a91cc61\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z"
Jun 08 12:19:08.415031 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:08.414955    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2e15ac4d-1865-406b-8e34-95e83a91cc61-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-vcx4z\" (UID: \"2e15ac4d-1865-406b-8e34-95e83a91cc61\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z"
Jun 08 12:19:08.516306 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:08.516259    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2e15ac4d-1865-406b-8e34-95e83a91cc61-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-vcx4z\" (UID: \"2e15ac4d-1865-406b-8e34-95e83a91cc61\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z"
Jun 08 12:19:08.516306 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:08.516310    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2e15ac4d-1865-406b-8e34-95e83a91cc61-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-vcx4z\" (UID: \"2e15ac4d-1865-406b-8e34-95e83a91cc61\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z"
Jun 08 12:19:08.516556 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:08.516343    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2e15ac4d-1865-406b-8e34-95e83a91cc61-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-vcx4z\" (UID: \"2e15ac4d-1865-406b-8e34-95e83a91cc61\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z"
Jun 08 12:19:08.516556 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:08.516389    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2e15ac4d-1865-406b-8e34-95e83a91cc61-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-vcx4z\" (UID: \"2e15ac4d-1865-406b-8e34-95e83a91cc61\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z"
Jun 08 12:19:08.516556 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:08.516432    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2e15ac4d-1865-406b-8e34-95e83a91cc61-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-vcx4z\" (UID: \"2e15ac4d-1865-406b-8e34-95e83a91cc61\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z"
Jun 08 12:19:08.516556 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:08.516455    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r266j\" (UniqueName: \"kubernetes.io/projected/2e15ac4d-1865-406b-8e34-95e83a91cc61-kube-api-access-r266j\") pod \"feast-simple-feast-setup-75c64c888b-vcx4z\" (UID: \"2e15ac4d-1865-406b-8e34-95e83a91cc61\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z"
Jun 08 12:19:08.516743 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:19:08.516560    2583 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
Jun 08 12:19:08.516743 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:19:08.516634    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e15ac4d-1865-406b-8e34-95e83a91cc61-ui-tls podName:2e15ac4d-1865-406b-8e34-95e83a91cc61 nodeName:}" failed. No retries permitted until 2026-06-08 12:19:09.016613428 +0000 UTC m=+1870.288188615 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/2e15ac4d-1865-406b-8e34-95e83a91cc61-ui-tls") pod "feast-simple-feast-setup-75c64c888b-vcx4z" (UID: "2e15ac4d-1865-406b-8e34-95e83a91cc61") : secret "feast-simple-feast-setup-ui-tls" not found
Jun 08 12:19:08.516903 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:19:08.516883    2583 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
Jun 08 12:19:08.516961 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:19:08.516945    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e15ac4d-1865-406b-8e34-95e83a91cc61-registry-tls podName:2e15ac4d-1865-406b-8e34-95e83a91cc61 nodeName:}" failed. No retries permitted until 2026-06-08 12:19:09.01692597 +0000 UTC m=+1870.288501134 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/2e15ac4d-1865-406b-8e34-95e83a91cc61-registry-tls") pod "feast-simple-feast-setup-75c64c888b-vcx4z" (UID: "2e15ac4d-1865-406b-8e34-95e83a91cc61") : secret "feast-simple-feast-setup-registry-tls" not found
Jun 08 12:19:08.517078 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:08.517037    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2e15ac4d-1865-406b-8e34-95e83a91cc61-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-vcx4z\" (UID: \"2e15ac4d-1865-406b-8e34-95e83a91cc61\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z"
Jun 08 12:19:08.519375 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:08.519344    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2e15ac4d-1865-406b-8e34-95e83a91cc61-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-vcx4z\" (UID: \"2e15ac4d-1865-406b-8e34-95e83a91cc61\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z"
Jun 08 12:19:08.519508 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:08.519395    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2e15ac4d-1865-406b-8e34-95e83a91cc61-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-vcx4z\" (UID: \"2e15ac4d-1865-406b-8e34-95e83a91cc61\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z"
Jun 08 12:19:08.529398 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:08.529372    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r266j\" (UniqueName: \"kubernetes.io/projected/2e15ac4d-1865-406b-8e34-95e83a91cc61-kube-api-access-r266j\") pod \"feast-simple-feast-setup-75c64c888b-vcx4z\" (UID: \"2e15ac4d-1865-406b-8e34-95e83a91cc61\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z"
Jun 08 12:19:08.652871 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:08.652841    2583 generic.go:356] "Generic (PLEG): container finished" podID="8dbfe80e-acb5-4694-8288-caff4be668d1" containerID="94737ad2eca704c260857a15c790bb05c62d2c8f8672f625ce0ddea2a280332e" exitCode=0
Jun 08 12:19:08.652996 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:08.652917    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d" event={"ID":"8dbfe80e-acb5-4694-8288-caff4be668d1","Type":"ContainerDied","Data":"94737ad2eca704c260857a15c790bb05c62d2c8f8672f625ce0ddea2a280332e"}
Jun 08 12:19:09.021818 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:09.021713    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2e15ac4d-1865-406b-8e34-95e83a91cc61-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-vcx4z\" (UID: \"2e15ac4d-1865-406b-8e34-95e83a91cc61\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z"
Jun 08 12:19:09.021818 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:09.021779    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2e15ac4d-1865-406b-8e34-95e83a91cc61-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-vcx4z\" (UID: \"2e15ac4d-1865-406b-8e34-95e83a91cc61\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z"
Jun 08 12:19:09.024206 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:09.024185    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2e15ac4d-1865-406b-8e34-95e83a91cc61-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-vcx4z\" (UID: \"2e15ac4d-1865-406b-8e34-95e83a91cc61\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z"
Jun 08 12:19:09.024270 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:09.024203    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2e15ac4d-1865-406b-8e34-95e83a91cc61-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-vcx4z\" (UID: \"2e15ac4d-1865-406b-8e34-95e83a91cc61\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z"
Jun 08 12:19:09.229543 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:09.229505    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z"
Jun 08 12:19:09.371007 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:09.370974    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z"]
Jun 08 12:19:09.372442 ip-10-0-136-189 kubenswrapper[2583]: W0608 12:19:09.372412    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2e15ac4d_1865_406b_8e34_95e83a91cc61.slice/crio-4b28d824887aaf7f03803fb8b5a80069a2e875ca0d15bdd2cdc70ee489272665 WatchSource:0}: Error finding container 4b28d824887aaf7f03803fb8b5a80069a2e875ca0d15bdd2cdc70ee489272665: Status 404 returned error can't find the container with id 4b28d824887aaf7f03803fb8b5a80069a2e875ca0d15bdd2cdc70ee489272665
Jun 08 12:19:09.663293 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:09.663252    2583 generic.go:356] "Generic (PLEG): container finished" podID="8dbfe80e-acb5-4694-8288-caff4be668d1" containerID="fca4a311a192ee3a22cadf5e283e4ef6ad882d7eeed33b3894d5017dacb0882c" exitCode=0
Jun 08 12:19:09.663493 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:09.663404    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d" event={"ID":"8dbfe80e-acb5-4694-8288-caff4be668d1","Type":"ContainerDied","Data":"fca4a311a192ee3a22cadf5e283e4ef6ad882d7eeed33b3894d5017dacb0882c"}
Jun 08 12:19:09.666061 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:09.666028    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z" event={"ID":"2e15ac4d-1865-406b-8e34-95e83a91cc61","Type":"ContainerStarted","Data":"76b438907e9c14669f8954212cdc88d2b02cc24da59fd5d262494877254d29fc"}
Jun 08 12:19:09.666133 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:09.666093    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z" event={"ID":"2e15ac4d-1865-406b-8e34-95e83a91cc61","Type":"ContainerStarted","Data":"4b28d824887aaf7f03803fb8b5a80069a2e875ca0d15bdd2cdc70ee489272665"}
Jun 08 12:19:14.687404 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:14.687369    2583 generic.go:356] "Generic (PLEG): container finished" podID="2e15ac4d-1865-406b-8e34-95e83a91cc61" containerID="76b438907e9c14669f8954212cdc88d2b02cc24da59fd5d262494877254d29fc" exitCode=0
Jun 08 12:19:14.687777 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:14.687441    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z" event={"ID":"2e15ac4d-1865-406b-8e34-95e83a91cc61","Type":"ContainerDied","Data":"76b438907e9c14669f8954212cdc88d2b02cc24da59fd5d262494877254d29fc"}
Jun 08 12:19:15.693519 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:15.693485    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z" event={"ID":"2e15ac4d-1865-406b-8e34-95e83a91cc61","Type":"ContainerStarted","Data":"28eda9a71d0f43b060efce1187cf78e68a656d99824d358b037fa202c7196fe9"}
Jun 08 12:19:16.399759 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:16.399692    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d" podUID="8dbfe80e-acb5-4694-8288-caff4be668d1" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.40:8443: connect: connection refused"
Jun 08 12:19:16.399759 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:16.399740    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d" podUID="8dbfe80e-acb5-4694-8288-caff4be668d1" containerName="online" probeResult="failure" output="Get \"https://10.132.0.40:6567/health\": dial tcp 10.132.0.40:6567: connect: connection refused"
Jun 08 12:19:20.715310 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:20.715275    2583 generic.go:356] "Generic (PLEG): container finished" podID="2e15ac4d-1865-406b-8e34-95e83a91cc61" containerID="28eda9a71d0f43b060efce1187cf78e68a656d99824d358b037fa202c7196fe9" exitCode=0
Jun 08 12:19:20.715687 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:20.715324    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z" event={"ID":"2e15ac4d-1865-406b-8e34-95e83a91cc61","Type":"ContainerDied","Data":"28eda9a71d0f43b060efce1187cf78e68a656d99824d358b037fa202c7196fe9"}
Jun 08 12:19:21.725764 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:21.725716    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z" event={"ID":"2e15ac4d-1865-406b-8e34-95e83a91cc61","Type":"ContainerStarted","Data":"b96a17a950135d8d7a9464749c560004bce0a2fd27ff9d3dec03b25238e40830"}
Jun 08 12:19:21.726309 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:21.725781    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z" event={"ID":"2e15ac4d-1865-406b-8e34-95e83a91cc61","Type":"ContainerStarted","Data":"d542349bb214b210cc55d2a3c19351c41229efb6b324a0b701d857e7bec38c03"}
Jun 08 12:19:21.726309 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:21.725802    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z" event={"ID":"2e15ac4d-1865-406b-8e34-95e83a91cc61","Type":"ContainerStarted","Data":"d8d3f72dbce3dc6cb59eedfc6a50fd7723e8d8762bb5565d6d7d344c6590fea7"}
Jun 08 12:19:21.726309 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:21.725824    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z" event={"ID":"2e15ac4d-1865-406b-8e34-95e83a91cc61","Type":"ContainerStarted","Data":"304e6094861b045a0770e94806704207d1565c2350a71de8dae42b49484f3905"}
Jun 08 12:19:21.754760 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:21.754688    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z" podStartSLOduration=13.754667413 podStartE2EDuration="13.754667413s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:19:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:19:21.753476153 +0000 UTC m=+1883.025051341" watchObservedRunningTime="2026-06-08 12:19:21.754667413 +0000 UTC m=+1883.026242591"
Jun 08 12:19:24.231157 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:24.231105    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z"
Jun 08 12:19:24.231646 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:24.231192    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z"
Jun 08 12:19:24.231646 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:24.231214    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z"
Jun 08 12:19:24.231646 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:24.231234    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z"
Jun 08 12:19:24.232697 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:24.232663    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z" podUID="2e15ac4d-1865-406b-8e34-95e83a91cc61" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.41:6571: connect: connection refused"
Jun 08 12:19:24.232940 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:24.232696    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z" podUID="2e15ac4d-1865-406b-8e34-95e83a91cc61" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.41:8443: connect: connection refused"
Jun 08 12:19:24.233150 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:24.232713    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z" podUID="2e15ac4d-1865-406b-8e34-95e83a91cc61" containerName="online" probeResult="failure" output="Get \"https://10.132.0.41:6567/health\": dial tcp 10.132.0.41:6567: connect: connection refused"
Jun 08 12:19:24.233150 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:24.232723    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z" podUID="2e15ac4d-1865-406b-8e34-95e83a91cc61" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.41:8816: connect: connection refused"
Jun 08 12:19:26.399627 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:26.399582    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d" podUID="8dbfe80e-acb5-4694-8288-caff4be668d1" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.40:8443: connect: connection refused"
Jun 08 12:19:26.399627 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:26.399618    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d" podUID="8dbfe80e-acb5-4694-8288-caff4be668d1" containerName="online" probeResult="failure" output="Get \"https://10.132.0.40:6567/health\": dial tcp 10.132.0.40:6567: connect: connection refused"
Jun 08 12:19:27.231459 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:27.231423    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z"
Jun 08 12:19:27.231668 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:27.231608    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z"
Jun 08 12:19:27.231811 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:27.231787    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z"
Jun 08 12:19:27.232165 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:27.232129    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z"
Jun 08 12:19:27.232277 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:27.232177    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z"
Jun 08 12:19:27.232277 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:27.232197    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z"
Jun 08 12:19:27.232277 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:27.232256    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z"
Jun 08 12:19:27.232403 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:27.232308    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z"
Jun 08 12:19:27.232403 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:27.232357    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z"
Jun 08 12:19:27.236071 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:27.236030    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z"
Jun 08 12:19:27.758534 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:27.758503    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z"
Jun 08 12:19:27.761581 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:27.761556    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z"
Jun 08 12:19:36.400163 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:36.400115    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d" podUID="8dbfe80e-acb5-4694-8288-caff4be668d1" containerName="online" probeResult="failure" output="Get \"https://10.132.0.40:6567/health\": dial tcp 10.132.0.40:6567: connect: connection refused"
Jun 08 12:19:36.402539 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:36.400118    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d" podUID="8dbfe80e-acb5-4694-8288-caff4be668d1" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.40:8443: connect: connection refused"
Jun 08 12:19:36.402539 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:36.400267    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d"
Jun 08 12:19:36.402539 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:36.400347    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d"
Jun 08 12:19:38.609090 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:38.609065    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d"
Jun 08 12:19:38.684264 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:38.684231    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8dbfe80e-acb5-4694-8288-caff4be668d1-offline-tls\") pod \"8dbfe80e-acb5-4694-8288-caff4be668d1\" (UID: \"8dbfe80e-acb5-4694-8288-caff4be668d1\") "
Jun 08 12:19:38.684549 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:38.684295    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8dbfe80e-acb5-4694-8288-caff4be668d1-registry-tls\") pod \"8dbfe80e-acb5-4694-8288-caff4be668d1\" (UID: \"8dbfe80e-acb5-4694-8288-caff4be668d1\") "
Jun 08 12:19:38.684549 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:38.684336    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8dbfe80e-acb5-4694-8288-caff4be668d1-ui-tls\") pod \"8dbfe80e-acb5-4694-8288-caff4be668d1\" (UID: \"8dbfe80e-acb5-4694-8288-caff4be668d1\") "
Jun 08 12:19:38.684549 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:38.684371    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8dbfe80e-acb5-4694-8288-caff4be668d1-feast-data\") pod \"8dbfe80e-acb5-4694-8288-caff4be668d1\" (UID: \"8dbfe80e-acb5-4694-8288-caff4be668d1\") "
Jun 08 12:19:38.684549 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:38.684397    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mvfcj\" (UniqueName: \"kubernetes.io/projected/8dbfe80e-acb5-4694-8288-caff4be668d1-kube-api-access-mvfcj\") pod \"8dbfe80e-acb5-4694-8288-caff4be668d1\" (UID: \"8dbfe80e-acb5-4694-8288-caff4be668d1\") "
Jun 08 12:19:38.684549 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:38.684420    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8dbfe80e-acb5-4694-8288-caff4be668d1-online-tls\") pod \"8dbfe80e-acb5-4694-8288-caff4be668d1\" (UID: \"8dbfe80e-acb5-4694-8288-caff4be668d1\") "
Jun 08 12:19:38.684932 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:38.684901    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8dbfe80e-acb5-4694-8288-caff4be668d1-feast-data" (OuterVolumeSpecName: "feast-data") pod "8dbfe80e-acb5-4694-8288-caff4be668d1" (UID: "8dbfe80e-acb5-4694-8288-caff4be668d1"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 08 12:19:38.686761 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:38.686727    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8dbfe80e-acb5-4694-8288-caff4be668d1-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "8dbfe80e-acb5-4694-8288-caff4be668d1" (UID: "8dbfe80e-acb5-4694-8288-caff4be668d1"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 08 12:19:38.686880 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:38.686780    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8dbfe80e-acb5-4694-8288-caff4be668d1-online-tls" (OuterVolumeSpecName: "online-tls") pod "8dbfe80e-acb5-4694-8288-caff4be668d1" (UID: "8dbfe80e-acb5-4694-8288-caff4be668d1"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 08 12:19:38.686880 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:38.686790    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8dbfe80e-acb5-4694-8288-caff4be668d1-kube-api-access-mvfcj" (OuterVolumeSpecName: "kube-api-access-mvfcj") pod "8dbfe80e-acb5-4694-8288-caff4be668d1" (UID: "8dbfe80e-acb5-4694-8288-caff4be668d1"). InnerVolumeSpecName "kube-api-access-mvfcj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 08 12:19:38.686880 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:38.686821    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8dbfe80e-acb5-4694-8288-caff4be668d1-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "8dbfe80e-acb5-4694-8288-caff4be668d1" (UID: "8dbfe80e-acb5-4694-8288-caff4be668d1"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 08 12:19:38.686880 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:38.686848    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8dbfe80e-acb5-4694-8288-caff4be668d1-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "8dbfe80e-acb5-4694-8288-caff4be668d1" (UID: "8dbfe80e-acb5-4694-8288-caff4be668d1"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 08 12:19:38.785760 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:38.785669    2583 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8dbfe80e-acb5-4694-8288-caff4be668d1-online-tls\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:19:38.785760 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:38.785701    2583 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8dbfe80e-acb5-4694-8288-caff4be668d1-offline-tls\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:19:38.785760 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:38.785710    2583 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8dbfe80e-acb5-4694-8288-caff4be668d1-registry-tls\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:19:38.785760 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:38.785718    2583 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8dbfe80e-acb5-4694-8288-caff4be668d1-ui-tls\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:19:38.785760 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:38.785725    2583 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8dbfe80e-acb5-4694-8288-caff4be668d1-feast-data\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:19:38.785760 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:38.785734    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mvfcj\" (UniqueName: \"kubernetes.io/projected/8dbfe80e-acb5-4694-8288-caff4be668d1-kube-api-access-mvfcj\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:19:38.805711 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:38.805678    2583 generic.go:356] "Generic (PLEG): container finished" podID="8dbfe80e-acb5-4694-8288-caff4be668d1" containerID="9049fb684cf76354de4cf5300da4ef07e8f16f5f63a3ad7e1ba8af7db8f60356" exitCode=137
Jun 08 12:19:38.805711 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:38.805705    2583 generic.go:356] "Generic (PLEG): container finished" podID="8dbfe80e-acb5-4694-8288-caff4be668d1" containerID="1d540fb8c6a4e28c58ade0f2cc19bef0dc6a73385fbf63ed151211dd8612bb87" exitCode=137
Jun 08 12:19:38.805945 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:38.805748    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d"
Jun 08 12:19:38.805945 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:38.805746    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d" event={"ID":"8dbfe80e-acb5-4694-8288-caff4be668d1","Type":"ContainerDied","Data":"9049fb684cf76354de4cf5300da4ef07e8f16f5f63a3ad7e1ba8af7db8f60356"}
Jun 08 12:19:38.805945 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:38.805864    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d" event={"ID":"8dbfe80e-acb5-4694-8288-caff4be668d1","Type":"ContainerDied","Data":"1d540fb8c6a4e28c58ade0f2cc19bef0dc6a73385fbf63ed151211dd8612bb87"}
Jun 08 12:19:38.805945 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:38.805880    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d" event={"ID":"8dbfe80e-acb5-4694-8288-caff4be668d1","Type":"ContainerDied","Data":"2325cdde92b8463e331be2a34e0e3da3ab638484711bc62d212c55f8f6dd6844"}
Jun 08 12:19:38.805945 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:38.805898    2583 scope.go:117] "RemoveContainer" containerID="94737ad2eca704c260857a15c790bb05c62d2c8f8672f625ce0ddea2a280332e"
Jun 08 12:19:38.815998 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:38.815978    2583 scope.go:117] "RemoveContainer" containerID="9049fb684cf76354de4cf5300da4ef07e8f16f5f63a3ad7e1ba8af7db8f60356"
Jun 08 12:19:38.823653 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:38.823628    2583 scope.go:117] "RemoveContainer" containerID="fca4a311a192ee3a22cadf5e283e4ef6ad882d7eeed33b3894d5017dacb0882c"
Jun 08 12:19:38.832642 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:38.830462    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d"]
Jun 08 12:19:38.833546 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:38.833468    2583 scope.go:117] "RemoveContainer" containerID="1d540fb8c6a4e28c58ade0f2cc19bef0dc6a73385fbf63ed151211dd8612bb87"
Jun 08 12:19:38.836820 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:38.836795    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-7hz8d"]
Jun 08 12:19:38.842043 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:38.842022    2583 scope.go:117] "RemoveContainer" containerID="c2c6ffd1617e827410a1df030f8f08469efe94d8dcd78a430d64f91f95dcfb55"
Jun 08 12:19:38.849155 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:38.849134    2583 scope.go:117] "RemoveContainer" containerID="02f30d63ae350d37f3497e2ea9dde48d8aa62817d2b7b960b2646e5bd80abd8c"
Jun 08 12:19:38.856251 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:38.856227    2583 scope.go:117] "RemoveContainer" containerID="94737ad2eca704c260857a15c790bb05c62d2c8f8672f625ce0ddea2a280332e"
Jun 08 12:19:38.856520 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:19:38.856495    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94737ad2eca704c260857a15c790bb05c62d2c8f8672f625ce0ddea2a280332e\": container with ID starting with 94737ad2eca704c260857a15c790bb05c62d2c8f8672f625ce0ddea2a280332e not found: ID does not exist" containerID="94737ad2eca704c260857a15c790bb05c62d2c8f8672f625ce0ddea2a280332e"
Jun 08 12:19:38.856605 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:38.856525    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94737ad2eca704c260857a15c790bb05c62d2c8f8672f625ce0ddea2a280332e"} err="failed to get container status \"94737ad2eca704c260857a15c790bb05c62d2c8f8672f625ce0ddea2a280332e\": rpc error: code = NotFound desc = could not find container \"94737ad2eca704c260857a15c790bb05c62d2c8f8672f625ce0ddea2a280332e\": container with ID starting with 94737ad2eca704c260857a15c790bb05c62d2c8f8672f625ce0ddea2a280332e not found: ID does not exist"
Jun 08 12:19:38.856605 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:38.856545    2583 scope.go:117] "RemoveContainer" containerID="9049fb684cf76354de4cf5300da4ef07e8f16f5f63a3ad7e1ba8af7db8f60356"
Jun 08 12:19:38.856785 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:19:38.856769    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9049fb684cf76354de4cf5300da4ef07e8f16f5f63a3ad7e1ba8af7db8f60356\": container with ID starting with 9049fb684cf76354de4cf5300da4ef07e8f16f5f63a3ad7e1ba8af7db8f60356 not found: ID does not exist" containerID="9049fb684cf76354de4cf5300da4ef07e8f16f5f63a3ad7e1ba8af7db8f60356"
Jun 08 12:19:38.856828 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:38.856788    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9049fb684cf76354de4cf5300da4ef07e8f16f5f63a3ad7e1ba8af7db8f60356"} err="failed to get container status \"9049fb684cf76354de4cf5300da4ef07e8f16f5f63a3ad7e1ba8af7db8f60356\": rpc error: code = NotFound desc = could not find container \"9049fb684cf76354de4cf5300da4ef07e8f16f5f63a3ad7e1ba8af7db8f60356\": container with ID starting with 9049fb684cf76354de4cf5300da4ef07e8f16f5f63a3ad7e1ba8af7db8f60356 not found: ID does not exist"
Jun 08 12:19:38.856828 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:38.856800    2583 scope.go:117] "RemoveContainer" containerID="fca4a311a192ee3a22cadf5e283e4ef6ad882d7eeed33b3894d5017dacb0882c"
Jun 08 12:19:38.856991 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:19:38.856975    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fca4a311a192ee3a22cadf5e283e4ef6ad882d7eeed33b3894d5017dacb0882c\": container with ID starting with fca4a311a192ee3a22cadf5e283e4ef6ad882d7eeed33b3894d5017dacb0882c not found: ID does not exist" containerID="fca4a311a192ee3a22cadf5e283e4ef6ad882d7eeed33b3894d5017dacb0882c"
Jun 08 12:19:38.857031 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:38.856994    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fca4a311a192ee3a22cadf5e283e4ef6ad882d7eeed33b3894d5017dacb0882c"} err="failed to get container status \"fca4a311a192ee3a22cadf5e283e4ef6ad882d7eeed33b3894d5017dacb0882c\": rpc error: code = NotFound desc = could not find container \"fca4a311a192ee3a22cadf5e283e4ef6ad882d7eeed33b3894d5017dacb0882c\": container with ID starting with fca4a311a192ee3a22cadf5e283e4ef6ad882d7eeed33b3894d5017dacb0882c not found: ID does not exist"
Jun 08 12:19:38.857031 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:38.857006    2583 scope.go:117] "RemoveContainer" containerID="1d540fb8c6a4e28c58ade0f2cc19bef0dc6a73385fbf63ed151211dd8612bb87"
Jun 08 12:19:38.857254 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:19:38.857239    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d540fb8c6a4e28c58ade0f2cc19bef0dc6a73385fbf63ed151211dd8612bb87\": container with ID starting with 1d540fb8c6a4e28c58ade0f2cc19bef0dc6a73385fbf63ed151211dd8612bb87 not found: ID does not exist" containerID="1d540fb8c6a4e28c58ade0f2cc19bef0dc6a73385fbf63ed151211dd8612bb87"
Jun 08 12:19:38.857303 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:38.857258    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d540fb8c6a4e28c58ade0f2cc19bef0dc6a73385fbf63ed151211dd8612bb87"} err="failed to get container status \"1d540fb8c6a4e28c58ade0f2cc19bef0dc6a73385fbf63ed151211dd8612bb87\": rpc error: code = NotFound desc = could not find container \"1d540fb8c6a4e28c58ade0f2cc19bef0dc6a73385fbf63ed151211dd8612bb87\": container with ID starting with 1d540fb8c6a4e28c58ade0f2cc19bef0dc6a73385fbf63ed151211dd8612bb87 not found: ID does not exist"
Jun 08 12:19:38.857303 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:38.857270    2583 scope.go:117] "RemoveContainer" containerID="c2c6ffd1617e827410a1df030f8f08469efe94d8dcd78a430d64f91f95dcfb55"
Jun 08 12:19:38.857477 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:19:38.857462    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2c6ffd1617e827410a1df030f8f08469efe94d8dcd78a430d64f91f95dcfb55\": container with ID starting with c2c6ffd1617e827410a1df030f8f08469efe94d8dcd78a430d64f91f95dcfb55 not found: ID does not exist" containerID="c2c6ffd1617e827410a1df030f8f08469efe94d8dcd78a430d64f91f95dcfb55"
Jun 08 12:19:38.857521 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:38.857480    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2c6ffd1617e827410a1df030f8f08469efe94d8dcd78a430d64f91f95dcfb55"} err="failed to get container status \"c2c6ffd1617e827410a1df030f8f08469efe94d8dcd78a430d64f91f95dcfb55\": rpc error: code = NotFound desc = could not find container \"c2c6ffd1617e827410a1df030f8f08469efe94d8dcd78a430d64f91f95dcfb55\": container with ID starting with c2c6ffd1617e827410a1df030f8f08469efe94d8dcd78a430d64f91f95dcfb55 not found: ID does not exist"
Jun 08 12:19:38.857521 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:38.857492    2583 scope.go:117] "RemoveContainer" containerID="02f30d63ae350d37f3497e2ea9dde48d8aa62817d2b7b960b2646e5bd80abd8c"
Jun 08 12:19:38.857703 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:19:38.857685    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02f30d63ae350d37f3497e2ea9dde48d8aa62817d2b7b960b2646e5bd80abd8c\": container with ID starting with 02f30d63ae350d37f3497e2ea9dde48d8aa62817d2b7b960b2646e5bd80abd8c not found: ID does not exist" containerID="02f30d63ae350d37f3497e2ea9dde48d8aa62817d2b7b960b2646e5bd80abd8c"
Jun 08 12:19:38.857747 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:38.857705    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02f30d63ae350d37f3497e2ea9dde48d8aa62817d2b7b960b2646e5bd80abd8c"} err="failed to get container status \"02f30d63ae350d37f3497e2ea9dde48d8aa62817d2b7b960b2646e5bd80abd8c\": rpc error: code = NotFound desc = could not find container \"02f30d63ae350d37f3497e2ea9dde48d8aa62817d2b7b960b2646e5bd80abd8c\": container with ID starting with 02f30d63ae350d37f3497e2ea9dde48d8aa62817d2b7b960b2646e5bd80abd8c not found: ID does not exist"
Jun 08 12:19:38.857747 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:38.857717    2583 scope.go:117] "RemoveContainer" containerID="94737ad2eca704c260857a15c790bb05c62d2c8f8672f625ce0ddea2a280332e"
Jun 08 12:19:38.857927 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:38.857905    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94737ad2eca704c260857a15c790bb05c62d2c8f8672f625ce0ddea2a280332e"} err="failed to get container status \"94737ad2eca704c260857a15c790bb05c62d2c8f8672f625ce0ddea2a280332e\": rpc error: code = NotFound desc = could not find container \"94737ad2eca704c260857a15c790bb05c62d2c8f8672f625ce0ddea2a280332e\": container with ID starting with 94737ad2eca704c260857a15c790bb05c62d2c8f8672f625ce0ddea2a280332e not found: ID does not exist"
Jun 08 12:19:38.858000 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:38.857930    2583 scope.go:117] "RemoveContainer" containerID="9049fb684cf76354de4cf5300da4ef07e8f16f5f63a3ad7e1ba8af7db8f60356"
Jun 08 12:19:38.858151 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:38.858135    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9049fb684cf76354de4cf5300da4ef07e8f16f5f63a3ad7e1ba8af7db8f60356"} err="failed to get container status \"9049fb684cf76354de4cf5300da4ef07e8f16f5f63a3ad7e1ba8af7db8f60356\": rpc error: code = NotFound desc = could not find container \"9049fb684cf76354de4cf5300da4ef07e8f16f5f63a3ad7e1ba8af7db8f60356\": container with ID starting with 9049fb684cf76354de4cf5300da4ef07e8f16f5f63a3ad7e1ba8af7db8f60356 not found: ID does not exist"
Jun 08 12:19:38.858210 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:38.858151    2583 scope.go:117] "RemoveContainer" containerID="fca4a311a192ee3a22cadf5e283e4ef6ad882d7eeed33b3894d5017dacb0882c"
Jun 08 12:19:38.858333 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:38.858318    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fca4a311a192ee3a22cadf5e283e4ef6ad882d7eeed33b3894d5017dacb0882c"} err="failed to get container status \"fca4a311a192ee3a22cadf5e283e4ef6ad882d7eeed33b3894d5017dacb0882c\": rpc error: code = NotFound desc = could not find container \"fca4a311a192ee3a22cadf5e283e4ef6ad882d7eeed33b3894d5017dacb0882c\": container with ID starting with fca4a311a192ee3a22cadf5e283e4ef6ad882d7eeed33b3894d5017dacb0882c not found: ID does not exist"
Jun 08 12:19:38.858375 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:38.858333    2583 scope.go:117] "RemoveContainer" containerID="1d540fb8c6a4e28c58ade0f2cc19bef0dc6a73385fbf63ed151211dd8612bb87"
Jun 08 12:19:38.858495 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:38.858480    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d540fb8c6a4e28c58ade0f2cc19bef0dc6a73385fbf63ed151211dd8612bb87"} err="failed to get container status \"1d540fb8c6a4e28c58ade0f2cc19bef0dc6a73385fbf63ed151211dd8612bb87\": rpc error: code = NotFound desc = could not find container \"1d540fb8c6a4e28c58ade0f2cc19bef0dc6a73385fbf63ed151211dd8612bb87\": container with ID starting with 1d540fb8c6a4e28c58ade0f2cc19bef0dc6a73385fbf63ed151211dd8612bb87 not found: ID does not exist"
Jun 08 12:19:38.858542 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:38.858495    2583 scope.go:117] "RemoveContainer" containerID="c2c6ffd1617e827410a1df030f8f08469efe94d8dcd78a430d64f91f95dcfb55"
Jun 08 12:19:38.858673 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:38.858658    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2c6ffd1617e827410a1df030f8f08469efe94d8dcd78a430d64f91f95dcfb55"} err="failed to get container status \"c2c6ffd1617e827410a1df030f8f08469efe94d8dcd78a430d64f91f95dcfb55\": rpc error: code = NotFound desc = could not find container \"c2c6ffd1617e827410a1df030f8f08469efe94d8dcd78a430d64f91f95dcfb55\": container with ID starting with c2c6ffd1617e827410a1df030f8f08469efe94d8dcd78a430d64f91f95dcfb55 not found: ID does not exist"
Jun 08 12:19:38.858730 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:38.858673    2583 scope.go:117] "RemoveContainer" containerID="02f30d63ae350d37f3497e2ea9dde48d8aa62817d2b7b960b2646e5bd80abd8c"
Jun 08 12:19:38.858862 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:38.858846    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02f30d63ae350d37f3497e2ea9dde48d8aa62817d2b7b960b2646e5bd80abd8c"} err="failed to get container status \"02f30d63ae350d37f3497e2ea9dde48d8aa62817d2b7b960b2646e5bd80abd8c\": rpc error: code = NotFound desc = could not find container \"02f30d63ae350d37f3497e2ea9dde48d8aa62817d2b7b960b2646e5bd80abd8c\": container with ID starting with 02f30d63ae350d37f3497e2ea9dde48d8aa62817d2b7b960b2646e5bd80abd8c not found: ID does not exist"
Jun 08 12:19:39.185992 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:19:39.185959    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8dbfe80e-acb5-4694-8288-caff4be668d1" path="/var/lib/kubelet/pods/8dbfe80e-acb5-4694-8288-caff4be668d1/volumes"
Jun 08 12:20:29.873569 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:29.873532    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-glqhc"]
Jun 08 12:20:29.874212 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:29.873987    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8dbfe80e-acb5-4694-8288-caff4be668d1" containerName="ui"
Jun 08 12:20:29.874212 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:29.874005    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8dbfe80e-acb5-4694-8288-caff4be668d1" containerName="ui"
Jun 08 12:20:29.874212 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:29.874023    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8dbfe80e-acb5-4694-8288-caff4be668d1" containerName="offline"
Jun 08 12:20:29.874212 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:29.874032    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8dbfe80e-acb5-4694-8288-caff4be668d1" containerName="offline"
Jun 08 12:20:29.874212 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:29.874067    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8dbfe80e-acb5-4694-8288-caff4be668d1" containerName="feast-init"
Jun 08 12:20:29.874212 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:29.874076    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8dbfe80e-acb5-4694-8288-caff4be668d1" containerName="feast-init"
Jun 08 12:20:29.874212 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:29.874086    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8dbfe80e-acb5-4694-8288-caff4be668d1" containerName="feast-apply"
Jun 08 12:20:29.874212 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:29.874094    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8dbfe80e-acb5-4694-8288-caff4be668d1" containerName="feast-apply"
Jun 08 12:20:29.874212 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:29.874104    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8dbfe80e-acb5-4694-8288-caff4be668d1" containerName="registry"
Jun 08 12:20:29.874212 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:29.874112    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8dbfe80e-acb5-4694-8288-caff4be668d1" containerName="registry"
Jun 08 12:20:29.874212 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:29.874126    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8dbfe80e-acb5-4694-8288-caff4be668d1" containerName="online"
Jun 08 12:20:29.874212 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:29.874134    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8dbfe80e-acb5-4694-8288-caff4be668d1" containerName="online"
Jun 08 12:20:29.874877 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:29.874222    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="8dbfe80e-acb5-4694-8288-caff4be668d1" containerName="offline"
Jun 08 12:20:29.874877 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:29.874234    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="8dbfe80e-acb5-4694-8288-caff4be668d1" containerName="ui"
Jun 08 12:20:29.874877 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:29.874245    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="8dbfe80e-acb5-4694-8288-caff4be668d1" containerName="registry"
Jun 08 12:20:29.874877 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:29.874254    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="8dbfe80e-acb5-4694-8288-caff4be668d1" containerName="online"
Jun 08 12:20:29.877734 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:29.877713    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-glqhc"
Jun 08 12:20:29.883090 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:29.883069    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
Jun 08 12:20:29.883523 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:29.883497    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
Jun 08 12:20:29.883630 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:29.883529    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
Jun 08 12:20:29.883630 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:29.883593    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
Jun 08 12:20:29.883752 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:29.883630    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-prk82\""
Jun 08 12:20:29.884073 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:29.884038    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
Jun 08 12:20:29.884313 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:29.884283    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
Jun 08 12:20:29.911038 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:29.911012    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-glqhc"]
Jun 08 12:20:30.010005 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:30.009971    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c3f91db9-607b-4ce3-b7de-a8072b0da896-feast-data\") pod \"feast-simple-feast-remote-setup-669bcf45fc-glqhc\" (UID: \"c3f91db9-607b-4ce3-b7de-a8072b0da896\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-glqhc"
Jun 08 12:20:30.010185 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:30.010024    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c3f91db9-607b-4ce3-b7de-a8072b0da896-online-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-glqhc\" (UID: \"c3f91db9-607b-4ce3-b7de-a8072b0da896\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-glqhc"
Jun 08 12:20:30.010185 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:30.010069    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27pjg\" (UniqueName: \"kubernetes.io/projected/c3f91db9-607b-4ce3-b7de-a8072b0da896-kube-api-access-27pjg\") pod \"feast-simple-feast-remote-setup-669bcf45fc-glqhc\" (UID: \"c3f91db9-607b-4ce3-b7de-a8072b0da896\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-glqhc"
Jun 08 12:20:30.010185 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:30.010107    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/c3f91db9-607b-4ce3-b7de-a8072b0da896-registry-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-glqhc\" (UID: \"c3f91db9-607b-4ce3-b7de-a8072b0da896\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-glqhc"
Jun 08 12:20:30.010185 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:30.010139    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c3f91db9-607b-4ce3-b7de-a8072b0da896-offline-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-glqhc\" (UID: \"c3f91db9-607b-4ce3-b7de-a8072b0da896\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-glqhc"
Jun 08 12:20:30.010185 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:30.010163    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c3f91db9-607b-4ce3-b7de-a8072b0da896-ui-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-glqhc\" (UID: \"c3f91db9-607b-4ce3-b7de-a8072b0da896\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-glqhc"
Jun 08 12:20:30.111548 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:30.111513    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c3f91db9-607b-4ce3-b7de-a8072b0da896-feast-data\") pod \"feast-simple-feast-remote-setup-669bcf45fc-glqhc\" (UID: \"c3f91db9-607b-4ce3-b7de-a8072b0da896\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-glqhc"
Jun 08 12:20:30.111732 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:30.111555    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c3f91db9-607b-4ce3-b7de-a8072b0da896-online-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-glqhc\" (UID: \"c3f91db9-607b-4ce3-b7de-a8072b0da896\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-glqhc"
Jun 08 12:20:30.111732 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:30.111575    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27pjg\" (UniqueName: \"kubernetes.io/projected/c3f91db9-607b-4ce3-b7de-a8072b0da896-kube-api-access-27pjg\") pod \"feast-simple-feast-remote-setup-669bcf45fc-glqhc\" (UID: \"c3f91db9-607b-4ce3-b7de-a8072b0da896\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-glqhc"
Jun 08 12:20:30.111732 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:30.111597    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/c3f91db9-607b-4ce3-b7de-a8072b0da896-registry-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-glqhc\" (UID: \"c3f91db9-607b-4ce3-b7de-a8072b0da896\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-glqhc"
Jun 08 12:20:30.111732 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:30.111664    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c3f91db9-607b-4ce3-b7de-a8072b0da896-offline-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-glqhc\" (UID: \"c3f91db9-607b-4ce3-b7de-a8072b0da896\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-glqhc"
Jun 08 12:20:30.111732 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:30.111708    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c3f91db9-607b-4ce3-b7de-a8072b0da896-ui-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-glqhc\" (UID: \"c3f91db9-607b-4ce3-b7de-a8072b0da896\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-glqhc"
Jun 08 12:20:30.112017 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:20:30.111842    2583 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-ui-tls: secret "feast-simple-feast-remote-setup-ui-tls" not found
Jun 08 12:20:30.112017 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:20:30.111910    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3f91db9-607b-4ce3-b7de-a8072b0da896-ui-tls podName:c3f91db9-607b-4ce3-b7de-a8072b0da896 nodeName:}" failed. No retries permitted until 2026-06-08 12:20:30.611889931 +0000 UTC m=+1951.883465086 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/c3f91db9-607b-4ce3-b7de-a8072b0da896-ui-tls") pod "feast-simple-feast-remote-setup-669bcf45fc-glqhc" (UID: "c3f91db9-607b-4ce3-b7de-a8072b0da896") : secret "feast-simple-feast-remote-setup-ui-tls" not found
Jun 08 12:20:30.112017 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:30.112001    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c3f91db9-607b-4ce3-b7de-a8072b0da896-feast-data\") pod \"feast-simple-feast-remote-setup-669bcf45fc-glqhc\" (UID: \"c3f91db9-607b-4ce3-b7de-a8072b0da896\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-glqhc"
Jun 08 12:20:30.112430 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:30.112402    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/c3f91db9-607b-4ce3-b7de-a8072b0da896-registry-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-glqhc\" (UID: \"c3f91db9-607b-4ce3-b7de-a8072b0da896\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-glqhc"
Jun 08 12:20:30.114111 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:30.114093    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c3f91db9-607b-4ce3-b7de-a8072b0da896-offline-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-glqhc\" (UID: \"c3f91db9-607b-4ce3-b7de-a8072b0da896\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-glqhc"
Jun 08 12:20:30.114210 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:30.114170    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c3f91db9-607b-4ce3-b7de-a8072b0da896-online-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-glqhc\" (UID: \"c3f91db9-607b-4ce3-b7de-a8072b0da896\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-glqhc"
Jun 08 12:20:30.126260 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:30.126206    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27pjg\" (UniqueName: \"kubernetes.io/projected/c3f91db9-607b-4ce3-b7de-a8072b0da896-kube-api-access-27pjg\") pod \"feast-simple-feast-remote-setup-669bcf45fc-glqhc\" (UID: \"c3f91db9-607b-4ce3-b7de-a8072b0da896\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-glqhc"
Jun 08 12:20:30.615869 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:30.615835    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c3f91db9-607b-4ce3-b7de-a8072b0da896-ui-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-glqhc\" (UID: \"c3f91db9-607b-4ce3-b7de-a8072b0da896\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-glqhc"
Jun 08 12:20:30.618164 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:30.618134    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c3f91db9-607b-4ce3-b7de-a8072b0da896-ui-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-glqhc\" (UID: \"c3f91db9-607b-4ce3-b7de-a8072b0da896\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-glqhc"
Jun 08 12:20:30.787516 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:30.787472    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-glqhc"
Jun 08 12:20:30.930198 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:30.930166    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-glqhc"]
Jun 08 12:20:30.934359 ip-10-0-136-189 kubenswrapper[2583]: W0608 12:20:30.934337    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc3f91db9_607b_4ce3_b7de_a8072b0da896.slice/crio-0c995ecba6f192357cb3325f01410aeda15543c66d86c98e7329c07e8ac20bf9 WatchSource:0}: Error finding container 0c995ecba6f192357cb3325f01410aeda15543c66d86c98e7329c07e8ac20bf9: Status 404 returned error can't find the container with id 0c995ecba6f192357cb3325f01410aeda15543c66d86c98e7329c07e8ac20bf9
Jun 08 12:20:31.009203 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:31.009173    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-glqhc" event={"ID":"c3f91db9-607b-4ce3-b7de-a8072b0da896","Type":"ContainerStarted","Data":"0e06ceec43c3c6e3f0fe22a02763cfad48b9704b0c9a69e82b8e0828c3689499"}
Jun 08 12:20:31.009307 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:31.009216    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-glqhc" event={"ID":"c3f91db9-607b-4ce3-b7de-a8072b0da896","Type":"ContainerStarted","Data":"0c995ecba6f192357cb3325f01410aeda15543c66d86c98e7329c07e8ac20bf9"}
Jun 08 12:20:36.032588 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:36.032549    2583 generic.go:356] "Generic (PLEG): container finished" podID="c3f91db9-607b-4ce3-b7de-a8072b0da896" containerID="0e06ceec43c3c6e3f0fe22a02763cfad48b9704b0c9a69e82b8e0828c3689499" exitCode=0
Jun 08 12:20:36.033041 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:36.032598    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-glqhc" event={"ID":"c3f91db9-607b-4ce3-b7de-a8072b0da896","Type":"ContainerDied","Data":"0e06ceec43c3c6e3f0fe22a02763cfad48b9704b0c9a69e82b8e0828c3689499"}
Jun 08 12:20:37.038586 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:37.038540    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-glqhc" event={"ID":"c3f91db9-607b-4ce3-b7de-a8072b0da896","Type":"ContainerStarted","Data":"16595f3e72043fbbf6e1a06fe889080df903e2b7960e4431d0fbdf24fdb1ad23"}
Jun 08 12:20:42.061961 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:42.061870    2583 generic.go:356] "Generic (PLEG): container finished" podID="c3f91db9-607b-4ce3-b7de-a8072b0da896" containerID="16595f3e72043fbbf6e1a06fe889080df903e2b7960e4431d0fbdf24fdb1ad23" exitCode=0
Jun 08 12:20:42.062464 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:42.061950    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-glqhc" event={"ID":"c3f91db9-607b-4ce3-b7de-a8072b0da896","Type":"ContainerDied","Data":"16595f3e72043fbbf6e1a06fe889080df903e2b7960e4431d0fbdf24fdb1ad23"}
Jun 08 12:20:43.071499 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:43.071454    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-glqhc" event={"ID":"c3f91db9-607b-4ce3-b7de-a8072b0da896","Type":"ContainerStarted","Data":"bb354553f080a25245714e90e9d95f5be8d1da74d153314271a321da77d83e25"}
Jun 08 12:20:43.072001 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:43.071521    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-glqhc" event={"ID":"c3f91db9-607b-4ce3-b7de-a8072b0da896","Type":"ContainerStarted","Data":"08785cc2775e90456e63a9f559f4bc33d048dcef6b3690371cf433a3adb0ba32"}
Jun 08 12:20:43.072001 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:43.071543    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-glqhc" event={"ID":"c3f91db9-607b-4ce3-b7de-a8072b0da896","Type":"ContainerStarted","Data":"d4e19fdbe9109931759d89b1d5105202fb37d4bbef34a05f39dffd949b2ca475"}
Jun 08 12:20:43.102224 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:43.102153    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-glqhc" podStartSLOduration=14.1021315 podStartE2EDuration="14.1021315s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:20:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:20:43.09936661 +0000 UTC m=+1964.370941788" watchObservedRunningTime="2026-06-08 12:20:43.1021315 +0000 UTC m=+1964.373706679"
Jun 08 12:20:45.787817 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:45.787735    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-glqhc"
Jun 08 12:20:45.787817 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:45.787799    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-glqhc"
Jun 08 12:20:45.787817 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:45.787822    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-glqhc"
Jun 08 12:20:45.789260 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:45.789230    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-glqhc" podUID="c3f91db9-607b-4ce3-b7de-a8072b0da896" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.42:8443: connect: connection refused"
Jun 08 12:20:45.789407 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:45.789259    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-glqhc" podUID="c3f91db9-607b-4ce3-b7de-a8072b0da896" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.42:8816: connect: connection refused"
Jun 08 12:20:45.789407 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:45.789289    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-glqhc" podUID="c3f91db9-607b-4ce3-b7de-a8072b0da896" containerName="online" probeResult="failure" output="Get \"https://10.132.0.42:6567/health\": dial tcp 10.132.0.42:6567: connect: connection refused"
Jun 08 12:20:48.788961 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:48.788882    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-glqhc"
Jun 08 12:20:48.789427 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:48.789002    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-glqhc"
Jun 08 12:20:48.789494 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:48.789473    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-glqhc"
Jun 08 12:20:48.789546 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:48.789509    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-glqhc"
Jun 08 12:20:48.789658 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:48.789644    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-glqhc"
Jun 08 12:20:48.789880 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:48.789861    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-glqhc"
Jun 08 12:20:48.792992 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:48.792970    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-glqhc"
Jun 08 12:20:49.102717 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:49.102675    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-glqhc"
Jun 08 12:20:49.105744 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:20:49.105724    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-glqhc"
Jun 08 12:21:50.922171 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:21:50.922133    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-glqhc"]
Jun 08 12:21:50.922666 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:21:50.922346    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-glqhc" podUID="c3f91db9-607b-4ce3-b7de-a8072b0da896" containerName="online" containerID="cri-o://d4e19fdbe9109931759d89b1d5105202fb37d4bbef34a05f39dffd949b2ca475" gracePeriod=30
Jun 08 12:21:50.922666 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:21:50.922406    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-glqhc" podUID="c3f91db9-607b-4ce3-b7de-a8072b0da896" containerName="offline" containerID="cri-o://08785cc2775e90456e63a9f559f4bc33d048dcef6b3690371cf433a3adb0ba32" gracePeriod=30
Jun 08 12:21:50.922666 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:21:50.922399    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-glqhc" podUID="c3f91db9-607b-4ce3-b7de-a8072b0da896" containerName="ui" containerID="cri-o://bb354553f080a25245714e90e9d95f5be8d1da74d153314271a321da77d83e25" gracePeriod=30
Jun 08 12:21:51.065414 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:21:51.065376    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z"]
Jun 08 12:21:51.065648 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:21:51.065616    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z" podUID="2e15ac4d-1865-406b-8e34-95e83a91cc61" containerName="registry" containerID="cri-o://304e6094861b045a0770e94806704207d1565c2350a71de8dae42b49484f3905" gracePeriod=30
Jun 08 12:21:51.065731 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:21:51.065691    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z" podUID="2e15ac4d-1865-406b-8e34-95e83a91cc61" containerName="online" containerID="cri-o://d8d3f72dbce3dc6cb59eedfc6a50fd7723e8d8762bb5565d6d7d344c6590fea7" gracePeriod=30
Jun 08 12:21:51.065814 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:21:51.065771    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z" podUID="2e15ac4d-1865-406b-8e34-95e83a91cc61" containerName="ui" containerID="cri-o://b96a17a950135d8d7a9464749c560004bce0a2fd27ff9d3dec03b25238e40830" gracePeriod=30
Jun 08 12:21:51.065954 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:21:51.065698    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z" podUID="2e15ac4d-1865-406b-8e34-95e83a91cc61" containerName="offline" containerID="cri-o://d542349bb214b210cc55d2a3c19351c41229efb6b324a0b701d857e7bec38c03" gracePeriod=30
Jun 08 12:21:52.365470 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:21:52.365436    2583 generic.go:356] "Generic (PLEG): container finished" podID="2e15ac4d-1865-406b-8e34-95e83a91cc61" containerID="b96a17a950135d8d7a9464749c560004bce0a2fd27ff9d3dec03b25238e40830" exitCode=0
Jun 08 12:21:52.365470 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:21:52.365462    2583 generic.go:356] "Generic (PLEG): container finished" podID="2e15ac4d-1865-406b-8e34-95e83a91cc61" containerID="d8d3f72dbce3dc6cb59eedfc6a50fd7723e8d8762bb5565d6d7d344c6590fea7" exitCode=0
Jun 08 12:21:52.365918 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:21:52.365511    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z" event={"ID":"2e15ac4d-1865-406b-8e34-95e83a91cc61","Type":"ContainerDied","Data":"b96a17a950135d8d7a9464749c560004bce0a2fd27ff9d3dec03b25238e40830"}
Jun 08 12:21:52.365918 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:21:52.365562    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z" event={"ID":"2e15ac4d-1865-406b-8e34-95e83a91cc61","Type":"ContainerDied","Data":"d8d3f72dbce3dc6cb59eedfc6a50fd7723e8d8762bb5565d6d7d344c6590fea7"}
Jun 08 12:21:52.368042 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:21:52.368019    2583 generic.go:356] "Generic (PLEG): container finished" podID="c3f91db9-607b-4ce3-b7de-a8072b0da896" containerID="bb354553f080a25245714e90e9d95f5be8d1da74d153314271a321da77d83e25" exitCode=0
Jun 08 12:21:52.368042 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:21:52.368037    2583 generic.go:356] "Generic (PLEG): container finished" podID="c3f91db9-607b-4ce3-b7de-a8072b0da896" containerID="d4e19fdbe9109931759d89b1d5105202fb37d4bbef34a05f39dffd949b2ca475" exitCode=0
Jun 08 12:21:52.368219 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:21:52.368070    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-glqhc" event={"ID":"c3f91db9-607b-4ce3-b7de-a8072b0da896","Type":"ContainerDied","Data":"bb354553f080a25245714e90e9d95f5be8d1da74d153314271a321da77d83e25"}
Jun 08 12:21:52.368219 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:21:52.368105    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-glqhc" event={"ID":"c3f91db9-607b-4ce3-b7de-a8072b0da896","Type":"ContainerDied","Data":"d4e19fdbe9109931759d89b1d5105202fb37d4bbef34a05f39dffd949b2ca475"}
Jun 08 12:21:57.232795 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:21:57.232748    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z" podUID="2e15ac4d-1865-406b-8e34-95e83a91cc61" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.41:8443: connect: connection refused"
Jun 08 12:21:57.758762 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:21:57.758712    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z" podUID="2e15ac4d-1865-406b-8e34-95e83a91cc61" containerName="online" probeResult="failure" output="Get \"https://10.132.0.41:6567/health\": dial tcp 10.132.0.41:6567: connect: connection refused"
Jun 08 12:21:58.790139 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:21:58.790089    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-glqhc" podUID="c3f91db9-607b-4ce3-b7de-a8072b0da896" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.42:8443: connect: connection refused"
Jun 08 12:21:59.103705 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:21:59.103669    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-glqhc" podUID="c3f91db9-607b-4ce3-b7de-a8072b0da896" containerName="online" probeResult="failure" output="Get \"https://10.132.0.42:6567/health\": dial tcp 10.132.0.42:6567: connect: connection refused"
Jun 08 12:22:07.232962 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:07.232909    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z" podUID="2e15ac4d-1865-406b-8e34-95e83a91cc61" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.41:8443: connect: connection refused"
Jun 08 12:22:07.759278 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:07.759233    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z" podUID="2e15ac4d-1865-406b-8e34-95e83a91cc61" containerName="online" probeResult="failure" output="Get \"https://10.132.0.41:6567/health\": dial tcp 10.132.0.41:6567: connect: connection refused"
Jun 08 12:22:08.790105 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:08.790035    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-glqhc" podUID="c3f91db9-607b-4ce3-b7de-a8072b0da896" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.42:8443: connect: connection refused"
Jun 08 12:22:09.102986 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:09.102938    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-glqhc" podUID="c3f91db9-607b-4ce3-b7de-a8072b0da896" containerName="online" probeResult="failure" output="Get \"https://10.132.0.42:6567/health\": dial tcp 10.132.0.42:6567: connect: connection refused"
Jun 08 12:22:17.232128 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:17.232071    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z" podUID="2e15ac4d-1865-406b-8e34-95e83a91cc61" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.41:8443: connect: connection refused"
Jun 08 12:22:17.232576 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:17.232229    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z"
Jun 08 12:22:17.759690 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:17.759647    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z" podUID="2e15ac4d-1865-406b-8e34-95e83a91cc61" containerName="online" probeResult="failure" output="Get \"https://10.132.0.41:6567/health\": dial tcp 10.132.0.41:6567: connect: connection refused"
Jun 08 12:22:17.759910 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:17.759785    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z"
Jun 08 12:22:18.789759 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:18.789662    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-glqhc" podUID="c3f91db9-607b-4ce3-b7de-a8072b0da896" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.42:8443: connect: connection refused"
Jun 08 12:22:18.790161 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:18.789806    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-glqhc"
Jun 08 12:22:19.103468 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:19.103430    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-glqhc" podUID="c3f91db9-607b-4ce3-b7de-a8072b0da896" containerName="online" probeResult="failure" output="Get \"https://10.132.0.42:6567/health\": dial tcp 10.132.0.42:6567: connect: connection refused"
Jun 08 12:22:19.103648 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:19.103548    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-glqhc"
Jun 08 12:22:21.493859 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:21.493828    2583 generic.go:356] "Generic (PLEG): container finished" podID="2e15ac4d-1865-406b-8e34-95e83a91cc61" containerID="d542349bb214b210cc55d2a3c19351c41229efb6b324a0b701d857e7bec38c03" exitCode=137
Jun 08 12:22:21.493859 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:21.493858    2583 generic.go:356] "Generic (PLEG): container finished" podID="2e15ac4d-1865-406b-8e34-95e83a91cc61" containerID="304e6094861b045a0770e94806704207d1565c2350a71de8dae42b49484f3905" exitCode=137
Jun 08 12:22:21.494333 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:21.493874    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z" event={"ID":"2e15ac4d-1865-406b-8e34-95e83a91cc61","Type":"ContainerDied","Data":"d542349bb214b210cc55d2a3c19351c41229efb6b324a0b701d857e7bec38c03"}
Jun 08 12:22:21.494333 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:21.493924    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z" event={"ID":"2e15ac4d-1865-406b-8e34-95e83a91cc61","Type":"ContainerDied","Data":"304e6094861b045a0770e94806704207d1565c2350a71de8dae42b49484f3905"}
Jun 08 12:22:21.503644 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:21.503616    2583 generic.go:356] "Generic (PLEG): container finished" podID="c3f91db9-607b-4ce3-b7de-a8072b0da896" containerID="08785cc2775e90456e63a9f559f4bc33d048dcef6b3690371cf433a3adb0ba32" exitCode=137
Jun 08 12:22:21.503786 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:21.503657    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-glqhc" event={"ID":"c3f91db9-607b-4ce3-b7de-a8072b0da896","Type":"ContainerDied","Data":"08785cc2775e90456e63a9f559f4bc33d048dcef6b3690371cf433a3adb0ba32"}
Jun 08 12:22:21.574556 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:21.574530    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-glqhc"
Jun 08 12:22:21.660918 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:21.660888    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-27pjg\" (UniqueName: \"kubernetes.io/projected/c3f91db9-607b-4ce3-b7de-a8072b0da896-kube-api-access-27pjg\") pod \"c3f91db9-607b-4ce3-b7de-a8072b0da896\" (UID: \"c3f91db9-607b-4ce3-b7de-a8072b0da896\") "
Jun 08 12:22:21.661131 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:21.660949    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c3f91db9-607b-4ce3-b7de-a8072b0da896-ui-tls\") pod \"c3f91db9-607b-4ce3-b7de-a8072b0da896\" (UID: \"c3f91db9-607b-4ce3-b7de-a8072b0da896\") "
Jun 08 12:22:21.661131 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:21.660977    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/c3f91db9-607b-4ce3-b7de-a8072b0da896-registry-tls\") pod \"c3f91db9-607b-4ce3-b7de-a8072b0da896\" (UID: \"c3f91db9-607b-4ce3-b7de-a8072b0da896\") "
Jun 08 12:22:21.661131 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:21.661060    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c3f91db9-607b-4ce3-b7de-a8072b0da896-online-tls\") pod \"c3f91db9-607b-4ce3-b7de-a8072b0da896\" (UID: \"c3f91db9-607b-4ce3-b7de-a8072b0da896\") "
Jun 08 12:22:21.661131 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:21.661100    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c3f91db9-607b-4ce3-b7de-a8072b0da896-offline-tls\") pod \"c3f91db9-607b-4ce3-b7de-a8072b0da896\" (UID: \"c3f91db9-607b-4ce3-b7de-a8072b0da896\") "
Jun 08 12:22:21.661131 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:21.661130    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c3f91db9-607b-4ce3-b7de-a8072b0da896-feast-data\") pod \"c3f91db9-607b-4ce3-b7de-a8072b0da896\" (UID: \"c3f91db9-607b-4ce3-b7de-a8072b0da896\") "
Jun 08 12:22:21.661475 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:21.661394    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3f91db9-607b-4ce3-b7de-a8072b0da896-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c3f91db9-607b-4ce3-b7de-a8072b0da896" (UID: "c3f91db9-607b-4ce3-b7de-a8072b0da896"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 08 12:22:21.661787 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:21.661759    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3f91db9-607b-4ce3-b7de-a8072b0da896-feast-data" (OuterVolumeSpecName: "feast-data") pod "c3f91db9-607b-4ce3-b7de-a8072b0da896" (UID: "c3f91db9-607b-4ce3-b7de-a8072b0da896"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 08 12:22:21.663308 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:21.663287    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3f91db9-607b-4ce3-b7de-a8072b0da896-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "c3f91db9-607b-4ce3-b7de-a8072b0da896" (UID: "c3f91db9-607b-4ce3-b7de-a8072b0da896"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 08 12:22:21.663522 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:21.663501    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3f91db9-607b-4ce3-b7de-a8072b0da896-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "c3f91db9-607b-4ce3-b7de-a8072b0da896" (UID: "c3f91db9-607b-4ce3-b7de-a8072b0da896"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 08 12:22:21.663586 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:21.663503    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3f91db9-607b-4ce3-b7de-a8072b0da896-kube-api-access-27pjg" (OuterVolumeSpecName: "kube-api-access-27pjg") pod "c3f91db9-607b-4ce3-b7de-a8072b0da896" (UID: "c3f91db9-607b-4ce3-b7de-a8072b0da896"). InnerVolumeSpecName "kube-api-access-27pjg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 08 12:22:21.663713 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:21.663688    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3f91db9-607b-4ce3-b7de-a8072b0da896-online-tls" (OuterVolumeSpecName: "online-tls") pod "c3f91db9-607b-4ce3-b7de-a8072b0da896" (UID: "c3f91db9-607b-4ce3-b7de-a8072b0da896"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 08 12:22:21.717787 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:21.717764    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z"
Jun 08 12:22:21.761642 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:21.761624    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2e15ac4d-1865-406b-8e34-95e83a91cc61-registry-tls\") pod \"2e15ac4d-1865-406b-8e34-95e83a91cc61\" (UID: \"2e15ac4d-1865-406b-8e34-95e83a91cc61\") "
Jun 08 12:22:21.761721 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:21.761651    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2e15ac4d-1865-406b-8e34-95e83a91cc61-feast-data\") pod \"2e15ac4d-1865-406b-8e34-95e83a91cc61\" (UID: \"2e15ac4d-1865-406b-8e34-95e83a91cc61\") "
Jun 08 12:22:21.761721 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:21.761676    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2e15ac4d-1865-406b-8e34-95e83a91cc61-offline-tls\") pod \"2e15ac4d-1865-406b-8e34-95e83a91cc61\" (UID: \"2e15ac4d-1865-406b-8e34-95e83a91cc61\") "
Jun 08 12:22:21.761811 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:21.761734    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2e15ac4d-1865-406b-8e34-95e83a91cc61-online-tls\") pod \"2e15ac4d-1865-406b-8e34-95e83a91cc61\" (UID: \"2e15ac4d-1865-406b-8e34-95e83a91cc61\") "
Jun 08 12:22:21.761811 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:21.761785    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2e15ac4d-1865-406b-8e34-95e83a91cc61-ui-tls\") pod \"2e15ac4d-1865-406b-8e34-95e83a91cc61\" (UID: \"2e15ac4d-1865-406b-8e34-95e83a91cc61\") "
Jun 08 12:22:21.762029 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:21.761815    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r266j\" (UniqueName: \"kubernetes.io/projected/2e15ac4d-1865-406b-8e34-95e83a91cc61-kube-api-access-r266j\") pod \"2e15ac4d-1865-406b-8e34-95e83a91cc61\" (UID: \"2e15ac4d-1865-406b-8e34-95e83a91cc61\") "
Jun 08 12:22:21.762537 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:21.762203    2583 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c3f91db9-607b-4ce3-b7de-a8072b0da896-online-tls\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:22:21.762537 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:21.762227    2583 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c3f91db9-607b-4ce3-b7de-a8072b0da896-offline-tls\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:22:21.762537 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:21.762247    2583 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c3f91db9-607b-4ce3-b7de-a8072b0da896-feast-data\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:22:21.762537 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:21.762245    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e15ac4d-1865-406b-8e34-95e83a91cc61-feast-data" (OuterVolumeSpecName: "feast-data") pod "2e15ac4d-1865-406b-8e34-95e83a91cc61" (UID: "2e15ac4d-1865-406b-8e34-95e83a91cc61"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 08 12:22:21.762537 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:21.762262    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-27pjg\" (UniqueName: \"kubernetes.io/projected/c3f91db9-607b-4ce3-b7de-a8072b0da896-kube-api-access-27pjg\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:22:21.762537 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:21.762277    2583 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c3f91db9-607b-4ce3-b7de-a8072b0da896-ui-tls\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:22:21.762537 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:21.762289    2583 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/c3f91db9-607b-4ce3-b7de-a8072b0da896-registry-tls\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:22:21.764374 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:21.764320    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e15ac4d-1865-406b-8e34-95e83a91cc61-online-tls" (OuterVolumeSpecName: "online-tls") pod "2e15ac4d-1865-406b-8e34-95e83a91cc61" (UID: "2e15ac4d-1865-406b-8e34-95e83a91cc61"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 08 12:22:21.764790 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:21.764713    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e15ac4d-1865-406b-8e34-95e83a91cc61-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "2e15ac4d-1865-406b-8e34-95e83a91cc61" (UID: "2e15ac4d-1865-406b-8e34-95e83a91cc61"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 08 12:22:21.764790 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:21.764748    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e15ac4d-1865-406b-8e34-95e83a91cc61-kube-api-access-r266j" (OuterVolumeSpecName: "kube-api-access-r266j") pod "2e15ac4d-1865-406b-8e34-95e83a91cc61" (UID: "2e15ac4d-1865-406b-8e34-95e83a91cc61"). InnerVolumeSpecName "kube-api-access-r266j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 08 12:22:21.764953 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:21.764810    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e15ac4d-1865-406b-8e34-95e83a91cc61-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "2e15ac4d-1865-406b-8e34-95e83a91cc61" (UID: "2e15ac4d-1865-406b-8e34-95e83a91cc61"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 08 12:22:21.764953 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:21.764865    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e15ac4d-1865-406b-8e34-95e83a91cc61-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "2e15ac4d-1865-406b-8e34-95e83a91cc61" (UID: "2e15ac4d-1865-406b-8e34-95e83a91cc61"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 08 12:22:21.863140 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:21.863110    2583 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2e15ac4d-1865-406b-8e34-95e83a91cc61-registry-tls\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:22:21.863140 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:21.863137    2583 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2e15ac4d-1865-406b-8e34-95e83a91cc61-feast-data\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:22:21.863140 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:21.863146    2583 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2e15ac4d-1865-406b-8e34-95e83a91cc61-offline-tls\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:22:21.863368 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:21.863154    2583 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2e15ac4d-1865-406b-8e34-95e83a91cc61-online-tls\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:22:21.863368 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:21.863163    2583 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2e15ac4d-1865-406b-8e34-95e83a91cc61-ui-tls\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:22:21.863368 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:21.863171    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r266j\" (UniqueName: \"kubernetes.io/projected/2e15ac4d-1865-406b-8e34-95e83a91cc61-kube-api-access-r266j\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:22:22.510780 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:22.510742    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z" event={"ID":"2e15ac4d-1865-406b-8e34-95e83a91cc61","Type":"ContainerDied","Data":"4b28d824887aaf7f03803fb8b5a80069a2e875ca0d15bdd2cdc70ee489272665"}
Jun 08 12:22:22.511227 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:22.510753    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z"
Jun 08 12:22:22.511227 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:22.510809    2583 scope.go:117] "RemoveContainer" containerID="b96a17a950135d8d7a9464749c560004bce0a2fd27ff9d3dec03b25238e40830"
Jun 08 12:22:22.513544 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:22.513514    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-glqhc" event={"ID":"c3f91db9-607b-4ce3-b7de-a8072b0da896","Type":"ContainerDied","Data":"0c995ecba6f192357cb3325f01410aeda15543c66d86c98e7329c07e8ac20bf9"}
Jun 08 12:22:22.513544 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:22.513553    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-glqhc"
Jun 08 12:22:22.520762 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:22.520743    2583 scope.go:117] "RemoveContainer" containerID="d542349bb214b210cc55d2a3c19351c41229efb6b324a0b701d857e7bec38c03"
Jun 08 12:22:22.528291 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:22.528269    2583 scope.go:117] "RemoveContainer" containerID="d8d3f72dbce3dc6cb59eedfc6a50fd7723e8d8762bb5565d6d7d344c6590fea7"
Jun 08 12:22:22.535761 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:22.535742    2583 scope.go:117] "RemoveContainer" containerID="304e6094861b045a0770e94806704207d1565c2350a71de8dae42b49484f3905"
Jun 08 12:22:22.542654 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:22.542627    2583 scope.go:117] "RemoveContainer" containerID="28eda9a71d0f43b060efce1187cf78e68a656d99824d358b037fa202c7196fe9"
Jun 08 12:22:22.548883 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:22.548855    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z"]
Jun 08 12:22:22.549681 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:22.549669    2583 scope.go:117] "RemoveContainer" containerID="76b438907e9c14669f8954212cdc88d2b02cc24da59fd5d262494877254d29fc"
Jun 08 12:22:22.552270 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:22.552250    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-vcx4z"]
Jun 08 12:22:22.559225 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:22.559206    2583 scope.go:117] "RemoveContainer" containerID="bb354553f080a25245714e90e9d95f5be8d1da74d153314271a321da77d83e25"
Jun 08 12:22:22.566420 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:22.566402    2583 scope.go:117] "RemoveContainer" containerID="08785cc2775e90456e63a9f559f4bc33d048dcef6b3690371cf433a3adb0ba32"
Jun 08 12:22:22.571405 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:22.571382    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-glqhc"]
Jun 08 12:22:22.573662 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:22.573640    2583 scope.go:117] "RemoveContainer" containerID="d4e19fdbe9109931759d89b1d5105202fb37d4bbef34a05f39dffd949b2ca475"
Jun 08 12:22:22.577517 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:22.577490    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-glqhc"]
Jun 08 12:22:22.580884 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:22.580868    2583 scope.go:117] "RemoveContainer" containerID="16595f3e72043fbbf6e1a06fe889080df903e2b7960e4431d0fbdf24fdb1ad23"
Jun 08 12:22:22.587473 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:22.587455    2583 scope.go:117] "RemoveContainer" containerID="0e06ceec43c3c6e3f0fe22a02763cfad48b9704b0c9a69e82b8e0828c3689499"
Jun 08 12:22:23.186017 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:23.185983    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e15ac4d-1865-406b-8e34-95e83a91cc61" path="/var/lib/kubelet/pods/2e15ac4d-1865-406b-8e34-95e83a91cc61/volumes"
Jun 08 12:22:23.186623 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:23.186609    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3f91db9-607b-4ce3-b7de-a8072b0da896" path="/var/lib/kubelet/pods/c3f91db9-607b-4ce3-b7de-a8072b0da896/volumes"
Jun 08 12:22:42.089356 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:42.089313    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-b7q6d/must-gather-65xng"]
Jun 08 12:22:42.089835 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:42.089635    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3f91db9-607b-4ce3-b7de-a8072b0da896" containerName="feast-apply"
Jun 08 12:22:42.089835 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:42.089647    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3f91db9-607b-4ce3-b7de-a8072b0da896" containerName="feast-apply"
Jun 08 12:22:42.089835 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:42.089656    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e15ac4d-1865-406b-8e34-95e83a91cc61" containerName="online"
Jun 08 12:22:42.089835 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:42.089662    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e15ac4d-1865-406b-8e34-95e83a91cc61" containerName="online"
Jun 08 12:22:42.089835 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:42.089669    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e15ac4d-1865-406b-8e34-95e83a91cc61" containerName="feast-init"
Jun 08 12:22:42.089835 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:42.089675    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e15ac4d-1865-406b-8e34-95e83a91cc61" containerName="feast-init"
Jun 08 12:22:42.089835 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:42.089683    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e15ac4d-1865-406b-8e34-95e83a91cc61" containerName="feast-apply"
Jun 08 12:22:42.089835 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:42.089688    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e15ac4d-1865-406b-8e34-95e83a91cc61" containerName="feast-apply"
Jun 08 12:22:42.089835 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:42.089693    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e15ac4d-1865-406b-8e34-95e83a91cc61" containerName="ui"
Jun 08 12:22:42.089835 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:42.089699    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e15ac4d-1865-406b-8e34-95e83a91cc61" containerName="ui"
Jun 08 12:22:42.089835 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:42.089704    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3f91db9-607b-4ce3-b7de-a8072b0da896" containerName="feast-init"
Jun 08 12:22:42.089835 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:42.089709    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3f91db9-607b-4ce3-b7de-a8072b0da896" containerName="feast-init"
Jun 08 12:22:42.089835 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:42.089718    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3f91db9-607b-4ce3-b7de-a8072b0da896" containerName="ui"
Jun 08 12:22:42.089835 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:42.089722    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3f91db9-607b-4ce3-b7de-a8072b0da896" containerName="ui"
Jun 08 12:22:42.089835 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:42.089733    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e15ac4d-1865-406b-8e34-95e83a91cc61" containerName="offline"
Jun 08 12:22:42.089835 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:42.089737    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e15ac4d-1865-406b-8e34-95e83a91cc61" containerName="offline"
Jun 08 12:22:42.089835 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:42.089743    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3f91db9-607b-4ce3-b7de-a8072b0da896" containerName="offline"
Jun 08 12:22:42.089835 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:42.089748    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3f91db9-607b-4ce3-b7de-a8072b0da896" containerName="offline"
Jun 08 12:22:42.089835 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:42.089753    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e15ac4d-1865-406b-8e34-95e83a91cc61" containerName="registry"
Jun 08 12:22:42.089835 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:42.089759    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e15ac4d-1865-406b-8e34-95e83a91cc61" containerName="registry"
Jun 08 12:22:42.089835 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:42.089772    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3f91db9-607b-4ce3-b7de-a8072b0da896" containerName="online"
Jun 08 12:22:42.089835 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:42.089777    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3f91db9-607b-4ce3-b7de-a8072b0da896" containerName="online"
Jun 08 12:22:42.089835 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:42.089818    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e15ac4d-1865-406b-8e34-95e83a91cc61" containerName="offline"
Jun 08 12:22:42.089835 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:42.089826    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e15ac4d-1865-406b-8e34-95e83a91cc61" containerName="online"
Jun 08 12:22:42.089835 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:42.089832    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3f91db9-607b-4ce3-b7de-a8072b0da896" containerName="offline"
Jun 08 12:22:42.089835 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:42.089838    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e15ac4d-1865-406b-8e34-95e83a91cc61" containerName="ui"
Jun 08 12:22:42.089835 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:42.089843    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e15ac4d-1865-406b-8e34-95e83a91cc61" containerName="registry"
Jun 08 12:22:42.089835 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:42.089849    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3f91db9-607b-4ce3-b7de-a8072b0da896" containerName="ui"
Jun 08 12:22:42.090663 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:42.089855    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3f91db9-607b-4ce3-b7de-a8072b0da896" containerName="online"
Jun 08 12:22:42.092834 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:42.092815    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b7q6d/must-gather-65xng"
Jun 08 12:22:42.095353 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:22:42.095324    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-65xng\" is forbidden: User \"system:node:ip-10-0-136-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-b7q6d\": no relationship found between node 'ip-10-0-136-189.ec2.internal' and this object" podUID="e57053c6-9fca-496c-9ce7-b65649196beb" pod="openshift-must-gather-b7q6d/must-gather-65xng"
Jun 08 12:22:42.095476 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:22:42.095361    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-136-189.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-must-gather-b7q6d\": no relationship found between node 'ip-10-0-136-189.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-must-gather-b7q6d\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Jun 08 12:22:42.095476 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:22:42.095361    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"default-dockercfg-fgmbh\" is forbidden: User \"system:node:ip-10-0-136-189.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-must-gather-b7q6d\": no relationship found between node 'ip-10-0-136-189.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-must-gather-b7q6d\"/\"default-dockercfg-fgmbh\"" type="*v1.Secret"
Jun 08 12:22:42.095647 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:22:42.095626    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-136-189.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-must-gather-b7q6d\": no relationship found between node 'ip-10-0-136-189.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-must-gather-b7q6d\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Jun 08 12:22:42.108157 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:42.108130    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b7q6d/must-gather-65xng"]
Jun 08 12:22:42.232813 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:42.232773    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhrnz\" (UniqueName: \"kubernetes.io/projected/e57053c6-9fca-496c-9ce7-b65649196beb-kube-api-access-mhrnz\") pod \"must-gather-65xng\" (UID: \"e57053c6-9fca-496c-9ce7-b65649196beb\") " pod="openshift-must-gather-b7q6d/must-gather-65xng"
Jun 08 12:22:42.232962 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:42.232832    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e57053c6-9fca-496c-9ce7-b65649196beb-must-gather-output\") pod \"must-gather-65xng\" (UID: \"e57053c6-9fca-496c-9ce7-b65649196beb\") " pod="openshift-must-gather-b7q6d/must-gather-65xng"
Jun 08 12:22:42.333639 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:42.333588    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e57053c6-9fca-496c-9ce7-b65649196beb-must-gather-output\") pod \"must-gather-65xng\" (UID: \"e57053c6-9fca-496c-9ce7-b65649196beb\") " pod="openshift-must-gather-b7q6d/must-gather-65xng"
Jun 08 12:22:42.333787 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:42.333664    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhrnz\" (UniqueName: \"kubernetes.io/projected/e57053c6-9fca-496c-9ce7-b65649196beb-kube-api-access-mhrnz\") pod \"must-gather-65xng\" (UID: \"e57053c6-9fca-496c-9ce7-b65649196beb\") " pod="openshift-must-gather-b7q6d/must-gather-65xng"
Jun 08 12:22:42.333937 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:42.333918    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e57053c6-9fca-496c-9ce7-b65649196beb-must-gather-output\") pod \"must-gather-65xng\" (UID: \"e57053c6-9fca-496c-9ce7-b65649196beb\") " pod="openshift-must-gather-b7q6d/must-gather-65xng"
Jun 08 12:22:42.984277 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:42.984241    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-b7q6d\"/\"kube-root-ca.crt\""
Jun 08 12:22:43.482001 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:43.481971    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-b7q6d\"/\"openshift-service-ca.crt\""
Jun 08 12:22:43.490099 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:43.490070    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhrnz\" (UniqueName: \"kubernetes.io/projected/e57053c6-9fca-496c-9ce7-b65649196beb-kube-api-access-mhrnz\") pod \"must-gather-65xng\" (UID: \"e57053c6-9fca-496c-9ce7-b65649196beb\") " pod="openshift-must-gather-b7q6d/must-gather-65xng"
Jun 08 12:22:43.507107 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:43.507082    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-b7q6d\"/\"default-dockercfg-fgmbh\""
Jun 08 12:22:43.622275 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:43.622245    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b7q6d/must-gather-65xng"
Jun 08 12:22:43.752799 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:43.752729    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b7q6d/must-gather-65xng"]
Jun 08 12:22:43.758598 ip-10-0-136-189 kubenswrapper[2583]: W0608 12:22:43.758569    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode57053c6_9fca_496c_9ce7_b65649196beb.slice/crio-426b3b418b1671e6e1d42e282802d52ca1ea748d9e5c3e8f42b00466a129c861 WatchSource:0}: Error finding container 426b3b418b1671e6e1d42e282802d52ca1ea748d9e5c3e8f42b00466a129c861: Status 404 returned error can't find the container with id 426b3b418b1671e6e1d42e282802d52ca1ea748d9e5c3e8f42b00466a129c861
Jun 08 12:22:43.760196 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:43.760179    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 08 12:22:44.601873 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:44.601801    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b7q6d/must-gather-65xng" event={"ID":"e57053c6-9fca-496c-9ce7-b65649196beb","Type":"ContainerStarted","Data":"426b3b418b1671e6e1d42e282802d52ca1ea748d9e5c3e8f42b00466a129c861"}
Jun 08 12:22:50.633464 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:50.633416    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b7q6d/must-gather-65xng" event={"ID":"e57053c6-9fca-496c-9ce7-b65649196beb","Type":"ContainerStarted","Data":"d233949bdf7359c79d229e452e836cad9ff0f1f8c4f25dfdd15226225f14bdcc"}
Jun 08 12:22:50.633464 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:50.633462    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b7q6d/must-gather-65xng" event={"ID":"e57053c6-9fca-496c-9ce7-b65649196beb","Type":"ContainerStarted","Data":"a2b767934f7ab4723da21c75b0164659cf95d6ca4114812d8272bcc62308c2ea"}
Jun 08 12:22:59.286276 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:59.286244    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mnnbj_cdf82c13-c30a-474a-a135-3d1dbcbb6046/console-operator/2.log"
Jun 08 12:22:59.289792 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:59.289770    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mnnbj_cdf82c13-c30a-474a-a135-3d1dbcbb6046/console-operator/2.log"
Jun 08 12:22:59.671335 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:59.671302    2583 generic.go:356] "Generic (PLEG): container finished" podID="e57053c6-9fca-496c-9ce7-b65649196beb" containerID="a2b767934f7ab4723da21c75b0164659cf95d6ca4114812d8272bcc62308c2ea" exitCode=0
Jun 08 12:22:59.671537 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:59.671373    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b7q6d/must-gather-65xng" event={"ID":"e57053c6-9fca-496c-9ce7-b65649196beb","Type":"ContainerDied","Data":"a2b767934f7ab4723da21c75b0164659cf95d6ca4114812d8272bcc62308c2ea"}
Jun 08 12:22:59.671697 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:22:59.671682    2583 scope.go:117] "RemoveContainer" containerID="a2b767934f7ab4723da21c75b0164659cf95d6ca4114812d8272bcc62308c2ea"
Jun 08 12:23:00.515466 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:00.515436    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-b7q6d_must-gather-65xng_e57053c6-9fca-496c-9ce7-b65649196beb/gather/0.log"
Jun 08 12:23:03.977175 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:03.977144    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-c6hh2_2579f4ef-e90c-4da0-9617-9ba892dba6ef/global-pull-secret-syncer/0.log"
Jun 08 12:23:04.251764 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:04.251688    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vxkpp_5ba152b0-fb41-414a-a375-ae9ae8f60d2a/konnectivity-agent/0.log"
Jun 08 12:23:04.368944 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:04.368911    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-189.ec2.internal_506ef425fb62c5dbd2433ce02355f53c/haproxy/0.log"
Jun 08 12:23:05.881417 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:05.881379    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-b7q6d/must-gather-65xng"]
Jun 08 12:23:05.881888 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:05.881609    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-must-gather-b7q6d/must-gather-65xng" podUID="e57053c6-9fca-496c-9ce7-b65649196beb" containerName="copy" containerID="cri-o://d233949bdf7359c79d229e452e836cad9ff0f1f8c4f25dfdd15226225f14bdcc" gracePeriod=2
Jun 08 12:23:05.886718 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:05.886673    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-b7q6d/must-gather-65xng"]
Jun 08 12:23:06.109392 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:06.109369    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-b7q6d_must-gather-65xng_e57053c6-9fca-496c-9ce7-b65649196beb/copy/0.log"
Jun 08 12:23:06.111987 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:06.111967    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b7q6d/must-gather-65xng"
Jun 08 12:23:06.116563 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:23:06.116535    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-65xng\" is forbidden: User \"system:node:ip-10-0-136-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-b7q6d\": no relationship found between node 'ip-10-0-136-189.ec2.internal' and this object" podUID="e57053c6-9fca-496c-9ce7-b65649196beb" pod="openshift-must-gather-b7q6d/must-gather-65xng"
Jun 08 12:23:06.132990 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:06.132946    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e57053c6-9fca-496c-9ce7-b65649196beb-must-gather-output\") pod \"e57053c6-9fca-496c-9ce7-b65649196beb\" (UID: \"e57053c6-9fca-496c-9ce7-b65649196beb\") "
Jun 08 12:23:06.133093 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:06.133003    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mhrnz\" (UniqueName: \"kubernetes.io/projected/e57053c6-9fca-496c-9ce7-b65649196beb-kube-api-access-mhrnz\") pod \"e57053c6-9fca-496c-9ce7-b65649196beb\" (UID: \"e57053c6-9fca-496c-9ce7-b65649196beb\") "
Jun 08 12:23:06.133301 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:06.133277    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e57053c6-9fca-496c-9ce7-b65649196beb-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "e57053c6-9fca-496c-9ce7-b65649196beb" (UID: "e57053c6-9fca-496c-9ce7-b65649196beb"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 08 12:23:06.134964 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:06.134937    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e57053c6-9fca-496c-9ce7-b65649196beb-kube-api-access-mhrnz" (OuterVolumeSpecName: "kube-api-access-mhrnz") pod "e57053c6-9fca-496c-9ce7-b65649196beb" (UID: "e57053c6-9fca-496c-9ce7-b65649196beb"). InnerVolumeSpecName "kube-api-access-mhrnz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 08 12:23:06.234309 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:06.234287    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mhrnz\" (UniqueName: \"kubernetes.io/projected/e57053c6-9fca-496c-9ce7-b65649196beb-kube-api-access-mhrnz\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:23:06.234309 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:06.234307    2583 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e57053c6-9fca-496c-9ce7-b65649196beb-must-gather-output\") on node \"ip-10-0-136-189.ec2.internal\" DevicePath \"\""
Jun 08 12:23:06.699767 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:06.699736    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-b7q6d_must-gather-65xng_e57053c6-9fca-496c-9ce7-b65649196beb/copy/0.log"
Jun 08 12:23:06.700164 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:06.700139    2583 generic.go:356] "Generic (PLEG): container finished" podID="e57053c6-9fca-496c-9ce7-b65649196beb" containerID="d233949bdf7359c79d229e452e836cad9ff0f1f8c4f25dfdd15226225f14bdcc" exitCode=143
Jun 08 12:23:06.700232 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:06.700190    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b7q6d/must-gather-65xng"
Jun 08 12:23:06.700288 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:06.700194    2583 scope.go:117] "RemoveContainer" containerID="d233949bdf7359c79d229e452e836cad9ff0f1f8c4f25dfdd15226225f14bdcc"
Jun 08 12:23:06.708075 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:06.708041    2583 scope.go:117] "RemoveContainer" containerID="a2b767934f7ab4723da21c75b0164659cf95d6ca4114812d8272bcc62308c2ea"
Jun 08 12:23:06.709319 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:23:06.709294    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-65xng\" is forbidden: User \"system:node:ip-10-0-136-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-b7q6d\": no relationship found between node 'ip-10-0-136-189.ec2.internal' and this object" podUID="e57053c6-9fca-496c-9ce7-b65649196beb" pod="openshift-must-gather-b7q6d/must-gather-65xng"
Jun 08 12:23:06.711280 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:23:06.711257    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-65xng\" is forbidden: User \"system:node:ip-10-0-136-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-b7q6d\": no relationship found between node 'ip-10-0-136-189.ec2.internal' and this object" podUID="e57053c6-9fca-496c-9ce7-b65649196beb" pod="openshift-must-gather-b7q6d/must-gather-65xng"
Jun 08 12:23:06.718557 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:06.718541    2583 scope.go:117] "RemoveContainer" containerID="d233949bdf7359c79d229e452e836cad9ff0f1f8c4f25dfdd15226225f14bdcc"
Jun 08 12:23:06.718822 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:23:06.718801    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d233949bdf7359c79d229e452e836cad9ff0f1f8c4f25dfdd15226225f14bdcc\": container with ID starting with d233949bdf7359c79d229e452e836cad9ff0f1f8c4f25dfdd15226225f14bdcc not found: ID does not exist" containerID="d233949bdf7359c79d229e452e836cad9ff0f1f8c4f25dfdd15226225f14bdcc"
Jun 08 12:23:06.718874 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:06.718830    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d233949bdf7359c79d229e452e836cad9ff0f1f8c4f25dfdd15226225f14bdcc"} err="failed to get container status \"d233949bdf7359c79d229e452e836cad9ff0f1f8c4f25dfdd15226225f14bdcc\": rpc error: code = NotFound desc = could not find container \"d233949bdf7359c79d229e452e836cad9ff0f1f8c4f25dfdd15226225f14bdcc\": container with ID starting with d233949bdf7359c79d229e452e836cad9ff0f1f8c4f25dfdd15226225f14bdcc not found: ID does not exist"
Jun 08 12:23:06.718874 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:06.718848    2583 scope.go:117] "RemoveContainer" containerID="a2b767934f7ab4723da21c75b0164659cf95d6ca4114812d8272bcc62308c2ea"
Jun 08 12:23:06.719042 ip-10-0-136-189 kubenswrapper[2583]: E0608 12:23:06.719026    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2b767934f7ab4723da21c75b0164659cf95d6ca4114812d8272bcc62308c2ea\": container with ID starting with a2b767934f7ab4723da21c75b0164659cf95d6ca4114812d8272bcc62308c2ea not found: ID does not exist" containerID="a2b767934f7ab4723da21c75b0164659cf95d6ca4114812d8272bcc62308c2ea"
Jun 08 12:23:06.719135 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:06.719105    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2b767934f7ab4723da21c75b0164659cf95d6ca4114812d8272bcc62308c2ea"} err="failed to get container status \"a2b767934f7ab4723da21c75b0164659cf95d6ca4114812d8272bcc62308c2ea\": rpc error: code = NotFound desc = could not find container \"a2b767934f7ab4723da21c75b0164659cf95d6ca4114812d8272bcc62308c2ea\": container with ID starting with a2b767934f7ab4723da21c75b0164659cf95d6ca4114812d8272bcc62308c2ea not found: ID does not exist"
Jun 08 12:23:07.185953 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:07.185920    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e57053c6-9fca-496c-9ce7-b65649196beb" path="/var/lib/kubelet/pods/e57053c6-9fca-496c-9ce7-b65649196beb/volumes"
Jun 08 12:23:07.953782 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:07.953718    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a7dd2ec1-d2c0-43fb-aa0f-16186d21689d/alertmanager/0.log"
Jun 08 12:23:07.984719 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:07.984698    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a7dd2ec1-d2c0-43fb-aa0f-16186d21689d/config-reloader/0.log"
Jun 08 12:23:08.018498 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:08.018481    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a7dd2ec1-d2c0-43fb-aa0f-16186d21689d/kube-rbac-proxy-web/0.log"
Jun 08 12:23:08.059678 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:08.059658    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a7dd2ec1-d2c0-43fb-aa0f-16186d21689d/kube-rbac-proxy/0.log"
Jun 08 12:23:08.096267 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:08.096245    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a7dd2ec1-d2c0-43fb-aa0f-16186d21689d/kube-rbac-proxy-metric/0.log"
Jun 08 12:23:08.134166 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:08.134148    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a7dd2ec1-d2c0-43fb-aa0f-16186d21689d/prom-label-proxy/0.log"
Jun 08 12:23:08.161027 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:08.161009    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a7dd2ec1-d2c0-43fb-aa0f-16186d21689d/init-config-reloader/0.log"
Jun 08 12:23:08.391264 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:08.391246    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6685959c65-lh79s_3551e56b-be4b-4455-b0bc-20b38830c9c8/metrics-server/0.log"
Jun 08 12:23:08.690945 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:08.690872    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mtxvm_d889c0cd-6ab9-4989-823e-b6f30b645fbb/node-exporter/0.log"
Jun 08 12:23:08.714946 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:08.714924    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mtxvm_d889c0cd-6ab9-4989-823e-b6f30b645fbb/kube-rbac-proxy/0.log"
Jun 08 12:23:08.736010 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:08.735987    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mtxvm_d889c0cd-6ab9-4989-823e-b6f30b645fbb/init-textfile/0.log"
Jun 08 12:23:09.068355 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:09.068297    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-zxc2w_14f03648-781e-458c-8f1d-f4898e83e0a4/prometheus-operator/0.log"
Jun 08 12:23:09.096927 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:09.096906    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-zxc2w_14f03648-781e-458c-8f1d-f4898e83e0a4/kube-rbac-proxy/0.log"
Jun 08 12:23:09.169347 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:09.169328    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5dc4cd8bbc-k9qbn_be7626e5-4c6f-4c17-b00d-c5a0db40cb11/telemeter-client/0.log"
Jun 08 12:23:09.204191 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:09.204172    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5dc4cd8bbc-k9qbn_be7626e5-4c6f-4c17-b00d-c5a0db40cb11/reload/0.log"
Jun 08 12:23:09.236043 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:09.236025    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5dc4cd8bbc-k9qbn_be7626e5-4c6f-4c17-b00d-c5a0db40cb11/kube-rbac-proxy/0.log"
Jun 08 12:23:11.044563 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:11.044533    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mnnbj_cdf82c13-c30a-474a-a135-3d1dbcbb6046/console-operator/2.log"
Jun 08 12:23:11.048353 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:11.048334    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mnnbj_cdf82c13-c30a-474a-a135-3d1dbcbb6046/console-operator/3.log"
Jun 08 12:23:11.284941 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:11.284915    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-nxbcb/perf-node-gather-daemonset-sw8bn"]
Jun 08 12:23:11.285267 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:11.285250    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e57053c6-9fca-496c-9ce7-b65649196beb" containerName="copy"
Jun 08 12:23:11.285346 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:11.285270    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e57053c6-9fca-496c-9ce7-b65649196beb" containerName="copy"
Jun 08 12:23:11.285346 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:11.285291    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e57053c6-9fca-496c-9ce7-b65649196beb" containerName="gather"
Jun 08 12:23:11.285346 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:11.285300    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e57053c6-9fca-496c-9ce7-b65649196beb" containerName="gather"
Jun 08 12:23:11.285501 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:11.285385    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="e57053c6-9fca-496c-9ce7-b65649196beb" containerName="copy"
Jun 08 12:23:11.285501 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:11.285397    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="e57053c6-9fca-496c-9ce7-b65649196beb" containerName="gather"
Jun 08 12:23:11.290034 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:11.290014    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nxbcb/perf-node-gather-daemonset-sw8bn"
Jun 08 12:23:11.292219 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:11.292200    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nxbcb\"/\"kube-root-ca.crt\""
Jun 08 12:23:11.293083 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:11.293063    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-nxbcb\"/\"default-dockercfg-dsq6p\""
Jun 08 12:23:11.293153 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:11.293109    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nxbcb\"/\"openshift-service-ca.crt\""
Jun 08 12:23:11.301309 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:11.301288    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nxbcb/perf-node-gather-daemonset-sw8bn"]
Jun 08 12:23:11.369094 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:11.369066    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cfb5ebcf-229f-4e79-886f-96aa4063a195-podres\") pod \"perf-node-gather-daemonset-sw8bn\" (UID: \"cfb5ebcf-229f-4e79-886f-96aa4063a195\") " pod="openshift-must-gather-nxbcb/perf-node-gather-daemonset-sw8bn"
Jun 08 12:23:11.369213 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:11.369136    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cfb5ebcf-229f-4e79-886f-96aa4063a195-lib-modules\") pod \"perf-node-gather-daemonset-sw8bn\" (UID: \"cfb5ebcf-229f-4e79-886f-96aa4063a195\") " pod="openshift-must-gather-nxbcb/perf-node-gather-daemonset-sw8bn"
Jun 08 12:23:11.369213 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:11.369173    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cfb5ebcf-229f-4e79-886f-96aa4063a195-sys\") pod \"perf-node-gather-daemonset-sw8bn\" (UID: \"cfb5ebcf-229f-4e79-886f-96aa4063a195\") " pod="openshift-must-gather-nxbcb/perf-node-gather-daemonset-sw8bn"
Jun 08 12:23:11.369314 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:11.369245    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49bz8\" (UniqueName: \"kubernetes.io/projected/cfb5ebcf-229f-4e79-886f-96aa4063a195-kube-api-access-49bz8\") pod \"perf-node-gather-daemonset-sw8bn\" (UID: \"cfb5ebcf-229f-4e79-886f-96aa4063a195\") " pod="openshift-must-gather-nxbcb/perf-node-gather-daemonset-sw8bn"
Jun 08 12:23:11.369314 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:11.369279    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cfb5ebcf-229f-4e79-886f-96aa4063a195-proc\") pod \"perf-node-gather-daemonset-sw8bn\" (UID: \"cfb5ebcf-229f-4e79-886f-96aa4063a195\") " pod="openshift-must-gather-nxbcb/perf-node-gather-daemonset-sw8bn"
Jun 08 12:23:11.470502 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:11.470480    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cfb5ebcf-229f-4e79-886f-96aa4063a195-lib-modules\") pod \"perf-node-gather-daemonset-sw8bn\" (UID: \"cfb5ebcf-229f-4e79-886f-96aa4063a195\") " pod="openshift-must-gather-nxbcb/perf-node-gather-daemonset-sw8bn"
Jun 08 12:23:11.470632 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:11.470510    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cfb5ebcf-229f-4e79-886f-96aa4063a195-sys\") pod \"perf-node-gather-daemonset-sw8bn\" (UID: \"cfb5ebcf-229f-4e79-886f-96aa4063a195\") " pod="openshift-must-gather-nxbcb/perf-node-gather-daemonset-sw8bn"
Jun 08 12:23:11.470632 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:11.470540    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49bz8\" (UniqueName: \"kubernetes.io/projected/cfb5ebcf-229f-4e79-886f-96aa4063a195-kube-api-access-49bz8\") pod \"perf-node-gather-daemonset-sw8bn\" (UID: \"cfb5ebcf-229f-4e79-886f-96aa4063a195\") " pod="openshift-must-gather-nxbcb/perf-node-gather-daemonset-sw8bn"
Jun 08 12:23:11.470632 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:11.470556    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cfb5ebcf-229f-4e79-886f-96aa4063a195-proc\") pod \"perf-node-gather-daemonset-sw8bn\" (UID: \"cfb5ebcf-229f-4e79-886f-96aa4063a195\") " pod="openshift-must-gather-nxbcb/perf-node-gather-daemonset-sw8bn"
Jun 08 12:23:11.470632 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:11.470600    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cfb5ebcf-229f-4e79-886f-96aa4063a195-sys\") pod \"perf-node-gather-daemonset-sw8bn\" (UID: \"cfb5ebcf-229f-4e79-886f-96aa4063a195\") " pod="openshift-must-gather-nxbcb/perf-node-gather-daemonset-sw8bn"
Jun 08 12:23:11.470632 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:11.470612    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cfb5ebcf-229f-4e79-886f-96aa4063a195-proc\") pod \"perf-node-gather-daemonset-sw8bn\" (UID: \"cfb5ebcf-229f-4e79-886f-96aa4063a195\") " pod="openshift-must-gather-nxbcb/perf-node-gather-daemonset-sw8bn"
Jun 08 12:23:11.470912 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:11.470639    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cfb5ebcf-229f-4e79-886f-96aa4063a195-lib-modules\") pod \"perf-node-gather-daemonset-sw8bn\" (UID: \"cfb5ebcf-229f-4e79-886f-96aa4063a195\") " pod="openshift-must-gather-nxbcb/perf-node-gather-daemonset-sw8bn"
Jun 08 12:23:11.470912 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:11.470656    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cfb5ebcf-229f-4e79-886f-96aa4063a195-podres\") pod \"perf-node-gather-daemonset-sw8bn\" (UID: \"cfb5ebcf-229f-4e79-886f-96aa4063a195\") " pod="openshift-must-gather-nxbcb/perf-node-gather-daemonset-sw8bn"
Jun 08 12:23:11.470912 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:11.470788    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cfb5ebcf-229f-4e79-886f-96aa4063a195-podres\") pod \"perf-node-gather-daemonset-sw8bn\" (UID: \"cfb5ebcf-229f-4e79-886f-96aa4063a195\") " pod="openshift-must-gather-nxbcb/perf-node-gather-daemonset-sw8bn"
Jun 08 12:23:11.479224 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:11.479203    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49bz8\" (UniqueName: \"kubernetes.io/projected/cfb5ebcf-229f-4e79-886f-96aa4063a195-kube-api-access-49bz8\") pod \"perf-node-gather-daemonset-sw8bn\" (UID: \"cfb5ebcf-229f-4e79-886f-96aa4063a195\") " pod="openshift-must-gather-nxbcb/perf-node-gather-daemonset-sw8bn"
Jun 08 12:23:11.484973 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:11.484952    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7bcf5c7bb5-29rdw_e9bf4ba0-a132-4b07-8a41-de89849a05db/console/0.log"
Jun 08 12:23:11.599992 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:11.599975    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nxbcb/perf-node-gather-daemonset-sw8bn"
Jun 08 12:23:11.726274 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:11.726244    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nxbcb/perf-node-gather-daemonset-sw8bn"]
Jun 08 12:23:11.729725 ip-10-0-136-189 kubenswrapper[2583]: W0608 12:23:11.729701    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podcfb5ebcf_229f_4e79_886f_96aa4063a195.slice/crio-4aa3eaddc62066f0ba988829a4e75fbb564990ed904671430a003135904d2ce1 WatchSource:0}: Error finding container 4aa3eaddc62066f0ba988829a4e75fbb564990ed904671430a003135904d2ce1: Status 404 returned error can't find the container with id 4aa3eaddc62066f0ba988829a4e75fbb564990ed904671430a003135904d2ce1
Jun 08 12:23:12.725230 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:12.725196    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nxbcb/perf-node-gather-daemonset-sw8bn" event={"ID":"cfb5ebcf-229f-4e79-886f-96aa4063a195","Type":"ContainerStarted","Data":"633f7f09e2ea3fb6d8c26d4593950d33ee68b1f4adfae39e8358dbd99803d796"}
Jun 08 12:23:12.725644 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:12.725245    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nxbcb/perf-node-gather-daemonset-sw8bn" event={"ID":"cfb5ebcf-229f-4e79-886f-96aa4063a195","Type":"ContainerStarted","Data":"4aa3eaddc62066f0ba988829a4e75fbb564990ed904671430a003135904d2ce1"}
Jun 08 12:23:12.725644 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:12.725303    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-nxbcb/perf-node-gather-daemonset-sw8bn"
Jun 08 12:23:12.742544 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:12.742505    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-nxbcb/perf-node-gather-daemonset-sw8bn" podStartSLOduration=1.7424926520000001 podStartE2EDuration="1.742492652s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:23:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:23:12.742004405 +0000 UTC m=+2114.013579582" watchObservedRunningTime="2026-06-08 12:23:12.742492652 +0000 UTC m=+2114.014067827"
Jun 08 12:23:12.821197 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:12.821177    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5nvrq_5853cb11-e926-49de-a93b-7b64dc90d574/dns/0.log"
Jun 08 12:23:12.842542 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:12.842521    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5nvrq_5853cb11-e926-49de-a93b-7b64dc90d574/kube-rbac-proxy/0.log"
Jun 08 12:23:13.014030 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:13.013975    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dmbw7_f7cbbb77-d234-4a11-811c-26a8a21019df/dns-node-resolver/0.log"
Jun 08 12:23:13.426340 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:13.421720    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ps66l_42241258-7f82-4c8b-9862-4a32ddfcf5f2/node-ca/0.log"
Jun 08 12:23:14.114801 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:14.114770    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7fb545c65c-8k4dn_264c6dd1-c7ac-402c-af66-abda335100e1/router/0.log"
Jun 08 12:23:14.475661 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:14.475582    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-j82tx_97cb5e19-342d-49be-ad3a-346a649f83af/serve-healthcheck-canary/0.log"
Jun 08 12:23:14.852104 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:14.852073    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-7rkd5_3214fd2f-d623-436b-b69a-579cf961f902/insights-operator/0.log"
Jun 08 12:23:14.852275 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:14.852109    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-7rkd5_3214fd2f-d623-436b-b69a-579cf961f902/insights-operator/1.log"
Jun 08 12:23:15.018369 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:15.018345    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-st8rr_54a30869-0529-4e42-a111-f178894d4e91/kube-rbac-proxy/0.log"
Jun 08 12:23:15.039127 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:15.039106    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-st8rr_54a30869-0529-4e42-a111-f178894d4e91/exporter/0.log"
Jun 08 12:23:15.063756 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:15.063738    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-st8rr_54a30869-0529-4e42-a111-f178894d4e91/extractor/0.log"
Jun 08 12:23:18.737932 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:18.737907    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-nxbcb/perf-node-gather-daemonset-sw8bn"
Jun 08 12:23:19.534281 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:19.534247    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-xbsg8_17db10cc-af45-4ddc-9415-de45156683a9/migrator/0.log"
Jun 08 12:23:19.559177 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:19.559154    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-xbsg8_17db10cc-af45-4ddc-9415-de45156683a9/graceful-termination/0.log"
Jun 08 12:23:21.005082 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:21.005034    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bzgvn_40910c2e-803d-4cf1-9451-917a8d88f182/kube-multus-additional-cni-plugins/0.log"
Jun 08 12:23:21.033109 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:21.033087    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bzgvn_40910c2e-803d-4cf1-9451-917a8d88f182/egress-router-binary-copy/0.log"
Jun 08 12:23:21.056384 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:21.056325    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bzgvn_40910c2e-803d-4cf1-9451-917a8d88f182/cni-plugins/0.log"
Jun 08 12:23:21.080395 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:21.080377    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bzgvn_40910c2e-803d-4cf1-9451-917a8d88f182/bond-cni-plugin/0.log"
Jun 08 12:23:21.102980 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:21.102962    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bzgvn_40910c2e-803d-4cf1-9451-917a8d88f182/routeoverride-cni/0.log"
Jun 08 12:23:21.126040 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:21.126020    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bzgvn_40910c2e-803d-4cf1-9451-917a8d88f182/whereabouts-cni-bincopy/0.log"
Jun 08 12:23:21.146707 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:21.146664    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bzgvn_40910c2e-803d-4cf1-9451-917a8d88f182/whereabouts-cni/0.log"
Jun 08 12:23:21.523143 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:21.523120    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-f4gdp_fe7bc26d-99a1-4168-996f-f3322e778ed5/kube-multus/0.log"
Jun 08 12:23:21.660487 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:21.660461    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6m4cb_0b2281a3-722f-4113-b3e1-7f4b4614f599/network-metrics-daemon/0.log"
Jun 08 12:23:21.685634 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:21.685612    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6m4cb_0b2281a3-722f-4113-b3e1-7f4b4614f599/kube-rbac-proxy/0.log"
Jun 08 12:23:22.822794 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:22.822721    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9x6v7_a447431c-750b-4ed2-b229-59acbc3534e8/ovn-controller/0.log"
Jun 08 12:23:22.843555 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:22.843531    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9x6v7_a447431c-750b-4ed2-b229-59acbc3534e8/ovn-acl-logging/0.log"
Jun 08 12:23:22.869364 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:22.869343    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9x6v7_a447431c-750b-4ed2-b229-59acbc3534e8/kube-rbac-proxy-node/0.log"
Jun 08 12:23:22.896804 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:22.896779    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9x6v7_a447431c-750b-4ed2-b229-59acbc3534e8/kube-rbac-proxy-ovn-metrics/0.log"
Jun 08 12:23:22.914843 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:22.914821    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9x6v7_a447431c-750b-4ed2-b229-59acbc3534e8/northd/0.log"
Jun 08 12:23:22.940877 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:22.940857    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9x6v7_a447431c-750b-4ed2-b229-59acbc3534e8/nbdb/0.log"
Jun 08 12:23:22.965400 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:22.965380    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9x6v7_a447431c-750b-4ed2-b229-59acbc3534e8/sbdb/0.log"
Jun 08 12:23:23.013450 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:23.013428    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9x6v7_a447431c-750b-4ed2-b229-59acbc3534e8/ovnkube-controller/0.log"
Jun 08 12:23:24.166442 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:24.166413    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-dbd9cf844-wrn8q_563dc1f2-5754-45d6-8b8e-02aab0908ef8/check-endpoints/0.log"
Jun 08 12:23:24.286873 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:24.286839    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-rx5rz_3b153dca-66ed-4681-b70b-6061158f6676/network-check-target-container/0.log"
Jun 08 12:23:25.310952 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:25.310927    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-dplqn_4866962b-3c74-43c5-a2eb-fa8209ebeba3/iptables-alerter/0.log"
Jun 08 12:23:26.141916 ip-10-0-136-189 kubenswrapper[2583]: I0608 12:23:26.141887    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-pm229_ad420f23-b7b2-45a6-ad9a-118f28203f03/tuned/0.log"